From llvm-testresults at cs.uiuc.edu Sat Sep 1 03:28:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 05:28:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901102847.2C64D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3341?compare_to=3340&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3341, Order: 163057, Start Time: 2012-09-01 09:18:32, End Time: 2012-09-01 10:29:52 To: 3340, Order: 163049, Start Time: 2012-09-01 04:36:30, End Time: 2012-09-01 05:48:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (42 on baseline) Performance Improvements: 4 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (815 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.43% (0.1915 => 0.2019, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 50.49% (0.0206 => 0.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.68% (3.2034 => 3.6416, std. dev.: 0.0982) SingleSource/Benchmarks/Shootout/heapsort: 9.73% (3.0438 => 3.3400, std. dev.: 0.0906) SingleSource/Benchmarks/Stanford/Puzzle: 6.56% (0.1525 => 0.1625, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.77% (2.8553 => 2.9058, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.66% (0.2191 => 0.2089, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.64% (1.4298 => 1.4064, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.43% (61.5992 => 60.0997, std. dev.: 0.3399) SingleSource/Benchmarks/Misc/richards_benchmark: -1.00% (1.3577 => 1.3441, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 3.28% (1.0046 => 1.0376, std. dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 2.75% (2.1763 => 2.2362, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.5150 => 1.5563, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (12.6413 => 12.9326, std. dev.: 0.0304) MultiSource/Applications/minisat/minisat: 2.28% (0.6173 => 0.6314, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.22% (1.3935 => 1.4105, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 14.79% (1.7426 => 2.0003, std. dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5630, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 13.40% (0.1433 => 0.1625, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 13.24% (0.4296 => 0.4865, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: 12.68% (3.4406 => 3.8769, std. dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.65% (3.0256 => 3.3780, std. dev.: 0.0621) MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (62.4126 => 69.0862, std. dev.: 0.1601) SingleSource/Benchmarks/Shootout/lists: 8.36% (7.0025 => 7.5877, std. dev.: 0.0349) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.20% (1.0063 => 1.0888, std. dev.: 0.0144) SingleSource/Benchmarks/McGill/chomp: 8.03% (1.0194 => 1.1013, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout/methcall: 6.74% (8.5566 => 9.1333, std. dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.4876 => 3.7181, std. dev.: 0.0429) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7357, std. dev.: 0.1404) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.14% (4.2129 => 4.4293, std. dev.: 0.0662) SingleSource/Benchmarks/Misc/fp-convert: 4.61% (15.2242 => 15.9259, std. dev.: 0.0243) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (0.3301 => 0.3437, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 4.02% (0.9851 => 1.0247, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.76% (2.6656 => 2.7657, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.06% (6.6312 => 6.8344, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.05% (0.3508 => 0.3615, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 2.66% (8.5113 => 8.7379, std. dev.: 0.0674) SingleSource/Benchmarks/Shootout-C++/hash: 1.82% (0.6308 => 0.6423, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.6459 => 0.6573, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.62% (2.3453 => 2.3833, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.60% (2.8599 => 2.9058, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.53% (4.6127 => 4.6833, std. dev.: 0.0189) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5327, std. dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 1.37% (6.7458 => 6.8380, std. dev.: 0.0107) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.34% (4.0659 => 4.1204, std. dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6754, std. dev.: 0.0390) MultiSource/Benchmarks/Olden/power/power: 1.13% (1.4184 => 1.4344, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6922, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.72% (0.3497 => 0.2073, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.72% (5.2665 => 4.2279, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9903, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1619, std. dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9373, std. dev.: 0.0304) SingleSource/Benchmarks/Misc/richards_benchmark: -6.92% (1.4441 => 1.3441, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: -6.13% (1.6538 => 1.5524, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/methcall: -5.91% (9.2503 => 8.7035, std. dev.: 0.1866) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (4.6355 => 4.4029, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.02% (3.9413 => 3.7436, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.18% (2.4457 => 2.3435, std. dev.: 0.0389) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.74% (0.4140 => 0.3985, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -3.05% (7.6833 => 7.4486, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.04% (1.7361 => 1.6834, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1353, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2891, std. dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.52% (3.7496 => 3.6551, std. dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: -2.41% (92.7467 => 90.5131, std. dev.: 0.4282) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.32% (2.8964 => 2.8291, std. dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.76% (61.1734 => 60.0997, std. dev.: 0.3399) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2251, std. dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.3569 => 2.3228, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std. dev.: 0.0192) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3178, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.14% (2.5669 => 2.5376, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.07% (3.6388 => 3.6000, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -1.01% (1.7330 => 1.7155, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 06:41:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 08:41:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901134151.5C9872A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3342?compare_to=3341&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3342, Order: 163058, Start Time: 2012-09-01 12:31:04, End Time: 2012-09-01 13:42:57 To: 3341, Order: 163057, Start Time: 2012-09-01 09:18:32, End Time: 2012-09-01 10:29:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (42 on baseline) Performance Improvements: 3 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (813 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.67% (0.4351 => 0.4554, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.7020 => 0.7241, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.7512 => 0.7694, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.8720 => 0.8893, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8020 => 3.8744, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 1.27% (0.9320 => 0.9438, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.12% (4.2661 => 4.3137, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (2.5221 => 2.5738, std. dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/spiff/spiff: -2.19% (2.9058 => 2.8422, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/lpbench: -1.64% (4.2279 => 4.1584, std. dev.: 0.0119) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.59% (1.2490 => 1.2292, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.1653 => 1.2057, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 3.40% (2.1763 => 2.2504, std. dev.: 0.0139) MultiSource/Applications/lemon/lemon: 3.21% (1.0046 => 1.0368, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.5150 => 1.5592, std. dev.: 0.0107) MultiSource/Applications/minisat/minisat: 1.99% (0.6173 => 0.6296, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.70% (3.0225 => 3.0738, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 1.57% (29.3170 => 29.7761, std. dev.: 0.0384) MultiSource/Applications/Burg/burg: 1.45% (1.1440 => 1.1606, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 1.30% (2.0972 => 2.1245, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.18% (1.3935 => 1.4099, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 14.77% (1.7426 => 1.9999, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/misr: 13.94% (0.4296 => 0.4895, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.75% (4.0101 => 4.5613, std. dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 12.81% (0.3746 => 0.4226, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 12.79% (3.4406 => 3.8806, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (62.4126 => 69.1197, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0056) SingleSource/Benchmarks/Stanford/Puzzle: 9.00% (0.1433 => 0.1562, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6075, std. dev.: 0.0227) SingleSource/Benchmarks/McGill/chomp: 7.71% (1.0194 => 1.0980, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/methcall: 7.68% (8.5566 => 9.2139, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.4876 => 3.7206, std. dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.84% (27.1724 => 28.7591, std. dev.: 0.0535) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.22% (0.8498 => 0.8857, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8522, std. dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (4.2129 => 4.3625, std. dev.: 0.0392) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.5587 => 0.5778, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.33% (2.6656 => 2.7543, std. dev.: 0.0321) SingleSource/Benchmarks/Misc/ReedSolomon: 3.27% (8.5113 => 8.7900, std. dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (6.6312 => 6.8374, std. dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 2.53% (5.1938 => 5.3251, std. dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.6308 => 0.6465, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5338, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.47% (2.9152 => 2.9580, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6657, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 1.14% (6.7458 => 6.8228, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (4.6414 => 4.6913, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.6254 => 3.6634, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.51% (0.9029 => 0.8893, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: -1.45% (0.7738 => 0.7626, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.24% (4.2815 => 4.2282, std. dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.02% (1.2742 => 1.2612, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.04% (5.2665 => 4.1584, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.02% (1.1647 => 0.9898, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.67% (3.2007 => 2.9552, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.4441 => 1.3427, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5512, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -5.54% (9.2503 => 8.7378, std. dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.95% (3.9413 => 3.7463, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4074, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -3.52% (8.5323 => 8.2316, std. dev.: 0.0787) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.38% (1.2722 => 1.2292, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.30% (1.7361 => 1.6788, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.05% (2.4457 => 2.3712, std. dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: -2.91% (7.6833 => 7.4597, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.70% (1.1683 => 1.1367, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: -2.56% (9.5474 => 9.3030, std. dev.: 0.0175) MultiSource/Benchmarks/PAQ8p/paq8p: -2.41% (92.7467 => 90.5092, std. dev.: 0.2850) MultiSource/Applications/siod/siod: -2.20% (3.5520 => 3.4737, std. dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.15% (3.7496 => 3.6689, std. dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -1.49% (3.4286 => 3.3776, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.48% (9.3855 => 9.2466, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3128, std. dev.: 0.0222) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7692, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 08:08:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 10:08:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901150828.EDDED2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3343?compare_to=3342&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3343, Order: 163059, Start Time: 2012-09-01 13:58:28, End Time: 2012-09-01 15:09:34 To: 3342, Order: 163058, Start Time: 2012-09-01 12:31:04, End Time: 2012-09-01 13:42:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (50 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (807 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.7800 => 0.8119, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (0.8893 => 0.9043, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 1.07% (1.8875 => 1.9077, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.3267 => 0.3485, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.39% (1.4163 => 1.4360, std. dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.43% (0.1414 => 0.1519, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (0.7722 => 0.8119, std. dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2073, std. dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 3.12% (2.1763 => 2.2442, std. dev.: 0.0218) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.5150 => 1.5531, std. dev.: 0.0078) MultiSource/Applications/minisat/minisat: 2.41% (0.6173 => 0.6322, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (1.3935 => 1.4227, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.5309 => 0.5410, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.77% (2.0972 => 2.1343, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 1.66% (3.0225 => 3.0727, std. dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: 1.50% (13.3238 => 13.5233, std. dev.: 0.0558) MultiSource/Applications/treecc/treecc: 1.48% (1.8798 => 1.9077, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.39% (1.3268 => 1.3453, std. dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 1.37% (29.3170 => 29.7173, std. dev.: 0.1113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.93% (0.0766 => 0.0911, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9987, std. dev.: 0.0146) SingleSource/Benchmarks/McGill/misr: 13.83% (0.4296 => 0.4890, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5631, std. dev.: 0.0284) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (3.4406 => 3.8800, std. dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 12.49% (0.3746 => 0.4214, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 10.68% (62.4126 => 69.0778, std. dev.: 0.0914) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6057, std. dev.: 0.0230) SingleSource/Benchmarks/McGill/chomp: 7.97% (1.0194 => 1.1006, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.48% (1.0063 => 1.0816, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/methcall: 6.83% (8.5566 => 9.1410, std. dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.4876 => 3.7222, std. dev.: 0.0189) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7382, std. dev.: 0.1291) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.38% (4.2129 => 4.4394, std. dev.: 0.0731) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.55% (40.4792 => 42.3194, std. dev.: 0.1727) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 3.96% (15.2242 => 15.8273, std. dev.: 0.0478) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.75% (0.8498 => 0.8817, std. dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.69% (3.4080 => 3.5336, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.67% (2.6656 => 2.7633, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.04% (6.6312 => 6.8329, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.1938 => 5.3008, std. dev.: 0.0278) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.6127 => 4.7045, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.86% (0.5876 => 0.5985, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 1.63% (0.6308 => 0.6411, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (2.4971 => 2.5285, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.25% (1.2726 => 1.2885, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 1.21% (14.4877 => 14.6637, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4346, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6923, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.6254 => 3.6626, std. dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.26% (0.3497 => 0.2089, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.78% (5.2665 => 4.1195, std. dev.: 0.0281) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.94% (1.1647 => 0.9907, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.84% (1.4034 => 1.2794, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.08% (3.2007 => 2.9420, std. dev.: 0.0428) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3421, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: -6.56% (9.2503 => 8.6432, std. dev.: 0.0607) SingleSource/Benchmarks/Misc/pi: -6.32% (1.6538 => 1.5492, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7460, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4077, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.30% (1.7361 => 1.6615, std. dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.03% (1.2722 => 1.2337, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -2.94% (7.6833 => 7.4571, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1354, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: -2.70% (92.7467 => 90.2459, std. dev.: 0.2148) MultiSource/Applications/siod/siod: -2.29% (3.5520 => 3.4708, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.89% (61.1734 => 60.0150, std. dev.: 0.3271) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.80% (3.7496 => 3.6822, std. dev.: 0.0257) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3696, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2251, std. dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: -1.47% (3.8200 => 3.7637, std. dev.: 0.0198) MultiSource/Benchmarks/Olden/tsp/tsp: -1.47% (1.7330 => 1.7075, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3081, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.13% (1.8739 => 1.8528, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: -1.07% (2.8599 => 2.8293, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.04% (16.5617 => 16.3900, std. dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 09:35:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 11:35:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901163516.45BE92A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3344?compare_to=3343&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3344, Order: 163062, Start Time: 2012-09-01 15:25:29, End Time: 2012-09-01 16:36:21 To: 3343, Order: 163059, Start Time: 2012-09-01 13:58:28, End Time: 2012-09-01 15:09:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 1 (46 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 887 (809 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.7190 => 8.8381, std. dev.: 0.0312) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.30% (2.5211 => 2.4380, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.17% (0.6238 => 0.6040, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.42% (0.1414 => 0.1533, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.7722 => 0.8018, std. dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 3.79% (2.1763 => 2.2588, std. dev.: 0.0085) MultiSource/Applications/lemon/lemon: 2.95% (1.0046 => 1.0342, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 2.43% (0.6173 => 0.6323, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.16% (0.7226 => 0.7382, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (12.6413 => 12.8654, std. dev.: 0.0390) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.5150 => 1.5416, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.44% (0.7639 => 0.7749, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.43% (1.3935 => 1.4134, std. dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 1.42% (15.3105 => 15.5278, std. dev.: 0.0308) MultiSource/Benchmarks/Bullet/bullet: 1.24% (29.3170 => 29.6806, std. dev.: 0.0700) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 15.12% (1.7426 => 2.0061, std. dev.: 0.0129) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.41% (4.0101 => 4.5478, std. dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8792, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.00% (0.0917 => 0.1027, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (62.4126 => 69.1476, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.76% (7.0025 => 7.6161, std. dev.: 0.0155) SingleSource/Benchmarks/Stanford/Puzzle: 7.54% (0.1433 => 0.1541, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/methcall: 7.17% (8.5566 => 9.1702, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (3.4876 => 3.7140, std. dev.: 0.0225) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.18% (1.0063 => 1.0685, std. dev.: 0.0185) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7342, std. dev.: 0.0415) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.33% (40.4792 => 42.6354, std. dev.: 0.3693) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.3301 => 0.3465, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8780, std. dev.: 0.0287) SingleSource/Benchmarks/Misc/dt: 3.97% (0.9851 => 1.0242, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.86% (0.8498 => 0.8826, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 3.84% (8.5113 => 8.8381, std. dev.: 0.0312) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.30% (2.6656 => 2.7536, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.05% (0.3508 => 0.3615, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.05% (6.6312 => 6.8334, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 2.68% (5.1938 => 5.3328, std. dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.14% (0.5876 => 0.6002, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4843, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.51% (4.6127 => 4.6822, std. dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (2.4042 => 2.4380, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5308, std. dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6698, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2080 => 0.1936, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.81% (0.3497 => 0.2105, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.14% (5.2665 => 4.1006, std. dev.: 0.0536) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9903, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9364, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.4441 => 1.3423, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: -6.21% (1.6538 => 1.5511, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (9.2503 => 8.6910, std. dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.01% (4.6355 => 4.4034, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.95% (3.9413 => 3.7461, std. dev.: 0.0213) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.90% (45.4683 => 43.6948, std. dev.: 0.5928) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.89% (1.7361 => 1.6685, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.14% (2.4457 => 2.3689, std. dev.: 0.0189) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4496, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.85% (1.1683 => 1.1350, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2858, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.59% (1.2722 => 1.2392, std. dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -2.49% (92.7467 => 90.4358, std. dev.: 0.1835) MultiSource/Applications/siod/siod: -2.31% (3.5520 => 3.4700, std. dev.: 0.0231) MultiSource/Benchmarks/FreeBench/neural/neural: -2.28% (1.0926 => 1.0677, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.26% (3.7496 => 3.6648, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.92% (1.0686 => 1.0481, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.89% (1.8739 => 1.8385, std. dev.: 0.0130) MultiSource/Applications/aha/aha: -1.68% (3.4286 => 3.3710, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2319, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/tsp/tsp: -1.53% (1.7330 => 1.7065, std. dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -1.52% (3.8907 => 3.8315, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3108, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: -1.15% (16.5617 => 16.3705, std. dev.: 0.0272) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.09% (1.1116 => 1.0995, std. dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 11:02:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 13:02:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901180202.341412A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3345?compare_to=3344&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3345, Order: 163063, Start Time: 2012-09-01 16:51:42, End Time: 2012-09-01 18:03:07 To: 3344, Order: 163062, Start Time: 2012-09-01 15:25:29, End Time: 2012-09-01 16:36:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (49 on baseline) Performance Improvements: 2 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (808 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 3.98% (0.7590 => 0.7892, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.61% (1.1563 => 1.1865, std. dev.: 0.0052) MultiSource/Applications/treecc/treecc: 1.68% (1.8850 => 1.9166, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.06% (1.2669 => 1.2803, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (2.4218 => 2.5860, std. dev.: 0.0192) MultiSource/Applications/spiff/spiff: 1.74% (2.8258 => 2.8751, std. dev.: 0.0109) MultiSource/Benchmarks/llubenchmark/llu: 1.49% (1.9977 => 2.0274, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.10% (1.6685 => 1.6868, std. dev.: 0.0068) SingleSource/Benchmarks/McGill/chomp: 1.03% (1.0877 => 1.0989, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.21% (0.7693 => 0.7369, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout/heapsort: -3.18% (3.3832 => 3.2755, std. dev.: 0.0362) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 3.72% (1.1440 => 1.1865, std. dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.1653 => 1.2053, std. dev.: 0.0104) MultiSource/Applications/lemon/lemon: 3.35% (1.0046 => 1.0383, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.61% (0.6173 => 0.6334, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.5150 => 1.5510, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 1.99% (0.7738 => 0.7892, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 1.96% (1.8798 => 1.9166, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (12.6413 => 12.8601, std. dev.: 0.0631) MultiSource/Benchmarks/Bullet/bullet: 1.68% (29.3170 => 29.8085, std. dev.: 0.1729) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.54% (0.7639 => 0.7757, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.01% (0.0263 => 0.0384, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std. dev.: 0.0285) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.49% (0.0766 => 0.0900, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 14.95% (1.7426 => 2.0032, std. dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.15% (4.0101 => 4.5777, std. dev.: 0.0203) SingleSource/Benchmarks/McGill/misr: 12.73% (0.4296 => 0.4843, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 12.72% (3.4406 => 3.8781, std. dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 10.74% (62.4126 => 69.1166, std. dev.: 0.1755) SingleSource/Benchmarks/Stanford/Puzzle: 10.19% (0.1433 => 0.1579, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.32% (0.2694 => 0.2945, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 8.73% (7.0025 => 7.6137, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.30% (1.0063 => 1.0898, std. dev.: 0.0144) SingleSource/Benchmarks/McGill/chomp: 7.80% (1.0194 => 1.0989, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/methcall: 7.57% (8.5566 => 9.2046, std. dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/hash2: 6.39% (3.4876 => 3.7103, std. dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7402, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.50% (40.4792 => 42.7043, std. dev.: 0.4858) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.3301 => 0.3473, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8510, std. dev.: 0.0281) SingleSource/Benchmarks/Misc/dt: 3.93% (0.9851 => 1.0238, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.43% (2.6656 => 2.7569, std. dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.20% (0.5876 => 0.6064, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (6.6312 => 6.8389, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.6308 => 0.6499, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.88% (0.8498 => 0.8743, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 2.86% (8.5113 => 8.7543, std. dev.: 0.0472) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.6127 => 4.7121, std. dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.14% (2.4042 => 2.4556, std. dev.: 0.0175) MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.1938 => 5.3027, std. dev.: 0.0385) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4833, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.32% (1.6110 => 1.6323, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6696, std. dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 1.21% (6.7458 => 6.8277, std. dev.: 0.0205) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.17% (4.0659 => 4.1134, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6932, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.12% (0.2080 => 0.1911, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.63% (0.3497 => 0.2111, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.90% (5.2665 => 4.1131, std. dev.: 0.0553) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.02% (1.1647 => 0.9898, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1649, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.00% (3.6023 => 3.2060, std. dev.: 0.1385) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9453, std. dev.: 0.0800) SingleSource/Benchmarks/Misc/richards_benchmark: -6.92% (1.4441 => 1.3442, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/pi: -6.22% (1.6538 => 1.5509, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7965, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -5.89% (9.2503 => 8.7054, std. dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.95% (3.9413 => 3.7463, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std. dev.: 0.0291) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.60% (2.4457 => 2.3331, std. dev.: 0.0308) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2322, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -2.94% (7.6833 => 7.4571, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.87% (1.1683 => 1.1348, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.84% (1.7361 => 1.6868, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2876, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -2.43% (92.7467 => 90.4932, std. dev.: 0.5060) MultiSource/Applications/aha/aha: -1.63% (3.4286 => 3.3728, std. dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.62% (3.7496 => 3.6890, std. dev.: 0.0140) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2348, std. dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.49% (3.8907 => 3.8327, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3112, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7677, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -1.01% (1.7330 => 1.7155, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 12:29:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 14:29:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901192909.B48E22A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3346?compare_to=3345&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3346, Order: 163069, Start Time: 2012-09-01 18:18:51, End Time: 2012-09-01 19:30:14 To: 3345, Order: 163063, Start Time: 2012-09-01 16:51:42, End Time: 2012-09-01 18:03:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (36 on baseline) Performance Improvements: 5 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (819 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.23% (0.1911 => 0.2011, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.2945 => 0.3045, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.4070 => 1.4232, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.07% (22.2475 => 24.4874, std. dev.: 0.3677) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.18% (2.3331 => 2.3607, std. dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.40% (0.7892 => 0.7624, std. dev.: 0.0084) MultiSource/Applications/Burg/burg: -2.39% (1.1865 => 1.1582, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -1.63% (0.6499 => 0.6393, std. dev.: 0.0025) MultiSource/Benchmarks/llubenchmark/llu: -1.33% (2.0274 => 2.0005, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.24% (3.6890 => 3.6431, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (2.1763 => 2.2408, std. dev.: 0.0238) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (1.5150 => 1.5556, std. dev.: 0.0156) MultiSource/Applications/Burg/burg: 1.24% (1.1440 => 1.1582, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0396) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 15.66% (21.1721 => 24.4874, std. dev.: 0.3677) SingleSource/Benchmarks/Shootout/ary3: 15.18% (1.7426 => 2.0072, std. dev.: 0.0266) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.25% (4.0101 => 4.5816, std. dev.: 0.0755) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.18% (0.0917 => 0.1047, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: 13.94% (0.4296 => 0.4895, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0075) SingleSource/Benchmarks/Stanford/Puzzle: 11.93% (0.1433 => 0.1604, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (62.4126 => 69.1065, std. dev.: 0.0197) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.60% (7.0025 => 7.6050, std. dev.: 0.0333) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.22% (1.0063 => 1.0890, std. dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: 7.29% (1.0194 => 1.0937, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (3.4876 => 3.7299, std. dev.: 0.0338) SingleSource/Benchmarks/Shootout/methcall: 6.81% (8.5566 => 9.1392, std. dev.: 0.0368) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7336, std. dev.: 0.0826) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.3301 => 0.3473, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/dt: 4.45% (0.9851 => 1.0289, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.26% (15.2242 => 15.8722, std. dev.: 0.0390) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.48% (0.8498 => 0.8794, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.19% (2.6656 => 2.7505, std. dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8351, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.58% (8.5113 => 8.7306, std. dev.: 0.0481) MultiSource/Benchmarks/BitBench/five11/five11: 2.27% (5.1938 => 5.3117, std. dev.: 0.0300) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.08% (0.5876 => 0.5998, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (2.4971 => 2.5294, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6717, std. dev.: 0.0344) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6932, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.01% (3.6254 => 3.6619, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.27% (5.2665 => 4.0936, std. dev.: 0.1574) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.98% (1.1647 => 0.9902, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std. dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.02% (3.2007 => 2.9440, std. dev.: 0.0278) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.4441 => 1.3424, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: -6.90% (0.1479 => 0.1377, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -6.59% (9.2503 => 8.6409, std. dev.: 0.0937) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5499, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4090, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.48% (2.4457 => 2.3607, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.09% (1.1683 => 1.1322, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -3.01% (7.6833 => 7.4520, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.84% (3.7496 => 3.6431, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -2.38% (92.7467 => 90.5353, std. dev.: 0.3980) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.18% (2.8964 => 2.8332, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.07% (1.7361 => 1.7002, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.04% (2.5984 => 2.5454, std. dev.: 0.0182) MultiSource/Benchmarks/FreeBench/neural/neural: -2.00% (1.0926 => 1.0708, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2256, std. dev.: 0.0187) MultiSource/Applications/aha/aha: -1.68% (3.4286 => 3.3711, std. dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -1.54% (3.5520 => 3.4972, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.49% (3.8907 => 3.8327, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3096, std. dev.: 0.0697) MultiSource/Benchmarks/Olden/tsp/tsp: -1.38% (1.7330 => 1.7091, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7682, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.13% (1.1116 => 1.0990, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -1.13% (16.5617 => 16.3741, std. dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 13:55:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 15:55:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901205531.E15BC2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3347?compare_to=3346&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3347, Order: 163073, Start Time: 2012-09-01 19:45:54, End Time: 2012-09-01 20:56:37 To: 3346, Order: 163069, Start Time: 2012-09-01 18:18:51, End Time: 2012-09-01 19:30:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (44 on baseline) Performance Improvements: 1 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (814 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.96% (0.4454 => 0.4675, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.70% (1.2423 => 1.2758, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 2.43% (1.3133 => 1.3452, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5638 => 0.5746, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.54% (1.1851 => 1.2034, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.09% (3.5608 => 3.5996, std. dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 7.45% (3.6110 => 3.8802, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (4.3145 => 4.4592, std. dev.: 0.0283) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.6467 => 4.7135, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.35% (1.7002 => 1.6773, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3.34% (1.1653 => 1.2042, std. dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 3.07% (2.1763 => 2.2431, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 2.82% (1.0046 => 1.0329, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (12.6413 => 12.9442, std. dev.: 0.0788) MultiSource/Applications/minisat/minisat: 2.37% (0.6173 => 0.6319, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 2.35% (1.1440 => 1.1709, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.95% (0.5636 => 0.5746, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.1827 => 1.2034, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.67% (1.5150 => 1.5403, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.48% (0.7639 => 0.7752, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.39% (1.3268 => 1.3452, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (1.3935 => 1.4120, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 1.29% (29.3170 => 29.6963, std. dev.: 0.0842) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.37% (0.0766 => 0.0945, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: 13.97% (0.4296 => 0.4896, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.60% (4.0101 => 4.5556, std. dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 12.87% (0.3746 => 0.4228, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8802, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1299, std. dev.: 0.1485) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.66% (7.0025 => 7.6087, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.94% (1.0063 => 1.0862, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout/methcall: 6.80% (8.5566 => 9.1381, std. dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash2: 6.53% (3.4876 => 3.7152, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.85% (4.2129 => 4.4592, std. dev.: 0.0283) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (27.1724 => 28.7319, std. dev.: 0.0876) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.01% (15.2242 => 15.8345, std. dev.: 0.0496) SingleSource/Benchmarks/Misc/dt: 3.99% (0.9851 => 1.0244, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.95% (0.8498 => 0.8834, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 3.44% (8.5113 => 8.8041, std. dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8350, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.96% (2.6656 => 2.7444, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/five11/five11: 2.35% (5.1938 => 5.3160, std. dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.19% (4.6127 => 4.7135, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/whetstone: 1.64% (2.3453 => 2.3837, std. dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5324, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6700, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.55% (0.3497 => 0.2079, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.16% (5.2665 => 4.0994, std. dev.: 0.2470) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.89% (1.1647 => 0.9913, std. dev.: 0.0289) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std. dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.05% (3.2007 => 2.9432, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: -7.29% (1.4441 => 1.3388, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.80% (9.2503 => 8.7134, std. dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7460, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.92% (1.2959 => 1.2451, std. dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.83% (45.4683 => 43.7258, std. dev.: 0.5598) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.83% (2.4457 => 2.3521, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.39% (1.7361 => 1.6773, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2309, std. dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: -3.07% (7.6833 => 7.4476, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -2.45% (92.7467 => 90.4727, std. dev.: 0.2314) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.44% (1.0686 => 1.0425, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.40% (1.1683 => 1.1403, std. dev.: 0.0023) MultiSource/Applications/siod/siod: -2.26% (3.5520 => 3.4719, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.18% (3.7496 => 3.6678, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.81% (1.8739 => 1.8400, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2284, std. dev.: 0.0086) MultiSource/Applications/aha/aha: -1.59% (3.4286 => 3.3740, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3066, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.24% (2.5669 => 2.5351, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 15:27:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 17:27:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901222707.BC7FE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3348?compare_to=3347&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3348, Order: 163074, Start Time: 2012-09-01 21:16:38, End Time: 2012-09-01 22:28:12 To: 3347, Order: 163073, Start Time: 2012-09-01 19:45:54, End Time: 2012-09-01 20:56:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (42 on baseline) Performance Improvements: 3 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (810 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.11% (2.2431 => 2.2681, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.44% (15.6234 => 17.5674, std. dev.: 0.4937) MultiSource/Benchmarks/nbench/nbench: 9.67% (21.1172 => 23.1601, std. dev.: 0.3389) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.71% (21.6529 => 22.4552, std. dev.: 0.1123) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.80% (4.0994 => 4.1731, std. dev.: 0.0237) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (5.3160 => 5.3793, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.03% (1.2309 => 1.2436, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.03% (2.7444 => 2.7727, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.44% (0.2936 => 0.2835, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: -1.91% (1.1709 => 1.1485, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.07% (39.6905 => 39.2646, std. dev.: 0.1026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.22% (2.1763 => 2.2681, std. dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.1653 => 1.2059, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 3.07% (1.0046 => 1.0354, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (12.6413 => 12.9147, std. dev.: 0.0797) MultiSource/Applications/oggenc/oggenc: 1.39% (4.7455 => 4.8114, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.1827 => 1.1972, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 14.98% (1.7426 => 2.0037, std. dev.: 0.0176) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.36% (0.0766 => 0.0876, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.90% (4.0101 => 4.5674, std. dev.: 0.0178) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8790, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 12.41% (0.3746 => 0.4211, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.97% (15.8312 => 17.5674, std. dev.: 0.4937) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1309, std. dev.: 0.0650) SingleSource/Benchmarks/Stanford/Puzzle: 10.68% (0.1433 => 0.1586, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.61% (0.2694 => 0.2953, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 9.39% (21.1721 => 23.1601, std. dev.: 0.3389) SingleSource/Benchmarks/Shootout/lists: 9.30% (7.0025 => 7.6534, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.78% (1.0063 => 1.0846, std. dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.63% (0.3301 => 0.3553, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/methcall: 7.50% (8.5566 => 9.1987, std. dev.: 0.0265) SingleSource/Benchmarks/McGill/chomp: 6.79% (1.0194 => 1.0886, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (3.4876 => 3.7127, std. dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.87% (27.1724 => 28.7664, std. dev.: 0.2294) SingleSource/Benchmarks/Misc/fp-convert: 4.45% (15.2242 => 15.9017, std. dev.: 0.0190) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.02% (2.6656 => 2.7727, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5395, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: 3.82% (0.9851 => 1.0227, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: 3.57% (5.1938 => 5.3793, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.41% (0.8498 => 0.8788, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (6.6312 => 6.8364, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.6127 => 4.7117, std. dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.10% (0.7609 => 0.7769, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4455 => 2.4838, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.42% (6.7458 => 6.8415, std. dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6757, std. dev.: 0.0201) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.01% (3.6254 => 3.6621, std. dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.82% (0.2467 => 0.2348, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.72% (0.5963 => 0.5801, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.09% (0.3497 => 0.2060, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.76% (5.2665 => 4.1731, std. dev.: 0.0237) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.50% (1.1647 => 0.9958, std. dev.: 0.0246) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std. dev.: 0.0208) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.25% (3.2007 => 2.9366, std. dev.: 0.0371) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.4441 => 1.3424, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/methcall: -6.29% (9.2503 => 8.6681, std. dev.: 0.0355) SingleSource/Benchmarks/Misc/pi: -6.19% (1.6538 => 1.5515, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: -5.93% (0.2664 => 0.2506, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -5.50% (1.7361 => 1.6406, std. dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4105, std. dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.20% (1.2959 => 1.2415, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.09% (1.4021 => 1.3448, std. dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.02% (2.4457 => 2.3474, std. dev.: 0.0269) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.4140 => 0.3987, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4553, std. dev.: 0.0303) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.60% (1.1683 => 1.1379, std. dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: -2.54% (92.7467 => 90.3894, std. dev.: 0.6016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.47% (3.7496 => 3.6571, std. dev.: 0.0084) MultiSource/Applications/siod/siod: -2.26% (3.5520 => 3.4717, std. dev.: 0.0114) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.25% (1.2722 => 1.2436, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.84% (1.8739 => 1.8395, std. dev.: 0.0132) MultiSource/Applications/aha/aha: -1.70% (3.4286 => 3.3703, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2346, std. dev.: 0.0358) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.46% (3.8907 => 3.8339, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7658, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3342, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.06% (1.1116 => 1.0998, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 17:00:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 19:00:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902000054.AF27D2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3349?compare_to=3348&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3349, Order: 163075, Start Time: 2012-09-01 22:51:13, End Time: 2012-09-02 00:01:57 To: 3348, Order: 163074, Start Time: 2012-09-01 21:16:38, End Time: 2012-09-01 22:28:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (39 on baseline) Performance Improvements: 4 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 876 (813 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.49% (0.7380 => 0.7933, std. dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.2853 => 0.3011, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.08% (0.5804 => 0.5983, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 2.98% (0.7477 => 0.7700, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5662 => 0.5820, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.4009 => 1.4245, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (4.2293 => 4.2779, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 26.41% (0.0515 => 0.0651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.70% (3.1034 => 3.5596, std. dev.: 0.0357) SingleSource/Benchmarks/Misc/ReedSolomon: 1.38% (8.7201 => 8.8404, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.66% (0.7769 => 0.7407, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.07% (4.1731 => 4.0868, std. dev.: 0.0275) MultiSource/Benchmarks/BitBench/five11/five11: -1.60% (5.3793 => 5.2935, std. dev.: 0.0128) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.19% (1.2436 => 1.2288, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.39% (1.1653 => 1.2048, std. dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 2.90% (2.1763 => 2.2394, std. dev.: 0.0239) MultiSource/Applications/lemon/lemon: 2.76% (1.0046 => 1.0323, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.5150 => 1.5473, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (1.3935 => 1.4184, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.77% (0.6173 => 0.6282, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 30.46% (0.0499 => 0.0651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9970, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: 13.99% (0.4296 => 0.4897, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.69% (4.0101 => 4.5592, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std. dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 11.93% (0.1433 => 0.1604, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 10.74% (62.4126 => 69.1168, std. dev.: 0.0160) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.51% (7.0025 => 7.5987, std. dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.77% (1.0063 => 1.0845, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 7.68% (3.4406 => 3.7050, std. dev.: 0.0833) SingleSource/Benchmarks/Shootout/methcall: 7.33% (8.5566 => 9.1842, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash2: 6.87% (3.4876 => 3.7271, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 6.71% (1.0194 => 1.0878, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (0.3301 => 0.3506, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7342, std. dev.: 0.0905) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.16% (40.4792 => 42.1648, std. dev.: 0.2652) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8516, std. dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 3.87% (8.5113 => 8.8404, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (6.6312 => 6.8385, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.03% (2.4455 => 2.4952, std. dev.: 0.0091) MultiSource/Benchmarks/BitBench/five11/five11: 1.92% (5.1938 => 5.2935, std. dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.57% (4.6127 => 4.6851, std. dev.: 0.0248) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.24% (2.9152 => 2.9513, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6652, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.46% (0.3497 => 0.2047, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.40% (5.2665 => 4.0868, std. dev.: 0.0275) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -13.79% (1.1647 => 1.0041, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.68% (1.4034 => 1.2816, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9513, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/richards_benchmark: -6.92% (1.4441 => 1.3441, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -6.57% (9.2503 => 8.6427, std. dev.: 0.0677) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5500, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/fibo: -4.99% (4.6355 => 4.4043, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.97% (3.9413 => 3.7456, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: -4.46% (1.4117 => 1.3487, std. dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.27% (0.4564 => 0.4369, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.18% (1.7361 => 1.6635, std. dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.11% (1.2959 => 1.2426, std. dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: -3.69% (8.5323 => 8.2172, std. dev.: 0.1186) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.41% (1.2722 => 1.2288, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.13% (61.1734 => 59.2587, std. dev.: 0.4716) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.06% (2.4457 => 2.3709, std. dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.03% (45.4683 => 44.0912, std. dev.: 0.2594) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1333, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4561, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.89% (3.7496 => 3.6414, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2850, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.73% (0.4140 => 0.4027, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -2.59% (92.7467 => 90.3402, std. dev.: 0.4794) MultiSource/Applications/siod/siod: -2.39% (3.5520 => 3.4670, std. dev.: 0.0173) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3627, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2278, std. dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.58% (3.8907 => 3.8292, std. dev.: 0.0183) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.47% (1.8739 => 1.8463, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.42% (2.5669 => 2.5304, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3064, std. dev.: 0.0121) MultiSource/Benchmarks/FreeBench/neural/neural: -1.39% (1.0926 => 1.0774, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.3569 => 2.3246, std. dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 5.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 18:31:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 20:31:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902013129.E6AFA2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3350?compare_to=3349&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3350, Order: 163077, Start Time: 2012-09-02 00:17:21, End Time: 2012-09-02 01:32:34 To: 3349, Order: 163075, Start Time: 2012-09-01 22:51:13, End Time: 2012-09-02 00:01:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (50 on baseline) Performance Improvements: 1 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (808 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.16% (0.7228 => 0.7384, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.70% (1.1677 => 1.1875, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 1.62% (0.6282 => 0.6384, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 1.41% (1.1465 => 1.1627, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (3.7050 => 3.8799, std. dev.: 0.0289) SingleSource/Benchmarks/McGill/chomp: 2.38% (1.0878 => 1.1137, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: 1.00% (1.6988 => 1.7158, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.34% (1.0041 => 0.9906, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.55% (1.1653 => 1.2067, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: 3.42% (0.6173 => 0.6384, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (2.1763 => 2.2489, std. dev.: 0.0260) MultiSource/Applications/lemon/lemon: 3.09% (1.0046 => 1.0356, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.26% (0.6410 => 0.6555, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.19% (0.7226 => 0.7384, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 1.91% (1.3268 => 1.3522, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.74% (1.1672 => 1.1875, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 1.64% (2.0972 => 2.1315, std. dev.: 0.0072) MultiSource/Applications/Burg/burg: 1.63% (1.1440 => 1.1627, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 1.61% (13.3238 => 13.5388, std. dev.: 0.0202) MultiSource/Applications/d/make_dparser: 1.50% (3.0225 => 3.0677, std. dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 1.39% (29.3170 => 29.7258, std. dev.: 0.0894) MultiSource/Applications/treecc/treecc: 1.04% (1.8798 => 1.8993, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.89% (0.0766 => 0.0949, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.47% (0.0917 => 0.1068, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9996, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: 14.01% (0.4296 => 0.4898, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5549, std. dev.: 0.0269) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (3.4406 => 3.8799, std. dev.: 0.0289) MultiSource/Applications/sgefa/sgefa: 12.47% (0.3746 => 0.4213, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (62.4126 => 69.1083, std. dev.: 0.0305) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 9.25% (1.0194 => 1.1137, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6012, std. dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.95% (1.0063 => 1.0863, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout/methcall: 7.49% (8.5566 => 9.1977, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.4876 => 3.7186, std. dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (27.1724 => 28.7493, std. dev.: 0.0382) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (0.3301 => 0.3478, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.51% (4.2129 => 4.4028, std. dev.: 0.0667) SingleSource/Benchmarks/Misc/fp-convert: 4.39% (15.2242 => 15.8920, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/dt: 4.03% (0.9851 => 1.0248, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 3.87% (8.5113 => 8.8408, std. dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.68% (3.4080 => 3.5335, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (6.6312 => 6.8372, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.58% (0.5587 => 0.5731, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.02% (4.6127 => 4.7057, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4833, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5317, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.30% (2.3453 => 2.3758, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6744, std. dev.: 0.0234) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (4.6414 => 4.6944, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 1.08% (2.5166 => 2.5439, std. dev.: 0.0099) MultiSource/Applications/minisat/minisat: 1.07% (6.2244 => 6.2909, std. dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.38% (0.3497 => 0.2085, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.40% (5.2665 => 4.0870, std. dev.: 0.0370) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.95% (1.1647 => 0.9906, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.82% (3.2007 => 2.9504, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -6.88% (1.4441 => 1.3447, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5513, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7925, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.60% (9.2503 => 8.7327, std. dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4054, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.29% (1.7361 => 1.6789, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -2.89% (7.6833 => 7.4611, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.89% (2.4457 => 2.3750, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2868, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.48% (1.2722 => 1.2407, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.41% (1.1683 => 1.1402, std. dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (92.7467 => 90.6203, std. dev.: 0.1560) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.26% (3.7496 => 3.6648, std. dev.: 0.0101) MultiSource/Applications/siod/siod: -1.78% (3.5520 => 3.4886, std. dev.: 0.0059) MultiSource/Applications/aha/aha: -1.75% (3.4286 => 3.3687, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.64% (1.8739 => 1.8431, std. dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.51% (9.3855 => 9.2435, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: -1.47% (3.8200 => 3.7639, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0926 => 1.0772, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3126, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -1.18% (3.8907 => 3.8447, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.03% (2.5669 => 2.5405, std. dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 20:03:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 22:03:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902030321.2AB9E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3351?compare_to=3350&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3351, Order: 163079, Start Time: 2012-09-02 01:53:14, End Time: 2012-09-02 03:04:26 To: 3350, Order: 163077, Start Time: 2012-09-02 00:17:21, End Time: 2012-09-02 01:32:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (48 on baseline) Performance Improvements: 1 (27 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (814 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 1.36% (15.4423 => 15.6524, std. dev.: 0.0191) MultiSource/Applications/lua/lua: 1.18% (3.6064 => 3.6491, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.0726 => 1.0836, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 5.96% (0.2501 => 0.2650, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.34% (0.7540 => 0.7943, std. dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.41% (2.7295 => 2.7680, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.3758 => 2.4011, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (4.3106 => 4.2663, std. dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3217 => 0.3336, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 3.45% (0.6173 => 0.6386, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.1827 => 1.2154, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.5150 => 1.5550, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.44% (0.5937 => 0.6082, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.7226 => 0.7393, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (12.6413 => 12.9245, std. dev.: 0.0540) MultiSource/Applications/kimwitu++/kc: 2.23% (15.3105 => 15.6524, std. dev.: 0.0191) MultiSource/Applications/hbd/hbd: 1.76% (1.3268 => 1.3501, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.70% (8.2559 => 8.3965, std. dev.: 0.0280) MultiSource/Applications/lua/lua: 1.42% (3.5980 => 3.6491, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.0689 => 1.0836, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9987, std. dev.: 0.0221) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 13.08% (0.4296 => 0.4858, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.08% (4.0101 => 4.5345, std. dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/sieve: 12.68% (3.4406 => 3.8768, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.12% (0.0917 => 0.1019, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (62.4126 => 69.1097, std. dev.: 0.0760) MultiSource/Applications/sgefa/sgefa: 10.49% (0.3746 => 0.4139, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.98% (7.0025 => 7.6316, std. dev.: 0.0268) SingleSource/Benchmarks/Shootout/methcall: 7.89% (8.5566 => 9.2316, std. dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: 7.12% (1.0194 => 1.0920, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.4876 => 3.7209, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.57% (1.0063 => 1.0724, std. dev.: 0.0156) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7522, std. dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3301 => 0.3472, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.39% (0.7609 => 0.7943, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8533, std. dev.: 0.0320) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.84% (2.6656 => 2.7680, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 3.81% (8.5113 => 8.8354, std. dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (40.4792 => 41.8415, std. dev.: 0.3883) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.27% (3.4080 => 3.5193, std. dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8345, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.80% (2.4042 => 2.4715, std. dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.47% (0.5876 => 0.6021, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 2.38% (2.3453 => 2.4011, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/five11/five11: 2.19% (5.1938 => 5.3078, std. dev.: 0.0306) MultiSource/Applications/minisat/minisat: 2.00% (6.2244 => 6.3490, std. dev.: 0.0373) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6747, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.5166 => 2.5433, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.02% (3.6254 => 3.6624, std. dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.21% (5.2665 => 4.0969, std. dev.: 0.0745) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.95% (1.1647 => 0.9906, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1614, std. dev.: 0.0184) MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.99% (2.5984 => 2.3648, std. dev.: 0.0879) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9415, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3422, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/pi: -6.14% (1.6538 => 1.5522, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.60% (9.2503 => 8.7327, std. dev.: 0.0519) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (4.6355 => 4.4029, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.94% (3.9413 => 3.7466, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.30% (1.7361 => 1.6614, std. dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.96% (2.4457 => 2.3488, std. dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.10% (3.7496 => 3.6333, std. dev.: 0.0237) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (7.6833 => 7.4515, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.72% (1.1683 => 1.1365, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -2.63% (9.5474 => 9.2962, std. dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -2.52% (92.7467 => 90.4070, std. dev.: 0.6777) MultiSource/Applications/siod/siod: -2.37% (3.5520 => 3.4679, std. dev.: 0.0163) MultiSource/Applications/aha/aha: -1.73% (3.4286 => 3.3694, std. dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7675, std. dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3154, std. dev.: 0.0612) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 1 22:19:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 00:19:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902051910.6B0F02A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3352?compare_to=3351&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3352, Order: 163083, Start Time: 2012-09-02 04:08:56, End Time: 2012-09-02 05:20:14 To: 3351, Order: 163079, Start Time: 2012-09-02 01:53:14, End Time: 2012-09-02 03:04:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (56 on baseline) Performance Improvements: 5 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (805 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5726 => 0.5860, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (4.0387 => 4.0818, std. dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.77% (1.7102 => 1.8601, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4989 => 2.5326, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -10.89% (0.1552 => 0.1383, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: -7.88% (3.2831 => 3.0244, std. dev.: 0.0242) MultiSource/Applications/minisat/minisat: -2.37% (6.3490 => 6.1985, std. dev.: 0.0525) SingleSource/Benchmarks/Misc/mandel-2: -2.03% (4.4003 => 4.3108, std. dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.73% (4.5162 => 4.4382, std. dev.: 0.0243) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3.89% (1.1653 => 1.2106, std. dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 3.46% (2.1763 => 2.2517, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 3.26% (0.3217 => 0.3322, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 3.01% (1.0046 => 1.0348, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.87% (0.6173 => 0.6350, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.5150 => 1.5564, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (12.6413 => 12.9843, std. dev.: 0.1260) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1672 => 1.1974, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5740 => 0.5860, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.06% (0.7226 => 0.7375, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.05% (0.5937 => 0.6059, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.1827 => 1.2066, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.02% (1.1440 => 1.1671, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.7639 => 0.7783, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.59% (1.3935 => 1.4156, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.58% (3.0225 => 3.0703, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 1.49% (3.8796 => 3.9375, std. dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 1.43% (13.3238 => 13.5147, std. dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (4.0318 => 4.0818, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 1.18% (14.6079 => 14.7798, std. dev.: 0.0243) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.08% (4.2616 => 4.3078, std. dev.: 0.0176) MultiSource/Benchmarks/Bullet/bullet: 1.08% (29.3170 => 29.6342, std. dev.: 0.0301) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2271, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0011, std. dev.: 0.0133) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.45% (0.0766 => 0.0869, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.44% (4.0101 => 4.5492, std. dev.: 0.0311) SingleSource/Benchmarks/McGill/misr: 13.22% (0.4296 => 0.4864, std. dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 12.69% (3.4406 => 3.8772, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1277, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.06% (0.2694 => 0.2938, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.78% (7.0025 => 7.6171, std. dev.: 0.0295) SingleSource/Benchmarks/McGill/chomp: 7.23% (1.0194 => 1.0931, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/methcall: 6.83% (8.5566 => 9.1412, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 6.83% (3.4876 => 3.7258, std. dev.: 0.0282) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (27.1724 => 28.7324, std. dev.: 0.0337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8523, std. dev.: 0.0398) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.82% (0.8498 => 0.8823, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (6.6312 => 6.8364, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.60% (2.6656 => 2.7350, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/whetstone: 2.52% (2.3453 => 2.4044, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/ReedSolomon: 2.37% (8.5113 => 8.7132, std. dev.: 0.0774) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.59% (4.6127 => 4.6861, std. dev.: 0.0238) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5326, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4455 => 2.4789, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6762, std. dev.: 0.0341) MultiSource/Applications/JM/lencod/lencod: 1.21% (6.7458 => 6.8273, std. dev.: 0.0248) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 1.09% (2.4013 => 2.4274, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6918, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.64% (0.3497 => 0.2041, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.22% (5.2665 => 4.0965, std. dev.: 0.0725) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9904, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.49% (3.2007 => 2.9610, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/richards_benchmark: -7.31% (1.4441 => 1.3385, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/methcall: -6.46% (9.2503 => 8.6524, std. dev.: 0.0296) SingleSource/Benchmarks/Misc/pi: -6.29% (1.6538 => 1.5497, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.95% (3.9413 => 3.7464, std. dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4104, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.12% (1.7361 => 1.6646, std. dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.75% (2.4457 => 2.3539, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.08% (1.1683 => 1.1323, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -3.08% (7.6833 => 7.4466, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.88% (3.7496 => 3.6417, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std. dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -2.71% (92.7467 => 90.2370, std. dev.: 0.1182) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3681, std. dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2263, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -1.55% (1.7330 => 1.7062, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.50% (4.5056 => 4.4382, std. dev.: 0.0243) SingleSource/Benchmarks/Misc/oourafft: -1.46% (3.8200 => 3.7644, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std. dev.: 0.0440) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 02:49:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 04:49:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902094904.CD6EA2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3353?compare_to=3352&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3353, Order: 163085, Start Time: 2012-09-02 08:38:50, End Time: 2012-09-02 09:50:09 To: 3352, Order: 163083, Start Time: 2012-09-02 04:08:56, End Time: 2012-09-02 05:20:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 1 (44 on baseline) Performance Improvements: 2 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 887 (812 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.13% (43.2274 => 45.4458, std. dev.: 0.2429) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -6.19% (0.3085 => 0.2894, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.34% (3.1100 => 3.0683, std. dev.: 0.0153) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.16% (2.1763 => 2.2669, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (1.1653 => 1.2099, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.5150 => 1.5628, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 3.11% (0.3217 => 0.3317, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 2.97% (1.0046 => 1.0344, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: 2.83% (0.6173 => 0.6348, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.84% (1.3935 => 1.4191, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.82% (0.5937 => 0.6045, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.52% (0.7639 => 0.7755, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (8.2559 => 8.3624, std. dev.: 0.0344) MultiSource/Benchmarks/Bullet/bullet: 1.24% (29.3170 => 29.6808, std. dev.: 0.0896) MultiSource/Applications/Burg/burg: 1.14% (1.1440 => 1.1570, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 21.97% (3.4629 => 4.2238, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.10% (0.0766 => 0.0897, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.29% (4.0101 => 4.5832, std. dev.: 0.0062) SingleSource/Benchmarks/McGill/misr: 13.45% (0.4296 => 0.4874, std. dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 12.81% (0.3746 => 0.4226, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8793, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1035, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6109, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/methcall: 7.55% (8.5566 => 9.2022, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.53% (1.0063 => 1.0821, std. dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (3.4876 => 3.7253, std. dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7507, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8288, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.44% (2.6656 => 2.7574, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (6.6312 => 6.8367, std. dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.93% (0.5876 => 0.6048, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 2.83% (8.5113 => 8.7521, std. dev.: 0.0416) MultiSource/Benchmarks/BitBench/five11/five11: 2.42% (5.1938 => 5.3194, std. dev.: 0.0339) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.00% (1.2726 => 1.2980, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 1.82% (0.6308 => 0.6423, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (2.4971 => 2.5344, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.4455 => 2.4800, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.39% (6.7458 => 6.8393, std. dev.: 0.0244) MultiSource/Applications/hexxagon/hexxagon: 1.20% (14.4877 => 14.6610, std. dev.: 0.0241) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (4.6414 => 4.6914, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.02% (3.6254 => 3.6623, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.98% (5.2665 => 4.2144, std. dev.: 0.1707) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.11% (1.1647 => 0.9887, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.24% (3.2007 => 2.9690, std. dev.: 0.0473) SingleSource/Benchmarks/Misc/richards_benchmark: -6.90% (1.4441 => 1.3444, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -6.27% (9.2503 => 8.6703, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/pi: -6.23% (1.6538 => 1.5508, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7459, std. dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4100, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.18% (8.5323 => 8.1758, std. dev.: 0.1338) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.42% (1.7361 => 1.6767, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.37% (2.4457 => 2.3633, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.24% (1.1683 => 1.1305, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.11% (1.8739 => 1.8156, std. dev.: 0.0203) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -2.92% (7.6833 => 7.4588, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.70% (3.7496 => 3.6485, std. dev.: 0.0112) MultiSource/Benchmarks/PAQ8p/paq8p: -2.55% (92.7467 => 90.3815, std. dev.: 0.4537) MultiSource/Applications/siod/siod: -2.27% (3.5520 => 3.4715, std. dev.: 0.0080) MultiSource/Benchmarks/sim/sim: -1.67% (3.8907 => 3.8257, std. dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2318, std. dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -1.59% (3.4286 => 3.3741, std. dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7661, std. dev.: 0.0162) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.3569 => 2.3238, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5617 => 16.3563, std. dev.: 0.0294) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 04:21:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 06:21:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902112128.5700C2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3354?compare_to=3353&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3354, Order: 163088, Start Time: 2012-09-02 10:11:20, End Time: 2012-09-02 11:22:35 To: 3353, Order: 163085, Start Time: 2012-09-02 08:38:50, End Time: 2012-09-02 09:50:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (53 on baseline) Performance Improvements: 4 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (807 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 7.84% (0.2894 => 0.3121, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 1.02% (15.4317 => 15.5888, std. dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 4.92% (3.0216 => 3.1704, std. dev.: 0.0492) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (0.3393 => 0.3503, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.42% (1.8156 => 1.8596, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.17% (1.5870 => 1.6214, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.17% (1.2854 => 1.2704, std. dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -1.02% (2.2669 => 2.2437, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.84% (45.4458 => 44.1550, std. dev.: 0.3601) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.49% (22.7414 => 22.1757, std. dev.: 0.1188) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 3.76% (0.3008 => 0.3121, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.71% (1.1653 => 1.2085, std. dev.: 0.0111) MultiSource/Applications/minisat/minisat: 3.39% (0.6173 => 0.6382, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 3.10% (2.1763 => 2.2437, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.46% (1.5150 => 1.5522, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (12.6413 => 12.9413, std. dev.: 0.0694) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.1827 => 1.2077, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.94% (0.5937 => 0.6052, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.1672 => 1.1894, std. dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 1.82% (15.3105 => 15.5888, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.81% (0.7226 => 0.7357, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.60% (13.3238 => 13.5373, std. dev.: 0.0732) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.59% (1.2021 => 1.2212, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.53% (4.2616 => 4.3270, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.44% (8.2559 => 8.3745, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.41% (1.3935 => 1.4132, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 1.21% (1.3268 => 1.3428, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.19% (29.3170 => 29.6646, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9970, std. dev.: 0.0961) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.75% (4.0101 => 4.5614, std. dev.: 0.1020) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 12.66% (3.4406 => 3.8761, std. dev.: 0.0061) SingleSource/Benchmarks/McGill/misr: 12.45% (0.4296 => 0.4831, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 11.08% (0.3746 => 0.4161, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (62.4126 => 69.1487, std. dev.: 0.2039) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6057, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout/methcall: 7.11% (8.5566 => 9.1647, std. dev.: 0.0134) SingleSource/Benchmarks/McGill/chomp: 7.04% (1.0194 => 1.0912, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.55% (3.4876 => 3.7159, std. dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.52% (1.0063 => 1.0719, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3301 => 0.3503, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7523, std. dev.: 0.1144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.37% (40.4792 => 42.6541, std. dev.: 0.4701) SingleSource/Benchmarks/Misc/fp-convert: 4.38% (15.2242 => 15.8916, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/dt: 4.23% (0.9851 => 1.0268, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 4.10% (0.6459 => 0.6724, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.00% (4.2129 => 4.3816, std. dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.76% (2.6656 => 2.7657, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/five11/five11: 3.32% (5.1938 => 5.3662, std. dev.: 0.0337) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 3.10% (8.5113 => 8.7754, std. dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (6.6312 => 6.8360, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.54% (0.5587 => 0.5729, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.06% (0.5876 => 0.5997, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (2.4455 => 2.4889, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 1.43% (4.6414 => 4.7076, std. dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5312, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6741, std. dev.: 0.0199) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.4184 => 1.4354, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.10% (29.5232 => 29.8481, std. dev.: 0.0627) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.37% (5.2665 => 4.1411, std. dev.: 0.0941) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.01% (1.1647 => 0.9899, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.21% (3.2007 => 2.9379, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/richards_benchmark: -6.99% (1.4441 => 1.3432, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5500, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/methcall: -5.89% (9.2503 => 8.7053, std. dev.: 0.0482) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7460, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.25% (8.5323 => 8.1701, std. dev.: 0.1362) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.84% (2.4457 => 2.3519, std. dev.: 0.0250) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.57% (1.7361 => 1.6741, std. dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: -2.92% (7.6833 => 7.4589, std. dev.: 0.0563) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.89% (1.2722 => 1.2354, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.89% (45.4683 => 44.1550, std. dev.: 0.3601) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.83% (1.1683 => 1.1352, std. dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.79% (3.7496 => 3.6448, std. dev.: 0.0387) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std. dev.: 0.0185) MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (92.7467 => 90.5525, std. dev.: 0.3186) MultiSource/Benchmarks/FreeBench/neural/neural: -2.03% (1.0926 => 1.0704, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2284, std. dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0054) MultiSource/Applications/aha/aha: -1.59% (3.4286 => 3.3740, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3078, std. dev.: 0.0244) MultiSource/Benchmarks/sim/sim: -1.29% (3.8907 => 3.8407, std. dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 06:30:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 08:30:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902133056.91D932A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3355?compare_to=3354&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3355, Order: 163091, Start Time: 2012-09-02 12:20:45, End Time: 2012-09-02 13:32:02 To: 3354, Order: 163088, Start Time: 2012-09-02 10:11:20, End Time: 2012-09-02 11:22:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (42 on baseline) Performance Improvements: 7 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (817 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 3.13% (8.1701 => 8.4262, std. dev.: 0.0905) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.59% (4.3816 => 4.4952, std. dev.: 0.0180) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -5.74% (0.3121 => 0.2942, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.12% (1.2077 => 1.1821, std. dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.07% (1.1894 => 1.1648, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.79% (0.7357 => 0.7225, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.51% (1.2212 => 1.2027, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: -1.40% (1.0908 => 1.0755, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.5671 => 4.4967, std. dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.1653 => 1.2043, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 2.89% (1.0046 => 1.0336, std. dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 2.88% (2.1763 => 2.2389, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: 2.46% (0.6173 => 0.6325, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.5150 => 1.5484, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (12.6413 => 12.8884, std. dev.: 0.0772) MultiSource/Applications/Burg/burg: 1.80% (1.1440 => 1.1646, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.40% (3.0225 => 3.0649, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.47% (0.0917 => 0.1068, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9997, std. dev.: 0.0249) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.97% (0.0766 => 0.0873, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5640, std. dev.: 0.0395) SingleSource/Benchmarks/McGill/misr: 13.71% (0.4296 => 0.4885, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 12.72% (3.4406 => 3.8782, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1012, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.40% (1.0063 => 1.1009, std. dev.: 0.0270) SingleSource/Benchmarks/McGill/chomp: 9.10% (1.0194 => 1.1122, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout/lists: 8.80% (7.0025 => 7.6187, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout/methcall: 7.19% (8.5566 => 9.1722, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.70% (4.2129 => 4.4952, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (3.4876 => 3.7132, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7393, std. dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.43% (40.4792 => 42.6760, std. dev.: 0.5058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3301 => 0.3472, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.64% (15.2242 => 15.9307, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 3.91% (8.5113 => 8.8438, std. dev.: 0.0418) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.54% (0.5876 => 0.6084, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.12% (6.6312 => 6.8379, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: 2.88% (5.1938 => 5.3432, std. dev.: 0.0178) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.89% (4.6127 => 4.6999, std. dev.: 0.0244) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (2.4455 => 2.4868, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5347, std. dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.50% (2.4042 => 2.4403, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 1.21% (14.4877 => 14.6623, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6925, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.33% (4.3380 => 4.2805, std. dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.21% (0.3497 => 0.2091, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.95% (5.2665 => 4.1630, std. dev.: 0.0838) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.91% (1.1647 => 0.9910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -7.28% (1.4441 => 1.3390, std. dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.00% (3.2007 => 2.9767, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (9.2503 => 8.6536, std. dev.: 0.0492) SingleSource/Benchmarks/Misc/pi: -6.25% (1.6538 => 1.5505, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: -4.99% (4.6355 => 4.4044, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.62% (1.7361 => 1.6559, std. dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (7.6833 => 7.4450, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.93% (1.1683 => 1.1341, std. dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std. dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.59% (3.7496 => 3.6523, std. dev.: 0.0350) MultiSource/Benchmarks/PAQ8p/paq8p: -2.42% (92.7467 => 90.5011, std. dev.: 0.4090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.41% (1.4021 => 1.3683, std. dev.: 0.0104) MultiSource/Applications/siod/siod: -2.16% (3.5520 => 3.4751, std. dev.: 0.0295) MultiSource/Applications/aha/aha: -1.78% (3.4286 => 3.3675, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2294, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -1.50% (1.7330 => 1.7070, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0926 => 1.0763, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3121, std. dev.: 0.0247) MultiSource/Benchmarks/sim/sim: -1.27% (3.8907 => 3.8411, std. dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 07:57:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 09:57:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902145751.485D72A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3356?compare_to=3355&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3356, Order: 163094, Start Time: 2012-09-02 13:47:32, End Time: 2012-09-02 14:58:57 To: 3355, Order: 163091, Start Time: 2012-09-02 12:20:45, End Time: 2012-09-02 13:32:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (55 on baseline) Performance Improvements: 1 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 874 (800 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.52% (8.8873 => 9.4666, std. dev.: 0.0709) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.64% (0.7767 => 0.7972, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.3936 => 1.4247, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.4037 => 1.4333, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5664 => 0.5774, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 1.28% (1.3233 => 1.3403, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 1.17% (1.0755 => 1.0881, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 7.89% (3.1041 => 3.3489, std. dev.: 0.0514) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.13% (2.6644 => 2.7478, std. dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (4.4403 => 4.5123, std. dev.: 0.0227) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.37% (1.6088 => 1.6308, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.36% (4.4967 => 4.5579, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/methcall: 1.29% (8.6536 => 8.7655, std. dev.: 0.0341) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.10% (5.8788 => 5.9436, std. dev.: 0.0225) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.01% (2.8304 => 2.8589, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.45% (3.1105 => 3.0653, std. dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.21% (8.9977 => 9.4666, std. dev.: 0.0709) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.2662 => 0.2772, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.1653 => 1.2069, std. dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.24% (0.7722 => 0.7972, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 2.86% (1.0046 => 1.0333, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.86% (1.3935 => 1.4333, std. dev.: 0.0104) MultiSource/Applications/Burg/burg: 2.71% (1.1440 => 1.1750, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5150 => 1.5540, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: 2.51% (0.6173 => 0.6328, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (12.6413 => 12.9557, std. dev.: 0.1097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6069 => 0.6179, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.70% (3.0225 => 3.0740, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 1.67% (13.3238 => 13.5460, std. dev.: 0.0858) MultiSource/Applications/siod/siod: 1.51% (2.0972 => 2.1288, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.43% (0.7639 => 0.7748, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.27% (1.8798 => 1.9036, std. dev.: 0.0088) MultiSource/Applications/hbd/hbd: 1.02% (1.3268 => 1.3403, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.15% (0.0766 => 0.0928, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 15.81% (1.7426 => 2.0181, std. dev.: 0.0263) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5567, std. dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8787, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0901, std. dev.: 0.1038) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.69% (3.0256 => 3.3489, std. dev.: 0.0514) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 9.45% (7.0025 => 7.6644, std. dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.35% (1.0063 => 1.0903, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout/methcall: 7.73% (8.5566 => 9.2182, std. dev.: 0.0446) SingleSource/Benchmarks/McGill/chomp: 7.35% (1.0194 => 1.0943, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (3.4876 => 3.7218, std. dev.: 0.0146) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.82% (27.1724 => 28.7536, std. dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.69% (40.4792 => 42.7844, std. dev.: 0.4431) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.20% (15.2242 => 15.8631, std. dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.31% (0.3508 => 0.3624, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (6.6312 => 6.8372, std. dev.: 0.0137) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.08% (2.6656 => 2.7478, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.78% (0.8498 => 0.8734, std. dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (2.4042 => 2.4685, std. dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: 1.74% (4.3016 => 4.3765, std. dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 1.62% (6.7458 => 6.8553, std. dev.: 0.0417) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.4455 => 2.4837, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.54% (1.6061 => 1.6308, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.51% (4.6127 => 4.6825, std. dev.: 0.0254) MultiSource/Applications/hexxagon/hexxagon: 1.32% (14.4877 => 14.6795, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.4184 => 1.4354, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6925, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.07% (3.6254 => 3.6642, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.03% (5.8830 => 5.9436, std. dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.59% (5.2665 => 4.1823, std. dev.: 0.1358) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.87% (1.1647 => 0.9915, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.15% (8.1594 => 7.1679, std. dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.41% (3.2007 => 2.9314, std. dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -7.00% (1.4441 => 1.3430, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5512, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.24% (9.2503 => 8.7655, std. dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7459, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (4.6355 => 4.4142, std. dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.92% (2.4457 => 2.3498, std. dev.: 0.0195) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.80% (1.2959 => 1.2467, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.17% (3.7496 => 3.6307, std. dev.: 0.0173) MultiSource/Applications/lambda-0_1_3/lambda: -2.87% (7.6833 => 7.4628, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.81% (1.1683 => 1.1355, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2887, std. dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.44% (0.4140 => 0.4039, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.26% (1.2722 => 1.2435, std. dev.: 0.0082) MultiSource/Applications/siod/siod: -2.23% (3.5520 => 3.4728, std. dev.: 0.0188) MultiSource/Applications/SPASS/SPASS: -1.79% (8.5323 => 8.3796, std. dev.: 0.0459) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2276, std. dev.: 0.0364) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3717, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.65% (1.8739 => 1.8430, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.56% (1.0686 => 1.0519, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0926 => 1.0772, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3158, std. dev.: 0.0583) MultiSource/Benchmarks/sim/sim: -1.33% (3.8907 => 3.8390, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.29% (2.8964 => 2.8589, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -1.21% (1.7330 => 1.7120, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.09% (1.1116 => 1.0995, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 09:25:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 11:25:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902162541.0732D2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3357?compare_to=3356&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3357, Order: 163096, Start Time: 2012-09-02 15:14:34, End Time: 2012-09-02 16:26:47 To: 3356, Order: 163094, Start Time: 2012-09-02 13:47:32, End Time: 2012-09-02 14:58:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 1 (36 on baseline) Performance Improvements: 2 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 887 (821 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.92% (2.4685 => 2.5406, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.23% (22.2198 => 21.7246, std. dev.: 0.1093) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.62% (1.6308 => 1.6044, std. dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.18% (1.1653 => 1.2023, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (1.5150 => 1.5576, std. dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 39.54% (0.0263 => 0.0367, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0176) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.12% (0.0917 => 0.1074, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0330) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.01% (4.0101 => 4.5718, std. dev.: 0.0915) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.84% (0.0766 => 0.0872, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 13.53% (0.3746 => 0.4253, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 11.97% (3.4406 => 3.8525, std. dev.: 0.0208) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (62.4126 => 69.1102, std. dev.: 0.0331) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.80% (0.2694 => 0.2931, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6177, std. dev.: 0.0542) SingleSource/Benchmarks/McGill/chomp: 8.48% (1.0194 => 1.1058, std. dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 8.16% (0.1433 => 0.1550, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.89% (1.0063 => 1.0857, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (3.4876 => 3.7266, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/methcall: 6.69% (8.5566 => 9.1291, std. dev.: 0.0517) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7360, std. dev.: 0.0886) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.67% (2.4042 => 2.5406, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.3301 => 0.3481, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.63% (15.2242 => 15.9286, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.44% (40.4792 => 42.2784, std. dev.: 0.5743) SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.6308 => 0.6583, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.64% (2.6656 => 2.7626, std. dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8351, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: 2.99% (5.1938 => 5.3489, std. dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5113 => 8.7563, std. dev.: 0.0524) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4455 => 2.4820, std. dev.: 0.0140) MultiSource/Applications/hexxagon/hexxagon: 1.34% (14.4877 => 14.6823, std. dev.: 0.0068) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.31% (2.9152 => 2.9535, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.68% (5.2665 => 4.0722, std. dev.: 0.1828) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.99% (1.1647 => 0.9901, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -7.11% (1.4441 => 1.3414, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: -6.80% (9.2503 => 8.6217, std. dev.: 0.0903) SingleSource/Benchmarks/Misc/pi: -6.55% (1.6538 => 1.5455, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.01% (4.6355 => 4.4031, std. dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.95% (3.9413 => 3.7462, std. dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.23% (1.7361 => 1.6627, std. dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.62% (0.4140 => 0.3990, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.61% (2.4457 => 2.3574, std. dev.: 0.0220) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2303, std. dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4505, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.97% (1.1683 => 1.1336, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.75% (22.3381 => 21.7246, std. dev.: 0.1093) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2861, std. dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.50% (3.7496 => 3.6557, std. dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (92.7467 => 90.5482, std. dev.: 0.5434) MultiSource/Applications/siod/siod: -2.31% (3.5520 => 3.4700, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.70% (2.8964 => 2.8471, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0019) MultiSource/Applications/aha/aha: -1.60% (3.4286 => 3.3737, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -1.48% (3.8907 => 3.8331, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3078, std. dev.: 0.0985) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.32% (9.3855 => 9.2620, std. dev.: 0.0321) SingleSource/Benchmarks/Misc/oourafft: -1.24% (3.8200 => 3.7726, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.18% (1.1116 => 1.0985, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 10:52:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 12:52:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120902175204.3C1182A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3358?compare_to=3357&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3358, Order: 163098, Start Time: 2012-09-02 16:42:30, End Time: 2012-09-02 17:53:09 To: 3357, Order: 163096, Start Time: 2012-09-02 15:14:34, End Time: 2012-09-02 16:26:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (48 on baseline) Performance Improvements: 1 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (811 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.7586 => 0.7979, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.14% (0.7483 => 0.7868, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.17% (0.5680 => 0.5803, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 28.26% (0.0453 => 0.0581, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.79% (0.7810 => 0.8887, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.23% (2.3628 => 2.3919, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.36% (1.0947 => 1.0798, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.78% (1.1653 => 1.2093, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.33% (0.7722 => 0.7979, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 3.17% (1.0046 => 1.0364, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.11% (1.5150 => 1.5621, std. dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: 3.02% (2.1763 => 2.2421, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (12.6413 => 12.9410, std. dev.: 0.0753) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.1827 => 1.2029, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (1.4113 => 1.4327, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.40% (0.7226 => 0.7327, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 1.38% (14.6079 => 14.8090, std. dev.: 0.0727) MultiSource/Applications/d/make_dparser: 1.34% (3.0225 => 3.0629, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.34% (1.1672 => 1.1828, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.23% (1.3935 => 1.4106, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 1.17% (13.3238 => 13.4794, std. dev.: 0.0538) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.62% (0.0766 => 0.0901, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9989, std. dev.: 0.0202) SingleSource/Benchmarks/McGill/misr: 13.97% (0.4296 => 0.4896, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5560, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 12.81% (0.3746 => 0.4226, std. dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 12.77% (0.1433 => 0.1616, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8792, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.81% (62.4126 => 69.1582, std. dev.: 0.1067) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6042, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.94% (1.0063 => 1.0862, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: 7.46% (1.0194 => 1.0954, std. dev.: 0.0189) SingleSource/Benchmarks/Shootout/methcall: 7.12% (8.5566 => 9.1660, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (3.4876 => 3.7078, std. dev.: 0.0132) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7351, std. dev.: 0.0302) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3301 => 0.3472, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.58% (0.8498 => 0.8887, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 4.54% (15.2242 => 15.9147, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8345, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.89% (2.6656 => 2.7426, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/ReedSolomon: 2.35% (8.5113 => 8.7109, std. dev.: 0.0590) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.21% (0.5876 => 0.6006, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.99% (2.3453 => 2.3919, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/five11/five11: 1.98% (5.1938 => 5.2964, std. dev.: 0.0275) MultiSource/Applications/hexxagon/hexxagon: 1.36% (14.4877 => 14.6841, std. dev.: 0.0432) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.33% (1.6110 => 1.6324, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.26% (2.9152 => 2.9519, std. dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (2.4971 => 2.5254, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6924, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.52% (5.2665 => 4.0806, std. dev.: 0.2549) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.93% (1.1647 => 0.9908, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.66% (3.2007 => 2.9235, std. dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -6.94% (1.4441 => 1.3439, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5499, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -6.25% (9.2503 => 8.6717, std. dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.16% (4.6355 => 4.3961, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.61% (2.4457 => 2.3330, std. dev.: 0.0294) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.95% (1.7361 => 1.6675, std. dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.2959 => 1.2495, std. dev.: 0.0106) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.10% (1.2722 => 1.2327, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.07% (45.4683 => 44.0718, std. dev.: 0.3126) MultiSource/Applications/lambda-0_1_3/lambda: -2.99% (7.6833 => 7.4537, std. dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1360, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2872, std. dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.65% (3.7496 => 3.6503, std. dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: -2.59% (92.7467 => 90.3474, std. dev.: 0.3449) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.36% (61.1734 => 59.7300, std. dev.: 0.3863) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2341, std. dev.: 0.0402) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -1.49% (3.8200 => 3.7630, std. dev.: 0.0113) MultiSource/Applications/aha/aha: -1.40% (3.4286 => 3.3806, std. dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3084, std. dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 18:54:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 20:54:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903015420.EAAFC2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3359?compare_to=3358&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3359, Order: 163099, Start Time: 2012-09-03 00:44:50, End Time: 2012-09-03 01:55:26 To: 3358, Order: 163098, Start Time: 2012-09-02 16:42:30, End Time: 2012-09-02 17:53:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (38 on baseline) Performance Improvements: 2 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (815 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 13.62% (1.6385 => 1.8616, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.76% (3.3264 => 3.6844, std. dev.: 0.0816) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.56% (2.2884 => 2.3927, std. dev.: 0.0318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.89% (1.4318 => 1.4588, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 1.41% (8.7109 => 8.8334, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.01% (3.6503 => 3.6870, std. dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.49% (0.7868 => 0.7672, std. dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -1.01% (3.8636 => 3.8244, std. dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.42% (2.1763 => 2.2508, std. dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.1653 => 1.2043, std. dev.: 0.0044) MultiSource/Applications/lemon/lemon: 3.03% (1.0046 => 1.0350, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: 1.93% (0.6173 => 0.6292, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.34% (3.0225 => 3.0629, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.83% (0.0263 => 0.0373, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0367) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std. dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.41% (4.0101 => 4.5477, std. dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 12.91% (0.1433 => 0.1618, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 12.66% (3.4406 => 3.8763, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: 12.45% (0.4296 => 0.4831, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (62.4126 => 69.1228, std. dev.: 0.0472) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.17% (0.2694 => 0.2968, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 9.11% (7.0025 => 7.6405, std. dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.86% (1.0063 => 1.0955, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash2: 6.78% (3.4876 => 3.7240, std. dev.: 0.0389) SingleSource/Benchmarks/Shootout/methcall: 6.67% (8.5566 => 9.1275, std. dev.: 0.0366) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7411, std. dev.: 0.1308) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.41% (0.8498 => 0.8873, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.95% (2.4042 => 2.4992, std. dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 3.78% (8.5113 => 8.8334, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (40.4792 => 42.0074, std. dev.: 0.4572) SingleSource/Benchmarks/Misc/fp-convert: 3.57% (15.2242 => 15.7682, std. dev.: 0.0453) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.04% (6.6312 => 6.8331, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 2.89% (5.1938 => 5.3439, std. dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.84% (1.4324 => 1.4588, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.78% (6.9722 => 7.0964, std. dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.42% (4.6127 => 4.6784, std. dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 1.37% (6.7458 => 6.8383, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6661, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.02% (3.6254 => 3.6623, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2080 => 0.1979, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -2.07% (0.7738 => 0.7578, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.35% (0.3497 => 0.2086, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.08% (5.2665 => 4.1038, std. dev.: 0.0397) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.72% (1.1647 => 0.9816, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std. dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.17% (3.2007 => 2.9391, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -6.99% (1.4441 => 1.3431, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/methcall: -6.56% (9.2503 => 8.6434, std. dev.: 0.0985) SingleSource/Benchmarks/Misc/pi: -6.29% (1.6538 => 1.5498, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7459, std. dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4062, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.22% (1.7361 => 1.6628, std. dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.16% (61.1734 => 58.6269, std. dev.: 0.5085) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.88% (1.2959 => 1.2456, std. dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.71% (45.4683 => 43.7829, std. dev.: 0.0879) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.38% (1.2722 => 1.2292, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.08% (1.1683 => 1.1323, std. dev.: 0.0096) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -2.99% (7.6833 => 7.4537, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/flops: -2.79% (9.5474 => 9.2811, std. dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -2.47% (92.7467 => 90.4580, std. dev.: 0.5399) MultiSource/Applications/siod/siod: -2.28% (3.5520 => 3.4710, std. dev.: 0.0006) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3648, std. dev.: 0.0124) MultiSource/Benchmarks/sim/sim: -1.70% (3.8907 => 3.8244, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.67% (3.7496 => 3.6870, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.66% (2.8964 => 2.8483, std. dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2336, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3088, std. dev.: 0.0309) SingleSource/Benchmarks/Misc/oourafft: -1.29% (3.8200 => 3.7706, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: -1.03% (16.5617 => 16.3906, std. dev.: 0.0400) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 20:31:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 22:31:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903033143.07C792A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3360?compare_to=3359&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3360, Order: 163100, Start Time: 2012-09-03 02:21:07, End Time: 2012-09-03 03:32:49 To: 3359, Order: 163099, Start Time: 2012-09-03 00:44:50, End Time: 2012-09-03 01:55:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (39 on baseline) Performance Improvements: 2 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (821 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.99% (20.7245 => 22.3813, std. dev.: 0.4409) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.43% (4.1038 => 4.3266, std. dev.: 0.0554) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.78% (4.3219 => 4.4854, std. dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.95% (43.7829 => 45.0746, std. dev.: 0.3381) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.76% (2.6630 => 2.7366, std. dev.: 0.0220) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.67% (1.5967 => 1.6233, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.65% (3.6870 => 3.6261, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.33% (1.6902 => 1.6677, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.47% (2.1763 => 2.2518, std. dev.: 0.0271) MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std. dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.1653 => 1.2022, std. dev.: 0.0073) MultiSource/Applications/lemon/lemon: 3.02% (1.0046 => 1.0349, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.7639 => 0.7766, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.16% (13.3238 => 13.4787, std. dev.: 0.0428) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout/ary3: 16.42% (1.7426 => 2.0288, std. dev.: 0.0707) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.64% (4.0101 => 4.5572, std. dev.: 0.0089) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: 12.85% (0.4296 => 0.4848, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 12.80% (3.4406 => 3.8810, std. dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 12.47% (0.3746 => 0.4213, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 10.74% (62.4126 => 69.1177, std. dev.: 0.2883) SingleSource/Benchmarks/Shootout/lists: 9.26% (7.0025 => 7.6512, std. dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.30% (1.0063 => 1.0898, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/methcall: 7.73% (8.5566 => 9.2178, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.4876 => 3.7213, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.47% (4.2129 => 4.4854, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7438, std. dev.: 0.1003) MultiSource/Benchmarks/nbench/nbench: 5.71% (21.1721 => 22.3813, std. dev.: 0.4409) SingleSource/Benchmarks/Misc/fp-convert: 4.43% (15.2242 => 15.8987, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/dt: 4.10% (0.9851 => 1.0255, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.08% (0.8498 => 0.8845, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (6.6312 => 6.8373, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 2.68% (8.5113 => 8.7390, std. dev.: 0.0747) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.66% (2.6656 => 2.7366, std. dev.: 0.0220) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.25% (4.6127 => 4.7166, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/hash: 1.92% (0.6308 => 0.6429, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.89% (0.5876 => 0.5987, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.37% (6.7458 => 6.8384, std. dev.: 0.0192) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5302, std. dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 1.32% (14.4877 => 14.6786, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: 1.17% (2.4013 => 2.4294, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.07% (1.6061 => 1.6233, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.02% (4.2815 => 4.1948, std. dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.94% (0.5520 => 0.5413, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -17.85% (5.2665 => 4.3266, std. dev.: 0.0554) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.00% (1.1647 => 0.9900, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout/sieve: -12.16% (8.1594 => 7.1675, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.72% (3.2007 => 2.9535, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: -6.93% (1.4441 => 1.3440, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/pi: -6.10% (1.6538 => 1.5529, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (9.2503 => 8.7493, std. dev.: 0.0545) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.76% (1.7361 => 1.6709, std. dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.29% (3.7496 => 3.6261, std. dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -2.95% (7.6833 => 7.4565, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.92% (1.2722 => 1.2350, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.81% (1.1683 => 1.1355, std. dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: -2.79% (92.7467 => 90.1581, std. dev.: 0.6435) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2882, std. dev.: 0.0181) MultiSource/Applications/siod/siod: -2.31% (3.5520 => 3.4700, std. dev.: 0.0237) MultiSource/Benchmarks/FreeBench/neural/neural: -2.05% (1.0926 => 1.0702, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2347, std. dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std. dev.: 0.0031) MultiSource/Applications/aha/aha: -1.52% (3.4286 => 3.3765, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7691, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3308, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 21:58:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Sep 2012 23:58:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903045818.552342A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3361?compare_to=3360&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3361, Order: 163105, Start Time: 2012-09-03 03:48:42, End Time: 2012-09-03 04:59:23 To: 3360, Order: 163100, Start Time: 2012-09-03 02:21:07, End Time: 2012-09-03 03:32:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (35 on baseline) Performance Improvements: 2 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (819 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.60% (0.2662 => 0.2811, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7462 => 0.7792, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (2.4917 => 2.5366, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.66% (2.5713 => 2.6139, std. dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.23% (1.2825 => 1.2983, std. dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: 1.15% (1.9901 => 2.0129, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.55% (45.0746 => 43.4740, std. dev.: 0.3430) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.21% (1.6233 => 1.5875, std. dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.1653 => 1.2037, std. dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: 3.04% (2.1763 => 2.2424, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: 2.43% (0.6173 => 0.6323, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.01% (3.4629 => 4.2251, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.49% (0.0766 => 0.0900, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0179) SingleSource/Benchmarks/McGill/misr: 13.62% (0.4296 => 0.4881, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.25% (4.0101 => 4.5416, std. dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 12.87% (0.3746 => 0.4228, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1251, std. dev.: 0.0395) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.13% (0.2694 => 0.2967, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.23% (3.4406 => 3.7583, std. dev.: 0.0610) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6178, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.54% (1.0063 => 1.0922, std. dev.: 0.0093) SingleSource/Benchmarks/Stanford/Puzzle: 7.40% (0.1433 => 0.1539, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/methcall: 7.28% (8.5566 => 9.1797, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (3.4876 => 3.7250, std. dev.: 0.0172) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7336, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (0.3301 => 0.3469, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.88% (15.2242 => 15.8142, std. dev.: 0.0513) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.73% (2.4455 => 2.5366, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8348, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: 2.96% (5.1938 => 5.3476, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.73% (2.6656 => 2.7385, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7145, std. dev.: 0.0786) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.02% (1.2726 => 1.2983, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.76% (2.5687 => 2.6139, std. dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5322, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6646, std. dev.: 0.0327) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.02% (3.6254 => 3.6623, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.72% (4.2815 => 4.2080, std. dev.: 0.0235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.91% (5.2665 => 4.1126, std. dev.: 0.2191) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.83% (1.1647 => 0.9920, std. dev.: 0.0243) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.57% (3.2007 => 2.9263, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.46% (1.4034 => 1.2847, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -7.41% (1.4441 => 1.3371, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/pi: -6.21% (1.6538 => 1.5511, std. dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7929, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (9.2503 => 8.7065, std. dev.: 0.0563) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.19% (2.4457 => 2.3187, std. dev.: 0.0334) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -5.11% (1.7361 => 1.6473, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.39% (45.4683 => 43.4740, std. dev.: 0.3430) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.75% (1.2722 => 1.2245, std. dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.37% (3.7496 => 3.6232, std. dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (7.6833 => 7.4454, std. dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -2.81% (92.7467 => 90.1409, std. dev.: 0.2800) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0269) MultiSource/Applications/siod/siod: -2.38% (3.5520 => 3.4675, std. dev.: 0.0125) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.35% (1.2959 => 1.2654, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.15% (61.1734 => 59.8582, std. dev.: 0.1228) MultiSource/Applications/aha/aha: -1.88% (3.4286 => 3.3642, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.87% (1.1683 => 1.1464, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.51% (9.3855 => 9.2435, std. dev.: 0.0274) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8323, std. dev.: 0.0219) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3060, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.16% (1.6061 => 1.5875, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: -1.02% (16.5617 => 16.3923, std. dev.: 0.0239) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 2 23:50:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 01:50:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903065047.988292A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3362?compare_to=3361&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3362, Order: 163106, Start Time: 2012-09-03 05:40:40, End Time: 2012-09-03 06:51:51 To: 3361, Order: 163105, Start Time: 2012-09-03 03:48:42, End Time: 2012-09-03 04:59:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (40 on baseline) Performance Improvements: 5 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 872 (814 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.3963 => 1.4191, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.14% (20.9844 => 21.8534, std. dev.: 0.2404) SingleSource/Benchmarks/Shootout-C++/sieve: 3.18% (3.7583 => 3.8778, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.31% (2.3187 => 2.3722, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.98% (59.8582 => 61.0432, std. dev.: 0.3222) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.71% (2.4369 => 2.4786, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.68% (2.3743 => 2.4142, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.48% (1.0922 => 1.1084, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.6102 => 1.6338, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (3.6086 => 3.6568, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.14% (4.0810 => 4.1274, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.07% (2.7385 => 2.7678, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.01% (2.9229 => 2.9525, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.08% (0.7792 => 0.7552, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -2.06% (0.6520 => 0.6386, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.02% (2.5366 => 2.4853, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.93% (2.6139 => 2.5634, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.76% (1.2983 => 1.2755, std. dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.1653 => 1.2059, std. dev.: 0.0067) MultiSource/Applications/lemon/lemon: 3.29% (1.0046 => 1.0377, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 3.19% (0.6173 => 0.6370, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.5150 => 1.5427, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std. dev.: 0.0265) SingleSource/Benchmarks/Shootout/ary3: 14.81% (1.7426 => 2.0007, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.97% (0.0766 => 0.0873, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5639, std. dev.: 0.0096) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 12.95% (0.3746 => 0.4231, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 12.71% (3.4406 => 3.8778, std. dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 11.65% (0.1433 => 0.1600, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 10.82% (62.4126 => 69.1657, std. dev.: 0.0552) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.15% (1.0063 => 1.1084, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 9.18% (7.0025 => 7.6450, std. dev.: 0.0279) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.09% (0.2694 => 0.2912, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 7.83% (1.0194 => 1.0992, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout/methcall: 6.85% (8.5566 => 9.1424, std. dev.: 0.0421) SingleSource/Benchmarks/Shootout-C++/hash2: 6.74% (3.4876 => 3.7227, std. dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7386, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.99% (4.2129 => 4.4232, std. dev.: 0.0496) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.39% (40.4792 => 42.2575, std. dev.: 0.6459) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.83% (2.6656 => 2.7678, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: 3.83% (0.9851 => 1.0228, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 3.80% (15.2242 => 15.8022, std. dev.: 0.0632) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.22% (21.1721 => 21.8534, std. dev.: 0.2404) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.09% (2.4042 => 2.4786, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.38% (2.3580 => 2.4142, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/five11/five11: 2.18% (5.1938 => 5.3071, std. dev.: 0.0134) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4853, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.51% (4.0659 => 4.1274, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5340, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.42% (1.6110 => 1.6338, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.28% (2.9152 => 2.9525, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6653, std. dev.: 0.0305) SingleSource/Benchmarks/Misc/whetstone: 1.08% (2.3453 => 2.3706, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.98% (0.7784 => 0.7552, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.36% (5.2665 => 4.1417, std. dev.: 0.0733) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9896, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: -12.07% (8.1594 => 7.1749, std. dev.: 0.0280) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.43% (3.2007 => 2.9308, std. dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -7.14% (1.4441 => 1.3410, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/pi: -6.16% (1.6538 => 1.5520, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7967, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: -5.73% (9.2503 => 8.7207, std. dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4051, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.47% (1.7361 => 1.6585, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.47% (0.4140 => 0.3955, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.16% (1.2722 => 1.2320, std. dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.01% (2.4457 => 2.3722, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.91% (45.4683 => 44.1463, std. dev.: 0.2653) MultiSource/Applications/lambda-0_1_3/lambda: -2.86% (7.6833 => 7.4638, std. dev.: 0.0323) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6425, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2931, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.66% (1.1683 => 1.1372, std. dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -2.64% (92.7467 => 90.2964, std. dev.: 0.4812) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.36% (1.8739 => 1.8297, std. dev.: 0.0127) MultiSource/Applications/siod/siod: -2.30% (3.5520 => 3.4703, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.19% (2.8964 => 2.8330, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (9.3855 => 9.2023, std. dev.: 0.0441) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.70% (1.0686 => 1.0504, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -1.59% (3.8907 => 3.8287, std. dev.: 0.0099) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -1.28% (3.8200 => 3.7711, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.3569 => 2.3277, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.18% (25.6658 => 25.3625, std. dev.: 0.0968) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.11% (1.1116 => 1.0993, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 01:17:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 03:17:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903081731.DF1CB2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3363?compare_to=3362&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3363, Order: 163107, Start Time: 2012-09-03 07:07:28, End Time: 2012-09-03 08:18:35 To: 3362, Order: 163106, Start Time: 2012-09-03 05:40:40, End Time: 2012-09-03 06:51:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (38 on baseline) Performance Improvements: 0 (27 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 887 (824 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 5.94% (1.2529 => 1.3273, std. dev.: 0.0284) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.3334 => 0.3495, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.12% (1.6585 => 1.6771, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.87% (1.1653 => 1.2104, std. dev.: 0.0111) MultiSource/Applications/minisat/minisat: 3.47% (0.6173 => 0.6387, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 3.29% (2.1763 => 2.2479, std. dev.: 0.0227) MultiSource/Applications/lemon/lemon: 2.72% (1.0046 => 1.0319, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (12.6413 => 12.9366, std. dev.: 0.0159) MultiSource/Applications/d/make_dparser: 1.16% (3.0225 => 3.0575, std. dev.: 0.0126) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.6079 => 14.7574, std. dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0225) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std. dev.: 0.0273) SingleSource/Benchmarks/McGill/misr: 14.27% (0.4296 => 0.4909, std. dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.10% (4.0101 => 4.5356, std. dev.: 0.0256) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.56% (0.0917 => 0.1023, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 10.89% (3.4406 => 3.8152, std. dev.: 0.0348) MultiSource/Benchmarks/mafft/pairlocalalign: 10.80% (62.4126 => 69.1515, std. dev.: 0.1075) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6077, std. dev.: 0.0253) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.54% (1.0063 => 1.0822, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout/methcall: 6.98% (8.5566 => 9.1542, std. dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/hash2: 6.60% (3.4876 => 3.7177, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7377, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.74% (40.4792 => 42.3988, std. dev.: 0.6227) SingleSource/Benchmarks/Misc/dt: 4.48% (0.9851 => 1.0292, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.47% (0.8498 => 0.8878, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/fp-convert: 4.27% (15.2242 => 15.8743, std. dev.: 0.0375) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (2.4042 => 2.4890, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.6308 => 0.6496, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.81% (0.5587 => 0.5744, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2995, std. dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.89% (0.5876 => 0.5987, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: 1.51% (2.3453 => 2.3807, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.46% (2.3580 => 2.3924, std. dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5308, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6730, std. dev.: 0.0304) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.14% (0.2080 => 0.1973, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.35% (0.3497 => 0.2086, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.42% (5.2665 => 4.0858, std. dev.: 0.0890) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.95% (1.1647 => 0.9906, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1611, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9390, std. dev.: 0.0490) SingleSource/Benchmarks/Misc/richards_benchmark: -7.13% (1.4441 => 1.3411, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/pi: -6.60% (1.6538 => 1.5446, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std. dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (9.2503 => 8.7426, std. dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/fibo: -5.13% (4.6355 => 4.3979, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.40% (1.7361 => 1.6771, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -3.06% (7.6833 => 7.4485, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.92% (0.4140 => 0.4019, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.90% (1.1683 => 1.1344, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2860, std. dev.: 0.0079) MultiSource/Applications/siod/siod: -2.24% (3.5520 => 3.4726, std. dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.23% (3.7496 => 3.6661, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (1.0686 => 1.0494, std. dev.: 0.0010) MultiSource/Applications/aha/aha: -1.73% (3.4286 => 3.3693, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2305, std. dev.: 0.0102) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.3569 => 2.3222, std. dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3063, std. dev.: 0.0562) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 4.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 03:38:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 05:38:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903103820.4437D2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3364?compare_to=3363&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3364, Order: 163110, Start Time: 2012-09-03 09:28:29, End Time: 2012-09-03 10:39:26 To: 3363, Order: 163107, Start Time: 2012-09-03 07:07:28, End Time: 2012-09-03 08:18:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (49 on baseline) Performance Improvements: 1 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 872 (811 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.76% (0.4348 => 0.4642, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.70% (0.2051 => 0.2168, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.30% (0.5651 => 0.5894, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.30% (0.2954 => 0.3081, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.8776 => 0.9097, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.82% (0.5820 => 0.5984, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.59% (0.5514 => 0.5657, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.7176 => 0.7357, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5438 => 0.5569, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.13% (0.5825 => 0.5949, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.16% (4.2350 => 4.2841, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 1.16% (3.8235 => 3.8678, std. dev.: 0.0131) MultiSource/Applications/Burg/burg: 1.01% (1.1482 => 1.1598, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.18% (0.7361 => 0.7742, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (2.4541 => 2.5763, std. dev.: 0.0181) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.12% (2.6756 => 2.7591, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sieve: 1.73% (3.8152 => 3.8811, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -6.04% (1.3273 => 1.2471, std. dev.: 0.0197) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.50% (0.1414 => 0.1520, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 3.83% (2.1763 => 2.2597, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.53% (0.6173 => 0.6391, std. dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.1653 => 1.2016, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 3.09% (1.0046 => 1.0356, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5740 => 0.5894, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (12.6413 => 12.9101, std. dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.81% (0.7226 => 0.7357, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.5150 => 1.5376, std. dev.: 0.0081) MultiSource/Applications/Burg/burg: 1.38% (1.1440 => 1.1598, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.20% (1.1827 => 1.1969, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.19% (4.7455 => 4.8020, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.19% (3.0225 => 3.0584, std. dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.6079 => 14.7566, std. dev.: 0.0333) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2293, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout/ary3: 17.42% (1.7426 => 2.0462, std. dev.: 0.0356) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.39% (4.0101 => 4.5471, std. dev.: 0.0315) MultiSource/Applications/sgefa/sgefa: 12.84% (0.3746 => 0.4227, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 12.80% (3.4406 => 3.8811, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/misr: 12.52% (0.4296 => 0.4834, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 10.65% (62.4126 => 69.0584, std. dev.: 0.0441) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 9.20% (7.0025 => 7.6467, std. dev.: 0.0546) SingleSource/Benchmarks/McGill/chomp: 8.33% (1.0194 => 1.1043, std. dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.87% (1.0063 => 1.0855, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout/methcall: 7.81% (8.5566 => 9.2246, std. dev.: 0.0157) MultiSource/Benchmarks/nbench/nbench: 7.02% (21.1721 => 22.6586, std. dev.: 0.5189) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.4876 => 3.7188, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (27.1724 => 28.7552, std. dev.: 0.1384) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (0.3301 => 0.3461, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 4.76% (15.2242 => 15.9482, std. dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.62% (0.8498 => 0.8891, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 3.90% (8.5113 => 8.8434, std. dev.: 0.0752) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.51% (2.6656 => 2.7591, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.05% (0.3508 => 0.3615, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 2.37% (5.1938 => 5.3168, std. dev.: 0.0351) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.12% (4.6127 => 4.7107, std. dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (2.4042 => 2.4537, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/whetstone: 1.81% (2.3453 => 2.3877, std. dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4833, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6732, std. dev.: 0.0382) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6933, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.09% (3.6254 => 3.6649, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.55% (5.2665 => 4.1844, std. dev.: 0.1035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.90% (1.1647 => 0.9912, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout/sieve: -12.11% (8.1594 => 7.1710, std. dev.: 0.0311) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2878, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9514, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.4441 => 1.3423, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: -6.25% (1.6538 => 1.5504, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.54% (9.2503 => 8.7382, std. dev.: 0.0658) MultiSource/Applications/SPASS/SPASS: -5.00% (8.5323 => 8.1056, std. dev.: 0.1180) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4091, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.56% (1.7361 => 1.6743, std. dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4498, std. dev.: 0.0417) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.99% (1.2722 => 1.2342, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.83% (1.1683 => 1.1352, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2941, std. dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.44% (0.4140 => 0.4039, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (92.7467 => 90.5719, std. dev.: 0.4176) MultiSource/Applications/siod/siod: -2.17% (3.5520 => 3.4750, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.16% (3.7496 => 3.6686, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2266, std. dev.: 0.0077) MultiSource/Applications/aha/aha: -1.64% (3.4286 => 3.3725, std. dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3162, std. dev.: 0.1039) MultiSource/Benchmarks/sim/sim: -1.02% (3.8907 => 3.8509, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 05:04:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 07:04:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903120437.9F2402A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3365?compare_to=3364&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3365, Order: 163112, Start Time: 2012-09-03 10:54:35, End Time: 2012-09-03 12:05:45 To: 3364, Order: 163110, Start Time: 2012-09-03 09:28:29, End Time: 2012-09-03 10:39:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (41 on baseline) Performance Improvements: 2 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (819 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.98% (0.7790 => 0.8022, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.93% (1.1645 => 1.1870, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.0287 => 2.0605, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.01% (41.3115 => 42.9665, std. dev.: 0.1674) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.74% (43.3700 => 44.5600, std. dev.: 0.4224) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.13% (1.1352 => 1.1480, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.28% (0.8490 => 0.8381, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -2.16% (2.0462 => 2.0020, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.7722 => 0.8022, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 3.05% (0.6173 => 0.6361, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (12.6413 => 12.8802, std. dev.: 0.0350) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.5150 => 1.5425, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.70% (1.1672 => 1.1870, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.0317 => 2.0605, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.01% (1.1440 => 1.1556, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.54% (0.0766 => 0.0931, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.89% (1.7426 => 2.0020, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.60% (4.0101 => 4.5555, std. dev.: 0.0424) SingleSource/Benchmarks/McGill/misr: 13.04% (0.4296 => 0.4856, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 12.84% (3.4406 => 3.8823, std. dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1005, std. dev.: 0.0491) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.06% (0.2694 => 0.2965, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6246, std. dev.: 0.0479) SingleSource/Benchmarks/Shootout/methcall: 7.86% (8.5566 => 9.2288, std. dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.42% (15.8312 => 17.0060, std. dev.: 0.3846) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (3.4876 => 3.7229, std. dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.14% (40.4792 => 42.9665, std. dev.: 0.1674) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7380, std. dev.: 0.0822) SingleSource/Benchmarks/Misc/dt: 4.08% (0.9851 => 1.0253, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8227, std. dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.57% (0.8498 => 0.8801, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.37% (2.6656 => 2.7555, std. dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.94% (0.3508 => 0.3611, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.83% (0.5876 => 0.6042, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 2.71% (8.5113 => 8.7420, std. dev.: 0.0524) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.92% (4.6127 => 4.7013, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.53% (4.0659 => 4.1282, std. dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 1.51% (6.7458 => 6.8474, std. dev.: 0.0253) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6748, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 1.17% (6.2244 => 6.2971, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (4.6414 => 4.6897, std. dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.02% (5.2665 => 4.1070, std. dev.: 0.0721) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.91% (1.1647 => 0.9911, std. dev.: 0.0292) SingleSource/Benchmarks/Shootout/sieve: -12.14% (8.1594 => 7.1691, std. dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.97% (3.2007 => 2.9456, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/richards_benchmark: -7.15% (1.4441 => 1.3408, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/methcall: -6.68% (9.2503 => 8.6325, std. dev.: 0.0931) SingleSource/Benchmarks/Misc/pi: -6.23% (1.6538 => 1.5507, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4085, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.21% (1.7361 => 1.6803, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -3.09% (7.6833 => 7.4456, std. dev.: 0.0342) MultiSource/Benchmarks/PAQ8p/paq8p: -2.78% (92.7467 => 90.1686, std. dev.: 0.7599) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.44% (3.7496 => 3.6581, std. dev.: 0.0273) MultiSource/Applications/siod/siod: -2.28% (3.5520 => 3.4709, std. dev.: 0.0173) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3628, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.74% (1.1683 => 1.1480, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2310, std. dev.: 0.0316) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7656, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/tsp/tsp: -1.37% (1.7330 => 1.7093, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3178, std. dev.: 0.1257) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.22% (1.8739 => 1.8511, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.21% (16.5617 => 16.3617, std. dev.: 0.0413) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 06:30:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 08:30:53 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903133053.E19AE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3366?compare_to=3365&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3366, Order: 163114, Start Time: 2012-09-03 12:20:49, End Time: 2012-09-03 13:32:02 To: 3365, Order: 163112, Start Time: 2012-09-03 10:54:35, End Time: 2012-09-03 12:05:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (43 on baseline) Performance Improvements: 4 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (812 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 14.51% (3.3750 => 3.8646, std. dev.: 0.0910) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (2.5039 => 2.5314, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.72% (2.0605 => 2.0251, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -4.47% (8.6046 => 8.2198, std. dev.: 0.1326) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.40% (0.7729 => 0.7389, std. dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.14% (5.9328 => 5.8651, std. dev.: 0.0231) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.78% (0.1414 => 0.1524, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.47% (0.7722 => 0.7990, std. dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (2.1763 => 2.2404, std. dev.: 0.0222) MultiSource/Applications/minisat/minisat: 2.87% (0.6173 => 0.6350, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.5150 => 1.5510, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (12.6413 => 12.8887, std. dev.: 0.0762) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (1.4113 => 1.4260, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.00% (1.1672 => 1.1789, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.58% (0.0766 => 0.0893, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9975, std. dev.: 0.0494) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.39% (4.0101 => 4.5471, std. dev.: 0.0342) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0934, std. dev.: 0.0768) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.28% (0.2694 => 0.2971, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6151, std. dev.: 0.0460) SingleSource/Benchmarks/Stanford/Puzzle: 8.72% (0.1433 => 0.1558, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/methcall: 7.60% (8.5566 => 9.2065, std. dev.: 0.0238) SingleSource/Benchmarks/McGill/chomp: 7.47% (1.0194 => 1.0956, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.42% (1.0063 => 1.0810, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.28% (3.6023 => 3.8646, std. dev.: 0.0910) SingleSource/Benchmarks/Shootout-C++/hash2: 6.58% (3.4876 => 3.7172, std. dev.: 0.0299) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3301 => 0.3504, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7418, std. dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.13% (40.4792 => 42.5557, std. dev.: 0.4890) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.05% (4.2129 => 4.4258, std. dev.: 0.0344) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5420, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.75% (15.2242 => 15.7949, std. dev.: 0.0690) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8719, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.94% (0.3508 => 0.3611, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.86% (0.5587 => 0.5747, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 2.81% (8.5113 => 8.7504, std. dev.: 0.0494) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 2.19% (5.1938 => 5.3073, std. dev.: 0.0286) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.16% (2.6656 => 2.7233, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.13% (1.2726 => 1.2997, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: 1.59% (2.3453 => 2.3827, std. dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5314, std. dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6677, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.13% (6.9722 => 7.0512, std. dev.: 0.0225) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6907, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.58% (0.3497 => 0.2078, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.29% (5.2665 => 4.0925, std. dev.: 0.2413) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.84% (1.1647 => 0.9919, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout/sieve: -12.30% (8.1594 => 7.1561, std. dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.52% (1.4034 => 1.2838, std. dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.05% (3.2007 => 2.9432, std. dev.: 0.0777) SingleSource/Benchmarks/Misc/richards_benchmark: -7.35% (1.4441 => 1.3380, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/methcall: -6.67% (9.2503 => 8.6329, std. dev.: 0.0562) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.67% (2.4457 => 2.2826, std. dev.: 0.0533) SingleSource/Benchmarks/Misc/pi: -6.22% (1.6538 => 1.5509, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (4.6355 => 4.4030, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.47% (1.7361 => 1.6758, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.22% (1.2722 => 1.2312, std. dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4494, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.02% (3.7496 => 3.6364, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1354, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std. dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.39% (1.0686 => 1.0431, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.38% (61.1734 => 59.7176, std. dev.: 0.4938) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (92.7467 => 90.5751, std. dev.: 0.2568) MultiSource/Benchmarks/FreeBench/neural/neural: -2.03% (1.0926 => 1.0704, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.91% (2.8964 => 2.8412, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2262, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/ffbench: -1.66% (1.4117 => 1.3883, std. dev.: 0.0073) MultiSource/Applications/aha/aha: -1.56% (3.4286 => 3.3750, std. dev.: 0.0113) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8322, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/oourafft: -1.49% (3.8200 => 3.7629, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3069, std. dev.: 0.0486) SingleSource/Benchmarks/Shootout-C++/lists: -1.15% (16.5617 => 16.3709, std. dev.: 0.0598) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (1.7473 => 1.7294, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 07:57:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 09:57:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903145754.E19792A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3367?compare_to=3366&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3367, Order: 163115, Start Time: 2012-09-03 13:47:26, End Time: 2012-09-03 14:59:02 To: 3366, Order: 163114, Start Time: 2012-09-03 12:20:49, End Time: 2012-09-03 13:32:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (42 on baseline) Performance Improvements: 2 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (811 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (16.0656 => 17.8925, std. dev.: 0.3198) SingleSource/Benchmarks/McGill/misr: 10.85% (0.4368 => 0.4842, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 7.93% (3.5967 => 3.8819, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 3.56% (3.2049 => 3.3191, std. dev.: 0.0292) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.68% (2.7233 => 2.7690, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.44% (1.4339 => 1.4545, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.19% (59.7176 => 60.4286, std. dev.: 0.2398) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.57% (1.2997 => 1.2663, std. dev.: 0.0046) MultiSource/Benchmarks/llubenchmark/llu: -1.11% (2.0330 => 2.0105, std. dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.00% (2.1763 => 2.2633, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3217 => 0.3321, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.05% (0.6173 => 0.6361, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 3.01% (1.0046 => 1.0348, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.7639 => 0.7782, std. dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 1.52% (13.3238 => 13.5267, std. dev.: 0.0155) MultiSource/Applications/d/make_dparser: 1.50% (3.0225 => 3.0678, std. dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.35% (0.0263 => 0.0377, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.32% (0.0766 => 0.0937, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/ary3: 14.80% (1.7426 => 2.0005, std. dev.: 0.0344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.35% (4.0101 => 4.5455, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.02% (15.8312 => 17.8925, std. dev.: 0.3198) SingleSource/Benchmarks/Shootout-C++/sieve: 12.83% (3.4406 => 3.8819, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: 12.71% (0.4296 => 0.4842, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.02% (0.2694 => 0.2991, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 10.82% (62.4126 => 69.1676, std. dev.: 0.0964) SingleSource/Benchmarks/Shootout/lists: 8.74% (7.0025 => 7.6145, std. dev.: 0.0434) SingleSource/Benchmarks/Shootout/methcall: 7.27% (8.5566 => 9.1786, std. dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.4876 => 3.7195, std. dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7372, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.21% (40.4792 => 42.5889, std. dev.: 0.5008) SingleSource/Benchmarks/Misc/fp-convert: 4.47% (15.2242 => 15.9043, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.88% (2.6656 => 2.7690, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout/heapsort: 3.21% (3.2159 => 3.3191, std. dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 2.46% (8.5113 => 8.7208, std. dev.: 0.0620) MultiSource/Benchmarks/BitBench/five11/five11: 2.39% (5.1938 => 5.3181, std. dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.31% (0.5587 => 0.5716, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.54% (1.4324 => 1.4545, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.43% (1.6110 => 1.6341, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.4455 => 2.4799, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.38% (6.7458 => 6.8391, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6687, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (4.6414 => 4.6942, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.56% (0.2080 => 0.1902, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.35% (0.7784 => 0.7679, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.44% (0.3497 => 0.2048, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.42% (5.2665 => 4.1384, std. dev.: 0.0976) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.01% (1.1647 => 0.9899, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std. dev.: 0.0357) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.75% (3.2007 => 2.9528, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/richards_benchmark: -6.83% (1.4441 => 1.3455, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: -6.17% (1.6538 => 1.5517, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (9.2503 => 8.6817, std. dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.14% (0.4140 => 0.3927, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: -4.94% (8.5323 => 8.1110, std. dev.: 0.1127) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4073, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (3.9413 => 3.7641, std. dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.32% (2.4457 => 2.3400, std. dev.: 0.0288) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.29% (1.2959 => 1.2403, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.25% (1.7361 => 1.6623, std. dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: -3.08% (7.6833 => 7.4466, std. dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6395, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.88% (1.1683 => 1.1346, std. dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.85% (1.2722 => 1.2359, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std. dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (92.7467 => 90.5699, std. dev.: 0.1997) MultiSource/Applications/siod/siod: -2.33% (3.5520 => 3.4693, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2300, std. dev.: 0.0382) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -1.57% (3.4286 => 3.3747, std. dev.: 0.0177) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7669, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3158, std. dev.: 0.0209) MultiSource/Benchmarks/Olden/tsp/tsp: -1.36% (1.7330 => 1.7094, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.22% (61.1734 => 60.4286, std. dev.: 0.2398) MultiSource/Benchmarks/sim/sim: -1.09% (3.8907 => 3.8482, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 10:57:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 12:57:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903175744.570502A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3368?compare_to=3367&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3368, Order: 163116, Start Time: 2012-09-03 16:47:00, End Time: 2012-09-03 17:58:51 To: 3367, Order: 163115, Start Time: 2012-09-03 13:47:26, End Time: 2012-09-03 14:59:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (36 on baseline) Performance Improvements: 6 (39 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (814 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 3.02% (2.3400 => 2.4107, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.83% (1.2663 => 1.2895, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.74% (1.6623 => 1.6912, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.10% (1.2403 => 1.2539, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -3.61% (0.2905 => 0.2800, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.39% (0.4593 => 0.4483, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -17.26% (0.0585 => 0.0484, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.88% (17.8925 => 15.4089, std. dev.: 0.7887) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.30% (1.4545 => 1.4211, std. dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.18% (1.6341 => 1.6148, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 3.34% (1.0046 => 1.0382, std. dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 2.99% (2.1763 => 2.2413, std. dev.: 0.0199) MultiSource/Applications/SIBsim4/SIBsim4: 2.93% (1.1653 => 1.1994, std. dev.: 0.0082) MultiSource/Applications/minisat/minisat: 2.41% (0.6173 => 0.6322, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.5150 => 1.5456, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout/ary3: 15.04% (1.7426 => 2.0046, std. dev.: 0.0327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5442, std. dev.: 0.0258) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8788, std. dev.: 0.0106) SingleSource/Benchmarks/McGill/misr: 12.15% (0.4296 => 0.4818, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (62.4126 => 69.0859, std. dev.: 0.0259) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.76% (0.2694 => 0.2957, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6035, std. dev.: 0.0490) SingleSource/Benchmarks/Shootout/methcall: 7.38% (8.5566 => 9.1884, std. dev.: 0.0171) SingleSource/Benchmarks/McGill/chomp: 7.34% (1.0194 => 1.0942, std. dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (0.3301 => 0.3528, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.4876 => 3.7209, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7410, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/fp-convert: 4.38% (15.2242 => 15.8913, std. dev.: 0.0445) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5421, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.86% (0.5876 => 0.6044, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.25% (2.4042 => 2.4584, std. dev.: 0.0192) MultiSource/Benchmarks/BitBench/five11/five11: 2.23% (5.1938 => 5.3098, std. dev.: 0.0171) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4843, std. dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5331, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 1.36% (2.3453 => 2.3772, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 1.33% (14.4877 => 14.6810, std. dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.33% (1.2726 => 1.2895, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.29% (4.6127 => 4.6724, std. dev.: 0.0165) MultiSource/Applications/JM/lencod/lencod: 1.12% (6.7458 => 6.8216, std. dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.6254 => 3.6627, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.46% (0.4596 => 0.4483, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -2.05% (0.7738 => 0.7579, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.47% (1.4189 => 1.3980, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.97% (5.2665 => 4.1095, std. dev.: 0.0776) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.32% (1.1647 => 0.9863, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9415, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/richards_benchmark: -7.18% (1.4441 => 1.3404, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -6.80% (9.2503 => 8.6217, std. dev.: 0.1048) SingleSource/Benchmarks/Misc/pi: -6.23% (1.6538 => 1.5508, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.24% (0.4140 => 0.3923, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4093, std. dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.83% (45.4683 => 43.2743, std. dev.: 0.4118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.24% (1.2959 => 1.2539, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.17% (1.2722 => 1.2319, std. dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.07% (3.7496 => 3.6345, std. dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4497, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.81% (1.1683 => 1.1355, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2852, std. dev.: 0.0359) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.59% (1.7361 => 1.6912, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -2.47% (1.0926 => 1.0656, std. dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -2.38% (92.7467 => 90.5414, std. dev.: 0.2704) MultiSource/Applications/siod/siod: -2.35% (3.5520 => 3.4684, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.32% (2.8964 => 2.8293, std. dev.: 0.0186) MultiSource/Applications/aha/aha: -1.78% (3.4286 => 3.3677, std. dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.43% (2.4457 => 2.4107, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.43% (9.3855 => 9.2516, std. dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3138, std. dev.: 0.0063) MultiSource/Benchmarks/sim/sim: -1.28% (3.8907 => 3.8410, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.23% (2.5669 => 2.5352, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.11% (1.1116 => 1.0993, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.06% (1.8739 => 1.8540, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.05% (1.0120 => 1.0014, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 12:25:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 14:25:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903192524.521B72A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3369?compare_to=3368&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3369, Order: 163119, Start Time: 2012-09-03 18:14:49, End Time: 2012-09-03 19:26:31 To: 3368, Order: 163116, Start Time: 2012-09-03 16:47:00, End Time: 2012-09-03 17:58:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (42 on baseline) Performance Improvements: 1 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (810 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.30% (0.0719 => 0.0829, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.13% (0.2182 => 0.2294, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.37% (57.1643 => 60.2317, std. dev.: 0.2174) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (4.3005 => 4.4461, std. dev.: 0.0549) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.00% (21.9554 => 22.6146, std. dev.: 0.1382) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.80% (0.3923 => 0.4033, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.56% (2.7092 => 2.7514, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.06% (1.3942 => 1.3236, std. dev.: 0.0211) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 3.05% (1.0046 => 1.0352, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5150 => 1.5561, std. dev.: 0.0076) MultiSource/Applications/minisat/minisat: 2.69% (0.6173 => 0.6339, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.31% (3.0225 => 3.0622, std. dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.97% (0.0766 => 0.0896, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 15.99% (1.7426 => 2.0213, std. dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.86% (4.0101 => 4.5659, std. dev.: 0.0054) SingleSource/Benchmarks/McGill/misr: 13.27% (0.4296 => 0.4866, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 12.92% (0.3746 => 0.4230, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.26% (3.4406 => 3.8279, std. dev.: 0.0277) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1007, std. dev.: 0.1687) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0088) SingleSource/Benchmarks/Stanford/Puzzle: 10.12% (0.1433 => 0.1578, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6233, std. dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.63% (1.0063 => 1.0831, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout/methcall: 7.41% (8.5566 => 9.1907, std. dev.: 0.0689) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (3.4876 => 3.7125, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7430, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.54% (4.2129 => 4.4461, std. dev.: 0.0549) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.48% (40.4792 => 42.2920, std. dev.: 0.1363) SingleSource/Benchmarks/Misc/dt: 4.44% (0.9851 => 1.0288, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8526, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 3.47% (5.1938 => 5.3741, std. dev.: 0.0278) SingleSource/Benchmarks/Misc/ReedSolomon: 3.30% (8.5113 => 8.7918, std. dev.: 0.0264) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.22% (2.6656 => 2.7514, std. dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 1.74% (0.6308 => 0.6418, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4455 => 2.4829, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5349, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.41% (4.6127 => 4.6777, std. dev.: 0.0178) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6690, std. dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.23% (38.9255 => 39.4031, std. dev.: 0.1361) MultiSource/Applications/JM/lencod/lencod: 1.22% (6.7458 => 6.8280, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.15% (4.6414 => 4.6947, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.5166 => 2.5451, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.01% (2.9152 => 2.9446, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.01% (3.6254 => 3.6619, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.74% (0.2080 => 0.1919, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.85% (0.7738 => 0.7595, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.08% (4.2815 => 4.2354, std. dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.43% (5.2665 => 4.1380, std. dev.: 0.0347) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1625, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.62% (1.4034 => 1.2824, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9413, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/richards_benchmark: -7.12% (1.4441 => 1.3413, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: -6.22% (1.6538 => 1.5510, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (9.2503 => 8.7029, std. dev.: 0.0499) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.60% (1.4021 => 1.3236, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -3.99% (8.5323 => 8.1915, std. dev.: 0.0760) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.75% (1.2959 => 1.2473, std. dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.07% (1.2722 => 1.2332, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -2.77% (7.6833 => 7.4702, std. dev.: 0.0444) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2872, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.71% (3.7496 => 3.6479, std. dev.: 0.0291) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.58% (0.4140 => 0.4033, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.55% (1.1683 => 1.1385, std. dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -2.45% (92.7467 => 90.4751, std. dev.: 0.4822) MultiSource/Applications/siod/siod: -2.32% (3.5520 => 3.4695, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.18% (2.8964 => 2.8333, std. dev.: 0.0133) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3664, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.78% (1.0686 => 1.0496, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2325, std. dev.: 0.0231) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.54% (1.8739 => 1.8450, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.54% (61.1734 => 60.2317, std. dev.: 0.2174) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3134, std. dev.: 0.0518) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7677, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists: -1.11% (16.5617 => 16.3772, std. dev.: 0.0438) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 13:52:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 15:52:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903205240.D07782A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3370?compare_to=3369&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3370, Order: 163123, Start Time: 2012-09-03 19:42:12, End Time: 2012-09-03 20:53:47 To: 3369, Order: 163119, Start Time: 2012-09-03 18:14:49, End Time: 2012-09-03 19:26:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (36 on baseline) Performance Improvements: 0 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (820 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.51% (0.2089 => 0.2204, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.87% (0.8858 => 0.9024, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (1.3874 => 1.4092, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 2.28% (8.1915 => 8.3779, std. dev.: 0.0403) MultiSource/Benchmarks/llubenchmark/llu: 1.38% (1.9939 => 2.0214, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 1.28% (3.8279 => 3.8769, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 1.18% (2.3549 => 2.3826, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 3.85% (1.0046 => 1.0433, std. dev.: 0.0107) MultiSource/Applications/minisat/minisat: 3.56% (0.6173 => 0.6393, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.34% (1.1827 => 1.1985, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0634) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.84% (0.0766 => 0.0918, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 14.73% (1.7426 => 1.9993, std. dev.: 0.0278) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.73% (4.0101 => 4.5607, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 12.92% (0.3746 => 0.4230, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 12.68% (3.4406 => 3.8769, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 10.82% (62.4126 => 69.1656, std. dev.: 0.1521) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.48% (7.0025 => 7.5962, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.99% (1.0063 => 1.0867, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout/methcall: 7.23% (8.5566 => 9.1756, std. dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.4876 => 3.7189, std. dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: 6.43% (1.0194 => 1.0849, std. dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7379, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (0.3301 => 0.3475, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.20% (40.4792 => 42.5857, std. dev.: 0.3389) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.83% (4.2129 => 4.4164, std. dev.: 0.0388) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8459, std. dev.: 0.0597) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.53% (2.6656 => 2.7596, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.19% (0.3508 => 0.3620, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.43% (8.5113 => 8.7177, std. dev.: 0.0578) SingleSource/Benchmarks/Misc/whetstone: 1.59% (2.3453 => 2.3826, std. dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5324, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4455 => 2.4789, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.32% (14.4877 => 14.6796, std. dev.: 0.0369) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6908, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.01% (0.7738 => 0.7505, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.29% (4.3380 => 4.2821, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.43% (0.3497 => 0.2083, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.07% (5.2665 => 4.1040, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.80% (1.1647 => 0.9923, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std. dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.64% (3.2007 => 2.9561, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.4441 => 1.3425, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: -6.44% (9.2503 => 8.6550, std. dev.: 0.0771) SingleSource/Benchmarks/Misc/pi: -6.32% (1.6538 => 1.5493, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std. dev.: 0.0339) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0602) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.20% (1.7361 => 1.6631, std. dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.12% (2.4457 => 2.3450, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.64% (1.4021 => 1.3511, std. dev.: 0.0173) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.07% (1.2722 => 1.2331, std. dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -2.92% (7.6833 => 7.4591, std. dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.91% (1.1683 => 1.1343, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.80% (0.4140 => 0.4024, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -2.75% (92.7467 => 90.1953, std. dev.: 0.3155) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2945, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.48% (3.7496 => 3.6567, std. dev.: 0.0174) MultiSource/Applications/SPASS/SPASS: -1.81% (8.5323 => 8.3779, std. dev.: 0.0403) MultiSource/Applications/aha/aha: -1.74% (3.4286 => 3.3690, std. dev.: 0.0123) MultiSource/Benchmarks/sim/sim: -1.63% (3.8907 => 3.8273, std. dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7674, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.24% (2.5669 => 2.5350, std. dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 15:20:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Sep 2012 17:20:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120903222033.E470A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3371?compare_to=3370&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3371, Order: 163126, Start Time: 2012-09-03 21:09:30, End Time: 2012-09-03 22:21:41 To: 3370, Order: 163123, Start Time: 2012-09-03 19:42:12, End Time: 2012-09-03 20:53:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (43 on baseline) Performance Improvements: 3 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 875 (814 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/oourafft: 5.56% (0.1889 => 0.1994, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: 2.49% (8.8451 => 9.0650, std. dev.: 0.0353) MultiSource/Benchmarks/Bullet/bullet: 1.53% (29.4268 => 29.8779, std. dev.: 0.0871) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.45% (1.5331 => 1.5553, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.32% (1.1984 => 1.2142, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.29% (1.3902 => 1.4082, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 1.28% (3.5781 => 3.6239, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (4.0031 => 4.0535, std. dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (2.2332 => 2.2595, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.11% (8.2074 => 8.2984, std. dev.: 0.0213) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.95% (2.3545 => 2.5653, std. dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/hash: 3.60% (0.6396 => 0.6626, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -2.22% (8.3779 => 8.1923, std. dev.: 0.0374) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.93% (1.7015 => 1.6687, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: -1.44% (6.9266 => 6.8269, std. dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.82% (2.1763 => 2.2595, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2073, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: 3.58% (0.6173 => 0.6394, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.39% (1.0046 => 1.0387, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (12.6413 => 12.9812, std. dev.: 0.0825) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.5150 => 1.5553, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.02% (0.5636 => 0.5750, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.91% (29.3170 => 29.8779, std. dev.: 0.0871) MultiSource/Applications/kimwitu++/kc: 1.30% (15.3105 => 15.5101, std. dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (1.3935 => 1.4082, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.01% (1.2021 => 1.2142, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.54% (0.0766 => 0.0908, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std. dev.: 0.0044) SingleSource/Benchmarks/McGill/misr: 13.90% (0.4296 => 0.4893, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.23% (4.0101 => 4.5408, std. dev.: 0.0271) MultiSource/Applications/sgefa/sgefa: 12.87% (0.3746 => 0.4228, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 11.05% (3.4406 => 3.8208, std. dev.: 0.0289) MultiSource/Benchmarks/mafft/pairlocalalign: 10.66% (62.4126 => 69.0643, std. dev.: 0.0365) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.97% (1.0063 => 1.0966, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6155, std. dev.: 0.0104) SingleSource/Benchmarks/Stanford/Puzzle: 8.23% (0.1433 => 0.1551, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 7.88% (1.0194 => 1.0997, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout/methcall: 7.20% (8.5566 => 9.1729, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.82% (15.8312 => 16.9115, std. dev.: 0.1059) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (3.4876 => 3.7245, std. dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7343, std. dev.: 0.0555) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (0.3301 => 0.3468, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 5.04% (0.6308 => 0.6626, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: 4.69% (15.2242 => 15.9389, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.17% (2.6656 => 2.7767, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.18% (0.8498 => 0.8768, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 3.16% (8.5113 => 8.7801, std. dev.: 0.0327) MultiSource/Benchmarks/BitBench/five11/five11: 2.33% (5.1938 => 5.3149, std. dev.: 0.0174) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (2.4971 => 2.5344, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6707, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: 1.20% (6.7458 => 6.8269, std. dev.: 0.0161) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.07% (4.0659 => 4.1093, std. dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.58% (0.2080 => 0.1964, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0776, std. dev.: 0.0664) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.09% (1.1647 => 0.9889, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.38% (3.2007 => 2.9324, std. dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -6.81% (1.4441 => 1.3457, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/methcall: -6.60% (9.2503 => 8.6401, std. dev.: 0.0271) SingleSource/Benchmarks/Misc/pi: -6.25% (1.6538 => 1.5505, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.16% (1.4021 => 1.3297, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7621, std. dev.: 0.0569) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.52% (0.4140 => 0.3953, std. dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: -3.98% (8.5323 => 8.1923, std. dev.: 0.0374) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.58% (1.7361 => 1.6740, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -3.07% (7.6833 => 7.4475, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.73% (1.1683 => 1.1364, std. dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: -2.43% (92.7467 => 90.4950, std. dev.: 0.4377) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.32% (3.7496 => 3.6627, std. dev.: 0.0282) MultiSource/Applications/aha/aha: -1.73% (3.4286 => 3.3693, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2262, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.49% (1.8739 => 1.8459, std. dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -1.42% (3.8907 => 3.8353, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3091, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7674, std. dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 22:07:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 00:07:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904050725.4AAB22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3372?compare_to=3371&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3372, Order: 163127, Start Time: 2012-09-04 03:57:05, End Time: 2012-09-04 05:08:31 To: 3371, Order: 163126, Start Time: 2012-09-03 21:09:30, End Time: 2012-09-03 22:21:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (42 on baseline) Performance Improvements: 1 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (815 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.49% (0.7344 => 0.7747, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.87% (3.4235 => 3.5903, std. dev.: 0.0432) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.41% (1.3297 => 1.3750, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/ffbench: 2.10% (1.3916 => 1.4208, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 1.52% (3.8208 => 3.8789, std. dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.05% (3.6627 => 3.7010, std. dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -3.50% (0.6626 => 0.6394, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.67% (2.1763 => 2.2561, std. dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 3.29% (1.1653 => 1.2036, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.26% (0.6173 => 0.6374, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.92% (1.0046 => 1.0339, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (12.6413 => 12.9364, std. dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: 1.32% (29.3170 => 29.7031, std. dev.: 0.0376) MultiSource/Applications/SPASS/SPASS: 1.22% (13.3238 => 13.4862, std. dev.: 0.0238) MultiSource/Applications/d/make_dparser: 1.08% (3.0225 => 3.0550, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.81% (0.0263 => 0.0394, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.50% (0.0766 => 0.0923, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std. dev.: 0.0570) SingleSource/Benchmarks/McGill/misr: 14.06% (0.4296 => 0.4900, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.34% (4.0101 => 4.5451, std. dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8789, std. dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 12.44% (0.3746 => 0.4212, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.10% (0.0917 => 0.1028, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.77% (62.4126 => 69.1368, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std. dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.42% (0.1433 => 0.1568, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.56% (7.0025 => 7.6021, std. dev.: 0.0554) SingleSource/Benchmarks/McGill/chomp: 7.71% (1.0194 => 1.0980, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.4876 => 3.7223, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/methcall: 6.58% (8.5566 => 9.1193, std. dev.: 0.0491) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std. dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7381, std. dev.: 0.0648) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.40% (4.2129 => 4.3982, std. dev.: 0.0578) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.31% (0.8498 => 0.8864, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8432, std. dev.: 0.0510) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std. dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7576, std. dev.: 0.0404) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.74% (2.4042 => 2.4701, std. dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.81% (0.7609 => 0.7747, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.77% (4.0659 => 4.1379, std. dev.: 0.0246) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5327, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4455 => 2.4786, std. dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6694, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (4.6414 => 4.6915, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.48% (0.2080 => 0.1966, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.52% (0.3497 => 0.2080, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.36% (5.2665 => 4.0889, std. dev.: 0.0928) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.10% (1.1647 => 0.9888, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std. dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.91% (3.2007 => 2.9474, std. dev.: 0.0413) SingleSource/Benchmarks/Misc/richards_benchmark: -6.86% (1.4441 => 1.3451, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (9.2503 => 8.6534, std. dev.: 0.0799) SingleSource/Benchmarks/Misc/pi: -6.17% (1.6538 => 1.5518, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7621, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.99% (1.2959 => 1.2442, std. dev.: 0.0101) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.47% (1.2722 => 1.2281, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4551, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.93% (45.4683 => 44.1371, std. dev.: 0.2702) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.85% (0.4140 => 0.4022, std. dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (92.7467 => 90.1492, std. dev.: 0.0971) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.56% (1.1683 => 1.1384, std. dev.: 0.0039) MultiSource/Applications/siod/siod: -2.39% (3.5520 => 3.4672, std. dev.: 0.0079) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3683, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2232, std. dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.41% (25.6658 => 25.3051, std. dev.: 0.0855) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.30% (3.7496 => 3.7010, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -1.25% (1.7330 => 1.7114, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.23% (2.5669 => 2.5353, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 22:22:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 00:22:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904052209.D79782A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3373?compare_to=3314&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3373, Order: 163127, Start Time: 2012-09-04 04:08:58, End Time: 2012-09-04 05:23:16 To: 3314, Order: 162869, Start Time: 2012-08-29 22:54:48, End Time: 2012-08-30 00:09:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 16 (163 on baseline) Performance Improvements: 15 (33 on baseline) Added Tests: 2 (66 on baseline) Unchanged Tests: 937 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.60% (0.1500 => 0.1614, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.18% (0.2536 => 0.2642, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.10% (1.2959 => 1.3490, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 3.73% (1.0604 => 1.0999, std. dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 2.83% (2.3283 => 2.3941, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.58% (0.6945 => 0.7124, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.37% (1.1034 => 1.3502, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 11.66% (1.0972 => 1.2251, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 9.46% (1.1190 => 1.2249, std. dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 8.94% (0.1432 => 0.1560, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (3.1451 => 3.4157, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 4.17% (3.0214 => 3.1475, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.22% (0.4163 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (9.7912 => 9.9805, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (5.2162 => 5.2863, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.26% (2.9632 => 3.0006, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -8.11% (0.4355 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.97% (0.3432 => 0.3330, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -1.28% (1.3012 => 1.2846, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.33% (0.0629 => 0.0520, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.23% (0.9518 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.27% (20.1120 => 18.2486, std. dev.: 0.0371) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.03% (1.8157 => 1.7062, std. dev.: 0.0059) MultiSource/Applications/siod/siod: -5.71% (3.3401 => 3.1493, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (1.4192 => 1.3783, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.73% (1.6590 => 1.6137, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -2.19% (4.6395 => 4.5380, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.3847 => 12.1659, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.73% (1.5334 => 1.5068, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.66% (2.9717 => 2.9223, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.43% (26.3353 => 25.9584, std. dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.66% (2.0176 => 2.3941, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.47% (0.1410 => 0.1614, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.38% (0.5748 => 0.6402, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference: 11.06% (0.7061 => 0.7842, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 9.81% (0.3578 => 0.3929, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3663 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3601 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3623 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.57% (0.3646 => 0.3995, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.57% (0.7710 => 0.8448, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.45% (0.3650 => 0.3995, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.45% (0.3789 => 0.4147, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.40% (0.3914 => 0.4282, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.14% (0.3940 => 0.4300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.02% (3.9660 => 4.3236, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4911, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.51% (0.2596 => 0.2817, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.36% (0.5265 => 0.5705, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (0.4328 => 0.4689, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.10% (0.9199 => 0.9944, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.03% (1.2193 => 1.3172, std. dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 7.97% (0.7038 => 0.7599, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.76% (0.1327 => 0.1430, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.63% (0.6959 => 0.7490, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.53% (0.2721 => 0.2926, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.53% (1.4563 => 1.5659, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.48% (1.1364 => 1.2214, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: 7.44% (0.3293 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.40% (0.3756 => 0.4034, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.36% (0.3899 => 0.4186, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.31% (0.7506 => 0.8055, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.30% (0.1589 => 0.1705, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.28% (13.8202 => 14.8270, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (1.9828 => 2.1270, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.23% (0.5577 => 0.5980, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.18% (0.1588 => 0.1702, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3107 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4379 => 0.4688, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (7.2180 => 7.7223, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3580 => 0.3830, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.87% (0.4016 => 0.4292, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.87% (0.4791 => 0.5120, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.2914 => 0.3113, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3534 => 0.3772, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.70% (0.3192 => 0.3406, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.69% (0.3246 => 0.3463, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.65% (1.0313 => 1.0999, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.40% (0.6283 => 0.6685, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.39% (0.8310 => 0.8841, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.35% (0.5637 => 0.5995, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.29% (1.1061 => 1.1757, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (13.2842 => 14.1181, std. dev.: 0.0143) MultiSource/Benchmarks/McCat/18-imp/imp: 6.27% (0.3220 => 0.3422, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.10% (3.8646 => 4.1004, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.05% (0.2925 => 0.3102, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.91% (0.2945 => 0.3119, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (1.2749 => 1.3490, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.79% (0.7460 => 0.7892, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 5.74% (0.4113 => 0.4349, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.73% (1.3245 => 1.4004, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.72% (1.9270 => 2.0372, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: 5.63% (0.6744 => 0.7124, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.3813 => 1.4583, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 5.56% (2.1791 => 2.3003, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (3.6692 => 3.8731, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.3819 => 1.4585, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.52% (3.1889 => 3.3648, std. dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.24% (1.0594 => 1.1149, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.6135 => 0.6456, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.3801 => 4.6075, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.19% (4.4433 => 4.6737, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.19% (0.8698 => 0.9149, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4512, std. dev.: 0.0199) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.90% (0.8818 => 0.9250, std. dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 4.85% (14.5298 => 15.2348, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 4.83% (14.8535 => 15.5706, std. dev.: 0.0210) MultiSource/Benchmarks/sim/sim: 4.79% (0.3131 => 0.3281, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.68% (8.4961 => 8.8935, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.3245 => 0.3396, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.51% (1.2292 => 1.2846, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.50% (1.1333 => 1.1843, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.44% (0.2859 => 0.2986, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.21% (4.6629 => 4.8591, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4805 => 0.5000, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.90% (6.5754 => 6.8316, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (3.2742 => 3.4005, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.6250 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.9865 => 5.1614, std. dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 3.48% (16.2614 => 16.8279, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.43% (1.5188 => 1.5709, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.41% (0.9108 => 0.9419, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.1007 => 2.1688, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 2.85% (3.7467 => 3.8535, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.52% (33.2944 => 34.1325, std. dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.31% (6.2785 => 6.4237, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.04% (1.2998 => 1.3783, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 5.96% (1.1560 => 1.2249, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0006, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7340, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1136, std. dev.: 0.0496) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6092, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5946, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6874, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.06% (0.4657 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.05% (22.5627 => 21.4238, std. dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.29% (20.3410 => 18.2486, std. dev.: 0.0371) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.21% (1.3780 => 1.3200, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9223, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5833, std. dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -2.10% (26.5159 => 25.9584, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2389, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2191, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.19% (4.5928 => 4.5380, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 22:27:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 00:27:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904052702.7E0472A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3374?compare_to=3315&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3374, Order: 163127, Start Time: 2012-09-04 04:08:57, End Time: 2012-09-04 05:28:07 To: 3315, Order: 162870, Start Time: 2012-08-29 23:05:35, End Time: 2012-08-30 00:25:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 13 (132 on baseline) Performance Improvements: 16 (37 on baseline) Added Tests: 2 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 919 (718 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1621 => 0.1746, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.95% (0.2632 => 0.2736, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.10% (0.7302 => 0.7528, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.77% (1.0969 => 1.1163, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.16% (3.4658 => 3.5059, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.90% (1.1232 => 1.3692, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 11.88% (3.0508 => 3.4133, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.37% (1.0704 => 1.1921, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.66% (1.1006 => 1.2069, std. dev.: 0.0067) SingleSource/Benchmarks/Stanford/Puzzle: 8.94% (0.1432 => 0.1560, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (3.1935 => 3.3820, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.22% (0.4163 => 0.4297, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 1.16% (5.2200 => 5.2803, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.65% (0.4365 => 0.4031, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.57% (20.5638 => 20.2409, std. dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -1.34% (1.3277 => 1.3099, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.43% (0.0631 => 0.0521, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.34% (0.9505 => 0.8522, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.13% (20.0907 => 18.2557, std. dev.: 0.0345) MultiSource/Applications/siod/siod: -5.73% (3.3405 => 3.1491, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.18% (1.8138 => 1.7198, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -4.44% (1.4408 => 1.3768, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.98% (1.6633 => 1.6138, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.09% (4.4575 => 4.3642, std. dev.: 0.0076) MultiSource/Applications/lua/lua: -1.77% (26.5261 => 26.0558, std. dev.: 0.0249) MultiSource/Applications/hexxagon/hexxagon: -1.63% (12.3847 => 12.1830, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.63% (1.5316 => 1.5067, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.34% (2.9505 => 2.9111, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: -1.12% (2.3378 => 2.3115, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.61% (10.3673 => 13.2296, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.53% (0.3497 => 0.3970, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.49% (0.3543 => 0.4021, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 13.43% (0.3543 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.34% (0.3516 => 0.3985, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.91% (0.3694 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.64% (0.3828 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.40% (0.3886 => 0.4368, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.49% (0.1566 => 0.1746, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.34% (1.1194 => 1.2463, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 10.85% (0.1622 => 0.1798, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.74% (1.7609 => 1.9501, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.94% (2.2022 => 2.3991, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.46% (0.1584 => 0.1718, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.07% (0.7326 => 0.7844, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 6.67% (0.1695 => 0.1808, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.63% (0.8172 => 0.8714, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4615 => 0.4904, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2271 => 0.2413, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.06% (0.3282 => 0.3481, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (0.3121 => 0.3308, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.99% (7.0540 => 7.4764, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.96% (0.7433 => 0.7876, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.93% (10.4361 => 11.0551, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.92% (0.4879 => 0.5168, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.81% (0.7835 => 0.8290, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.80% (0.7115 => 0.7528, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 5.76% (0.3109 => 0.3288, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.70% (0.2107 => 0.2227, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.67% (9.4845 => 10.0223, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5860 => 0.6189, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 5.61% (0.3423 => 0.3615, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.61% (0.3817 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (8.1363 => 8.5920, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 5.60% (0.2554 => 0.2697, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5569 => 0.5879, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.47% (0.5105 => 0.5384, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.3050 => 1.3761, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.44% (4.2646 => 4.4966, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (1.5415 => 1.6233, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.25% (5.0018 => 5.2643, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.18% (4.9449 => 5.2009, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 5.11% (3.3354 => 3.5059, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.93% (0.9765 => 1.0246, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 4.87% (5.7591 => 6.0396, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 4.83% (1.5603 => 1.6356, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.73% (0.6675 => 0.6991, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3441 => 0.3601, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.65% (1.1642 => 1.2183, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.63% (0.2700 => 0.2825, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.5020 => 0.5248, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.51% (0.4299 => 0.4493, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.8067 => 0.8430, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 4.46% (0.3092 => 0.3230, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (14.3668 => 14.9980, std. dev.: 0.0141) MultiSource/Applications/lua/lua: 4.33% (3.8723 => 4.0400, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.32% (1.1861 => 1.2373, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.20% (2.0273 => 2.1125, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.4064 => 0.4234, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.4103 => 0.4274, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.4636 => 0.4829, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 4.11% (1.0722 => 1.1163, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.6456 => 0.6715, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6450 => 0.6707, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 3.90% (0.3387 => 0.3519, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3650 => 0.3787, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.69% (0.4203 => 0.4358, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.66% (0.4289 => 0.4446, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2871 => 0.2976, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.61% (0.8921 => 0.9243, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3826 => 0.3964, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.56% (2.2969 => 2.3787, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3232 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0665 => 2.1391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.51% (0.2877 => 0.2978, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.3052 => 0.3158, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3684 => 0.3809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.4620 => 0.4775, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.4186 => 1.4658, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.32% (0.3162 => 0.3267, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.31% (1.5859 => 1.6384, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.2024 => 2.2679, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.97% (17.1811 => 17.6906, std. dev.: 0.0269) MultiSource/Benchmarks/nbench/nbench: 2.23% (1.1840 => 1.2104, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2842 => 1.3099, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (0.8101 => 0.8243, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.67% (21.9371 => 22.3044, std. dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.65% (7.9617 => 8.0933, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.1396 => 1.1921, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (4.2280 => 4.3642, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7477, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 1.51% (2.2771 => 2.3115, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2346, std. dev.: 0.0383) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.46% (5.2763 => 3.1942, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.67% (5.3855 => 3.7337, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7243, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1441, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.21% (2.9384 => 2.5501, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -8.73% (22.1758 => 20.2409, std. dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.44% (1.5373 => 1.3768, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2557, std. dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.17% (1.8329 => 1.7198, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5118, std. dev.: 0.0032) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1491, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.97% (1.6805 => 1.6138, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5048, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9816, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4261, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (8.1563 => 7.9522, std. dev.: 0.0105) SingleSource/Benchmarks/McGill/chomp: -2.46% (1.2373 => 1.2069, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -2.33% (12.4730 => 12.1830, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2323, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 3 23:51:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 01:51:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120904065140.777FB2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3375?compare_to=3316&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3375, Order: 163127, Start Time: 2012-09-04 04:09:12, End Time: 2012-09-04 06:52:47 To: 3316, Order: 162859, Start Time: 2012-08-29 21:55:16, End Time: 2012-08-30 00:38:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 2 (62 on baseline) Unchanged Tests: 967 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.02% (2.3745 => 2.4937, std. dev.: 0.0299) Added Tests - Compile Time -------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.34% (0.3465 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.31% (0.3446 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.29% (0.3442 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.22% (0.3488 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.62% (0.3650 => 0.4147, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.62% (0.3643 => 0.4139, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.35% (0.3724 => 0.4221, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5826 => 0.6349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.75% (0.5889 => 0.6404, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.70% (0.1620 => 0.1761, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.35% (1.5932 => 1.7103, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.27% (3.5627 => 3.8217, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (1.6211 => 1.7366, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.07% (0.4994 => 0.5347, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.04% (1.3152 => 1.4078, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.01% (0.7171 => 0.7674, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.66% (0.5000 => 0.5333, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (0.2014 => 0.2147, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.57% (0.5026 => 0.5356, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.49% (0.4361 => 0.4644, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (0.3930 => 0.4174, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.21% (0.4029 => 0.4279, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.5900 => 0.6264, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.16% (4.2109 => 4.4705, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 5.99% (1.0781 => 1.1427, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (2.7292 => 2.8876, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.2866 => 0.3030, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.29% (0.2875 => 0.3027, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 5.21% (5.5417 => 5.8305, std. dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 5.19% (0.3004 => 0.3160, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.3362 => 0.3533, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (1.9694 => 2.0695, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (0.4658 => 0.4894, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.05% (2.1013 => 2.2075, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.04% (0.9909 => 1.0408, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.01% (0.3195 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2823 => 0.2963, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.94% (1.9966 => 2.0952, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (0.3890 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.88% (0.3792 => 0.3977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.83% (0.2813 => 0.2949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2714 => 0.2844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.73% (0.2725 => 0.2854, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.72% (4.6177 => 4.8355, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2803 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.69% (0.2750 => 0.2879, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.59% (0.3903 => 0.4082, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (2.0673 => 2.1609, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 4.52% (0.3096 => 0.3236, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.52% (0.2811 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.50% (0.2780 => 0.2905, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.47% (0.2911 => 0.3041, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.44% (0.3267 => 0.3412, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (4.4195 => 4.6153, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (2.1653 => 2.2609, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.35% (0.3124 => 0.3260, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.34% (0.3477 => 0.3628, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.33% (0.3258 => 0.3399, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.3271 => 0.3412, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 4.30% (23.5202 => 24.5315, std. dev.: 0.0691) MultiSource/Applications/treecc/treecc: 4.27% (0.7875 => 0.8211, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.24% (1.4269 => 1.4874, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (1.8794 => 1.9587, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3678 => 0.3833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.19% (0.3317 => 0.3456, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.4139 => 0.4311, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3348 => 0.3487, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3282 => 0.3418, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.13% (0.3726 => 0.3880, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.3084 => 0.3211, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.01% (0.9697 => 1.0086, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.95% (0.6634 => 0.6896, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3690 => 0.3832, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.2969 => 0.3082, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.73% (0.5546 => 0.5753, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4251 => 0.4409, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4146 => 0.4300, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.52% (0.3981 => 0.4121, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 3.39% (0.3336 => 0.3449, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.5012 => 0.5173, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.6435 => 0.6633, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.62% (2.0346 => 2.0879, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (0.4847 => 0.4952, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (0.7426 => 0.7556, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6682, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8972, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1712, std. dev.: 0.0637) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6479, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2105, std. dev.: 0.0360) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5024, std. dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4402, std. dev.: 0.0260) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2845, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5937, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5362, std. dev.: 0.0192) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8074, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7924, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7452, std. dev.: 0.0764) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9631, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 02:46:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 04:46:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904094646.C1CD22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3376?compare_to=3372&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3376, Order: 163128, Start Time: 2012-09-04 08:36:48, End Time: 2012-09-04 09:47:53 To: 3372, Order: 163127, Start Time: 2012-09-04 03:57:05, End Time: 2012-09-04 05:08:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (43 on baseline) Performance Improvements: 0 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.32% (1.3198 => 1.3372, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.24% (4.2394 => 4.2919, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (4.2826 => 4.3318, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.14% (1.1635 => 1.1768, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.38% (0.0824 => 0.0926, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.79% (21.6244 => 22.4447, std. dev.: 0.2109) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.20% (2.6674 => 2.7528, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.30% (4.3982 => 4.4994, std. dev.: 0.0303) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.1653 => 1.2065, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 3.18% (0.6173 => 0.6369, std. dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 3.03% (2.1763 => 2.2422, std. dev.: 0.0195) MultiSource/Applications/lemon/lemon: 2.90% (1.0046 => 1.0337, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5150 => 1.5548, std. dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: 1.54% (29.3170 => 29.7688, std. dev.: 0.1684) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/ary3: 14.94% (1.7426 => 2.0029, std. dev.: 0.0267) SingleSource/Benchmarks/McGill/misr: 14.27% (0.4296 => 0.4909, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5544, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 12.79% (3.4406 => 3.8808, std. dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 11.93% (0.1433 => 0.1604, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.12% (0.0917 => 0.1019, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 10.81% (62.4126 => 69.1608, std. dev.: 0.0127) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.99% (1.0063 => 1.1068, std. dev.: 0.0242) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.30% (15.8312 => 17.3041, std. dev.: 0.4674) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6054, std. dev.: 0.0379) SingleSource/Benchmarks/Shootout/methcall: 7.46% (8.5566 => 9.1948, std. dev.: 0.0207) SingleSource/Benchmarks/McGill/chomp: 7.18% (1.0194 => 1.0926, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (4.2129 => 4.4994, std. dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.4876 => 3.7211, std. dev.: 0.0178) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7359, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.3301 => 0.3473, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 4.37% (15.2242 => 15.8897, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.15% (0.8498 => 0.8851, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.98% (40.4792 => 42.0907, std. dev.: 0.3154) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.27% (2.6656 => 2.7528, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 2.97% (5.1938 => 5.3479, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/ReedSolomon: 2.45% (8.5113 => 8.7198, std. dev.: 0.0550) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.43% (0.5876 => 0.6019, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 1.66% (0.6308 => 0.6413, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5321, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.34% (4.6127 => 4.6746, std. dev.: 0.0168) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6680, std. dev.: 0.0385) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (4.6414 => 4.6917, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.05% (0.2080 => 0.1975, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.29% (0.3497 => 0.2088, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.37% (5.2665 => 4.0884, std. dev.: 0.0966) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9408, std. dev.: 0.0521) SingleSource/Benchmarks/Misc/richards_benchmark: -6.79% (1.4441 => 1.3461, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (9.2503 => 8.6769, std. dev.: 0.1212) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5513, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.68% (2.4457 => 2.3069, std. dev.: 0.0444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4109, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.4140 => 0.3982, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.68% (45.4683 => 43.7971, std. dev.: 0.6066) MultiSource/Applications/lambda-0_1_3/lambda: -3.06% (7.6833 => 7.4481, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.02% (1.7361 => 1.6836, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2896, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.62% (3.7496 => 3.6512, std. dev.: 0.0195) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.58% (1.2722 => 1.2394, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.47% (1.1683 => 1.1394, std. dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -2.43% (92.7467 => 90.4955, std. dev.: 0.4110) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.06% (1.4021 => 1.3732, std. dev.: 0.0086) MultiSource/Applications/siod/siod: -1.99% (3.5520 => 3.4812, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.92% (2.8964 => 2.8408, std. dev.: 0.0207) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2200, std. dev.: 0.0188) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3683, std. dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -1.40% (3.8907 => 3.8364, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3109, std. dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 03:02:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 05:02:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904100250.CD93B2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3377?compare_to=3373&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3377, Order: 163128, Start Time: 2012-09-04 08:49:17, End Time: 2012-09-04 10:03:42 To: 3373, Order: 163127, Start Time: 2012-09-04 04:08:58, End Time: 2012-09-04 05:23:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (160 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.57% (2.0176 => 2.3923, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.40% (0.1410 => 0.1613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.35% (0.7061 => 0.7792, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 9.92% (0.3578 => 0.3933, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.76% (0.3646 => 0.4002, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3601 => 0.3951, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.68% (0.7710 => 0.8456, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 9.61% (0.3663 => 0.4015, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3623 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3650 => 0.3997, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3789 => 0.4148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.43% (0.3914 => 0.4283, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.4003 => 0.4371, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.14% (0.3940 => 0.4300, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.97% (3.9660 => 4.3217, std. dev.: 0.0118) MultiSource/Applications/hbd/hbd: 8.92% (1.3693 => 1.4915, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.82% (0.2596 => 0.2825, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.38% (0.5265 => 0.5706, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (0.4328 => 0.4689, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.12% (0.9199 => 0.9946, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.06% (1.2193 => 1.3176, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.93% (0.7038 => 0.7596, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.63% (0.6959 => 0.7490, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.53% (0.2721 => 0.2926, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.48% (1.4563 => 1.5653, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.45% (1.1364 => 1.2211, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.41% (1.9828 => 2.1298, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3293 => 0.3537, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.24% (0.1589 => 0.1704, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.23% (13.8202 => 14.8190, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.22% (0.2937 => 0.3149, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.21% (0.5577 => 0.5979, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.3756 => 0.4026, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.18% (0.1588 => 0.1702, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.18% (0.3580 => 0.3837, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4379 => 0.4688, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (7.2180 => 7.7247, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.4791 => 0.5122, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.85% (0.7506 => 0.8020, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.2914 => 0.3110, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3868 => 0.4128, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3453 => 0.3684, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.64% (0.2995 => 0.3194, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.62% (0.3246 => 0.3461, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.52% (1.0313 => 1.0985, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4390 => 0.4673, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 6.32% (0.8310 => 0.8835, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.5637 => 0.5992, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.6283 => 0.6678, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (13.2842 => 14.1126, std. dev.: 0.0055) MultiSource/Applications/Burg/burg: 6.22% (1.1061 => 1.1749, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.18% (0.3220 => 0.3419, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2243 => 0.2381, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.05% (0.2925 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4113 => 0.4359, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.2945 => 0.3120, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.81% (3.8646 => 4.0890, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.3245 => 1.4008, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.76% (1.3819 => 1.4615, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.75% (0.7460 => 0.7889, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 5.74% (0.6744 => 0.7131, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.70% (3.6692 => 3.8783, std. dev.: 0.0052) MultiSource/Applications/treecc/treecc: 5.68% (1.9270 => 2.0364, std. dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 5.67% (1.2749 => 1.3472, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.53% (1.3813 => 1.4577, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.52% (3.1889 => 3.3648, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 5.51% (2.1791 => 2.2992, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.36% (0.8698 => 0.9164, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.30% (4.3801 => 4.6121, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 5.24% (1.0594 => 1.1149, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.6135 => 0.6456, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.23% (4.4433 => 4.6756, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 5.14% (16.6129 => 17.4664, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.90% (0.8818 => 0.9250, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 4.87% (14.8535 => 15.5771, std. dev.: 0.0094) MultiSource/Benchmarks/sim/sim: 4.82% (0.3131 => 0.3282, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.76% (14.5298 => 15.2208, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.75% (0.3245 => 0.3399, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.67% (8.4961 => 8.8926, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 4.58% (1.2292 => 1.2855, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (1.1333 => 1.1846, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 4.51% (0.2859 => 0.2988, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 4.15% (4.6629 => 4.8564, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4805 => 0.4994, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (3.2742 => 3.4017, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.87% (6.5754 => 6.8297, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 3.60% (0.6250 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.9865 => 5.1645, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.44% (16.2614 => 16.8210, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.41% (1.5188 => 1.5706, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.40% (0.9108 => 0.9418, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.1007 => 2.1688, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.85% (3.7467 => 3.8533, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 2.44% (33.2944 => 34.1074, std. dev.: 0.0429) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.27% (6.2785 => 6.4211, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2667, std. dev.: 0.0377) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4126, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.13% (1.1560 => 1.2269, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7340, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1123, std. dev.: 0.0794) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5964, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.17% (1.4298 => 1.4465, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5935, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5714, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.96% (0.4657 => 0.4007, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.08% (22.5627 => 21.4174, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2732, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.42% (1.3780 => 1.3171, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9259, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5853, std. dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -2.08% (26.5159 => 25.9644, std. dev.: 0.0592) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2440, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2165, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5360, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8726, std. dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 03:07:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 05:07:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904100740.CA06E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3378?compare_to=3374&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3378, Order: 163128, Start Time: 2012-09-04 08:49:23, End Time: 2012-09-04 10:08:47 To: 3374, Order: 163127, Start Time: 2012-09-04 04:08:57, End Time: 2012-09-04 05:28:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (724 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (78.0249 => 79.1236, std. dev.: 0.2577) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.61% (10.3673 => 13.2299, std. dev.: 0.0170) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.49% (0.3543 => 0.4021, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.43% (0.3543 => 0.4019, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.37% (0.3516 => 0.3986, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3497 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.28% (0.3561 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.91% (0.3694 => 0.4171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.71% (0.3927 => 0.4426, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.59% (0.3828 => 0.4310, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.30% (0.1566 => 0.1743, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (0.1622 => 0.1800, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.74% (1.7609 => 1.9501, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.91% (2.2022 => 2.3984, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.40% (0.1584 => 0.1717, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.6030 => 0.6513, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.96% (0.7326 => 0.7836, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.86% (0.3177 => 0.3395, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 6.67% (0.1695 => 0.1808, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.62% (0.8172 => 0.8713, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4615 => 0.4907, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2271 => 0.2412, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 6.09% (0.3282 => 0.3482, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (10.4361 => 11.0641, std. dev.: 0.0204) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7433 => 0.7879, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.90% (7.0540 => 7.4700, std. dev.: 0.0094) MultiSource/Applications/minisat/minisat: 5.80% (0.7115 => 0.7528, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.80% (0.4879 => 0.5162, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 5.76% (0.3109 => 0.3288, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.74% (0.7835 => 0.8285, std. dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 5.64% (0.2554 => 0.2698, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.63% (0.5860 => 0.6190, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5569 => 0.5882, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1940 => 0.2049, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.61% (0.3423 => 0.3615, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.61% (0.3817 => 0.4031, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.59% (9.4845 => 10.0143, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (8.1363 => 8.5893, std. dev.: 0.0144) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.42% (4.2646 => 4.4958, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.40% (0.2758 => 0.2907, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.36% (1.3050 => 1.3749, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.5105 => 0.5377, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.5415 => 1.6227, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (5.0018 => 5.2620, std. dev.: 0.0141) MultiSource/Applications/d/make_dparser: 5.20% (3.3354 => 3.5088, std. dev.: 0.0181) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2603 => 0.2738, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.9449 => 5.2013, std. dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.94% (0.9765 => 1.0247, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 4.86% (1.5603 => 1.6362, std. dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 4.83% (5.7591 => 6.0370, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.6675 => 0.6987, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.8067 => 0.8439, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.56% (0.5020 => 0.5249, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.52% (0.2700 => 0.2822, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.52% (1.1642 => 1.2168, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 4.47% (0.4299 => 0.4491, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 4.46% (0.3092 => 0.3230, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.36% (0.3441 => 0.3591, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (14.3668 => 14.9907, std. dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.28% (1.1861 => 1.2369, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 4.25% (3.8723 => 4.0370, std. dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3422 => 0.3565, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.12% (2.0273 => 2.1108, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 4.07% (1.0722 => 1.1158, std. dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.2905 => 0.3017, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.84% (0.3387 => 0.3517, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.80% (0.6450 => 0.6695, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.78% (0.4289 => 0.4451, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3650 => 0.3787, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3865 => 0.4009, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4636 => 0.4807, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.69% (0.3826 => 0.3967, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.4203 => 0.4355, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.56% (2.2969 => 2.3787, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.5981 => 0.6193, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 3.53% (0.8921 => 0.9236, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 3.49% (0.3098 => 0.3206, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.4048 => 0.4188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3684 => 0.3809, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.39% (2.0665 => 2.1366, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.29% (0.3283 => 0.3391, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.4186 => 1.4652, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.24% (1.5859 => 1.6373, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.99% (17.1811 => 17.6940, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.95% (2.2024 => 2.2673, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.12% (1.1840 => 1.2091, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3102, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (0.8101 => 0.8233, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (7.9617 => 8.0903, std. dev.: 0.0155) MultiSource/Applications/JM/lencod/lencod: 1.61% (21.9371 => 22.2902, std. dev.: 0.0412) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.1396 => 1.1921, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (4.2280 => 4.3705, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7600, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2431, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7617, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.49% (5.2763 => 3.1926, std. dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.73% (5.3855 => 3.7308, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.40% (5.3526 => 3.7255, std. dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1554, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5542, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: -8.74% (22.1758 => 20.2377, std. dev.: 0.0531) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2659, std. dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (1.8329 => 1.7186, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1492, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.89% (1.6805 => 1.6151, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -3.26% (1.2373 => 1.1970, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5089, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.6802 => 8.4384, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9978, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9603, std. dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: -2.27% (12.4730 => 12.1896, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8552, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 04:16:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 06:16:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904111600.BEF932A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3379?compare_to=3376&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3379, Order: 163131, Start Time: 2012-09-04 10:04:56, End Time: 2012-09-04 11:17:09 To: 3376, Order: 163128, Start Time: 2012-09-04 08:36:48, End Time: 2012-09-04 09:47:53 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (44 on baseline) Performance Improvements: 1 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (816 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.7413 => 0.7644, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 5.17% (8.2222 => 8.6472, std. dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (42.0907 => 43.5497, std. dev.: 0.1886) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.3069 => 2.3715, std. dev.: 0.0207) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.7198 => 8.8396, std. dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.37% (22.4447 => 22.7519, std. dev.: 0.0583) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.36% (4.2919 => 4.2337, std. dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.61% (2.1763 => 2.2548, std. dev.: 0.0305) MultiSource/Applications/lemon/lemon: 3.25% (1.0046 => 1.0372, std. dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.1653 => 1.2031, std. dev.: 0.0084) MultiSource/Applications/minisat/minisat: 3.00% (0.6173 => 0.6358, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.5150 => 1.5425, std. dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 1.37% (29.3170 => 29.7196, std. dev.: 0.0714) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout/ary3: 14.84% (1.7426 => 2.0012, std. dev.: 0.0209) SingleSource/Benchmarks/McGill/misr: 14.20% (0.4296 => 0.4906, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.74% (0.0917 => 0.1043, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.29% (4.0101 => 4.5431, std. dev.: 0.0292) SingleSource/Benchmarks/Stanford/Puzzle: 13.05% (0.1433 => 0.1620, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 12.66% (3.4406 => 3.8762, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (62.4126 => 69.1443, std. dev.: 0.0613) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.01% (1.0063 => 1.0970, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6237, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.34% (3.0256 => 3.2779, std. dev.: 0.0939) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.95% (4.2129 => 4.5480, std. dev.: 0.0636) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.59% (40.4792 => 43.5497, std. dev.: 0.1886) SingleSource/Benchmarks/McGill/chomp: 7.43% (1.0194 => 1.0951, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout/methcall: 7.17% (8.5566 => 9.1704, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.4876 => 3.7340, std. dev.: 0.0438) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7425, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (0.3301 => 0.3454, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 3.95% (15.2242 => 15.8249, std. dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5403, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 3.86% (8.5113 => 8.8396, std. dev.: 0.0186) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.73% (2.6656 => 2.7649, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8731, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.6308 => 0.6512, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 3.06% (5.1938 => 5.3526, std. dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.38% (0.5587 => 0.5720, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.89% (4.6127 => 4.6997, std. dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.85% (22.3381 => 22.7519, std. dev.: 0.0583) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4455 => 2.4877, std. dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: 1.35% (8.5323 => 8.6472, std. dev.: 0.0215) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6718, std. dev.: 0.0204) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.08% (1.6110 => 1.6284, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6907, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (0.7784 => 0.7644, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.43% (0.3497 => 0.2118, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.54% (5.2665 => 4.1845, std. dev.: 0.0515) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.05% (1.1647 => 0.9894, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1613, std. dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.84% (3.2007 => 2.9176, std. dev.: 0.0404) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -6.88% (1.4441 => 1.3447, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: -6.30% (1.6538 => 1.5496, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -5.51% (9.2503 => 8.7408, std. dev.: 0.0360) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4092, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.19% (1.7361 => 1.6633, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.03% (2.4457 => 2.3715, std. dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.83% (3.7496 => 3.6433, std. dev.: 0.0214) MultiSource/Applications/lambda-0_1_3/lambda: -2.77% (7.6833 => 7.4704, std. dev.: 0.0382) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2901, std. dev.: 0.0154) MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (92.7467 => 90.7633, std. dev.: 0.4258) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.89% (1.1683 => 1.1462, std. dev.: 0.0038) MultiSource/Applications/aha/aha: -1.73% (3.4286 => 3.3693, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.72% (1.8739 => 1.8417, std. dev.: 0.0109) MultiSource/Applications/siod/siod: -1.69% (3.5520 => 3.4920, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2295, std. dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.60% (3.8907 => 3.8285, std. dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: -1.50% (2.0192 => 1.9890, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3287, std. dev.: 0.0771) SingleSource/Benchmarks/Misc/oourafft: -1.26% (3.8200 => 3.7717, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 04:31:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 06:31:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120904113123.589582A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3380?compare_to=3375&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3380, Order: 163128, Start Time: 2012-09-04 08:49:05, End Time: 2012-09-04 11:32:32 To: 3375, Order: 163127, Start Time: 2012-09-04 04:09:12, End Time: 2012-09-04 06:52:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.90% (123.6350 => 128.4555, std. dev.: 1.5709) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.1265 => 54.8003, std. dev.: 0.0855) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.15% (2.0858 => 2.1097, std. dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 14.42% (0.3460 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.39% (0.3446 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.35% (0.3442 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.30% (0.3496 => 0.3996, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.30% (0.3469 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.70% (0.3643 => 0.4142, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5826 => 0.6345, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.89% (0.1620 => 0.1764, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.5889 => 0.6411, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.96% (1.5932 => 1.7200, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (3.5627 => 3.8326, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (1.6211 => 1.7386, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 7.18% (0.7171 => 0.7686, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (1.3152 => 1.4067, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.79% (0.4361 => 0.4657, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.53% (0.4994 => 0.5320, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.34% (0.5900 => 0.6274, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (0.3930 => 0.4178, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (0.5000 => 0.5312, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.18% (0.4029 => 0.4278, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.12% (4.2109 => 4.4688, std. dev.: 0.0113) MultiSource/Applications/d/make_dparser: 6.05% (1.0781 => 1.1433, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.1968 => 0.2085, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (0.5026 => 0.5321, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (2.7292 => 2.8862, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.2866 => 0.3030, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.2736 => 0.2887, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.29% (0.2875 => 0.3027, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.25% (5.5417 => 5.8324, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 5.21% (0.9909 => 1.0425, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (1.9694 => 2.0706, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.13% (0.4658 => 0.4897, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (1.9966 => 2.0980, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2738 => 0.2877, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.99% (0.3004 => 0.3154, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.99% (0.2566 => 0.2694, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (0.3890 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.98% (0.3792 => 0.3981, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (2.1013 => 2.2060, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 4.98% (0.2811 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.95% (0.3195 => 0.3353, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.91% (0.2813 => 0.2951, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.90% (0.2714 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2823 => 0.2959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2803 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2780 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.77% (0.2911 => 0.3050, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.76% (0.2792 => 0.2925, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.72% (0.3096 => 0.3242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.69% (0.2729 => 0.2857, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.67% (2.0673 => 2.1638, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.61% (0.3903 => 0.4083, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (1.8794 => 1.9643, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.51% (0.3060 => 0.3198, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.50% (4.6177 => 4.8254, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (4.4195 => 4.6177, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.48% (0.7875 => 0.8228, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.45% (2.1653 => 2.2616, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.43% (0.3362 => 0.3511, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.42% (0.3348 => 0.3496, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3726 => 0.3890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.3258 => 0.3401, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3267 => 0.3410, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3477 => 0.3629, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3282 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.32% (23.5202 => 24.5366, std. dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/ary2: 4.28% (0.3317 => 0.3459, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.25% (0.3625 => 0.3779, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.20% (1.4269 => 1.4869, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3678 => 0.3832, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.4139 => 0.4308, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 4.07% (0.6634 => 0.6904, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.2969 => 0.3088, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3690 => 0.3837, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.88% (0.5546 => 0.5761, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4251 => 0.4412, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.76% (0.4146 => 0.4302, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.3981 => 0.4123, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.3845 => 0.3981, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.3084 => 0.3193, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.51% (0.3336 => 0.3453, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.5012 => 0.5178, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.11% (0.6435 => 0.6635, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.64% (2.0346 => 2.0883, std. dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (0.4847 => 0.4953, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (0.7426 => 0.7557, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (4.6926 => 4.7401, std. dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6703, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8948, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1731, std. dev.: 0.0365) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6272, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2004, std. dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5037, std. dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4450, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2827, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (2.0820 => 2.1097, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5886, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4778, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5273, std. dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8030, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7950, std. dev.: 0.0145) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7679, std. dev.: 0.1151) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9623, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 04:45:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 06:45:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904114510.776352A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3381?compare_to=3377&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3381, Order: 163131, Start Time: 2012-09-04 10:31:58, End Time: 2012-09-04 11:46:19 To: 3377, Order: 163128, Start Time: 2012-09-04 08:49:17, End Time: 2012-09-04 10:03:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (162 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.96% (27.6608 => 29.5853, std. dev.: 0.0429) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.29% (55.8062 => 56.5256, std. dev.: 0.0859) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.14% (0.5475 => 0.5358, std. dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.60% (2.0176 => 2.3928, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.40% (0.1410 => 0.1613, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.40% (0.7061 => 0.7795, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.89% (0.3578 => 0.3932, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3601 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3646 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3663 => 0.4017, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1413 => 0.1549, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.55% (0.3789 => 0.4151, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.55% (0.3623 => 0.3969, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.48% (0.7710 => 0.8441, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.40% (0.3914 => 0.4282, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.09% (0.3940 => 0.4298, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.98% (3.9660 => 4.3223, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.92% (1.3693 => 1.4914, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.71% (0.2596 => 0.2822, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.47% (0.5265 => 0.5711, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.14% (0.9199 => 0.9948, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.05% (1.2193 => 1.3175, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.96% (0.7038 => 0.7598, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1327 => 0.1431, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.70% (0.6959 => 0.7495, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.51% (1.4563 => 1.5656, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.49% (1.1364 => 1.2215, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3022 => 0.3247, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.41% (0.2765 => 0.2970, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.3899 => 0.4188, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.40% (1.9828 => 2.1296, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.30% (13.8202 => 14.8294, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.30% (0.5577 => 0.5984, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 7.26% (0.3293 => 0.3532, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.22% (0.2937 => 0.3149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.18% (0.3580 => 0.3837, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.12% (0.1588 => 0.1701, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.11% (0.3756 => 0.4023, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.4379 => 0.4690, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7272, std. dev.: 0.0108) MultiSource/Applications/spiff/spiff: 7.03% (0.7506 => 0.8034, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.90% (0.2914 => 0.3115, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3868 => 0.4134, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.85% (0.4791 => 0.5119, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.84% (0.2995 => 0.3200, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.81% (0.3246 => 0.3467, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.72% (0.4390 => 0.4685, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.64% (1.0313 => 1.0998, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3534 => 0.3765, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.53% (0.5637 => 0.6005, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.39% (0.8310 => 0.8841, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.38% (0.6283 => 0.6684, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.36% (1.1061 => 1.1764, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (13.2842 => 14.1098, std. dev.: 0.0151) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.15% (0.3220 => 0.3418, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: 6.06% (0.2243 => 0.2379, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4113 => 0.4359, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.91% (3.8646 => 4.0929, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.77% (1.3245 => 1.4009, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.75% (0.6744 => 0.7132, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.73% (1.9270 => 2.0374, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.72% (0.7460 => 0.7887, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.2749 => 1.3477, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 5.66% (2.1791 => 2.3025, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.64% (1.3819 => 1.4599, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (3.6692 => 3.8733, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.54% (3.1889 => 3.3655, std. dev.: 0.0111) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.49% (1.3813 => 1.4572, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.30% (0.8698 => 0.9159, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.25% (4.3801 => 4.6100, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 5.22% (1.0594 => 1.1147, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.21% (4.4433 => 4.6749, std. dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 5.20% (16.6129 => 17.4761, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.6135 => 0.6453, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.89% (14.8535 => 15.5794, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.83% (0.8818 => 0.9244, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std. dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 4.76% (0.3131 => 0.3280, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 4.69% (0.2859 => 0.2993, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.68% (14.5298 => 15.2100, std. dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: 4.64% (8.4961 => 8.8905, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (1.1333 => 1.1855, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.57% (1.2292 => 1.2854, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.20% (4.6629 => 4.8588, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4805 => 0.5001, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (6.5754 => 6.8328, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.80% (3.2742 => 3.3986, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.6250 => 0.6482, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.67% (16.2614 => 16.8587, std. dev.: 0.0264) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.9865 => 5.1651, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (1.5188 => 1.5703, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (0.9108 => 0.9415, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.1007 => 2.1708, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.91% (3.7467 => 3.8559, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 2.54% (33.2944 => 34.1408, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (6.2785 => 6.4230, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0255) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4116, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.06% (1.1560 => 1.2260, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.56% (10.7476 => 11.1303, std. dev.: 0.0624) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6009, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6135, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5936, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.00% (0.4657 => 0.4005, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.06% (22.5627 => 21.4215, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2626, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5112, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0186) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9245, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5979, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.05% (26.5159 => 25.9717, std. dev.: 0.0305) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2136, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.5928 => 4.5366, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2351, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 04:55:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 06:55:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904115524.1F4512A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3382?compare_to=3378&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3382, Order: 163131, Start Time: 2012-09-04 10:37:04, End Time: 2012-09-04 11:56:31 To: 3378, Order: 163128, Start Time: 2012-09-04 08:49:23, End Time: 2012-09-04 10:08:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (721 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.69% (79.1236 => 80.4605, std. dev.: 0.4384) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.57% (10.3673 => 13.2256, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 13.85% (0.3473 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.47% (0.3497 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.43% (0.3543 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.42% (0.3516 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.31% (0.3561 => 0.4035, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.83% (0.3694 => 0.4168, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.66% (0.3927 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.64% (0.3828 => 0.4312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.40% (0.3886 => 0.4368, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.43% (0.1566 => 0.1745, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.31% (1.1194 => 1.2460, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 10.85% (0.1622 => 0.1798, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.71% (1.7609 => 1.9495, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.85% (2.2022 => 2.3972, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.46% (0.1584 => 0.1718, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5925 => 0.6417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4615 => 0.4949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.96% (0.7326 => 0.7836, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 6.89% (0.1655 => 0.1769, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.86% (0.3177 => 0.3395, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.75% (0.8172 => 0.8724, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.43% (0.2271 => 0.2417, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.16% (0.5569 => 0.5912, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.13% (0.2758 => 0.2927, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 6.06% (0.3282 => 0.3481, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.00% (7.0540 => 7.4771, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: 5.96% (0.7115 => 0.7539, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (10.4361 => 11.0564, std. dev.: 0.0127) MultiSource/Applications/spiff/spiff: 5.88% (0.7835 => 0.8296, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7433 => 0.7869, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.86% (0.4879 => 0.5165, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.74% (0.3817 => 0.4036, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5860 => 0.6194, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 5.69% (0.3109 => 0.3286, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (8.1363 => 8.5947, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 5.60% (0.2554 => 0.2697, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 5.58% (0.3423 => 0.3614, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.57% (9.4845 => 10.0132, std. dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.51% (1.3050 => 1.3769, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.46% (1.5415 => 1.6257, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (4.2646 => 4.4948, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.29% (0.5105 => 0.5375, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.23% (4.9449 => 5.2036, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 5.16% (3.3354 => 3.5075, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (5.0018 => 5.2584, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.04% (1.5603 => 1.6389, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9765 => 1.0245, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.88% (0.5020 => 0.5265, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 4.82% (5.7591 => 6.0366, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.76% (1.1642 => 1.2196, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.75% (0.8067 => 0.8450, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.69% (0.6675 => 0.6988, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 4.63% (0.4299 => 0.4498, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.59% (0.2700 => 0.2824, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 4.46% (0.3092 => 0.3230, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.39% (0.3441 => 0.3592, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 4.33% (3.8723 => 4.0400, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (14.3668 => 14.9856, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (1.1861 => 1.2368, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.4064 => 0.4235, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3422 => 0.3565, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.16% (2.0273 => 2.1116, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 4.03% (1.0722 => 1.1154, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.6456 => 0.6710, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.90% (0.3387 => 0.3519, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.2905 => 0.3018, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3865 => 0.4008, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.67% (0.6450 => 0.6687, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.67% (2.2969 => 2.3812, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.4203 => 0.4355, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.3098 => 0.3209, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (0.4636 => 0.4801, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.4048 => 0.4191, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.52% (0.8921 => 0.9235, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (2.0665 => 2.1384, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.41% (0.3136 => 0.3243, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 3.37% (0.3052 => 0.3155, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6386, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.28% (0.3935 => 0.4064, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.4186 => 1.4651, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 3.23% (0.3283 => 0.3389, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4620 => 0.4768, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.94% (17.1811 => 17.6863, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.86% (2.2024 => 2.2654, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.29% (1.1840 => 1.2111, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3098, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.63% (21.9371 => 22.2956, std. dev.: 0.0204) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.57% (7.9617 => 8.0868, std. dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.04% (3.1578 => 3.3800, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 4.62% (1.1396 => 1.1923, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.18% (4.2280 => 4.3624, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 1.68% (9.1159 => 9.2692, std. dev.: 0.0308) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.51% (0.9540 => 0.9684, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7620, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.45% (5.2763 => 3.1950, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.63% (5.3855 => 3.7358, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7261, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.0987, std. dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5528, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -8.66% (22.1758 => 20.2564, std. dev.: 0.0248) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -10.49% (1.5373 => 1.3761, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2493, std. dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (1.8329 => 1.7186, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.82% (1.5660 => 1.4905, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.93% (1.6805 => 1.6144, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5049, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4191, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9894, std. dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9629, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1888, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5144, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.06% (1.0313 => 1.0204, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8570, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 05:42:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 07:42:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904124249.667A82A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3383?compare_to=3379&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3383, Order: 163132, Start Time: 2012-09-04 11:32:35, End Time: 2012-09-04 12:43:58 To: 3379, Order: 163131, Start Time: 2012-09-04 10:04:56, End Time: 2012-09-04 11:17:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 31 (55 on baseline) Performance Improvements: 3 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 858 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 16.23% (0.0690 => 0.0802, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.13% (0.1671 => 0.1857, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.75% (0.5543 => 0.5917, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.81% (0.4443 => 0.4701, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.69% (0.3092 => 0.3268, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.44% (0.2951 => 0.3082, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.25% (0.4420 => 0.4608, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.16% (0.2765 => 0.2880, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.79% (0.5407 => 0.5612, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8024 => 3.9389, std. dev.: 0.0205) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (1.3853 => 1.4303, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5577 => 0.5730, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (4.2337 => 4.3406, std. dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.2626 => 1.2942, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.1790 => 1.2078, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.7261 => 0.7433, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.89% (1.3200 => 1.3449, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.75% (8.2427 => 8.3872, std. dev.: 0.0532) MultiSource/Applications/lua/lua: 1.72% (3.5836 => 3.6454, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8394 => 0.8528, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.4458 => 1.4673, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.48% (4.3080 => 4.3717, std. dev.: 0.0110) MultiSource/Applications/lemon/lemon: 1.37% (1.0372 => 1.0514, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (6.4617 => 6.5495, std. dev.: 0.0087) MultiSource/Applications/treecc/treecc: 1.32% (1.8874 => 1.9123, std. dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 1.06% (14.6625 => 14.8172, std. dev.: 0.0213) MultiSource/Applications/JM/lencod/lencod: 1.03% (14.7177 => 14.8688, std. dev.: 0.0531) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.37% (0.0278 => 0.0393, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: 10.16% (3.1113 => 3.4274, std. dev.: 0.0656) MultiSource/Benchmarks/nbench/nbench: 2.64% (21.5717 => 22.1418, std. dev.: 0.1373) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.57% (2.3715 => 2.4087, std. dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.51% (1.3934 => 1.3305, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.83% (4.5480 => 4.3739, std. dev.: 0.0375) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.08% (22.7519 => 22.2793, std. dev.: 0.0771) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 4.66% (1.0046 => 1.0514, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.50% (1.1653 => 1.2177, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 4.23% (0.6173 => 0.6434, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.70% (0.4248 => 0.4405, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.5150 => 1.5671, std. dev.: 0.0133) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.7722 => 0.7985, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.08% (0.5740 => 0.5917, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.7226 => 0.7433, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.28% (0.4596 => 0.4701, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.1827 => 1.2078, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 2.06% (2.0972 => 2.1404, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.00% (15.3105 => 15.6174, std. dev.: 0.1116) MultiSource/Applications/d/make_dparser: 2.00% (3.0225 => 3.0828, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.84% (1.4408 => 1.4673, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.82% (13.3238 => 13.5657, std. dev.: 0.0377) MultiSource/Applications/Burg/burg: 1.76% (1.1440 => 1.1641, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 1.73% (1.8798 => 1.9123, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.0317 => 2.0659, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.61% (1.2021 => 1.2214, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.2742 => 1.2942, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8796 => 3.9389, std. dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/football/football: 1.46% (0.8405 => 0.8528, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.43% (14.6079 => 14.8172, std. dev.: 0.0213) MultiSource/Applications/hbd/hbd: 1.36% (1.3268 => 1.3449, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.32% (3.5980 => 3.6454, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.43% (0.0263 => 0.0393, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.90% (3.4629 => 4.2214, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.12% (0.0917 => 0.1074, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.98% (1.7426 => 2.0037, std. dev.: 0.0138) SingleSource/Benchmarks/McGill/misr: 13.73% (0.4296 => 0.4886, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.13% (4.0101 => 4.5368, std. dev.: 0.0578) MultiSource/Applications/sgefa/sgefa: 12.44% (0.3746 => 0.4212, std. dev.: 0.0052) SingleSource/Benchmarks/Stanford/Puzzle: 12.28% (0.1433 => 0.1609, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.81% (62.4126 => 69.1580, std. dev.: 0.0241) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.62% (0.2694 => 0.2980, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 9.57% (7.0025 => 7.6727, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.61% (1.0063 => 1.0929, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/methcall: 7.27% (8.5566 => 9.1784, std. dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.4876 => 3.7198, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout/heapsort: 6.58% (3.2159 => 3.4274, std. dev.: 0.0656) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7370, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (0.3301 => 0.3464, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.69% (15.2242 => 15.9375, std. dev.: 0.0190) MultiSource/Benchmarks/nbench/nbench: 4.58% (21.1721 => 22.1418, std. dev.: 0.1373) SingleSource/Benchmarks/Misc/dt: 4.37% (0.9851 => 1.0281, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.25% (40.4792 => 42.2000, std. dev.: 0.6646) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.82% (4.2129 => 4.3739, std. dev.: 0.0375) SingleSource/Benchmarks/Misc/ReedSolomon: 3.80% (8.5113 => 8.8344, std. dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std. dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.42% (0.5587 => 0.5722, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (2.4455 => 2.4896, std. dev.: 0.0123) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.61% (4.6127 => 4.6870, std. dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6735, std. dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.61% (0.3497 => 0.2077, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.97% (5.2665 => 4.2149, std. dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.84% (1.1647 => 0.9919, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std. dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.89% (3.2007 => 2.9481, std. dev.: 0.0394) SingleSource/Benchmarks/Misc/richards_benchmark: -7.24% (1.4441 => 1.3396, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/pi: -6.22% (1.6538 => 1.5510, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/methcall: -5.50% (9.2503 => 8.7415, std. dev.: 0.0893) SingleSource/Benchmarks/Shootout-C++/fibo: -5.14% (4.6355 => 4.3973, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.11% (1.4021 => 1.3305, std. dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.08% (0.4564 => 0.4332, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.43% (3.7496 => 3.6210, std. dev.: 0.0239) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.28% (1.7361 => 1.6792, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.99% (1.1683 => 1.1334, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4557, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.74% (45.4683 => 44.2227, std. dev.: 0.4712) SingleSource/Benchmarks/Misc/flops: -2.64% (9.5474 => 9.2956, std. dev.: 0.0096) MultiSource/Applications/siod/siod: -2.34% (3.5520 => 3.4688, std. dev.: 0.0091) MultiSource/Applications/aha/aha: -1.83% (3.4286 => 3.3658, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.69% (2.8964 => 2.8474, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2429, std. dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.51% (2.4457 => 2.4087, std. dev.: 0.0090) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3168, std. dev.: 0.0946) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 06:27:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 08:27:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904132727.C84772A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3384?compare_to=3381&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3384, Order: 163132, Start Time: 2012-09-04 12:14:18, End Time: 2012-09-04 13:28:36 To: 3381, Order: 163131, Start Time: 2012-09-04 10:31:58, End Time: 2012-09-04 11:46:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (163 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.09% (79.2174 => 81.6668, std. dev.: 0.0984) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.65% (2.0176 => 2.3938, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.54% (0.1410 => 0.1615, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.09% (0.5818 => 0.6463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.91% (0.5748 => 0.6375, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.04% (0.7061 => 0.7770, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.46% (0.7710 => 0.8439, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.19% (1.3693 => 1.4952, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.94% (3.9660 => 4.3207, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.78% (0.4328 => 0.4708, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.71% (0.2596 => 0.2822, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 8.50% (0.3940 => 0.4275, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.43% (0.5265 => 0.5709, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2782 => 0.3012, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.26% (0.9199 => 0.9959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.99% (0.2628 => 0.2838, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.97% (1.2193 => 1.3165, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 7.97% (0.7038 => 0.7599, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1327 => 0.1431, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.2966 => 0.3196, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.75% (1.4563 => 1.5692, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 7.75% (0.2607 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.72% (1.9828 => 2.1359, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.72% (0.2655 => 0.2860, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.71% (0.3489 => 0.3758, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.69% (0.3485 => 0.3753, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 7.68% (0.3293 => 0.3546, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.62% (0.6959 => 0.7489, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.61% (0.2760 => 0.2970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2765 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2726 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2761 => 0.2968, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.46% (0.2696 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3107 => 0.3338, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.3756 => 0.4035, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.43% (1.1364 => 1.2208, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std. dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 7.39% (13.8202 => 14.8414, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.32% (0.5577 => 0.5985, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.30% (0.1588 => 0.1704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4016 => 0.4308, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.24% (0.2127 => 0.2281, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.14% (0.3192 => 0.3420, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.3868 => 0.4143, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.09% (0.7506 => 0.8038, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 7.07% (0.3534 => 0.3784, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.4791 => 0.5127, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.97% (7.2180 => 7.7214, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.97% (0.1435 => 0.1535, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4390 => 0.4693, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.62% (0.3246 => 0.3461, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.59% (1.0313 => 1.0993, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.55% (0.5637 => 0.6006, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.47% (0.8310 => 0.8848, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.46% (0.6283 => 0.6689, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.27% (1.1061 => 1.1754, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.23% (13.2842 => 14.1112, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.09% (0.3220 => 0.3416, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 5.99% (0.6744 => 0.7148, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.98% (0.2925 => 0.3100, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.97% (0.2243 => 0.2377, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.95% (0.7460 => 0.7904, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.85% (3.8646 => 4.0907, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.78% (1.3245 => 1.4010, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.70% (0.3755 => 0.3969, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.64% (3.6692 => 3.8762, std. dev.: 0.0112) MultiSource/Applications/treecc/treecc: 5.63% (1.9270 => 2.0355, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.61% (0.8698 => 0.9186, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.60% (1.2749 => 1.3463, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.59% (0.2504 => 0.2644, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.42% (1.0594 => 1.1168, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 5.42% (2.1791 => 2.2971, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 5.38% (3.1889 => 3.3606, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.30% (1.3819 => 1.4552, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.25% (1.3813 => 1.4538, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.6135 => 0.6456, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.21% (4.4433 => 4.6748, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.20% (4.3801 => 4.6077, std. dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 5.17% (16.6129 => 17.4726, std. dev.: 0.0299) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.07% (0.8818 => 0.9265, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.2292 => 1.2894, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.80% (14.8535 => 15.5665, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 4.79% (8.4961 => 8.9027, std. dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 4.76% (0.3131 => 0.3280, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.64% (14.5298 => 15.2046, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (1.1333 => 1.1858, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.62% (0.2859 => 0.2991, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 4.24% (4.6629 => 4.8604, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.11% (3.2742 => 3.4087, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4805 => 0.5001, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (6.5754 => 6.8271, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.59% (0.9108 => 0.9435, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.50% (1.5188 => 1.5720, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.46% (4.9865 => 5.1591, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1734, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.45% (16.2614 => 16.8222, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 2.75% (3.7467 => 3.8498, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 2.70% (33.2944 => 34.1926, std. dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (6.2785 => 6.4261, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fbench: 24.99% (1.8175 => 2.2717, std. dev.: 0.0433) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.88% (1.0895 => 1.3497, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.07% (1.1560 => 1.2262, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.71% (10.7476 => 11.1465, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6134, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5888, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.00% (22.5627 => 21.4350, std. dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.37% (20.3410 => 18.2315, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.11% (1.3780 => 1.3213, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1489, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std. dev.: 0.0184) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6040, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -2.08% (26.5159 => 25.9655, std. dev.: 0.0163) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2175, std. dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.5928 => 4.5369, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2398, std. dev.: 0.0293) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 06:42:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 08:42:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904134244.9FD762A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3385?compare_to=3382&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3385, Order: 163132, Start Time: 2012-09-04 12:24:36, End Time: 2012-09-04 13:43:52 To: 3382, Order: 163131, Start Time: 2012-09-04 10:37:04, End Time: 2012-09-04 11:56:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (134 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.12% (80.4605 => 77.9479, std. dev.: 0.8473) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.76% (10.3673 => 13.1416, std. dev.: 0.0118) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.37% (0.1566 => 0.1744, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.54% (1.1194 => 1.2374, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.96% (1.7609 => 1.9363, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 9.62% (0.1622 => 0.1778, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.33% (0.1584 => 0.1716, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.11% (2.2022 => 2.3807, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.82% (0.1625 => 0.1752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.44% (0.5925 => 0.6366, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.1906 => 0.2046, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.30% (0.6030 => 0.6470, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.3177 => 0.3404, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.2758 => 0.2943, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.8172 => 0.8687, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 6.29% (0.7326 => 0.7787, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.18% (0.7835 => 0.8319, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.99% (0.2271 => 0.2407, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5569 => 0.5899, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 5.86% (10.4361 => 11.0475, std. dev.: 0.0252) MultiSource/Applications/lambda-0_1_3/lambda: 5.79% (0.7433 => 0.7863, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5860 => 0.6192, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 5.64% (0.7115 => 0.7516, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.52% (9.4845 => 10.0079, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1940 => 0.2047, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (7.0540 => 7.4430, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 5.50% (0.3109 => 0.3280, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (1.5415 => 1.6262, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 5.43% (0.3423 => 0.3609, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.3050 => 1.3755, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.39% (8.1363 => 8.5745, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.29% (4.2646 => 4.4904, std. dev.: 0.0170) MultiSource/Benchmarks/McCat/08-main/main: 5.25% (0.2554 => 0.2688, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.21% (0.5105 => 0.5371, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.16% (0.4879 => 0.5131, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.08% (3.3354 => 3.5049, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.06% (0.9765 => 1.0259, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 4.99% (5.7591 => 6.0462, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.85% (4.9449 => 5.1846, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (5.0018 => 5.2435, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 4.65% (1.5603 => 1.6329, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3817 => 0.3994, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.63% (0.6675 => 0.6984, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.57% (0.6450 => 0.6745, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 4.55% (1.1642 => 1.2172, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 4.40% (0.3180 => 0.3320, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.37% (0.2700 => 0.2818, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.35% (0.3422 => 0.3571, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.33% (0.8067 => 0.8416, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 4.32% (3.8723 => 4.0397, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.4064 => 0.4239, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.30% (0.3136 => 0.3271, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3826 => 0.3988, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.2905 => 0.3028, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.23% (0.4299 => 0.4481, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.21% (0.2872 => 0.2993, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.4203 => 0.4379, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.17% (0.3162 => 0.3294, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (1.1861 => 1.2356, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.17% (2.0273 => 2.1119, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 4.14% (0.3092 => 0.3220, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (14.3668 => 14.9549, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6456 => 0.6718, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.05% (1.0722 => 1.1156, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.05% (0.2891 => 0.3008, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4289 => 0.4462, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3865 => 0.4018, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.89% (0.3650 => 0.3792, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.87% (0.3387 => 0.3518, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3232 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2831 => 0.2938, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.5981 => 0.6207, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 3.75% (0.2877 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (2.0665 => 2.1430, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.70% (0.2756 => 0.2858, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.68% (0.4048 => 0.4197, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.66% (2.2969 => 2.3809, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.49% (0.8921 => 0.9232, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.4186 => 1.4674, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.40% (0.4620 => 0.4777, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6385, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.95% (2.2024 => 2.2674, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.76% (17.1811 => 17.6557, std. dev.: 0.0181) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.2842 => 1.3113, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.1840 => 1.2086, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.67% (0.8101 => 0.8236, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (7.9617 => 8.0685, std. dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 1.15% (21.9371 => 22.1895, std. dev.: 0.0210) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.92% (4.3953 => 10.8967, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3805, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 4.59% (1.1396 => 1.1919, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7563, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (4.2280 => 4.3636, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2412, std. dev.: 0.0152) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.04% (2.2771 => 2.3008, std. dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7620, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.73% (5.2763 => 3.1798, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7046, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7006, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1153, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5392, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.96% (22.1758 => 20.1897, std. dev.: 0.0379) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2720, std. dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.25% (1.8329 => 1.7184, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0010) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.93% (1.6805 => 1.6144, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4133, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0033, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9603, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -2.34% (1.2373 => 1.2083, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1883, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.77% (2.5528 => 2.5075, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6788, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 07:26:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 09:26:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904142656.099152A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3386?compare_to=3383&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3386, Order: 163134, Start Time: 2012-09-04 13:17:10, End Time: 2012-09-04 14:28:04 To: 3383, Order: 163132, Start Time: 2012-09-04 11:32:35, End Time: 2012-09-04 12:43:58 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (49 on baseline) Performance Improvements: 17 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 870 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.20% (2.3953 => 2.5916, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.94% (1.3305 => 1.3962, std. dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/sieve: 3.42% (3.6655 => 3.7907, std. dev.: 0.0462) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.34% (2.2754 => 2.3287, std. dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.06% (3.6210 => 3.6595, std. dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.62% (0.5917 => 0.5703, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.91% (0.7433 => 0.7291, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.79% (1.2942 => 1.2710, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.61% (4.3717 => 4.3013, std. dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.56% (1.4673 => 1.4444, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.45% (1.4357 => 1.4149, std. dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: -1.30% (1.2177 => 1.2019, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.22% (3.6454 => 3.6010, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: -1.21% (0.8528 => 0.8425, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (3.1220 => 3.0865, std. dev.: 0.0085) MultiSource/Applications/lemon/lemon: -1.11% (1.0514 => 1.0397, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.09% (2.0659 => 2.0433, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.07% (8.3872 => 8.2971, std. dev.: 0.0243) MultiSource/Benchmarks/MallocBench/gs/gs: -1.03% (3.9389 => 3.8984, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -28.26% (0.0591 => 0.0424, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.66% (1.1174 => 1.0989, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -1.25% (8.7415 => 8.6320, std. dev.: 0.0327) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 3.49% (1.0046 => 1.0397, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.40% (0.6173 => 0.6383, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 3.25% (2.1763 => 2.2470, std. dev.: 0.0232) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.1653 => 1.2019, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (12.6413 => 12.9307, std. dev.: 0.0486) MultiSource/Applications/siod/siod: 1.58% (2.0972 => 2.1303, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (1.3935 => 1.4154, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.56% (13.3238 => 13.5314, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.53% (1.1672 => 1.1851, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.47% (0.7639 => 0.7751, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.44% (3.0225 => 3.0660, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 1.38% (1.1440 => 1.1598, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 1.04% (15.3105 => 15.4695, std. dev.: 0.0534) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9961, std. dev.: 0.0195) SingleSource/Benchmarks/McGill/misr: 13.90% (0.4296 => 0.4893, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.48% (4.0101 => 4.5505, std. dev.: 0.0063) SingleSource/Benchmarks/Stanford/Puzzle: 12.98% (0.1433 => 0.1619, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3746 => 0.4200, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1037, std. dev.: 0.0687) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.18% (3.4406 => 3.7907, std. dev.: 0.0462) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6212, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 8.13% (1.0194 => 1.1023, std. dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.18% (1.0063 => 1.0786, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/methcall: 6.88% (8.5566 => 9.1456, std. dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (3.4876 => 3.7176, std. dev.: 0.0161) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (27.1724 => 28.7568, std. dev.: 0.1448) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.27% (4.2129 => 4.4351, std. dev.: 0.0433) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8460, std. dev.: 0.0524) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.04% (40.4792 => 42.1144, std. dev.: 0.5623) SingleSource/Benchmarks/Misc/dt: 3.94% (0.9851 => 1.0239, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8713, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.36% (0.3508 => 0.3626, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.33% (0.8498 => 0.8781, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 3.15% (5.1938 => 5.3573, std. dev.: 0.0555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5113 => 8.7564, std. dev.: 0.0392) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.71% (2.6656 => 2.7379, std. dev.: 0.0208) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.43% (0.5876 => 0.6019, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 1.60% (0.6308 => 0.6409, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.25% (4.6127 => 4.6703, std. dev.: 0.0179) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6682, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (2.4971 => 2.5254, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.09% (3.6254 => 3.6650, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.09% (6.7458 => 6.8193, std. dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.24% (0.3497 => 0.2055, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.47% (5.2665 => 4.0831, std. dev.: 0.0905) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.01% (1.1647 => 0.9899, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1607, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.41% (3.2007 => 2.9315, std. dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.4441 => 1.3427, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -6.68% (9.2503 => 8.6320, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.12% (2.9728 => 2.7909, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.76% (1.7361 => 1.6535, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7619, std. dev.: 0.0598) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.06% (1.2959 => 1.2433, std. dev.: 0.0132) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.65% (0.4140 => 0.3989, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -2.92% (7.6833 => 7.4587, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0138) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.66% (1.2722 => 1.2384, std. dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -2.63% (92.7467 => 90.3113, std. dev.: 0.7781) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.40% (3.7496 => 3.6595, std. dev.: 0.0084) MultiSource/Applications/siod/siod: -2.33% (3.5520 => 3.4692, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.20% (61.1734 => 59.8280, std. dev.: 0.4958) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3626, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2324, std. dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -1.49% (1.7330 => 1.7072, std. dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -1.43% (3.8907 => 3.8350, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3084, std. dev.: 0.0336) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.14% (1.1116 => 1.0989, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -1.12% (16.5617 => 16.3762, std. dev.: 0.0633) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 07:42:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 09:42:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120904144242.786812A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3387?compare_to=3380&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3387, Order: 163132, Start Time: 2012-09-04 12:00:25, End Time: 2012-09-04 14:43:48 To: 3380, Order: 163128, Start Time: 2012-09-04 08:49:05, End Time: 2012-09-04 11:32:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 31.50% (56.9620 => 74.9075, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.06% (128.4555 => 124.5223, std. dev.: 1.4790) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3446 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.38% (0.3460 => 0.3923, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.85% (0.3650 => 0.4119, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.79% (0.3643 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.36% (0.5826 => 0.6313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5889 => 0.6378, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1620 => 0.1753, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.29% (1.5932 => 1.7094, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (1.6211 => 1.7363, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (3.5627 => 3.8133, std. dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7171 => 0.7648, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.62% (1.3152 => 1.4023, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.47% (0.4361 => 0.4643, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.2014 => 0.2143, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (0.4994 => 0.5307, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.25% (0.5026 => 0.5340, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (0.5000 => 0.5300, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (0.3930 => 0.4165, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.91% (4.2109 => 4.4597, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.83% (0.5900 => 0.6244, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 5.69% (1.0781 => 1.1394, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.2866 => 0.3020, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.23% (2.7292 => 2.8719, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2875 => 0.3024, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.15% (5.5417 => 5.8270, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.90% (0.2714 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.89% (0.2738 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.2803 => 0.2940, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (0.4658 => 0.4884, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3195 => 0.3349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.79% (0.3004 => 0.3148, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.78% (0.3890 => 0.4076, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.75% (2.1013 => 2.2012, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.74% (1.9694 => 2.0627, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 4.73% (0.2811 => 0.2944, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.69% (0.9909 => 1.0374, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.69% (0.2750 => 0.2879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.68% (0.2823 => 0.2955, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (1.9966 => 2.0889, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.60% (0.2780 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2813 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.55% (0.3096 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.54% (2.0673 => 2.1611, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.2911 => 0.3043, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.3903 => 0.4077, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 4.45% (0.3258 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.35% (1.4269 => 1.4889, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (1.8794 => 1.9605, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.28% (0.3060 => 0.3191, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.25% (4.6177 => 4.8141, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (2.1653 => 2.2561, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.15% (23.5202 => 24.4971, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.3477 => 0.3621, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (4.4195 => 4.6021, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3726 => 0.3878, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.08% (0.7875 => 0.8196, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.3678 => 0.3827, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3317 => 0.3451, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3792 => 0.3945, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.4139 => 0.4306, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.03% (0.3348 => 0.3483, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3625 => 0.3769, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3690 => 0.3835, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.83% (0.6634 => 0.6888, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.69% (0.9697 => 1.0055, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4146 => 0.4299, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4251 => 0.4407, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.64% (0.5546 => 0.5748, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.3084 => 0.3192, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.47% (0.2969 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.39% (0.3336 => 0.3449, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.3845 => 0.3972, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.5012 => 0.5169, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.6435 => 0.6631, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.72% (2.0346 => 2.0900, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.27% (0.4847 => 0.4957, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (0.7426 => 0.7555, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.2122 => 0.2269, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6692, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2074, std. dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5003, std. dev.: 0.0251) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4560, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2856, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5867, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5592, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -10.16% (0.2402 => 0.2158, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7961, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std. dev.: 0.0029) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -2.96% (17.2379 => 16.7271, std. dev.: 0.0631) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.64% (0.6293 => 0.6127, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9668, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 4.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 08:09:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 10:09:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904150944.166C12A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3388?compare_to=3384&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3388, Order: 163134, Start Time: 2012-09-04 13:56:38, End Time: 2012-09-04 15:10:52 To: 3384, Order: 163132, Start Time: 2012-09-04 12:14:18, End Time: 2012-09-04 13:28:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (162 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.41% (2.0176 => 2.3890, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.47% (0.1410 => 0.1614, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.80% (0.5748 => 0.6369, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.79% (0.5818 => 0.6446, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.98% (0.3578 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.81% (0.7061 => 0.7754, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.75% (0.7710 => 0.8462, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3601 => 0.3951, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 9.65% (0.3646 => 0.3998, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1413 => 0.1549, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3663 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.55% (0.3623 => 0.3969, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3789 => 0.4148, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.45% (0.3650 => 0.3995, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 9.38% (0.3914 => 0.4281, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.07% (1.3693 => 1.4935, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 8.98% (0.3940 => 0.4294, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.92% (3.9660 => 4.3199, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.67% (0.2596 => 0.2821, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.52% (0.2781 => 0.3018, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.30% (0.5265 => 0.5702, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2782 => 0.3012, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.17% (0.9199 => 0.9951, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.96% (1.2193 => 1.3164, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.81% (1.9828 => 2.1376, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.79% (0.2607 => 0.2810, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2655 => 0.2861, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.2966 => 0.3196, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (0.2628 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.68% (0.3293 => 0.3546, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2760 => 0.2972, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.66% (0.6959 => 0.7492, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7038 => 0.7576, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2726 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.61% (0.1327 => 0.1428, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2765 => 0.2974, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3489 => 0.3751, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.46% (0.2761 => 0.2967, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3756 => 0.4036, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.45% (1.4563 => 1.5648, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.5577 => 0.5989, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.35% (0.2721 => 0.2921, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4016 => 0.4311, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.34% (0.3107 => 0.3335, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.33% (1.1364 => 1.2197, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 7.33% (0.3453 => 0.3706, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.30% (0.3149 => 0.3379, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.2988 => 0.3205, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.3868 => 0.4147, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.21% (13.8202 => 14.8169, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary2: 7.21% (0.3192 => 0.3422, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (7.2180 => 7.7336, std. dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.08% (0.4379 => 0.4689, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.02% (0.7506 => 0.8033, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.93% (0.1588 => 0.1698, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4390 => 0.4693, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.78% (0.2995 => 0.3198, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.74% (0.4791 => 0.5114, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.62% (0.3246 => 0.3461, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.39% (1.0313 => 1.0972, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.35% (0.5637 => 0.5995, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 6.33% (0.8310 => 0.8836, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 6.25% (1.1061 => 1.1752, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.19% (13.2842 => 14.1061, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.18% (0.6283 => 0.6671, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2243 => 0.2381, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.09% (0.3220 => 0.3416, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4113 => 0.4359, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.89% (3.8646 => 4.0922, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.76% (0.7460 => 0.7890, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.3245 => 1.4008, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.69% (0.6744 => 0.7128, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.66% (1.9270 => 2.0360, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.62% (3.6692 => 3.8754, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.57% (0.3755 => 0.3964, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.51% (1.2749 => 1.3452, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.8698 => 0.9176, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (1.3813 => 1.4550, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.31% (3.1889 => 3.3583, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 5.31% (2.1791 => 2.2948, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.28% (1.3819 => 1.4549, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.22% (4.4433 => 4.6751, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.20% (4.3801 => 4.6077, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.17% (1.0594 => 1.1142, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.14% (16.6129 => 17.4665, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.00% (0.6135 => 0.6442, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.93% (1.2292 => 1.2898, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.89% (0.8818 => 0.9249, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.81% (14.8535 => 15.5683, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.71% (0.3245 => 0.3398, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.70% (8.4961 => 8.8950, std. dev.: 0.0199) MultiSource/Benchmarks/sim/sim: 4.69% (0.3131 => 0.3278, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (1.1333 => 1.1852, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.56% (14.5298 => 15.1927, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 4.51% (0.2859 => 0.2988, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.13% (4.6629 => 4.8554, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.04% (0.4805 => 0.4999, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (3.2742 => 3.4005, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.6250 => 0.6486, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (6.5754 => 6.8200, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (4.9865 => 5.1610, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (0.9108 => 0.9415, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.34% (16.2614 => 16.8050, std. dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.29% (1.5188 => 1.5687, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.1007 => 2.1669, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.75% (3.7467 => 3.8496, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (6.2785 => 6.4324, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.44% (33.2944 => 34.1060, std. dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.11% (1.8175 => 2.2557, std. dev.: 0.0552) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.13% (1.1560 => 1.2269, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 6.00% (1.2998 => 1.3778, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7343, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1163, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5964, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.91% (1.5824 => 1.6127, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5937, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.04% (0.4657 => 0.4003, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.11% (22.5627 => 21.4106, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2674, std. dev.: 0.0282) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.42% (1.3780 => 1.3171, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9220, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5969, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -2.12% (26.5159 => 25.9542, std. dev.: 0.0161) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2534, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2147, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.5928 => 4.5378, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2373, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 08:30:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 10:30:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904153028.036462A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3389?compare_to=3385&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3389, Order: 163134, Start Time: 2012-09-04 14:12:06, End Time: 2012-09-04 15:31:36 To: 3385, Order: 163132, Start Time: 2012-09-04 12:24:36, End Time: 2012-09-04 13:43:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.89% (77.9479 => 80.1997, std. dev.: 0.6437) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.23% (54.5371 => 55.7522, std. dev.: 0.3783) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.79% (10.3673 => 13.1449, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3473 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.43% (0.1566 => 0.1745, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.78% (1.1194 => 1.2401, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.15% (1.7609 => 1.9396, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 9.62% (0.1622 => 0.1778, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.27% (0.1584 => 0.1715, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.13% (2.2022 => 2.3812, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.2065 => 0.2222, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 7.49% (0.5925 => 0.6369, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.36% (0.6030 => 0.6474, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 6.89% (0.1655 => 0.1769, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.8172 => 0.8715, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.36% (0.7326 => 0.7792, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2271 => 0.2414, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7433 => 0.7892, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4615 => 0.4894, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 6.03% (10.4361 => 11.0657, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5860 => 0.6208, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.71% (0.7835 => 0.8282, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 5.70% (0.3282 => 0.3469, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.66% (0.7115 => 0.7518, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5569 => 0.5879, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 5.50% (0.3109 => 0.3280, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (7.0540 => 7.4394, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.44% (9.4845 => 10.0001, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/18-imp/imp: 5.40% (0.3423 => 0.3608, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (1.5415 => 1.6239, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.33% (0.2758 => 0.2905, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (4.2646 => 4.4912, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.30% (8.1363 => 8.5672, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.29% (0.3121 => 0.3286, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.3050 => 1.3736, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.25% (0.5105 => 0.5373, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2554 => 0.2686, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (4.9449 => 5.1947, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 5.03% (5.7591 => 6.0487, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.8067 => 0.8472, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.99% (3.3354 => 3.5019, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.96% (0.9765 => 1.0249, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (5.0018 => 5.2452, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.72% (0.3817 => 0.3997, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3441 => 0.3601, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.58% (0.6675 => 0.6981, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.58% (1.5603 => 1.6317, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.5020 => 0.5247, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 4.43% (1.1642 => 1.2158, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.3422 => 0.3572, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.4064 => 0.4242, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.34% (0.4636 => 0.4837, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2700 => 0.2817, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.4103 => 0.4280, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.28% (0.3180 => 0.3316, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (1.1861 => 1.2367, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4203 => 0.4382, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 4.23% (0.4299 => 0.4481, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.22% (2.0273 => 2.1128, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3092 => 0.3222, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (14.3668 => 14.9705, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.18% (0.2872 => 0.2992, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.11% (3.8723 => 4.0316, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6456 => 0.6721, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4289 => 0.4464, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 4.07% (0.3387 => 0.3525, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 4.02% (0.3603 => 0.3748, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 3.98% (1.0722 => 1.1149, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.93% (0.3052 => 0.3172, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.4048 => 0.4206, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.86% (0.3650 => 0.3791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.82% (0.2877 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.2831 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (2.0665 => 2.1428, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.69% (0.3826 => 0.3967, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.68% (2.2969 => 2.3815, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3162 => 0.3275, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.56% (0.8921 => 0.9239, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.5981 => 0.6193, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.48% (0.3935 => 0.4072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.47% (0.3283 => 0.3397, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.40% (0.4620 => 0.4777, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (1.4186 => 1.4640, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (2.2024 => 2.2663, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.77% (17.1811 => 17.6563, std. dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3125, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (7.9617 => 8.1042, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (0.8101 => 0.8239, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.09% (21.9371 => 22.1772, std. dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 4.69% (1.1396 => 1.1930, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (4.2280 => 4.3599, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7474, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.43% (1.3045 => 1.3232, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2233, std. dev.: 0.0174) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5756, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7621, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.66% (5.2763 => 3.1839, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7065, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7003, std. dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1265, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.64% (2.9384 => 2.5375, std. dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -8.92% (22.1758 => 20.1971, std. dev.: 0.0266) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2915, std. dev.: 0.0691) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (1.8329 => 1.7197, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.90% (1.6805 => 1.6150, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5052, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4258, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0100, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9614, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -2.29% (12.4730 => 12.1872, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -2.25% (1.2373 => 1.2095, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5144, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2329, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.05% (1.0313 => 1.0205, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 09:11:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 11:11:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904161113.2F33E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3390?compare_to=3386&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3390, Order: 163136, Start Time: 2012-09-04 15:00:47, End Time: 2012-09-04 16:12:21 To: 3386, Order: 163134, Start Time: 2012-09-04 13:17:10, End Time: 2012-09-04 14:28:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (42 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 5.11% (8.1079 => 8.5226, std. dev.: 0.0496) SingleSource/Benchmarks/Shootout-C++/sieve: 2.37% (3.7907 => 3.8807, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.42% (1.6535 => 1.6769, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: 1.36% (4.3063 => 4.3648, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.50% (0.8029 => 0.7668, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.22% (1.4117 => 1.3804, std. dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 4.18% (0.6173 => 0.6431, std. dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 3.63% (1.1653 => 1.2076, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 3.40% (1.0046 => 1.0388, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.91% (2.1763 => 2.2397, std. dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (12.6413 => 12.8520, std. dev.: 0.0677) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 39.54% (0.0263 => 0.0367, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0017, std. dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.73% (4.0101 => 4.5606, std. dev.: 0.0570) SingleSource/Benchmarks/Shootout-C++/sieve: 12.79% (3.4406 => 3.8807, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 12.31% (0.3746 => 0.4207, std. dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 11.72% (0.1433 => 0.1601, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0920, std. dev.: 0.0553) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 9.21% (7.0025 => 7.6477, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.17% (1.0063 => 1.0986, std. dev.: 0.0251) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.90% (15.8312 => 17.2402, std. dev.: 0.5102) SingleSource/Benchmarks/McGill/misr: 7.75% (0.4296 => 0.4629, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout/methcall: 7.54% (8.5566 => 9.2018, std. dev.: 0.0138) SingleSource/Benchmarks/McGill/chomp: 6.81% (1.0194 => 1.0888, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (3.4876 => 3.7116, std. dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.85% (27.1724 => 28.7620, std. dev.: 0.1348) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.60% (4.2129 => 4.4069, std. dev.: 0.0701) SingleSource/Benchmarks/Misc/fp-convert: 4.19% (15.2242 => 15.8614, std. dev.: 0.0443) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8387, std. dev.: 0.0271) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.46% (2.6656 => 2.7578, std. dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (2.4042 => 2.4638, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.25% (1.2726 => 1.3012, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/five11/five11: 2.14% (5.1938 => 5.3047, std. dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5328, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4455 => 2.4802, std. dev.: 0.0116) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6722, std. dev.: 0.0354) MultiSource/Applications/JM/lencod/lencod: 1.20% (6.7458 => 6.8265, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.11% (4.6414 => 4.6929, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.08% (3.6254 => 3.6646, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.39% (0.2004 => 0.1896, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.83% (0.3497 => 0.2104, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.42% (5.2665 => 4.0857, std. dev.: 0.1808) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.63% (1.1647 => 0.9827, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -12.17% (8.1594 => 7.1660, std. dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.49% (3.2007 => 2.9290, std. dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -7.17% (1.4441 => 1.3405, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: -6.10% (1.6538 => 1.5530, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: -5.99% (9.2503 => 8.6962, std. dev.: 0.0708) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7966, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: -4.84% (4.6355 => 4.4112, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7625, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.41% (1.7361 => 1.6769, std. dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.25% (1.2959 => 1.2538, std. dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.09% (2.4457 => 2.3702, std. dev.: 0.0270) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -2.98% (7.6833 => 7.4544, std. dev.: 0.0336) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.64% (1.1683 => 1.1374, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -2.58% (9.5474 => 9.3007, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.55% (3.7496 => 3.6539, std. dev.: 0.0144) MultiSource/Benchmarks/PAQ8p/paq8p: -2.42% (92.7467 => 90.5007, std. dev.: 0.4915) MultiSource/Applications/siod/siod: -2.42% (3.5520 => 3.4661, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: -2.22% (1.4117 => 1.3804, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/neural/neural: -1.91% (1.0926 => 1.0717, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.76% (1.0686 => 1.0498, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2291, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -1.59% (1.7330 => 1.7055, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.3569 => 2.3219, std. dev.: 0.0118) MultiSource/Benchmarks/sim/sim: -1.47% (3.8907 => 3.8335, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3071, std. dev.: 0.0333) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7697, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.01% (1.1116 => 1.1004, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 09:51:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 11:51:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904165152.117B22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3391?compare_to=3388&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3391, Order: 163137, Start Time: 2012-09-04 15:38:50, End Time: 2012-09-04 16:52:58 To: 3388, Order: 163134, Start Time: 2012-09-04 13:56:38, End Time: 2012-09-04 15:10:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (162 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.34% (2.0176 => 2.3876, std. dev.: 0.0152) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.33% (0.1410 => 0.1612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 10.61% (0.5818 => 0.6435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.44% (0.5748 => 0.6348, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.64% (0.7710 => 0.8453, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.49% (0.7061 => 0.7731, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.48% (0.1413 => 0.1547, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/synchronized: 9.28% (0.3663 => 0.4003, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.05% (3.9660 => 4.3249, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.92% (0.3914 => 0.4263, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.81% (1.3693 => 1.4899, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.63% (0.2596 => 0.2820, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.36% (0.4328 => 0.4690, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.30% (0.5265 => 0.5702, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.12% (0.9199 => 0.9946, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.92% (1.2193 => 1.3159, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.72% (0.7038 => 0.7581, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.46% (0.6959 => 0.7478, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.40% (1.4563 => 1.5640, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.39% (0.2721 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.32% (13.8202 => 14.8319, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.30% (0.5577 => 0.5984, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3899 => 0.4182, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.23% (1.1364 => 1.2186, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.12% (0.2937 => 0.3146, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.11% (0.1589 => 0.1702, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3293 => 0.3527, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.03% (0.3485 => 0.3730, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.99% (0.3246 => 0.3473, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.99% (0.4791 => 0.5126, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.99% (0.4379 => 0.4685, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.96% (1.9828 => 2.1208, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.91% (0.7506 => 0.8025, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.90% (0.3580 => 0.3827, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.89% (7.2180 => 7.7150, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3489 => 0.3729, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.82% (0.3756 => 0.4012, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.67% (0.4016 => 0.4284, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.67% (0.5637 => 0.6013, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 6.57% (1.0313 => 1.0991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.51% (0.2995 => 0.3190, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4390 => 0.4673, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.36% (0.3868 => 0.4114, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.30% (0.3220 => 0.3423, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.30% (0.6283 => 0.6679, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.28% (1.1061 => 1.1756, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (13.2842 => 14.1091, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.15% (0.8310 => 0.8821, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.01% (0.1865 => 0.1977, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.93% (0.2243 => 0.2376, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.80% (0.7460 => 0.7893, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 5.73% (3.8646 => 4.0861, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.69% (1.3245 => 1.3998, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 5.66% (1.9270 => 2.0361, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.62% (0.6744 => 0.7123, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.59% (0.4113 => 0.4343, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.57% (1.2749 => 1.3459, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.54% (3.1889 => 3.3657, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.52% (1.3819 => 1.4582, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (3.6692 => 3.8711, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.3813 => 1.4562, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 5.19% (2.1791 => 2.2923, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.17% (0.8698 => 0.9148, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3755 => 0.3949, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.12% (1.0594 => 1.1136, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.02% (4.3801 => 4.5999, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.93% (4.4433 => 4.6625, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.89% (0.6135 => 0.6435, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.4011, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 4.72% (14.5298 => 15.2151, std. dev.: 0.0137) MultiSource/Benchmarks/sim/sim: 4.69% (0.3131 => 0.3278, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.66% (14.8535 => 15.5450, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.50% (0.8818 => 0.9215, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.49% (8.4961 => 8.8778, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (1.1333 => 1.1829, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.38% (0.3245 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.34% (0.2859 => 0.2983, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.4805 => 0.4993, std. dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.88% (4.6629 => 4.8438, std. dev.: 0.0164) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (6.5754 => 6.8219, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (3.2742 => 3.3965, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.58% (16.2614 => 16.8431, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.55% (4.9865 => 5.1635, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.6250 => 0.6469, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.23% (1.5188 => 1.5678, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.1007 => 2.1661, std. dev.: 0.0192) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.09% (0.9108 => 0.9389, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.76% (3.7467 => 3.8501, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 2.34% (33.2944 => 34.0732, std. dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (6.2785 => 6.4145, std. dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0453) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (3.1736 => 3.4174, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.02% (1.1560 => 1.2256, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.76% (10.7476 => 11.1514, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.96% (1.5824 => 1.6134, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5152, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.43% (0.4657 => 0.3985, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.08% (22.5627 => 21.4159, std. dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2956, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3170, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std. dev.: 0.0096) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9242, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6021, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -2.05% (26.5159 => 25.9716, std. dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2479, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2308, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5352, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 10:18:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 12:18:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904171803.256FF2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3392?compare_to=3389&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3392, Order: 163137, Start Time: 2012-09-04 15:59:49, End Time: 2012-09-04 17:19:11 To: 3389, Order: 163134, Start Time: 2012-09-04 14:12:06, End Time: 2012-09-04 15:31:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.81% (13.1449 => 13.5146, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.42% (55.7522 => 56.5435, std. dev.: 0.0271) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.36% (10.3673 => 13.5146, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 13.53% (0.3473 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3497 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.15% (0.3543 => 0.4009, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3543 => 0.4007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3561 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3694 => 0.4159, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.51% (0.3828 => 0.4307, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.17% (0.3886 => 0.4359, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.56% (0.1566 => 0.1747, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.93% (1.1194 => 1.2417, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 10.54% (0.1622 => 0.1793, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.18% (1.7609 => 1.9401, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.78% (2.2022 => 2.3956, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.27% (0.1584 => 0.1715, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.19% (0.1906 => 0.2043, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4615 => 0.4941, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.93% (0.2107 => 0.2253, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.67% (0.7326 => 0.7815, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.63% (0.8172 => 0.8714, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.28% (0.3282 => 0.3488, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.99% (0.7835 => 0.8304, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 5.95% (10.4361 => 11.0570, std. dev.: 0.0161) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.94% (0.2271 => 0.2406, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 5.92% (0.3109 => 0.3293, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.3307 => 0.3502, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.83% (0.7115 => 0.7530, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (7.0540 => 7.4602, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 5.74% (9.4845 => 10.0292, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.71% (0.5569 => 0.5887, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 5.64% (0.7433 => 0.7852, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5415 => 1.6275, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.53% (0.3817 => 0.4028, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.51% (0.5860 => 0.6183, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (8.1363 => 8.5847, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.3050 => 1.3768, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 5.49% (0.3423 => 0.3611, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (4.2646 => 4.4951, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.17% (0.5105 => 0.5369, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.11% (0.9765 => 1.0264, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 5.07% (3.3354 => 3.5044, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (4.9449 => 5.1953, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (5.0018 => 5.2509, std. dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 4.89% (0.2554 => 0.2679, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.81% (5.7591 => 6.0361, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.78% (0.5020 => 0.5260, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.67% (1.1642 => 1.2186, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.6675 => 0.6982, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.60% (1.5603 => 1.6320, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 4.54% (0.4299 => 0.4494, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.48% (0.4103 => 0.4287, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.45% (0.8067 => 0.8426, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (14.3668 => 15.0050, std. dev.: 0.0308) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.37% (0.2700 => 0.2818, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.3180 => 0.3317, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (1.1861 => 1.2367, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 4.24% (0.3092 => 0.3223, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.10% (2.0273 => 2.1104, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 4.05% (3.8723 => 4.0291, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (0.4064 => 0.4228, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 4.03% (0.3422 => 0.3560, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.02% (0.3387 => 0.3523, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 3.94% (1.0722 => 1.1144, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6456 => 0.6709, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.88% (0.6450 => 0.6700, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.2905 => 0.3017, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4203 => 0.4362, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.73% (0.2872 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.3098 => 0.3213, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.68% (0.8921 => 0.9249, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5981 => 0.6195, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.55% (0.2871 => 0.2973, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.50% (0.3826 => 0.3960, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4289 => 0.4439, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.49% (2.0665 => 2.1387, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3865 => 0.3998, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.44% (2.2969 => 2.3758, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.4048 => 0.4187, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3603 => 0.3726, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.35% (0.3162 => 0.3268, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.4186 => 1.4661, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.31% (0.4620 => 0.4773, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.29% (0.3283 => 0.3391, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.24% (1.5859 => 1.6373, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.95% (2.2024 => 2.2674, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.92% (17.1811 => 17.6833, std. dev.: 0.0173) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.1840 => 1.2110, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.78% (7.9617 => 8.1036, std. dev.: 0.0187) MultiSource/Applications/JM/lencod/lencod: 1.62% (21.9371 => 22.2925, std. dev.: 0.0230) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.8101 => 0.8228, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0023) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3811, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 4.64% (1.1396 => 1.1925, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7583, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.24% (4.2280 => 4.3648, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std. dev.: 0.0156) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7618, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.61% (5.2763 => 3.1861, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7137, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7126, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1503, std. dev.: 0.0820) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5456, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -8.90% (22.1758 => 20.2019, std. dev.: 0.0358) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (19.9488 => 18.2356, std. dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (1.8329 => 1.7197, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std. dev.: 0.0035) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1491, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4307, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0068, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (8.1563 => 7.9568, std. dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: -2.33% (1.2373 => 1.2085, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -2.27% (12.4730 => 12.1896, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2263, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 10:37:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 12:37:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904173752.475D22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3393?compare_to=3390&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3393, Order: 163142, Start Time: 2012-09-04 16:28:12, End Time: 2012-09-04 17:38:58 To: 3390, Order: 163136, Start Time: 2012-09-04 15:00:47, End Time: 2012-09-04 16:12:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 26 (51 on baseline) Performance Improvements: 1 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 865 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 63.20% (0.0250 => 0.0408, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.2990 => 0.3210, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1896 => 0.2018, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.60% (0.2738 => 0.2864, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.45% (0.7668 => 0.8009, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.44% (0.2949 => 0.3080, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7440 => 0.7769, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.37% (0.5635 => 0.5881, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.7126 => 0.7382, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.18% (0.4561 => 0.4706, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.69% (0.5871 => 0.6029, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.54% (0.5561 => 0.5702, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.8930 => 0.9115, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.00% (1.1583 => 1.1815, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 1.86% (1.3084 => 1.3328, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.63% (3.9906 => 4.0555, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.58% (0.6409 => 0.6510, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.2564 => 1.2760, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.32% (1.1893 => 1.2050, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.21% (1.5337 => 1.5522, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (1.4144 => 1.4313, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (6.2277 => 6.2910, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.05% (0.7343 => 0.7787, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/misr: 4.52% (0.4629 => 0.4838, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.55% (4.0151 => 4.0773, std. dev.: 0.0224) SingleSource/Benchmarks/Misc/whetstone: 1.24% (2.3656 => 2.3949, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -4.17% (1.8687 => 1.7907, std. dev.: 0.0298) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.78% (0.1414 => 0.1524, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.1653 => 1.2097, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.72% (0.7722 => 0.8009, std. dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 3.46% (2.1763 => 2.2515, std. dev.: 0.0261) MultiSource/Applications/minisat/minisat: 3.00% (0.6173 => 0.6358, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.92% (0.4248 => 0.4372, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.86% (1.0046 => 1.0333, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.46% (0.5740 => 0.5881, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.46% (1.5150 => 1.5522, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.39% (0.4596 => 0.4706, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (12.6413 => 12.9144, std. dev.: 0.0339) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.16% (0.7226 => 0.7382, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.89% (1.1827 => 1.2050, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.82% (3.0225 => 3.0776, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.6410 => 0.6510, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.42% (1.1440 => 1.1603, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.17% (29.3170 => 29.6611, std. dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.38% (4.0101 => 4.5468, std. dev.: 0.0561) SingleSource/Benchmarks/Stanford/Puzzle: 12.98% (0.1433 => 0.1619, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 12.62% (0.4296 => 0.4838, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.10% (0.0917 => 0.1028, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.67% (62.4126 => 69.0700, std. dev.: 0.0372) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.18% (1.0063 => 1.0987, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6067, std. dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/sieve: 8.40% (3.4406 => 3.7296, std. dev.: 0.0620) SingleSource/Benchmarks/Shootout/methcall: 7.41% (8.5566 => 9.1910, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.4876 => 3.7185, std. dev.: 0.0121) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7378, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (0.3301 => 0.3463, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: 4.07% (0.9851 => 1.0252, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 3.98% (15.2242 => 15.8300, std. dev.: 0.0498) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8718, std. dev.: 0.0271) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (40.4792 => 41.8303, std. dev.: 0.4548) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.91% (0.5876 => 0.6047, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5113 => 8.7527, std. dev.: 0.0549) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (2.4455 => 2.5032, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.34% (0.7609 => 0.7787, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: 2.11% (2.3453 => 2.3949, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/five11/five11: 1.91% (5.1938 => 5.2930, std. dev.: 0.0337) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5318, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.19% (14.4877 => 14.6599, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.98% (0.3497 => 0.2134, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.73% (5.2665 => 4.1220, std. dev.: 0.0621) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.66% (1.1647 => 0.9940, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.24% (3.2007 => 2.9371, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/richards_benchmark: -7.28% (1.4441 => 1.3389, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: -6.32% (9.2503 => 8.6657, std. dev.: 0.0305) SingleSource/Benchmarks/Misc/pi: -6.25% (1.6538 => 1.5505, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4059, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (3.9413 => 3.7614, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -4.44% (1.8739 => 1.7907, std. dev.: 0.0298) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.27% (1.7361 => 1.6620, std. dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.19% (2.4457 => 2.3432, std. dev.: 0.0331) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.2722 => 1.2317, std. dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4548, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.80% (1.1683 => 1.1356, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2857, std. dev.: 0.0238) MultiSource/Benchmarks/PAQ8p/paq8p: -2.71% (92.7467 => 90.2328, std. dev.: 0.4912) MultiSource/Applications/siod/siod: -2.37% (3.5520 => 3.4677, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.26% (3.7496 => 3.6649, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (9.3855 => 9.2155, std. dev.: 0.0500) MultiSource/Applications/aha/aha: -1.75% (3.4286 => 3.3687, std. dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.44% (3.8907 => 3.8346, std. dev.: 0.0174) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3073, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 10:54:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 12:54:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120904175445.C3BB42A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3394?compare_to=3387&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3394, Order: 163136, Start Time: 2012-09-04 15:12:35, End Time: 2012-09-04 17:55:54 To: 3387, Order: 163132, Start Time: 2012-09-04 12:00:25, End Time: 2012-09-04 14:43:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (127 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.55% (1.7094 => 1.7359, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.11% (2.0737 => 2.1174, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.1164 => 54.7099, std. dev.: 0.1535) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.52% (2.5391 => 2.5004, std. dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.10% (0.3650 => 0.4128, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.09% (0.3643 => 0.4120, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 8.96% (1.5932 => 1.7359, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 8.77% (0.5826 => 0.6337, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5889 => 0.6400, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.44% (0.1505 => 0.1617, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.33% (1.3152 => 1.4116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.24% (3.5627 => 3.8205, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.23% (1.6211 => 1.7383, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 7.10% (0.7171 => 0.7680, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.95% (0.4361 => 0.4664, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.67% (0.4994 => 0.5327, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.52% (0.5000 => 0.5326, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 6.43% (1.0781 => 1.1474, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (0.5026 => 0.5347, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.2866 => 0.3049, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.14% (4.2109 => 4.4694, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (0.3930 => 0.4171, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.10% (0.5900 => 0.6260, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.98% (0.4029 => 0.4270, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.74% (0.2875 => 0.3040, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.63% (0.3195 => 0.3375, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.57% (5.5417 => 5.8506, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std. dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 5.53% (0.3004 => 0.3170, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.44% (1.9694 => 2.0765, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2729 => 0.2877, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.38% (2.7292 => 2.8761, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.37% (0.2738 => 0.2885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.30% (0.9909 => 1.0434, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.24% (0.3890 => 0.4094, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2803 => 0.2949, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.20% (0.2750 => 0.2893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2792 => 0.2937, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.17% (1.8794 => 1.9766, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (2.0673 => 2.1741, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.2823 => 0.2968, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (1.9966 => 2.0991, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 5.11% (0.2780 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.10% (0.3096 => 0.3254, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.09% (0.2811 => 0.2954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2813 => 0.2956, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.95% (2.1013 => 2.2053, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.95% (0.2911 => 0.3055, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.92% (0.3271 => 0.3432, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (0.4658 => 0.4886, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 4.88% (0.3258 => 0.3417, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.87% (0.3060 => 0.3209, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.87% (0.3267 => 0.3426, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3362 => 0.3525, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.82% (23.5202 => 24.6532, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/lists: 4.81% (0.3348 => 0.3509, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3124 => 0.3274, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (2.1653 => 2.2688, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3726 => 0.3903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.72% (0.3282 => 0.3437, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3625 => 0.3795, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.68% (4.6177 => 4.8339, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3678 => 0.3850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3317 => 0.3472, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.64% (0.4139 => 0.4331, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 4.57% (0.3477 => 0.3636, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.3903 => 0.4081, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 4.54% (1.4269 => 1.4917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.53% (0.3690 => 0.3857, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (4.4195 => 4.6174, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 4.44% (0.4146 => 0.4330, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.40% (0.4251 => 0.4438, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.38% (0.7875 => 0.8220, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.30% (0.3792 => 0.3955, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.24% (0.6634 => 0.6915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.3981 => 0.4148, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.05% (0.3084 => 0.3209, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.05% (0.9697 => 1.0090, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.3845 => 0.3997, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.2969 => 0.3086, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.5012 => 0.5209, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.93% (0.3336 => 0.3467, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.2737 => 0.2844, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.79% (0.5546 => 0.5756, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.6435 => 0.6668, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 3.00% (2.0346 => 2.0956, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.74% (0.4847 => 0.4980, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (0.5361 => 0.5487, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (0.7426 => 0.7597, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (0.5584 => 0.5690, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.58% (4.6926 => 4.7669, std. dev.: 0.0154) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (11.6398 => 11.8212, std. dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6437, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1972, std. dev.: 0.0074) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5039, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.70% (2.0820 => 2.1174, std. dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std. dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4465, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6093, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5578, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: -8.28% (0.2402 => 0.2203, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7997, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7654, std. dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9576, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 12:05:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 14:05:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904190530.896AD2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3395?compare_to=3392&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3395, Order: 163144, Start Time: 2012-09-04 17:47:17, End Time: 2012-09-04 19:06:37 To: 3392, Order: 163137, Start Time: 2012-09-04 15:59:49, End Time: 2012-09-04 17:19:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (132 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (718 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.54% (10.3673 => 13.5333, std. dev.: 0.0089) SingleSource/UnitTests/ObjC/trivial-interface: 13.85% (0.3473 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.55% (0.3543 => 0.4023, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.50% (0.3497 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.42% (0.3516 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.94% (0.3694 => 0.4172, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.75% (0.3828 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.55% (0.3927 => 0.4420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.45% (0.3886 => 0.4370, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.00% (1.1194 => 1.2425, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.54% (0.1622 => 0.1793, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.32% (1.7609 => 1.9427, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 9.43% (0.1432 => 0.1567, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.90% (2.2022 => 2.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.75% (0.1625 => 0.1751, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.33% (0.7326 => 0.7863, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.99% (0.3177 => 0.3399, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 6.95% (0.1655 => 0.1770, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 6.40% (0.3282 => 0.3492, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.8172 => 0.8688, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 6.28% (0.7835 => 0.8327, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (0.4615 => 0.4900, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 6.05% (10.4361 => 11.0677, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7433 => 0.7870, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.82% (7.0540 => 7.4645, std. dev.: 0.0078) MultiSource/Applications/minisat/minisat: 5.75% (0.7115 => 0.7524, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 5.73% (0.3423 => 0.3619, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (9.4845 => 10.0246, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.69% (0.3817 => 0.4034, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.58% (0.5860 => 0.6187, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5569 => 0.5876, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (8.1363 => 8.5844, std. dev.: 0.0186) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 5.44% (0.3109 => 0.3278, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.41% (4.2646 => 4.4954, std. dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 5.32% (0.2554 => 0.2690, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (1.5415 => 1.6231, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.3050 => 1.3736, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.18% (0.2758 => 0.2901, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.17% (0.5105 => 0.5369, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.16% (3.3354 => 3.5076, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (5.0018 => 5.2573, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (4.9449 => 5.1960, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.9765 => 1.0255, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.93% (1.5603 => 1.6372, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 4.90% (5.7591 => 6.0412, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.78% (0.3136 => 0.3286, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.76% (0.6675 => 0.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5020 => 0.5257, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.64% (0.4636 => 0.4851, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (14.3668 => 15.0084, std. dev.: 0.0279) MultiSource/Benchmarks/McCat/09-vor/vor: 4.47% (0.3180 => 0.3322, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.45% (0.8067 => 0.8426, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 4.45% (1.1642 => 1.2160, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 4.44% (0.4299 => 0.4490, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.4103 => 0.4283, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (1.1861 => 1.2381, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.4064 => 0.4239, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.29% (0.3826 => 0.3990, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 4.27% (0.3092 => 0.3224, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 4.20% (3.8723 => 4.0349, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6456 => 0.6727, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.18% (2.0273 => 2.1120, std. dev.: 0.0092) MultiSource/Applications/lemon/lemon: 4.09% (1.0722 => 1.1161, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.07% (0.3098 => 0.3224, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.01% (0.2871 => 0.2986, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.99% (0.3387 => 0.3522, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.98% (0.2891 => 0.3006, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.97% (0.2872 => 0.2986, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.91% (0.3603 => 0.3744, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.90% (0.4203 => 0.4367, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3684 => 0.3826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.85% (0.4289 => 0.4454, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.2831 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3162 => 0.3280, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.71% (2.0665 => 2.1431, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: 3.68% (0.2877 => 0.2983, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.68% (0.4048 => 0.4197, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.54% (0.8921 => 0.9237, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5981 => 0.6191, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.49% (2.2969 => 2.3770, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4620 => 0.4781, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.38% (1.4186 => 1.4666, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.11% (1.5859 => 1.6352, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.95% (17.1811 => 17.6885, std. dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.2024 => 2.2624, std. dev.: 0.0196) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.1840 => 1.2107, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 2.22% (1.2842 => 1.3127, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.99% (0.8101 => 0.8262, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.71% (7.9617 => 8.0976, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 1.70% (21.9371 => 22.3110, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3808, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 4.62% (1.1396 => 1.1923, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.60% (0.4162 => 0.4312, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7585, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (4.2280 => 4.3661, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2395, std. dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.58% (5.2763 => 3.1882, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7193, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7113, std. dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1324, std. dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5455, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -8.77% (22.1758 => 20.2309, std. dev.: 0.0255) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3741, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2731, std. dev.: 0.0312) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.28% (1.8329 => 1.7178, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.93% (1.6805 => 1.6144, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5039, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -3.00% (1.2373 => 1.2002, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3295, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.6802 => 8.4380, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0114, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9593, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -2.29% (12.4730 => 12.1870, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2307, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 12:05:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 14:05:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904190538.E52692A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3396?compare_to=3393&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3396, Order: 163147, Start Time: 2012-09-04 17:54:44, End Time: 2012-09-04 19:06:45 To: 3393, Order: 163142, Start Time: 2012-09-04 16:28:12, End Time: 2012-09-04 17:38:58 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (41 on baseline) Performance Improvements: 5 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (820 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.69% (0.9416 => 0.9575, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 4.19% (3.7296 => 3.8860, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.13% (1.7907 => 1.8468, std. dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.92% (2.6912 => 2.7699, std. dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (59.3005 => 60.3760, std. dev.: 0.3612) SingleSource/Benchmarks/Misc/richards_benchmark: 1.45% (1.3389 => 1.3583, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.37% (1.6620 => 1.6848, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.17% (4.0773 => 4.1249, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: 1.10% (5.2930 => 5.3512, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: 1.04% (1.7072 => 1.7250, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.63% (0.4706 => 0.4441, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.8009 => 0.7678, std. dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.64% (0.3080 => 0.2968, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -1.94% (0.7634 => 0.7486, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (1.4313 => 1.4138, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.1653 => 1.2180, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (0.6915 => 0.7069, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 1.59% (0.9425 => 0.9575, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.1827 => 1.2008, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 1.20% (1.3268 => 1.3427, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (8.2559 => 8.3490, std. dev.: 0.0263) MultiSource/Applications/Burg/burg: 1.12% (1.1440 => 1.1568, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.24% (3.4629 => 4.2330, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.75% (0.0766 => 0.0879, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9988, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5538, std. dev.: 0.0379) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 12.95% (3.4406 => 3.8860, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: 10.87% (0.4296 => 0.4763, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 10.66% (62.4126 => 69.0648, std. dev.: 0.0690) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.65% (0.2694 => 0.2954, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6167, std. dev.: 0.0117) SingleSource/Benchmarks/McGill/chomp: 8.07% (1.0194 => 1.1017, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/methcall: 7.39% (8.5566 => 9.1890, std. dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.23% (40.4792 => 43.4059, std. dev.: 0.8635) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (3.4876 => 3.7158, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7524, std. dev.: 0.0330) SingleSource/Benchmarks/Misc/fp-convert: 4.47% (15.2242 => 15.9047, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.91% (2.6656 => 2.7699, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.81% (4.2129 => 4.3735, std. dev.: 0.0357) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/ReedSolomon: 3.46% (8.5113 => 8.8055, std. dev.: 0.0474) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 3.03% (5.1938 => 5.3512, std. dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.60% (2.4042 => 2.4667, std. dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.86% (4.6127 => 4.6987, std. dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (2.4455 => 2.4875, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 1.49% (2.5166 => 2.5541, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5338, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.46% (14.4877 => 14.6985, std. dev.: 0.0147) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.45% (4.0659 => 4.1249, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.26% (0.7738 => 0.7486, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.24% (5.2665 => 4.0953, std. dev.: 0.1205) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9903, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.39% (3.2007 => 2.9321, std. dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5513, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.09% (1.4021 => 1.3167, std. dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -5.94% (1.4441 => 1.3583, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (9.2503 => 8.7396, std. dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4073, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.95% (1.7361 => 1.6848, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -2.92% (7.6833 => 7.4590, std. dev.: 0.0273) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std. dev.: 0.0140) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4140 => 0.4030, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: -2.66% (1.4117 => 1.3742, std. dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.54% (3.7496 => 3.6544, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.31% (1.1683 => 1.1413, std. dev.: 0.0041) MultiSource/Applications/siod/siod: -2.24% (3.5520 => 3.4724, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -1.82% (1.0926 => 1.0727, std. dev.: 0.0023) MultiSource/Applications/aha/aha: -1.67% (3.4286 => 3.3714, std. dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2479, std. dev.: 0.0326) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.45% (1.8739 => 1.8468, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3142, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 13:21:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 15:21:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904202133.198752A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3397?compare_to=3391&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3397, Order: 163150, Start Time: 2012-09-04 19:08:22, End Time: 2012-09-04 20:22:40 To: 3391, Order: 163137, Start Time: 2012-09-04 15:38:50, End Time: 2012-09-04 16:52:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (163 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.33% (0.7731 => 0.7834, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.24% (0.9215 => 0.9329, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (2.1208 => 2.1431, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5205 => 56.3272, std. dev.: 0.1114) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.37% (2.0176 => 2.4085, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.75% (0.1410 => 0.1618, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.41% (0.5818 => 0.6482, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.26% (0.5748 => 0.6395, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.10% (0.3578 => 0.3975, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.95% (0.7061 => 0.7834, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.94% (0.3601 => 0.3995, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.93% (0.3650 => 0.4049, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3646 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.76% (0.3623 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3663 => 0.4056, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.66% (0.3789 => 0.4193, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3914 => 0.4330, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.4003 => 0.4420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.36% (0.3940 => 0.4348, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.70% (0.7710 => 0.8458, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.41% (1.3693 => 1.4982, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.34% (3.9660 => 4.3363, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 9.29% (0.4328 => 0.4730, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2781 => 0.3030, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.70% (0.5265 => 0.5723, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.59% (0.2782 => 0.3021, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.37% (0.4062 => 0.4402, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.35% (0.9199 => 0.9967, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2607 => 0.2823, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (1.2193 => 1.3202, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 8.26% (0.2760 => 0.2988, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.25% (0.2690 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2655 => 0.2874, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.18% (0.3899 => 0.4218, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 8.14% (0.2726 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.14% (0.3022 => 0.3268, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.14% (0.3293 => 0.3561, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 8.11% (0.7038 => 0.7609, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2761 => 0.2985, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.08% (1.9828 => 2.1431, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.06% (0.2966 => 0.3205, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3489 => 0.3770, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.04% (0.2937 => 0.3173, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.96% (0.2765 => 0.2985, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.91% (0.3149 => 0.3398, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.90% (0.2696 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.90% (0.2988 => 0.3224, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.89% (0.3107 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.87% (0.6959 => 0.7507, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.85% (0.3580 => 0.3861, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.84% (0.4390 => 0.4734, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.78% (13.8202 => 14.8954, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.77% (0.3756 => 0.4048, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.77% (1.4563 => 1.5694, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.76% (0.1327 => 0.1430, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.74% (0.3192 => 0.3439, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4016 => 0.4323, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.59% (1.1364 => 1.2226, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.57% (0.2721 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3453 => 0.3711, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 7.39% (0.3868 => 0.4154, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.5577 => 0.5989, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.25% (7.2180 => 7.7415, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: 7.24% (0.3534 => 0.3790, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.24% (0.1588 => 0.1703, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.07% (0.7506 => 0.8037, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.03% (0.4791 => 0.5128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.2945 => 0.3150, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.89% (1.0313 => 1.1024, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.5637 => 0.6016, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.72% (0.3246 => 0.3464, std. dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (13.2842 => 14.1705, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.65% (0.6283 => 0.6701, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 6.43% (0.8310 => 0.8844, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.38% (1.1061 => 1.1767, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.30% (0.3220 => 0.3423, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.2925 => 0.3108, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.13% (0.3755 => 0.3985, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.07% (3.8646 => 4.0993, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 6.06% (0.2243 => 0.2379, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.7460 => 0.7908, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.92% (0.6744 => 0.7143, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.88% (1.3819 => 1.4632, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.88% (3.6692 => 3.8850, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.86% (1.3813 => 1.4622, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 5.84% (1.9270 => 2.0395, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.83% (1.3245 => 1.4017, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 5.80% (3.1889 => 3.3739, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.79% (0.8818 => 0.9329, std. dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 5.78% (1.2749 => 1.3486, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.76% (0.8698 => 0.9199, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 5.73% (2.1791 => 2.3039, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.59% (0.2504 => 0.2644, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.47% (1.0594 => 1.1174, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6168, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.36% (4.4433 => 4.6813, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.6135 => 0.6459, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.23% (16.6129 => 17.4823, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 5.21% (1.2292 => 1.2933, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 5.18% (0.2859 => 0.3007, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.13% (14.8535 => 15.6155, std. dev.: 0.0222) MultiSource/Benchmarks/sim/sim: 5.05% (0.3131 => 0.3289, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 5.04% (14.5298 => 15.2624, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3245 => 0.3407, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.88% (8.4961 => 8.9105, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (1.1333 => 1.1869, std. dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 4.21% (6.5754 => 6.8523, std. dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 4.19% (4.6629 => 4.8585, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4805 => 0.5001, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6250 => 0.6502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (4.9865 => 5.1842, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (3.2742 => 3.4005, std. dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: 3.80% (16.2614 => 16.8799, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.46% (0.9108 => 0.9423, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.39% (2.1007 => 2.1720, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.38% (1.5188 => 1.5701, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.09% (3.7467 => 3.8623, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 2.91% (33.2944 => 34.2648, std. dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.91% (6.2785 => 6.4614, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0530) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4127, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.1560 => 1.2270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7338, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1216, std. dev.: 0.0551) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5978, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6135, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5943, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6861, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4442, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.97% (0.4657 => 0.4053, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.80% (22.5627 => 21.4792, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2848, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5113, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7089, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9247, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5837, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.05% (26.5159 => 25.9719, std. dev.: 0.0418) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2380, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2182, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5361, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 13:33:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 15:33:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904203347.2F2D02A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3398?compare_to=3396&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3398, Order: 163154, Start Time: 2012-09-04 19:22:24, End Time: 2012-09-04 20:34:51 To: 3396, Order: 163147, Start Time: 2012-09-04 17:54:44, End Time: 2012-09-04 19:06:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (44 on baseline) Performance Improvements: 6 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 876 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.04% (0.4437 => 0.4572, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.09% (0.8821 => 0.9005, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.19% (1.5261 => 1.5443, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.73% (19.5742 => 21.8697, std. dev.: 0.8084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.86% (0.3240 => 0.3527, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.00% (3.0238 => 3.2355, std. dev.: 0.0769) SingleSource/Benchmarks/McGill/misr: 2.10% (0.4763 => 0.4863, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 1.62% (1.7355 => 1.7637, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.34% (2.9321 => 2.9713, std. dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.26% (1.6172 => 1.6376, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -2.53% (0.7069 => 0.6890, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.82% (3.6339 => 3.5679, std. dev.: 0.0240) MultiSource/Applications/hexxagon/hexxagon: -1.35% (0.9575 => 0.9446, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -3.55% (6.4494 => 6.2203, std. dev.: 0.0343) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.62% (4.5684 => 4.4485, std. dev.: 0.0244) SingleSource/Benchmarks/Misc/richards_benchmark: -1.18% (1.3583 => 1.3423, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.27% (0.1414 => 0.1531, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 4.08% (1.1653 => 1.2128, std. dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 3.36% (2.1763 => 2.2495, std. dev.: 0.0254) MultiSource/Applications/minisat/minisat: 3.14% (0.6173 => 0.6367, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 3.13% (1.0046 => 1.0360, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.5150 => 1.5443, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.93% (3.0225 => 3.0809, std. dev.: 0.0060) MultiSource/Applications/Burg/burg: 1.57% (1.1440 => 1.1620, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.51% (13.3238 => 13.5255, std. dev.: 0.0275) MultiSource/Applications/siod/siod: 1.14% (2.0972 => 2.1211, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0014, std. dev.: 0.0315) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.87% (4.0101 => 4.5665, std. dev.: 0.0600) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/misr: 13.20% (0.4296 => 0.4863, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8793, std. dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 12.44% (0.3746 => 0.4212, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1020, std. dev.: 0.2760) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 9.21% (0.1433 => 0.1565, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.92% (1.0063 => 1.0961, std. dev.: 0.0239) SingleSource/Benchmarks/Shootout/lists: 8.80% (7.0025 => 7.6186, std. dev.: 0.0164) SingleSource/Benchmarks/McGill/chomp: 8.13% (1.0194 => 1.1023, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout/methcall: 6.96% (8.5566 => 9.1520, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (3.0256 => 3.2355, std. dev.: 0.0769) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.85% (0.3301 => 0.3527, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.4876 => 3.7199, std. dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (27.1724 => 28.7481, std. dev.: 0.0822) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8336, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (4.2129 => 4.3700, std. dev.: 0.0483) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/five11/five11: 2.64% (5.1938 => 5.3308, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7145, std. dev.: 0.0293) MultiSource/Applications/JM/lencod/lencod: 1.80% (6.7458 => 6.8670, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.65% (1.6110 => 1.6376, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6641, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6919, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout/hash: 1.07% (4.3016 => 4.3476, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.06% (3.6254 => 3.6640, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.53% (0.2080 => 0.1965, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -5.25% (8.9977 => 8.5250, std. dev.: 0.1651) MultiSource/Applications/spiff/spiff: -2.93% (0.7738 => 0.7511, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.26% (0.3497 => 0.2054, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.62% (5.2665 => 4.1281, std. dev.: 0.0477) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9897, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout/sieve: -12.18% (8.1594 => 7.1657, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.17% (3.2007 => 2.9713, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.4441 => 1.3423, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5512, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -6.01% (9.2503 => 8.6943, std. dev.: 0.1025) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4049, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0592) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.16% (1.7361 => 1.6639, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.21% (1.1683 => 1.1308, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.19% (0.4140 => 0.4008, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4505, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2878, std. dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: -2.51% (92.7467 => 90.4197, std. dev.: 0.7653) MultiSource/Benchmarks/FreeBench/neural/neural: -2.32% (1.0926 => 1.0673, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -2.29% (3.5520 => 3.4706, std. dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.22% (3.7496 => 3.6662, std. dev.: 0.0137) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.91% (2.8964 => 2.8412, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2264, std. dev.: 0.0157) MultiSource/Applications/aha/aha: -1.68% (3.4286 => 3.3710, std. dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7654, std. dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3569 => 2.3237, std. dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3149, std. dev.: 0.0347) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 13:52:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 15:52:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904205247.F3CE92A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3399?compare_to=3395&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3399, Order: 163154, Start Time: 2012-09-04 19:34:41, End Time: 2012-09-04 20:53:55 To: 3395, Order: 163144, Start Time: 2012-09-04 17:47:17, End Time: 2012-09-04 19:06:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (139 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.53% (0.5329 => 0.5517, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.19% (79.1014 => 80.8319, std. dev.: 0.4875) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (13.5333 => 13.2233, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.55% (10.3673 => 13.2233, std. dev.: 0.0123) SingleSource/UnitTests/ObjC/trivial-interface: 15.06% (0.3473 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.73% (0.3543 => 0.4065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.73% (0.3497 => 0.4012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.70% (0.3516 => 0.4033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3543 => 0.4061, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 14.57% (0.3561 => 0.4080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.08% (0.3694 => 0.4214, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.77% (0.3828 => 0.4355, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.60% (0.3927 => 0.4461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.38% (0.3886 => 0.4406, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.41% (1.7609 => 1.9619, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: 10.48% (0.1622 => 0.1792, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.33% (2.2022 => 2.4076, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 7.92% (0.5925 => 0.6394, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.6030 => 0.6504, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.09% (10.4361 => 11.1761, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/oourafft: 6.89% (0.3282 => 0.3508, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.82% (0.8172 => 0.8729, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.76% (0.3817 => 0.4075, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.76% (0.7326 => 0.7821, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (0.4615 => 0.4921, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.42% (0.7835 => 0.8338, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.34% (0.2271 => 0.2415, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.33% (0.4879 => 0.5188, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.24% (7.0540 => 7.4945, std. dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (9.4845 => 10.0620, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.00% (0.7115 => 0.7542, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.96% (0.7433 => 0.7876, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 5.90% (0.3423 => 0.3625, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 5.89% (0.3109 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (8.1363 => 8.6112, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.66% (0.5569 => 0.5884, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (4.2646 => 4.5056, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.65% (4.9449 => 5.2241, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 5.60% (0.2554 => 0.2697, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.60% (0.5860 => 0.6188, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.51% (1.3050 => 1.3769, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.50% (0.5105 => 0.5386, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.47% (5.0018 => 5.2753, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.40% (0.2758 => 0.2907, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.5415 => 1.6244, std. dev.: 0.0077) MultiSource/Applications/d/make_dparser: 5.23% (3.3354 => 3.5100, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.14% (0.3422 => 0.3598, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.08% (0.9765 => 1.0261, std. dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 5.06% (0.2905 => 0.3052, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.05% (1.5603 => 1.6391, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.02% (0.6675 => 0.7010, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (0.4064 => 0.4267, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4636 => 0.4865, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3603 => 0.3780, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.88% (0.2725 => 0.2858, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.88% (0.2891 => 0.3032, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.4103 => 0.4303, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.81% (0.2700 => 0.2830, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.74% (0.5020 => 0.5258, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2872 => 0.3008, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2831 => 0.2964, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 4.70% (5.7591 => 6.0296, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.66% (0.3136 => 0.3282, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.62% (0.4203 => 0.4397, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.8067 => 0.8439, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.61% (0.2756 => 0.2883, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.61% (0.3865 => 0.4043, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4048 => 0.4234, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (14.3668 => 15.0263, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 4.57% (0.4289 => 0.4485, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 4.55% (0.3052 => 0.3191, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.3650 => 0.3816, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3283 => 0.3432, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.52% (0.2877 => 0.3007, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.52% (0.3232 => 0.3378, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6456 => 0.6747, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.50% (1.1861 => 1.2395, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 4.50% (0.3092 => 0.3231, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2871 => 0.3000, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.49% (1.1642 => 1.2165, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (2.0665 => 2.1585, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3826 => 0.3995, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.37% (0.2793 => 0.2915, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.35% (0.2802 => 0.2924, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3162 => 0.3298, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.28% (0.3387 => 0.3532, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.25% (2.0273 => 2.1134, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 4.20% (3.8723 => 4.0350, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists1: 4.18% (0.3684 => 0.3838, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3935 => 0.4099, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.16% (1.0722 => 1.1168, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (0.4620 => 0.4811, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.02% (0.6450 => 0.6709, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 3.94% (0.3379 => 0.3512, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.73% (2.2969 => 2.3825, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 3.70% (0.8921 => 0.9251, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.61% (0.5981 => 0.6197, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.4186 => 1.4680, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.19% (1.5859 => 1.6365, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.95% (2.2024 => 2.2673, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.94% (17.1811 => 17.6862, std. dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2842 => 1.3205, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.1840 => 1.2123, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (7.9617 => 8.1438, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.87% (21.9371 => 22.3469, std. dev.: 0.0799) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.8101 => 0.8231, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 4.69% (1.1396 => 1.1931, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (4.2280 => 4.3659, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7569, std. dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 1.92% (0.5413 => 0.5517, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.45% (2.2771 => 2.3102, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2360, std. dev.: 0.0110) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7622, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.20% (5.2763 => 3.2082, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.45% (5.3855 => 3.7454, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.20% (5.3526 => 3.7360, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2093, std. dev.: 0.0239) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.84% (2.9384 => 2.5612, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -8.69% (22.1758 => 20.2486, std. dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2667, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (1.8329 => 1.7176, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0099) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.96% (1.6805 => 1.6140, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.17% (8.6802 => 8.4054, std. dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5074, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0073, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9647, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1886, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -2.08% (1.2373 => 1.2116, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2306, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 14:06:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 16:06:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120904210615.D9E082A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3400?compare_to=3394&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3400, Order: 163148, Start Time: 2012-09-04 18:23:50, End Time: 2012-09-04 21:07:24 To: 3394, Order: 163136, Start Time: 2012-09-04 15:12:35, End Time: 2012-09-04 17:55:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.20% (117.8470 => 125.1564, std. dev.: 1.1210) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.04% (1.7359 => 1.7178, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.39% (0.3446 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.37% (0.3465 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.35% (0.3442 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.31% (0.3488 => 0.3987, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.30% (0.3496 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.27% (0.3469 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.1620 => 0.1758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.50% (0.5826 => 0.6321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5889 => 0.6378, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.82% (1.5932 => 1.7178, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.36% (3.5627 => 3.8249, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (1.6211 => 1.7369, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.99% (1.3152 => 1.4071, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.90% (0.5026 => 0.5373, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.86% (0.7171 => 0.7663, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.47% (0.4994 => 0.5317, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.35% (0.4361 => 0.4638, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 6.26% (4.2109 => 4.4743, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (0.5000 => 0.5312, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (0.3930 => 0.4175, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 5.85% (1.0781 => 1.1412, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.1968 => 0.2083, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.63% (0.2875 => 0.3037, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.2736 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.53% (2.7292 => 2.8802, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.25% (5.5417 => 5.8327, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.23% (0.2792 => 0.2938, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2738 => 0.2881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2780 => 0.2925, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.20% (0.2750 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2803 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.15% (0.2813 => 0.2958, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (1.9694 => 2.0707, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 5.07% (0.9909 => 1.0411, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (2.0673 => 2.1718, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.05% (0.2911 => 0.3058, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.04% (0.3890 => 0.4086, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (1.9966 => 2.0971, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3362 => 0.3531, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.02% (0.2811 => 0.2952, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.99% (0.2566 => 0.2694, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (2.1013 => 2.2059, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (0.4658 => 0.4888, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.91% (0.3096 => 0.3248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.91% (0.3792 => 0.3978, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.87% (0.3060 => 0.3209, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.82% (0.3258 => 0.3415, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.74% (0.3124 => 0.3272, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.71% (4.6177 => 4.8353, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.69% (0.3282 => 0.3436, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3625 => 0.3795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.69% (0.3348 => 0.3505, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3317 => 0.3471, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (4.4195 => 4.6227, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 4.59% (2.1653 => 2.2647, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (1.8794 => 1.9656, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.59% (0.3903 => 0.4082, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.54% (0.3477 => 0.3635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.51% (0.3678 => 0.3844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3690 => 0.3855, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.46% (0.7875 => 0.8226, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.42% (23.5202 => 24.5608, std. dev.: 0.0095) MultiSource/Applications/lua/lua: 4.34% (1.4269 => 1.4888, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.4139 => 0.4317, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4146 => 0.4324, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.28% (0.4251 => 0.4433, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.25% (0.6634 => 0.6916, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.22% (0.3981 => 0.4149, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.22% (0.9697 => 1.0106, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.97% (0.2969 => 0.3087, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.2737 => 0.2843, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.3845 => 0.3992, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.81% (0.3336 => 0.3463, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.73% (0.5546 => 0.5753, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.61% (0.5012 => 0.5193, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.77% (2.0346 => 2.0909, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 2.39% (0.4847 => 0.4963, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (0.7426 => 0.7581, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (0.5361 => 0.5470, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.67% (11.6398 => 11.8344, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.61% (4.6926 => 4.7683, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6755, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.78% (15.4430 => 16.1809, std. dev.: 0.0517) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8882, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6435, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1961, std. dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5079, std. dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (2.0820 => 2.1180, std. dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4485, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5818, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5663, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7974, std. dev.: 0.0037) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8402, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.19% (0.6293 => 0.6155, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5792, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9611, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 15:00:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 17:00:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904220054.D982E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3401?compare_to=3398&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3401, Order: 163161, Start Time: 2012-09-04 20:50:19, End Time: 2012-09-04 22:02:02 To: 3398, Order: 163154, Start Time: 2012-09-04 19:22:24, End Time: 2012-09-04 20:34:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (39 on baseline) Performance Improvements: 3 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1299 => 0.1401, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.60% (0.4389 => 0.4591, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 22.40% (0.1384 => 0.1694, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.89% (0.7408 => 0.7770, std. dev.: 0.0134) MultiSource/Applications/minisat/minisat: 4.71% (6.2203 => 6.5131, std. dev.: 0.0428) SingleSource/Benchmarks/Misc/ffbench: 2.77% (1.3685 => 1.4064, std. dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.11% (2.4644 => 2.5163, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/whetstone: 1.75% (2.3537 => 2.3950, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.19% (0.5535 => 0.5414, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.40% (1.2751 => 1.2573, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.19% (1.6194 => 1.6002, std. dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.29% (1.1653 => 1.2036, std. dev.: 0.0110) MultiSource/Applications/minisat/minisat: 2.79% (0.6173 => 0.6345, std. dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 2.59% (2.1763 => 2.2326, std. dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (12.6413 => 12.9192, std. dev.: 0.0757) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 45.25% (0.0263 => 0.0382, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/mst/mst: 19.55% (0.1417 => 0.1694, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std. dev.: 0.0293) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.76% (4.0101 => 4.5620, std. dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: 12.29% (0.4296 => 0.4824, std. dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 11.37% (0.1433 => 0.1596, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1270, std. dev.: 0.0170) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.61% (0.2694 => 0.2953, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6340, std. dev.: 0.0406) SingleSource/Benchmarks/Shootout/methcall: 7.64% (8.5566 => 9.2100, std. dev.: 0.0248) SingleSource/Benchmarks/McGill/chomp: 7.56% (1.0194 => 1.0965, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.4876 => 3.7386, std. dev.: 0.0205) MultiSource/Benchmarks/Olden/bisort/bisort: 6.81% (0.6459 => 0.6899, std. dev.: 0.0147) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7350, std. dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.65% (1.0063 => 1.0632, std. dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (2.4042 => 2.5163, std. dev.: 0.0100) MultiSource/Applications/minisat/minisat: 4.64% (6.2244 => 6.5131, std. dev.: 0.0428) SingleSource/Benchmarks/Misc/fp-convert: 3.96% (15.2242 => 15.8271, std. dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.94% (40.4792 => 42.0734, std. dev.: 0.4541) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5391, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: 3.70% (0.9851 => 1.0215, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: 3.48% (5.1938 => 5.3747, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.47% (0.8498 => 0.8793, std. dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.63% (0.5587 => 0.5734, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 2.41% (8.5113 => 8.7162, std. dev.: 0.0528) SingleSource/Benchmarks/Misc/whetstone: 2.12% (2.3453 => 2.3950, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (2.4455 => 2.4862, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 1.35% (14.4877 => 14.6838, std. dev.: 0.0261) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (29.5232 => 29.8386, std. dev.: 0.0706) SingleSource/Benchmarks/Dhrystone/fldry: 1.06% (2.4971 => 2.5236, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.82% (0.2080 => 0.1959, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.82% (0.5740 => 0.5521, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.92% (0.5520 => 0.5414, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.34% (0.7784 => 0.7680, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.33% (1.2742 => 1.2573, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.56% (5.2665 => 4.0784, std. dev.: 0.0831) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.84% (1.1647 => 0.9919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std. dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.49% (1.4034 => 1.2842, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3422, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: -6.55% (9.2503 => 8.6446, std. dev.: 0.0905) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7965, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4101, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0591) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.35% (0.4140 => 0.3960, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.16% (1.7361 => 1.6638, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.11% (1.2959 => 1.2427, std. dev.: 0.0112) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.02% (1.2722 => 1.2338, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -2.80% (9.5474 => 9.2802, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1361, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (7.6833 => 7.4867, std. dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.53% (2.4457 => 2.3838, std. dev.: 0.0230) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (92.7467 => 90.5791, std. dev.: 0.1397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.31% (3.7496 => 3.6628, std. dev.: 0.0148) MultiSource/Applications/siod/siod: -2.27% (3.5520 => 3.4712, std. dev.: 0.0177) MultiSource/Benchmarks/FreeBench/neural/neural: -2.21% (1.0926 => 1.0685, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.05% (1.0686 => 1.0467, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6119 => 0.6010, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2237, std. dev.: 0.0175) MultiSource/Applications/aha/aha: -1.58% (3.4286 => 3.3744, std. dev.: 0.0187) MultiSource/Benchmarks/Olden/tsp/tsp: -1.43% (1.7330 => 1.7082, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7658, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3063, std. dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.28% (3.8907 => 3.8408, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 15:04:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 17:04:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904220402.011322A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3402?compare_to=3397&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3402, Order: 163161, Start Time: 2012-09-04 20:50:43, End Time: 2012-09-04 22:05:02 To: 3397, Order: 163150, Start Time: 2012-09-04 19:08:22, End Time: 2012-09-04 20:22:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.97% (2.0176 => 2.4003, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.68% (0.1410 => 0.1617, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 12.51% (0.5748 => 0.6467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.50% (0.5818 => 0.6545, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.19% (0.3578 => 0.4014, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.05% (0.3601 => 0.4035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.90% (0.3646 => 0.4080, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.84% (0.3650 => 0.4082, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3663 => 0.4095, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.79% (0.3623 => 0.4050, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3789 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.50% (0.3914 => 0.4364, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.22% (0.4003 => 0.4452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.12% (0.3940 => 0.4378, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.31% (0.7710 => 0.8505, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.48% (1.3693 => 1.4991, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.30% (3.9660 => 4.3348, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 9.06% (0.4328 => 0.4720, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.94% (0.2596 => 0.2828, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.88% (0.2781 => 0.3028, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.68% (0.5265 => 0.5722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.59% (0.2782 => 0.3021, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.29% (1.2193 => 1.3204, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.28% (0.9199 => 0.9961, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 8.22% (0.4062 => 0.4396, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.21% (0.2655 => 0.2873, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2726 => 0.2949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.17% (0.2607 => 0.2820, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.14% (0.2690 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2628 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.06% (1.9828 => 2.1427, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.99% (0.2765 => 0.2986, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.99% (0.7038 => 0.7600, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/lists: 7.96% (0.3293 => 0.3555, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.93% (0.2760 => 0.2979, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.90% (0.4390 => 0.4737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.90% (0.2937 => 0.3169, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.90% (0.2761 => 0.2979, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.87% (0.6959 => 0.7507, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3485 => 0.3758, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.82% (0.2966 => 0.3198, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3580 => 0.3859, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.79% (0.2696 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.78% (0.3149 => 0.3394, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.77% (0.3489 => 0.3760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.76% (0.1327 => 0.1430, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.75% (1.4563 => 1.5692, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.67% (0.3756 => 0.4044, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2127 => 0.2290, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.64% (13.8202 => 14.8759, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.61% (0.2721 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.60% (0.2988 => 0.3215, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.60% (0.3107 => 0.3343, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.57% (0.4016 => 0.4320, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.54% (1.1364 => 1.2221, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1589 => 0.1708, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3192 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.46% (0.5577 => 0.5993, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.38% (0.7506 => 0.8060, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.35% (7.2180 => 7.7482, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 7.33% (0.3453 => 0.3706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.26% (0.3868 => 0.4149, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.16% (0.3534 => 0.3787, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.12% (0.4791 => 0.5132, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.3246 => 0.3472, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.69% (0.5637 => 0.6014, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.66% (0.2945 => 0.3141, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.64% (1.0313 => 1.0998, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1865 => 0.1988, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.54% (13.2842 => 14.1524, std. dev.: 0.0140) MultiSource/Applications/Burg/burg: 6.49% (1.1061 => 1.1779, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 6.41% (0.8310 => 0.8843, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.38% (0.6283 => 0.6684, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3220 => 0.3425, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.36% (0.2925 => 0.3111, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.2243 => 0.2385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.13% (0.4113 => 0.4365, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.13% (0.7460 => 0.7917, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.05% (1.3813 => 1.4649, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.04% (3.8646 => 4.0981, std. dev.: 0.0075) MultiSource/Applications/treecc/treecc: 5.94% (1.9270 => 2.0414, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4639, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.91% (0.3755 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.89% (1.3245 => 1.4025, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.89% (0.6744 => 0.7141, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.87% (3.6692 => 3.8844, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.75% (1.2749 => 1.3482, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.70% (3.1889 => 3.3706, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.8698 => 0.9189, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.57% (4.3801 => 4.6239, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 5.56% (2.1791 => 2.3002, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.47% (1.0594 => 1.1174, std. dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.45% (4.4433 => 4.6855, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.33% (0.6135 => 0.6462, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.24% (0.8818 => 0.9280, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.23% (1.2292 => 1.2935, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.18% (16.6129 => 17.4731, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 5.01% (14.8535 => 15.5981, std. dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2503, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 4.90% (0.2859 => 0.2999, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.88% (1.1333 => 1.1886, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.82% (0.3131 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.82% (8.4961 => 8.9055, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.18% (0.4805 => 0.5006, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.16% (6.5754 => 6.8490, std. dev.: 0.0152) MultiSource/Applications/oggenc/oggenc: 4.03% (4.6629 => 4.8510, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (3.2742 => 3.4052, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.60% (4.9865 => 5.1662, std. dev.: 0.0181) MultiSource/Applications/sqlite3/sqlite3: 3.53% (16.2614 => 16.8362, std. dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.41% (2.1007 => 2.1723, std. dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.34% (0.9108 => 0.9412, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.29% (1.5188 => 1.5688, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.09% (3.7467 => 3.8623, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.82% (33.2944 => 34.2322, std. dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.75% (6.2785 => 6.4514, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std. dev.: 0.0520) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.06% (1.1560 => 1.2260, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1191, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6047, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.96% (1.5824 => 1.6134, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5849, std. dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4443, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.28% (0.4657 => 0.4085, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.96% (22.5627 => 21.4439, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.36% (20.3410 => 18.2330, std. dev.: 0.0334) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.19% (1.3780 => 1.3202, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1492, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9239, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9202, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5825, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.08% (26.5159 => 25.9631, std. dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2463, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2116, std. dev.: 0.0234) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.5928 => 4.5341, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 15:41:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 17:41:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120904224133.8BFF82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3403?compare_to=3399&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3403, Order: 163164, Start Time: 2012-09-04 21:23:26, End Time: 2012-09-04 22:42:33 To: 3399, Order: 163154, Start Time: 2012-09-04 19:34:41, End Time: 2012-09-04 20:53:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (135 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.16% (13.2233 => 13.5092, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.89% (80.8319 => 79.3077, std. dev.: 0.3973) SingleSource/Regression/C/uint64_to_float: -1.85% (0.5517 => 0.5415, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.31% (10.3673 => 13.5092, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3473 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.47% (0.3497 => 0.4038, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.38% (0.3543 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.35% (0.3543 => 0.4087, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.33% (0.3516 => 0.4055, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.28% (0.3561 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.81% (0.3694 => 0.4241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.42% (0.3828 => 0.4380, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.29% (0.3927 => 0.4488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.05% (0.3886 => 0.4432, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 11.34% (0.1622 => 0.1806, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2454, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.78% (1.7609 => 1.9508, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 9.50% (0.1432 => 0.1568, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.81% (2.2022 => 2.3962, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.6030 => 0.6548, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.46% (0.1584 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.08% (0.7326 => 0.7918, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.52% (0.3817 => 0.4104, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 6.98% (10.4361 => 11.1645, std. dev.: 0.0156) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.66% (0.8172 => 0.8716, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.49% (0.3282 => 0.3495, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3307 => 0.3521, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.39% (0.4615 => 0.4910, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.19% (0.4879 => 0.5181, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.04% (7.0540 => 7.4801, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.01% (0.7835 => 0.8306, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 5.92% (0.7433 => 0.7873, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 5.92% (0.7115 => 0.7536, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.89% (9.4845 => 10.0428, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.87% (4.2646 => 4.5148, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (8.1363 => 8.6117, std. dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 5.82% (0.3109 => 0.3290, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.71% (0.5569 => 0.5887, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.70% (0.2107 => 0.2227, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5860 => 0.6191, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3121 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.64% (0.3423 => 0.3616, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.64% (1.5415 => 1.6284, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 5.52% (0.2554 => 0.2695, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.49% (1.3050 => 1.3767, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.47% (4.9449 => 5.2156, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.43% (0.5105 => 0.5382, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (5.0018 => 5.2728, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.26% (0.2603 => 0.2740, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.17% (3.3354 => 3.5080, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.14% (0.9765 => 1.0267, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 5.06% (0.2905 => 0.3052, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 5.02% (0.4299 => 0.4515, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.94% (1.5603 => 1.6374, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4636 => 0.4865, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 4.88% (0.3422 => 0.3589, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.84% (0.6675 => 0.6998, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.8067 => 0.8453, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.4064 => 0.4258, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.74% (0.5020 => 0.5258, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.3180 => 0.3330, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.70% (5.7591 => 6.0300, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2700 => 0.2827, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.68% (1.1642 => 1.2187, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.67% (14.3668 => 15.0381, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 4.56% (0.3092 => 0.3233, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.56% (0.4103 => 0.4290, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2387, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.3136 => 0.3275, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.39% (0.2872 => 0.2998, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3098 => 0.3233, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.35% (0.3865 => 0.4033, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2877 => 0.3001, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4203 => 0.4384, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3826 => 0.3989, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.24% (0.4289 => 0.4471, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.24% (3.8723 => 4.0366, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 4.24% (0.2831 => 0.2951, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.23% (2.0665 => 2.1539, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.22% (1.0722 => 1.1175, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sieve: 4.22% (0.3603 => 0.3755, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.6456 => 0.6728, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.17% (0.2756 => 0.2871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.16% (0.3052 => 0.3179, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.11% (0.4620 => 0.4810, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.10% (0.3387 => 0.3526, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.07% (2.0273 => 2.1099, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.06% (0.6450 => 0.6712, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3232 => 0.3362, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3684 => 0.3832, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2793 => 0.2904, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.93% (0.3283 => 0.3412, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2802 => 0.2911, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.78% (0.8921 => 0.9258, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.4186 => 1.4704, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.63% (2.2969 => 2.3802, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 3.61% (0.3379 => 0.3501, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5981 => 0.6195, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.31% (1.5859 => 1.6384, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (2.2024 => 2.2667, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.90% (17.1811 => 17.6798, std. dev.: 0.0145) MultiSource/Applications/hexxagon/hexxagon: 2.90% (1.2842 => 1.3214, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.1840 => 1.2127, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.84% (7.9617 => 8.1082, std. dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 1.82% (21.9371 => 22.3356, std. dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (0.8101 => 0.8239, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3861, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 4.58% (1.1396 => 1.1918, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3635, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7495, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2381, std. dev.: 0.0118) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7623, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.31% (5.2763 => 3.2023, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7191, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7180, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1827, std. dev.: 0.0573) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5516, std. dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: -8.77% (22.1758 => 20.2301, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.54% (1.5373 => 1.3752, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2672, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.19% (1.8329 => 1.7195, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std. dev.: 0.0021) MultiSource/Applications/siod/siod: -4.08% (3.2827 => 3.1489, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5083, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4198, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0117, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9620, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1858, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2282, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 16:29:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 18:29:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120904232942.EB26E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3404?compare_to=3401&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3404, Order: 163165, Start Time: 2012-09-04 22:18:35, End Time: 2012-09-04 23:30:51 To: 3401, Order: 163161, Start Time: 2012-09-04 20:50:19, End Time: 2012-09-04 22:02:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (47 on baseline) Performance Improvements: 4 (45 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 873 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.40% (8.4410 => 8.8968, std. dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.05% (2.0258 => 2.1078, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.24% (1.4342 => 1.4807, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3181 => 0.3282, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5521 => 0.5628, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.7725 => 0.7854, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (3.6484 => 3.8843, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.93% (42.0734 => 43.3052, std. dev.: 0.3239) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.90% (2.6865 => 2.7643, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.23% (4.0784 => 4.1693, std. dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.19% (59.3063 => 60.6029, std. dev.: 0.2264) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.62% (1.6063 => 1.6323, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 1.58% (8.7162 => 8.8535, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.0632 => 1.0799, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 1.49% (8.6446 => 8.7737, std. dev.: 0.0487) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.76% (0.7680 => 0.7391, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.32% (17.1765 => 15.2318, std. dev.: 0.1830) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (1.3778 => 1.3206, std. dev.: 0.0208) SingleSource/Benchmarks/Misc/ffbench: -2.30% (1.4064 => 1.3741, std. dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.89% (2.1763 => 2.2610, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.0317 => 2.1078, std. dev.: 0.0207) MultiSource/Applications/lemon/lemon: 3.61% (1.0046 => 1.0409, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 2.96% (1.1653 => 1.1998, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.7639 => 0.7854, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.77% (1.4408 => 1.4807, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.61% (0.6173 => 0.6334, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (12.6413 => 12.9266, std. dev.: 0.0929) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.5150 => 1.5442, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.5309 => 0.5410, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (1.3935 => 1.4138, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2293, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9990, std. dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.00% (4.0101 => 4.5715, std. dev.: 0.0167) SingleSource/Benchmarks/Stanford/Puzzle: 13.05% (0.1433 => 0.1620, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.90% (3.4406 => 3.8843, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.65% (62.4126 => 69.0600, std. dev.: 0.0851) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 10.15% (0.4296 => 0.4732, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout/lists: 8.94% (7.0025 => 7.6282, std. dev.: 0.0198) SingleSource/Benchmarks/McGill/chomp: 7.66% (1.0194 => 1.0975, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.31% (1.0063 => 1.0799, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/methcall: 7.29% (8.5566 => 9.1806, std. dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.98% (40.4792 => 43.3052, std. dev.: 0.3239) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.69% (4.2129 => 4.4948, std. dev.: 0.0651) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.4876 => 3.7208, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.3301 => 0.3500, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (27.1724 => 28.7488, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/dt: 4.23% (0.9851 => 1.0268, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 4.02% (8.5113 => 8.8535, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5396, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7899, std. dev.: 0.0519) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.71% (6.6312 => 6.8775, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.70% (2.6656 => 2.7643, std. dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.69% (2.4042 => 2.4930, std. dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.22% (0.5876 => 0.6065, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 2.48% (5.1938 => 5.3228, std. dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/hash: 2.27% (0.6308 => 0.6451, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5327, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.32% (1.6110 => 1.6323, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6726, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/power/power: 1.23% (1.4184 => 1.4358, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.13% (3.6254 => 3.6662, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6936, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -6.75% (0.1836 => 0.1712, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.05% (0.7784 => 0.7391, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.00% (0.2080 => 0.1976, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.82% (0.9029 => 0.8774, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: -2.17% (3.8796 => 3.7955, std. dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.95% (0.5740 => 0.5628, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.31% (4.3380 => 4.2812, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.12% (4.2815 => 4.2334, std. dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.83% (5.2665 => 4.1693, std. dev.: 0.0337) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9917, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: -12.18% (8.1594 => 7.1653, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.63% (3.2007 => 2.9566, std. dev.: 0.0375) SingleSource/Benchmarks/Misc/richards_benchmark: -7.10% (1.4441 => 1.3415, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/pi: -6.10% (1.6538 => 1.5529, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.81% (1.4021 => 1.3206, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/methcall: -5.15% (9.2503 => 8.7737, std. dev.: 0.0487) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4100, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7618, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.34% (1.7361 => 1.6607, std. dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: -4.34% (8.5323 => 8.1618, std. dev.: 0.1260) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.79% (15.8312 => 15.2318, std. dev.: 0.1830) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.2722 => 1.2318, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.12% (1.1683 => 1.1319, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.95% (2.4457 => 2.3735, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.87% (0.4140 => 0.4021, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.81% (3.7496 => 3.6443, std. dev.: 0.0150) MultiSource/Applications/lambda-0_1_3/lambda: -2.75% (7.6833 => 7.4721, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: -2.66% (1.4117 => 1.3741, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -2.61% (9.5474 => 9.2979, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.36% (1.8739 => 1.8297, std. dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: -2.32% (92.7467 => 90.5910, std. dev.: 0.4903) MultiSource/Applications/siod/siod: -2.32% (3.5520 => 3.4695, std. dev.: 0.0215) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2364, std. dev.: 0.0370) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.56% (1.0686 => 1.0519, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -1.44% (3.4286 => 3.3792, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.38% (2.8964 => 2.8563, std. dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (25.6658 => 25.3278, std. dev.: 0.0396) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7700, std. dev.: 0.0136) MultiSource/Benchmarks/sim/sim: -1.10% (3.8907 => 3.8479, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/tsp/tsp: -1.08% (1.7330 => 1.7142, std. dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 16:46:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 18:46:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120904234636.638852A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3405?compare_to=3402&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3405, Order: 163165, Start Time: 2012-09-04 22:33:21, End Time: 2012-09-04 23:47:43 To: 3402, Order: 163161, Start Time: 2012-09-04 20:50:43, End Time: 2012-09-04 22:05:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.80% (3.7868 => 3.8551, std. dev.: 0.0256) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.75% (2.0176 => 2.3959, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.31% (0.5818 => 0.6534, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.21% (0.5748 => 0.6450, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3578 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3601 => 0.4017, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3646 => 0.4066, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.48% (0.3623 => 0.4039, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.47% (0.7061 => 0.7871, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.41% (0.3663 => 0.4081, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.34% (0.3650 => 0.4064, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.24% (0.3789 => 0.4215, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.19% (0.3914 => 0.4352, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.89% (0.4003 => 0.4439, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 10.76% (0.3940 => 0.4364, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.18% (0.7710 => 0.8495, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 9.86% (1.3693 => 1.5043, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 9.35% (0.2781 => 0.3041, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.31% (0.4328 => 0.4731, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.30% (3.9660 => 4.3349, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.02% (0.2782 => 0.3033, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.66% (0.5265 => 0.5721, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2607 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.51% (0.2655 => 0.2881, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: 8.49% (0.2628 => 0.2851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.47% (0.9199 => 0.9978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.44% (0.2690 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.41% (0.2760 => 0.2992, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.39% (0.3899 => 0.4226, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.39% (0.3756 => 0.4071, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 8.38% (0.3293 => 0.3569, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.37% (1.9828 => 2.1487, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.35% (0.2765 => 0.2996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.34% (0.2937 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.33% (0.2726 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.26% (0.2761 => 0.2989, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.22% (1.2193 => 1.3195, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.18% (0.7038 => 0.7614, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2696 => 0.2916, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.16% (0.2966 => 0.3208, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.13% (0.6959 => 0.7525, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.09% (0.3485 => 0.3767, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3489 => 0.3771, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.08% (0.3107 => 0.3358, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.02% (0.4390 => 0.4742, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3580 => 0.3867, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.91% (0.1327 => 0.1432, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.91% (0.3149 => 0.3398, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.86% (0.2988 => 0.3223, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.4563 => 1.5707, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 7.83% (0.3192 => 0.3442, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.82% (0.4016 => 0.4330, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.72% (13.8202 => 14.8870, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2127 => 0.2291, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.66% (1.1364 => 1.2234, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.64% (0.2721 => 0.2929, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.63% (0.4379 => 0.4713, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 7.62% (0.3453 => 0.3716, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.60% (0.3868 => 0.4162, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5577 => 0.5996, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 7.47% (0.3534 => 0.3798, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.43% (0.7506 => 0.8064, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (7.2180 => 7.7442, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.20% (0.4791 => 0.5136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.18% (0.1588 => 0.1702, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std. dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.2945 => 0.3150, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.84% (1.0313 => 1.1018, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.83% (0.5637 => 0.6022, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.78% (0.2995 => 0.3198, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.62% (0.6283 => 0.6699, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.50% (1.1061 => 1.1780, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 6.46% (0.8310 => 0.8847, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3220 => 0.3427, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.40% (0.1657 => 0.1763, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.37% (13.2842 => 14.1307, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 6.36% (0.2925 => 0.3111, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.29% (0.2243 => 0.2384, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.28% (0.3755 => 0.3991, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.14% (0.7460 => 0.7918, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.11% (3.8646 => 4.1007, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: 5.99% (0.6744 => 0.7148, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.96% (1.3245 => 1.4035, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.93% (0.4113 => 0.4357, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.87% (1.9270 => 2.0402, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.86% (1.3819 => 1.4629, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.84% (3.6692 => 3.8835, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.78% (1.3813 => 1.4612, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.70% (3.1889 => 3.3707, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 5.66% (1.2749 => 1.3470, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.63% (0.2504 => 0.2645, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 5.62% (2.1791 => 2.3015, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 5.48% (1.2292 => 1.2965, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.47% (1.0594 => 1.1173, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.42% (4.3801 => 4.6174, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6135 => 0.6467, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (4.4433 => 4.6821, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 5.35% (16.6129 => 17.5014, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.19% (0.8818 => 0.9276, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.97% (14.8535 => 15.5915, std. dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 4.94% (14.5298 => 15.2472, std. dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (1.1333 => 1.1884, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (8.4961 => 8.9065, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: 4.83% (0.2859 => 0.2997, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.82% (0.3131 => 0.3282, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.17% (4.6629 => 4.8574, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 4.11% (0.6250 => 0.6507, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (6.5754 => 6.8395, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (3.2742 => 3.4057, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.73% (4.9865 => 5.1727, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 3.59% (16.2614 => 16.8449, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.45% (1.5188 => 1.5712, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.1007 => 2.1731, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.32% (0.9108 => 0.9410, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 3.11% (3.7467 => 3.8633, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 2.75% (33.2944 => 34.2096, std. dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (6.2785 => 6.4400, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5191, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 23.81% (1.8175 => 2.2502, std. dev.: 0.0486) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.48% (3.1736 => 3.4109, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.1560 => 1.2272, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.51% (10.7476 => 11.1245, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5975, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.17% (3.7731 => 3.8551, std. dev.: 0.0256) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6135, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5956, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6859, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.54% (0.4657 => 0.4073, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.13% (22.5627 => 21.4059, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.36% (20.3410 => 18.2341, std. dev.: 0.0234) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.3780 => 1.3195, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6033, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -2.05% (26.5159 => 25.9714, std. dev.: 0.0328) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2381, std. dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2062, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5348, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2307, std. dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 17:18:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 19:18:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905001802.7FA7A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3406?compare_to=3400&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3406, Order: 163164, Start Time: 2012-09-04 21:35:28, End Time: 2012-09-05 00:19:09 To: 3400, Order: 163148, Start Time: 2012-09-04 18:23:50, End Time: 2012-09-04 21:07:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.3538 => 1.3689, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.53% (1.7178 => 1.6915, std. dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.58% (0.3446 => 0.3983, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.54% (0.3442 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.53% (0.3465 => 0.4003, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.49% (0.3460 => 0.3996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.48% (0.3488 => 0.4028, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.47% (0.3496 => 0.4037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.42% (0.3469 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.71% (0.3643 => 0.4179, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.50% (0.3724 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.63% (0.5826 => 0.6387, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5889 => 0.6451, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.70% (0.1620 => 0.1761, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7171 => 0.7734, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.42% (3.5627 => 3.8269, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.15% (1.6211 => 1.7370, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (0.5900 => 0.6295, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.66% (1.3152 => 1.4028, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.55% (0.5026 => 0.5355, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2875 => 0.3057, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.28% (0.4361 => 0.4635, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.23% (0.4994 => 0.5305, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 6.21% (0.4029 => 0.4279, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.17% (1.5932 => 1.6915, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (0.3930 => 0.4170, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.04% (0.3792 => 0.4021, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (0.5000 => 0.5301, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.3004 => 0.3183, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.92% (0.2738 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2811 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3195 => 0.3383, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2780 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.85% (0.2750 => 0.2911, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.83% (4.2109 => 4.4564, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2813 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.83% (0.2729 => 0.2888, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2803 => 0.2966, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.77% (0.2792 => 0.2953, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.73% (0.9909 => 1.0477, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3060 => 0.3235, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.71% (2.0673 => 2.1853, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2823 => 0.2984, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.64% (1.0781 => 1.1389, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.3096 => 0.3270, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (2.7292 => 2.8820, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.57% (0.2911 => 0.3073, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.49% (0.3258 => 0.3437, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3267 => 0.3445, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.38% (0.3362 => 0.3543, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.31% (0.3317 => 0.3493, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3124 => 0.3287, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.20% (0.3348 => 0.3522, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3678 => 0.3868, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.14% (5.5417 => 5.8268, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3477 => 0.3655, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3726 => 0.3916, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (1.9694 => 2.0697, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.3625 => 0.3809, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.03% (0.3282 => 0.3447, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (0.3890 => 0.4084, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (1.9966 => 2.0961, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3690 => 0.3872, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (0.4658 => 0.4885, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.72% (0.2566 => 0.2687, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.3903 => 0.4086, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.68% (0.4251 => 0.4450, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.65% (2.1013 => 2.1991, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.61% (0.4146 => 0.4337, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.57% (0.9697 => 1.0140, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.47% (0.3981 => 0.4159, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.3845 => 0.4015, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 4.41% (23.5202 => 24.5572, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 4.41% (1.8794 => 1.9622, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.4139 => 0.4317, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.28% (4.6177 => 4.8154, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (4.4195 => 4.6071, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 4.24% (2.1653 => 2.2571, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.17% (0.2737 => 0.2851, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.16% (1.4269 => 1.4862, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 4.09% (0.7875 => 0.8197, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.3271 => 0.3403, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.98% (0.6634 => 0.6898, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.5012 => 0.5211, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.2969 => 0.3082, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.79% (0.5546 => 0.5756, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.78% (0.3336 => 0.3462, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.10% (2.0346 => 2.0774, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (0.7426 => 0.7536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (4.6926 => 4.7529, std. dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (11.6398 => 11.7764, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: 1.06% (2.4764 => 2.5026, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6723, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.99% (1.8057 => 1.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6405, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std. dev.: 0.0100) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5025, std. dev.: 0.0258) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4617, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.07% (105.3826 => 106.5074, std. dev.: 0.0748) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5875, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5643, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7846, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8041, std. dev.: 0.0105) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8358, std. dev.: 0.0218) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.86% (0.6293 => 0.6176, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9664, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5003, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 17:29:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 19:29:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905002912.A02EA2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3407?compare_to=3403&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3407, Order: 163174, Start Time: 2012-09-04 23:10:49, End Time: 2012-09-05 00:30:20 To: 3403, Order: 163164, Start Time: 2012-09-04 21:23:26, End Time: 2012-09-04 22:42:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (138 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.40% (1.9508 => 1.9782, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.45% (55.1368 => 56.4876, std. dev.: 0.0354) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.19% (13.5092 => 13.2127, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.45% (10.3673 => 13.2127, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 15.32% (0.3473 => 0.4005, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.87% (0.3543 => 0.4070, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.81% (0.3497 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3543 => 0.4066, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.73% (0.3516 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.71% (0.3561 => 0.4085, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3694 => 0.4217, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.87% (0.3828 => 0.4359, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3927 => 0.4468, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.64% (0.3886 => 0.4416, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.34% (1.7609 => 1.9782, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.51% (1.1194 => 1.2482, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 10.36% (0.1622 => 0.1790, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 9.99% (0.1432 => 0.1575, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.61% (2.2022 => 2.4138, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5925 => 0.6443, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.64% (0.7326 => 0.7886, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.07% (0.3282 => 0.3514, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.83% (0.8172 => 0.8730, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.79% (0.3817 => 0.4076, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (10.4361 => 11.1343, std. dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.4879 => 0.5198, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.43% (7.0540 => 7.5079, std. dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: 6.43% (0.3109 => 0.3309, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.38% (9.4845 => 10.0899, std. dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7433 => 0.7905, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.30% (0.7115 => 0.7563, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.24% (0.7835 => 0.8324, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3423 => 0.3635, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5860 => 0.6218, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.10% (4.2646 => 4.5249, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (8.1363 => 8.6304, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 6.03% (0.2554 => 0.2708, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5569 => 0.5902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.90% (1.3050 => 1.3820, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.78% (0.4103 => 0.4340, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.76% (5.0018 => 5.2898, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (1.5415 => 1.6295, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2603 => 0.2751, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (4.9449 => 5.2259, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.50% (3.3354 => 3.5187, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 5.46% (0.3422 => 0.3609, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.43% (1.5603 => 1.6450, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9765 => 1.0292, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 5.38% (5.7591 => 6.0687, std. dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.33% (0.4636 => 0.4883, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.24% (0.5020 => 0.5283, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.2905 => 0.3057, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.22% (0.2891 => 0.3042, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.4064 => 0.4274, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.11% (0.2700 => 0.2838, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6675 => 0.7015, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (2.0665 => 2.1714, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.04% (0.3826 => 0.4019, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.3180 => 0.3340, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3650 => 0.3832, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2831 => 0.2971, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.93% (1.1642 => 1.2216, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.91% (0.3098 => 0.3250, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.88% (0.8067 => 0.8461, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.86% (0.3865 => 0.4053, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.85% (0.3136 => 0.3288, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.83% (0.4289 => 0.4496, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.83% (0.2756 => 0.2889, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.81% (0.2871 => 0.3009, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 4.79% (0.3092 => 0.3240, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (14.3668 => 15.0531, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2872 => 0.3009, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (1.1861 => 1.2426, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2877 => 0.3014, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.76% (0.6456 => 0.6763, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4203 => 0.4402, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3232 => 0.3385, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3162 => 0.3311, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3441 => 0.3603, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.69% (0.4048 => 0.4238, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.69% (0.2793 => 0.2924, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2714 => 0.2841, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 4.66% (0.3283 => 0.3436, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.65% (0.3052 => 0.3194, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.64% (0.3603 => 0.3770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3684 => 0.3854, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.57% (2.0273 => 2.1199, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 4.53% (3.8723 => 4.0477, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.52% (0.3935 => 0.4113, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.51% (1.0722 => 1.1206, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2802 => 0.2928, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.40% (0.3387 => 0.3536, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.37% (0.4620 => 0.4822, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.36% (0.6450 => 0.6731, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3379 => 0.3519, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.08% (0.8921 => 0.9285, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.01% (2.2969 => 2.3891, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.98% (0.5981 => 0.6219, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (1.4186 => 1.4725, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (1.5859 => 1.6433, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.2024 => 2.2759, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2842 => 1.3259, std. dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 3.12% (17.1811 => 17.7175, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.1840 => 1.2164, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.69% (7.9617 => 8.1759, std. dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.8101 => 0.8267, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 1.94% (21.9371 => 22.3630, std. dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3822, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 4.67% (1.1396 => 1.1928, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7616, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (4.2280 => 4.3643, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2393, std. dev.: 0.0089) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.07% (2.2771 => 2.3014, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7614, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.10% (5.2763 => 3.2132, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.45% (5.3855 => 3.7456, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.15% (5.3526 => 3.7387, std. dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1208, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5529, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.44% (22.1758 => 20.3052, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2731, std. dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (1.8329 => 1.7186, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std. dev.: 0.0014) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.96% (1.6805 => 1.6140, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4265, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.82% (1.3677 => 1.3291, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9967, std. dev.: 0.0160) SingleSource/Benchmarks/McGill/chomp: -2.59% (1.2373 => 1.2053, std. dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9663, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1861, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2189, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 17:57:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 19:57:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905005723.5E0782A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3408?compare_to=3404&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3408, Order: 163180, Start Time: 2012-09-04 23:46:43, End Time: 2012-09-05 00:58:30 To: 3404, Order: 163165, Start Time: 2012-09-04 22:18:35, End Time: 2012-09-04 23:30:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (34 on baseline) Performance Improvements: 3 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (822 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 75.89% (0.0224 => 0.0394, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.72% (0.1712 => 0.1827, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.97% (0.7480 => 0.7627, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.45% (1.1668 => 1.1837, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.66% (1.3206 => 1.4085, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/misr: 3.30% (0.4732 => 0.4888, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.34% (1.0799 => 1.1052, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.49% (1.8297 => 1.8570, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.08% (0.7854 => 0.7691, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.87% (22.7398 => 19.8141, std. dev.: 1.0122) MultiSource/Benchmarks/llubenchmark/llu: -1.54% (2.0230 => 1.9918, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.1653 => 1.2002, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.64% (1.0046 => 1.0311, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.5150 => 1.5444, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.42% (12.6413 => 12.8210, std. dev.: 0.0254) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.41% (1.1672 => 1.1837, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.36% (0.0917 => 0.1067, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9989, std. dev.: 0.0353) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.16% (4.0101 => 4.5379, std. dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/sieve: 12.85% (3.4406 => 3.8828, std. dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.78% (62.4126 => 69.1376, std. dev.: 0.0641) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.83% (1.0063 => 1.1052, std. dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 8.63% (1.0194 => 1.1074, std. dev.: 0.0224) SingleSource/Benchmarks/Shootout/lists: 8.34% (7.0025 => 7.5862, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout/methcall: 6.62% (8.5566 => 9.1232, std. dev.: 0.0737) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (3.4876 => 3.7133, std. dev.: 0.0328) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (0.3301 => 0.3502, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7422, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.88% (0.8498 => 0.8913, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8505, std. dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.85% (2.6656 => 2.7683, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/ReedSolomon: 2.73% (8.5113 => 8.7440, std. dev.: 0.0893) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.58% (0.5587 => 0.5731, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.72% (1.6110 => 1.6387, std. dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.45% (4.6127 => 4.6795, std. dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5328, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6921, std. dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.35% (0.2080 => 0.1948, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.43% (0.7738 => 0.7627, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.25% (4.2815 => 4.2279, std. dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.09% (0.3497 => 0.2060, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.32% (5.2665 => 4.0909, std. dev.: 0.1021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1605, std. dev.: 0.0304) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9362, std. dev.: 0.0202) SingleSource/Benchmarks/Misc/richards_benchmark: -7.08% (1.4441 => 1.3419, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: -6.43% (9.2503 => 8.6559, std. dev.: 0.1708) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5503, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4056, std. dev.: 0.0281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (3.9413 => 3.7615, std. dev.: 0.0594) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.32% (1.7361 => 1.6611, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.84% (0.4140 => 0.3981, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.23% (1.1683 => 1.1306, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -2.81% (7.6833 => 7.4673, std. dev.: 0.0761) MultiSource/Benchmarks/PAQ8p/paq8p: -2.79% (92.7467 => 90.1606, std. dev.: 0.3730) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0098) MultiSource/Applications/siod/siod: -2.35% (3.5520 => 3.4684, std. dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.29% (3.7496 => 3.6636, std. dev.: 0.0310) SingleSource/Benchmarks/Misc/ffbench: -2.25% (1.4117 => 1.3800, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.91% (2.8964 => 2.8410, std. dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2237, std. dev.: 0.0273) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -1.53% (3.4286 => 3.3761, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: -1.52% (3.8200 => 3.7620, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3104, std. dev.: 0.0735) MultiSource/Benchmarks/llubenchmark/llu: -1.36% (2.0192 => 1.9918, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -1.34% (3.8907 => 3.8385, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.01% (1.1116 => 1.1004, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 18:29:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 20:29:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905012909.0828E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3409?compare_to=3405&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3409, Order: 163180, Start Time: 2012-09-05 00:15:46, End Time: 2012-09-05 01:30:16 To: 3405, Order: 163165, Start Time: 2012-09-04 22:33:21, End Time: 2012-09-04 23:47:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (163 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.24% (7.9473 => 8.0455, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.71% (3.8551 => 3.7891, std. dev.: 0.0172) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.59% (2.0176 => 2.3927, std. dev.: 0.0158) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.47% (0.1410 => 0.1614, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.10% (0.5818 => 0.6522, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.92% (0.5748 => 0.6433, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.90% (0.7061 => 0.7901, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 11.74% (0.3578 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3601 => 0.4017, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.55% (0.3646 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.38% (0.3663 => 0.4080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.37% (0.3623 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3650 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.27% (0.3789 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.06% (0.3914 => 0.4347, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.79% (0.4003 => 0.4435, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.69% (0.3940 => 0.4361, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.77% (0.7710 => 0.8463, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 9.71% (1.3693 => 1.5023, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.41% (0.1413 => 0.1546, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.17% (0.2781 => 0.3036, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.08% (3.9660 => 4.3262, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 9.08% (0.4328 => 0.4721, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.88% (0.2782 => 0.3029, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.70% (0.2655 => 0.2886, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.62% (0.5265 => 0.5719, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 8.54% (0.4062 => 0.4409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2607 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.36% (0.2690 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.33% (0.2761 => 0.2991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.27% (0.2937 => 0.3180, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.27% (0.3022 => 0.3272, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.27% (1.9828 => 2.1467, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2628 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.23% (0.3293 => 0.3564, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.22% (0.2760 => 0.2987, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.21% (0.9199 => 0.9954, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.16% (1.2193 => 1.3188, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.14% (0.3489 => 0.3773, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.11% (0.2726 => 0.2947, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.08% (0.3899 => 0.4214, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.06% (0.2966 => 0.3205, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.94% (0.7038 => 0.7597, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.94% (0.2696 => 0.2910, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.92% (0.3485 => 0.3761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.91% (0.3756 => 0.4053, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.89% (0.4016 => 0.4333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.89% (0.3107 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.86% (0.2721 => 0.2935, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.82% (0.3580 => 0.3860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.81% (0.3149 => 0.3395, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.80% (0.3192 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.79% (0.3453 => 0.3722, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.77% (0.6959 => 0.7500, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 7.76% (0.2988 => 0.3220, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.76% (0.1327 => 0.1430, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.60% (0.3868 => 0.4162, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.53% (1.4563 => 1.5660, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.53% (1.1364 => 1.2220, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.37% (13.8202 => 14.8382, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.4390 => 0.4712, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.27% (0.7506 => 0.8052, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: 7.24% (0.3534 => 0.3790, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.24% (0.1588 => 0.1703, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.23% (0.5577 => 0.5980, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.19% (7.2180 => 7.7368, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.97% (0.1435 => 0.1535, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.95% (0.4791 => 0.5124, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.88% (0.2995 => 0.3201, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.83% (0.2945 => 0.3146, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.65% (0.3246 => 0.3462, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.55% (0.5637 => 0.6006, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.55% (1.0313 => 1.0988, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.46% (0.6283 => 0.6689, std. dev.: 0.0135) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.38% (0.8310 => 0.8840, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (13.2842 => 14.1286, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.27% (0.3220 => 0.3422, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 6.27% (1.1061 => 1.1754, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.20% (0.4113 => 0.4368, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.12% (0.2925 => 0.3104, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2243 => 0.2380, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.07% (0.7460 => 0.7913, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.99% (0.3755 => 0.3980, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.2749 => 1.3512, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.95% (1.3813 => 1.4635, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.86% (1.3819 => 1.4629, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 5.86% (0.6744 => 0.7139, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.81% (3.8646 => 4.0891, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.3245 => 1.4008, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 5.76% (1.9270 => 2.0379, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.75% (3.6692 => 3.8802, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.70% (0.8818 => 0.9321, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.63% (0.8698 => 0.9188, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.53% (3.1889 => 3.3654, std. dev.: 0.0096) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 5.43% (2.1791 => 2.2975, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6167, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.38% (4.4433 => 4.6825, std. dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 5.34% (1.2292 => 1.2949, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 5.28% (1.0594 => 1.1153, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6135 => 0.6458, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.18% (16.6129 => 17.4742, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 5.09% (14.8535 => 15.6102, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.76% (0.3131 => 0.3280, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.76% (8.4961 => 8.9004, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 4.71% (14.5298 => 15.2139, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 4.65% (0.2859 => 0.2992, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.62% (1.1333 => 1.1857, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.31% (4.6629 => 4.8640, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/bigfib: 4.11% (0.6250 => 0.6507, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.04% (0.4805 => 0.4999, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (3.2742 => 3.4037, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.93% (6.5754 => 6.8336, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 3.50% (16.2614 => 16.8310, std. dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (4.9865 => 5.1607, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.38% (0.9108 => 0.9416, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (1.5188 => 1.5684, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.1007 => 2.1682, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.99% (3.7467 => 3.8587, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 2.89% (33.2944 => 34.2573, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.54% (6.2785 => 6.4378, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2687, std. dev.: 0.0485) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.1560 => 1.2255, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7338, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.61% (10.7476 => 11.1352, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5980, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.00% (1.5824 => 1.6141, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2066, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.20% (1.4298 => 1.4470, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6872, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5925, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.63% (0.4657 => 0.4069, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.10% (22.5627 => 21.4121, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2605, std. dev.: 0.0536) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5118, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9243, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5941, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.04% (26.5159 => 25.9754, std. dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2133, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5353, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 19:16:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 21:16:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905021633.5D0322A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3410?compare_to=3407&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3410, Order: 163182, Start Time: 2012-09-05 00:58:23, End Time: 2012-09-05 02:17:38 To: 3407, Order: 163174, Start Time: 2012-09-04 23:10:49, End Time: 2012-09-05 00:30:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.68% (13.2127 => 13.5674, std. dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.87% (10.3673 => 13.5674, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/trivial-interface: 15.49% (0.3473 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.27% (0.3516 => 0.4053, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.19% (0.3561 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.16% (0.3497 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.13% (0.3543 => 0.4079, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.10% (0.3543 => 0.4078, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.51% (0.3694 => 0.4230, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.29% (0.3828 => 0.4375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.11% (0.3927 => 0.4481, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.87% (0.3886 => 0.4425, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.40% (1.7609 => 1.9617, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (0.1622 => 0.1802, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.85% (1.1194 => 1.2408, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 10.27% (0.1432 => 0.1579, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.05% (2.2022 => 2.4015, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7326 => 0.7890, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.15% (0.3817 => 0.4090, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 6.95% (0.3282 => 0.3510, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.8172 => 0.8739, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 6.88% (10.4361 => 11.1545, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3307 => 0.3530, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4615 => 0.4922, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.52% (0.2271 => 0.2419, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.42% (0.2758 => 0.2935, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.32% (0.7835 => 0.8330, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.32% (7.0540 => 7.4995, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.28% (0.7115 => 0.7562, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.28% (0.5860 => 0.6228, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (9.4845 => 10.0717, std. dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.7433 => 0.7893, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (4.2646 => 4.5277, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5569 => 0.5903, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (8.1363 => 8.6225, std. dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (0.3121 => 0.3304, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3805, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.76% (0.5105 => 0.5399, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.70% (1.5415 => 1.6294, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.69% (4.9449 => 5.2262, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (5.0018 => 5.2853, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists: 5.52% (0.3422 => 0.3611, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.50% (3.3354 => 3.5190, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.49% (0.2603 => 0.2746, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.44% (0.4299 => 0.4533, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.4636 => 0.4888, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.37% (5.7591 => 6.0683, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 5.36% (1.5603 => 1.6440, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.34% (0.4103 => 0.4322, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.28% (0.5020 => 0.5285, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.27% (0.9765 => 1.0280, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.4064 => 0.4275, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.18% (0.3826 => 0.4024, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.16% (0.2905 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.15% (0.2891 => 0.3040, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.11% (0.6675 => 0.7016, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.09% (0.8067 => 0.8478, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.07% (0.2700 => 0.2837, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 4.98% (0.2831 => 0.2972, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.94% (0.4289 => 0.4501, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.92% (1.1642 => 1.2215, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.91% (0.3098 => 0.3250, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.88% (0.2725 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.87% (0.3180 => 0.3335, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (14.3668 => 15.0651, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.85% (0.3650 => 0.3827, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.85% (0.3052 => 0.3200, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.84% (0.3162 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.77% (1.1861 => 1.2427, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.77% (0.2871 => 0.3008, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3684 => 0.3859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2872 => 0.3008, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.73% (0.3865 => 0.4048, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.71% (0.6456 => 0.6760, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3441 => 0.3603, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.70% (2.0665 => 2.1637, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.69% (0.4203 => 0.4400, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.64% (0.3232 => 0.3382, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 4.62% (0.2877 => 0.3010, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.62% (0.4048 => 0.4235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.61% (0.2714 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3603 => 0.3768, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 4.57% (3.8723 => 4.0491, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.55% (0.2793 => 0.2920, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3283 => 0.3431, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.50% (2.0273 => 2.1185, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3935 => 0.4109, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.40% (1.0722 => 1.1194, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.37% (0.3387 => 0.3535, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (0.4620 => 0.4820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2802 => 0.2922, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (0.6450 => 0.6725, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.05% (0.3379 => 0.3516, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.98% (0.5981 => 0.6219, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.94% (2.2969 => 2.3873, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.73% (1.4186 => 1.4715, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (1.5859 => 1.6416, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.2024 => 2.2715, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 3.03% (17.1811 => 17.7024, std. dev.: 0.0247) MultiSource/Applications/hexxagon/hexxagon: 3.01% (1.2842 => 1.3228, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.1840 => 1.2162, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.61% (7.9617 => 8.1696, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.8101 => 0.8263, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.88% (21.9371 => 22.3494, std. dev.: 0.0250) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 4.56% (1.1396 => 1.1916, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (4.2280 => 4.3697, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.42% (2.2771 => 2.3095, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2403, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5827, std. dev.: 0.0072) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7609, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.30% (5.2763 => 3.2025, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.80% (5.3855 => 3.7270, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1163, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5490, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -8.63% (22.1758 => 20.2631, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2769, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.26% (1.8329 => 1.7182, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1491, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5012, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4253, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0139, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9615, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -2.29% (12.4730 => 12.1879, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -1.73% (1.2373 => 1.2159, std. dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (1.7254 => 1.7047, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2285, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.09% (1.0313 => 1.0201, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 19:25:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 21:25:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905022516.8F8FD2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3411?compare_to=3408&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3411, Order: 163182, Start Time: 2012-09-05 01:14:26, End Time: 2012-09-05 02:26:23 To: 3408, Order: 163180, Start Time: 2012-09-04 23:46:43, End Time: 2012-09-05 00:58:30 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (45 on baseline) Performance Improvements: 4 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 7.78% (0.1389 => 0.1497, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.20% (0.4379 => 0.4563, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.31% (0.5505 => 0.5687, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 2.07% (15.3277 => 15.6453, std. dev.: 0.1150) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7566 => 0.7713, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2002 => 1.2176, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.39% (14.6415 => 14.8454, std. dev.: 0.0440) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.39% (19.8141 => 22.2681, std. dev.: 0.4814) SingleSource/Benchmarks/Misc/ffbench: 2.36% (1.3800 => 1.4126, std. dev.: 0.0118) MultiSource/Benchmarks/llubenchmark/llu: 2.10% (1.9918 => 2.0337, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/ReedSolomon: 1.06% (8.7440 => 8.8363, std. dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.53% (0.7627 => 0.7510, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.63% (45.0952 => 43.9073, std. dev.: 0.3219) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.11% (4.5781 => 4.4817, std. dev.: 0.0335) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.72% (1.1052 => 1.0862, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.49% (1.1653 => 1.2176, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 3.11% (0.3217 => 0.3317, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.06% (0.6173 => 0.6362, std. dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 2.71% (2.1763 => 2.2352, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (12.6413 => 12.9212, std. dev.: 0.0752) MultiSource/Applications/kimwitu++/kc: 2.19% (15.3105 => 15.6453, std. dev.: 0.1150) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (0.7639 => 0.7746, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.6079 => 14.7565, std. dev.: 0.0423) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.01% (1.2021 => 1.2143, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0338) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9996, std. dev.: 0.0303) SingleSource/Benchmarks/McGill/misr: 13.97% (0.4296 => 0.4896, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.09% (4.0101 => 4.5349, std. dev.: 0.0342) MultiSource/Applications/sgefa/sgefa: 12.81% (0.3746 => 0.4226, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8794, std. dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: 10.77% (62.4126 => 69.1318, std. dev.: 0.0140) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.39% (0.2694 => 0.2947, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 9.19% (1.0194 => 1.1131, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6221, std. dev.: 0.0563) SingleSource/Benchmarks/Stanford/Puzzle: 8.79% (0.1433 => 0.1559, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.94% (1.0063 => 1.0862, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/methcall: 7.03% (8.5566 => 9.1581, std. dev.: 0.0486) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (3.4876 => 3.7266, std. dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.85% (0.3301 => 0.3527, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8038, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.67% (40.4792 => 42.7742, std. dev.: 0.3264) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.20% (15.2242 => 15.8642, std. dev.: 0.0186) MultiSource/Benchmarks/Olden/bisort/bisort: 3.96% (0.6459 => 0.6715, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 3.82% (8.5113 => 8.8363, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8716, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.56% (2.6656 => 2.7604, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/five11/five11: 2.23% (5.1938 => 5.3094, std. dev.: 0.0305) SingleSource/Benchmarks/Misc/whetstone: 1.88% (2.3453 => 2.3895, std. dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.84% (4.6127 => 4.6978, std. dev.: 0.0166) MultiSource/Applications/JM/lencod/lencod: 1.79% (6.7458 => 6.8663, std. dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (2.4971 => 2.5363, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4455 => 2.4821, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 1.41% (14.4877 => 14.6924, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 1.40% (2.5166 => 2.5519, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 1.28% (29.5232 => 29.9004, std. dev.: 0.1015) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6923, std. dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: 1.09% (2.4013 => 2.4275, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.95% (0.7738 => 0.7510, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.75% (0.9029 => 0.8781, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0778, std. dev.: 0.1266) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.94% (1.1647 => 0.9907, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std. dev.: 0.0253) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.83% (3.2007 => 2.9501, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/richards_benchmark: -7.20% (1.4441 => 1.3401, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/pi: -6.32% (1.6538 => 1.5493, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.85% (9.2503 => 8.7087, std. dev.: 0.0655) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.99% (1.7361 => 1.6495, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.69% (2.4457 => 2.3555, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.48% (0.4140 => 0.3996, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.43% (45.4683 => 43.9073, std. dev.: 0.3219) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.18% (1.1683 => 1.1312, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -2.94% (7.6833 => 7.4571, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.78% (2.8964 => 2.8160, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2849, std. dev.: 0.0167) MultiSource/Benchmarks/PAQ8p/paq8p: -2.65% (92.7467 => 90.2915, std. dev.: 0.1710) MultiSource/Applications/siod/siod: -2.02% (3.5520 => 3.4801, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.89% (3.7496 => 3.6788, std. dev.: 0.0067) MultiSource/Applications/aha/aha: -1.84% (3.4286 => 3.3655, std. dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2332, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -1.50% (1.0926 => 1.0762, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.48% (3.8907 => 3.8331, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7663, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3123, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -1.14% (1.7330 => 1.7132, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 20:11:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 22:11:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905031143.641452A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3412?compare_to=3409&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3412, Order: 163188, Start Time: 2012-09-05 01:58:20, End Time: 2012-09-05 03:12:48 To: 3409, Order: 163180, Start Time: 2012-09-05 00:15:46, End Time: 2012-09-05 01:30:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (166 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.24% (54.5970 => 56.3634, std. dev.: 0.1801) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.48% (78.5232 => 80.4712, std. dev.: 0.3402) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3099 => 1.3247, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.96% (2.0176 => 2.4002, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.75% (0.1410 => 0.1618, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.22% (0.5818 => 0.6529, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.06% (0.5748 => 0.6441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3578 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3601 => 0.4023, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3646 => 0.4066, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.48% (0.3623 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.47% (0.3663 => 0.4083, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.42% (0.3650 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 11.22% (0.3789 => 0.4214, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.19% (0.3914 => 0.4352, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.02% (0.4003 => 0.4444, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.84% (0.3940 => 0.4367, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.97% (0.7710 => 0.8479, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 9.67% (1.3693 => 1.5017, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1413 => 0.1549, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.39% (3.9660 => 4.3383, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 9.15% (0.4328 => 0.4724, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 9.06% (0.2781 => 0.3033, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.03% (0.4062 => 0.4429, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.81% (0.5265 => 0.5729, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.73% (0.2782 => 0.3025, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.45% (0.9199 => 0.9976, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2607 => 0.2827, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.44% (0.2690 => 0.2917, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.34% (0.7038 => 0.7625, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.32% (0.2655 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.30% (0.2628 => 0.2846, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.26% (1.9828 => 2.1466, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.26% (1.2193 => 1.3200, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.21% (0.3022 => 0.3270, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.20% (0.3293 => 0.3563, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.18% (0.3899 => 0.4218, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2726 => 0.2949, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2760 => 0.2985, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.14% (0.3489 => 0.3773, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.14% (0.2937 => 0.3176, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.08% (0.6959 => 0.7521, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.06% (0.2966 => 0.3205, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.04% (0.2761 => 0.2983, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.03% (0.3485 => 0.3765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.99% (0.3580 => 0.3866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3107 => 0.3355, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.97% (0.2696 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.91% (0.1327 => 0.1432, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.90% (0.2988 => 0.3224, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.85% (0.3756 => 0.4051, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 7.81% (0.3149 => 0.3395, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.80% (1.4563 => 1.5699, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.2721 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.74% (0.4016 => 0.4327, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.74% (0.3192 => 0.3439, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.73% (13.8202 => 14.8880, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.67% (0.5577 => 0.6005, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4379 => 0.4715, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2127 => 0.2290, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.64% (1.1364 => 1.2232, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.53% (0.3453 => 0.3713, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.42% (0.3868 => 0.4155, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (7.2180 => 7.7473, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 7.33% (0.3534 => 0.3793, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.33% (0.7506 => 0.8056, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.24% (0.4390 => 0.4708, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.12% (0.1588 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.99% (0.3246 => 0.3473, std. dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.87% (0.2023 => 0.2162, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.82% (1.0313 => 1.1016, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.72% (0.2945 => 0.3143, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.71% (0.5637 => 0.6015, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (13.2842 => 14.1644, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.56% (0.6283 => 0.6695, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.55% (1.1061 => 1.1786, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 6.41% (0.8310 => 0.8843, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2243 => 0.2386, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3220 => 0.3424, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.32% (0.2925 => 0.3110, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.23% (0.3755 => 0.3989, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.22% (0.4113 => 0.4369, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.21% (0.7460 => 0.7923, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 6.19% (3.8646 => 4.1037, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.07% (1.3819 => 1.4658, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.05% (0.6744 => 0.7152, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (1.3245 => 1.4046, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.05% (1.3813 => 1.4648, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.89% (0.8698 => 0.9210, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.84% (1.9270 => 2.0396, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.84% (3.6692 => 3.8836, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 5.68% (1.2749 => 1.3473, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 5.66% (2.1791 => 2.3024, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 5.60% (3.1889 => 3.3676, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.59% (4.3801 => 4.6248, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.55% (0.2504 => 0.2643, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.50% (1.0594 => 1.1177, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (4.4433 => 4.6866, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.41% (1.2292 => 1.2957, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.36% (0.8818 => 0.9291, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.36% (16.6129 => 17.5030, std. dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6135 => 0.6463, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.07% (14.8535 => 15.6073, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.96% (0.3245 => 0.3406, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.95% (8.4961 => 8.9165, std. dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 4.94% (14.5298 => 15.2481, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.93% (1.1333 => 1.1892, std. dev.: 0.0093) MultiSource/Benchmarks/sim/sim: 4.89% (0.3131 => 0.3284, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.86% (0.2859 => 0.2998, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4805 => 0.5009, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6250 => 0.6510, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.13% (3.2742 => 3.4094, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (6.5754 => 6.8443, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 4.08% (4.6629 => 4.8533, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1750, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.63% (1.5188 => 1.5739, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.59% (16.2614 => 16.8449, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1007 => 2.1742, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.46% (0.9108 => 0.9423, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.03% (3.7467 => 3.8602, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.68% (33.2944 => 34.1879, std. dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.65% (6.2785 => 6.4449, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 26.82% (1.8175 => 2.3050, std. dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.87% (1.0895 => 1.3496, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.36% (1.2998 => 1.3825, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.1560 => 1.2272, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.54% (10.7476 => 11.1284, std. dev.: 0.0573) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5991, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6136, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5185, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5964, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6874, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.54% (0.4657 => 0.4073, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.84% (22.5627 => 21.4717, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2735, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.87% (1.3780 => 1.3247, std. dev.: 0.0046) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1490, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9220, std. dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.25% (0.4867 => 0.4709, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5845, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -2.02% (7.3305 => 7.1826, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.85% (26.5159 => 26.0265, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2445, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5361, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 20:29:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 22:29:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905032939.EDFCC2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3413?compare_to=3406&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3413, Order: 163182, Start Time: 2012-09-05 00:47:11, End Time: 2012-09-05 03:30:48 To: 3406, Order: 163164, Start Time: 2012-09-04 21:35:28, End Time: 2012-09-05 00:19:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.51% (0.2091 => 0.2248, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (2.0874 => 2.1147, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.99% (0.3446 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.92% (0.3460 => 0.4011, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 15.92% (0.3442 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.87% (0.3465 => 0.4015, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 15.85% (0.3496 => 0.4050, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.74% (0.3488 => 0.4037, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.74% (0.3469 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.18% (0.3643 => 0.4196, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.10% (0.3650 => 0.4201, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.85% (0.3724 => 0.4277, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.39% (0.5826 => 0.6373, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.15% (0.5889 => 0.6428, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.83% (0.1620 => 0.1763, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7171 => 0.7715, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (3.5627 => 3.8276, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.41% (1.6211 => 1.7413, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.89% (1.5932 => 1.7030, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.75% (1.3152 => 1.4040, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.51% (0.4361 => 0.4645, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.5900 => 0.6278, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.35% (0.5026 => 0.5345, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.28% (0.3792 => 0.4030, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (0.3930 => 0.4174, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.16% (0.5000 => 0.5308, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 6.08% (4.2109 => 4.4670, std. dev.: 0.0175) MultiSource/Applications/spiff/spiff: 6.08% (0.4029 => 0.4274, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.1968 => 0.2083, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.76% (2.7292 => 2.8863, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.74% (0.2875 => 0.3040, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.69% (1.0781 => 1.1394, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.2736 => 0.2891, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.49% (0.3004 => 0.3169, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.2866 => 0.3022, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 5.39% (0.2725 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2780 => 0.2928, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.31% (5.5417 => 5.8359, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.30% (0.2792 => 0.2940, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3060 => 0.3222, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2738 => 0.2882, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.26% (0.9909 => 1.0430, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2803 => 0.2948, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.16% (0.2750 => 0.2892, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.12% (0.2811 => 0.2955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.12% (0.2813 => 0.2957, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (2.0673 => 2.1724, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.3096 => 0.3253, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (0.3890 => 0.4085, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (1.9966 => 2.0964, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (1.9694 => 2.0677, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.91% (0.2911 => 0.3054, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (0.4658 => 0.4886, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.3258 => 0.3416, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.84% (0.3267 => 0.3425, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.79% (0.3362 => 0.3523, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.74% (0.3124 => 0.3272, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.70% (0.3726 => 0.3901, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.3903 => 0.4086, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3317 => 0.3472, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.66% (0.3845 => 0.4024, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (2.1013 => 2.1980, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: 4.60% (0.3348 => 0.3502, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.3678 => 0.3847, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (1.8794 => 1.9654, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3690 => 0.3858, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.55% (0.9697 => 1.0138, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.54% (0.3282 => 0.3431, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.52% (0.3477 => 0.3634, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3625 => 0.3788, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.3271 => 0.3418, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.49% (0.4251 => 0.4442, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.47% (4.6177 => 4.8243, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.4139 => 0.4324, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (4.4195 => 4.6156, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 4.35% (1.4269 => 1.4890, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.25% (0.3981 => 0.4150, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.23% (23.5202 => 24.5148, std. dev.: 0.0194) MultiSource/Applications/JM/ldecod/ldecod: 4.21% (2.1653 => 2.2565, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4146 => 0.4318, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.04% (0.7875 => 0.8193, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.2737 => 0.2846, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.91% (0.5546 => 0.5763, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.81% (0.6634 => 0.6887, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.2969 => 0.3082, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.56% (0.6435 => 0.6664, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.49% (0.5012 => 0.5187, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.28% (2.0346 => 2.0809, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (0.7426 => 0.7560, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.21% (4.6926 => 4.7493, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.11% (11.6398 => 11.7694, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.2122 => 0.2248, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std. dev.: 0.0207) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6271, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std. dev.: 0.0090) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5053, std. dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2260, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (2.0820 => 2.1147, std. dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4397, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5855, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4574, std. dev.: 0.0355) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5557, std. dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8046, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7996, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7447, std. dev.: 0.0774) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9621, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 20:52:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 22:52:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905035203.79DA02A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3414?compare_to=3411&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3414, Order: 163190, Start Time: 2012-09-05 02:41:52, End Time: 2012-09-05 03:53:11 To: 3411, Order: 163182, Start Time: 2012-09-05 01:14:26, End Time: 2012-09-05 02:26:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (44 on baseline) Performance Improvements: 5 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 876 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2897 => 0.3075, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.8781 => 0.9013, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8374 => 0.8542, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.63% (1.2644 => 1.2850, std. dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 1.52% (3.8501 => 3.9088, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.89% (1.3250 => 1.3765, std. dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 3.38% (8.2221 => 8.5000, std. dev.: 0.0318) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.72% (4.3693 => 4.4881, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.24% (1.0862 => 1.1105, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.99% (1.6495 => 1.6823, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.69% (2.8160 => 2.8635, std. dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.04% (1.2176 => 1.2049, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -2.37% (1.2785 => 1.2482, std. dev.: 0.0107) SingleSource/Benchmarks/McGill/chomp: -2.23% (1.1131 => 1.0883, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.10% (1.8615 => 1.8411, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: -1.03% (2.3895 => 2.3649, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 4.60% (1.0046 => 1.0508, std. dev.: 0.0095) MultiSource/Applications/minisat/minisat: 3.97% (0.6173 => 0.6418, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 3.73% (2.1763 => 2.2574, std. dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 3.40% (1.1653 => 1.2049, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (12.6413 => 12.8884, std. dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8405 => 0.8542, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.5150 => 1.5394, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 1.39% (4.7455 => 4.8116, std. dev.: 0.0253) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout/ary3: 14.72% (1.7426 => 1.9991, std. dev.: 0.0333) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.55% (4.0101 => 4.5534, std. dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/sieve: 12.93% (3.4406 => 3.8855, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: 12.80% (0.4296 => 0.4846, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.67% (0.0917 => 0.1024, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1028, std. dev.: 0.0545) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.35% (1.0063 => 1.1105, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 9.12% (7.0025 => 7.6409, std. dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.76% (0.2694 => 0.2930, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/methcall: 7.70% (8.5566 => 9.2157, std. dev.: 0.0429) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (3.4876 => 3.7236, std. dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 6.76% (1.0194 => 1.0883, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.53% (4.2129 => 4.4881, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7515, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.52% (40.4792 => 42.3074, std. dev.: 0.5736) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.11% (2.6656 => 2.7751, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 3.93% (8.5113 => 8.8457, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8739, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/fp-convert: 3.54% (15.2242 => 15.7627, std. dev.: 0.0764) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.33% (0.8498 => 0.8781, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/five11/five11: 2.36% (5.1938 => 5.3166, std. dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.30% (0.5876 => 0.6011, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (2.4971 => 2.5363, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4835, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 1.42% (14.4877 => 14.6929, std. dev.: 0.0371) MultiSource/Applications/JM/lencod/lencod: 1.24% (6.7458 => 6.8292, std. dev.: 0.0194) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4346, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 1.10% (2.4013 => 2.4277, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.06% (3.6254 => 3.6640, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (38.9255 => 39.3256, std. dev.: 0.1260) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -7.04% (0.1817 => 0.1689, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.35% (0.3497 => 0.2121, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.59% (5.2665 => 4.1293, std. dev.: 0.0623) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.88% (1.1647 => 0.9914, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std. dev.: 0.0300) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.81% (3.2007 => 2.9507, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: -6.94% (1.4441 => 1.3439, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: -6.16% (1.6538 => 1.5519, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -5.99% (9.2503 => 8.6960, std. dev.: 0.0818) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (4.6355 => 4.4156, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.51% (3.9413 => 3.7636, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.68% (1.2959 => 1.2482, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.10% (1.7361 => 1.6823, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1333, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.87% (0.4140 => 0.4021, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -2.81% (7.6833 => 7.4671, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: -2.61% (9.5474 => 9.2978, std. dev.: 0.0122) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.39% (1.2722 => 1.2418, std. dev.: 0.0110) MultiSource/Applications/siod/siod: -2.24% (3.5520 => 3.4723, std. dev.: 0.0231) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6903, std. dev.: 0.4177) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3684, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.75% (1.8739 => 1.8411, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2303, std. dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.60% (3.7496 => 3.6895, std. dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8325, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.3569 => 2.3242, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3220, std. dev.: 0.0530) SingleSource/Benchmarks/Misc/oourafft: -1.28% (3.8200 => 3.7710, std. dev.: 0.0187) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.8964 => 2.8635, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/tsp/tsp: -1.03% (1.7330 => 1.7152, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 21:03:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 23:03:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905040348.0CF7A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3415?compare_to=3410&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3415, Order: 163190, Start Time: 2012-09-05 02:45:42, End Time: 2012-09-05 04:04:51 To: 3410, Order: 163182, Start Time: 2012-09-05 00:58:23, End Time: 2012-09-05 02:17:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (80.0042 => 80.9969, std. dev.: 0.2747) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.33% (10.3673 => 13.5120, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 15.09% (0.3473 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.93% (0.3543 => 0.4072, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.93% (0.3497 => 0.4019, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.71% (0.3543 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.70% (0.3516 => 0.4033, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 14.60% (0.3561 => 0.4081, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3694 => 0.4218, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.90% (0.3828 => 0.4360, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.83% (0.3927 => 0.4470, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/property: 13.54% (0.3886 => 0.4412, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 11.16% (0.1622 => 0.1803, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.97% (1.1194 => 1.2422, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.93% (1.7609 => 1.9533, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 9.71% (0.1432 => 0.1571, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.98% (2.2022 => 2.4000, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7326 => 0.7888, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.27% (0.3177 => 0.3408, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.8172 => 0.8739, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.89% (0.4615 => 0.4933, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 6.89% (0.3282 => 0.3508, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.81% (0.3817 => 0.4077, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.63% (10.4361 => 11.1281, std. dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3307 => 0.3519, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 6.24% (0.7835 => 0.8324, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.04% (0.7115 => 0.7545, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7433 => 0.7879, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.98% (7.0540 => 7.4759, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5569 => 0.5902, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (4.2646 => 4.5194, std. dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (9.4845 => 10.0510, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.96% (8.1363 => 8.6214, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.96% (0.5860 => 0.6209, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.82% (1.5415 => 1.6312, std. dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.3050 => 1.3798, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.58% (4.9449 => 5.2206, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (5.0018 => 5.2780, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.45% (0.5105 => 0.5383, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.38% (3.3354 => 3.5148, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/05-eks/eks: 5.26% (0.4299 => 0.4525, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9765 => 1.0273, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.11% (0.2700 => 0.2838, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.06% (1.5603 => 1.6392, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.96% (0.5020 => 0.5269, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.90% (5.7591 => 6.0412, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.87% (0.4289 => 0.4498, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.84% (0.6675 => 0.6998, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.8067 => 0.8453, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 4.76% (1.1642 => 1.2196, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 4.73% (0.3422 => 0.3584, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.72% (0.4636 => 0.4855, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.72% (1.1861 => 1.2421, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (14.3668 => 15.0408, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 4.69% (0.3092 => 0.3237, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.58% (0.4103 => 0.4291, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.58% (0.2905 => 0.3038, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.56% (3.8723 => 4.0488, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2891 => 0.3022, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.41% (2.0273 => 2.1168, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.40% (0.6450 => 0.6734, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3650 => 0.3809, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.35% (1.0722 => 1.1188, std. dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 4.31% (0.3387 => 0.3533, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.29% (0.3098 => 0.3231, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.22% (0.3865 => 0.4028, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4203 => 0.4380, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (2.0665 => 2.1532, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.18% (0.3826 => 0.3986, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.17% (0.4048 => 0.4217, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.17% (0.2831 => 0.2949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.15% (0.3136 => 0.3266, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.07% (0.2872 => 0.2989, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.3684 => 0.3833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.02% (0.3283 => 0.3415, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2756 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.96% (0.2877 => 0.2991, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 3.95% (0.8921 => 0.9273, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.94% (2.2969 => 2.3873, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4620 => 0.4795, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.76% (0.2793 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.4186 => 1.4713, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.55% (1.5859 => 1.6422, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.49% (0.3379 => 0.3497, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (2.2024 => 2.2726, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 3.05% (17.1811 => 17.7047, std. dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 2.60% (1.2842 => 1.3176, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.1840 => 1.2141, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.22% (7.9617 => 8.1384, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.8101 => 0.8268, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.77% (21.9371 => 22.3251, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3804, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.1396 => 1.1921, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (4.2280 => 4.3745, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2347, std. dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (1.3045 => 1.3203, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.44% (5.2763 => 3.1955, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.91% (5.3855 => 3.7210, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.58% (5.3526 => 3.7158, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1227, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.41% (2.9384 => 2.5443, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.77% (22.1758 => 20.2317, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2792, std. dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.21% (1.8329 => 1.7190, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0005) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4107, std. dev.: 0.0146) SingleSource/Benchmarks/McGill/chomp: -3.10% (1.2373 => 1.1989, std. dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0073, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9616, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -2.32% (12.4730 => 12.1835, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 6.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 21:54:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Sep 2012 23:54:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905045400.7A1AA2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3416?compare_to=3412&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3416, Order: 163190, Start Time: 2012-09-05 03:40:49, End Time: 2012-09-05 04:55:07 To: 3412, Order: 163188, Start Time: 2012-09-05 01:58:20, End Time: 2012-09-05 03:12:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (162 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.27% (2.3050 => 2.2527, std. dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.05% (2.0176 => 2.4019, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.75% (0.1410 => 0.1618, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.15% (0.5818 => 0.6525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.95% (0.5748 => 0.6435, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 11.80% (0.7061 => 0.7894, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.77% (0.3578 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3601 => 0.4017, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.55% (0.3663 => 0.4086, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3646 => 0.4066, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-3: 11.37% (0.3623 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3650 => 0.4065, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.27% (0.3789 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3914 => 0.4348, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.4003 => 0.4440, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.86% (0.3940 => 0.4368, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.09% (0.7710 => 0.8488, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.77% (0.1413 => 0.1551, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.76% (1.3693 => 1.5030, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.32% (3.9660 => 4.3356, std. dev.: 0.0119) SingleSource/Regression/C++/ofstream_ctor: 9.10% (0.2781 => 0.3034, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 9.06% (0.4062 => 0.4430, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 9.03% (0.4328 => 0.4719, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.73% (0.2782 => 0.3025, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.72% (0.5265 => 0.5724, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 8.40% (0.7038 => 0.7629, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.37% (1.2193 => 1.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2607 => 0.2825, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.36% (0.2655 => 0.2877, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.36% (0.9199 => 0.9968, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 8.33% (0.2690 => 0.2914, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.29% (0.2966 => 0.3212, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.27% (1.9828 => 2.1468, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.21% (0.2937 => 0.3178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2628 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2760 => 0.2985, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.14% (0.3293 => 0.3561, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.13% (0.3899 => 0.4216, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.11% (0.3022 => 0.3267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.11% (0.2726 => 0.2947, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.08% (0.2761 => 0.2984, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3485 => 0.3766, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.03% (0.6959 => 0.7518, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.03% (0.3489 => 0.3769, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.01% (0.2696 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.91% (0.3149 => 0.3398, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.85% (0.3580 => 0.3861, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.83% (1.4563 => 1.5703, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.82% (0.3107 => 0.3350, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.80% (0.3756 => 0.4049, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.2721 => 0.2933, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 7.74% (0.3192 => 0.3439, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.73% (0.2988 => 0.3219, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2127 => 0.2291, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.69% (0.4016 => 0.4325, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.67% (13.8202 => 14.8800, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.60% (1.1364 => 1.2228, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.55% (0.5577 => 0.5998, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.53% (0.3453 => 0.3713, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1589 => 0.1708, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.45% (0.7506 => 0.8065, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.45% (0.3868 => 0.4156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.39% (0.3534 => 0.3795, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (7.2180 => 7.7474, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.18% (0.1588 => 0.1702, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.2914 => 0.3123, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.12% (0.4791 => 0.5132, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.05% (0.3246 => 0.3475, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.79% (0.2945 => 0.3145, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.78% (1.0313 => 1.1012, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.67% (0.5637 => 0.6013, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.62% (0.6283 => 0.6699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.56% (13.2842 => 14.1558, std. dev.: 0.0130) MultiSource/Benchmarks/Olden/em3d/em3d: 6.52% (0.1657 => 0.1765, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 6.51% (0.8310 => 0.8851, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.46% (1.1061 => 1.1776, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3220 => 0.3425, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.18% (3.8646 => 4.1033, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.12% (1.9270 => 2.0449, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3755 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.07% (0.7460 => 0.7913, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.06% (1.3819 => 1.4657, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (3.6692 => 3.8917, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.05% (1.3813 => 1.4648, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.00% (1.3245 => 1.4040, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.89% (0.6744 => 0.7141, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.8698 => 0.9205, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.2749 => 1.3477, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 5.71% (2.1791 => 2.3035, std. dev.: 0.0148) MultiSource/Applications/d/make_dparser: 5.67% (3.1889 => 3.3698, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.53% (4.3801 => 4.6225, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.49% (4.4433 => 4.6871, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 5.45% (1.0594 => 1.1171, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.41% (16.6129 => 17.5121, std. dev.: 0.0126) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.32% (0.8818 => 0.9287, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.26% (1.2292 => 1.2939, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.13% (14.8535 => 15.6162, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.98% (14.5298 => 15.2528, std. dev.: 0.0160) MultiSource/Benchmarks/sim/sim: 4.89% (0.3131 => 0.3284, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.86% (0.2859 => 0.2998, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.86% (8.4961 => 8.9086, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.82% (1.1333 => 1.1879, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.27% (0.4805 => 0.5010, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.16% (4.6629 => 4.8568, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.09% (3.2742 => 3.4081, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (6.5754 => 6.8432, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6250 => 0.6500, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1771, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 3.68% (16.2614 => 16.8591, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.55% (1.5188 => 1.5727, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1734, std. dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.41% (0.9108 => 0.9419, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.11% (3.7467 => 3.8633, std. dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 2.71% (33.2944 => 34.1980, std. dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.65% (6.2785 => 6.4448, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5165, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.12% (1.1560 => 1.2268, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7342, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.53% (10.7476 => 11.1270, std. dev.: 0.0283) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5993, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5986, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5745, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.54% (0.4657 => 0.4073, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.85% (22.5627 => 21.4688, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2575, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9228, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5801, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -2.08% (26.5159 => 25.9653, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2447, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2122, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.16% (4.5928 => 4.5395, std. dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 22:19:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 00:19:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905051927.9509D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3417?compare_to=3414&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3417, Order: 163191, Start Time: 2012-09-05 04:08:42, End Time: 2012-09-05 05:20:35 To: 3414, Order: 163190, Start Time: 2012-09-05 02:41:52, End Time: 2012-09-05 03:53:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (41 on baseline) Performance Improvements: 4 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 15.55% (0.1428 => 0.1650, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 6.34% (0.1689 => 0.1796, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.26% (0.7456 => 0.7699, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.27% (1.1382 => 1.1640, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (15.7767 => 16.8949, std. dev.: 0.3828) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.43% (2.3294 => 2.3861, std. dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.32% (1.2850 => 1.2681, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -1.21% (4.8116 => 4.7532, std. dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -2.27% (8.5000 => 8.3070, std. dev.: 0.0483) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.49% (1.6093 => 1.5854, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.23% (2.1763 => 2.2683, std. dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: 3.10% (1.1653 => 1.2014, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (12.6413 => 12.9279, std. dev.: 0.0201) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.5150 => 1.5484, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.12% (0.7722 => 0.7886, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.75% (1.1440 => 1.1640, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.14% (29.3170 => 29.6525, std. dev.: 0.0854) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.04% (1.1827 => 1.1950, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.58% (0.0766 => 0.0939, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0740) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.04% (4.0101 => 4.5730, std. dev.: 0.0271) SingleSource/Benchmarks/McGill/misr: 13.71% (0.4296 => 0.4885, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 12.63% (3.4406 => 3.8752, std. dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 12.21% (0.1433 => 0.1608, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (62.4126 => 69.1244, std. dev.: 0.1180) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6029, std. dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.76% (1.0063 => 1.0844, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash2: 7.31% (3.4876 => 3.7425, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/methcall: 6.98% (8.5566 => 9.1539, std. dev.: 0.0813) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.72% (15.8312 => 16.8949, std. dev.: 0.3828) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7358, std. dev.: 0.0276) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.87% (0.8498 => 0.8912, std. dev.: 0.0125) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.49% (2.6656 => 2.7853, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/fp-convert: 4.28% (15.2242 => 15.8763, std. dev.: 0.0502) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 2.46% (8.5113 => 8.7205, std. dev.: 0.0578) MultiSource/Benchmarks/BitBench/five11/five11: 2.05% (5.1938 => 5.3004, std. dev.: 0.0257) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.42% (4.6127 => 4.6784, std. dev.: 0.0213) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5318, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4455 => 2.4791, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6691, std. dev.: 0.0478) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6932, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.38% (4.2815 => 4.2226, std. dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.66% (0.3497 => 0.2110, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.52% (5.2665 => 4.0805, std. dev.: 0.1225) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.89% (1.1647 => 0.9913, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std. dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.56% (1.4034 => 1.2833, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.32% (3.2007 => 2.9663, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -7.13% (1.4441 => 1.3411, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -6.64% (9.2503 => 8.6358, std. dev.: 0.0915) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5500, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4062, std. dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.68% (3.9413 => 3.7568, std. dev.: 0.0363) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.59% (0.4140 => 0.3950, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.40% (2.4457 => 2.3381, std. dev.: 0.0297) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.50% (1.7361 => 1.6753, std. dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.29% (45.4683 => 43.9740, std. dev.: 0.5538) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.26% (1.2722 => 1.2307, std. dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4555, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.92% (1.1683 => 1.1342, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.73% (2.8964 => 2.8172, std. dev.: 0.0233) MultiSource/Applications/SPASS/SPASS: -2.64% (8.5323 => 8.3070, std. dev.: 0.0483) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (92.7467 => 90.5789, std. dev.: 0.2555) MultiSource/Applications/siod/siod: -2.26% (3.5520 => 3.4718, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.00% (3.7496 => 3.6745, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -1.73% (3.4286 => 3.3694, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -1.51% (3.8907 => 3.8320, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (9.3855 => 9.2489, std. dev.: 0.0234) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.29% (1.6061 => 1.5854, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: -1.27% (16.5617 => 16.3508, std. dev.: 0.0313) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.01% (1.8739 => 1.8550, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 22:51:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 00:51:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905055101.F25042A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3418?compare_to=3415&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3418, Order: 163191, Start Time: 2012-09-05 04:32:56, End Time: 2012-09-05 05:52:07 To: 3415, Order: 163190, Start Time: 2012-09-05 02:45:42, End Time: 2012-09-05 04:04:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (138 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (712 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.81% (2.2964 => 2.3840, std. dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (54.5055 => 56.5117, std. dev.: 0.0279) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.45% (10.3673 => 13.5237, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 15.12% (0.3473 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.82% (0.3543 => 0.4068, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.76% (0.3497 => 0.4013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3543 => 0.4064, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.65% (0.3516 => 0.4031, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.60% (0.3561 => 0.4081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3694 => 0.4221, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.87% (0.3828 => 0.4359, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.70% (0.3927 => 0.4465, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.59% (0.3886 => 0.4414, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (0.1622 => 0.1802, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (1.7609 => 1.9544, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.75% (1.1194 => 1.2397, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 9.71% (0.1432 => 0.1571, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.96% (2.2022 => 2.3995, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.13% (0.8172 => 0.8836, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7326 => 0.7887, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.81% (0.3817 => 0.4077, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.79% (0.3282 => 0.3505, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.59% (10.4361 => 11.1241, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.39% (0.7835 => 0.8336, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.4879 => 0.5182, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.14% (0.7115 => 0.7552, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.06% (9.4845 => 10.0591, std. dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7433 => 0.7879, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.97% (7.0540 => 7.4750, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (8.1363 => 8.6197, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5860 => 0.6208, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.5415 => 1.6326, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (0.3121 => 0.3304, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (4.2646 => 4.5126, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.3050 => 1.3801, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.63% (5.0018 => 5.2832, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.61% (4.9449 => 5.2225, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.41% (0.5105 => 0.5381, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.37% (3.3354 => 3.5146, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9765 => 1.0287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.34% (0.4103 => 0.4322, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.15% (0.2700 => 0.2839, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.10% (1.5603 => 1.6399, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4636 => 0.4865, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.6675 => 0.7004, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.89% (5.7591 => 6.0408, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.86% (0.8067 => 0.8459, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.84% (0.5020 => 0.5263, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 4.83% (1.1642 => 1.2204, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 4.82% (0.3422 => 0.3587, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.74% (0.3162 => 0.3312, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3441 => 0.3603, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (14.3668 => 15.0391, std. dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.65% (1.1861 => 1.2413, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.59% (0.3092 => 0.3234, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4064 => 0.4250, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 4.44% (3.8723 => 4.0443, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4289 => 0.4479, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.43% (0.2891 => 0.3019, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.40% (0.6456 => 0.6740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3098 => 0.3233, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.35% (2.0273 => 2.1155, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.24% (1.0722 => 1.1177, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.22% (0.3387 => 0.3530, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.21% (0.3684 => 0.3839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.20% (0.2831 => 0.2950, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (2.0665 => 2.1530, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.18% (0.2872 => 0.2992, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3826 => 0.3985, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.14% (0.4203 => 0.4377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.4048 => 0.4213, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.07% (0.2877 => 0.2994, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.05% (0.5981 => 0.6223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.00% (0.3052 => 0.3174, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.93% (0.3283 => 0.3412, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.92% (0.8921 => 0.9271, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 3.85% (2.2969 => 2.3854, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.83% (0.2793 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4620 => 0.4796, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.75% (1.4186 => 1.4718, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2802 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.52% (1.5859 => 1.6417, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.2024 => 2.2698, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.03% (17.1811 => 17.7019, std. dev.: 0.0240) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3183, std. dev.: 0.0123) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.1840 => 1.2140, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.22% (7.9617 => 8.1386, std. dev.: 0.0133) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.8101 => 0.8264, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.74% (21.9371 => 22.3199, std. dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 4.69% (2.2771 => 2.3840, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/richards_benchmark: 4.67% (1.1396 => 1.1928, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (4.2280 => 4.3627, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7533, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2478, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (1.3045 => 1.3229, std. dev.: 0.0067) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5760, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7615, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.41% (5.2763 => 3.1971, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.89% (5.3855 => 3.7217, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.58% (5.3526 => 3.7160, std. dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1132, std. dev.: 0.0526) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5465, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.75% (22.1758 => 20.2360, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2716, std. dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (1.8329 => 1.7177, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4978, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4329, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0095, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.48% (8.1563 => 7.9540, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1886, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -2.21% (1.2373 => 1.2100, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 23:36:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 01:36:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905063616.0FAF52A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3419?compare_to=3416&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3419, Order: 163191, Start Time: 2012-09-05 05:23:11, End Time: 2012-09-05 06:37:22 To: 3416, Order: 163190, Start Time: 2012-09-05 03:40:49, End Time: 2012-09-05 04:55:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.42% (3.8266 => 3.7724, std. dev.: 0.0173) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.00% (2.0176 => 2.4010, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.89% (0.1410 => 0.1620, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.10% (0.5818 => 0.6522, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.97% (0.5748 => 0.6436, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3578 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3601 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.55% (0.3646 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3623 => 0.4038, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.43% (0.3789 => 0.4222, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.42% (0.3650 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.41% (0.3663 => 0.4081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.37% (0.7061 => 0.7864, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 11.11% (0.3914 => 0.4349, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.97% (0.4003 => 0.4442, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.84% (0.3940 => 0.4367, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.04% (0.7710 => 0.8484, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.77% (0.1413 => 0.1551, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.71% (1.3693 => 1.5023, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.32% (3.9660 => 4.3357, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 9.21% (0.4062 => 0.4436, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.21% (0.2781 => 0.3037, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.08% (0.4328 => 0.4721, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.78% (0.2655 => 0.2888, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.72% (0.5265 => 0.5724, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2782 => 0.3024, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2607 => 0.2827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.44% (0.2690 => 0.2917, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.42% (0.9199 => 0.9974, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 8.35% (0.3293 => 0.3568, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.32% (1.2193 => 1.3208, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.30% (0.7038 => 0.7622, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.30% (0.2628 => 0.2846, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.29% (1.9828 => 2.1472, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.26% (0.2760 => 0.2988, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.21% (0.2937 => 0.3178, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2726 => 0.2949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.17% (0.3489 => 0.3774, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.16% (0.3580 => 0.3872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.14% (0.3022 => 0.3268, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2761 => 0.2985, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.08% (0.3899 => 0.4214, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.07% (0.3756 => 0.4059, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.06% (0.2966 => 0.3205, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.03% (0.2765 => 0.2987, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.3107 => 0.3356, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.01% (0.2696 => 0.2912, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.00% (0.6959 => 0.7516, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3485 => 0.3762, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1327 => 0.1431, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.81% (1.4563 => 1.5701, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.80% (0.3192 => 0.3441, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.79% (0.4016 => 0.4329, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.78% (0.3149 => 0.3394, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.76% (0.2988 => 0.3220, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.76% (0.3453 => 0.3721, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.75% (13.8202 => 14.8915, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.72% (0.2721 => 0.2931, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.68% (0.3868 => 0.4165, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2127 => 0.2290, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.66% (1.1364 => 1.2234, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5577 => 0.5997, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.42% (0.7506 => 0.8063, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.33% (0.3534 => 0.3793, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (7.2180 => 7.7463, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4390 => 0.4711, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.12% (0.1588 => 0.1701, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.08% (0.4791 => 0.5130, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.93% (0.3246 => 0.3471, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 6.85% (1.0313 => 1.1019, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 6.83% (0.2945 => 0.3146, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.76% (0.5637 => 0.6018, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.61% (13.2842 => 14.1622, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.61% (0.6283 => 0.6698, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.48% (1.1061 => 1.1778, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.37% (0.8310 => 0.8839, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3220 => 0.3424, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.2243 => 0.2385, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.29% (3.8646 => 4.1076, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.09% (0.7460 => 0.7914, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.08% (1.3819 => 1.4659, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.07% (1.3813 => 1.4651, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.99% (0.3755 => 0.3980, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.96% (1.3245 => 1.4034, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.93% (1.9270 => 2.0412, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 5.92% (0.6744 => 0.7143, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.86% (3.6692 => 3.8841, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.72% (1.2749 => 1.3478, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 5.67% (2.1791 => 2.3027, std. dev.: 0.0105) MultiSource/Applications/d/make_dparser: 5.66% (3.1889 => 3.3693, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.56% (4.3801 => 4.6235, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.45% (4.4433 => 4.6855, std. dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 5.45% (1.0594 => 1.1171, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.38% (0.6135 => 0.6465, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 5.37% (1.2292 => 1.2952, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.35% (0.8818 => 0.9290, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 5.35% (16.6129 => 17.5019, std. dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.07% (14.8535 => 15.6066, std. dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 4.97% (14.5298 => 15.2522, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 4.87% (8.4961 => 8.9099, std. dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 4.85% (0.3131 => 0.3283, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1333 => 1.1881, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.79% (0.2859 => 0.2996, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.2742 => 3.4212, std. dev.: 0.0183) MultiSource/Applications/oggenc/oggenc: 4.35% (4.6629 => 4.8656, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (6.5754 => 6.8454, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.6250 => 0.6497, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1752, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 3.58% (16.2614 => 16.8435, std. dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.57% (1.5188 => 1.5730, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (2.1007 => 2.1749, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.51% (0.9108 => 0.9428, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 3.06% (3.7467 => 3.8614, std. dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.2785 => 6.4461, std. dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 2.65% (33.2944 => 34.1783, std. dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5113, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2793, std. dev.: 0.0440) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.1560 => 1.2255, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.52% (10.7476 => 11.1256, std. dev.: 0.0511) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6013, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.93% (1.5824 => 1.6129, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5185, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.24% (1.4298 => 1.4476, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5827, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.54% (0.4657 => 0.4073, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.87% (22.5627 => 21.4628, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2614, std. dev.: 0.0345) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0007) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1490, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.8259 => 8.5752, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.09% (26.5159 => 25.9611, std. dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2423, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2194, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5336, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 4 23:41:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 01:41:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905064131.C6DA32A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3420?compare_to=3413&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3420, Order: 163191, Start Time: 2012-09-05 03:58:58, End Time: 2012-09-05 06:42:37 To: 3413, Order: 163182, Start Time: 2012-09-05 00:47:11, End Time: 2012-09-05 03:30:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.33% (54.1994 => 54.9224, std. dev.: 0.0367) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.41% (0.3446 => 0.3977, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.35% (0.3460 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.34% (0.3469 => 0.4001, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 15.32% (0.3465 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.28% (0.3442 => 0.3968, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.28% (0.3488 => 0.4021, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.27% (0.3496 => 0.4030, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.60% (0.3650 => 0.4183, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.52% (0.3643 => 0.4172, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.29% (0.3724 => 0.4256, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.23% (0.5826 => 0.6364, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.5889 => 0.6419, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.46% (0.7171 => 0.7706, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.08% (3.5627 => 3.8148, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (1.6211 => 1.7327, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.72% (1.5932 => 1.7003, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (0.4994 => 0.5324, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.45% (1.3152 => 1.4000, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.40% (0.5000 => 0.5320, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.23% (0.5026 => 0.5339, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.18% (0.4029 => 0.4278, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (0.4361 => 0.4629, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (0.3930 => 0.4167, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2738 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (0.5900 => 0.6249, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 5.83% (1.0781 => 1.1410, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.80% (0.3792 => 0.4012, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.72% (4.2109 => 4.4518, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.63% (0.2875 => 0.3037, std. dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 5.53% (0.3004 => 0.3170, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.44% (2.7292 => 2.8776, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 5.37% (0.9909 => 1.0441, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.30% (0.2792 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.28% (0.2725 => 0.2869, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.24% (0.2729 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.2866 => 0.3016, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3195 => 0.3360, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.14% (0.2780 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.10% (0.3096 => 0.3254, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (0.2823 => 0.2967, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.09% (2.0673 => 2.1726, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2803 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.05% (0.2811 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.02% (0.2750 => 0.2888, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.89% (5.5417 => 5.8125, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.87% (0.3060 => 0.3209, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.78% (1.9694 => 2.0636, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (0.4658 => 0.4878, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.3625 => 0.3796, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3258 => 0.3411, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.68% (0.2566 => 0.2686, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.67% (0.3124 => 0.3270, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.67% (0.2911 => 0.3047, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (1.9966 => 2.0889, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.61% (0.3362 => 0.3517, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.59% (0.3726 => 0.3897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.3348 => 0.3500, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.53% (0.3903 => 0.4080, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.3845 => 0.4019, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.49% (0.3477 => 0.3633, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.49% (0.3678 => 0.3843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3690 => 0.3855, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (4.4195 => 4.6147, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 4.30% (0.9697 => 1.0114, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 4.25% (2.1653 => 2.2573, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (2.1013 => 2.1904, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 4.23% (0.4251 => 0.4431, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.21% (4.6177 => 4.8120, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 4.19% (1.8794 => 1.9581, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.3981 => 0.4145, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4146 => 0.4315, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 4.06% (23.5202 => 24.4757, std. dev.: 0.0104) MultiSource/Applications/lua/lua: 4.04% (1.4269 => 1.4845, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 3.89% (0.7875 => 0.8181, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.78% (0.6634 => 0.6885, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.2737 => 0.2838, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.62% (0.5546 => 0.5747, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.60% (0.3084 => 0.3195, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 3.55% (0.5012 => 0.5190, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.50% (0.2969 => 0.3073, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.6435 => 0.6649, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.15% (2.0346 => 2.0784, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (0.5361 => 0.5464, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.19% (4.6926 => 4.7486, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (11.6398 => 11.7729, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.2122 => 0.2269, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6129, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std. dev.: 0.1426) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6370, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1929, std. dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5016, std. dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4404, std. dev.: 0.0221) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2785, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5901, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5442, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7912, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std. dev.: 0.0072) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5192, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7455, std. dev.: 0.0926) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.67% (0.6293 => 0.6188, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9599, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 00:21:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 02:21:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905072136.3C6C32A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3421?compare_to=3417&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3421, Order: 163192, Start Time: 2012-09-05 06:10:27, End Time: 2012-09-05 07:22:43 To: 3417, Order: 163191, Start Time: 2012-09-05 04:08:42, End Time: 2012-09-05 05:20:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (45 on baseline) Performance Improvements: 5 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 878 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.84% (0.2121 => 0.2266, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.4862 => 0.4977, std. dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2014 => 1.2160, std. dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.2565 => 6.3307, std. dev.: 0.0113) MultiSource/Applications/d/make_dparser: 1.03% (3.0570 => 3.0886, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 2.59% (8.3070 => 8.5220, std. dev.: 0.0662) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.48% (42.0374 => 43.0784, std. dev.: 0.3358) MultiSource/Benchmarks/Olden/tsp/tsp: 1.84% (1.7050 => 1.7363, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.12% (4.6784 => 4.7307, std. dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.25% (0.7699 => 0.7526, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.80% (1.4101 => 1.3847, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: -1.24% (1.3263 => 1.3099, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -19.80% (0.0586 => 0.0470, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.76% (0.0939 => 0.0838, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.35% (1.1653 => 1.2160, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: 3.32% (1.0046 => 1.0380, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: 3.19% (0.6173 => 0.6370, std. dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 3.10% (2.1763 => 2.2437, std. dev.: 0.0196) MultiSource/Applications/d/make_dparser: 2.19% (3.0225 => 3.0886, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.59% (2.0972 => 2.1306, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.33% (1.2021 => 1.2181, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.2546 => 6.3307, std. dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 40.68% (0.0263 => 0.0370, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.39% (3.4629 => 4.2382, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/ary3: 15.01% (1.7426 => 2.0042, std. dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.20% (4.0101 => 4.5794, std. dev.: 0.0604) SingleSource/Benchmarks/Shootout-C++/sieve: 12.96% (3.4406 => 3.8865, std. dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1433 => 0.1598, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.34% (0.0917 => 0.1021, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 10.82% (62.4126 => 69.1628, std. dev.: 0.0530) SingleSource/Benchmarks/McGill/misr: 10.66% (0.4296 => 0.4754, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: 8.52% (7.0025 => 7.5994, std. dev.: 0.0338) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.94% (1.0063 => 1.0862, std. dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (0.3301 => 0.3539, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/methcall: 7.11% (8.5566 => 9.1650, std. dev.: 0.1667) MultiSource/Benchmarks/BitBench/drop3/drop3: 6.98% (0.2694 => 0.2882, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 6.55% (3.4876 => 3.7162, std. dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 6.43% (1.0194 => 1.0849, std. dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.42% (40.4792 => 43.0784, std. dev.: 0.3358) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.91% (27.1724 => 28.7786, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.71% (4.2129 => 4.4115, std. dev.: 0.0757) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.36% (2.6656 => 2.7819, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/dt: 4.06% (0.9851 => 1.0251, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8309, std. dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5397, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/ReedSolomon: 3.05% (8.5113 => 8.7711, std. dev.: 0.0653) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.01% (0.5876 => 0.6053, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.79% (0.5587 => 0.5743, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.56% (4.6127 => 4.7307, std. dev.: 0.0141) MultiSource/Benchmarks/BitBench/five11/five11: 2.41% (5.1938 => 5.3188, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/whetstone: 1.79% (2.3453 => 2.3872, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 1.59% (6.7458 => 6.8532, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.56% (14.4877 => 14.7140, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.55% (2.9152 => 2.9605, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (2.4971 => 2.5343, std. dev.: 0.0067) MultiSource/Applications/lua/lua: 1.29% (29.5232 => 29.9039, std. dev.: 0.1395) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6925, std. dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.76% (8.9977 => 8.3898, std. dev.: 0.1513) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.48% (0.2080 => 0.1966, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.24% (0.2806 => 0.2687, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: -2.74% (0.7738 => 0.7526, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.07% (0.5740 => 0.5621, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: -1.27% (1.3268 => 1.3099, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.37% (5.2665 => 4.1408, std. dev.: 0.0739) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0183) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1615, std. dev.: 0.0478) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/richards_benchmark: -7.13% (1.4441 => 1.3411, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -6.22% (9.2503 => 8.6751, std. dev.: 0.1019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std. dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.08% (0.4564 => 0.4332, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.64% (0.4140 => 0.3948, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6392, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.94% (1.7361 => 1.6851, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.88% (1.1683 => 1.1347, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -2.86% (7.6833 => 7.4635, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.82% (2.4457 => 2.3767, std. dev.: 0.0247) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0187) MultiSource/Benchmarks/PAQ8p/paq8p: -2.63% (92.7467 => 90.3063, std. dev.: 0.4792) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.23% (2.8964 => 2.8319, std. dev.: 0.0117) MultiSource/Applications/siod/siod: -1.82% (3.5520 => 3.4874, std. dev.: 0.0171) MultiSource/Applications/aha/aha: -1.70% (3.4286 => 3.3703, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (9.3855 => 9.2454, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: -1.49% (3.8200 => 3.7632, std. dev.: 0.0156) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3171, std. dev.: 0.0702) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 00:44:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 02:44:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905074411.4BAE9352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3422?compare_to=3418&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3422, Order: 163192, Start Time: 2012-09-05 06:23:00, End Time: 2012-09-05 07:45:18 To: 3418, Order: 163191, Start Time: 2012-09-05 04:32:56, End Time: 2012-09-05 05:52:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (127 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (79.1158 => 80.0684, std. dev.: 0.1190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.32% (2.3840 => 2.3048, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.40% (10.3673 => 13.5188, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 15.26% (0.3473 => 0.4003, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: 14.78% (0.3497 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.76% (0.3516 => 0.4035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.73% (0.3543 => 0.4065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.73% (0.3543 => 0.4065, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 14.66% (0.3561 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3694 => 0.4218, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.87% (0.3828 => 0.4359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3927 => 0.4467, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 13.59% (0.3886 => 0.4414, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.58% (0.1566 => 0.1763, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.63% (0.0886 => 0.0989, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.34% (0.1622 => 0.1806, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (1.7609 => 1.9480, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1584 => 0.1723, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (2.2022 => 2.3932, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.54% (0.8172 => 0.8870, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7326 => 0.7890, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.27% (0.2271 => 0.2436, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2107 => 0.2256, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.84% (0.3817 => 0.4078, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 6.64% (10.4361 => 11.1293, std. dev.: 0.1695) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.61% (0.4615 => 0.4920, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.49% (0.3282 => 0.3495, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.44% (0.1940 => 0.2065, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.11% (0.4879 => 0.5177, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.11% (0.5569 => 0.5909, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 6.06% (9.4845 => 10.0592, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.5860 => 0.6214, std. dev.: 0.0048) MultiSource/Applications/hbd/hbd: 5.98% (1.5603 => 1.6536, std. dev.: 0.0354) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.87% (4.2646 => 4.5148, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.5415 => 1.6319, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.86% (7.0540 => 7.4674, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (8.1363 => 8.6082, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 5.76% (0.3423 => 0.3620, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.66% (1.3050 => 1.3788, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.64% (0.5105 => 0.5393, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (4.9449 => 5.2192, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.53% (5.0018 => 5.2786, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 5.20% (0.3422 => 0.3600, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.4103 => 0.4312, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9765 => 1.0256, std. dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 4.99% (0.2905 => 0.3050, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 4.98% (0.3092 => 0.3246, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4636 => 0.4863, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 4.87% (5.7591 => 6.0398, std. dev.: 0.1049) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.4064 => 0.4262, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.85% (0.6675 => 0.6999, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.81% (0.2891 => 0.3030, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.4289 => 0.4493, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2700 => 0.2827, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (14.3668 => 15.0331, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.8067 => 0.8439, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.60% (2.0665 => 2.1616, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.57% (0.2756 => 0.2882, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.53% (0.3180 => 0.3324, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 4.53% (0.2871 => 0.3001, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.53% (0.2872 => 0.3002, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.52% (0.2831 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3098 => 0.3238, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.49% (0.3650 => 0.3814, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.47% (1.1861 => 1.2391, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3826 => 0.3996, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4203 => 0.4389, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.42% (0.6450 => 0.6735, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 4.41% (0.2877 => 0.3004, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.40% (0.3865 => 0.4035, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.40% (0.4048 => 0.4226, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3052 => 0.3186, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.39% (0.3603 => 0.3761, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.37% (0.2793 => 0.2915, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.36% (0.3162 => 0.3300, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 4.36% (0.3232 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.36% (3.8723 => 4.0412, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/ary3: 4.36% (0.3283 => 0.3426, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2802 => 0.2923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3684 => 0.3842, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3935 => 0.4100, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.19% (0.3387 => 0.3529, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4620 => 0.4808, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.91% (0.8921 => 0.9270, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3379 => 0.3510, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5981 => 0.6210, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (1.5859 => 1.6426, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.4186 => 1.4687, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (2.2024 => 2.2662, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.1840 => 1.2161, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.8101 => 0.8264, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.87% (7.9617 => 8.1108, std. dev.: 0.0259) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.1396 => 1.1921, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (4.2280 => 4.3741, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.42% (1.3045 => 1.3230, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 1.22% (2.2771 => 2.3048, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5813, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7615, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.29% (5.2763 => 3.2030, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7153, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7092, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1728, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.03% (2.9384 => 2.5554, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -8.72% (22.1758 => 20.2419, std. dev.: 0.4145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2886, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.28% (1.8329 => 1.7178, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5118, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -3.30% (1.2373 => 1.1965, std. dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5017, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4235, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9574, std. dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1856, std. dev.: 0.0242) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0107) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 01:24:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 03:24:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905082431.F285A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3423?compare_to=3419&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3423, Order: 163194, Start Time: 2012-09-05 07:09:57, End Time: 2012-09-05 08:25:37 To: 3419, Order: 163191, Start Time: 2012-09-05 05:23:11, End Time: 2012-09-05 06:37:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.93% (79.5874 => 81.1195, std. dev.: 0.3652) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.19% (2.0176 => 2.4047, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std. dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std. dev.: 0.0175) SingleSource/UnitTests/ObjC/trivial-interface: 10.84% (0.3578 => 0.3966, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 10.66% (0.3601 => 0.3985, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3646 => 0.4034, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: 10.54% (0.3623 => 0.4005, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 10.54% (0.3663 => 0.4049, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.48% (0.7710 => 0.8518, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3650 => 0.4032, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3789 => 0.4185, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3914 => 0.4323, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 10.12% (0.4003 => 0.4408, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 10.08% (0.3940 => 0.4337, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 9.71% (1.3693 => 1.5022, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1413 => 0.1549, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.19% (3.9660 => 4.3303, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 9.10% (0.4328 => 0.4722, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.99% (0.2781 => 0.3031, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 8.81% (0.4062 => 0.4420, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.66% (0.5265 => 0.5721, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.50% (0.9199 => 0.9981, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.24% (0.7038 => 0.7618, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.19% (1.4563 => 1.5756, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.18% (0.6959 => 0.7528, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.11% (1.9828 => 2.1436, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.08% (1.2193 => 1.3178, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 8.06% (0.2607 => 0.2817, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.96% (0.3293 => 0.3555, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.93% (0.2760 => 0.2979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.2937 => 0.3170, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.92% (0.3485 => 0.3761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (0.2628 => 0.2835, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1327 => 0.1431, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.2721 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3580 => 0.3859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.78% (0.2726 => 0.2938, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2761 => 0.2975, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.75% (0.3756 => 0.4047, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.74% (0.3489 => 0.3759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.2966 => 0.3195, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4390 => 0.4728, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.64% (0.2696 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.62% (1.1364 => 1.2230, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.56% (0.3107 => 0.3342, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3149 => 0.3387, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5577 => 0.5997, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 7.50% (0.2988 => 0.3212, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.48% (13.8202 => 14.8533, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: 7.42% (0.3192 => 0.3429, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.37% (0.4016 => 0.4312, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.25% (0.7506 => 0.8050, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.2914 => 0.3123, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (7.2180 => 7.7336, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.3868 => 0.4143, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.05% (0.3534 => 0.3783, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.93% (0.1588 => 0.1698, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.89% (0.4791 => 0.5121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.3246 => 0.3468, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.73% (1.0313 => 1.1007, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.63% (0.5637 => 0.6011, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.2945 => 0.3138, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 6.40% (1.1061 => 1.1769, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.37% (13.2842 => 14.1299, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.2243 => 0.2385, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 6.32% (0.2925 => 0.3110, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 6.30% (3.8646 => 4.1082, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.6283 => 0.6678, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 6.28% (0.2995 => 0.3183, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 6.26% (0.8310 => 0.8830, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 6.12% (0.3220 => 0.3417, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.99% (0.7460 => 0.7907, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.98% (1.3819 => 1.4645, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.3755 => 0.3978, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.93% (1.3813 => 1.4632, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 5.91% (1.9270 => 2.0409, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.87% (0.6744 => 0.7140, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.3245 => 1.4021, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.83% (0.2504 => 0.2650, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 5.81% (2.1791 => 2.3058, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.76% (0.8698 => 0.9199, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.70% (3.6692 => 3.8785, std. dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 5.66% (1.2749 => 1.3471, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.55% (3.1889 => 3.3660, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 5.52% (1.0594 => 1.1179, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6168, std. dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 5.40% (16.6129 => 17.5094, std. dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.6135 => 0.6461, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (4.4433 => 4.6778, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.16% (1.2292 => 1.2926, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.08% (14.5298 => 15.2678, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.85% (14.8535 => 15.5742, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.80% (0.8818 => 0.9241, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 4.76% (0.3131 => 0.3280, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.74% (1.1333 => 1.1870, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.67% (8.4961 => 8.8930, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: 4.65% (0.2859 => 0.2992, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.16% (0.4805 => 0.5005, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 4.06% (4.6629 => 4.8520, std. dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (6.5754 => 6.8404, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (3.2742 => 3.4041, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6250 => 0.6485, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.68% (4.9865 => 5.1700, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.61% (16.2614 => 16.8488, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.28% (1.5188 => 1.5686, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.26% (0.9108 => 0.9405, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.1007 => 2.1691, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 3.15% (3.7467 => 3.8647, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.54% (33.2944 => 34.1385, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.47% (6.2785 => 6.4334, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.72% (3.1736 => 3.4187, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.59% (0.2093 => 0.2231, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.07% (1.1560 => 1.2262, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.69% (10.7476 => 11.1443, std. dev.: 0.0502) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6050, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.95% (1.5824 => 1.6133, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4460, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6873, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5908, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.25% (0.4657 => 0.4040, std. dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.09% (22.5627 => 21.4135, std. dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.64% (0.2670 => 0.2546, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2584, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std. dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -2.09% (26.5159 => 25.9621, std. dev.: 0.0372) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.89% (0.6615 => 0.6490, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2381, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2079, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9919, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5365, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2276, std. dev.: 0.0277) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5650, std. dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 5.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 01:49:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 03:49:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905084921.D32C62A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3424?compare_to=3421&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3424, Order: 163196, Start Time: 2012-09-05 07:38:26, End Time: 2012-09-05 08:50:29 To: 3421, Order: 163192, Start Time: 2012-09-05 06:10:27, End Time: 2012-09-05 07:22:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (40 on baseline) Performance Improvements: 4 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (818 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.17% (0.1437 => 0.1540, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.18% (0.6936 => 0.7295, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.84% (0.2687 => 0.2817, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.44% (0.5440 => 0.5627, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.24% (0.4471 => 0.4616, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3871 => 1.4085, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.88% (15.0649 => 17.3071, std. dev.: 0.3670) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.0862 => 1.0990, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.07% (0.4977 => 0.4874, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (6.3307 => 6.2488, std. dev.: 0.0234) MultiSource/Benchmarks/nbench/nbench: -1.12% (1.0892 => 1.0770, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -1.54% (1.7363 => 1.7096, std. dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.91% (0.1414 => 0.1540, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3.44% (1.1653 => 1.2054, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 3.18% (0.6173 => 0.6369, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 3.08% (2.1763 => 2.2434, std. dev.: 0.0125) MultiSource/Applications/lemon/lemon: 2.71% (1.0046 => 1.0318, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (12.6413 => 12.9308, std. dev.: 0.0632) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (1.5150 => 1.5432, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.81% (0.0263 => 0.0394, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 15.20% (1.7426 => 2.0074, std. dev.: 0.0121) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.05% (0.0917 => 0.1055, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.74% (4.0101 => 4.5610, std. dev.: 0.1458) SingleSource/Benchmarks/McGill/misr: 12.80% (0.4296 => 0.4846, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 12.70% (3.4406 => 3.8776, std. dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1004, std. dev.: 0.1383) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.32% (15.8312 => 17.3071, std. dev.: 0.3670) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.21% (1.0063 => 1.0990, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6216, std. dev.: 0.0211) SingleSource/Benchmarks/Stanford/Puzzle: 8.16% (0.1433 => 0.1550, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 7.36% (1.0194 => 1.0944, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/methcall: 7.17% (8.5566 => 9.1697, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 6.23% (3.4876 => 3.7049, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7374, std. dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.00% (40.4792 => 42.5031, std. dev.: 0.3297) SingleSource/Benchmarks/Misc/fp-convert: 4.53% (15.2242 => 15.9134, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/dt: 3.91% (0.9851 => 1.0236, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5375, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.48% (0.8498 => 0.8794, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.35% (2.6656 => 2.7548, std. dev.: 0.0259) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.16% (0.3508 => 0.3619, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 2.67% (8.5113 => 8.7383, std. dev.: 0.0681) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (2.4455 => 2.4782, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6711, std. dev.: 0.0452) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6922, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.83% (0.2080 => 0.1938, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.97% (1.2742 => 1.2364, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.12% (0.7784 => 0.7619, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.15% (0.3497 => 0.2093, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.23% (5.2665 => 4.1486, std. dev.: 0.0614) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.56% (1.1647 => 0.9835, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -6.55% (1.4441 => 1.3495, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7960, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/methcall: -5.85% (9.2503 => 8.7087, std. dev.: 0.0574) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4085, std. dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.73% (0.4140 => 0.3944, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7628, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.69% (1.7361 => 1.6721, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.31% (1.1683 => 1.1296, std. dev.: 0.0140) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.03% (1.2722 => 1.2337, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4549, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6394, std. dev.: 0.0186) MultiSource/Benchmarks/PAQ8p/paq8p: -2.83% (92.7467 => 90.1246, std. dev.: 0.4795) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.83% (2.4457 => 2.3766, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0192) MultiSource/Benchmarks/FreeBench/neural/neural: -2.28% (1.0926 => 1.0677, std. dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -1.69% (3.8907 => 3.8250, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2337, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/ffbench: -1.55% (1.4117 => 1.3898, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7660, std. dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3154, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: -1.35% (1.7330 => 1.7096, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: -1.07% (16.5617 => 16.3849, std. dev.: 0.0581) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 02:32:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 04:32:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905093212.CF5FC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3425?compare_to=3422&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3425, Order: 163199, Start Time: 2012-09-05 08:13:37, End Time: 2012-09-05 09:33:19 To: 3422, Order: 163192, Start Time: 2012-09-05 06:23:00, End Time: 2012-09-05 07:45:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (13.5188 => 13.6858, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.01% (10.3673 => 13.6858, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 16.10% (0.3473 => 0.4032, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.81% (0.3497 => 0.4050, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.81% (0.3543 => 0.4103, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 15.70% (0.3516 => 0.4068, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.69% (0.3543 => 0.4099, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 15.59% (0.3561 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.21% (0.3694 => 0.4256, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 14.79% (0.3828 => 0.4394, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.67% (0.3927 => 0.4503, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.51% (0.3886 => 0.4450, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (1.1194 => 1.2439, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.73% (0.1622 => 0.1796, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (1.7609 => 1.9494, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 9.99% (0.1432 => 0.1575, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5925 => 0.6460, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.2065 => 0.2246, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7326 => 0.7895, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.75% (0.3817 => 0.4113, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.8172 => 0.8791, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.03% (0.2758 => 0.2952, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.93% (0.4615 => 0.4935, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 6.64% (0.3282 => 0.3500, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.55% (0.5860 => 0.6244, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 6.41% (0.7835 => 0.8337, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (0.7433 => 0.7909, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (4.2646 => 4.5368, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 6.38% (10.4361 => 11.1021, std. dev.: 0.0358) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (9.4845 => 10.0862, std. dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3423 => 0.3635, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.18% (0.7115 => 0.7555, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (8.1363 => 8.6394, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2554 => 0.2710, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.09% (0.4879 => 0.5176, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.05% (1.5415 => 1.6348, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.03% (0.5569 => 0.5905, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.03% (7.0540 => 7.4795, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.95% (0.5105 => 0.5409, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.92% (0.2603 => 0.2757, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.91% (4.9449 => 5.2371, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.89% (5.0018 => 5.2965, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.3050 => 1.3817, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 5.71% (3.3354 => 3.5258, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.55% (0.9765 => 1.0307, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4299 => 0.4534, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 5.46% (0.3422 => 0.3609, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.42% (1.5603 => 1.6448, std. dev.: 0.0066) SingleSource/Regression/C++/ofstream_ctor: 5.40% (0.2905 => 0.3062, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.4103 => 0.4323, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 5.21% (5.7591 => 6.0589, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.16% (0.5020 => 0.5279, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.3180 => 0.3344, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.6675 => 0.7018, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.13% (1.1642 => 1.2239, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.4064 => 0.4271, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.08% (0.3092 => 0.3249, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.06% (0.8067 => 0.8475, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2700 => 0.2836, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.00% (14.3668 => 15.0858, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.95% (0.2891 => 0.3034, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.90% (1.1861 => 1.2442, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.88% (0.3650 => 0.3828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.87% (0.4289 => 0.4498, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.83% (0.4203 => 0.4406, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.81% (0.3098 => 0.3247, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.80% (2.0273 => 2.1247, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (2.0665 => 2.1650, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 4.74% (0.6456 => 0.6762, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.74% (0.2871 => 0.3007, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.73% (0.2725 => 0.2854, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2831 => 0.2965, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.72% (0.3136 => 0.3284, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 4.71% (3.8723 => 4.0545, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3684 => 0.3857, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.68% (0.3826 => 0.4005, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2872 => 0.3006, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3865 => 0.4045, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.3162 => 0.3308, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.62% (1.0722 => 1.1217, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.61% (0.2756 => 0.2883, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4636 => 0.4849, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3603 => 0.3768, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.58% (0.3232 => 0.3380, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2714 => 0.2837, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3283 => 0.3431, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2877 => 0.3006, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3935 => 0.4110, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.44% (0.2793 => 0.2917, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.40% (0.3387 => 0.3536, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.37% (0.6450 => 0.6732, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3052 => 0.3185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.35% (0.4620 => 0.4821, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.19% (2.2969 => 2.3931, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5981 => 0.6228, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.11% (0.8921 => 0.9288, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 4.05% (0.3379 => 0.3516, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.4186 => 1.4751, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.72% (1.5859 => 1.6449, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.2024 => 2.2785, std. dev.: 0.0178) MultiSource/Applications/sqlite3/sqlite3: 3.27% (17.1811 => 17.7424, std. dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 2.97% (1.2842 => 1.3223, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.1840 => 1.2174, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.8101 => 0.8292, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.22% (7.9617 => 8.1384, std. dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 2.19% (21.9371 => 22.4179, std. dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0005) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4144, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (3.1578 => 3.3838, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 6.26% (0.1629 => 0.1731, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 4.69% (1.1396 => 1.1930, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (4.2280 => 4.3586, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (1.3045 => 1.3262, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2467, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7617, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.33% (5.2763 => 3.2013, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.81% (5.3855 => 3.7261, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7172, std. dev.: 0.0111) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1431, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.87% (2.9384 => 2.5603, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.65% (22.1758 => 20.2587, std. dev.: 0.0576) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2540, std. dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.15% (1.8329 => 1.7201, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0011) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1491, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.94% (1.6805 => 1.6143, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5036, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4233, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9892, std. dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9580, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -2.29% (12.4730 => 12.1869, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.85% (2.5528 => 2.5055, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8562, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 03:00:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 05:00:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905100000.63FED2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3426?compare_to=3420&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3426, Order: 163195, Start Time: 2012-09-05 07:16:43, End Time: 2012-09-05 10:00:28 To: 3420, Order: 163191, Start Time: 2012-09-05 03:58:58, End Time: 2012-09-05 06:42:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.92% (2.0877 => 2.1277, std. dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.98% (0.3465 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.85% (0.3442 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.79% (0.3496 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.68% (0.3488 => 0.4000, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 14.67% (0.3469 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.11% (0.3643 => 0.4157, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.05% (0.3650 => 0.4163, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 13.86% (0.3724 => 0.4240, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.23% (0.5826 => 0.6364, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5889 => 0.6424, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7171 => 0.7713, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (1.6211 => 1.7347, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (3.5627 => 3.8094, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.87% (1.5932 => 1.7026, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (0.4361 => 0.4646, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.52% (1.3152 => 1.4009, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.2014 => 0.2143, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.34% (0.5900 => 0.6274, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2875 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (0.4994 => 0.5299, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2729 => 0.2894, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (0.5000 => 0.5297, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 5.91% (0.2725 => 0.2886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.84% (0.2792 => 0.2955, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.83% (0.4029 => 0.4264, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.81% (0.5026 => 0.5318, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.80% (0.3930 => 0.4158, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 5.77% (4.2109 => 4.4538, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2738 => 0.2895, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2823 => 0.2983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.62% (0.2813 => 0.2971, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.61% (0.2780 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2803 => 0.2959, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.3096 => 0.3267, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.49% (1.0781 => 1.1373, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 5.48% (0.2811 => 0.2965, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.45% (0.2750 => 0.2900, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.45% (0.9909 => 1.0449, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3060 => 0.3224, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (2.0673 => 2.1778, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.34% (0.3317 => 0.3494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2911 => 0.3064, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.17% (0.3348 => 0.3521, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (2.7292 => 2.8694, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 5.11% (0.3678 => 0.3866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3267 => 0.3433, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.04% (0.3690 => 0.3876, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 5.03% (0.3258 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3124 => 0.3281, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3726 => 0.3913, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.96% (5.5417 => 5.8164, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.90% (1.9694 => 2.0659, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.88% (0.3362 => 0.3526, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.88% (0.3282 => 0.3442, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.86% (0.3625 => 0.3801, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (0.4658 => 0.4882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.80% (0.3477 => 0.3644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (0.4251 => 0.4454, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.75% (1.9966 => 2.0914, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 4.71% (0.9697 => 1.0154, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.70% (0.3981 => 0.4168, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.3903 => 0.4086, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 4.61% (0.4146 => 0.4337, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.42% (2.1013 => 2.1941, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (4.4195 => 4.6141, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 4.38% (1.8794 => 1.9618, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 4.36% (23.5202 => 24.5457, std. dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: 4.27% (4.6177 => 4.8148, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 4.23% (2.1653 => 2.2569, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.3845 => 0.4006, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.17% (0.2737 => 0.2851, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.4139 => 0.4307, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 4.02% (1.4269 => 1.4842, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.2969 => 0.3088, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.3271 => 0.3401, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.92% (0.6634 => 0.6894, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 3.91% (0.7875 => 0.8183, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.5012 => 0.5206, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.87% (0.3336 => 0.3465, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.66% (0.5546 => 0.5749, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.6435 => 0.6666, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.84% (2.0346 => 2.0923, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (0.4847 => 0.4965, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (0.7426 => 0.7562, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.46% (11.6398 => 11.8094, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.28% (4.6926 => 4.7526, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6489, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.20% (2.0820 => 2.1277, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1904, std. dev.: 0.0093) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5028, std. dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4481, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2816, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5923, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5700, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8034, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7926, std. dev.: 0.0160) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.72% (0.6293 => 0.6122, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: -2.46% (17.2379 => 16.8134, std. dev.: 0.0311) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (16.2163 => 15.9810, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 03:07:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 05:07:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905100745.864882A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3427?compare_to=3423&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3427, Order: 163199, Start Time: 2012-09-05 08:53:53, End Time: 2012-09-05 10:08:47 To: 3423, Order: 163194, Start Time: 2012-09-05 07:09:57, End Time: 2012-09-05 08:25:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.17% (2.0176 => 2.4043, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.50% (0.5818 => 0.6545, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.47% (0.5748 => 0.6465, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.02% (0.7061 => 0.7910, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 11.54% (0.3578 => 0.3991, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.33% (0.3601 => 0.4009, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.27% (0.3646 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3650 => 0.4061, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.14% (0.3663 => 0.4071, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.10% (0.3623 => 0.4025, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.01% (0.3789 => 0.4206, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.91% (0.7710 => 0.8551, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.88% (0.3914 => 0.4340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.4003 => 0.4434, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.61% (0.3940 => 0.4358, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.84% (1.3693 => 1.5040, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.46% (0.2781 => 0.3044, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.43% (3.9660 => 4.3399, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.36% (0.4328 => 0.4733, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2760 => 0.3014, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.20% (0.3293 => 0.3596, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.17% (0.2782 => 0.3037, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.95% (0.5265 => 0.5736, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 8.94% (0.2607 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.94% (0.4062 => 0.4425, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.83% (1.9828 => 2.1579, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.81% (0.2690 => 0.2927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.70% (0.3022 => 0.3285, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.68% (0.2628 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.66% (0.2966 => 0.3223, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.62% (0.3899 => 0.4235, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2127 => 0.2310, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.2937 => 0.3189, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2765 => 0.3002, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 8.55% (0.2726 => 0.2959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.50% (0.2988 => 0.3242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.46% (0.2696 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.44% (0.2761 => 0.2994, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.33% (1.2193 => 1.3209, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.31% (0.9199 => 0.9963, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 8.28% (0.7038 => 0.7621, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 8.24% (0.3107 => 0.3363, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.23% (0.3489 => 0.3776, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3485 => 0.3771, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.16% (0.3149 => 0.3406, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.16% (0.2721 => 0.2943, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.16% (1.4563 => 1.5751, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.16% (0.3580 => 0.3872, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.11% (0.4390 => 0.4746, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.08% (0.6959 => 0.7521, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.07% (0.4016 => 0.4340, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.06% (0.1327 => 0.1434, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 8.05% (0.3192 => 0.3449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.94% (0.3453 => 0.3727, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.76% (1.1364 => 1.2246, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.70% (0.3868 => 0.4166, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.65% (13.8202 => 14.8778, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists1: 7.61% (0.3534 => 0.3803, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.61% (0.7506 => 0.8077, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5577 => 0.5997, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.42% (0.4379 => 0.4704, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (7.2180 => 7.7466, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 7.16% (0.2945 => 0.3156, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.12% (0.1588 => 0.1701, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.4791 => 0.5122, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.90% (0.3246 => 0.3470, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.78% (1.0313 => 1.1012, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.66% (1.1061 => 1.1798, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (13.2842 => 14.1616, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.52% (0.8310 => 0.8852, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.52% (0.1657 => 0.1765, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.50% (0.2925 => 0.3115, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 6.48% (0.2995 => 0.3189, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.46% (0.6283 => 0.6689, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3220 => 0.3428, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.38% (0.6744 => 0.7174, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.35% (1.3819 => 1.4697, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.34% (0.3755 => 0.3993, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.32% (1.3245 => 1.4082, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 6.24% (3.8646 => 4.1057, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (1.2749 => 1.3535, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (1.3813 => 1.4661, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.06% (0.7460 => 0.7912, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 5.96% (0.4113 => 0.4358, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.95% (1.9270 => 2.0416, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.91% (0.8698 => 0.9212, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.84% (3.6692 => 3.8835, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 5.82% (2.1791 => 2.3059, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 5.81% (1.2292 => 1.3006, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.79% (3.1889 => 3.3734, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.78% (16.6129 => 17.5729, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.6135 => 0.6487, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.68% (1.0594 => 1.1196, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.62% (0.8818 => 0.9314, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.60% (4.3801 => 4.6253, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.59% (0.2504 => 0.2644, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.47% (4.4433 => 4.6865, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 5.15% (14.5298 => 15.2777, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 5.14% (0.3131 => 0.3292, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 5.06% (14.8535 => 15.6050, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 5.02% (8.4961 => 8.9228, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.98% (1.1333 => 1.1897, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 4.97% (0.2859 => 0.3001, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.35% (0.2321 => 0.2422, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6250 => 0.6520, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 4.19% (4.6629 => 4.8582, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 4.14% (6.5754 => 6.8479, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.92% (4.9865 => 5.1819, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (3.2742 => 3.4025, std. dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 3.58% (16.2614 => 16.8443, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.39% (0.9108 => 0.9417, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.1007 => 2.1705, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.31% (1.5188 => 1.5691, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 3.17% (3.7467 => 3.8655, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (6.2785 => 6.4465, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.66% (33.2944 => 34.1805, std. dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5097, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.97% (1.0895 => 1.3506, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (3.1736 => 3.4173, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.74% (0.2093 => 0.2234, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.06% (1.1560 => 1.2261, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.49% (10.7476 => 11.2297, std. dev.: 0.0227) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7342, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5981, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.96% (1.5824 => 1.6134, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.24% (1.4298 => 1.4476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (3.6469 => 3.6885, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5977, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1405, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5720, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.67% (0.4657 => 0.4067, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.82% (22.5627 => 21.4761, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.34% (0.2670 => 0.2554, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2865, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1490, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5949, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -2.12% (26.5159 => 25.9549, std. dev.: 0.1287) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.89% (0.6615 => 0.6490, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2129, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.5928 => 4.5367, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8710, std. dev.: 0.0164) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2334, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 4.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 03:16:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 05:16:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905101607.CF7002A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3428?compare_to=3424&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3428, Order: 163202, Start Time: 2012-09-05 09:05:52, End Time: 2012-09-05 10:17:14 To: 3424, Order: 163196, Start Time: 2012-09-05 07:38:26, End Time: 2012-09-05 08:50:29 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (41 on baseline) Performance Improvements: 2 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (820 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 11.96% (0.1480 => 0.1657, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.58% (0.7604 => 0.7876, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.38% (1.2364 => 1.2782, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 2.43% (0.7579 => 0.7763, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 1.25% (1.3192 => 1.3357, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.86% (1.0990 => 1.1414, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.37% (0.9835 => 0.9970, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.01% (8.7883 => 8.4356, std. dev.: 0.0957) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (40.1534 => 39.0008, std. dev.: 0.2906) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.83% (0.1414 => 0.1553, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3.36% (1.1653 => 1.2045, std. dev.: 0.0134) MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (2.1763 => 2.2490, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 2.46% (0.6173 => 0.6325, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.5150 => 1.5472, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.06% (1.2021 => 1.2148, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.91% (0.0263 => 0.0389, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.71% (0.0766 => 0.0917, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std. dev.: 0.0252) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 13.43% (1.0063 => 1.1414, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.36% (4.0101 => 4.5458, std. dev.: 0.0290) MultiSource/Applications/sgefa/sgefa: 12.49% (0.3746 => 0.4214, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.02% (0.2694 => 0.2991, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: 10.99% (0.4296 => 0.4768, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 10.78% (62.4126 => 69.1420, std. dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/sieve: 10.52% (3.4406 => 3.8027, std. dev.: 0.0388) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.36% (15.8312 => 17.4710, std. dev.: 0.3479) SingleSource/Benchmarks/Stanford/Puzzle: 9.63% (0.1433 => 0.1571, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6043, std. dev.: 0.0217) SingleSource/Benchmarks/Shootout/methcall: 7.57% (8.5566 => 9.2045, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.4876 => 3.7204, std. dev.: 0.0237) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7407, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.97% (40.4792 => 42.4897, std. dev.: 0.6956) SingleSource/Benchmarks/Misc/fp-convert: 4.58% (15.2242 => 15.9222, std. dev.: 0.0208) SingleSource/Benchmarks/Misc/dt: 4.37% (0.9851 => 1.0281, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8716, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.77% (0.7609 => 0.7820, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.74% (0.5876 => 0.6037, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 2.48% (8.5113 => 8.7221, std. dev.: 0.0585) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.24% (2.4042 => 2.4581, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 2.08% (5.1938 => 5.3020, std. dev.: 0.0354) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (2.4455 => 2.4929, std. dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5323, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6706, std. dev.: 0.0493) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.14% (3.6254 => 3.6666, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.25% (8.9977 => 8.4356, std. dev.: 0.0957) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.00% (0.2080 => 0.1976, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.66% (0.3497 => 0.2075, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.55% (5.2665 => 4.1318, std. dev.: 0.0780) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.40% (1.1647 => 0.9970, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1605, std. dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9413, std. dev.: 0.0860) MultiSource/Benchmarks/Ptrdist/ks/ks: -7.60% (1.4034 => 1.2968, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: -7.26% (1.4441 => 1.3393, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/pi: -6.50% (1.6538 => 1.5463, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (9.2503 => 8.6538, std. dev.: 0.0911) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.08% (3.6023 => 3.4193, std. dev.: 0.0523) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4049, std. dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.69% (3.9413 => 3.7564, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.52% (1.7361 => 1.6576, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.30% (1.1683 => 1.1298, std. dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4561, std. dev.: 0.0230) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.95% (0.4140 => 0.4018, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.85% (3.7496 => 3.6429, std. dev.: 0.0341) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std. dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (92.7467 => 90.4291, std. dev.: 0.0963) MultiSource/Applications/aha/aha: -1.75% (3.4286 => 3.3685, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.51% (9.3855 => 9.2439, std. dev.: 0.0090) MultiSource/Benchmarks/FreeBench/neural/neural: -1.45% (1.0926 => 1.0768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7652, std. dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3081, std. dev.: 0.0172) MultiSource/Benchmarks/sim/sim: -1.28% (3.8907 => 3.8410, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 04:19:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 06:19:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905111945.B450C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3429?compare_to=3425&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3429, Order: 163206, Start Time: 2012-09-05 10:01:30, End Time: 2012-09-05 11:20:54 To: 3425, Order: 163199, Start Time: 2012-09-05 08:13:37, End Time: 2012-09-05 09:33:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (133 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.34% (0.7895 => 0.7789, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.05% (2.1650 => 2.1422, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.25% (1.2141 => 1.1989, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.67% (10.3673 => 13.6502, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 14.77% (0.3473 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.44% (0.3497 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.42% (0.3543 => 0.4054, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.39% (0.3543 => 0.4053, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.35% (0.3561 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3516 => 0.4017, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.89% (0.3694 => 0.4207, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.58% (0.3828 => 0.4348, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.50% (0.3927 => 0.4457, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 13.25% (0.3886 => 0.4401, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.30% (1.7609 => 1.9599, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 11.16% (0.1622 => 0.1803, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.92% (0.1432 => 0.1574, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.23% (2.2022 => 2.4055, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1625 => 0.1767, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.15% (0.3177 => 0.3436, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference-object: 7.26% (0.6030 => 0.6468, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.8172 => 0.8758, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 6.83% (0.3282 => 0.3506, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.4615 => 0.4929, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.57% (0.7433 => 0.7921, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.50% (0.3817 => 0.4065, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.5860 => 0.6239, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.39% (0.7115 => 0.7570, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 6.37% (9.4845 => 10.0884, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 6.35% (10.4361 => 11.0983, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 6.34% (0.7835 => 0.8332, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7326 => 0.7789, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (4.2646 => 4.5340, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.28% (7.0540 => 7.4967, std. dev.: 0.0183) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (8.1363 => 8.6317, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5569 => 0.5903, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (0.3121 => 0.3308, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.2554 => 0.2706, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.91% (1.3050 => 1.3821, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.88% (1.5415 => 1.6322, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.84% (0.2603 => 0.2755, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.70% (4.9449 => 5.2266, std. dev.: 0.0098) MultiSource/Applications/d/make_dparser: 5.66% (3.3354 => 3.5241, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (5.0018 => 5.2840, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9765 => 1.0304, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.4103 => 0.4325, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.41% (0.2700 => 0.2846, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.25% (0.3180 => 0.3347, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.21% (5.7591 => 6.0591, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.17% (0.6675 => 0.7020, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.12% (0.4299 => 0.4519, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2235, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.08% (0.8067 => 0.8477, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.99% (2.0273 => 2.1285, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.99% (14.3668 => 15.0835, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.97% (1.1861 => 1.2450, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.94% (0.5020 => 0.5268, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 4.87% (3.8723 => 4.0610, std. dev.: 0.0164) MultiSource/Applications/lemon/lemon: 4.81% (1.0722 => 1.1238, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.78% (1.5603 => 1.6349, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.3162 => 0.3308, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.57% (0.4636 => 0.4848, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 4.55% (0.6456 => 0.6750, std. dev.: 0.0098) MultiSource/Benchmarks/sim/sim: 4.52% (0.3387 => 0.3540, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3826 => 0.3998, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.44% (2.2969 => 2.3989, std. dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.43% (0.6450 => 0.6736, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.3422 => 0.3572, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.27% (0.8921 => 0.9302, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.15% (0.2891 => 0.3011, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.3650 => 0.3800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.4203 => 0.4372, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.4186 => 1.4749, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.5859 => 1.6483, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3935 => 0.4089, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.2905 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4048 => 0.4203, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.3098 => 0.3215, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.66% (2.0665 => 2.1422, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.53% (0.3684 => 0.3814, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (2.2024 => 2.2801, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.3052 => 0.3157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.41% (0.3283 => 0.3395, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.41% (17.1811 => 17.7672, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.81% (1.1840 => 1.2173, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 2.39% (1.2842 => 1.3149, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.18% (7.9617 => 8.1356, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.8101 => 0.8268, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.01% (21.9371 => 22.3772, std. dev.: 0.0268) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (3.1578 => 3.3796, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 4.65% (1.1396 => 1.1926, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (4.2280 => 4.3718, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7472, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2309, std. dev.: 0.0433) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5868, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7623, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.47% (5.2763 => 3.1938, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.53% (5.3855 => 3.7415, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.16% (5.3526 => 3.7382, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1757, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.80% (2.9384 => 2.5624, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -8.40% (22.1758 => 20.3131, std. dev.: 0.0306) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.12% (19.9488 => 18.3292, std. dev.: 0.1064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.22% (1.8329 => 1.7189, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std. dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8047, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.04% (3.2827 => 3.1502, std. dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -3.10% (1.2373 => 1.1989, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5043, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4269, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0054, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9588, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -2.31% (12.4730 => 12.1844, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2353, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 04:43:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 06:43:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905114327.B1CB92A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3430?compare_to=3428&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3430, Order: 163208, Start Time: 2012-09-05 10:32:50, End Time: 2012-09-05 11:44:38 To: 3428, Order: 163202, Start Time: 2012-09-05 09:05:52, End Time: 2012-09-05 10:17:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (44 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 6.35% (0.2833 => 0.3013, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 2.89% (4.3258 => 4.4510, std. dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/sieve: 2.10% (3.8027 => 3.8824, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 1.71% (2.3539 => 2.3942, std. dev.: 0.0079) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.65% (2.7158 => 2.7605, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.51% (1.6576 => 1.6826, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.31% (3.6429 => 3.6905, std. dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -3.46% (0.2946 => 0.2844, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.17% (3.6263 => 3.5838, std. dev.: 0.0164) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.1653 => 1.2019, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (2.1763 => 2.2383, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.77% (0.7722 => 0.7936, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 2.63% (1.0046 => 1.0310, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: 15.20% (1.7426 => 2.0074, std. dev.: 0.0231) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.88% (0.0766 => 0.0880, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5638, std. dev.: 0.0125) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 13.52% (0.4296 => 0.4877, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 12.84% (3.4406 => 3.8824, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.76% (0.0917 => 0.1034, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (62.4126 => 69.1478, std. dev.: 0.1641) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.73% (7.0025 => 7.6137, std. dev.: 0.0275) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (15.8312 => 16.9844, std. dev.: 0.2583) SingleSource/Benchmarks/Shootout/methcall: 6.93% (8.5566 => 9.1500, std. dev.: 0.0503) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.4876 => 3.7216, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.79% (27.1724 => 28.7455, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (4.2129 => 4.4510, std. dev.: 0.0260) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.04% (15.2242 => 15.8399, std. dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.56% (2.6656 => 2.7605, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.37% (0.8498 => 0.8784, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5113 => 8.7563, std. dev.: 0.0437) SingleSource/Benchmarks/Misc/whetstone: 2.09% (2.3453 => 2.3942, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.02% (0.7609 => 0.7763, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 2.00% (0.6308 => 0.6434, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/five11/five11: 1.97% (5.1938 => 5.2962, std. dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4455 => 2.4859, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.57% (4.6127 => 4.6851, std. dev.: 0.0191) MultiSource/Applications/JM/lencod/lencod: 1.42% (6.7458 => 6.8414, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5303, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6703, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: 1.19% (1.4184 => 1.4353, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.13% (2.4013 => 2.4284, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6935, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.10% (3.6254 => 3.6654, std. dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.56% (0.9029 => 0.8888, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.39% (4.3380 => 4.2777, std. dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.97% (5.2665 => 4.1094, std. dev.: 0.1051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.48% (1.1647 => 0.9961, std. dev.: 0.0270) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1604, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9454, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -7.18% (1.4441 => 1.3404, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5513, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (9.2503 => 8.7188, std. dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4056, std. dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: -4.91% (8.5323 => 8.1134, std. dev.: 0.1174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7629, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.37% (1.2959 => 1.2522, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.28% (2.4457 => 2.3656, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2309, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -3.16% (7.6833 => 7.4408, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.08% (1.7361 => 1.6826, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2880, std. dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -2.52% (92.7467 => 90.4136, std. dev.: 0.3090) MultiSource/Applications/siod/siod: -2.33% (3.5520 => 3.4694, std. dev.: 0.0237) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3626, std. dev.: 0.0196) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2280, std. dev.: 0.0403) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.58% (3.7496 => 3.6905, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.43% (1.8739 => 1.8471, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0926 => 1.0772, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3143, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7678, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5617 => 16.3567, std. dev.: 0.0734) MultiSource/Benchmarks/Olden/tsp/tsp: -1.17% (1.7330 => 1.7128, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 04:51:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 06:51:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905115104.1A9BC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3431?compare_to=3427&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3431, Order: 163208, Start Time: 2012-09-05 10:37:21, End Time: 2012-09-05 11:52:13 To: 3427, Order: 163199, Start Time: 2012-09-05 08:53:53, End Time: 2012-09-05 10:08:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.16% (2.1579 => 2.1328, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.99% (2.0176 => 2.4008, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.83% (0.5748 => 0.6428, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3578 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.11% (0.3646 => 0.4051, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.08% (0.3601 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.06% (0.7061 => 0.7842, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.96% (0.3650 => 0.4050, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3663 => 0.4061, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.76% (0.3623 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.66% (0.3789 => 0.4193, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3914 => 0.4330, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.43% (0.7710 => 0.8514, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.37% (0.4003 => 0.4418, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.28% (0.3940 => 0.4345, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.25% (3.9660 => 4.3328, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.08% (1.3693 => 1.4936, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.79% (0.5265 => 0.5728, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 8.62% (0.7038 => 0.7645, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.46% (0.4328 => 0.4694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.39% (0.4062 => 0.4403, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.24% (0.9199 => 0.9957, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 8.23% (0.2781 => 0.3010, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.21% (0.2655 => 0.2873, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.4563 => 1.5758, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.19% (1.2193 => 1.3191, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.09% (0.6959 => 0.7522, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.2721 => 0.2939, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.79% (0.2760 => 0.2975, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.76% (0.1327 => 0.1430, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.70% (1.1364 => 1.2239, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: 7.68% (0.3293 => 0.3546, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 7.65% (13.8202 => 14.8775, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2607 => 0.2805, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.57% (1.9828 => 2.1328, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.51% (0.2690 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.44% (0.5577 => 0.5992, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.42% (0.2937 => 0.3155, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3580 => 0.3844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.36% (0.2988 => 0.3208, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.34% (0.7506 => 0.8057, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2761 => 0.2963, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.31% (0.2914 => 0.3127, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4390 => 0.4710, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.24% (0.3756 => 0.4028, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.19% (7.2180 => 7.7373, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.12% (0.4016 => 0.4302, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.89% (0.3192 => 0.3412, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.88% (0.2995 => 0.3201, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.83% (0.4791 => 0.5118, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.82% (1.0313 => 1.1016, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.81% (0.3453 => 0.3688, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.71% (0.5637 => 0.6015, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (13.2842 => 14.1684, std. dev.: 0.0240) MultiSource/Applications/Burg/burg: 6.62% (1.1061 => 1.1793, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 6.61% (0.8310 => 0.8859, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.40% (0.1657 => 0.1763, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.36% (0.2925 => 0.3111, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.34% (1.3819 => 1.4695, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.6283 => 0.6680, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.30% (3.8646 => 4.1081, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 6.29% (0.2243 => 0.2384, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (1.3813 => 1.4681, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.27% (0.3220 => 0.3422, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.05% (0.7460 => 0.7911, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 6.02% (1.9270 => 2.0430, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.3245 => 1.4042, std. dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 6.01% (1.2749 => 1.3515, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 5.93% (0.6744 => 0.7144, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 5.81% (2.1791 => 2.3057, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.77% (0.8818 => 0.9327, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.76% (3.1889 => 3.3726, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.73% (3.6692 => 3.8796, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.72% (0.6135 => 0.6486, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.66% (1.0594 => 1.1194, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 5.64% (0.4113 => 0.4345, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.47% (4.3801 => 4.6198, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.36% (4.4433 => 4.6813, std. dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 5.33% (16.6129 => 17.4982, std. dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 5.27% (14.8535 => 15.6364, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.27% (0.8698 => 0.9156, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 5.25% (0.2859 => 0.3009, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2700, std. dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 4.95% (0.3131 => 0.3286, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.82% (1.1333 => 1.1879, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 4.78% (8.4961 => 8.9026, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2292 => 1.2877, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.75% (0.3245 => 0.3399, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (6.5754 => 6.8528, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 4.19% (4.6629 => 4.8585, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (3.2742 => 3.4032, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4805 => 0.4994, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.73% (16.2614 => 16.8684, std. dev.: 0.0327) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1719, std. dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: 3.60% (0.6250 => 0.6475, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.36% (0.9108 => 0.9414, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.1007 => 2.1709, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.34% (1.5188 => 1.5695, std. dev.: 0.0080) MultiSource/Applications/lua/lua: 3.25% (3.7467 => 3.8686, std. dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.67% (33.2944 => 34.1834, std. dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (6.2785 => 6.4330, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std. dev.: 0.0469) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.78% (0.2093 => 0.2235, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.11% (1.1560 => 1.2266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 5.60% (1.2998 => 1.3726, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.2619 => 11.7344, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.50% (10.7476 => 11.1237, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/flops-6: 3.28% (1.9199 => 1.9828, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6039, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.99% (1.5824 => 1.6139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1420, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.06% (0.4657 => 0.4049, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.92% (22.5627 => 21.4522, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.68% (0.2670 => 0.2545, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.30% (20.3410 => 18.2450, std. dev.: 0.0196) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -5.31% (2.6470 => 2.5064, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3192, std. dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9243, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6138, std. dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.97% (26.5159 => 25.9935, std. dev.: 0.0151) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2509, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2143, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.17% (4.5928 => 4.5389, std. dev.: 0.0162) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2421, std. dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 06:07:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 08:07:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905130705.300B52A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3432?compare_to=3429&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3432, Order: 163208, Start Time: 2012-09-05 11:49:00, End Time: 2012-09-05 13:08:14 To: 3429, Order: 163206, Start Time: 2012-09-05 10:01:30, End Time: 2012-09-05 11:20:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (133 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (717 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.06% (0.4059 => 0.4386, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.01% (1.5019 => 1.5170, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.29% (10.3673 => 13.6115, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 15.63% (0.3473 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.35% (0.3543 => 0.4087, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.30% (0.3497 => 0.4032, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.21% (0.3543 => 0.4082, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.19% (0.3516 => 0.4050, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.08% (0.3561 => 0.4098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3694 => 0.4238, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.39% (0.3828 => 0.4379, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.16% (0.3927 => 0.4483, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.95% (0.3886 => 0.4428, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.91% (0.1622 => 0.1799, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.80% (1.1194 => 1.2403, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.69% (1.7609 => 1.9491, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.84% (2.2022 => 2.3968, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.37% (0.1625 => 0.1761, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.17% (0.5925 => 0.6409, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 7.30% (0.7835 => 0.8407, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.8172 => 0.8768, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.28% (0.3817 => 0.4095, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7326 => 0.7859, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4615 => 0.4927, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7433 => 0.7910, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.34% (0.1940 => 0.2063, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.34% (0.3282 => 0.3490, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.31% (10.4361 => 11.0948, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: 6.30% (0.7115 => 0.7563, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (4.2646 => 4.5277, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.16% (0.5860 => 0.6221, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (8.1363 => 8.6369, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (9.4845 => 10.0653, std. dev.: 0.0176) MultiSource/Benchmarks/McCat/18-imp/imp: 6.08% (0.3423 => 0.3631, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.94% (0.4879 => 0.5169, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3121 => 0.3306, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (7.0540 => 7.4719, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 5.91% (0.2554 => 0.2705, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.90% (1.5415 => 1.6324, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.3050 => 1.3809, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.80% (0.2603 => 0.2754, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.70% (3.3354 => 3.5255, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.63% (5.0018 => 5.2833, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.9449 => 5.2227, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.58% (0.5105 => 0.5390, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.47% (0.9765 => 1.0299, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.23% (0.4299 => 0.4524, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.22% (0.2700 => 0.2841, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2241, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.10% (5.7591 => 6.0530, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.09% (0.8067 => 0.8478, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.3180 => 0.3340, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.99% (0.6675 => 0.7008, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.97% (1.1861 => 1.2450, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.90% (0.5020 => 0.5266, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (14.3668 => 15.0702, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.88% (0.3441 => 0.3609, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 4.84% (3.8723 => 4.0599, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 4.83% (2.0273 => 2.1252, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 4.83% (1.5603 => 1.6356, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 4.72% (0.3092 => 0.3238, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.64% (1.0722 => 1.1220, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.53% (0.4103 => 0.4289, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4636 => 0.4845, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.46% (0.3136 => 0.3276, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.44% (0.3422 => 0.3574, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.43% (0.3387 => 0.3537, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.31% (2.2969 => 2.3960, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3826 => 0.3989, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.4064 => 0.4235, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8921 => 0.9294, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5859 => 1.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.89% (0.4289 => 0.4456, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.4186 => 1.4731, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4203 => 0.4362, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.3098 => 0.3212, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2871 => 0.2974, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0665 => 2.1406, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.58% (0.3684 => 0.3816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.4048 => 0.4192, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4620 => 0.4783, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.48% (0.3162 => 0.3272, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.2024 => 2.2785, std. dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3603 => 0.3726, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.34% (0.3232 => 0.3340, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.31% (17.1811 => 17.7505, std. dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.1840 => 1.2161, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.30% (1.2842 => 1.3138, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.8101 => 0.8271, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.05% (7.9617 => 8.1247, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 1.89% (21.9371 => 22.3521, std. dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.1396 => 1.1921, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7601, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (4.2280 => 4.3638, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.54% (1.3045 => 1.3246, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2313, std. dev.: 0.0158) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.68% (5.2763 => 3.1828, std. dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.86% (5.3855 => 3.7237, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.50% (5.3526 => 3.7200, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1427, std. dev.: 0.0241) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5446, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.44% (22.1758 => 20.3048, std. dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2931, std. dev.: 0.0886) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1491, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.96% (1.6805 => 1.6140, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4990, std. dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: -3.08% (1.2373 => 1.1992, std. dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4303, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9921, std. dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9622, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1888, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6788, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2274, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0181) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 06:12:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 08:12:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905131202.6E0AC2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3433?compare_to=3426&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3433, Order: 163206, Start Time: 2012-09-05 10:29:17, End Time: 2012-09-05 13:13:12 To: 3426, Order: 163195, Start Time: 2012-09-05 07:16:43, End Time: 2012-09-05 10:00:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.34% (54.1722 => 54.8969, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.7820 => 2.8114, std. dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.21% (0.3446 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 15.15% (0.3465 => 0.3990, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 15.14% (0.3442 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.05% (0.3496 => 0.4022, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.41% (0.3643 => 0.4168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.21% (0.3724 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.19% (0.1620 => 0.1785, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.60% (0.5826 => 0.6327, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.32% (0.5889 => 0.6379, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (3.5627 => 3.8351, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.46% (1.6211 => 1.7420, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.5900 => 0.6326, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.13% (1.3152 => 1.4090, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.99% (0.4994 => 0.5343, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.86% (0.7171 => 0.7663, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.73% (0.4029 => 0.4300, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.64% (0.5000 => 0.5332, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.63% (0.4361 => 0.4650, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.59% (0.5026 => 0.5357, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 6.38% (1.5932 => 1.6949, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 6.36% (4.2109 => 4.4786, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (0.3930 => 0.4176, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.3004 => 0.3189, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2738 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (2.7292 => 2.8922, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2875 => 0.3042, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 5.81% (0.2566 => 0.2715, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.76% (1.0781 => 1.1402, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.2866 => 0.3031, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.67% (0.3792 => 0.4007, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.65% (0.3060 => 0.3233, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.52% (1.9694 => 2.0781, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 5.50% (0.9909 => 1.0454, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.50% (0.4658 => 0.4914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.43% (5.5417 => 5.8426, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/objinst: 5.42% (0.2823 => 0.2976, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.41% (0.2792 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.38% (0.3195 => 0.3367, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3625 => 0.3819, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.31% (0.2729 => 0.2874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.30% (0.2813 => 0.2962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.27% (0.2750 => 0.2895, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (1.9966 => 2.1018, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 5.24% (2.1013 => 2.2114, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 5.23% (0.3096 => 0.3258, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2803 => 0.2949, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (2.0673 => 2.1748, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2911 => 0.3062, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.16% (0.2811 => 0.2956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.14% (0.2780 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.12% (0.3362 => 0.3534, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.05% (0.3845 => 0.4039, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.04% (0.3890 => 0.4086, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3267 => 0.3431, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.97% (0.3258 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.91% (0.3317 => 0.3480, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.90% (0.4139 => 0.4342, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 4.89% (1.8794 => 1.9713, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (0.3903 => 0.4093, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.87% (0.3124 => 0.3276, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.83% (0.3726 => 0.3906, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.3282 => 0.3439, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.78% (0.3348 => 0.3508, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.75% (23.5202 => 24.6377, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/lists1: 4.72% (0.3477 => 0.3641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.70% (0.3678 => 0.3851, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (4.4195 => 4.6273, std. dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 4.69% (4.6177 => 4.8343, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4146 => 0.4338, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (2.1653 => 2.2655, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.59% (0.4251 => 0.4446, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 4.53% (1.4269 => 1.4916, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 4.50% (0.7875 => 0.8229, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.39% (0.9697 => 1.0123, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.30% (0.3981 => 0.4152, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.3271 => 0.3410, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.2969 => 0.3090, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.02% (0.3084 => 0.3208, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.95% (0.2737 => 0.2845, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.90% (0.6634 => 0.6893, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.5012 => 0.5197, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.43% (2.0346 => 2.0841, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.60% (0.7426 => 0.7545, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (11.6398 => 11.7998, std. dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: 1.32% (2.4764 => 2.5092, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.30% (4.6926 => 4.7537, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6681, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8974, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std. dev.: 0.0271) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2091, std. dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4980, std. dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4462, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2883, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5884, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4712, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5740, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7898, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std. dev.: 0.0044) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.88% (17.2379 => 16.7419, std. dev.: 0.0751) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.44% (16.2163 => 15.9832, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 06:44:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 08:44:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905134420.663052A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3434?compare_to=3430&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3434, Order: 163212, Start Time: 2012-09-05 12:34:42, End Time: 2012-09-05 13:45:31 To: 3430, Order: 163208, Start Time: 2012-09-05 10:32:50, End Time: 2012-09-05 11:44:38 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (44 on baseline) Performance Improvements: 4 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.94% (8.3925 => 8.8908, std. dev.: 0.0497) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 7.53% (3.3252 => 3.5755, std. dev.: 0.0747) MultiSource/Benchmarks/nbench/nbench: 4.73% (21.1970 => 22.1996, std. dev.: 0.0958) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.36% (0.7763 => 0.8024, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: 2.82% (2.0074 => 2.0641, std. dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.26% (4.1094 => 4.2022, std. dev.: 0.0120) MultiSource/Benchmarks/llubenchmark/llu: 1.24% (2.0256 => 2.0507, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.80% (22.7707 => 21.2230, std. dev.: 0.5490) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.21% (4.5763 => 4.4753, std. dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.02% (44.4229 => 43.5242, std. dev.: 0.3177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.29% (3.6905 => 3.6430, std. dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.14% (0.1414 => 0.1515, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.09% (0.6173 => 0.6364, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3.08% (1.1653 => 1.2012, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 2.73% (1.0046 => 1.0320, std. dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 2.67% (2.1763 => 2.2343, std. dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (12.6413 => 12.8490, std. dev.: 0.0353) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.5150 => 1.5392, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.16% (1.1440 => 1.1573, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.05% (3.4629 => 4.2265, std. dev.: 0.0235) SingleSource/Benchmarks/Shootout/ary3: 18.45% (1.7426 => 2.0641, std. dev.: 0.0163) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.0766 => 0.0904, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 13.71% (0.4296 => 0.4885, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.46% (4.0101 => 4.5500, std. dev.: 0.0136) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0054) SingleSource/Benchmarks/Stanford/Puzzle: 12.49% (0.1433 => 0.1612, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: 11.18% (3.2159 => 3.5755, std. dev.: 0.0747) MultiSource/Benchmarks/mafft/pairlocalalign: 10.78% (62.4126 => 69.1424, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/sieve: 10.66% (3.4406 => 3.8074, std. dev.: 0.0379) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6075, std. dev.: 0.1007) SingleSource/Benchmarks/McGill/chomp: 7.95% (1.0194 => 1.1004, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout/methcall: 7.90% (8.5566 => 9.2328, std. dev.: 0.1261) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.23% (1.0063 => 1.0791, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 6.97% (3.4876 => 3.7307, std. dev.: 0.0292) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7398, std. dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.45% (0.7609 => 0.8024, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (0.3301 => 0.3467, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.85% (21.1721 => 22.1996, std. dev.: 0.0958) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.76% (4.2129 => 4.4133, std. dev.: 0.0425) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (15.2242 => 15.9087, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/dt: 4.01% (0.9851 => 1.0246, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.99% (0.3508 => 0.3613, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5113 => 8.7605, std. dev.: 0.0313) MultiSource/Applications/JM/lencod/lencod: 2.59% (6.7458 => 6.9204, std. dev.: 0.0367) MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.1938 => 5.3031, std. dev.: 0.0420) MultiSource/Benchmarks/llubenchmark/llu: 1.56% (2.0192 => 2.0507, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.54% (4.6127 => 4.6839, std. dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (2.4971 => 2.5305, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6690, std. dev.: 0.0684) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.4184 => 1.4354, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.77% (0.7784 => 0.7646, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.37% (4.2815 => 4.2228, std. dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.43% (0.3497 => 0.2118, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.21% (5.2665 => 4.2022, std. dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.76% (1.1647 => 0.9928, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std. dev.: 0.0683) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2007 => 2.9419, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3421, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/pi: -6.37% (1.6538 => 1.5484, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (9.2503 => 8.6628, std. dev.: 0.1031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -5.35% (1.7361 => 1.6433, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0459) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.28% (45.4683 => 43.5242, std. dev.: 0.3177) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.13% (2.4457 => 2.3447, std. dev.: 0.0189) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.36% (1.2722 => 1.2294, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4557, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.84% (3.7496 => 3.6430, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.74% (1.1683 => 1.1363, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2899, std. dev.: 0.0066) MultiSource/Applications/siod/siod: -2.31% (3.5520 => 3.4699, std. dev.: 0.0198) MultiSource/Benchmarks/PAQ8p/paq8p: -2.01% (92.7467 => 90.8809, std. dev.: 0.2908) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.77% (1.8739 => 1.8407, std. dev.: 0.0070) MultiSource/Applications/aha/aha: -1.69% (3.4286 => 3.3707, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2358, std. dev.: 0.0218) MultiSource/Benchmarks/Olden/tsp/tsp: -1.55% (1.7330 => 1.7061, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.37% (4.5374 => 4.4753, std. dev.: 0.0227) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7682, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3211, std. dev.: 0.0522) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.13% (2.8964 => 2.8637, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 07:01:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 09:01:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905140116.C16EB2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3435?compare_to=3431&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3435, Order: 163212, Start Time: 2012-09-05 12:47:47, End Time: 2012-09-05 14:02:26 To: 3431, Order: 163208, Start Time: 2012-09-05 10:37:21, End Time: 2012-09-05 11:52:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (162 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.42% (55.6449 => 56.4341, std. dev.: 0.0672) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.02% (2.0176 => 2.4013, std. dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.68% (0.1410 => 0.1617, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.89% (0.5818 => 0.6510, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.81% (0.5748 => 0.6427, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3578 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.22% (0.3601 => 0.4005, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.11% (0.3663 => 0.4070, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.05% (0.3646 => 0.4049, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.90% (0.3650 => 0.4048, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.90% (0.3623 => 0.4018, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 10.86% (0.3914 => 0.4339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3789 => 0.4194, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.4003 => 0.4423, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.35% (0.7710 => 0.8508, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 10.28% (0.3940 => 0.4345, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1413 => 0.1549, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.09% (3.9660 => 4.3264, std. dev.: 0.0093) MultiSource/Applications/hbd/hbd: 9.08% (1.3693 => 1.4936, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.70% (0.5265 => 0.5723, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.38% (0.9199 => 0.9970, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.34% (0.2781 => 0.3013, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.18% (0.7038 => 0.7614, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.14% (1.2193 => 1.3185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.05% (0.2782 => 0.3006, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.99% (0.1327 => 0.1433, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.97% (1.4563 => 1.5724, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.90% (0.2721 => 0.2936, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.87% (0.6959 => 0.7507, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2760 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2655 => 0.2861, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.73% (1.1364 => 1.2242, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.69% (1.9828 => 2.1353, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 7.65% (13.8202 => 14.8769, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2607 => 0.2805, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3756 => 0.4041, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.58% (0.7506 => 0.8075, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.56% (0.4390 => 0.4722, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.56% (0.3293 => 0.3542, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.51% (0.3899 => 0.4192, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/random: 7.51% (0.2690 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.50% (0.5577 => 0.5995, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.46% (0.2628 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.2988 => 0.3209, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2765 => 0.2969, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.30% (0.1589 => 0.1705, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.20% (0.4016 => 0.4305, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.20% (0.2696 => 0.2890, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (7.2180 => 7.7337, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.3246 => 0.3472, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.95% (0.3192 => 0.3414, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.89% (0.4791 => 0.5121, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3453 => 0.3689, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.72% (1.0313 => 1.1006, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.71% (0.5637 => 0.6015, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (13.2842 => 14.1734, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.51% (0.2995 => 0.3190, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 6.40% (0.8310 => 0.8842, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.38% (1.3819 => 1.4700, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.37% (0.6283 => 0.6683, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.34% (1.1061 => 1.1762, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.32% (1.3813 => 1.4686, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 6.30% (0.3220 => 0.3423, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.2925 => 0.3108, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 6.20% (3.8646 => 4.1041, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 6.20% (0.2243 => 0.2382, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2140 => 0.2271, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.99% (0.7460 => 0.7907, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 5.94% (1.9270 => 2.0414, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.89% (1.3245 => 1.4025, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 5.78% (0.6744 => 0.7134, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (3.6692 => 3.8807, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 5.74% (0.4113 => 0.4349, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.70% (3.1889 => 3.3707, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 5.66% (2.1791 => 2.3025, std. dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 5.63% (1.2749 => 1.3467, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.57% (0.8818 => 0.9309, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.43% (1.0594 => 1.1169, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (4.3801 => 4.6155, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (4.4433 => 4.6788, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.6135 => 0.6459, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.28% (0.8698 => 0.9157, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.16% (16.6129 => 17.4708, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2714, std. dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 5.08% (14.8535 => 15.6075, std. dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 4.98% (0.3131 => 0.3287, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.77% (1.2292 => 1.2878, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.75% (1.1333 => 1.1871, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.74% (8.4961 => 8.8989, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 4.72% (0.2859 => 0.2994, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.71% (0.3245 => 0.3398, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.36% (4.6629 => 4.8664, std. dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (6.5754 => 6.8527, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4805 => 0.5000, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (3.2742 => 3.4002, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 3.72% (16.2614 => 16.8656, std. dev.: 0.0229) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1627, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.52% (0.6250 => 0.6470, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.46% (1.5188 => 1.5714, std. dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.1007 => 2.1714, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.29% (0.9108 => 0.9408, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.13% (3.7467 => 3.8638, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 2.70% (33.2944 => 34.1937, std. dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (6.2785 => 6.4323, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std. dev.: 0.0496) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (3.1736 => 3.4183, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.12% (1.1560 => 1.2267, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.05% (1.2998 => 1.3784, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.2619 => 11.7346, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.62% (10.7476 => 11.1371, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5923, std. dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.96% (1.5824 => 1.6134, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5923, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.97% (0.4657 => 0.4053, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.92% (22.5627 => 21.4536, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2716, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1490, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std. dev.: 0.0120) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9237, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5959, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.09% (26.5159 => 25.9615, std. dev.: 0.0199) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2504, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2149, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5365, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 07:54:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 09:54:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905145433.D3D6A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3436?compare_to=3432&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3436, Order: 163212, Start Time: 2012-09-05 13:36:27, End Time: 2012-09-05 14:55:43 To: 3432, Order: 163208, Start Time: 2012-09-05 11:49:00, End Time: 2012-09-05 13:08:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (717 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.56% (3.7778 => 3.8366, std. dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.30% (10.3673 => 13.6122, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 15.58% (0.3473 => 0.4014, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.41% (0.3543 => 0.4089, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 15.24% (0.3516 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.24% (0.3497 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.16% (0.3543 => 0.4080, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.14% (0.3561 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3694 => 0.4238, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 14.37% (0.3828 => 0.4378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3927 => 0.4487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.02% (0.3886 => 0.4431, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (0.1622 => 0.1800, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.84% (1.1194 => 1.2407, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.66% (1.7609 => 1.9486, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.91% (2.2022 => 2.3985, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.23% (0.3817 => 0.4093, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.17% (0.7835 => 0.8397, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.8172 => 0.8744, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7326 => 0.7828, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.4615 => 0.4929, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7433 => 0.7917, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.44% (0.3307 => 0.3520, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.44% (0.7115 => 0.7573, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.40% (0.3282 => 0.3492, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (4.2646 => 4.5334, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.24% (10.4361 => 11.0875, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.5860 => 0.6224, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.18% (9.4845 => 10.0710, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.16% (8.1363 => 8.6377, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.08% (0.3423 => 0.3631, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.5415 => 1.6335, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.92% (1.3050 => 1.3823, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (7.0540 => 7.4715, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (0.3121 => 0.3304, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.84% (0.2603 => 0.2755, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.84% (3.3354 => 3.5301, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.82% (0.5105 => 0.5402, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.9449 => 5.2284, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.68% (5.0018 => 5.2857, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9765 => 1.0304, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.30% (1.5603 => 1.6430, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.22% (0.2700 => 0.2841, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.16% (1.1642 => 1.2243, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 5.16% (5.7591 => 6.0561, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.10% (0.5020 => 0.5276, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.09% (0.8067 => 0.8478, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.3180 => 0.3342, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6675 => 0.7015, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 5.04% (3.8723 => 4.0676, std. dev.: 0.0161) MultiSource/Applications/treecc/treecc: 4.98% (2.0273 => 2.1282, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.97% (1.1861 => 1.2451, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (14.3668 => 15.0802, std. dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.94% (0.3441 => 0.3611, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 4.85% (0.3092 => 0.3242, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.80% (1.0722 => 1.1237, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.61% (0.4103 => 0.4292, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4636 => 0.4846, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6450 => 0.6738, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.46% (0.3387 => 0.3538, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.43% (2.2969 => 2.3987, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 4.38% (0.6456 => 0.6739, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.4064 => 0.4237, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8921 => 0.9299, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.88% (1.4186 => 1.4736, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3826 => 0.3974, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.85% (0.4620 => 0.4798, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.4289 => 0.4453, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6464, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3603 => 0.3737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.71% (0.4048 => 0.4198, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.70% (0.3136 => 0.3252, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.3098 => 0.3211, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (2.0665 => 2.1412, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (0.3935 => 0.4077, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.60% (2.2024 => 2.2817, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3162 => 0.3275, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.53% (0.3684 => 0.3814, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.41% (0.3283 => 0.3395, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.41% (17.1811 => 17.7662, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1840 => 1.2185, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.61% (1.2842 => 1.3177, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.8101 => 0.8273, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.11% (7.9617 => 8.1297, std. dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 1.96% (21.9371 => 22.3663, std. dev.: 0.0259) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (3.1578 => 3.3838, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 4.60% (1.1396 => 1.1920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (4.2280 => 4.3663, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7584, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (1.3045 => 1.3266, std. dev.: 0.0029) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7781 => 3.8366, std. dev.: 0.0165) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2465, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7618, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.69% (5.2763 => 3.1823, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.80% (5.3855 => 3.7265, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7190, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1392, std. dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5439, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -8.40% (22.1758 => 20.3120, std. dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (19.9488 => 18.2342, std. dev.: 0.1737) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.25% (1.8329 => 1.7183, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std. dev.: 0.0018) MultiSource/Applications/siod/siod: -4.08% (3.2827 => 3.1489, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.97% (1.6805 => 1.6138, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5085, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -3.04% (1.2373 => 1.1997, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4228, std. dev.: 0.0293) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9817, std. dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9651, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1880, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5067, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 09:23:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 11:23:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905162354.04BE22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3437?compare_to=3433&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3437, Order: 163212, Start Time: 2012-09-05 13:41:09, End Time: 2012-09-05 16:25:03 To: 3433, Order: 163206, Start Time: 2012-09-05 10:29:17, End Time: 2012-09-05 13:13:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.87% (127.1455 => 129.5256, std. dev.: 0.7320) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 16.02% (0.3446 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 16.01% (0.3442 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.96% (0.3465 => 0.4018, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.91% (0.3488 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.88% (0.3496 => 0.4051, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.87% (0.3460 => 0.4009, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.80% (0.3469 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.29% (0.3643 => 0.4200, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 15.21% (0.3650 => 0.4205, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.93% (0.3724 => 0.4280, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.30% (0.5826 => 0.6368, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.20% (0.1620 => 0.1769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.10% (0.5889 => 0.6425, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (3.5627 => 3.8404, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.54% (1.6211 => 1.7433, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7171 => 0.7707, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.26% (1.3152 => 1.4107, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.04% (0.4361 => 0.4668, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.5900 => 0.6310, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 6.82% (1.5932 => 1.7018, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 6.55% (0.4029 => 0.4293, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.52% (0.5000 => 0.5326, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.44% (0.3930 => 0.4183, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.38% (0.3792 => 0.4034, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (0.5026 => 0.5346, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 6.19% (4.2109 => 4.4716, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.00% (2.7292 => 2.8930, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.3004 => 0.3182, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.90% (1.0781 => 1.1417, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.88% (0.2875 => 0.3044, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.77% (0.2736 => 0.2894, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2823 => 0.2985, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.60% (1.9694 => 2.0796, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.58% (1.9966 => 2.1081, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.2866 => 0.3026, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.52% (0.4658 => 0.4915, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.52% (0.2792 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3195 => 0.3371, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.48% (5.5417 => 5.8455, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2738 => 0.2888, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.44% (0.2813 => 0.2966, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.34% (0.9909 => 1.0438, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.31% (2.1013 => 2.2129, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2780 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.27% (0.2750 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.27% (0.2811 => 0.2959, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.23% (2.0673 => 2.1754, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.22% (0.3890 => 0.4093, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2803 => 0.2949, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2911 => 0.3062, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.17% (0.3096 => 0.3256, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.07% (0.2566 => 0.2696, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.07% (0.3060 => 0.3215, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3267 => 0.3432, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.00% (0.3317 => 0.3483, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.00% (0.3282 => 0.3446, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 4.99% (1.8794 => 1.9731, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 4.94% (0.3258 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.3625 => 0.3804, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.93% (0.3124 => 0.3278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3726 => 0.3909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.84% (0.3678 => 0.3856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.84% (0.3348 => 0.3510, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.78% (0.4139 => 0.4337, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.77% (0.3477 => 0.3643, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.77% (0.3903 => 0.4089, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (4.4195 => 4.6274, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (2.1653 => 2.2660, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 4.64% (4.6177 => 4.8320, std. dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 4.54% (23.5202 => 24.5881, std. dev.: 0.0292) MultiSource/Applications/lua/lua: 4.53% (1.4269 => 1.4916, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.52% (0.3981 => 0.4161, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3690 => 0.3854, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.39% (0.7875 => 0.8221, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.39% (0.4146 => 0.4328, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (0.4251 => 0.4437, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.33% (0.9697 => 1.0117, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.27% (0.2737 => 0.2854, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.11% (0.3845 => 0.4003, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.09% (0.6634 => 0.6905, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.2969 => 0.3090, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.79% (0.5012 => 0.5202, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.69% (0.3336 => 0.3459, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.6435 => 0.6665, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.53% (2.0346 => 2.0861, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (0.7426 => 0.7558, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.36% (11.6398 => 11.7985, std. dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.31% (4.6926 => 4.7543, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: 1.10% (2.4764 => 2.5037, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6799, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1636, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6317, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std. dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5030, std. dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4422, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2795, std. dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5850, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4450, std. dev.: 0.0796) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5302, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary2: -10.57% (0.2402 => 0.2148, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7820, std. dev.: 0.0179) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.77% (11.2080 => 10.7860, std. dev.: 0.0189) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.15% (0.6293 => 0.6158, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -1.96% (17.2379 => 16.9001, std. dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9714, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 10:37:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 12:37:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905173717.808762A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3438?compare_to=3434&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3438, Order: 163214, Start Time: 2012-09-05 16:26:54, End Time: 2012-09-05 17:38:28 To: 3434, Order: 163212, Start Time: 2012-09-05 12:34:42, End Time: 2012-09-05 13:45:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (44 on baseline) Performance Improvements: 5 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.14% (4.7603 => 4.8621, std. dev.: 0.0111) MultiSource/Applications/lemon/lemon: 1.39% (1.0320 => 1.0463, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.91% (1.3255 => 1.4171, std. dev.: 0.0125) MultiSource/Benchmarks/FreeBench/distray/distray: 4.61% (0.2495 => 0.2610, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (41.5786 => 43.1283, std. dev.: 0.5283) MultiSource/Applications/minisat/minisat: 2.30% (6.2230 => 6.3660, std. dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/sieve: 1.65% (3.8074 => 3.8702, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 1.00% (8.6628 => 8.7497, std. dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -10.52% (3.5755 => 3.1995, std. dev.: 0.1399) SingleSource/Benchmarks/Shootout/ary3: -3.26% (2.0641 => 1.9969, std. dev.: 0.0246) MultiSource/Benchmarks/llubenchmark/llu: -2.24% (2.0507 => 2.0048, std. dev.: 0.0143) SingleSource/Benchmarks/McGill/chomp: -1.39% (1.1004 => 1.0851, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: -1.38% (6.9204 => 6.8246, std. dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 4.15% (1.0046 => 1.0463, std. dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3.19% (1.1653 => 1.2025, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 2.72% (0.6173 => 0.6341, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 2.46% (4.7455 => 4.8621, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (12.6413 => 12.8694, std. dev.: 0.0816) MultiSource/Applications/d/make_dparser: 1.80% (3.0225 => 3.0770, std. dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 1.31% (13.3238 => 13.4979, std. dev.: 0.0573) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std. dev.: 0.0246) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.09% (4.0101 => 4.5351, std. dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 12.49% (3.4406 => 3.8702, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: 12.15% (0.4296 => 0.4818, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.56% (0.0917 => 0.1023, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1039, std. dev.: 0.0340) SingleSource/Benchmarks/Stanford/Puzzle: 10.19% (0.1433 => 0.1579, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 9.14% (7.0025 => 7.6424, std. dev.: 0.0875) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.98% (0.2694 => 0.2936, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/methcall: 6.78% (8.5566 => 9.1370, std. dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/hash2: 6.55% (3.4876 => 3.7161, std. dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.54% (40.4792 => 43.1283, std. dev.: 0.5283) SingleSource/Benchmarks/McGill/chomp: 6.44% (1.0194 => 1.0851, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3301 => 0.3505, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7430, std. dev.: 0.0265) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.49% (1.0063 => 1.0615, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/fp-convert: 4.56% (15.2242 => 15.9191, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.77% (3.4080 => 3.5365, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8714, std. dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.84% (0.5876 => 0.6043, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/five11/five11: 2.56% (5.1938 => 5.3266, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/ReedSolomon: 2.42% (8.5113 => 8.7175, std. dev.: 0.0722) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.42% (4.6127 => 4.7242, std. dev.: 0.0163) MultiSource/Applications/minisat/minisat: 2.27% (6.2244 => 6.3660, std. dev.: 0.0432) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.76% (2.4455 => 2.4885, std. dev.: 0.0164) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.34% (4.0659 => 4.1203, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (2.4971 => 2.5300, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.20% (14.4877 => 14.6611, std. dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 1.17% (6.7458 => 6.8246, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.08% (2.9152 => 2.9467, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (4.6414 => 4.6901, std. dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.74% (0.7784 => 0.7337, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: -3.43% (0.3847 => 0.3715, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.18% (0.5740 => 0.5615, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.15% (1.2742 => 1.2468, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: -1.90% (0.7738 => 0.7591, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.66% (4.2815 => 4.2104, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.46% (0.9029 => 0.8897, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.42% (4.3380 => 4.2765, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.21% (1.4189 => 1.4018, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.41% (5.2665 => 4.1389, std. dev.: 0.1267) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.69% (1.1647 => 0.9936, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std. dev.: 0.0343) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.20% (1.4034 => 1.2883, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.80% (3.2007 => 2.9512, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3516, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: -6.20% (1.6538 => 1.5513, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -5.41% (9.2503 => 8.7497, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/fibo: -5.04% (4.6355 => 4.4019, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.72% (1.7361 => 1.6542, std. dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (3.9413 => 3.7667, std. dev.: 0.0409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.05% (3.7496 => 3.6353, std. dev.: 0.0371) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4562, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2877, std. dev.: 0.0094) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.62% (1.2722 => 1.2389, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.45% (1.1683 => 1.1397, std. dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -2.33% (92.7467 => 90.5847, std. dev.: 0.6496) MultiSource/Benchmarks/FreeBench/neural/neural: -1.98% (1.0926 => 1.0710, std. dev.: 0.0036) MultiSource/Applications/siod/siod: -1.91% (3.5520 => 3.4843, std. dev.: 0.0169) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.74% (2.8964 => 2.8460, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2256, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7655, std. dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.3569 => 2.3239, std. dev.: 0.0108) MultiSource/Benchmarks/sim/sim: -1.35% (3.8907 => 3.8382, std. dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.02% (1.0686 => 1.0577, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 10:52:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 12:52:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905175218.5035B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3439?compare_to=3435&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3439, Order: 163214, Start Time: 2012-09-05 16:38:59, End Time: 2012-09-05 17:53:26 To: 3435, Order: 163212, Start Time: 2012-09-05 12:47:47, End Time: 2012-09-05 14:02:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (78.0401 => 80.5624, std. dev.: 0.1413) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.09% (2.0176 => 2.4027, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.75% (0.1410 => 0.1618, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.99% (0.3578 => 0.4007, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.97% (0.3601 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.81% (0.5818 => 0.6505, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.75% (0.3650 => 0.4079, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3646 => 0.4074, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3663 => 0.4089, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.62% (0.5748 => 0.6416, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3623 => 0.4044, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.54% (0.7061 => 0.7876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3914 => 0.4363, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.43% (0.3789 => 0.4222, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.29% (0.4003 => 0.4455, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.19% (0.3940 => 0.4381, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.34% (0.7710 => 0.8507, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (3.9660 => 4.3439, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.14% (1.3693 => 1.4944, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5265 => 0.5731, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.71% (0.4328 => 0.4705, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.41% (1.2193 => 1.3218, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.37% (0.9199 => 0.9969, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 8.24% (0.7038 => 0.7618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.23% (0.6959 => 0.7532, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.98% (0.2721 => 0.2938, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.91% (1.4563 => 1.5715, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1327 => 0.1431, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.79% (1.1364 => 1.2249, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.72% (13.8202 => 14.8873, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5577 => 0.6007, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.70% (0.7506 => 0.8084, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.3756 => 0.4045, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3899 => 0.4198, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.65% (0.3293 => 0.3545, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.47% (1.9828 => 2.1310, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4390 => 0.4715, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.37% (0.2726 => 0.2927, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (7.2180 => 7.7501, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2761 => 0.2963, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.17% (0.4016 => 0.4304, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3107 => 0.3329, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.12% (0.1588 => 0.1701, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.99% (0.2988 => 0.3197, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.4791 => 0.5125, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.97% (0.1435 => 0.1535, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.95% (0.3192 => 0.3414, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std. dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5637 => 0.6024, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 6.83% (1.0313 => 1.1017, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.80% (13.2842 => 14.1880, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3534 => 0.3770, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.64% (1.1061 => 1.1795, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 6.55% (0.8310 => 0.8854, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.51% (0.2995 => 0.3190, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3220 => 0.3424, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.6283 => 0.6680, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 6.29% (3.8646 => 4.1076, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 6.15% (0.2945 => 0.3126, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.12% (1.3819 => 1.4665, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.08% (1.9270 => 2.0441, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.05% (0.7460 => 0.7911, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.01% (1.3245 => 1.4041, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (1.3813 => 1.4642, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 5.95% (0.6744 => 0.7145, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 5.87% (3.1889 => 3.3762, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4113 => 0.4354, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.84% (1.2749 => 1.3494, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.83% (3.6692 => 3.8830, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.76% (0.8818 => 0.9326, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 5.75% (2.1791 => 2.3043, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6941, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (4.3801 => 4.6270, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.55% (0.2504 => 0.2643, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.52% (1.0594 => 1.1179, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (0.8698 => 0.9174, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.34% (16.6129 => 17.5006, std. dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.6135 => 0.6461, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 5.13% (14.8535 => 15.6161, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2692, std. dev.: 0.0141) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.93% (0.2859 => 0.3000, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.1333 => 1.1891, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.90% (8.4961 => 8.9126, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2292 => 1.2887, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.24% (6.5754 => 6.8545, std. dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 4.23% (4.6629 => 4.8601, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.4805 => 0.5002, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.83% (16.2614 => 16.8846, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.83% (3.2742 => 3.3996, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.69% (4.9865 => 5.1704, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 3.58% (0.6250 => 0.6474, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.47% (0.9108 => 0.9424, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.38% (2.1007 => 2.1717, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.28% (1.5188 => 1.5686, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 3.24% (3.7467 => 3.8682, std. dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.80% (6.2785 => 6.4546, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.58% (33.2944 => 34.1526, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 25.49% (1.8175 => 2.2808, std. dev.: 0.0359) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4161, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.08% (1.1560 => 1.2263, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 3.54% (10.7476 => 11.1282, std. dev.: 0.0508) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5883, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5160, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.15% (1.4298 => 1.4463, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.37% (0.4657 => 0.4081, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.82% (22.5627 => 21.4758, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2594, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9250, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.8259 => 8.5751, std. dev.: 0.0166) MultiSource/Benchmarks/Olden/bh/bh: -2.81% (1.9762 => 1.9206, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -2.10% (26.5159 => 25.9581, std. dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2414, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2145, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5350, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2400, std. dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 10:57:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 12:57:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905175704.171752A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3440?compare_to=3436&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3440, Order: 163214, Start Time: 2012-09-05 16:38:59, End Time: 2012-09-05 17:58:13 To: 3436, Order: 163212, Start Time: 2012-09-05 13:36:27, End Time: 2012-09-05 14:55:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.51% (28.4238 => 29.7069, std. dev.: 0.0338) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (13.6122 => 13.4548, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.78% (10.3673 => 13.4548, std. dev.: 0.0095) SingleSource/UnitTests/ObjC/trivial-interface: 15.26% (0.3473 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.07% (0.3543 => 0.4077, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 15.07% (0.3497 => 0.4024, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 14.99% (0.3543 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.85% (0.3516 => 0.4038, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 14.77% (0.3561 => 0.4087, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.32% (0.3694 => 0.4223, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.93% (0.3927 => 0.4474, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.92% (0.3828 => 0.4361, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 13.69% (0.3886 => 0.4418, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.82% (1.1194 => 1.2405, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.42% (0.1622 => 0.1791, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.33% (1.7609 => 1.9428, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (2.2022 => 2.3931, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.8172 => 0.8774, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.3177 => 0.3398, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.86% (0.3817 => 0.4079, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 6.76% (10.4361 => 11.1411, std. dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.60% (0.3121 => 0.3327, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 6.49% (0.3282 => 0.3495, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.44% (0.4615 => 0.4912, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.34% (0.2271 => 0.2415, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.29% (0.3307 => 0.3515, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2758 => 0.2928, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.15% (0.7835 => 0.8317, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: 6.11% (0.7115 => 0.7550, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.89% (0.5569 => 0.5897, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2107 => 0.2231, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 5.85% (0.3109 => 0.3291, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (4.2646 => 4.5142, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (8.1363 => 8.6114, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 5.83% (0.7433 => 0.7866, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (9.4845 => 10.0346, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.77% (0.5860 => 0.6198, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.70% (1.5415 => 1.6293, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.66% (0.4879 => 0.5155, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.60% (7.0540 => 7.4489, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 5.52% (0.2554 => 0.2695, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.49% (4.9449 => 5.2163, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.41% (0.5105 => 0.5381, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (1.3050 => 1.3754, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (5.0018 => 5.2702, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.17% (3.3354 => 3.5079, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.17% (0.4103 => 0.4315, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4299 => 0.4517, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9765 => 1.0256, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.8067 => 0.8472, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 4.97% (0.3180 => 0.3338, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.86% (5.7591 => 6.0391, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1861 => 1.2435, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.81% (0.6675 => 0.6996, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.78% (0.5020 => 0.5260, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2700 => 0.2828, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.70% (1.1642 => 1.2189, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3422 => 0.3579, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (14.3668 => 15.0250, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 4.56% (0.3092 => 0.3233, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.53% (1.5603 => 1.6310, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4636 => 0.4844, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.4064 => 0.4242, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3162 => 0.3298, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 4.26% (3.8723 => 4.0371, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.18% (0.3826 => 0.3986, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4289 => 0.4468, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2905 => 0.3026, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.16% (2.0273 => 2.1117, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 4.10% (1.0722 => 1.1162, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.08% (0.2891 => 0.3009, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.07% (0.3387 => 0.3525, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.00% (0.6450 => 0.6708, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 3.95% (0.4048 => 0.4208, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3865 => 0.4017, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4203 => 0.4364, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (2.0665 => 2.1451, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.70% (0.2756 => 0.2858, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.70% (1.4186 => 1.4711, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.5981 => 0.6202, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.69% (0.3603 => 0.3736, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (0.8921 => 0.9250, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.59% (0.4620 => 0.4786, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.52% (2.2969 => 2.3778, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 3.51% (0.2877 => 0.2978, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.50% (0.3283 => 0.3398, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.29% (1.5859 => 1.6381, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3379 => 0.3486, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (2.2024 => 2.2694, std. dev.: 0.0215) MultiSource/Applications/sqlite3/sqlite3: 3.04% (17.1811 => 17.7028, std. dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.1840 => 1.2126, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.35% (1.2842 => 1.3144, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.8101 => 0.8255, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.71% (21.9371 => 22.3122, std. dev.: 0.0198) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.69% (7.9617 => 8.0965, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3842, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.1396 => 1.1921, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (4.2280 => 4.3643, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2284, std. dev.: 0.0191) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.22% (6.5088 => 6.5881, std. dev.: 0.0083) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7618, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.72% (5.2763 => 3.1804, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.05% (5.3855 => 3.7135, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7060, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1039, std. dev.: 0.0412) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.56% (2.9384 => 2.5400, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -8.82% (22.1758 => 20.2204, std. dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4186, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.74% (19.9488 => 18.4054, std. dev.: 0.1020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (1.8329 => 1.7177, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0029) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1490, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.97% (1.6805 => 1.6138, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5077, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4124, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9964, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -2.63% (1.2373 => 1.2047, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9590, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1858, std. dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4191, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2290, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8555, std. dev.: 0.0204) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 12:04:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 14:04:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905190449.24B1F2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3441?compare_to=3438&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3441, Order: 163220, Start Time: 2012-09-05 17:54:05, End Time: 2012-09-05 19:05:58 To: 3438, Order: 163214, Start Time: 2012-09-05 16:26:54, End Time: 2012-09-05 17:38:28 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (39 on baseline) Performance Improvements: 1 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (823 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.74% (0.2017 => 0.2153, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (1.0625 => 1.0809, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.15% (1.1993 => 1.2131, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.34% (13.9321 => 16.2087, std. dev.: 0.7069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.39% (21.3003 => 22.4479, std. dev.: 0.3752) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.58% (2.6655 => 2.7608, std. dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.39% (1.0615 => 1.0869, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.58% (1.6542 => 1.6804, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/five11/five11: 1.34% (5.3266 => 5.3978, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.22% (1.4171 => 1.3289, std. dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.64% (2.1763 => 2.2772, std. dev.: 0.0284) MultiSource/Applications/SIBsim4/SIBsim4: 3.27% (1.1653 => 1.2034, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (12.6413 => 12.9096, std. dev.: 0.0864) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.5150 => 1.5456, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.11% (0.0766 => 0.0943, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 15.08% (1.7426 => 2.0054, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.09% (4.0101 => 4.5751, std. dev.: 0.0261) SingleSource/Benchmarks/McGill/misr: 13.71% (0.4296 => 0.4885, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 13.56% (0.3746 => 0.4254, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.30% (0.0917 => 0.1039, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 12.11% (3.4406 => 3.8572, std. dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 10.66% (62.4126 => 69.0628, std. dev.: 0.0475) SingleSource/Benchmarks/Stanford/Puzzle: 10.26% (0.1433 => 0.1580, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.65% (0.2694 => 0.2954, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.6001, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.01% (1.0063 => 1.0869, std. dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 7.63% (1.0194 => 1.0972, std. dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.06% (0.3301 => 0.3534, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/methcall: 6.66% (8.5566 => 9.1267, std. dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (3.4876 => 3.7164, std. dev.: 0.0201) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7518, std. dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.61% (40.4792 => 42.3456, std. dev.: 0.3488) SingleSource/Benchmarks/Misc/dt: 4.61% (0.9851 => 1.0305, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.23% (15.2242 => 15.8682, std. dev.: 0.0277) MultiSource/Benchmarks/BitBench/five11/five11: 3.93% (5.1938 => 5.3978, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0297) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.57% (2.6656 => 2.7608, std. dev.: 0.0167) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.35% (2.4042 => 2.4847, std. dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.57% (0.5876 => 0.6027, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7245, std. dev.: 0.0647) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4455 => 2.4829, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5323, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6759, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6936, std. dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: 1.10% (2.4013 => 2.4278, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.32% (0.3497 => 0.2052, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.30% (5.2665 => 4.1445, std. dev.: 0.2412) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.04% (1.1647 => 0.9895, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.73% (1.4034 => 1.2809, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -7.12% (1.4441 => 1.3413, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -6.52% (9.2503 => 8.6473, std. dev.: 0.1501) SingleSource/Benchmarks/Misc/pi: -6.19% (1.6538 => 1.5514, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.22% (1.4021 => 1.3289, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4067, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7618, std. dev.: 0.0194) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.21% (1.7361 => 1.6804, std. dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.92% (1.2722 => 1.2351, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1360, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std. dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.63% (3.7496 => 3.6510, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.29% (2.4457 => 2.3896, std. dev.: 0.0195) MultiSource/Benchmarks/PAQ8p/paq8p: -2.23% (92.7467 => 90.6804, std. dev.: 0.3806) MultiSource/Applications/siod/siod: -2.11% (3.5520 => 3.4771, std. dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.59% (3.4286 => 3.3740, std. dev.: 0.0158) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2395, std. dev.: 0.0256) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.42% (2.8964 => 2.8554, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3094, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7695, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/lists: -1.06% (16.5617 => 16.3856, std. dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 12:34:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 14:34:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905193454.D6BF52A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3442?compare_to=3439&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3442, Order: 163222, Start Time: 2012-09-05 18:21:37, End Time: 2012-09-05 19:36:03 To: 3439, Order: 163214, Start Time: 2012-09-05 16:38:59, End Time: 2012-09-05 17:53:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (166 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.38% (2.1310 => 2.1604, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.2887 => 1.3018, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.84% (2.0176 => 2.3977, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.65% (0.5818 => 0.6554, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: 12.49% (0.5748 => 0.6466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.22% (0.7061 => 0.7924, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 12.19% (0.3578 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.89% (0.3601 => 0.4029, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.79% (0.3646 => 0.4076, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3663 => 0.4093, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.70% (0.3650 => 0.4077, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.68% (0.3623 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3789 => 0.4227, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3914 => 0.4365, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 11.19% (0.4003 => 0.4451, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.12% (0.3940 => 0.4378, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.32% (0.7710 => 0.8506, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.92% (1.3693 => 1.5051, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.78% (0.2781 => 0.3053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.70% (0.4328 => 0.4748, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 9.60% (0.4062 => 0.4452, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (3.9660 => 4.3439, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.49% (0.2782 => 0.3046, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 9.17% (0.3293 => 0.3595, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.13% (0.2607 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2655 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.06% (0.2628 => 0.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.03% (0.2690 => 0.2933, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.00% (0.3899 => 0.4250, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.00% (0.3022 => 0.3294, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.98% (0.2761 => 0.3009, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.96% (1.9828 => 2.1604, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 8.95% (0.2937 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.93% (0.5265 => 0.5735, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 8.91% (0.2760 => 0.3006, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.88% (0.2726 => 0.2968, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.87% (0.2966 => 0.3229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.86% (0.2765 => 0.3010, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.80% (0.3489 => 0.3796, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.78% (0.3485 => 0.3791, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.75% (0.4390 => 0.4774, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.73% (0.3756 => 0.4084, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.70% (1.2193 => 1.3254, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 8.66% (0.3107 => 0.3376, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.65% (0.3192 => 0.3468, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.61% (0.2696 => 0.2928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.57% (0.7038 => 0.7641, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 8.54% (0.3149 => 0.3418, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.46% (0.3580 => 0.3883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.44% (0.4016 => 0.4355, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.2721 => 0.2948, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.2988 => 0.3237, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.32% (0.3868 => 0.4190, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.25% (0.3453 => 0.3738, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.6959 => 0.7527, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.04% (0.3534 => 0.3818, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.03% (1.1364 => 1.2277, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.00% (0.1588 => 0.1715, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.99% (1.4563 => 1.5727, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 7.91% (0.7506 => 0.8100, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.87% (13.8202 => 14.9078, std. dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.76% (0.4379 => 0.4719, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 7.74% (0.2945 => 0.3173, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.71% (7.2180 => 7.7748, std. dev.: 0.0092) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.67% (0.5577 => 0.6005, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.4791 => 0.5153, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5637 => 0.6035, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.99% (0.6283 => 0.6722, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.98% (1.0313 => 1.1033, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.97% (0.1865 => 0.1995, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.91% (0.2995 => 0.3202, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.77% (0.2925 => 0.3123, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 6.71% (0.8310 => 0.8868, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3220 => 0.3436, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (13.2842 => 14.1735, std. dev.: 0.0323) MultiSource/Applications/Burg/burg: 6.60% (1.1061 => 1.1791, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.58% (0.3755 => 0.4002, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.57% (3.8646 => 4.1186, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.3245 => 1.4096, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 6.38% (1.9270 => 2.0500, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.30% (0.7460 => 0.7930, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 6.27% (0.6744 => 0.7167, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.24% (0.8698 => 0.9241, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.24% (3.6692 => 3.8980, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 6.19% (3.1889 => 3.3863, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.15% (1.3813 => 1.4663, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (1.3819 => 1.4669, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (1.2749 => 1.3520, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 5.96% (2.1791 => 2.3089, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.91% (1.2292 => 1.3018, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.89% (1.0594 => 1.1218, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.3801 => 4.6378, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.87% (4.4433 => 4.7039, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.6135 => 0.6491, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.72% (16.6129 => 17.5629, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.64% (0.8818 => 0.9315, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.62% (14.8535 => 15.6886, std. dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.21% (8.4961 => 8.9384, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.2859 => 0.3006, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (1.1333 => 1.1912, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 5.08% (14.5298 => 15.2684, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.4805 => 0.5029, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.58% (0.6250 => 0.6536, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (6.5754 => 6.8715, std. dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: 4.24% (4.6629 => 4.8604, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.19% (4.9865 => 5.1954, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.06% (0.9108 => 0.9478, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.06% (3.2742 => 3.4070, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 3.90% (16.2614 => 16.8959, std. dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5188 => 1.5737, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.38% (2.1007 => 2.1716, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 3.37% (3.7467 => 3.8728, std. dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.19% (6.2785 => 6.4790, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.07% (33.2944 => 34.3180, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.05% (1.0895 => 1.3515, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.1560 => 1.2270, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.04% (1.2998 => 1.3783, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.90% (2.8606 => 3.0007, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.59% (1.9144 => 2.0023, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7341, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.72% (10.7476 => 11.1475, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6051, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.99% (1.5824 => 1.6139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0072) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5720, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5886, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.37% (0.4657 => 0.4081, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.68% (22.5627 => 21.5061, std. dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.53% (0.2670 => 0.2549, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2531, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.93% (1.3780 => 1.3238, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1492, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.31% (3.0263 => 2.9260, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6029, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -2.07% (26.5159 => 25.9680, std. dev.: 0.0366) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2442, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2140, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -1.21% (4.5928 => 4.5372, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.5254 => 2.4967, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 12:35:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 14:35:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905193538.B74C02A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3443?compare_to=3437&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3443, Order: 163214, Start Time: 2012-09-05 16:53:20, End Time: 2012-09-05 19:36:48 To: 3437, Order: 163212, Start Time: 2012-09-05 13:41:09, End Time: 2012-09-05 16:25:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.2091 => 0.2243, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 16.04% (0.3460 => 0.4015, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 15.98% (0.3442 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.96% (0.3496 => 0.4054, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.96% (0.3446 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.96% (0.3465 => 0.4018, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.85% (0.3488 => 0.4041, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.77% (0.3469 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.34% (0.3650 => 0.4210, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 15.23% (0.3643 => 0.4198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.88% (0.3724 => 0.4278, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5826 => 0.6358, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.5889 => 0.6419, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.89% (0.1620 => 0.1764, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (3.5627 => 3.8266, std. dev.: 0.0094) SingleSource/UnitTests/ObjC++/property-reference: 7.31% (0.7171 => 0.7695, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (1.6211 => 1.7368, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 6.87% (1.5932 => 1.7027, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.83% (1.3152 => 1.4050, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 6.55% (0.4029 => 0.4293, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.54% (0.3792 => 0.4040, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.5900 => 0.6284, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.37% (0.4994 => 0.5312, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.33% (0.5026 => 0.5344, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (0.4361 => 0.4632, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (0.5000 => 0.5307, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 6.02% (4.2109 => 4.4642, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (2.7292 => 2.8889, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 5.68% (1.0781 => 1.1393, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2875 => 0.3035, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.48% (0.2866 => 0.3023, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (2.0673 => 2.1785, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 5.33% (0.9909 => 1.0437, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (1.9694 => 2.0733, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.27% (0.2714 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2738 => 0.2882, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.19% (0.2813 => 0.2959, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.18% (5.5417 => 5.8290, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 5.10% (0.2803 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.09% (0.2792 => 0.2934, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.98% (0.2911 => 0.3056, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.93% (0.2780 => 0.2917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.91% (0.2811 => 0.2949, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 4.88% (0.3096 => 0.3247, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.87% (0.3060 => 0.3209, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (0.4658 => 0.4884, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (1.9966 => 2.0933, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.79% (0.3362 => 0.3523, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.77% (0.3124 => 0.3273, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3317 => 0.3473, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.63% (0.3348 => 0.3503, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (2.1013 => 2.1980, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 4.56% (0.3267 => 0.3416, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.3903 => 0.4081, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.49% (0.3477 => 0.3633, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (1.8794 => 1.9635, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 4.46% (4.6177 => 4.8235, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3726 => 0.3892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.45% (0.3258 => 0.3403, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.4139 => 0.4322, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.37% (2.1653 => 2.2599, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (4.4195 => 4.6120, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.3625 => 0.3782, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.32% (0.3845 => 0.4011, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3282 => 0.3423, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.30% (0.3678 => 0.3836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3690 => 0.3846, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.22% (0.7875 => 0.8207, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.21% (23.5202 => 24.5109, std. dev.: 0.0176) MultiSource/Applications/siod/siod: 4.19% (0.6634 => 0.6912, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 4.11% (1.4269 => 1.4856, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.11% (0.5546 => 0.5774, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.10% (0.9697 => 1.0095, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.00% (0.4146 => 0.4312, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3.98% (0.2691 => 0.2798, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.97% (0.3981 => 0.4139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4251 => 0.4419, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.3084 => 0.3188, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.36% (0.3336 => 0.3448, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.19% (0.6435 => 0.6640, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.15% (0.5012 => 0.5170, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.98% (2.0346 => 2.0748, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6669, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8976, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6507, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2094, std. dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5058, std. dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4532, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5119, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5825, std. dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4574, std. dev.: 0.1045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5673, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7845, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8015, std. dev.: 0.0023) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7781, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.46% (0.6293 => 0.6138, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9617, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5023, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 12:44:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 14:44:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905194451.C6DF02A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3444?compare_to=3440&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3444, Order: 163222, Start Time: 2012-09-05 18:26:31, End Time: 2012-09-05 19:46:01 To: 3440, Order: 163214, Start Time: 2012-09-05 16:38:59, End Time: 2012-09-05 17:58:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (141 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 939 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 15.35% (0.1791 => 0.2066, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.73% (2.3931 => 2.4824, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 3.25% (13.4548 => 13.8927, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (3.7060 => 3.8248, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.13% (3.7135 => 3.8298, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.31% (7.4489 => 7.6208, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 1.41% (22.3122 => 22.6257, std. dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (8.0965 => 8.1961, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (11.1411 => 11.2748, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.5400 => 2.5665, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.45% (54.5322 => 56.4160, std. dev.: 0.1091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.00% (10.3673 => 13.8927, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 27.37% (0.1622 => 0.2066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.81% (0.3473 => 0.4022, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.66% (0.3543 => 0.4098, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 15.56% (0.3497 => 0.4041, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.42% (0.3516 => 0.4058, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.38% (0.3543 => 0.4088, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.30% (0.3561 => 0.4106, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.89% (0.3694 => 0.4244, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.71% (0.3828 => 0.4391, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/parameter-passing: 14.36% (0.3927 => 0.4491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.36% (0.3886 => 0.4444, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.72% (2.2022 => 2.4824, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.97% (1.7609 => 1.9541, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.76% (0.6030 => 0.6558, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 8.04% (10.4361 => 11.2748, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.04% (7.0540 => 7.6208, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1625 => 0.1750, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7326 => 0.7883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.57% (0.3817 => 0.4106, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.28% (0.8172 => 0.8767, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.88% (0.7835 => 0.8374, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.78% (0.4879 => 0.5210, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (8.1363 => 8.6767, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.51% (9.4845 => 10.1017, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2554 => 0.2718, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.17% (0.7115 => 0.7554, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (4.2646 => 4.5254, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 6.11% (0.3423 => 0.3632, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 6.05% (0.7433 => 0.7883, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5569 => 0.5903, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.99% (1.3050 => 1.3832, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 5.95% (0.3109 => 0.3294, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.92% (0.5105 => 0.5407, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.90% (0.3121 => 0.3305, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.87% (0.5860 => 0.6204, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.76% (1.5415 => 1.6303, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.9449 => 5.2229, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (5.0018 => 5.2794, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 5.52% (3.3354 => 3.5194, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9765 => 1.0290, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.36% (0.8067 => 0.8499, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.30% (0.6675 => 0.7029, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.22% (0.2700 => 0.2841, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.22% (0.3180 => 0.3346, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2242, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 5.06% (1.5603 => 1.6393, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.01% (0.3136 => 0.3293, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.91% (0.3422 => 0.3590, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (1.1861 => 1.2434, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.82% (0.5020 => 0.5262, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (14.3668 => 15.0587, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.79% (0.4636 => 0.4858, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 4.75% (0.3092 => 0.3239, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (0.4064 => 0.4257, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.73% (0.3826 => 0.4007, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.4103 => 0.4296, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.57% (3.8723 => 4.0492, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2891 => 0.3020, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.42% (2.0273 => 2.1170, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.38% (0.3650 => 0.3810, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.38% (1.0722 => 1.1192, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.37% (0.2905 => 0.3032, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6456 => 0.6735, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.32% (0.3865 => 0.4032, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.23% (0.3098 => 0.3229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3232 => 0.3367, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 4.14% (5.7591 => 5.9975, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.11% (0.2871 => 0.2989, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.10% (2.0665 => 2.1512, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.4203 => 0.4374, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.06% (0.2756 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.04% (0.2872 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.03% (0.2831 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.4048 => 0.4211, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3684 => 0.3831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.93% (0.3052 => 0.3172, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.90% (0.2793 => 0.2902, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.90% (2.2969 => 2.3865, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3283 => 0.3411, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4620 => 0.4800, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.89% (0.8921 => 0.9268, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.4186 => 1.4732, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2802 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.55% (0.3379 => 0.3499, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (1.5859 => 1.6374, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.14% (21.9371 => 22.6257, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.2024 => 2.2715, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (7.9617 => 8.1961, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.93% (17.1811 => 17.6848, std. dev.: 0.0207) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.1840 => 1.2171, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3166, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.8101 => 0.8265, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: 4.62% (1.1396 => 1.1922, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3633, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7524, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2716, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.37% (1.3045 => 1.3224, std. dev.: 0.0060) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std. dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.53% (5.2763 => 3.1904, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.89% (5.3855 => 3.8298, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.54% (5.3526 => 3.8248, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0965, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.66% (2.9384 => 2.5665, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -8.68% (22.1758 => 20.2508, std. dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3160, std. dev.: 0.1008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.20% (1.8329 => 1.7193, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1498, std. dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.96% (1.6805 => 1.6140, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5049, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4188, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9997, std. dev.: 0.0099) SingleSource/Benchmarks/McGill/chomp: -2.69% (1.2373 => 1.2040, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9631, std. dev.: 0.0126) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1892, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.85% (2.5528 => 2.5055, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 13:33:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 15:33:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905203310.C04FA2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3445?compare_to=3441&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3445, Order: 163230, Start Time: 2012-09-05 19:22:09, End Time: 2012-09-05 20:34:19 To: 3441, Order: 163220, Start Time: 2012-09-05 17:54:05, End Time: 2012-09-05 19:05:58 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (43 on baseline) Performance Improvements: 1 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.85% (0.5432 => 0.5641, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.10% (3.0413 => 3.1053, std. dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: 1.85% (8.7320 => 8.8937, std. dev.: 0.0386) MultiSource/Applications/siod/siod: 1.76% (2.1005 => 2.1374, std. dev.: 0.0140) MultiSource/Applications/SPASS/SPASS: 1.14% (13.3927 => 13.5448, std. dev.: 0.0437) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.05% (1.1765 => 1.1888, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 6.89% (3.0278 => 3.2364, std. dev.: 0.0642) SingleSource/Benchmarks/Shootout/heapsort: 4.49% (3.0231 => 3.1588, std. dev.: 0.0468) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.11% (43.8575 => 45.6582, std. dev.: 0.6601) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.47% (1.5979 => 1.6214, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.22% (4.6650 => 4.7220, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.20% (4.0751 => 4.1240, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.32% (2.6487 => 2.5873, std. dev.: 0.0222) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.47% (1.1653 => 1.2174, std. dev.: 0.0132) MultiSource/Applications/lemon/lemon: 3.50% (1.0046 => 1.0398, std. dev.: 0.0099) MultiSource/Benchmarks/PAQ8p/paq8p: 3.17% (2.1763 => 2.2453, std. dev.: 0.0142) MultiSource/Applications/d/make_dparser: 2.74% (3.0225 => 3.1053, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 1.92% (2.0972 => 2.1374, std. dev.: 0.0140) MultiSource/Applications/SPASS/SPASS: 1.66% (13.3238 => 13.5448, std. dev.: 0.0437) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std. dev.: 0.0487) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std. dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5544, std. dev.: 0.0294) SingleSource/Benchmarks/McGill/misr: 12.92% (0.4296 => 0.4851, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 12.85% (3.4406 => 3.8828, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (62.4126 => 69.0814, std. dev.: 0.2422) SingleSource/Benchmarks/Stanford/Puzzle: 9.49% (0.1433 => 0.1569, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.67% (1.0063 => 1.0935, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6074, std. dev.: 0.0412) SingleSource/Benchmarks/McGill/chomp: 7.92% (1.0194 => 1.1001, std. dev.: 0.0144) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.61% (0.2694 => 0.2899, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/methcall: 7.52% (8.5566 => 9.2003, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.97% (3.0256 => 3.2364, std. dev.: 0.0642) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (0.3301 => 0.3530, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 6.78% (3.4876 => 3.7242, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.01% (40.4792 => 42.9114, std. dev.: 0.3701) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (27.1724 => 28.7647, std. dev.: 0.1085) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8449, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/dt: 4.01% (0.9851 => 1.0246, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.64% (4.2129 => 4.3661, std. dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.33% (2.6656 => 2.7543, std. dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (2.4042 => 2.4830, std. dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 2.92% (5.1938 => 5.3455, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/ReedSolomon: 2.86% (8.5113 => 8.7550, std. dev.: 0.0534) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.37% (4.6127 => 4.7220, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4455 => 2.4879, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.68% (1.6110 => 1.6381, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5331, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.43% (4.0659 => 4.1240, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.31% (14.4877 => 14.6770, std. dev.: 0.0319) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.4184 => 1.4356, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.16% (4.6414 => 4.6954, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2080 => 0.1949, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: -3.00% (0.7738 => 0.7506, std. dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -1.16% (8.9977 => 8.8937, std. dev.: 0.0386) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.72% (0.3497 => 0.2038, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.21% (5.2665 => 4.1497, std. dev.: 0.0272) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.84% (1.1647 => 0.9919, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1604, std. dev.: 0.0391) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.91% (1.4034 => 1.2783, std. dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.96% (3.2007 => 2.9458, std. dev.: 0.0448) SingleSource/Benchmarks/Misc/richards_benchmark: -7.12% (1.4441 => 1.3413, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/pi: -6.30% (1.6538 => 1.5496, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (9.2503 => 8.7763, std. dev.: 0.0573) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4053, std. dev.: 0.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4140 => 0.3936, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7628, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.17% (1.7361 => 1.6810, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -3.09% (7.6833 => 7.4457, std. dev.: 0.0390) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.84% (1.1683 => 1.1351, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.77% (3.7496 => 3.6456, std. dev.: 0.0336) SingleSource/Benchmarks/Misc/flops: -2.61% (9.5474 => 9.2978, std. dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -2.58% (92.7467 => 90.3541, std. dev.: 0.2689) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.56% (2.4457 => 2.3830, std. dev.: 0.0210) MultiSource/Applications/siod/siod: -2.48% (3.5520 => 3.4640, std. dev.: 0.0175) MultiSource/Benchmarks/FreeBench/neural/neural: -2.26% (1.0926 => 1.0679, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2334, std. dev.: 0.0074) MultiSource/Applications/aha/aha: -1.61% (3.4286 => 3.3733, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -1.54% (3.8907 => 3.8306, std. dev.: 0.0196) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3569 => 2.3236, std. dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3168, std. dev.: 0.0265) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7682, std. dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 14:17:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 16:17:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905211732.2D58D2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3446?compare_to=3442&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3446, Order: 163234, Start Time: 2012-09-05 20:04:10, End Time: 2012-09-05 21:18:40 To: 3442, Order: 163222, Start Time: 2012-09-05 18:21:37, End Time: 2012-09-05 19:36:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (164 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.85% (27.4705 => 29.6258, std. dev.: 0.0450) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.93% (55.4392 => 56.5066, std. dev.: 0.1242) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.46% (0.7924 => 0.7808, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.98% (2.0176 => 2.4005, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.32% (0.1410 => 0.1626, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.12% (0.5818 => 0.6465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3578 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.58% (0.7061 => 0.7808, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3601 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.34% (0.3646 => 0.4023, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3650 => 0.4027, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3623 => 0.3996, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 10.21% (0.3663 => 0.4037, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.12% (0.3914 => 0.4310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.04% (0.4003 => 0.4405, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.92% (0.7710 => 0.8475, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 9.82% (0.3940 => 0.4327, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.54% (1.3693 => 1.4999, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.39% (3.9660 => 4.3384, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 8.96% (0.4328 => 0.4716, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2781 => 0.3030, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.72% (0.5265 => 0.5724, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.57% (1.2193 => 1.3238, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.52% (0.2782 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.41% (0.9199 => 0.9973, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 8.35% (0.7038 => 0.7626, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 8.35% (0.4062 => 0.4401, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.29% (0.6959 => 0.7536, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.23% (0.2721 => 0.2945, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 8.23% (0.3293 => 0.3564, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.14% (0.3022 => 0.3268, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.13% (0.2607 => 0.2819, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.13% (0.3899 => 0.4216, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2690 => 0.2908, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.10% (0.2655 => 0.2870, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.09% (0.3756 => 0.4060, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.08% (1.9828 => 2.1431, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3485 => 0.3766, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.04% (0.2760 => 0.2982, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.99% (0.2628 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.96% (0.2726 => 0.2943, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.95% (13.8202 => 14.9194, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.2937 => 0.3170, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2761 => 0.2980, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.91% (0.3489 => 0.3765, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.90% (1.4563 => 1.5714, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.90% (1.1364 => 1.2262, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.89% (0.2966 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.88% (0.3580 => 0.3862, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.87% (0.1588 => 0.1713, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.86% (0.4390 => 0.4735, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.79% (0.3107 => 0.3349, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.76% (0.2127 => 0.2292, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.72% (0.2696 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3149 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.68% (0.3192 => 0.3437, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4379 => 0.4715, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.67% (0.4016 => 0.4324, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.66% (0.2988 => 0.3217, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.4791 => 0.5153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5577 => 0.5997, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 7.50% (0.3868 => 0.4158, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (7.2180 => 7.7532, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3453 => 0.3708, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.35% (0.7506 => 0.8058, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 7.24% (0.3534 => 0.3790, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.15% (1.0313 => 1.1050, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.05% (0.3246 => 0.3475, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.01% (0.2995 => 0.3205, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5637 => 0.6028, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.92% (0.6283 => 0.6718, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.78% (0.2243 => 0.2395, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.75% (0.8310 => 0.8871, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.72% (0.2945 => 0.3143, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.68% (0.3220 => 0.3435, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.62% (13.2842 => 14.1635, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 6.61% (1.1061 => 1.1792, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.48% (3.8646 => 4.1150, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.22% (0.7460 => 0.7924, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.16% (3.6692 => 3.8953, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (1.3819 => 1.4669, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4659, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.11% (0.6744 => 0.7156, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.08% (0.4113 => 0.4363, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.05% (1.9270 => 2.0436, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 6.01% (1.2749 => 1.3515, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.97% (0.3755 => 0.3979, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.94% (0.8818 => 0.9342, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 5.93% (2.1791 => 2.3084, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.92% (0.8698 => 0.9213, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.85% (3.1889 => 3.3753, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 5.80% (1.0594 => 1.1208, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.77% (0.6135 => 0.6489, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (4.3801 => 4.6290, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (4.4433 => 4.6898, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 5.49% (16.6129 => 17.5245, std. dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 5.44% (14.8535 => 15.6611, std. dev.: 0.0075) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.2292 => 1.2936, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.19% (8.4961 => 8.9370, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.03% (1.1333 => 1.1903, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.00% (0.2859 => 0.3002, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.97% (14.5298 => 15.2518, std. dev.: 0.0183) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.48% (0.2321 => 0.2425, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.44% (6.5754 => 6.8673, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.25% (3.2742 => 3.4133, std. dev.: 0.0199) MultiSource/Applications/oggenc/oggenc: 4.20% (4.6629 => 4.8589, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6250 => 0.6509, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (0.9108 => 0.9484, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.09% (4.9865 => 5.1902, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.87% (1.5188 => 1.5776, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 3.85% (16.2614 => 16.8868, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.42% (2.1007 => 2.1725, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 3.34% (3.7467 => 3.8718, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.05% (6.2785 => 6.4702, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 2.89% (33.2944 => 34.2576, std. dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.08% (1.1560 => 1.2263, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7343, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.50% (10.7476 => 11.1242, std. dev.: 0.0617) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6085, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.95% (1.5824 => 1.6133, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5926, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5715, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4442, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.40% (0.4657 => 0.4033, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.66% (22.5627 => 21.5104, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2789, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.84% (0.4867 => 0.4680, std. dev.: 0.0011) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9248, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6081, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.11% (26.5159 => 25.9561, std. dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2398, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2170, std. dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5350, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2329, std. dev.: 0.0148) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 14:32:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 16:32:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905213240.3B8AF2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3447?compare_to=3444&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3447, Order: 163234, Start Time: 2012-09-05 20:14:08, End Time: 2012-09-05 21:33:49 To: 3444, Order: 163222, Start Time: 2012-09-05 18:26:31, End Time: 2012-09-05 19:46:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.17% (10.3673 => 14.0132, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/richards_benchmark: 26.76% (0.1622 => 0.2056, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3497 => 0.3977, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.66% (0.3543 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.65% (0.3561 => 0.4047, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.41% (2.2022 => 2.4975, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.91% (0.3927 => 0.4434, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3828 => 0.4322, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.09% (1.7609 => 1.9561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.28% (7.0540 => 7.6379, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.12% (0.3177 => 0.3435, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 8.08% (10.4361 => 11.2791, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.6030 => 0.6469, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.8172 => 0.8732, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 6.52% (9.4845 => 10.1033, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.43% (0.2271 => 0.2417, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4615 => 0.4908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.35% (0.7326 => 0.7791, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.2554 => 0.2716, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.23% (8.1363 => 8.6431, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 6.03% (0.7433 => 0.7881, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.03% (0.3817 => 0.4047, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 5.85% (0.7115 => 0.7531, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3806, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.73% (0.3423 => 0.3619, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.72% (0.7835 => 0.8283, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 5.66% (0.3109 => 0.3285, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (4.2646 => 4.5045, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.60% (0.5860 => 0.6188, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.58% (0.5105 => 0.5390, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5569 => 0.5878, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3121 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.5415 => 1.6241, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.9449 => 5.2091, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.34% (5.0018 => 5.2690, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.24% (3.3354 => 3.5102, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.6675 => 0.7013, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.03% (1.5603 => 1.6388, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.8067 => 0.8471, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.90% (0.9765 => 1.0243, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.79% (0.3422 => 0.3586, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2700 => 0.2829, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.78% (0.4103 => 0.4299, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.4064 => 0.4258, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.3180 => 0.3330, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2891 => 0.3026, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (14.3668 => 15.0319, std. dev.: 0.0197) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4636 => 0.4849, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.58% (1.1642 => 1.2175, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.1861 => 1.2397, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.5020 => 0.5246, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.45% (0.3441 => 0.3594, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.43% (0.3092 => 0.3229, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3650 => 0.3809, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.34% (3.8723 => 4.0402, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6456 => 0.6727, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4289 => 0.4468, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.15% (1.0722 => 1.1167, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 4.15% (5.7591 => 5.9979, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.3136 => 0.3265, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.11% (0.2872 => 0.2990, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3826 => 0.3983, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.3098 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.09% (0.4203 => 0.4375, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.09% (0.3865 => 0.4023, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.06% (0.2756 => 0.2868, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.04% (0.2871 => 0.2987, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.02% (0.6450 => 0.6709, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1085, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 3.99% (0.2831 => 0.2944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (2.0665 => 2.1488, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/moments: 3.95% (0.4048 => 0.4208, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.94% (0.3603 => 0.3745, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3232 => 0.3359, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3283 => 0.3410, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3684 => 0.3826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4620 => 0.4795, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.8921 => 0.9257, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2802 => 0.2907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.69% (2.2969 => 2.3816, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.5981 => 0.6193, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.4186 => 1.4679, std. dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 2.98% (21.9371 => 22.5901, std. dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (1.5859 => 1.6325, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.2024 => 2.2652, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.85% (17.1811 => 17.6705, std. dev.: 0.0212) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.54% (7.9617 => 8.1642, std. dev.: 0.0146) MultiSource/Applications/hexxagon/hexxagon: 2.40% (1.2842 => 1.3150, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.8101 => 0.8229, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3805, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 4.59% (1.1396 => 1.1919, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.33% (4.2280 => 4.3686, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0072) MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7781 => 3.8591, std. dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2370, std. dev.: 0.0098) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.39% (5.2763 => 3.1982, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.65% (5.3855 => 3.8427, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.37% (5.3526 => 3.8340, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1570, std. dev.: 0.0518) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.44% (2.9384 => 2.5730, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: -8.89% (22.1758 => 20.2045, std. dev.: 0.0321) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2901, std. dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.20% (1.8329 => 1.7192, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.38% (1.5835 => 1.5141, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1498, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5023, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4247, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0039, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (8.1563 => 7.9532, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: -2.35% (1.2373 => 1.2082, std. dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: -2.28% (12.4730 => 12.1882, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2203, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 15:00:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 17:00:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905220054.846D22A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3448?compare_to=3445&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3448, Order: 163238, Start Time: 2012-09-05 20:50:18, End Time: 2012-09-05 22:02:03 To: 3445, Order: 163230, Start Time: 2012-09-05 19:22:09, End Time: 2012-09-05 20:34:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (44 on baseline) Performance Improvements: 3 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (814 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.64% (0.7170 => 0.7933, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (4.2878 => 4.3452, std. dev.: 0.0120) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.20% (1.1770 => 1.1911, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 9.82% (21.3257 => 23.4199, std. dev.: 0.0659) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.76% (0.7708 => 0.7998, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.81% (3.1053 => 3.0492, std. dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.67% (45.6582 => 43.0680, std. dev.: 0.8387) SingleSource/Benchmarks/Shootout-C++/methcall: -1.81% (8.7763 => 8.6176, std. dev.: 0.0517) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.16% (2.1763 => 2.2887, std. dev.: 0.0223) MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.1653 => 1.2057, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (12.6413 => 13.0552, std. dev.: 0.0864) MultiSource/Applications/minisat/minisat: 2.77% (0.6173 => 0.6344, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.73% (0.7722 => 0.7933, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.5150 => 1.5462, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.05% (1.1672 => 1.1911, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.91% (1.2021 => 1.2251, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 21.97% (3.4629 => 4.2237, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.41% (0.0766 => 0.0930, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0035, std. dev.: 0.0233) SingleSource/Benchmarks/McGill/misr: 13.66% (0.4296 => 0.4883, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5504, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 12.55% (0.3746 => 0.4216, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 11.65% (3.4406 => 3.8415, std. dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1022, std. dev.: 0.0353) MultiSource/Benchmarks/nbench/nbench: 10.62% (21.1721 => 23.4199, std. dev.: 0.0659) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.73% (0.2694 => 0.2956, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.30% (7.0025 => 7.5834, std. dev.: 0.0254) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.76% (1.0063 => 1.0844, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 7.15% (1.0194 => 1.0923, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/methcall: 7.01% (8.5566 => 9.1568, std. dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.4876 => 3.7189, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.98% (4.2129 => 4.4647, std. dev.: 0.0509) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.69% (27.1724 => 28.7175, std. dev.: 0.0650) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.11% (0.7609 => 0.7998, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8245, std. dev.: 0.0578) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std. dev.: 0.0264) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.49% (2.6656 => 2.7587, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 2.53% (5.1938 => 5.3254, std. dev.: 0.0331) SingleSource/Benchmarks/Misc/ReedSolomon: 2.47% (8.5113 => 8.7214, std. dev.: 0.0570) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 1.71% (0.6308 => 0.6416, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.65% (38.9255 => 39.5666, std. dev.: 0.1774) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5325, std. dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.32% (1.2726 => 1.2894, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6708, std. dev.: 0.0297) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.11% (4.0659 => 4.1112, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (4.6414 => 4.6895, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.66% (0.3497 => 0.2075, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.72% (5.2665 => 4.1228, std. dev.: 0.2006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9917, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.82% (1.4034 => 1.2796, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.41% (3.2007 => 2.9315, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/richards_benchmark: -6.98% (1.4441 => 1.3433, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/methcall: -6.84% (9.2503 => 8.6176, std. dev.: 0.0517) SingleSource/Benchmarks/Misc/pi: -6.25% (1.6538 => 1.5505, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.28% (45.4683 => 43.0680, std. dev.: 0.8387) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.06% (1.4021 => 1.3312, std. dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4100, std. dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.26% (2.4457 => 2.3415, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.12% (1.7361 => 1.6645, std. dev.: 0.0100) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.31% (1.2722 => 1.2301, std. dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: -3.21% (8.5323 => 8.2588, std. dev.: 0.0650) MultiSource/Applications/lambda-0_1_3/lambda: -3.07% (7.6833 => 7.4473, std. dev.: 0.0124) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.87% (0.4140 => 0.4021, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1354, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.66% (3.7496 => 3.6500, std. dev.: 0.0192) MultiSource/Applications/siod/siod: -2.35% (3.5520 => 3.4686, std. dev.: 0.0090) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3665, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2475, std. dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3569 => 2.3237, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3074, std. dev.: 0.0220) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.33% (2.8964 => 2.8580, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: -1.28% (3.8200 => 3.7712, std. dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 15:47:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 17:47:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120905224737.A40B72A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3449?compare_to=3443&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3449, Order: 163234, Start Time: 2012-09-05 20:04:49, End Time: 2012-09-05 22:48:47 To: 3443, Order: 163214, Start Time: 2012-09-05 16:53:20, End Time: 2012-09-05 19:36:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (124 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.16% (2.0748 => 2.0988, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (2.1980 => 2.2216, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 25.88% (59.4970 => 74.8939, std. dev.: 0.0317) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.18% (124.5929 => 128.5539, std. dev.: 1.4088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.35% (0.3446 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.28% (0.3442 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.21% (0.3465 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.07% (0.3496 => 0.4023, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.93% (0.3469 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.47% (0.3643 => 0.4170, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3724 => 0.4255, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5826 => 0.6336, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.1620 => 0.1760, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.5889 => 0.6391, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.70% (1.6211 => 1.7459, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (3.5627 => 3.8357, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 7.38% (1.5932 => 1.7107, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.19% (1.3152 => 1.4098, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.99% (0.4361 => 0.4666, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.97% (0.7171 => 0.7671, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.92% (0.5000 => 0.5346, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.4994 => 0.5334, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.5900 => 0.6294, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.43% (2.7292 => 2.9046, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.36% (0.2738 => 0.2912, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (0.3930 => 0.4177, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 6.24% (4.2109 => 4.4737, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 6.23% (0.4029 => 0.4280, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (0.5026 => 0.5338, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.16% (5.5417 => 5.8829, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 6.02% (1.0781 => 1.1430, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.02% (0.2875 => 0.3048, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.83% (0.2866 => 0.3033, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.78% (0.2714 => 0.2871, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.73% (0.3004 => 0.3176, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (2.1013 => 2.2216, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.2736 => 0.2892, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 5.66% (0.9909 => 1.0470, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.62% (0.3792 => 0.4005, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3195 => 0.3374, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.60% (0.2750 => 0.2904, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.57% (0.2729 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2803 => 0.2959, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (2.0673 => 2.1814, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (1.9694 => 2.0780, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2811 => 0.2966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2813 => 0.2968, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.2823 => 0.2978, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.3845 => 0.4056, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.48% (0.2792 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.46% (0.3096 => 0.3265, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.40% (0.2780 => 0.2930, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2911 => 0.3068, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.35% (0.4146 => 0.4368, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3625 => 0.3819, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.30% (0.2566 => 0.2702, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3124 => 0.3289, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.26% (0.3267 => 0.3439, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3258 => 0.3429, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3060 => 0.3220, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.19% (0.3890 => 0.4092, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.17% (0.4658 => 0.4899, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.12% (0.3362 => 0.3534, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.07% (1.9966 => 2.0979, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 5.05% (4.6177 => 4.8511, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3726 => 0.3913, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (1.8794 => 1.9734, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.97% (0.3317 => 0.3482, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.97% (0.3282 => 0.3445, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (4.4195 => 4.6389, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.95% (0.3678 => 0.3860, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.3348 => 0.3513, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.89% (0.3477 => 0.3647, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.88% (0.2068 => 0.2169, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 4.88% (23.5202 => 24.6680, std. dev.: 0.0118) MultiSource/Applications/treecc/treecc: 4.83% (0.7875 => 0.8255, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.3903 => 0.4091, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.79% (0.6634 => 0.6952, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 4.78% (0.9697 => 1.0161, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (2.1653 => 2.2683, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.74% (0.3271 => 0.3426, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 4.69% (1.4269 => 1.4938, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3690 => 0.3862, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.4139 => 0.4330, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.56% (0.4251 => 0.4445, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.3981 => 0.4156, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.15% (0.5012 => 0.5220, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.06% (0.2737 => 0.2848, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.04% (0.2969 => 0.3089, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.02% (0.5546 => 0.5769, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.02% (0.3336 => 0.3470, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.6435 => 0.6671, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 3.16% (2.0346 => 2.0988, std. dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 2.74% (0.4847 => 0.4980, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (0.5361 => 0.5489, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (0.7426 => 0.7578, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.51% (11.6398 => 11.8160, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (4.6926 => 4.7518, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8955, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6399, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std. dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5077, std. dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4371, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2906, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5822, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4502, std. dev.: 0.0598) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5879, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7861, std. dev.: 0.0176) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.66% (0.2402 => 0.2266, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8012, std. dev.: 0.0031) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.49% (17.2379 => 16.8080, std. dev.: 0.0558) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5728, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9754, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 16:00:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 18:00:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120905230031.158A22A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3450?compare_to=3446&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3450, Order: 163243, Start Time: 2012-09-05 21:46:55, End Time: 2012-09-05 23:01:40 To: 3446, Order: 163234, Start Time: 2012-09-05 20:04:10, End Time: 2012-09-05 21:18:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.92% (2.0176 => 2.3993, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.46% (0.5748 => 0.6407, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 11.43% (0.5818 => 0.6483, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.79% (0.3578 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3646 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3623 => 0.3999, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.37% (0.3663 => 0.4043, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3650 => 0.4028, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.32% (0.3789 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3914 => 0.4313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.04% (0.7710 => 0.8484, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.95% (0.3940 => 0.4332, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.52% (1.3693 => 1.4996, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3323, std. dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 9.03% (0.4328 => 0.4719, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.77% (0.2782 => 0.3026, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.77% (0.3022 => 0.3287, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.49% (0.4062 => 0.4407, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.44% (0.3899 => 0.4228, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.41% (1.2193 => 1.3219, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.35% (0.9199 => 0.9967, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2628 => 0.2845, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 8.23% (0.3293 => 0.3564, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.21% (0.2607 => 0.2821, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.18% (0.7038 => 0.7614, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 8.18% (0.2690 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.15% (1.9828 => 2.1444, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.14% (0.2655 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.13% (0.6959 => 0.7525, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.12% (0.3485 => 0.3768, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3489 => 0.3771, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.06% (0.2966 => 0.3205, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 8.04% (0.2760 => 0.2982, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.04% (0.2937 => 0.3173, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.2721 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.00% (0.2761 => 0.2982, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 8.00% (0.2726 => 0.2944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.99% (0.1327 => 0.1433, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.96% (0.3756 => 0.4055, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.93% (0.1588 => 0.1714, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.93% (0.3580 => 0.3864, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.85% (0.3107 => 0.3351, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.83% (0.2696 => 0.2907, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.79% (1.4563 => 1.5698, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.76% (1.1364 => 1.2246, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.76% (0.2127 => 0.2292, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 7.74% (0.3192 => 0.3439, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3149 => 0.3391, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.4791 => 0.5159, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.65% (13.8202 => 14.8770, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2988 => 0.3216, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.59% (0.4016 => 0.4321, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.54% (0.7506 => 0.8072, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5577 => 0.5996, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 7.50% (0.3868 => 0.4158, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (7.2180 => 7.7526, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3453 => 0.3708, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.38% (0.4390 => 0.4714, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3534 => 0.3794, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.00% (0.6283 => 0.6723, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.92% (1.0313 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 6.86% (0.2945 => 0.3147, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.81% (0.3246 => 0.3467, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.78% (1.1061 => 1.1811, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.5637 => 0.6016, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 6.53% (0.8310 => 0.8853, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 6.50% (0.2925 => 0.3115, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (13.2842 => 14.1436, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3220 => 0.3425, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.30% (3.8646 => 4.1079, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.09% (1.3813 => 1.4654, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.08% (0.6744 => 0.7154, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.08% (1.3819 => 1.4659, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.3245 => 1.4049, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.96% (3.6692 => 3.8879, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 5.95% (1.9270 => 2.0416, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.94% (0.7460 => 0.7903, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.91% (0.3755 => 0.3977, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.87% (0.8818 => 0.9336, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.2749 => 1.3487, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 5.77% (2.1791 => 2.3048, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.69% (3.1889 => 3.3702, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.67% (4.3801 => 4.6286, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 5.64% (1.0594 => 1.1192, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.56% (0.6135 => 0.6476, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.54% (4.4433 => 4.6894, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.2140 => 0.2258, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 5.48% (16.6129 => 17.5228, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.29% (14.8535 => 15.6393, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 5.18% (1.2292 => 1.2929, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.06% (8.4961 => 8.9261, std. dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: 4.91% (14.5298 => 15.2431, std. dev.: 0.0304) MultiSource/Benchmarks/Olden/bh/bh: 4.90% (0.2859 => 0.2999, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.85% (1.1333 => 1.1883, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.31% (6.5754 => 6.8591, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.20% (3.2742 => 3.4116, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4805 => 0.5003, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (4.9865 => 5.1879, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 3.97% (4.6629 => 4.8481, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.79% (0.9108 => 0.9453, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.65% (16.2614 => 16.8550, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.53% (1.5188 => 1.5724, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1734, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.11% (33.2944 => 34.3309, std. dev.: 0.0195) MultiSource/Applications/lua/lua: 3.11% (3.7467 => 3.8632, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.93% (6.2785 => 6.4627, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0523) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (3.1736 => 3.4120, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.03% (1.1560 => 1.2257, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.39% (10.7476 => 11.2198, std. dev.: 0.0355) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6001, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.94% (1.5824 => 1.6131, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6011, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1423, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5715, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.00% (1.4298 => 1.4441, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.33% (0.4657 => 0.4036, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.71% (22.5627 => 21.5006, std. dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.28% (20.3410 => 18.2504, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3144, std. dev.: 0.0110) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.47% (3.0263 => 2.9212, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5737, std. dev.: 0.0200) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -2.04% (26.5159 => 25.9762, std. dev.: 0.0463) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2397, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2198, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5361, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2266, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8716, std. dev.: 0.0165) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 16:20:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 18:20:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120905232010.E3D102A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3451?compare_to=3447&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3451, Order: 163247, Start Time: 2012-09-05 22:01:56, End Time: 2012-09-05 23:21:20 To: 3447, Order: 163234, Start Time: 2012-09-05 20:14:08, End Time: 2012-09-05 21:33:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (140 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.75% (14.0132 => 13.7678, std. dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.80% (10.3673 => 13.7678, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 31.01% (0.1622 => 0.2125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.71% (0.3473 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.44% (0.3497 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.33% (0.3516 => 0.4020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3543 => 0.4050, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3543 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.24% (0.3561 => 0.4068, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.78% (0.3694 => 0.4203, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.56% (0.3828 => 0.4347, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.34% (0.3927 => 0.4451, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.25% (0.3886 => 0.4401, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.18% (2.2022 => 2.4924, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.27% (1.1194 => 1.2568, std. dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.31% (1.7609 => 1.9600, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 8.78% (0.3282 => 0.3570, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 8.48% (10.4361 => 11.3209, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.36% (7.0540 => 7.6434, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.52% (0.7326 => 0.7877, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.8172 => 0.8732, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4615 => 0.4922, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 6.65% (9.4845 => 10.1152, std. dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.44% (0.3817 => 0.4063, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (8.1363 => 8.6509, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 6.30% (0.7115 => 0.7563, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7433 => 0.7892, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5860 => 0.6208, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.87% (0.7835 => 0.8295, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (4.2646 => 4.5142, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.84% (0.2107 => 0.2230, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.84% (0.5569 => 0.5894, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3805, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2603 => 0.2751, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.62% (1.5415 => 1.6282, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.42% (4.9449 => 5.2131, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (5.0018 => 5.2703, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.36% (0.6675 => 0.7033, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.35% (3.3354 => 3.5137, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9765 => 1.0279, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.15% (1.5603 => 1.6407, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.8067 => 0.8481, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2700 => 0.2836, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.99% (1.1642 => 1.2223, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.97% (0.3180 => 0.3338, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.97% (0.3422 => 0.3592, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4636 => 0.4860, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.78% (0.5020 => 0.5260, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.78% (0.4103 => 0.4299, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (1.1861 => 1.2425, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 4.75% (0.3092 => 0.3239, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 4.75% (0.4299 => 0.4503, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.4064 => 0.4256, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (14.3668 => 15.0455, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 4.70% (3.8723 => 4.0543, std. dev.: 0.0089) SingleSource/Regression/C++/ofstream_ctor: 4.61% (0.2905 => 0.3039, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.55% (0.3387 => 0.3541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.46% (0.6456 => 0.6744, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.3136 => 0.3275, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3650 => 0.3811, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3826 => 0.3994, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.37% (5.7591 => 6.0107, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4203 => 0.4385, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.30% (0.4048 => 0.4222, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.29% (2.0273 => 2.1143, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.4289 => 0.4472, std. dev.: 0.0053) MultiSource/Applications/lemon/lemon: 4.26% (1.0722 => 1.1179, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.26% (0.3098 => 0.3230, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (2.0665 => 2.1530, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 4.17% (0.2831 => 0.2949, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.11% (0.3603 => 0.3751, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.09% (0.3935 => 0.4096, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.07% (0.2872 => 0.2989, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3232 => 0.3361, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2756 => 0.2866, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3684 => 0.3831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.96% (0.3283 => 0.3413, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.93% (0.3052 => 0.3172, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.93% (0.5981 => 0.6216, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.92% (0.4620 => 0.4801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.88% (0.8921 => 0.9267, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.83% (0.2793 => 0.2900, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.81% (2.2969 => 2.3844, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2802 => 0.2907, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.4186 => 1.4704, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 3.64% (0.3379 => 0.3502, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6385, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (2.2024 => 2.2723, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.06% (17.1811 => 17.7060, std. dev.: 0.0233) MultiSource/Applications/JM/lencod/lencod: 2.88% (21.9371 => 22.5690, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2177, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.79% (7.9617 => 8.1838, std. dev.: 0.0167) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2842 => 1.3192, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.91% (0.8101 => 0.8256, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 4.62% (1.1396 => 1.1923, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.24% (4.2280 => 4.3651, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7470, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2422, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (1.3045 => 1.3218, std. dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.99% (5.2763 => 3.2189, std. dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.38% (5.3855 => 3.8570, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.05% (5.3526 => 3.8510, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.2008, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.92% (2.9384 => 2.5882, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.62% (22.1758 => 20.2647, std. dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.56% (19.9488 => 18.2411, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.26% (1.8329 => 1.7181, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std. dev.: 0.0026) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.97% (1.6805 => 1.6138, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5051, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4239, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9889, std. dev.: 0.0300) SingleSource/Benchmarks/McGill/chomp: -2.85% (1.2373 => 1.2020, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9645, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -2.31% (12.4730 => 12.1846, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 16:28:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 18:28:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120905232852.B69662A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3452?compare_to=3448&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3452, Order: 163253, Start Time: 2012-09-05 22:17:56, End Time: 2012-09-05 23:30:03 To: 3448, Order: 163238, Start Time: 2012-09-05 20:50:18, End Time: 2012-09-05 22:02:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (45 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 878 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.87% (0.1285 => 0.1399, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.93% (0.7510 => 0.7730, std. dev.: 0.0074) MultiSource/Applications/Burg/burg: 1.97% (1.1407 => 1.1632, std. dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: 1.58% (13.3943 => 13.6055, std. dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.4294 => 6.5241, std. dev.: 0.0145) MultiSource/Applications/d/make_dparser: 1.10% (3.0492 => 3.0827, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.24% (21.7228 => 22.6435, std. dev.: 0.0876) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (42.0878 => 43.5202, std. dev.: 0.1682) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.45% (2.9315 => 2.9739, std. dev.: 0.0101) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.44% (2.9181 => 2.9600, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.35% (4.6491 => 4.7118, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/mandel-2: 1.13% (4.3122 => 4.3611, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.67% (1.1911 => 1.1712, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.27% (1.4437 => 1.4253, std. dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.37% (1.1653 => 1.2162, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5150 => 1.5557, std. dev.: 0.0113) MultiSource/Applications/lemon/lemon: 2.66% (1.0046 => 1.0313, std. dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 2.11% (13.3238 => 13.6055, std. dev.: 0.0097) MultiSource/Applications/d/make_dparser: 1.99% (3.0225 => 3.0827, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.68% (1.1440 => 1.1632, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.47% (1.1827 => 1.2001, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.45% (0.0766 => 0.0892, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 15.10% (1.7426 => 2.0058, std. dev.: 0.0222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.36% (4.0101 => 4.5859, std. dev.: 0.0249) SingleSource/Benchmarks/McGill/misr: 13.97% (0.4296 => 0.4896, std. dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.36% (3.4406 => 3.8315, std. dev.: 0.0256) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1034, std. dev.: 0.0793) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6100, std. dev.: 0.0342) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.46% (0.2694 => 0.2922, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.32% (1.0063 => 1.0900, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout/methcall: 7.66% (8.5566 => 9.2118, std. dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.51% (40.4792 => 43.5202, std. dev.: 0.1682) SingleSource/Benchmarks/McGill/chomp: 7.48% (1.0194 => 1.0957, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (3.4876 => 3.7165, std. dev.: 0.0336) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.88% (27.1724 => 28.7695, std. dev.: 0.0725) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (0.3301 => 0.3463, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 4.49% (0.9851 => 1.0293, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.40% (4.2129 => 4.3984, std. dev.: 0.0401) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8491, std. dev.: 0.0369) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.53% (0.5587 => 0.5784, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.34% (0.3508 => 0.3625, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.94% (2.6656 => 2.7440, std. dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 2.53% (8.5113 => 8.7270, std. dev.: 0.0576) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (2.4455 => 2.5000, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.6127 => 4.7118, std. dev.: 0.0219) MultiSource/Applications/JM/lencod/lencod: 1.83% (6.7458 => 6.8691, std. dev.: 0.0396) SingleSource/Benchmarks/Misc/whetstone: 1.60% (2.3453 => 2.3829, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (2.4971 => 2.5361, std. dev.: 0.0102) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.54% (2.9152 => 2.9600, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.37% (22.3381 => 22.6435, std. dev.: 0.0876) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6677, std. dev.: 0.0148) MultiSource/Benchmarks/Olden/em3d/em3d: 1.18% (4.6414 => 4.6962, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.6110 => 1.6298, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.09% (0.2080 => 0.1891, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/05-eks/eks: -2.56% (0.4253 => 0.4144, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.46% (5.2665 => 4.0839, std. dev.: 0.1001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9903, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0528) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.09% (3.2007 => 2.9739, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -6.78% (1.4441 => 1.3462, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -6.74% (9.2503 => 8.6264, std. dev.: 0.0609) SingleSource/Benchmarks/Misc/pi: -6.19% (1.6538 => 1.5515, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: -5.21% (4.6355 => 4.3942, std. dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.20% (1.7361 => 1.6631, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.75% (2.4457 => 2.3540, std. dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (1.4021 => 1.3552, std. dev.: 0.0176) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.33% (0.4140 => 0.4002, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -2.86% (7.6833 => 7.4638, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2894, std. dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: -2.58% (92.7467 => 90.3504, std. dev.: 0.6023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.47% (1.1683 => 1.1394, std. dev.: 0.0041) MultiSource/Applications/siod/siod: -2.24% (3.5520 => 3.4724, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: -2.16% (1.0926 => 1.0690, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.97% (3.7496 => 3.6758, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/ffbench: -1.71% (1.4117 => 1.3875, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -1.64% (3.4286 => 3.3724, std. dev.: 0.0101) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.8964 => 2.8491, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2323, std. dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.52% (1.0686 => 1.0524, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: -1.50% (3.8200 => 3.7628, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std. dev.: 0.0217) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 17:43:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 19:43:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906004320.A40B92A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3453?compare_to=3450&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3453, Order: 163263, Start Time: 2012-09-05 23:29:46, End Time: 2012-09-06 00:44:29 To: 3450, Order: 163243, Start Time: 2012-09-05 21:46:55, End Time: 2012-09-05 23:01:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (162 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.76% (2.0176 => 2.3962, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.89% (0.1410 => 0.1620, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3578 => 0.4020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.16% (0.3601 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.10% (0.5818 => 0.6522, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.07% (0.3646 => 0.4086, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.04% (0.3663 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3650 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.99% (0.5748 => 0.6437, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.95% (0.3623 => 0.4056, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.77% (0.7061 => 0.7892, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3789 => 0.4232, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3914 => 0.4370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.4003 => 0.4459, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.35% (0.3940 => 0.4387, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.94% (0.7710 => 0.8476, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.38% (1.3693 => 1.4977, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.29% (3.9660 => 4.3344, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.94% (0.2596 => 0.2828, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 8.73% (0.4328 => 0.4706, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std. dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 8.59% (0.2781 => 0.3020, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.48% (1.2193 => 1.3227, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.39% (0.9199 => 0.9971, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.17% (0.4062 => 0.4394, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2782 => 0.3009, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.08% (0.7038 => 0.7607, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.01% (1.4563 => 1.5729, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.98% (0.6959 => 0.7514, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.98% (0.2721 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (0.2655 => 0.2866, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.93% (1.1364 => 1.2265, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.92% (0.3485 => 0.3761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.90% (0.3293 => 0.3553, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1327 => 0.1431, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.83% (0.3756 => 0.4050, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 7.83% (0.2607 => 0.2811, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2127 => 0.2293, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.3899 => 0.4203, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.79% (1.9828 => 2.1373, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.75% (0.1588 => 0.1711, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.72% (0.2628 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.2966 => 0.3195, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.70% (13.8202 => 14.8846, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 7.66% (0.2937 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.65% (0.3489 => 0.3756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.64% (0.2760 => 0.2971, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2765 => 0.2975, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.57% (0.2761 => 0.2970, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.57% (0.7506 => 0.8074, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.50% (0.3107 => 0.3340, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.46% (0.5577 => 0.5993, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.46% (0.2696 => 0.2897, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (7.2180 => 7.7521, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3192 => 0.3426, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.30% (0.3149 => 0.3379, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.3868 => 0.4148, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.22% (0.4016 => 0.4306, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3534 => 0.3780, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4390 => 0.4695, std. dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.5637 => 0.6026, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.88% (0.6283 => 0.6715, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.78% (0.2995 => 0.3198, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.72% (0.3246 => 0.3464, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.61% (1.0313 => 1.0995, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1865 => 0.1988, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.51% (1.1061 => 1.1781, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (13.2842 => 14.1486, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: 6.47% (0.8310 => 0.8848, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 6.22% (3.8646 => 4.1050, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.18% (1.3813 => 1.4666, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.15% (0.7460 => 0.7919, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.05% (3.6692 => 3.8913, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 6.05% (1.9270 => 2.0435, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.96% (1.3245 => 1.4034, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 5.96% (1.0594 => 1.1225, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 5.92% (0.6744 => 0.7143, std. dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (1.2749 => 1.3499, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.88% (1.3819 => 1.4631, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.70% (0.8818 => 0.9321, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.8698 => 0.9192, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.67% (0.3755 => 0.3968, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6938, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.62% (0.6135 => 0.6480, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.62% (3.1889 => 3.3680, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 5.60% (2.1791 => 2.3011, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.53% (4.3801 => 4.6224, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.2140 => 0.2258, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.33% (14.8535 => 15.6449, std. dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 5.21% (0.3131 => 0.3294, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.12% (16.6129 => 17.4638, std. dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2916, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.04% (8.4961 => 8.9241, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2511, std. dev.: 0.0258) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.1333 => 1.1877, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.28% (6.5754 => 6.8569, std. dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 4.06% (4.6629 => 4.8520, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (3.2742 => 3.4035, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (4.9865 => 5.1800, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.81% (0.9108 => 0.9455, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.6250 => 0.6480, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.64% (16.2614 => 16.8536, std. dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (1.5188 => 1.5708, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.1007 => 2.1689, std. dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (6.2785 => 6.4752, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.11% (3.7467 => 3.8632, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 2.63% (33.2944 => 34.1686, std. dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0502) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.06% (1.1560 => 1.2261, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.71% (10.7476 => 11.1464, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5965, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.00% (1.5824 => 1.6141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.20% (1.4298 => 1.4470, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5866, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.13% (0.4657 => 0.4092, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.94% (0.2670 => 0.2538, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.93% (22.5627 => 21.4493, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2901, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3174, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: -3.34% (3.0263 => 2.9252, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5774, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -2.01% (26.5159 => 25.9825, std. dev.: 0.0673) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2421, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2084, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.15% (4.5928 => 4.5401, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 17:57:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 19:57:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906005722.CAEAA2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3454?compare_to=3452&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3454, Order: 163267, Start Time: 2012-09-05 23:45:41, End Time: 2012-09-06 00:58:33 To: 3452, Order: 163253, Start Time: 2012-09-05 22:17:56, End Time: 2012-09-05 23:30:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 24 (60 on baseline) Performance Improvements: 3 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 865 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.19% (0.1891 => 0.2008, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.87% (0.4370 => 0.4583, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 2.98% (0.3792 => 0.3905, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.8867 => 0.9096, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.7709 => 0.7908, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.24% (0.7455 => 0.7622, std. dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 2.18% (15.4406 => 15.7772, std. dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.17% (0.5664 => 0.5787, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (12.8928 => 13.1514, std. dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (4.0282 => 4.0799, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 1.28% (0.9357 => 0.9477, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.23% (29.5668 => 29.9297, std. dev.: 0.0517) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.21% (1.2087 => 1.2233, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (8.2274 => 8.3250, std. dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (6.2575 => 6.3231, std. dev.: 0.0240) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 54.23% (0.0201 => 0.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 29.91% (0.1384 => 0.1798, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.09% (4.4430 => 4.6690, std. dev.: 0.0671) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.69% (4.0839 => 4.2346, std. dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (1.7327 => 1.7936, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.3540 => 2.4284, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/sieve: 1.37% (3.8315 => 3.8838, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.29% (60.3608 => 61.1419, std. dev.: 0.2644) SingleSource/Benchmarks/Shootout/hash: 1.18% (4.3057 => 4.3565, std. dev.: 0.0181) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.88% (0.8013 => 0.7542, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -1.66% (3.9032 => 3.8386, std. dev.: 0.0148) MultiSource/Applications/SPASS/SPASS: -1.17% (8.4994 => 8.4002, std. dev.: 0.0274) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.11% (2.1763 => 2.2876, std. dev.: 0.0379) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (12.6413 => 13.1514, std. dev.: 0.0202) MultiSource/Applications/SIBsim4/SIBsim4: 3.73% (1.1653 => 1.2088, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: 3.55% (0.6173 => 0.6392, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.52% (0.7639 => 0.7908, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.5150 => 1.5633, std. dev.: 0.0044) MultiSource/Applications/lemon/lemon: 3.14% (1.0046 => 1.0361, std. dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 3.05% (15.3105 => 15.7772, std. dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.54% (0.4248 => 0.4356, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.09% (29.3170 => 29.9297, std. dev.: 0.0517) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.03% (0.7226 => 0.7373, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.84% (3.0225 => 3.0781, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.76% (1.2021 => 1.2233, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (8.2186 => 8.3250, std. dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.6079 => 14.7904, std. dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (4.0318 => 4.0799, std. dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.10% (6.2546 => 6.3231, std. dev.: 0.0240) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 26.89% (0.1417 => 0.1798, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: 17.65% (1.7426 => 2.0501, std. dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.24% (4.0101 => 4.5810, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/sieve: 12.88% (3.4406 => 3.8838, std. dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 11.59% (0.3746 => 0.4180, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/misr: 11.34% (0.4296 => 0.4783, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.12% (0.0917 => 0.1019, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0897, std. dev.: 0.0880) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.99% (0.2694 => 0.2963, std. dev.: 0.0089) SingleSource/Benchmarks/Stanford/Puzzle: 9.77% (0.1433 => 0.1573, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.07% (1.0063 => 1.0976, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout/lists: 8.52% (7.0025 => 7.5993, std. dev.: 0.0448) SingleSource/Benchmarks/Shootout/methcall: 7.40% (8.5566 => 9.1896, std. dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: 7.36% (1.0194 => 1.0944, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.06% (0.3301 => 0.3534, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 6.53% (3.4876 => 3.7153, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7925, std. dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.14% (40.4792 => 42.5602, std. dev.: 0.4651) SingleSource/Benchmarks/Misc/fp-convert: 4.63% (15.2242 => 15.9289, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5391, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8742, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.53% (2.6656 => 2.7598, std. dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.51% (0.5587 => 0.5783, std. dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.32% (2.4042 => 2.4841, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5113 => 8.7636, std. dev.: 0.0886) MultiSource/Benchmarks/BitBench/five11/five11: 2.75% (5.1938 => 5.3367, std. dev.: 0.0468) SingleSource/Benchmarks/Shootout-C++/hash: 2.69% (0.6308 => 0.6478, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.65% (1.7473 => 1.7936, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.76% (4.6127 => 4.6940, std. dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5347, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4455 => 2.4805, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 1.36% (2.5166 => 2.5508, std. dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 1.33% (14.4877 => 14.6803, std. dev.: 0.0220) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.31% (38.9255 => 39.4360, std. dev.: 0.0788) MultiSource/Applications/JM/lencod/lencod: 1.28% (6.7458 => 6.8323, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout/hash: 1.28% (4.3016 => 4.3565, std. dev.: 0.0181) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.4184 => 1.4357, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 1.20% (4.6414 => 4.6970, std. dev.: 0.0070) MultiSource/Applications/lua/lua: 1.17% (29.5232 => 29.8700, std. dev.: 0.1038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.13% (3.6254 => 3.6662, std. dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.33% (0.7722 => 0.7542, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -1.50% (0.7738 => 0.7622, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.26% (0.3497 => 0.2089, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.59% (5.2665 => 4.2346, std. dev.: 0.0432) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.88% (1.1647 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -13.24% (3.6023 => 3.1252, std. dev.: 0.1623) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1622, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: -6.88% (1.4441 => 1.3447, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/pi: -6.29% (1.6538 => 1.5497, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: -5.58% (9.2503 => 8.7339, std. dev.: 0.0905) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4079, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7629, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.81% (1.7361 => 1.6700, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4508, std. dev.: 0.0288) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.69% (1.1683 => 1.1369, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -2.60% (9.5474 => 9.2989, std. dev.: 0.0172) MultiSource/Benchmarks/PAQ8p/paq8p: -2.36% (92.7467 => 90.5564, std. dev.: 0.8344) MultiSource/Benchmarks/FreeBench/neural/neural: -2.26% (1.0926 => 1.0679, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.09% (3.7496 => 3.6714, std. dev.: 0.0287) MultiSource/Applications/siod/siod: -1.96% (3.5520 => 3.4824, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.95% (2.8964 => 2.8399, std. dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (9.3855 => 9.2073, std. dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -1.55% (8.5323 => 8.4002, std. dev.: 0.0274) MultiSource/Applications/aha/aha: -1.51% (3.4286 => 3.3767, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7684, std. dev.: 0.0139) MultiSource/Benchmarks/sim/sim: -1.34% (3.8907 => 3.8386, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3293, std. dev.: 0.0167) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 18:07:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 20:07:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906010752.B67A02A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3455?compare_to=3451&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3455, Order: 163267, Start Time: 2012-09-05 23:49:35, End Time: 2012-09-06 01:09:02 To: 3451, Order: 163247, Start Time: 2012-09-05 22:01:56, End Time: 2012-09-05 23:21:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (13.7678 => 14.0742, std. dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.76% (10.3673 => 14.0742, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 26.82% (0.1622 => 0.2057, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.26% (0.3473 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.07% (0.3543 => 0.4077, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.93% (0.3543 => 0.4072, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-2: 14.84% (0.3497 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.76% (0.3516 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.74% (0.3561 => 0.4086, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.21% (0.3694 => 0.4219, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.95% (0.3828 => 0.4362, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.88% (0.3927 => 0.4472, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.64% (0.3886 => 0.4416, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.23% (2.2022 => 2.4936, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.83% (1.7609 => 1.9516, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5925 => 0.6497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.6030 => 0.6602, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.08% (7.0540 => 7.6239, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.81% (10.4361 => 11.2507, std. dev.: 0.0182) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.8172 => 0.8733, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.86% (0.3817 => 0.4079, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.77% (0.3307 => 0.3531, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.67% (0.4615 => 0.4923, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.4879 => 0.5203, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3121 => 0.3323, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 6.37% (9.4845 => 10.0887, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.2554 => 0.2716, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.30% (8.1363 => 8.6488, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.5569 => 0.5919, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7433 => 0.7897, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 6.23% (0.7835 => 0.8323, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: 6.18% (0.7115 => 0.7555, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.96% (0.5860 => 0.6209, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.3050 => 1.3826, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (4.2646 => 4.5175, std. dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.5105 => 0.5401, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.79% (0.3109 => 0.3289, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3423 => 0.3621, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (1.5415 => 1.6273, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.49% (4.9449 => 5.2164, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (5.0018 => 5.2728, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.28% (3.3354 => 3.5116, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.27% (0.6675 => 0.7027, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.8067 => 0.8489, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.22% (0.9765 => 1.0275, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 5.04% (1.5603 => 1.6390, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.88% (0.3422 => 0.3589, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.85% (1.1642 => 1.2207, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.4064 => 0.4261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.4103 => 0.4300, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.79% (0.4636 => 0.4858, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2700 => 0.2829, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5020 => 0.5257, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (1.1861 => 1.2420, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.71% (14.3668 => 15.0431, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3826 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3441 => 0.3599, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.3650 => 0.3813, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.43% (0.3387 => 0.3537, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.39% (0.2872 => 0.2998, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 4.37% (3.8723 => 4.0415, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 4.37% (0.6456 => 0.6738, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.31% (0.6450 => 0.6728, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.28% (1.0722 => 1.1181, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.27% (2.0665 => 2.1547, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 4.25% (0.2871 => 0.2993, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.24% (0.3865 => 0.4029, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.23% (0.3098 => 0.3229, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4289 => 0.4470, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.20% (5.7591 => 6.0012, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.4203 => 0.4379, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.15% (2.0273 => 2.1114, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 4.13% (0.2831 => 0.2948, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.11% (0.3283 => 0.3418, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.11% (0.3162 => 0.3292, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.10% (0.4048 => 0.4214, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3232 => 0.3362, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.00% (0.2877 => 0.2992, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.94% (0.3684 => 0.3829, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.90% (0.2793 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2802 => 0.2911, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.73% (0.5981 => 0.6204, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 3.73% (2.2969 => 2.3825, std. dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.60% (1.4186 => 1.4696, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.52% (0.3379 => 0.3498, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.46% (1.5859 => 1.6407, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 3.09% (21.9371 => 22.6148, std. dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (2.2024 => 2.2704, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.79% (17.1811 => 17.6599, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.1840 => 1.2163, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 2.57% (1.2842 => 1.3172, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.47% (7.9617 => 8.1584, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.8101 => 0.8251, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4139, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3830, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 4.63% (1.1396 => 1.1924, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (4.2280 => 4.3608, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2369, std. dev.: 0.0312) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7617, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.54% (5.2763 => 3.1900, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.45% (5.3855 => 3.8532, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.08% (5.3526 => 3.8498, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0671, std. dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.37% (2.9384 => 2.5748, std. dev.: 0.0163) MultiSource/Applications/ClamAV/clamscan: -8.82% (22.1758 => 20.2201, std. dev.: 0.0315) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2897, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.20% (1.8329 => 1.7193, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8485, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std. dev.: 0.0019) MultiSource/Applications/siod/siod: -4.08% (3.2827 => 3.1489, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5074, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4249, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9963, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.46% (8.1563 => 7.9555, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1866, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -1.75% (1.2373 => 1.2156, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5091, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 19:02:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 21:02:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906020202.495302A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3456?compare_to=3449&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3456, Order: 163263, Start Time: 2012-09-05 23:19:30, End Time: 2012-09-06 02:03:12 To: 3449, Order: 163234, Start Time: 2012-09-05 20:04:49, End Time: 2012-09-05 22:48:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.93% (0.4142 => 0.4719, std. dev.: 0.0209) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 15.85% (0.3496 => 0.4050, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-2: 15.79% (0.3446 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.70% (0.3465 => 0.4009, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.66% (0.3442 => 0.3981, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 15.65% (0.3469 => 0.4012, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.62% (0.3488 => 0.4033, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.58% (0.3460 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.93% (0.3643 => 0.4187, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 14.88% (0.3650 => 0.4193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.61% (0.3724 => 0.4268, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5826 => 0.6350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.83% (0.5889 => 0.6409, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (3.5627 => 3.8252, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7171 => 0.7693, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (1.6211 => 1.7373, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.03% (1.3152 => 1.4076, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.90% (1.5932 => 1.7031, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.83% (0.4994 => 0.5335, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.65% (0.5026 => 0.5360, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.5900 => 0.6292, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.60% (0.4361 => 0.4649, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.45% (0.4029 => 0.4289, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.21% (4.2109 => 4.4725, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.12% (0.3792 => 0.4024, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.04% (2.7292 => 2.8941, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (0.5000 => 0.5301, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (0.3930 => 0.4166, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 5.95% (1.0781 => 1.1422, std. dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.62% (5.5417 => 5.8534, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2875 => 0.3035, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2738 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.42% (0.2566 => 0.2705, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.2866 => 0.3020, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.35% (2.1013 => 2.2138, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.3004 => 0.3163, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.27% (0.2714 => 0.2857, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (1.9694 => 2.0726, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (1.9966 => 2.1004, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.17% (0.9909 => 1.0421, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.16% (0.2792 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.15% (0.2813 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.14% (0.2803 => 0.2947, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.13% (2.0673 => 2.1734, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.13% (0.2729 => 0.2869, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (0.3890 => 0.4088, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.2780 => 0.2920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.98% (0.2911 => 0.3056, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.98% (0.2811 => 0.2951, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (0.4658 => 0.4885, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.87% (0.3124 => 0.3276, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.79% (0.3258 => 0.3414, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.74% (0.3060 => 0.3205, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.72% (4.6177 => 4.8358, std. dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (4.4195 => 4.6250, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.63% (0.3282 => 0.3434, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (2.1653 => 2.2653, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3317 => 0.3470, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.59% (0.3903 => 0.4082, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.3845 => 0.4021, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (1.8794 => 1.9654, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 4.54% (0.3678 => 0.3845, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.3348 => 0.3500, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (0.3625 => 0.3789, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 4.50% (0.7875 => 0.8229, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.49% (0.3477 => 0.3633, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.49% (1.4269 => 1.4909, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 4.48% (0.3726 => 0.3893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.34% (0.4146 => 0.4326, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.31% (0.6634 => 0.6920, std. dev.: 0.0093) MultiSource/Applications/Burg/burg: 4.20% (0.5546 => 0.5779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.14% (0.4251 => 0.4427, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.12% (0.3690 => 0.3842, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.3981 => 0.4141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.3271 => 0.3402, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.00% (23.5202 => 24.4612, std. dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.82% (0.9697 => 1.0067, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.61% (0.5012 => 0.5193, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.3084 => 0.3192, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.6435 => 0.6642, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.65% (2.0346 => 2.0886, std. dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (0.4847 => 0.4953, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (0.7426 => 0.7533, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8948, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std. dev.: 0.0301) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6237, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1933, std. dev.: 0.0077) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5059, std. dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4548, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2870, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5998, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5633, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7891, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -3.01% (17.2379 => 16.7194, std. dev.: 0.0697) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.86% (0.6293 => 0.6176, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9578, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 19:24:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 21:24:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906022447.13DED2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3457?compare_to=3454&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3457, Order: 163277, Start Time: 2012-09-06 01:14:14, End Time: 2012-09-06 02:25:57 To: 3454, Order: 163267, Start Time: 2012-09-05 23:45:41, End Time: 2012-09-06 00:58:33 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (38 on baseline) Performance Improvements: 22 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 865 (822 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.87% (0.7542 => 0.7909, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.54% (0.2777 => 0.2903, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 8.35% (20.2146 => 21.9032, std. dev.: 0.6508) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.25% (0.7422 => 0.7812, std. dev.: 0.0072) SingleSource/Benchmarks/McGill/misr: 2.63% (0.4783 => 0.4909, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -3.09% (0.4300 => 0.4167, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: -3.03% (15.7772 => 15.2995, std. dev.: 0.1028) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.12% (0.7908 => 0.7740, std. dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -2.04% (2.2876 => 2.2409, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.91% (3.1168 => 3.0574, std. dev.: 0.0153) MultiSource/Applications/siod/siod: -1.88% (2.1323 => 2.0922, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: -1.80% (1.0948 => 1.0751, std. dev.: 0.0063) MultiSource/Applications/lua/lua: -1.76% (3.6156 => 3.5521, std. dev.: 0.0132) MultiSource/Applications/Burg/burg: -1.74% (1.1634 => 1.1431, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: -1.71% (14.7904 => 14.5375, std. dev.: 0.0730) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.64% (6.3231 => 6.2196, std. dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.49% (1.4568 => 1.4351, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.46% (1.2233 => 1.2054, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.45% (4.0799 => 4.0209, std. dev.: 0.0184) MultiSource/Applications/d/make_dparser: -1.18% (3.0781 => 3.0419, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -1.14% (14.7801 => 14.6122, std. dev.: 0.0499) MultiSource/Benchmarks/Bullet/bullet: -1.06% (29.9297 => 29.6126, std. dev.: 0.1206) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -22.41% (0.1798 => 0.1395, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.80% (4.6690 => 4.4918, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/bisort/bisort: -3.59% (0.6742 => 0.6500, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.57% (2.4284 => 2.3659, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: -1.18% (1.7261 => 1.7057, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.97% (2.1763 => 2.2409, std. dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 2.82% (1.1653 => 1.1982, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.40% (0.6173 => 0.6321, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 2.33% (1.0046 => 1.0280, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.32% (0.7639 => 0.7740, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.77% (0.0263 => 0.0386, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0228) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.71% (0.0766 => 0.0917, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 15.15% (1.7426 => 2.0066, std. dev.: 0.0251) SingleSource/Benchmarks/McGill/misr: 14.27% (0.4296 => 0.4909, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5496, std. dev.: 0.0224) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (62.4126 => 69.1491, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout/lists: 8.91% (7.0025 => 7.6263, std. dev.: 0.0300) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.85% (1.0063 => 1.0853, std. dev.: 0.0188) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.46% (0.2694 => 0.2895, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/methcall: 7.42% (8.5566 => 9.1913, std. dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/hash2: 6.83% (3.4876 => 3.7258, std. dev.: 0.0174) SingleSource/Benchmarks/McGill/chomp: 6.82% (1.0194 => 1.0889, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7356, std. dev.: 0.0783) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.69% (40.4792 => 42.7829, std. dev.: 0.7450) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.58% (4.2129 => 4.4478, std. dev.: 0.0459) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: 4.04% (15.2242 => 15.8400, std. dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.19% (0.3508 => 0.3620, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.67% (0.7609 => 0.7812, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.40% (8.5113 => 8.7157, std. dev.: 0.0710) MultiSource/Benchmarks/BitBench/five11/five11: 2.21% (5.1938 => 5.3085, std. dev.: 0.0241) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5319, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6758, std. dev.: 0.0269) MultiSource/Benchmarks/Olden/power/power: 1.13% (1.4184 => 1.4344, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (4.6414 => 4.6937, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.07% (0.2467 => 0.2342, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.28% (3.5980 => 3.5521, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.81% (0.3497 => 0.2105, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.01% (5.2665 => 4.2127, std. dev.: 0.1913) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.05% (1.1647 => 0.9894, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.33% (3.2007 => 2.9340, std. dev.: 0.0256) SingleSource/Benchmarks/Misc/richards_benchmark: -6.92% (1.4441 => 1.3442, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/pi: -6.18% (1.6538 => 1.5516, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.76% (9.2503 => 8.7174, std. dev.: 0.0412) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.12% (0.4140 => 0.3928, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4096, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0527) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.48% (1.7361 => 1.6756, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.26% (2.4457 => 2.3659, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.22% (3.7496 => 3.6288, std. dev.: 0.0429) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.09% (1.1683 => 1.1322, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -3.06% (7.6833 => 7.4485, std. dev.: 0.0177) MultiSource/Benchmarks/PAQ8p/paq8p: -2.81% (92.7467 => 90.1361, std. dev.: 0.1664) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std. dev.: 0.0063) MultiSource/Applications/siod/siod: -2.44% (3.5520 => 3.4652, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.07% (1.0686 => 1.0465, std. dev.: 0.0022) MultiSource/Applications/aha/aha: -1.88% (3.4286 => 3.3643, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2278, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: -1.58% (1.7330 => 1.7057, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -1.53% (3.8907 => 3.8312, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std. dev.: 0.0286) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 19:25:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 21:25:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906022557.5DC262A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3458?compare_to=3453&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3458, Order: 163276, Start Time: 2012-09-06 01:12:36, End Time: 2012-09-06 02:27:06 To: 3453, Order: 163263, Start Time: 2012-09-05 23:29:46, End Time: 2012-09-06 00:44:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.64% (2.0176 => 2.3937, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.72% (0.5818 => 0.6500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 11.67% (0.5748 => 0.6419, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3578 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.16% (0.3601 => 0.4003, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.14% (0.3646 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3623 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.97% (0.3663 => 0.4065, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.96% (0.3650 => 0.4050, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.85% (0.3789 => 0.4200, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3914 => 0.4335, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.4003 => 0.4427, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.53% (0.3940 => 0.4355, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.47% (0.7710 => 0.8517, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.55% (3.9660 => 4.3446, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 9.22% (1.3693 => 1.4956, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.95% (0.5265 => 0.5736, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.88% (1.2193 => 1.3276, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 8.79% (0.4062 => 0.4419, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.76% (0.9199 => 1.0005, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.41% (0.2781 => 0.3015, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.36% (0.1327 => 0.1438, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.31% (0.6959 => 0.7537, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 8.28% (0.7038 => 0.7621, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.25% (1.4563 => 1.5765, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.21% (1.1364 => 1.2297, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.13% (0.2127 => 0.2300, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.12% (0.1588 => 0.1717, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.91% (0.2782 => 0.3002, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 7.79% (0.7506 => 0.8091, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5577 => 0.6011, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.78% (13.8202 => 14.8956, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.3899 => 0.4202, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.74% (0.3489 => 0.3759, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4390 => 0.4728, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.64% (7.2180 => 7.7697, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.63% (1.9828 => 2.1341, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.58% (0.2914 => 0.3135, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3756 => 0.4040, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.53% (0.2655 => 0.2855, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3293 => 0.3541, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.50% (0.3107 => 0.3340, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.50% (0.2628 => 0.2825, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2765 => 0.2972, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.46% (0.2761 => 0.2967, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.46% (0.3580 => 0.3847, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.2937 => 0.3156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.37% (0.2726 => 0.2927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.37% (0.4016 => 0.4312, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.31% (0.2696 => 0.2893, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.3868 => 0.4143, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.09% (1.0313 => 1.1044, std. dev.: 0.0133) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 7.03% (0.2988 => 0.3198, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.02% (0.1865 => 0.1996, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3192 => 0.3416, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.99% (0.3246 => 0.3473, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.99% (0.6283 => 0.6722, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.80% (1.1061 => 1.1813, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 6.74% (0.8310 => 0.8870, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.70% (13.2842 => 14.1747, std. dev.: 0.0130) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.61% (0.3220 => 0.3433, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.41% (0.7460 => 0.7938, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 6.37% (3.8646 => 4.1107, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.28% (1.3245 => 1.4077, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.25% (3.6692 => 3.8987, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.24% (1.9270 => 2.0473, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.22% (1.3813 => 1.4672, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.21% (1.3819 => 1.4677, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (1.2749 => 1.3540, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.15% (0.6744 => 0.7159, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 6.04% (1.0594 => 1.1234, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.94% (3.1889 => 3.3783, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.91% (0.8818 => 0.9339, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 5.89% (2.1791 => 2.3074, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.87% (4.3801 => 4.6374, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.80% (4.4433 => 4.7012, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.77% (0.6135 => 0.6489, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.75% (0.2504 => 0.2648, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.47% (14.8535 => 15.6656, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.43% (16.6129 => 17.5153, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 5.34% (8.4961 => 8.9497, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.15% (1.1333 => 1.1917, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2703, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 4.97% (0.2859 => 0.3001, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2292 => 1.2890, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.44% (0.2321 => 0.2424, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4805 => 0.5016, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.36% (6.5754 => 6.8622, std. dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 4.33% (4.6629 => 4.8650, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.31% (3.2742 => 3.4154, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.9865 => 5.1918, std. dev.: 0.0197) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (0.9108 => 0.9481, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.83% (16.2614 => 16.8845, std. dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (1.5188 => 1.5762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.6250 => 0.6486, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (2.1007 => 2.1748, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.38% (3.7467 => 3.8734, std. dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (6.2785 => 6.4751, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.72% (33.2944 => 34.2004, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2667, std. dev.: 0.0440) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.12% (1.1560 => 1.2268, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.2619 => 11.7346, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.55% (10.7476 => 11.1289, std. dev.: 0.0241) SingleSource/Benchmarks/Misc/flops-6: 3.53% (1.9199 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6000, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9705, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5868, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.88% (0.4657 => 0.4057, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.59% (22.5627 => 21.5274, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2796, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.34% (1.3780 => 1.3182, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9232, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5823, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.06% (26.5159 => 25.9686, std. dev.: 0.0458) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2524, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2152, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5359, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5644, std. dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 19:57:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 21:57:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906025736.084C02A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3459?compare_to=3455&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3459, Order: 163279, Start Time: 2012-09-06 01:39:29, End Time: 2012-09-06 02:58:45 To: 3455, Order: 163267, Start Time: 2012-09-05 23:49:35, End Time: 2012-09-06 01:09:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (138 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 945 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.05% (78.3431 => 79.9511, std. dev.: 0.3072) SingleSource/Benchmarks/Misc/lowercase: 1.31% (7.9407 => 8.0446, std. dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.37% (14.0742 => 13.8813, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.31% (3.8532 => 3.8028, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.16% (3.8498 => 3.8050, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.90% (10.3673 => 13.8813, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 26.02% (0.1622 => 0.2044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.72% (0.3473 => 0.4019, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.38% (0.3497 => 0.4035, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.33% (0.3543 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.27% (0.3543 => 0.4084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.22% (0.3516 => 0.4051, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.14% (0.3561 => 0.4100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.70% (0.3694 => 0.4237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.26% (0.3828 => 0.4374, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.03% (0.3927 => 0.4478, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.90% (0.3886 => 0.4426, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.28% (2.2022 => 2.4727, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.15% (0.1432 => 0.1606, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.43% (0.1566 => 0.1745, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.16% (1.1194 => 1.2443, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.00% (1.7609 => 1.9370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.12% (0.6030 => 0.6580, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.65% (0.1584 => 0.1721, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.04% (0.3282 => 0.3546, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7326 => 0.7911, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.4615 => 0.4961, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.47% (7.0540 => 7.5808, std. dev.: 0.0116) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.31% (0.3817 => 0.4096, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.16% (10.4361 => 11.1830, std. dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.3177 => 0.3398, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.8172 => 0.8739, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.92% (0.3307 => 0.3536, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 6.77% (0.1655 => 0.1767, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.67% (0.1695 => 0.1808, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.23% (8.1363 => 8.6432, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (9.4845 => 10.0653, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.4879 => 0.5173, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.00% (0.7115 => 0.7542, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.95% (0.7835 => 0.8301, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 5.91% (0.2554 => 0.2705, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7433 => 0.7869, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.79% (0.3422 => 0.3620, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (4.2646 => 4.5099, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.69% (0.5569 => 0.5886, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.5105 => 0.5395, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.62% (0.2758 => 0.2913, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.3050 => 1.3776, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 5.55% (0.3423 => 0.3613, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2905 => 0.3066, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.5860 => 0.6181, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 5.44% (0.3109 => 0.3278, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.40% (0.2891 => 0.3047, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.5415 => 1.6242, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.35% (0.4636 => 0.4884, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.33% (1.5603 => 1.6434, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (4.9449 => 5.2065, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (5.0018 => 5.2654, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.18% (3.3354 => 3.5083, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/strcat: 5.16% (0.2831 => 0.2977, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.13% (0.3136 => 0.3297, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.12% (0.2871 => 0.3018, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.09% (2.0665 => 2.1716, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.08% (0.2872 => 0.3018, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3162 => 0.3322, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.3098 => 0.3254, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.01% (0.3650 => 0.3833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.01% (0.2877 => 0.3021, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.00% (0.6675 => 0.7009, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.99% (0.4289 => 0.4503, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 4.98% (0.3052 => 0.3204, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.9765 => 1.0250, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.94% (0.3865 => 0.4056, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3603 => 0.3779, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3232 => 0.3389, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2802 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.81% (0.3283 => 0.3441, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2793 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4203 => 0.4404, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2700 => 0.2829, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.75% (0.8067 => 0.8450, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.73% (0.3826 => 0.4007, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.72% (0.6456 => 0.6761, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.72% (0.4048 => 0.4239, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.63% (0.3935 => 0.4117, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.62% (0.3379 => 0.3535, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (14.3668 => 15.0287, std. dev.: 0.0166) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.59% (0.3684 => 0.3853, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.54% (1.1861 => 1.2400, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.5020 => 0.5247, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.49% (0.4299 => 0.4492, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.48% (1.1642 => 1.2164, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.46% (0.4620 => 0.4826, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.3092 => 0.3227, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 4.21% (3.8723 => 4.0354, std. dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 4.16% (0.3387 => 0.3528, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.09% (1.0722 => 1.1161, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.98% (2.0273 => 2.1080, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.94% (0.6450 => 0.6704, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.72% (5.7591 => 5.9733, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.66% (0.5981 => 0.6200, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 3.61% (0.8921 => 0.9243, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.38% (2.2969 => 2.3746, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.4186 => 1.4658, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.29% (0.3131 => 0.3234, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.2842 => 1.3246, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5859 => 1.6331, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.93% (17.1811 => 17.6845, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.78% (2.2024 => 2.2636, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.57% (21.9371 => 22.4999, std. dev.: 0.0207) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.1840 => 1.2127, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.24% (7.9617 => 8.1398, std. dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.8101 => 0.8235, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3806, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 4.62% (1.1396 => 1.1922, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.24% (4.2280 => 4.3648, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7458, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2432, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.14% (1.3045 => 1.3194, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7615, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.77% (5.2763 => 3.1779, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.39% (5.3855 => 3.8028, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.91% (5.3526 => 3.8050, std. dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0856, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.95% (2.9384 => 2.5580, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -8.97% (22.1758 => 20.1858, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.72% (19.9488 => 18.2094, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.20% (1.8329 => 1.7193, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0014) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1490, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5099, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9838, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4281, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9653, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1863, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -1.24% (1.2373 => 1.2220, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 20:52:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 22:52:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906035214.B6DFB2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3460?compare_to=3457&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3460, Order: 163281, Start Time: 2012-09-06 02:41:33, End Time: 2012-09-06 03:53:25 To: 3457, Order: 163277, Start Time: 2012-09-06 01:14:14, End Time: 2012-09-06 02:25:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (39 on baseline) Performance Improvements: 0 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (817 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.25% (0.1903 => 0.2003, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.78% (2.0233 => 2.0997, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (3.0574 => 3.1308, std. dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.4351 => 1.4692, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.76% (0.5796 => 0.5898, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 7.31% (3.6139 => 3.8782, std. dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.08% (59.1381 => 60.9605, std. dev.: 0.3051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.90% (42.7829 => 43.5959, std. dev.: 0.1664) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.85% (1.6003 => 1.6299, std. dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.75% (1.4190 => 1.4438, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.13% (1.2680 => 1.2823, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.01% (3.6288 => 3.6655, std. dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.01% (5.8760 => 5.9352, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (2.0317 => 2.0997, std. dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 3.09% (2.1763 => 2.2436, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.77% (0.6173 => 0.6344, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.4248 => 0.4358, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.97% (1.4408 => 1.4692, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.58% (0.0766 => 0.0939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 15.02% (1.7426 => 2.0044, std. dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.23% (4.0101 => 4.5808, std. dev.: 0.0126) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.18% (0.0917 => 0.1047, std. dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 12.72% (3.4406 => 3.8782, std. dev.: 0.0161) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/misr: 11.10% (0.4296 => 0.4773, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 10.67% (62.4126 => 69.0691, std. dev.: 0.0321) SingleSource/Benchmarks/Shootout/lists: 8.39% (7.0025 => 7.5902, std. dev.: 0.0315) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.70% (40.4792 => 43.5959, std. dev.: 0.1664) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.57% (0.2694 => 0.2898, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/methcall: 6.97% (8.5566 => 9.1534, std. dev.: 0.0342) SingleSource/Benchmarks/McGill/chomp: 6.85% (1.0194 => 1.0892, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.4876 => 3.7196, std. dev.: 0.0135) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.8000, std. dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/dt: 4.51% (0.9851 => 1.0295, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8283, std. dev.: 0.0531) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.79% (3.4080 => 3.5370, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (6.6312 => 6.8805, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.36% (2.6656 => 2.7552, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.19% (0.8498 => 0.8769, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.03% (0.5876 => 0.6054, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7239, std. dev.: 0.0792) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.6127 => 4.7083, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.36% (3.6254 => 3.6747, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6679, std. dev.: 0.0223) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.24% (2.4455 => 2.4758, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4346, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (4.6414 => 4.6943, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 1.10% (6.7458 => 6.8202, std. dev.: 0.0240) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -10.91% (0.1100 => 0.0980, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.52% (0.2080 => 0.1882, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.61% (0.3497 => 0.2077, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.56% (5.2665 => 4.1308, std. dev.: 0.0914) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.93% (1.1647 => 0.9908, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1613, std. dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.56% (3.2007 => 2.9267, std. dev.: 0.0565) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.86% (1.4441 => 1.3450, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.13% (2.9728 => 2.7906, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/methcall: -5.71% (9.2503 => 8.7223, std. dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4057, std. dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (3.9413 => 3.7641, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.18% (0.4140 => 0.3967, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.63% (1.2959 => 1.2489, std. dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.52% (2.4457 => 2.3596, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.36% (1.7361 => 1.6778, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.19% (1.2722 => 1.2316, std. dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: -2.91% (7.6833 => 7.4598, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2915, std. dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (92.7467 => 90.3242, std. dev.: 0.1870) MultiSource/Benchmarks/FreeBench/neural/neural: -2.36% (1.0926 => 1.0668, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.24% (3.7496 => 3.6655, std. dev.: 0.0109) MultiSource/Applications/siod/siod: -2.23% (3.5520 => 3.4727, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.02% (1.8739 => 1.8361, std. dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6119 => 0.6009, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: -1.78% (1.4117 => 1.3866, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2294, std. dev.: 0.0358) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -1.48% (1.7330 => 1.7074, std. dev.: 0.0095) MultiSource/Benchmarks/sim/sim: -1.43% (3.8907 => 3.8352, std. dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3149, std. dev.: 0.0363) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7687, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 21:08:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 23:08:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906040828.759A62A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3461?compare_to=3458&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3461, Order: 163281, Start Time: 2012-09-06 02:55:17, End Time: 2012-09-06 04:09:38 To: 3458, Order: 163276, Start Time: 2012-09-06 01:12:36, End Time: 2012-09-06 02:27:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.7158 => 56.5072, std. dev.: 0.0663) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.86% (2.0176 => 2.3981, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.32% (0.5818 => 0.6535, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.30% (0.5748 => 0.6455, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.19% (0.7061 => 0.7922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.77% (0.3578 => 0.3999, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3601 => 0.4013, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.44% (0.3646 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.36% (0.3663 => 0.4079, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3623 => 0.4033, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3650 => 0.4062, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.24% (0.3789 => 0.4215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.14% (0.3914 => 0.4350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.4003 => 0.4440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.84% (0.3940 => 0.4367, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.99% (0.7710 => 0.8480, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (3.9660 => 4.3439, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.39% (1.3693 => 1.4979, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 9.38% (0.4328 => 0.4734, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.87% (0.5265 => 0.5732, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2781 => 0.3026, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.70% (1.2193 => 1.3254, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.55% (0.2782 => 0.3020, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.50% (0.7038 => 0.7636, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 8.37% (0.4062 => 0.4402, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.34% (0.3489 => 0.3780, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.27% (0.3022 => 0.3272, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.26% (0.6959 => 0.7534, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.26% (0.3899 => 0.4221, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.21% (0.2765 => 0.2992, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.19% (0.2760 => 0.2986, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2726 => 0.2949, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.16% (0.3580 => 0.3872, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.15% (1.9828 => 2.1443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.14% (0.2690 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.14% (0.3293 => 0.3561, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.14% (0.2937 => 0.3176, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.14% (0.2655 => 0.2871, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.2721 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.10% (0.2988 => 0.3230, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.2607 => 0.2818, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.06% (0.1588 => 0.1716, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.03% (0.3485 => 0.3765, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.03% (1.1364 => 1.2277, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.00% (0.3149 => 0.3401, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.99% (0.2127 => 0.2297, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.99% (0.2628 => 0.2838, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.99% (0.3756 => 0.4056, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.97% (1.4563 => 1.5724, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 7.97% (0.2761 => 0.2981, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.92% (0.2966 => 0.3201, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.81% (13.8202 => 14.8997, std. dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.76% (0.5577 => 0.6010, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.72% (0.2696 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.69% (0.4016 => 0.4325, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.69% (0.3107 => 0.3346, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.60% (7.2180 => 7.7663, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (0.2914 => 0.3134, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.53% (0.7506 => 0.8071, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.52% (0.3868 => 0.4159, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.52% (0.3192 => 0.3432, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3453 => 0.3709, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.41% (0.3534 => 0.3796, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std. dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.07% (0.6283 => 0.6727, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.97% (0.1865 => 0.1995, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.95% (1.0313 => 1.1030, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.90% (0.3246 => 0.3470, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.87% (0.2023 => 0.2162, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.86% (0.2945 => 0.3147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.80% (13.2842 => 14.1872, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 6.78% (0.2243 => 0.2395, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.76% (0.8310 => 0.8872, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.5637 => 0.6016, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.70% (0.2925 => 0.3121, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 6.65% (1.1061 => 1.1797, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.58% (0.3220 => 0.3432, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.52% (0.4113 => 0.4381, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.47% (3.8646 => 4.1147, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.36% (1.3245 => 1.4087, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.23% (0.3755 => 0.3989, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.21% (0.6744 => 0.7163, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.19% (3.6692 => 3.8965, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 6.17% (1.9270 => 2.0459, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.17% (0.7460 => 0.7920, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.14% (1.3819 => 1.4667, std. dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 6.07% (1.2749 => 1.3523, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (1.3813 => 1.4645, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 6.01% (1.0594 => 1.1231, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.98% (3.1889 => 3.3797, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.90% (4.3801 => 4.6385, std. dev.: 0.0082) MultiSource/Applications/siod/siod: 5.89% (2.1791 => 2.3075, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.8698 => 0.9208, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.84% (4.4433 => 4.7026, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.6135 => 0.6491, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.79% (0.2504 => 0.2649, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.76% (0.8818 => 0.9326, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 5.61% (16.6129 => 17.5455, std. dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 5.52% (8.4961 => 8.9654, std. dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 5.43% (14.8535 => 15.6595, std. dev.: 0.0175) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2292 => 1.2944, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1333 => 1.1923, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.2859 => 0.3006, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.06% (14.5298 => 15.2653, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.45% (6.5754 => 6.8678, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 4.42% (4.6629 => 4.8690, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.35% (3.2742 => 3.4167, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6250 => 0.6511, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.11% (4.9865 => 5.1914, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.95% (0.9108 => 0.9468, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5780, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 3.78% (16.2614 => 16.8763, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.59% (2.1007 => 2.1762, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.42% (3.7467 => 3.8750, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.2785 => 6.4839, std. dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.2944 => 34.3076, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.52% (1.8175 => 2.2813, std. dev.: 0.0395) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.00% (1.1560 => 1.2254, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7340, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.36% (10.7476 => 11.1092, std. dev.: 0.0761) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5926, std. dev.: 0.0109) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.14% (1.4298 => 1.4461, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5867, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.60% (0.4657 => 0.4070, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.5627 => 21.5355, std. dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2633, std. dev.: 0.0422) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3192, std. dev.: 0.0076) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1490, std. dev.: 0.0112) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9248, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5714, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.96% (26.5159 => 25.9973, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2321, std. dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.93% (0.6615 => 0.6487, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2151, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.5928 => 4.5342, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2424, std. dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 21:45:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Sep 2012 23:45:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906044511.83D5C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3462?compare_to=3459&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3462, Order: 163287, Start Time: 2012-09-06 03:26:54, End Time: 2012-09-06 04:46:19 To: 3459, Order: 163279, Start Time: 2012-09-06 01:39:29, End Time: 2012-09-06 02:58:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (141 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.7524 => 56.4980, std. dev.: 0.1214) MultiSource/Benchmarks/llubenchmark/llu: 2.55% (3.7854 => 3.8820, std. dev.: 0.0219) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.48% (10.3673 => 13.8384, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 26.70% (0.1622 => 0.2055, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 15.09% (0.3473 => 0.3997, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3543 => 0.4064, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 14.67% (0.3497 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.62% (0.3543 => 0.4061, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.62% (0.3516 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.55% (0.3561 => 0.4079, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3694 => 0.4212, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.77% (0.3828 => 0.4355, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.60% (0.3927 => 0.4461, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 13.41% (0.3886 => 0.4407, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.90% (2.2022 => 2.4862, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 12.15% (0.1432 => 0.1606, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.94% (1.1194 => 1.2531, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.24% (0.1566 => 0.1742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.86% (1.7609 => 1.9521, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5925 => 0.6457, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: 8.71% (0.3282 => 0.3568, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.33% (0.1584 => 0.1716, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.02% (7.0540 => 7.6200, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 7.90% (0.7326 => 0.7905, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.47% (10.4361 => 11.2153, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 6.77% (0.1655 => 0.1767, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.76% (0.3817 => 0.4075, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8172 => 0.8717, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.4879 => 0.5203, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.43% (0.2271 => 0.2417, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4615 => 0.4905, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (9.4845 => 10.0623, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.08% (8.1363 => 8.6306, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 5.82% (0.7115 => 0.7529, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 5.76% (0.2554 => 0.2701, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5860 => 0.6191, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.64% (0.7835 => 0.8277, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.56% (0.5105 => 0.5389, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.51% (4.2646 => 4.4996, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.7433 => 0.7842, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 5.40% (0.3423 => 0.3608, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.3050 => 1.3755, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 5.34% (0.3109 => 0.3275, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.30% (1.5415 => 1.6232, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.5569 => 0.5864, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.27% (4.9449 => 5.2056, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 5.22% (3.3354 => 3.5096, std. dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.15% (5.0018 => 5.2596, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.11% (0.2758 => 0.2899, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.10% (1.5603 => 1.6399, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6675 => 0.7015, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2700 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.4064 => 0.4260, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2905 => 0.3045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2891 => 0.3029, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.76% (0.8067 => 0.8451, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.70% (0.4636 => 0.4854, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.68% (0.4103 => 0.4295, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.64% (0.9765 => 1.0218, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3098 => 0.3240, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (14.3668 => 15.0198, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.5020 => 0.5248, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.52% (0.3650 => 0.3815, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.46% (0.3162 => 0.3303, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.43% (0.3180 => 0.3321, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (2.0665 => 2.1580, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.42% (0.2872 => 0.2999, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.2831 => 0.2956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.39% (0.2756 => 0.2877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.39% (0.2871 => 0.2997, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.38% (0.4289 => 0.4477, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 4.37% (0.4299 => 0.4487, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3826 => 0.3993, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.3603 => 0.3760, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (1.1861 => 1.2375, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.4048 => 0.4223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.29% (0.3283 => 0.3424, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.3052 => 0.3183, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.29% (1.1642 => 1.2141, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4203 => 0.4383, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.22% (0.4620 => 0.4815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.21% (0.3232 => 0.3368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2793 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.18% (0.2802 => 0.2919, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3379 => 0.3520, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2877 => 0.2997, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.16% (0.3387 => 0.3528, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.14% (0.3935 => 0.4098, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 4.14% (0.3092 => 0.3220, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3441 => 0.3581, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.3684 => 0.3833, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.95% (3.8723 => 4.0254, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 3.86% (1.0722 => 1.1136, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.85% (5.7591 => 5.9809, std. dev.: 0.0084) MultiSource/Applications/treecc/treecc: 3.80% (2.0273 => 2.1043, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5981 => 0.6191, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 3.40% (0.8921 => 0.9224, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.4186 => 1.4641, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.10% (2.2969 => 2.3681, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (1.5859 => 1.6312, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.74% (17.1811 => 17.6513, std. dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3183, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (2.2024 => 2.2606, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.57% (21.9371 => 22.5002, std. dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (7.9617 => 8.1577, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.1840 => 1.2107, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.8101 => 0.8222, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 4.55% (1.1396 => 1.1914, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.11% (4.2280 => 4.3594, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7464, std. dev.: 0.0056) MultiSource/Benchmarks/llubenchmark/llu: 2.75% (3.7781 => 3.8820, std. dev.: 0.0219) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2396, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.27% (1.3045 => 1.3211, std. dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6819, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.40% (5.2763 => 3.1974, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.79% (5.3855 => 3.8348, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.45% (5.3526 => 3.8300, std. dev.: 0.0091) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1375, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.28% (2.9384 => 2.5777, std. dev.: 0.0223) MultiSource/Applications/ClamAV/clamscan: -8.97% (22.1758 => 20.1866, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3039, std. dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.27% (1.8329 => 1.7179, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0009) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1490, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -3.06% (1.2373 => 1.1994, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9985, std. dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.6802 => 8.4417, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9606, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -2.29% (12.4730 => 12.1877, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5080, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2195, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std. dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 22:13:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 00:13:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906051350.DFAD62A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3463?compare_to=3456&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3463, Order: 163281, Start Time: 2012-09-06 02:31:09, End Time: 2012-09-06 05:15:00 To: 3456, Order: 163263, Start Time: 2012-09-05 23:19:30, End Time: 2012-09-06 02:03:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.08% (1.0421 => 1.0534, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.03% (1.0067 => 1.0171, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.23% (125.6420 => 130.9527, std. dev.: 0.4393) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 16.40% (0.3446 => 0.4011, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 16.30% (0.3496 => 0.4066, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 16.18% (0.3442 => 0.3999, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 16.16% (0.3465 => 0.4025, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 16.13% (0.3460 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.08% (0.3488 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 16.06% (0.3469 => 0.4026, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 15.43% (0.3643 => 0.4205, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.34% (0.3650 => 0.4210, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.04% (0.3724 => 0.4284, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5826 => 0.6422, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 10.12% (0.5889 => 0.6485, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.63% (0.1620 => 0.1776, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.65% (0.1619 => 0.1759, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7171 => 0.7765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (3.5627 => 3.8389, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.43% (1.6211 => 1.7415, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.02% (1.3152 => 1.4075, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.93% (0.4361 => 0.4663, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.83% (0.4029 => 0.4304, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2875 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.57% (0.5026 => 0.5356, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.54% (0.3792 => 0.4040, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.54% (0.2738 => 0.2917, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.5900 => 0.6284, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.46% (0.3004 => 0.3198, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.45% (1.5932 => 1.6959, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.37% (2.7292 => 2.9030, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.36% (0.3930 => 0.4180, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2813 => 0.2991, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.31% (0.9909 => 1.0534, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2792 => 0.2968, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2729 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.29% (0.2750 => 0.2923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.23% (0.2823 => 0.2999, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.22% (0.5000 => 0.5311, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2803 => 0.2977, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.21% (0.4994 => 0.5304, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3195 => 0.3393, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 6.17% (4.2109 => 4.4709, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.15% (0.2811 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.12% (0.2780 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.07% (2.0673 => 2.1927, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/wc: 6.04% (0.3096 => 0.3283, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.01% (0.2911 => 0.3086, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.85% (0.3348 => 0.3544, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.78% (0.3060 => 0.3237, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.78% (1.0781 => 1.1404, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3267 => 0.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3317 => 0.3507, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3124 => 0.3301, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.63% (0.2736 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.2866 => 0.3027, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.62% (0.3258 => 0.3441, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.56% (0.3362 => 0.3549, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (0.3625 => 0.3823, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.42% (0.3726 => 0.3928, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3282 => 0.3458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3477 => 0.3663, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (1.9694 => 2.0745, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 5.33% (0.3678 => 0.3874, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.3845 => 0.4049, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (1.9966 => 2.1019, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 5.26% (5.5417 => 5.8330, std. dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 5.22% (2.1013 => 2.2109, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.15% (0.4658 => 0.4898, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (0.3890 => 0.4088, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (0.4251 => 0.4464, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.99% (0.3690 => 0.3874, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.89% (0.9697 => 1.0171, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.87% (0.2566 => 0.2691, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (4.4195 => 4.6338, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.85% (0.3981 => 0.4174, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.3903 => 0.4091, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.74% (0.4139 => 0.4335, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.69% (4.6177 => 4.8343, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (2.1653 => 2.2667, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 4.48% (1.4269 => 1.4908, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (1.8794 => 1.9619, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 4.37% (0.7875 => 0.8219, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 4.30% (23.5202 => 24.5304, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.3271 => 0.3411, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.24% (0.2969 => 0.3095, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.13% (0.2737 => 0.2850, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.09% (0.5012 => 0.5217, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 4.04% (0.5546 => 0.5770, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.87% (0.6634 => 0.6891, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.73% (0.6435 => 0.6675, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.73% (0.3084 => 0.3199, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.66% (0.3336 => 0.3458, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.54% (2.0346 => 2.0862, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.29% (0.4847 => 0.4958, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6708, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8879, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6297, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2034, std. dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std. dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4357, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2856, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5972, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4623, std. dev.: 0.0208) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5545, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: -10.20% (0.2402 => 0.2157, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7905, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7960, std. dev.: 0.0100) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.69% (0.6293 => 0.6124, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -2.43% (17.2379 => 16.8194, std. dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9567, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 22:19:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 00:19:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906051908.84E772A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3464?compare_to=3460&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3464, Order: 163290, Start Time: 2012-09-06 04:09:02, End Time: 2012-09-06 05:20:19 To: 3460, Order: 163281, Start Time: 2012-09-06 02:41:33, End Time: 2012-09-06 03:53:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (41 on baseline) Performance Improvements: 2 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.73% (0.0980 => 0.1095, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.98% (0.1270 => 0.1384, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.94% (0.1714 => 0.1833, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.31% (0.5337 => 0.5674, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.7078 => 0.7290, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.57% (1.3435 => 1.3914, std. dev.: 0.0083) SingleSource/Benchmarks/McGill/misr: 2.35% (0.4773 => 0.4885, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.19% (2.0997 => 2.0327, std. dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.14% (43.5959 => 42.6618, std. dev.: 0.1613) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.32% (2.1763 => 2.2486, std. dev.: 0.0241) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.1653 => 1.2022, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.74% (0.6173 => 0.6342, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 2.59% (1.0046 => 1.0306, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.69% (1.1440 => 1.1633, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 1.25% (13.3238 => 13.4902, std. dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 1.18% (29.3170 => 29.6636, std. dev.: 0.0430) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.39% (0.0263 => 0.0385, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0358) SingleSource/Benchmarks/Shootout/ary3: 15.14% (1.7426 => 2.0065, std. dev.: 0.0574) SingleSource/Benchmarks/McGill/misr: 13.71% (0.4296 => 0.4885, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.34% (4.0101 => 4.5451, std. dev.: 0.0233) MultiSource/Applications/sgefa/sgefa: 12.73% (0.3746 => 0.4223, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 12.22% (3.4406 => 3.8610, std. dev.: 0.0480) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1052, std. dev.: 0.0254) SingleSource/Benchmarks/McGill/chomp: 8.63% (1.0194 => 1.1074, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 8.52% (7.0025 => 7.5989, std. dev.: 0.0713) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.28% (0.2694 => 0.2917, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/methcall: 7.35% (8.5566 => 9.1857, std. dev.: 0.0372) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.32% (1.0063 => 1.0800, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (3.4876 => 3.7244, std. dev.: 0.0128) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7386, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.3301 => 0.3484, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.39% (40.4792 => 42.6618, std. dev.: 0.1613) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.75% (4.2129 => 4.4132, std. dev.: 0.0635) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8224, std. dev.: 0.0527) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.36% (0.5587 => 0.5775, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.29% (2.6656 => 2.7532, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.16% (0.3508 => 0.3619, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7239, std. dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.40% (0.5876 => 0.6017, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: 1.90% (5.1938 => 5.2925, std. dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: 1.87% (6.7458 => 6.8719, std. dev.: 0.0249) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (2.4971 => 2.5333, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6665, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.16% (1.6110 => 1.6297, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.6254 => 3.6628, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.11% (8.9977 => 8.7178, std. dev.: 0.0937) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.26% (0.3497 => 0.2089, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.07% (5.2665 => 4.1044, std. dev.: 0.0547) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.90% (1.1647 => 0.9912, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std. dev.: 0.0331) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.86% (3.2007 => 2.9491, std. dev.: 0.0307) SingleSource/Benchmarks/Misc/richards_benchmark: -7.11% (1.4441 => 1.3414, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: -6.66% (9.2503 => 8.6341, std. dev.: 0.1083) SingleSource/Benchmarks/Misc/pi: -6.35% (1.6538 => 1.5488, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std. dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0309) MultiSource/Applications/SPASS/SPASS: -4.50% (8.5323 => 8.1483, std. dev.: 0.1262) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.40% (45.4683 => 43.4656, std. dev.: 0.3854) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.96% (1.2959 => 1.2446, std. dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.51% (2.4457 => 2.3599, std. dev.: 0.0197) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4140 => 0.4017, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -2.93% (7.6833 => 7.4580, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.86% (1.7361 => 1.6865, std. dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (92.7467 => 90.1507, std. dev.: 0.7632) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1360, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.31% (3.7496 => 3.6629, std. dev.: 0.0082) MultiSource/Applications/siod/siod: -2.23% (3.5520 => 3.4728, std. dev.: 0.0075) MultiSource/Applications/aha/aha: -1.80% (3.4286 => 3.3669, std. dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2297, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.57% (1.8739 => 1.8445, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: -1.49% (1.4117 => 1.3907, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7658, std. dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.3569 => 2.3253, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: -1.13% (1.7330 => 1.7134, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.01% (1.1116 => 1.1004, std. dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 22:50:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 00:50:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906055059.C5BD52A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3465?compare_to=3461&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3465, Order: 163290, Start Time: 2012-09-06 04:37:41, End Time: 2012-09-06 05:52:09 To: 3461, Order: 163281, Start Time: 2012-09-06 02:55:17, End Time: 2012-09-06 04:09:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.42% (2.0176 => 2.4094, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.32% (0.1410 => 0.1626, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.65% (0.5818 => 0.6554, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.36% (0.7061 => 0.7934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.28% (0.5748 => 0.6454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3578 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.05% (0.3601 => 0.4035, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 12.01% (0.3663 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.93% (0.3646 => 0.4081, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.84% (0.3623 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.82% (0.3789 => 0.4237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.81% (0.3650 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3914 => 0.4369, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.35% (0.3940 => 0.4387, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.32% (0.4003 => 0.4456, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.32% (0.7710 => 0.8506, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.89% (3.9660 => 4.3581, std. dev.: 0.0107) MultiSource/Applications/hbd/hbd: 9.74% (1.3693 => 1.5027, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.09% (1.2193 => 1.3301, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.99% (0.4328 => 0.4717, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5265 => 0.5738, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.84% (0.9199 => 1.0012, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 8.75% (0.7038 => 0.7654, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.56% (0.1588 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.52% (0.6959 => 0.7552, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.44% (1.4563 => 1.5792, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.44% (1.1364 => 1.2323, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2782 => 0.3014, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.32% (0.4062 => 0.4400, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.31% (0.1589 => 0.1721, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.20% (0.4379 => 0.4738, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.5577 => 0.6034, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 8.13% (13.8202 => 14.9441, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.13% (0.3899 => 0.4216, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.06% (0.4791 => 0.5177, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.04% (0.3022 => 0.3265, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.01% (0.1435 => 0.1550, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.99% (0.3293 => 0.3556, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.94% (0.3489 => 0.3766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2690 => 0.2903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.91% (7.2180 => 7.7891, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.91% (0.3756 => 0.4053, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.90% (0.2607 => 0.2813, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2760 => 0.2978, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.86% (0.7506 => 0.8096, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.86% (0.2966 => 0.3199, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.84% (1.9828 => 2.1383, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.83% (0.2655 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3580 => 0.3859, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.2914 => 0.3141, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.76% (0.2628 => 0.2832, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2761 => 0.2972, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.63% (0.2937 => 0.3161, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.61% (0.2995 => 0.3223, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2765 => 0.2975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.47% (0.3868 => 0.4157, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4016 => 0.4316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.46% (0.6283 => 0.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.46% (0.2988 => 0.3211, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.42% (0.2696 => 0.2896, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.39% (1.0313 => 1.1075, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.18% (0.3453 => 0.3701, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.18% (0.3246 => 0.3479, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (13.2842 => 14.2374, std. dev.: 0.0193) MultiSource/Benchmarks/McCat/05-eks/eks: 7.15% (0.4113 => 0.4407, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.15% (0.8310 => 0.8904, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.13% (0.3534 => 0.3786, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.94% (1.1061 => 1.1829, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.89% (0.3220 => 0.3442, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.87% (0.2925 => 0.3126, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.78% (3.6692 => 3.9181, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 6.71% (3.8646 => 4.1238, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.66% (0.8818 => 0.9405, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.63% (0.6744 => 0.7191, std. dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: 6.60% (1.2749 => 1.3591, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 6.59% (0.2945 => 0.3139, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.58% (1.3245 => 1.4117, std. dev.: 0.0106) MultiSource/Applications/treecc/treecc: 6.55% (1.9270 => 2.0532, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 6.46% (1.0594 => 1.1278, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.32% (1.3819 => 1.4693, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.31% (4.4433 => 4.7236, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.30% (4.3801 => 4.6561, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.30% (0.7460 => 0.7930, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.26% (3.1889 => 3.3885, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.21% (0.6135 => 0.6516, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 6.13% (2.1791 => 2.3126, std. dev.: 0.0139) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4658, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.02% (14.8535 => 15.7483, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.3755 => 0.3978, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (0.8698 => 0.9211, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.81% (8.4961 => 8.9894, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.69% (16.6129 => 17.5574, std. dev.: 0.0191) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.49% (1.1333 => 1.1955, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.44% (14.5298 => 15.3205, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.21% (0.2859 => 0.3008, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2917, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.95% (0.4805 => 0.5043, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.87% (6.5754 => 6.8955, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (3.2742 => 3.4315, std. dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 4.65% (4.6629 => 4.8798, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.52% (0.9108 => 0.9520, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.48% (0.2321 => 0.2425, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.26% (4.9865 => 5.1989, std. dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 4.19% (16.2614 => 16.9425, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.95% (1.5188 => 1.5788, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.1007 => 2.1794, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 3.68% (3.7467 => 3.8846, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.2785 => 6.5085, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 3.09% (33.2944 => 34.3248, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0498) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.1560 => 1.2272, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7339, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.54% (10.7476 => 11.1281, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5926, std. dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4459, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5876, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.22% (0.4657 => 0.4088, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.24% (22.5627 => 21.6067, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2694, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.26% (1.3780 => 1.3193, std. dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1496, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9224, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5865, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4831, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.16% (26.5159 => 25.9434, std. dev.: 0.0273) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2167, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5358, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 23:32:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 01:32:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906063234.CF7582A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3466?compare_to=3462&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3466, Order: 163290, Start Time: 2012-09-06 05:14:25, End Time: 2012-09-06 06:33:44 To: 3462, Order: 163287, Start Time: 2012-09-06 03:26:54, End Time: 2012-09-06 04:46:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.06% (0.4116 => 0.4777, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.55% (3.8820 => 3.7831, std. dev.: 0.0254) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.51% (10.3673 => 13.8417, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 26.70% (0.1622 => 0.2055, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 15.00% (0.3473 => 0.3994, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.82% (0.3543 => 0.4068, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 14.64% (0.3497 => 0.4009, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.59% (0.3516 => 0.4029, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.56% (0.3543 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.52% (0.3561 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3694 => 0.4212, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.77% (0.3828 => 0.4355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.36% (0.3886 => 0.4405, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (2.2022 => 2.4849, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: 12.29% (0.1432 => 0.1608, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.99% (1.1194 => 1.2536, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.30% (0.1566 => 0.1743, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.84% (1.7609 => 1.9518, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.40% (0.1584 => 0.1717, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.95% (7.0540 => 7.6147, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7326 => 0.7878, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 7.52% (10.4361 => 11.2209, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 6.89% (0.1655 => 0.1769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.76% (0.3817 => 0.4075, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.8172 => 0.8718, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.44% (0.3307 => 0.3520, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.43% (0.2271 => 0.2417, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4615 => 0.4904, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.14% (9.4845 => 10.0669, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.01% (8.1363 => 8.6251, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: 5.87% (0.7835 => 0.8295, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: 5.80% (0.7115 => 0.7528, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 5.61% (0.7433 => 0.7850, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.60% (0.5105 => 0.5391, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (4.2646 => 4.5011, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 5.52% (0.3423 => 0.3612, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.39% (0.5860 => 0.6176, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.38% (1.3050 => 1.3752, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.5569 => 0.5868, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.31% (0.3109 => 0.3274, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.18% (0.6675 => 0.7021, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.18% (1.5603 => 1.6411, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.14% (0.3422 => 0.3598, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14% (1.5415 => 1.6207, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.14% (5.0018 => 5.2587, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (4.9449 => 5.1982, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2758 => 0.2898, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.05% (3.3354 => 3.5039, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2700 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2905 => 0.3045, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.4064 => 0.4259, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.8067 => 0.8454, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.75% (0.9765 => 1.0229, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.70% (0.2891 => 0.3027, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.70% (0.4636 => 0.4854, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.68% (0.4103 => 0.4295, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.3180 => 0.3327, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.59% (0.4289 => 0.4486, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (14.3668 => 15.0151, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.3098 => 0.3236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.45% (0.2831 => 0.2957, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.45% (0.6456 => 0.6743, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3650 => 0.3812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.43% (0.2756 => 0.2878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.42% (0.2871 => 0.2998, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.42% (0.2872 => 0.2999, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.41% (2.0665 => 2.1577, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 4.41% (1.1642 => 1.2155, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.5020 => 0.5241, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3162 => 0.3301, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3826 => 0.3993, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.35% (0.4299 => 0.4486, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.35% (0.3865 => 0.4033, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3232 => 0.3371, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.30% (1.1861 => 1.2371, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2793 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.3052 => 0.3183, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3603 => 0.3757, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.27% (0.3092 => 0.3224, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4203 => 0.4382, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.25% (0.2802 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.21% (0.3441 => 0.3586, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.20% (0.4048 => 0.4218, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2877 => 0.2997, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.16% (0.3387 => 0.3528, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.14% (0.3935 => 0.4098, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.11% (0.3283 => 0.3418, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3684 => 0.3835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4620 => 0.4808, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.05% (3.8723 => 4.0291, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6450 => 0.6707, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.94% (0.3379 => 0.3512, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.88% (2.0273 => 2.1060, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 3.86% (1.0722 => 1.1136, std. dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 3.86% (5.7591 => 5.9814, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.46% (0.5981 => 0.6188, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.41% (0.8921 => 0.9225, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.39% (2.2969 => 2.3748, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.4186 => 1.4651, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.5859 => 1.6315, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.79% (17.1811 => 17.6598, std. dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 2.64% (1.2842 => 1.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.2024 => 2.2590, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.55% (21.9371 => 22.4967, std. dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (7.9617 => 8.1618, std. dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 2.29% (1.1840 => 1.2111, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.8101 => 0.8223, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3834, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 4.69% (1.1396 => 1.1930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7605, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (4.2280 => 4.3663, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2462, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.37% (5.2763 => 3.1992, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.83% (5.3855 => 3.8329, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.41% (5.3526 => 3.8320, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1028, std. dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.28% (2.9384 => 2.5777, std. dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: -8.91% (22.1758 => 20.2006, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (19.9488 => 18.2382, std. dev.: 0.0484) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.25% (1.8329 => 1.7184, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.97% (1.6805 => 1.6138, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4110, std. dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5074, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0049, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9636, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -2.30% (1.2373 => 1.2088, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1864, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 5 23:50:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 01:50:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906065055.36E922A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3467?compare_to=3464&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3467, Order: 163292, Start Time: 2012-09-06 05:40:43, End Time: 2012-09-06 06:52:06 To: 3464, Order: 163290, Start Time: 2012-09-06 04:09:02, End Time: 2012-09-06 05:20:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (40 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 889 (819 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.65% (0.4408 => 0.4569, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.17% (21.1200 => 23.9011, std. dev.: 0.3464) SingleSource/Benchmarks/Misc/ffbench: 1.58% (1.3907 => 1.4127, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.42% (1.1653 => 1.2051, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 3.30% (2.1763 => 2.2482, std. dev.: 0.0128) MultiSource/Applications/minisat/minisat: 2.93% (0.6173 => 0.6354, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 2.54% (1.0046 => 1.0301, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.5150 => 1.5487, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.76% (0.0766 => 0.0925, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0534) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.38% (4.0101 => 4.5468, std. dev.: 0.0725) SingleSource/Benchmarks/McGill/misr: 13.31% (0.4296 => 0.4868, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 12.89% (21.1721 => 23.9011, std. dev.: 0.3464) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8792, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 12.73% (0.3746 => 0.4223, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (62.4126 => 69.1093, std. dev.: 0.0246) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 8.48% (7.0025 => 7.5964, std. dev.: 0.0470) SingleSource/Benchmarks/Stanford/Puzzle: 7.68% (0.1433 => 0.1543, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/methcall: 7.25% (8.5566 => 9.1773, std. dev.: 0.0442) SingleSource/Benchmarks/McGill/chomp: 7.17% (1.0194 => 1.0925, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (0.3301 => 0.3521, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (3.4876 => 3.7163, std. dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7358, std. dev.: 0.0694) SingleSource/Benchmarks/Misc/fp-convert: 4.46% (15.2242 => 15.9028, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/dt: 4.27% (0.9851 => 1.0272, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.54% (0.5587 => 0.5785, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.13% (2.6656 => 2.7491, std. dev.: 0.0227) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7145, std. dev.: 0.0690) MultiSource/Benchmarks/BitBench/five11/five11: 2.33% (5.1938 => 5.3146, std. dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/hash: 2.28% (0.6308 => 0.6452, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (2.4455 => 2.4892, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 1.77% (2.3453 => 2.3868, std. dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5319, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (4.6414 => 4.6903, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.01% (3.6254 => 3.6619, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.38% (0.3497 => 0.2120, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.09% (5.2665 => 4.1029, std. dev.: 0.1248) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.05% (1.1647 => 0.9894, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std. dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9334, std. dev.: 0.0260) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.4441 => 1.3425, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -6.42% (9.2503 => 8.6562, std. dev.: 0.0506) SingleSource/Benchmarks/Misc/pi: -6.32% (1.6538 => 1.5493, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std. dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: -4.86% (8.5323 => 8.1176, std. dev.: 0.1430) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7619, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.49% (0.4140 => 0.3954, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.35% (1.7361 => 1.6605, std. dev.: 0.0107) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.42% (1.2722 => 1.2287, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.16% (1.1683 => 1.1314, std. dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.10% (3.7496 => 3.6332, std. dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: -3.09% (7.6833 => 7.4458, std. dev.: 0.0371) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2840, std. dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -2.41% (92.7467 => 90.5144, std. dev.: 0.1401) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.91% (2.8964 => 2.8411, std. dev.: 0.0029) MultiSource/Applications/siod/siod: -1.85% (3.5520 => 3.4862, std. dev.: 0.0093) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3664, std. dev.: 0.0212) MultiSource/Benchmarks/sim/sim: -1.81% (3.8907 => 3.8204, std. dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.48% (9.3855 => 9.2470, std. dev.: 0.0334) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7655, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.41% (25.6658 => 25.3050, std. dev.: 0.0251) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.3569 => 2.3252, std. dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 00:37:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 02:37:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906073706.557F02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3468?compare_to=3465&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3468, Order: 163292, Start Time: 2012-09-06 06:20:11, End Time: 2012-09-06 07:38:15 To: 3465, Order: 163290, Start Time: 2012-09-06 04:37:41, End Time: 2012-09-06 05:52:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (745 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.21% (2.0176 => 2.3851, std. dev.: 0.0248) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.15% (0.5818 => 0.6525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.08% (0.7061 => 0.7914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.07% (0.3578 => 0.4010, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.97% (0.5748 => 0.6436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.79% (0.3646 => 0.4076, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.77% (0.3601 => 0.4025, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.62% (0.3650 => 0.4074, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.58% (0.3663 => 0.4087, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.57% (0.3623 => 0.4042, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3789 => 0.4225, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.27% (0.3914 => 0.4355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.02% (0.4003 => 0.4444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.99% (0.3940 => 0.4373, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0052) MultiSource/Applications/hbd/hbd: 9.95% (1.3693 => 1.5056, std. dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/hash2: 9.47% (0.4328 => 0.4738, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.47% (3.9660 => 4.3416, std. dev.: 0.1172) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std. dev.: 0.0162) SingleSource/Regression/C++/ofstream_ctor: 9.24% (0.2781 => 0.3038, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.16% (0.4062 => 0.4434, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.99% (0.7038 => 0.7671, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9199 => 1.0019, std. dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.88% (0.2782 => 0.3029, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.83% (1.2193 => 1.3270, std. dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.61% (0.2765 => 0.3003, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2607 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3022 => 0.3277, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.44% (0.6959 => 0.7546, std. dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/except: 8.41% (0.2760 => 0.2992, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.40% (0.2690 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.40% (0.2655 => 0.2878, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.38% (1.9828 => 2.1490, std. dev.: 0.0481) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.38% (1.4563 => 1.5783, std. dev.: 0.0392) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2628 => 0.2848, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.34% (0.3489 => 0.3780, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.3899 => 0.4224, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.33% (0.3756 => 0.4069, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 8.33% (0.2726 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.32% (0.3293 => 0.3567, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.31% (0.2937 => 0.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.29% (0.2761 => 0.2990, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 8.26% (0.3149 => 0.3409, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3485 => 0.3771, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.16% (0.2966 => 0.3208, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 8.13% (0.2988 => 0.3231, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.09% (1.1364 => 1.2283, std. dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.05% (0.2696 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.04% (0.3580 => 0.3868, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3107 => 0.3355, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.87% (0.4016 => 0.4332, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.81% (0.3868 => 0.4170, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.78% (13.8202 => 14.8961, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary2: 7.77% (0.3192 => 0.3440, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4379 => 0.4718, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (7.2180 => 7.7733, std. dev.: 0.1801) SingleSource/Benchmarks/Shootout-C++/sieve: 7.65% (0.3453 => 0.3717, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.62% (0.1588 => 0.1709, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.62% (0.4791 => 0.5156, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.59% (0.4390 => 0.4723, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 7.50% (0.7506 => 0.8069, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.47% (0.3534 => 0.3798, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.11% (0.6283 => 0.6730, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.01% (0.2995 => 0.3205, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.98% (1.0313 => 1.1033, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.2945 => 0.3150, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.83% (1.1061 => 1.1816, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8310 => 0.8874, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3755 => 0.3997, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.30% (0.6744 => 0.7169, std. dev.: 0.0144) MultiSource/Benchmarks/nbench/nbench: 6.26% (1.0594 => 1.1257, std. dev.: 0.0235) MultiSource/Applications/treecc/treecc: 6.25% (1.9270 => 2.0474, std. dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (1.2749 => 1.3540, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (1.3813 => 1.4661, std. dev.: 0.0263) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.02% (0.8698 => 0.9222, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 6.00% (3.1889 => 3.3802, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 5.90% (2.1791 => 2.3077, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.79% (0.2504 => 0.2649, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.77% (0.8818 => 0.9327, std. dev.: 0.0184) MultiSource/Applications/JM/lencod/lencod: 5.51% (14.8535 => 15.6716, std. dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 5.38% (8.4961 => 8.9535, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.15% (14.5298 => 15.2784, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.45% (6.5754 => 6.8680, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.25% (3.2742 => 3.4132, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 4.22% (4.6629 => 4.8598, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.9865 => 5.1920, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6250 => 0.6506, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 3.89% (16.2614 => 16.8937, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5188 => 1.5766, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (2.1007 => 2.1736, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.81% (33.2944 => 34.2286, std. dev.: 0.0381) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.1560 => 1.2270, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7342, std. dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.68% (10.7476 => 11.1434, std. dev.: 0.0275) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6010, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6138, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5173, std. dev.: 0.0407) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5852, std. dev.: 0.0098) MultiSource/Applications/lemon/lemon: 1.03% (1.4298 => 1.4445, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.43% (0.4657 => 0.4078, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.5627 => 21.5384, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2657, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.96% (1.3780 => 1.3234, std. dev.: 0.0043) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1490, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9244, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0198) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5871, std. dev.: 0.0906) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3305 => 7.1998, std. dev.: 0.0387) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2477, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5358, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 01:17:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 03:17:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906081757.2F3012A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3469?compare_to=3467&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3469, Order: 163293, Start Time: 2012-09-06 07:07:31, End Time: 2012-09-06 08:19:07 To: 3467, Order: 163292, Start Time: 2012-09-06 05:40:43, End Time: 2012-09-06 06:52:06 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (44 on baseline) Performance Improvements: 2 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.7208 => 0.7380, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.15% (3.9895 => 4.1152, std. dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 1.56% (1.9882 => 2.0192, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.10% (1.6605 => 1.6787, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -2.61% (0.3869 => 0.3768, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.27% (1.8605 => 1.8369, std. dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.43% (0.1414 => 0.1519, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 3.18% (2.1763 => 2.2456, std. dev.: 0.0193) MultiSource/Applications/minisat/minisat: 3.05% (0.6173 => 0.6361, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 3.00% (1.0046 => 1.0347, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (12.6413 => 12.9739, std. dev.: 0.0464) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.13% (0.7226 => 0.7380, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.53% (0.0263 => 0.0388, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9981, std. dev.: 0.0208) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.07% (0.0917 => 0.1046, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.62% (4.0101 => 4.5564, std. dev.: 0.0160) SingleSource/Benchmarks/McGill/misr: 13.34% (0.4296 => 0.4869, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 12.68% (3.4406 => 3.8769, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.67% (62.4126 => 69.0731, std. dev.: 0.0280) SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1433 => 0.1583, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.76% (1.0063 => 1.0945, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout/lists: 8.49% (7.0025 => 7.5973, std. dev.: 0.0266) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.76% (0.2694 => 0.2903, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 7.15% (1.0194 => 1.0923, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/methcall: 7.10% (8.5566 => 9.1642, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.4876 => 3.7200, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (27.1724 => 28.8411, std. dev.: 0.0747) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.55% (40.4792 => 42.7257, std. dev.: 0.4298) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7899, std. dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8734, std. dev.: 0.0149) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.29% (2.6656 => 2.7532, std. dev.: 0.0178) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.19% (0.3508 => 0.3620, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 2.47% (8.5113 => 8.7216, std. dev.: 0.0793) SingleSource/Benchmarks/Shootout-C++/hash: 1.73% (0.6308 => 0.6417, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.4455 => 2.4870, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.68% (4.6127 => 4.6901, std. dev.: 0.0276) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5337, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.36% (14.4877 => 14.6848, std. dev.: 0.0214) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.21% (4.0659 => 4.1152, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.12% (6.7458 => 6.8214, std. dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.09% (3.6254 => 3.6649, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6908, std. dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -24.40% (0.0414 => 0.0313, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.71% (5.2665 => 4.1234, std. dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.87% (1.1647 => 0.9915, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (1.4034 => 1.2852, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.96% (3.2007 => 2.9459, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: -6.91% (1.4441 => 1.3443, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -6.27% (9.2503 => 8.6707, std. dev.: 0.0509) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/fibo: -5.01% (4.6355 => 4.4034, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -4.98% (8.5323 => 8.1076, std. dev.: 0.1606) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7619, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.03% (2.4457 => 2.3471, std. dev.: 0.0228) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.84% (0.4140 => 0.3981, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.31% (1.7361 => 1.6787, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.2722 => 1.2317, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.98% (1.1683 => 1.1335, std. dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -2.86% (7.6833 => 7.4638, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2878, std. dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.60% (3.7496 => 3.6522, std. dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.59% (45.4683 => 44.2923, std. dev.: 0.2651) MultiSource/Applications/siod/siod: -2.39% (3.5520 => 3.4671, std. dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (92.7467 => 90.5641, std. dev.: 0.2634) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.97% (1.8739 => 1.8369, std. dev.: 0.0088) MultiSource/Applications/aha/aha: -1.75% (3.4286 => 3.3687, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.72% (0.6119 => 0.6014, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.47% (3.8907 => 3.8334, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2475, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3179, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5617 => 16.3570, std. dev.: 0.0698) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 01:23:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 03:23:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906082333.D77F92A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3470?compare_to=3466&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3470, Order: 163293, Start Time: 2012-09-06 07:03:12, End Time: 2012-09-06 08:24:43 To: 3466, Order: 163290, Start Time: 2012-09-06 05:14:25, End Time: 2012-09-06 06:33:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (131 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.10% (54.8383 => 56.5401, std. dev.: 0.1673) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.59% (13.8417 => 13.4834, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.06% (10.3673 => 13.4834, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 25.59% (0.1622 => 0.2037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.94% (0.3473 => 0.3992, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-3: 14.68% (0.3516 => 0.4032, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-2: 14.64% (0.3497 => 0.4009, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-4: 14.59% (0.3543 => 0.4060, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/synchronized: 14.57% (0.3561 => 0.4080, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.51% (0.3543 => 0.4057, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/for-in: 14.05% (0.3694 => 0.4213, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3828 => 0.4346, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/property: 13.38% (0.3886 => 0.4406, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 13.34% (0.3927 => 0.4451, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (2.2022 => 2.4742, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 11.94% (0.1432 => 0.1603, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.84% (1.1194 => 1.2519, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.55% (1.7609 => 1.9466, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5925 => 0.6435, std. dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference-object: 8.57% (0.6030 => 0.6547, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: 8.23% (0.3282 => 0.3552, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.21% (0.1584 => 0.1714, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.62% (10.4361 => 11.2317, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.30% (7.0540 => 7.5692, std. dev.: 0.0113) MultiSource/Applications/viterbi/viterbi: 7.20% (0.1555 => 0.1667, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.8172 => 0.8748, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: 6.73% (0.7835 => 0.8362, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.60% (0.3817 => 0.4069, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.4615 => 0.4915, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.4879 => 0.5196, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1655 => 0.1762, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2271 => 0.2413, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (9.4845 => 10.0528, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.96% (8.1363 => 8.6209, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 5.64% (0.2554 => 0.2698, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.45% (0.7115 => 0.7503, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2891 => 0.3048, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.38% (0.3423 => 0.3607, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.34% (4.2646 => 4.4924, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 5.33% (0.7433 => 0.7829, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.22% (0.5860 => 0.6166, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.22% (1.3050 => 1.3731, std. dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 5.21% (0.3109 => 0.3271, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.17% (0.3422 => 0.3599, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 5.17% (1.5603 => 1.6409, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.15% (0.2758 => 0.2900, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5569 => 0.5854, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.07% (4.9449 => 5.1955, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (5.0018 => 5.2549, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.5415 => 1.6191, std. dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash: 4.99% (0.4289 => 0.4503, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.88% (0.6675 => 0.7001, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.87% (3.3354 => 3.4980, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: 4.78% (0.3052 => 0.3198, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.77% (0.9765 => 1.0231, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (0.4064 => 0.4257, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.67% (0.2700 => 0.2826, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.64% (0.8067 => 0.8441, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.3650 => 0.3816, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.4103 => 0.4288, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (2.0665 => 2.1584, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.2831 => 0.2956, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.40% (0.3865 => 0.4035, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.35% (0.2872 => 0.2997, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 4.33% (0.3098 => 0.3232, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.3180 => 0.3317, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4203 => 0.4382, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (14.3668 => 14.9750, std. dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.3826 => 0.3987, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 4.21% (0.2877 => 0.2998, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 4.19% (0.3603 => 0.3754, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3935 => 0.4099, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2793 => 0.2909, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.5020 => 0.5227, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.11% (1.1861 => 1.2349, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.11% (0.3162 => 0.3292, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2802 => 0.2917, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.09% (1.1642 => 1.2118, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.4048 => 0.4213, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 4.07% (0.4299 => 0.4474, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.3684 => 0.3833, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 4.01% (0.3092 => 0.3216, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 3.93% (3.8723 => 4.0245, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 3.78% (2.0273 => 2.1039, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6450 => 0.6689, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.59% (5.7591 => 5.9661, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 3.59% (1.0722 => 1.1107, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.31% (0.5981 => 0.6179, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 3.27% (2.2969 => 2.3719, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.4186 => 1.4642, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 3.21% (0.8921 => 0.9207, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.76% (1.2842 => 1.3197, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.57% (17.1811 => 17.6228, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5859 => 1.6260, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.34% (21.9371 => 22.4511, std. dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (2.2024 => 2.2538, std. dev.: 0.0179) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.19% (7.9617 => 8.1361, std. dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 2.15% (1.1840 => 1.2095, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.8101 => 0.8212, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0688) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.82% (1.1145 => 1.3688, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 8.72% (0.1629 => 0.1771, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std. dev.: 0.0266) SingleSource/Benchmarks/Misc/richards_benchmark: 4.64% (1.1396 => 1.1925, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (4.2280 => 4.3677, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7557, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (1.3045 => 1.3265, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2393, std. dev.: 0.0130) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5780, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.46% (5.2763 => 3.1943, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.94% (5.3855 => 3.8270, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.64% (5.3526 => 3.8195, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1503, std. dev.: 1.0887) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.36% (2.9384 => 2.5753, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.89% (22.1758 => 20.2051, std. dev.: 0.0274) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.85% (1.5373 => 1.3705, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2594, std. dev.: 0.1516) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.27% (1.8329 => 1.7179, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.40% (1.5835 => 1.5138, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.97% (1.6805 => 1.6138, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5046, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4172, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout/lists: -3.03% (6.2999 => 6.1092, std. dev.: 0.0614) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9918, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9619, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1865, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4242, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 01:27:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 03:27:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906082758.2A46A2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3471?compare_to=3463&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3471, Order: 163290, Start Time: 2012-09-06 05:42:57, End Time: 2012-09-06 08:29:08 To: 3463, Order: 163281, Start Time: 2012-09-06 02:31:09, End Time: 2012-09-06 05:15:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.2096 => 0.2225, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.64% (0.3446 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.63% (0.3442 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.61% (0.3465 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.54% (0.3488 => 0.4030, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 15.49% (0.3460 => 0.3996, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.47% (0.3496 => 0.4037, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 15.42% (0.3469 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.91% (0.3643 => 0.4186, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.20% (0.5826 => 0.6420, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.10% (0.5889 => 0.6484, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7171 => 0.7767, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.54% (3.5627 => 3.8313, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (1.6211 => 1.7408, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.94% (1.3152 => 1.4065, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (0.2014 => 0.2147, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2875 => 0.3064, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.5900 => 0.6284, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.50% (0.2738 => 0.2916, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.44% (0.4361 => 0.4642, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.42% (0.3004 => 0.3197, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.39% (0.9909 => 1.0542, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.31% (0.4994 => 0.5309, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 6.29% (0.2750 => 0.2923, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.26% (1.5932 => 1.6930, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.26% (0.3195 => 0.3395, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.20% (0.2823 => 0.2998, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2792 => 0.2965, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (0.5026 => 0.5337, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2813 => 0.2987, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.18% (0.3930 => 0.4173, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2780 => 0.2951, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2803 => 0.2975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2811 => 0.2983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.09% (0.3792 => 0.4023, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 6.04% (4.2109 => 4.4653, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.03% (2.0673 => 2.1920, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: 5.98% (0.4029 => 0.4270, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.98% (0.5000 => 0.5299, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.90% (1.0781 => 1.1417, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 5.88% (0.3096 => 0.3278, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3060 => 0.3238, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.81% (0.2911 => 0.3080, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (2.7292 => 2.8860, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3124 => 0.3303, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.69% (0.3267 => 0.3453, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.1968 => 0.2080, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.69% (0.2566 => 0.2712, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.61% (0.3317 => 0.3503, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.56% (0.3362 => 0.3549, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.3258 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3348 => 0.3531, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3282 => 0.3460, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.3845 => 0.4052, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.32% (1.9694 => 2.0741, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.29% (0.3726 => 0.3923, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (0.4658 => 0.4902, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.23% (0.3477 => 0.3659, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3678 => 0.3870, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (1.9966 => 2.1001, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.07% (0.9697 => 1.0189, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.94% (2.1013 => 2.2052, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3690 => 0.3872, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 4.91% (5.5417 => 5.8139, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (0.4251 => 0.4459, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.86% (0.3890 => 0.4079, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (4.4195 => 4.6330, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 4.82% (0.4146 => 0.4346, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (2.1653 => 2.2679, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.70% (0.3981 => 0.4168, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.3903 => 0.4086, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (1.8794 => 1.9671, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.66% (4.6177 => 4.8330, std. dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: 4.31% (23.5202 => 24.5335, std. dev.: 0.0243) MultiSource/Applications/lua/lua: 4.30% (1.4269 => 1.4882, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.10% (0.7875 => 0.8198, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.99% (0.5012 => 0.5212, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.3271 => 0.3401, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.95% (0.2737 => 0.2845, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.92% (0.6634 => 0.6894, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: 3.87% (0.3336 => 0.3465, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.86% (0.5546 => 0.5760, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.2969 => 0.3080, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.6435 => 0.6668, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.3498 => 0.3601, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.36% (2.0346 => 2.0826, std. dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6397, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1949, std. dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.4996, std. dev.: 0.0130) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std. dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4540, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2792, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5860, std. dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5647, std. dev.: 0.0198) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9733, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7869, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7906, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5194, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.42% (17.2379 => 16.8214, std. dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.72% (0.6293 => 0.6185, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9592, std. dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 02:19:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 04:19:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906091948.432BC2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3472?compare_to=3468&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3472, Order: 163295, Start Time: 2012-09-06 08:06:35, End Time: 2012-09-06 09:20:57 To: 3468, Order: 163292, Start Time: 2012-09-06 06:20:11, End Time: 2012-09-06 07:38:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.19% (0.0401 => 0.0300, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.23% (2.0176 => 2.3855, std. dev.: 0.0142) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.27% (0.5818 => 0.6532, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.00% (0.5748 => 0.6438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3578 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.69% (0.3601 => 0.4022, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3646 => 0.4070, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3663 => 0.4088, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: 11.51% (0.3623 => 0.4040, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.51% (0.3650 => 0.4070, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 11.38% (0.3789 => 0.4220, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.32% (0.3914 => 0.4357, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 11.09% (0.3940 => 0.4377, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.07% (0.4003 => 0.4446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.17% (0.7710 => 0.8494, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.88% (1.3693 => 1.5046, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.51% (3.9660 => 4.3433, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 9.24% (0.2781 => 0.3038, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.08% (0.4328 => 0.4721, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.96% (0.5265 => 0.5737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.91% (0.2782 => 0.3030, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.2193 => 1.3275, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.60% (0.9199 => 0.9990, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.57% (0.7038 => 0.7641, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2607 => 0.2827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.37% (0.3022 => 0.3275, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.36% (0.2690 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.36% (0.2726 => 0.2954, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.2721 => 0.2947, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 8.30% (0.2628 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.29% (0.2655 => 0.2875, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.28% (0.3489 => 0.3778, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.28% (0.3756 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.27% (1.9828 => 2.1468, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.26% (0.6959 => 0.7534, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.2937 => 0.3179, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 8.23% (0.3293 => 0.3564, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.22% (0.2760 => 0.2987, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.3899 => 0.4219, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 8.19% (0.2761 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (0.3485 => 0.3769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.10% (0.3580 => 0.3870, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.08% (0.3107 => 0.3358, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.06% (0.7506 => 0.8111, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.05% (1.4563 => 1.5736, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.02% (1.1364 => 1.2275, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.99% (0.2966 => 0.3203, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.97% (0.3149 => 0.3400, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.94% (0.2696 => 0.2910, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.84% (13.8202 => 14.9043, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/matrix: 7.83% (0.2988 => 0.3222, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.81% (7.2180 => 7.7815, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.75% (0.1588 => 0.1711, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.72% (0.4016 => 0.4326, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5577 => 0.6007, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.71% (0.3192 => 0.3438, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.70% (0.3868 => 0.4166, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.62% (0.4791 => 0.5156, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.59% (0.4390 => 0.4723, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (0.2914 => 0.3134, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 7.53% (0.3453 => 0.3713, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.41% (0.3534 => 0.3796, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.15% (0.3246 => 0.3478, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.13% (1.0313 => 1.1048, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.11% (0.6283 => 0.6730, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.08% (0.2995 => 0.3207, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2023 => 0.2165, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5637 => 0.6031, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.89% (0.2945 => 0.3148, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.87% (1.1061 => 1.1821, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.84% (13.2842 => 14.1928, std. dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/football/football: 6.81% (0.8310 => 0.8876, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3220 => 0.3436, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.54% (3.8646 => 4.1174, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.41% (1.3245 => 1.4094, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.34% (0.7460 => 0.7933, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.27% (0.4113 => 0.4371, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 6.22% (1.9270 => 2.0468, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.21% (0.3755 => 0.3988, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.19% (3.6692 => 3.8962, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (1.2749 => 1.3536, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.8698 => 0.9230, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.02% (1.3819 => 1.4651, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.01% (3.1889 => 3.3805, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.99% (1.3813 => 1.4640, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 5.97% (2.1791 => 2.3093, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.3801 => 4.6417, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.96% (4.4433 => 4.7080, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.92% (0.6135 => 0.6498, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.89% (1.0594 => 1.1218, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.87% (0.2504 => 0.2651, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.81% (0.8818 => 0.9330, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 5.50% (14.8535 => 15.6703, std. dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 5.46% (16.6129 => 17.5192, std. dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: 5.43% (1.2292 => 1.2959, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.39% (8.4961 => 8.9544, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.28% (1.1333 => 1.1931, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.2859 => 0.3006, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2698, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.4805 => 0.5023, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.52% (0.2321 => 0.2426, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (6.5754 => 6.8692, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.32% (3.2742 => 3.4158, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.21% (4.6629 => 4.8590, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6250 => 0.6506, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (0.9108 => 0.9481, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (4.9865 => 5.1877, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 3.92% (16.2614 => 16.8993, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5188 => 1.5770, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.1007 => 2.1751, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 3.50% (3.7467 => 3.8778, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.34% (6.2785 => 6.4880, std. dev.: 0.0129) MultiSource/Benchmarks/Bullet/bullet: 2.82% (33.2944 => 34.2337, std. dev.: 0.0238) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std. dev.: 0.0456) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.05% (1.1560 => 1.2259, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7332, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1129, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6029, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.35% (0.4657 => 0.4082, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.53% (22.5627 => 21.5404, std. dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2685, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5114, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3177, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.90% (0.4867 => 0.4677, std. dev.: 0.0014) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9234, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6031, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -2.07% (26.5159 => 25.9677, std. dev.: 0.0266) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2399, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2166, std. dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5360, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 02:44:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 04:44:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906094429.337252A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3473?compare_to=3469&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3473, Order: 163295, Start Time: 2012-09-06 08:34:40, End Time: 2012-09-06 09:45:40 To: 3469, Order: 163293, Start Time: 2012-09-06 07:07:31, End Time: 2012-09-06 08:19:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (44 on baseline) Performance Improvements: 1 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (814 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 8.49% (0.1520 => 0.1649, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.95% (0.1871 => 0.2001, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.36% (0.4470 => 0.4620, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.7776 => 0.8036, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.42% (1.3050 => 1.3366, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 1.55% (0.8312 => 0.8441, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.37% (1.1431 => 1.1588, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (6.2523 => 6.3233, std. dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 1.01% (3.8353 => 3.8740, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.00% (1.5361 => 1.5515, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.20% (0.7366 => 0.7749, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.23% (1.3214 => 1.3773, std. dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.86% (4.1234 => 4.2001, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.26% (1.2763 => 1.2924, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.40% (0.6673 => 0.6513, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.7722 => 0.8036, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.80% (1.0046 => 1.0428, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3.31% (1.1653 => 1.2039, std. dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: 2.86% (2.1763 => 2.2385, std. dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5150 => 1.5515, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 1.29% (1.1440 => 1.1588, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.18% (1.1827 => 1.1967, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.18% (3.0225 => 3.0581, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.10% (6.2546 => 6.3233, std. dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 21.89% (3.4629 => 4.2211, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.95% (4.0101 => 4.5697, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: 13.57% (0.4296 => 0.4879, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 12.92% (0.3746 => 0.4230, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 10.90% (3.4406 => 3.8155, std. dev.: 0.0294) MultiSource/Benchmarks/mafft/pairlocalalign: 10.68% (62.4126 => 69.0796, std. dev.: 0.1548) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6181, std. dev.: 0.0196) SingleSource/Benchmarks/McGill/chomp: 8.17% (1.0194 => 1.1027, std. dev.: 0.0110) SingleSource/Benchmarks/Stanford/Puzzle: 8.03% (0.1433 => 0.1548, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.78% (1.0063 => 1.0745, std. dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/hash2: 6.74% (3.4876 => 3.7228, std. dev.: 0.0358) SingleSource/Benchmarks/Shootout/methcall: 6.61% (8.5566 => 9.1225, std. dev.: 0.0413) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7397, std. dev.: 0.0640) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (0.3301 => 0.3463, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8514, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/ReedSolomon: 3.84% (8.5113 => 8.8383, std. dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.50% (6.7458 => 6.9146, std. dev.: 0.0600) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.27% (2.6656 => 2.7262, std. dev.: 0.0230) MultiSource/Benchmarks/BitBench/five11/five11: 2.01% (5.1938 => 5.2984, std. dev.: 0.0238) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.94% (4.6127 => 4.7023, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.56% (1.2726 => 1.2924, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5352, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6743, std. dev.: 0.0571) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.18% (2.9152 => 2.9497, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4346, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (4.6414 => 4.6910, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.04% (3.6254 => 3.6631, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.25% (5.2665 => 4.2001, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9413, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/richards_benchmark: -6.83% (1.4441 => 1.3455, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -6.34% (9.2503 => 8.6634, std. dev.: 0.0758) SingleSource/Benchmarks/Misc/pi: -6.19% (1.6538 => 1.5515, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4072, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -4.52% (8.5323 => 8.1470, std. dev.: 0.1103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (3.9413 => 3.7644, std. dev.: 0.0587) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.51% (45.4683 => 43.8715, std. dev.: 0.4638) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.2959 => 1.2513, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.41% (1.7361 => 1.6769, std. dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4502, std. dev.: 0.0516) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.00% (3.7496 => 3.6371, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0404) MultiSource/Benchmarks/PAQ8p/paq8p: -2.71% (92.7467 => 90.2296, std. dev.: 0.4180) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.71% (1.1683 => 1.1366, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.41% (61.1734 => 59.7016, std. dev.: 0.4231) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.33% (1.8739 => 1.8302, std. dev.: 0.0119) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.16% (2.8964 => 2.8339, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/tsp/tsp: -1.82% (1.7330 => 1.7014, std. dev.: 0.0095) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3665, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2398, std. dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3075, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7668, std. dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 03:12:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 05:12:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906101212.EC26E2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3474?compare_to=3470&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3474, Order: 163295, Start Time: 2012-09-06 08:53:04, End Time: 2012-09-06 10:13:22 To: 3470, Order: 163293, Start Time: 2012-09-06 07:03:12, End Time: 2012-09-06 08:24:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (139 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.18% (0.8748 => 0.8851, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.86% (78.5071 => 80.7517, std. dev.: 0.2694) SingleSource/Benchmarks/Shootout/lists: 1.88% (6.1092 => 6.2238, std. dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.24% (3.7416 => 3.6953, std. dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.15% (10.3673 => 13.4930, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 25.65% (0.1622 => 0.2038, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 15.06% (0.3473 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.76% (0.3543 => 0.4066, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3543 => 0.4066, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 14.76% (0.3497 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.56% (0.3516 => 0.4028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.43% (0.3561 => 0.4075, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.94% (0.3694 => 0.4209, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.69% (0.3828 => 0.4352, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.33% (0.3886 => 0.4404, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.41% (2.2022 => 2.4756, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.97% (1.1194 => 1.2534, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 11.66% (0.1432 => 0.1599, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (1.7609 => 1.9494, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.2065 => 0.2247, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.31% (0.8172 => 0.8851, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 8.26% (0.3282 => 0.3553, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.4879 => 0.5254, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4615 => 0.4963, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.51% (7.0540 => 7.5839, std. dev.: 0.0202) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7326 => 0.7875, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 7.43% (10.4361 => 11.2120, std. dev.: 0.0106) MultiSource/Applications/viterbi/viterbi: 7.40% (0.1555 => 0.1670, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.24% (0.1906 => 0.2044, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.71% (0.3817 => 0.4073, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.69% (0.7835 => 0.8359, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1655 => 0.1763, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.16% (0.2271 => 0.2411, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.14% (9.4845 => 10.0664, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5860 => 0.6219, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (8.1363 => 8.6219, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.96% (0.5569 => 0.5901, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 5.92% (0.7115 => 0.7536, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 5.90% (0.3423 => 0.3625, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.72% (0.2554 => 0.2700, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (1.3050 => 1.3765, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 5.45% (0.7433 => 0.7838, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.35% (4.9449 => 5.2094, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.33% (4.2646 => 4.4920, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.32% (0.2107 => 0.2219, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (1.5415 => 1.6234, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.31% (0.1940 => 0.2043, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.3121 => 0.3285, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 5.23% (0.3422 => 0.3601, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.5105 => 0.5372, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.21% (1.5603 => 1.6416, std. dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 5.18% (0.3109 => 0.3270, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (5.0018 => 5.2583, std. dev.: 0.0066) MultiSource/Applications/d/make_dparser: 4.96% (3.3354 => 3.5007, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.94% (0.6675 => 0.7005, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4636 => 0.4865, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.90% (0.2756 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.4064 => 0.4262, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.81% (0.2700 => 0.2830, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.81% (0.8067 => 0.8455, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2891 => 0.3029, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.65% (0.9765 => 1.0219, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.60% (2.0665 => 2.1616, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.58% (0.4103 => 0.4291, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 4.55% (0.4289 => 0.4484, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.3136 => 0.3278, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.52% (0.3162 => 0.3305, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.52% (0.4203 => 0.4393, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.47% (0.3180 => 0.3322, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.46% (1.1861 => 1.2390, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.45% (0.2831 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.45% (0.3865 => 0.4037, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3098 => 0.3235, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3650 => 0.3811, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.37% (1.1642 => 1.2151, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3826 => 0.3993, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.3603 => 0.3760, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2871 => 0.2996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.35% (0.2872 => 0.2997, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2877 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (14.3668 => 14.9858, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.3052 => 0.3183, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.26% (0.2793 => 0.2912, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.24% (0.5020 => 0.5233, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3232 => 0.3369, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.22% (0.4048 => 0.4219, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2802 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.17% (0.3283 => 0.3420, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.17% (0.3092 => 0.3221, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3935 => 0.4099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.15% (0.3684 => 0.3837, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.14% (0.4299 => 0.4477, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.03% (0.6450 => 0.6710, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 4.03% (3.8723 => 4.0283, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3441 => 0.3579, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4620 => 0.4805, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.99% (0.3387 => 0.3522, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.97% (0.3379 => 0.3513, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 3.69% (1.0722 => 1.1118, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.66% (5.7591 => 5.9700, std. dev.: 0.0136) MultiSource/Applications/treecc/treecc: 3.65% (2.0273 => 2.1012, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.43% (0.5981 => 0.6186, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 3.38% (2.2969 => 2.3745, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 3.14% (0.8921 => 0.9201, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (1.4186 => 1.4618, std. dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 2.94% (1.2842 => 1.3220, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.5859 => 1.6284, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.59% (17.1811 => 17.6257, std. dev.: 0.0291) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.56% (7.9617 => 8.1653, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.47% (21.9371 => 22.4795, std. dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.2024 => 2.2544, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.09% (1.1840 => 1.2088, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.8101 => 0.8229, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 4.62% (1.1396 => 1.1922, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (4.2280 => 4.3821, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.48% (0.4162 => 0.4307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7573, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2388, std. dev.: 0.0169) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7614, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.42% (5.2763 => 3.1964, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.87% (5.3855 => 3.8307, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.50% (5.3526 => 3.8273, std. dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1515, std. dev.: 0.0444) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.26% (2.9384 => 2.5781, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -8.86% (22.1758 => 20.2118, std. dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.54% (1.5373 => 1.3752, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2539, std. dev.: 0.0862) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (1.8329 => 1.7196, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.57% (1.9577 => 1.8486, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5115, std. dev.: 0.0017) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4997, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4154, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.63% (1.2373 => 1.2048, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0130, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.47% (8.1563 => 7.9547, std. dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1866, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: -1.21% (6.2999 => 6.2238, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 04:06:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 06:06:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906110640.C98312A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3475?compare_to=3472&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3475, Order: 163299, Start Time: 2012-09-06 09:52:57, End Time: 2012-09-06 11:07:28 To: 3472, Order: 163295, Start Time: 2012-09-06 08:06:35, End Time: 2012-09-06 09:20:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (166 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5226 => 56.4201, std. dev.: 0.0655) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.88% (78.8284 => 81.1005, std. dev.: 0.2301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.40% (42.0921 => 42.6834, std. dev.: 0.0600) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.1262 => 4.0566, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.32% (2.0176 => 2.4075, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.70% (0.5818 => 0.6557, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.56% (0.5748 => 0.6470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3578 => 0.4026, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3601 => 0.4045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.23% (0.3663 => 0.4111, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3646 => 0.4089, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3623 => 0.4060, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.05% (0.3650 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3789 => 0.4239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.4003 => 0.4476, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3914 => 0.4375, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.65% (0.3940 => 0.4399, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.50% (0.7061 => 0.7873, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.61% (0.7710 => 0.8528, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.74% (3.9660 => 4.3523, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 9.68% (1.3693 => 1.5019, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.15% (0.5265 => 0.5747, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 9.13% (0.4328 => 0.4723, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.91% (0.7038 => 0.7665, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.89% (0.9199 => 1.0017, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.83% (1.2193 => 1.3270, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 8.70% (0.2781 => 0.3023, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.66% (0.2782 => 0.3023, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.66% (0.2761 => 0.3000, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.54% (0.4062 => 0.4409, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.53% (1.4563 => 1.5805, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.49% (0.3899 => 0.4230, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.36% (0.2690 => 0.2915, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.36% (0.2655 => 0.2877, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.34% (0.3022 => 0.3274, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.32% (0.2607 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.21% (1.1364 => 1.2297, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.17% (0.3489 => 0.3774, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 8.14% (0.2726 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.12% (0.3485 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.12% (0.3756 => 0.4061, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.11% (0.3293 => 0.3560, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.08% (1.9828 => 2.1431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.07% (0.3580 => 0.3869, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.2937 => 0.3174, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.05% (13.8202 => 14.9325, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 8.04% (0.2760 => 0.2982, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.03% (0.5577 => 0.6025, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.02% (0.2966 => 0.3204, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.96% (0.2765 => 0.2985, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.94% (0.2696 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.92% (0.4379 => 0.4726, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.89% (0.7506 => 0.8098, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.87% (0.1588 => 0.1713, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.85% (7.2180 => 7.7849, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.82% (0.4016 => 0.4330, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.3246 => 0.3498, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.76% (0.3107 => 0.3348, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.69% (0.2914 => 0.3138, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.4791 => 0.5159, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.65% (0.3149 => 0.3390, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.50% (0.2988 => 0.3212, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.46% (0.3192 => 0.3430, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3453 => 0.3708, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.37% (0.3868 => 0.4153, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.32% (0.6283 => 0.6743, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std. dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.30% (0.2945 => 0.3160, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.27% (1.1061 => 1.1865, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3534 => 0.3789, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4390 => 0.4706, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.15% (1.0313 => 1.1050, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (3.8646 => 4.1377, std. dev.: 0.0080) MultiSource/Benchmarks/McCat/18-imp/imp: 7.02% (0.3220 => 0.3446, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.98% (13.2842 => 14.2120, std. dev.: 0.0155) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.71% (0.8310 => 0.8868, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.55% (1.9270 => 2.0533, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.50% (1.3245 => 1.4106, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 6.48% (2.1791 => 2.3202, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.36% (16.6129 => 17.6703, std. dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.34% (0.3755 => 0.3993, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.32% (0.6744 => 0.7170, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.26% (3.6692 => 3.8988, std. dev.: 0.0147) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.17% (3.1889 => 3.3855, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.02% (0.8698 => 0.9222, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (1.3819 => 1.4647, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.97% (1.3813 => 1.4638, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.91% (0.2504 => 0.2652, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.91% (1.0594 => 1.1220, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.89% (4.3801 => 4.6383, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.88% (0.6135 => 0.6496, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.87% (1.2749 => 1.3497, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.82% (4.4433 => 4.7020, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.3245 => 0.3426, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.45% (14.8535 => 15.6628, std. dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 5.43% (0.3131 => 0.3301, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (1.1333 => 1.1946, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.38% (14.5298 => 15.3119, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 5.36% (1.2292 => 1.2951, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.36% (8.4961 => 8.9515, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.14% (0.8818 => 0.9271, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2321 => 0.2438, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (4.9865 => 5.2157, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (6.5754 => 6.8693, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (3.2742 => 3.4180, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6250 => 0.6521, std. dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 4.18% (4.6629 => 4.8577, std. dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 3.92% (16.2614 => 16.8994, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5781, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 3.89% (3.7467 => 3.8924, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.87% (2.1007 => 2.1820, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.79% (0.9108 => 0.9453, std. dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.40% (6.2785 => 6.4922, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.2944 => 34.3074, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5128, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std. dev.: 0.0461) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.11% (1.1560 => 1.2266, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3777, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6987, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1181, std. dev.: 0.0701) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6084, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.98% (1.5824 => 1.6138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5158, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6864, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5854, std. dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.02% (0.4657 => 0.4097, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.22% (22.5627 => 21.6100, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2824, std. dev.: 0.0271) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.80% (3.2729 => 3.1484, std. dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.30% (3.0263 => 2.9263, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2378, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5264, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2321, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.25% (4.1080 => 4.0566, std. dev.: 0.0032) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1885, std. dev.: 0.0154) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 04:16:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 06:16:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906111628.243352A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3476?compare_to=3473&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3476, Order: 163299, Start Time: 2012-09-06 10:06:09, End Time: 2012-09-06 11:17:40 To: 3473, Order: 163295, Start Time: 2012-09-06 08:34:40, End Time: 2012-09-06 09:45:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (37 on baseline) Performance Improvements: 5 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (822 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/siod/siod: 10.39% (3.4741 => 3.8352, std. dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 2.93% (8.1470 => 8.3855, std. dev.: 0.0898) SingleSource/Benchmarks/Shootout-C++/sieve: 1.67% (3.8155 => 3.8793, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.37% (1.5892 => 1.6110, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.32% (1.8302 => 1.8544, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.15% (1.3366 => 1.3212, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.44% (0.0944 => 0.0836, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -9.52% (3.4410 => 3.1134, std. dev.: 0.0238) MultiSource/Applications/JM/lencod/lencod: -4.25% (6.9146 => 6.6207, std. dev.: 0.0563) SingleSource/Benchmarks/McGill/chomp: -1.14% (1.1027 => 1.0901, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 4.12% (1.0046 => 1.0460, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 3.37% (0.6173 => 0.6381, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3.28% (1.1653 => 1.2035, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.15% (0.7722 => 0.7965, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.91% (1.4113 => 1.4383, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.63% (0.7226 => 0.7344, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.10% (13.3238 => 13.4708, std. dev.: 0.0552) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9966, std. dev.: 0.0254) SingleSource/Benchmarks/McGill/misr: 13.92% (0.4296 => 0.4894, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5573, std. dev.: 0.0173) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.20% (0.0917 => 0.1038, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8793, std. dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.81% (62.4126 => 69.1592, std. dev.: 0.0619) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.98% (0.2694 => 0.2936, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 8.98% (7.0025 => 7.6310, std. dev.: 0.0080) MultiSource/Applications/siod/siod: 7.97% (3.5520 => 3.8352, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout/methcall: 7.44% (8.5566 => 9.1934, std. dev.: 0.0225) SingleSource/Benchmarks/McGill/chomp: 6.94% (1.0194 => 1.0901, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.64% (1.0063 => 1.0731, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 6.27% (3.4876 => 3.7063, std. dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7398, std. dev.: 0.0598) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.19% (4.2129 => 4.4314, std. dev.: 0.0364) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.58% (2.6656 => 2.7609, std. dev.: 0.0196) SingleSource/Benchmarks/Misc/fp-convert: 3.55% (15.2242 => 15.7648, std. dev.: 0.0709) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7244, std. dev.: 0.0543) MultiSource/Benchmarks/BitBench/five11/five11: 2.27% (5.1938 => 5.3117, std. dev.: 0.0252) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4855, std. dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5310, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6681, std. dev.: 0.0674) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (4.6414 => 4.6888, std. dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.34% (5.2665 => 4.1954, std. dev.: 0.0486) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.91% (1.1647 => 0.9910, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -9.04% (3.4230 => 3.1134, std. dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.36% (3.2007 => 2.9331, std. dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: -6.94% (1.4441 => 1.3439, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/pi: -6.60% (1.6538 => 1.5446, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -6.49% (9.2503 => 8.6496, std. dev.: 0.0387) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4091, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.12% (0.4564 => 0.4376, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.05% (45.4683 => 43.6278, std. dev.: 0.1327) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.77% (0.4140 => 0.3984, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6279, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.05% (1.7361 => 1.6831, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.04% (1.2722 => 1.2335, std. dev.: 0.0096) MultiSource/Applications/lambda-0_1_3/lambda: -2.76% (7.6833 => 7.4710, std. dev.: 0.0293) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1381, std. dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (92.7467 => 90.4279, std. dev.: 0.3296) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.99% (61.1734 => 59.9588, std. dev.: 0.1285) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.90% (1.0686 => 1.0483, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -1.64% (3.4286 => 3.3722, std. dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2336, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3082, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7675, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -1.35% (3.8907 => 3.8382, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.06% (2.3569 => 2.3318, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 04:39:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 06:39:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906113951.C7B2C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3477?compare_to=3471&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3477, Order: 163295, Start Time: 2012-09-06 08:57:13, End Time: 2012-09-06 11:40:47 To: 3471, Order: 163290, Start Time: 2012-09-06 05:42:57, End Time: 2012-09-06 08:29:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.21% (54.0769 => 54.7308, std. dev.: 0.0956) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3442 => 0.3984, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 15.73% (0.3446 => 0.3988, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 15.58% (0.3460 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.56% (0.3465 => 0.4004, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.51% (0.3488 => 0.4029, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 15.45% (0.3496 => 0.4036, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 15.39% (0.3469 => 0.4003, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 15.02% (0.3643 => 0.4190, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.66% (0.3724 => 0.4270, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5826 => 0.6425, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5889 => 0.6486, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.1620 => 0.1762, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.38% (0.7171 => 0.7772, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.50% (3.5627 => 3.8300, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.16% (1.6211 => 1.7372, std. dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 6.73% (1.5932 => 1.7005, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.68% (1.3152 => 1.4030, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (0.2014 => 0.2147, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2875 => 0.3064, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std. dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 6.32% (0.3004 => 0.3194, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.32% (0.2738 => 0.2911, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.28% (0.4361 => 0.4635, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2813 => 0.2989, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.2750 => 0.2922, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.24% (0.9909 => 1.0527, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.23% (0.2823 => 0.2999, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2792 => 0.2966, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.22% (0.5900 => 0.6267, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3195 => 0.3393, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.17% (0.3792 => 0.4026, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2729 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2803 => 0.2975, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.13% (0.4994 => 0.5300, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 6.12% (0.2780 => 0.2950, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.07% (2.0673 => 2.1927, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.01% (0.2911 => 0.3086, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (0.5000 => 0.5300, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (0.3930 => 0.4165, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2811 => 0.2978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.91% (0.3096 => 0.3279, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.81% (0.5026 => 0.5318, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 5.81% (0.4029 => 0.4263, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.78% (4.2109 => 4.4541, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3267 => 0.3454, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3060 => 0.3235, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 5.69% (1.0781 => 1.1394, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: 5.68% (0.3258 => 0.3443, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (2.7292 => 2.8820, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.57% (0.3124 => 0.3298, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.53% (0.3362 => 0.3548, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.53% (0.3348 => 0.3533, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3282 => 0.3460, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.33% (0.3678 => 0.3874, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3625 => 0.3817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3477 => 0.3661, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.26% (0.3726 => 0.3922, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.19% (0.2736 => 0.2878, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.96% (1.9694 => 2.0671, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 4.94% (0.4146 => 0.4351, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.88% (0.3690 => 0.3870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (0.4251 => 0.4457, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.81% (0.9697 => 1.0163, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 4.80% (5.5417 => 5.8078, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.79% (1.9966 => 2.0923, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (0.4658 => 0.4880, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.76% (2.1013 => 2.2014, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.74% (0.3903 => 0.4088, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.70% (0.3981 => 0.4168, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.68% (0.3845 => 0.4025, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (4.4195 => 4.6237, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 4.42% (4.6177 => 4.8220, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 4.37% (2.1653 => 2.2599, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 4.28% (23.5202 => 24.5279, std. dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.5012 => 0.5226, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.06% (1.8794 => 1.9557, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.2737 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.3271 => 0.3401, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.97% (1.4269 => 1.4835, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.73% (0.7875 => 0.8169, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.6435 => 0.6674, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 3.70% (0.5546 => 0.5751, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.2969 => 0.3078, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.23% (0.6634 => 0.6848, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.04% (2.0346 => 2.0762, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 1.15% (2.4764 => 2.5049, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6733, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6383, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std. dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5006, std. dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std. dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4499, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5946, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5608, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: -9.53% (0.2402 => 0.2173, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7912, std. dev.: 0.0172) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std. dev.: 0.0112) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8424, std. dev.: 0.0460) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5818, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9665, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 05:01:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 07:01:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906120123.0E30B2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3478?compare_to=3474&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3478, Order: 163304, Start Time: 2012-09-06 10:41:51, End Time: 2012-09-06 12:02:05 To: 3474, Order: 163295, Start Time: 2012-09-06 08:53:04, End Time: 2012-09-06 10:13:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (142 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 941 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.1616 => 2.2006, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 1.59% (0.6737 => 0.6844, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.53% (1.6416 => 1.6667, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.29% (1.3220 => 1.3390, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.89% (0.3004 => 0.3301, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 1.48% (3.6953 => 3.7500, std. dev.: 0.0148) MultiSource/Benchmarks/llubenchmark/llu: 1.34% (3.7781 => 3.8289, std. dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.63% (0.5065 => 0.4780, std. dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.37% (80.7517 => 78.8399, std. dev.: 0.1880) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.16% (10.3673 => 13.4939, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 29.90% (0.1622 => 0.2107, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.45% (0.3543 => 0.4126, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 16.10% (0.3473 => 0.4032, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.90% (0.3497 => 0.4053, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-3: 15.73% (0.3516 => 0.4069, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.72% (0.3543 => 0.4100, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.59% (0.3561 => 0.4116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.19% (0.3694 => 0.4255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.79% (0.3828 => 0.4394, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.69% (0.3927 => 0.4504, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 14.44% (0.3886 => 0.4447, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.61% (2.2022 => 2.4799, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 12.22% (0.1432 => 0.1607, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2464, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.71% (1.7609 => 1.9495, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.16% (0.5925 => 0.6527, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.98% (0.6030 => 0.6632, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.84% (0.3282 => 0.3572, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7326 => 0.7966, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.20% (7.0540 => 7.6323, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.73% (0.3817 => 0.4112, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.66% (0.8172 => 0.8798, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.62% (0.3307 => 0.3559, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.3177 => 0.3413, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.03% (10.4361 => 11.1697, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3422 => 0.3660, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.4615 => 0.4932, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 6.82% (1.5603 => 1.6667, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.68% (8.1363 => 8.6797, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 6.66% (9.4845 => 10.1162, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (0.7433 => 0.7925, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.57% (0.4064 => 0.4331, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.56% (0.7835 => 0.8349, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2831 => 0.3016, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.49% (2.0665 => 2.2006, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.45% (0.7115 => 0.7574, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4636 => 0.4935, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.4103 => 0.4366, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.37% (0.5105 => 0.5430, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.5569 => 0.5921, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2793 => 0.2967, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.3232 => 0.3433, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.18% (4.9449 => 5.2505, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.13% (0.3603 => 0.3824, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.10% (1.5415 => 1.6356, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4289 => 0.4550, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (1.3050 => 1.3844, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.08% (0.3865 => 0.4100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.01% (0.6456 => 0.6844, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (0.3121 => 0.3308, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (4.2646 => 4.5198, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.97% (0.4203 => 0.4454, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.95% (0.3109 => 0.3294, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5860 => 0.6207, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.90% (0.4048 => 0.4287, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.87% (3.3354 => 3.5311, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3379 => 0.3577, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4620 => 0.4889, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.79% (0.3935 => 0.4163, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (5.0018 => 5.2909, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.74% (0.6675 => 0.7058, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.8067 => 0.8520, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.50% (0.9765 => 1.0302, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.35% (14.3668 => 15.1355, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.30% (0.5020 => 0.5286, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.22% (0.3180 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.19% (0.4299 => 0.4522, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 5.14% (1.1642 => 1.2240, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 5.08% (0.3092 => 0.3249, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.07% (0.2700 => 0.2837, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (1.1861 => 1.2455, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 4.92% (3.8723 => 4.0628, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.59% (5.7591 => 6.0234, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.58% (1.0722 => 1.1213, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.49% (2.0273 => 2.1183, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.37% (0.6450 => 0.6732, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 4.34% (2.2969 => 2.3965, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2842 => 1.3390, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.26% (0.5981 => 0.6236, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 3.92% (0.8921 => 0.9271, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.79% (1.4186 => 1.4723, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 3.43% (17.1811 => 17.7711, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.41% (1.5859 => 1.6399, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.2024 => 2.2742, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.17% (21.9371 => 22.6332, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.97% (7.9617 => 8.1984, std. dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.1840 => 1.2165, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.8101 => 0.8273, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8966, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.13% (0.2944 => 0.3301, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4144, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (3.1578 => 3.3857, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 4.55% (1.1396 => 1.1914, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3480, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 1.62% (9.1159 => 9.2635, std. dev.: 0.0333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 1.37% (3.6994 => 3.7500, std. dev.: 0.0148) MultiSource/Benchmarks/llubenchmark/llu: 1.34% (3.7781 => 3.8289, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7885, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.55% (5.2763 => 3.1896, std. dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.70% (5.3855 => 3.8398, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.32% (5.3526 => 3.8368, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0893, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.69% (2.9384 => 2.5654, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.40% (22.1758 => 20.3133, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2953, std. dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.20% (1.8329 => 1.7193, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0016) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1492, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.96% (1.6805 => 1.6139, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5106, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4159, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9886, std. dev.: 0.0176) SingleSource/Benchmarks/McGill/chomp: -2.69% (1.2373 => 1.2040, std. dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (8.1563 => 7.9679, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1862, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8557, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 05:43:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 07:43:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906124355.ED5EB2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3479?compare_to=3476&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3479, Order: 163307, Start Time: 2012-09-06 11:33:49, End Time: 2012-09-06 12:45:07 To: 3476, Order: 163299, Start Time: 2012-09-06 10:06:09, End Time: 2012-09-06 11:17:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (48 on baseline) Performance Improvements: 1 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/health/health: 11.17% (0.1173 => 0.1304, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 1.68% (0.7493 => 0.7619, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (0.7654 => 0.7770, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (6.3006 => 6.3770, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.80% (0.2797 => 0.3099, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.62% (15.1472 => 16.7563, std. dev.: 0.2134) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.93% (1.3503 => 1.3899, std. dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.39% (2.3149 => 2.3702, std. dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (4.5063 => 4.6106, std. dev.: 0.0355) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.99% (0.5928 => 0.6046, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: 1.17% (4.3023 => 4.3527, std. dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.15% (4.4889 => 4.5406, std. dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.28% (2.0118 => 1.9860, std. dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.13% (2.1763 => 2.2662, std. dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 3.80% (1.1653 => 1.2096, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (12.6413 => 13.0408, std. dev.: 0.0586) MultiSource/Applications/lemon/lemon: 3.16% (1.0046 => 1.0363, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.5150 => 1.5612, std. dev.: 0.0113) MultiSource/Applications/minisat/minisat: 2.93% (0.6173 => 0.6354, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.7226 => 0.7398, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (6.2546 => 6.3770, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.82% (1.4113 => 1.4370, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.4408 => 1.4641, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 1.28% (3.0225 => 3.0612, std. dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 1.26% (13.3238 => 13.4911, std. dev.: 0.0635) MultiSource/Applications/siod/siod: 1.20% (2.0972 => 2.1223, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.12% (1.1827 => 1.1959, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.87% (0.0263 => 0.0381, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9981, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.84% (0.0766 => 0.0872, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.31% (4.0101 => 4.5437, std. dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/sieve: 12.71% (3.4406 => 3.8778, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 12.41% (0.4296 => 0.4829, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (62.4126 => 69.1456, std. dev.: 0.2786) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 9.05% (7.0025 => 7.6359, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 8.16% (3.5520 => 3.8418, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/methcall: 7.03% (8.5566 => 9.1583, std. dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/hash2: 6.14% (3.4876 => 3.7018, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.84% (15.8312 => 16.7563, std. dev.: 0.2134) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7378, std. dev.: 0.0801) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (0.3301 => 0.3477, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 4.54% (15.2242 => 15.9155, std. dev.: 0.0227) SingleSource/Benchmarks/Misc/dt: 4.26% (0.9851 => 1.0271, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5386, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8737, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.48% (2.6656 => 2.7584, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.45% (0.5587 => 0.5780, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.89% (0.5876 => 0.6046, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 2.83% (8.5113 => 8.7524, std. dev.: 0.0587) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (4.5056 => 4.6106, std. dev.: 0.0355) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.59% (4.6127 => 4.6859, std. dev.: 0.0262) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5340, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6731, std. dev.: 0.0210) MultiSource/Benchmarks/Olden/power/power: 1.19% (1.4184 => 1.4353, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 1.19% (4.3016 => 4.3527, std. dev.: 0.0160) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6904, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: 1.02% (2.4013 => 2.4258, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.29% (0.3497 => 0.2053, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0864, std. dev.: 0.0459) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.93% (1.1647 => 0.9908, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -8.65% (3.4230 => 3.1270, std. dev.: 0.0372) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.89% (3.2007 => 2.9482, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -6.80% (1.4441 => 1.3459, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.57% (9.2503 => 8.7353, std. dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/fibo: -5.06% (4.6355 => 4.4009, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (3.9413 => 3.7642, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.08% (0.4564 => 0.4378, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.89% (0.4140 => 0.3979, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: -3.18% (8.5323 => 8.2613, std. dev.: 0.0999) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.2722 => 1.2318, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -3.01% (7.6833 => 7.4520, std. dev.: 0.0491) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.00% (1.7361 => 1.6841, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0257) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.66% (1.1683 => 1.1372, std. dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.54% (3.7496 => 3.6542, std. dev.: 0.0145) MultiSource/Benchmarks/PAQ8p/paq8p: -2.24% (92.7467 => 90.6734, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: -1.94% (1.0926 => 1.0714, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.91% (1.8739 => 1.8382, std. dev.: 0.0109) MultiSource/Applications/aha/aha: -1.67% (3.4286 => 3.3715, std. dev.: 0.0098) MultiSource/Benchmarks/llubenchmark/llu: -1.64% (2.0192 => 1.9860, std. dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.50% (9.3855 => 9.2444, std. dev.: 0.0239) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7652, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 05:49:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 07:49:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906124920.701552A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3480?compare_to=3475&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3480, Order: 163307, Start Time: 2012-09-06 11:36:03, End Time: 2012-09-06 12:50:27 To: 3475, Order: 163299, Start Time: 2012-09-06 09:52:57, End Time: 2012-09-06 11:07:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.96% (0.3003 => 0.3302, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.96% (3.7746 => 3.8864, std. dev.: 0.0165) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.25% (2.0176 => 2.4059, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 13.23% (0.5818 => 0.6588, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 13.12% (0.5748 => 0.6502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.86% (0.3578 => 0.4038, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.64% (0.3601 => 0.4056, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3646 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.56% (0.3663 => 0.4123, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.50% (0.3623 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.38% (0.3650 => 0.4102, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3789 => 0.4255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3914 => 0.4391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.06% (0.3940 => 0.4415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.4003 => 0.4485, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.98% (0.7061 => 0.7907, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.13% (0.7710 => 0.8568, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.40% (1.3693 => 1.5117, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.97% (3.9660 => 4.3615, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 9.80% (0.4328 => 0.4752, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.78% (0.2781 => 0.3053, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.63% (0.2782 => 0.3050, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.55% (0.5265 => 0.5768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.36% (0.7038 => 0.7697, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.23% (0.3899 => 0.4259, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.21% (0.4062 => 0.4436, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 9.21% (0.2607 => 0.2847, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.19% (0.9199 => 1.0044, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2628 => 0.2869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.14% (0.2690 => 0.2936, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.10% (0.6959 => 0.7592, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.08% (1.9828 => 2.1629, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.07% (1.2193 => 1.3299, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.07% (0.3022 => 0.3296, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.01% (0.3485 => 0.3799, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.00% (0.2655 => 0.2894, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.99% (0.2937 => 0.3201, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.93% (0.3293 => 0.3587, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.91% (0.3489 => 0.3800, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.90% (0.2966 => 0.3230, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.88% (0.2760 => 0.3005, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.80% (0.2726 => 0.2966, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 8.80% (0.2761 => 0.3004, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.77% (0.3580 => 0.3894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.75% (0.2696 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.75% (0.2765 => 0.3007, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.73% (0.3756 => 0.4084, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.69% (0.3107 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.63% (1.4563 => 1.5820, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.50% (1.1364 => 1.2330, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.3149 => 0.3415, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.43% (0.2988 => 0.3240, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.42% (0.4016 => 0.4354, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.40% (0.3192 => 0.3460, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.32% (0.5577 => 0.6041, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.32% (13.8202 => 14.9695, std. dev.: 0.0133) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.2914 => 0.3155, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 8.24% (0.1589 => 0.1720, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.22% (0.3453 => 0.3737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.14% (0.3868 => 0.4183, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: 8.10% (0.7506 => 0.8114, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (7.2180 => 7.8009, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.04% (0.4390 => 0.4743, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.93% (0.1588 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.92% (0.3246 => 0.3503, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.89% (0.3534 => 0.3813, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.76% (0.4791 => 0.5163, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 7.64% (0.2945 => 0.3170, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.61% (0.2023 => 0.2177, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.53% (0.2243 => 0.2412, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.53% (1.0313 => 1.1090, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.52% (1.1061 => 1.1893, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 7.49% (3.8646 => 4.1542, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6283 => 0.6751, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.43% (0.5637 => 0.6056, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.40% (13.2842 => 14.2675, std. dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8310 => 0.8908, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.90% (0.3755 => 0.4014, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.82% (0.7460 => 0.7969, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 6.79% (2.1791 => 2.3271, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.73% (1.3245 => 1.4137, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 6.73% (1.9270 => 2.0566, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.63% (16.6129 => 17.7142, std. dev.: 0.0172) MultiSource/Applications/minisat/minisat: 6.60% (0.6744 => 0.7189, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.43% (3.1889 => 3.3941, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.43% (3.6692 => 3.9051, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (1.2749 => 1.3564, std. dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.39% (0.8698 => 0.9254, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.36% (4.3801 => 4.6586, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4113 => 0.4374, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 6.23% (1.0594 => 1.1254, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.13% (4.4433 => 4.7157, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6135 => 0.6511, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.08% (1.3813 => 1.4653, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 6.07% (1.2292 => 1.3038, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.06% (1.3819 => 1.4657, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.89% (0.3245 => 0.3436, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.72% (0.3131 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1975, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.64% (14.8535 => 15.6919, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 5.63% (8.4961 => 8.9741, std. dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 5.62% (14.5298 => 15.3461, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.57% (0.8818 => 0.9309, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.09% (0.6250 => 0.6568, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.85% (6.5754 => 6.8941, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.82% (3.2742 => 3.4319, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.77% (4.9865 => 5.2246, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.75% (0.4805 => 0.5033, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.72% (4.6629 => 4.8831, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5188 => 1.5822, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 4.08% (16.2614 => 16.9245, std. dev.: 0.0133) MultiSource/Applications/lua/lua: 4.01% (3.7467 => 3.8970, std. dev.: 0.0100) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.00% (0.9108 => 0.9472, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.98% (2.1007 => 2.1844, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.2785 => 6.5030, std. dev.: 0.0191) MultiSource/Benchmarks/Bullet/bullet: 3.13% (33.2944 => 34.3355, std. dev.: 0.0276) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 23.95% (1.8175 => 2.2528, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4117, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.09% (1.1560 => 1.2264, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.19% (0.3139 => 0.3302, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0058, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.60% (10.7476 => 11.1345, std. dev.: 0.0350) SingleSource/Benchmarks/Misc/flops-6: 3.53% (1.9199 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 3.00% (3.7731 => 3.8864, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6024, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.99% (1.5824 => 1.6139, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5183, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.16% (1.4298 => 1.4464, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5945, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6867, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.70% (0.4657 => 0.4112, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.16% (22.5627 => 21.6247, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.28% (20.3410 => 18.2496, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9229, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5961, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2279, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1477, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2324, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (4.1080 => 4.0632, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.02% (4.5928 => 4.5459, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 06:49:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 08:49:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906134948.D224C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3481?compare_to=3478&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3481, Order: 163309, Start Time: 2012-09-06 12:30:44, End Time: 2012-09-06 13:50:29 To: 3478, Order: 163304, Start Time: 2012-09-06 10:41:51, End Time: 2012-09-06 12:02:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (140 on baseline) Performance Improvements: 5 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.77% (13.4939 => 14.1381, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -2.50% (2.2006 => 2.1455, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -1.90% (0.6632 => 0.6506, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -1.81% (0.6527 => 0.6409, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -1.74% (1.3390 => 1.3157, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -1.66% (0.7966 => 0.7834, std. dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.37% (10.3673 => 14.1381, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: 25.28% (0.1622 => 0.2032, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.21% (0.3543 => 0.4082, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.94% (0.3473 => 0.3992, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 14.71% (0.3561 => 0.4085, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 14.64% (0.3497 => 0.4009, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.59% (0.3543 => 0.4060, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 14.59% (0.3516 => 0.4029, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 14.08% (0.3694 => 0.4214, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.82% (0.3828 => 0.4357, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.60% (0.3927 => 0.4461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.46% (0.3886 => 0.4409, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (2.2022 => 2.4700, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.84% (1.1194 => 1.2519, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (1.7609 => 1.9481, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 8.17% (0.5925 => 0.6409, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.13% (0.8172 => 0.8836, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 8.04% (0.3282 => 0.3546, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 7.89% (0.6030 => 0.6506, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.54% (7.0540 => 7.5860, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7326 => 0.7834, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.71% (0.3817 => 0.4073, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.67% (0.4615 => 0.4923, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.63% (0.7433 => 0.7926, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2554 => 0.2717, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (9.4845 => 10.0804, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.27% (0.7115 => 0.7561, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (1.5415 => 1.6369, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.19% (8.1363 => 8.6396, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.13% (0.7835 => 0.8315, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 6.09% (10.4361 => 11.0716, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.8067 => 0.8558, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (4.2646 => 4.5237, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.5860 => 0.6216, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.3050 => 1.3831, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.5105 => 0.5395, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 5.66% (0.3109 => 0.3285, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (5.0018 => 5.2796, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.50% (3.3354 => 3.5189, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.6675 => 0.7042, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9765 => 1.0290, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.9449 => 5.2085, std. dev.: 0.0125) MultiSource/Benchmarks/McCat/09-vor/vor: 5.28% (0.3180 => 0.3348, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.11% (0.3092 => 0.3250, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (14.3668 => 15.0984, std. dev.: 0.0050) MultiSource/Applications/Burg/burg: 5.06% (1.1642 => 1.2231, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.96% (0.5020 => 0.5269, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (1.1861 => 1.2443, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.88% (1.5603 => 1.6365, std. dev.: 0.0133) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2700 => 0.2829, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.78% (3.8723 => 4.0573, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/05-eks/eks: 4.75% (0.4299 => 0.4503, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.70% (0.4636 => 0.4854, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.66% (2.0273 => 2.1217, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 4.59% (1.0722 => 1.1214, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.56% (0.4103 => 0.4290, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.4064 => 0.4249, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.52% (0.3387 => 0.3540, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 4.49% (0.6456 => 0.6746, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 4.35% (2.2969 => 2.3968, std. dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 4.31% (5.7591 => 6.0072, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.28% (0.2756 => 0.2874, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.28% (0.6450 => 0.6726, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.25% (0.3650 => 0.3805, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4289 => 0.4470, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.22% (0.3865 => 0.4028, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.16% (0.4203 => 0.4378, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8921 => 0.9290, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3826 => 0.3979, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.97% (0.3098 => 0.3221, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3935 => 0.4089, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3603 => 0.3743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.87% (0.3052 => 0.3170, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.82% (0.2877 => 0.2987, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.82% (2.0665 => 2.1455, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.80% (0.3162 => 0.3282, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.73% (1.4186 => 1.4715, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3232 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.68% (0.4048 => 0.4197, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.66% (0.3684 => 0.3819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.57% (1.5859 => 1.6425, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.2024 => 2.2755, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.22% (17.1811 => 17.7348, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1840 => 1.2184, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.61% (21.9371 => 22.5093, std. dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: 2.45% (1.2842 => 1.3157, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.13% (7.9617 => 8.1309, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.8101 => 0.8260, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.09% (0.2944 => 0.3300, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.18% (3.1578 => 3.3845, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 4.63% (1.1396 => 1.1924, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (4.2280 => 4.3609, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7479, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2470, std. dev.: 0.0445) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7904, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std. dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.18% (5.2763 => 3.2088, std. dev.: 0.0170) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.92% (5.3855 => 3.8278, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.52% (5.3526 => 3.8260, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1164, std. dev.: 0.0400) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.43% (2.9384 => 2.5732, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -8.51% (22.1758 => 20.2886, std. dev.: 0.0295) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2679, std. dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.27% (1.8329 => 1.7180, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.96% (1.6805 => 1.6140, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.26% (8.6802 => 8.3975, std. dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5112, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0041, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.44% (1.2373 => 1.2071, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9655, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -2.33% (12.4730 => 12.1827, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.27% (6.2999 => 6.2200, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 07:11:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 09:11:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906141148.371CF2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3482?compare_to=3479&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3482, Order: 163309, Start Time: 2012-09-06 13:01:13, End Time: 2012-09-06 14:12:25 To: 3479, Order: 163307, Start Time: 2012-09-06 11:33:49, End Time: 2012-09-06 12:45:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (46 on baseline) Performance Improvements: 4 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.78% (0.1889 => 0.2017, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.44% (0.7619 => 0.7729, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.28% (21.7249 => 22.6558, std. dev.: 0.0355) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.18% (1.0745 => 1.1087, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.42% (0.8560 => 0.8767, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 2.04% (1.3459 => 1.3733, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 1.22% (16.3610 => 16.5602, std. dev.: 0.0201) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.08% (1.8382 => 1.8580, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (6.3770 => 6.2744, std. dev.: 0.0166) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.28% (1.4370 => 1.4186, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (4.3008 => 4.2563, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.01% (5.3515 => 5.2973, std. dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 4.38% (2.1763 => 2.2716, std. dev.: 0.0248) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (1.1653 => 1.2086, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.7722 => 0.7982, std. dev.: 0.0069) MultiSource/Applications/lemon/lemon: 2.94% (1.0046 => 1.0341, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5150 => 1.5557, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 2.54% (0.6173 => 0.6330, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (12.6413 => 12.9133, std. dev.: 0.1002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.58% (0.7226 => 0.7340, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.7639 => 0.7744, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.05% (1.1672 => 1.1794, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std. dev.: 0.0223) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.45% (0.0917 => 0.1077, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 15.51% (1.7426 => 2.0128, std. dev.: 0.0229) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.23% (0.0766 => 0.0875, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5565, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/sieve: 12.64% (3.4406 => 3.8755, std. dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 11.27% (0.3746 => 0.4168, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (62.4126 => 69.1206, std. dev.: 0.0330) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.18% (1.0063 => 1.1087, std. dev.: 0.0111) SingleSource/Benchmarks/McGill/misr: 10.08% (0.4296 => 0.4729, std. dev.: 0.0083) SingleSource/Benchmarks/Stanford/Puzzle: 9.63% (0.1433 => 0.1571, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.96% (7.0025 => 7.6298, std. dev.: 0.0548) MultiSource/Applications/siod/siod: 7.96% (3.5520 => 3.8346, std. dev.: 0.0180) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.60% (0.2857 => 0.3074, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/methcall: 7.44% (8.5566 => 9.1931, std. dev.: 0.0328) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.4876 => 3.7180, std. dev.: 0.0293) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7369, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (15.8312 => 16.6506, std. dev.: 0.2068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.77% (40.4792 => 42.4101, std. dev.: 0.1536) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 3.89% (15.2242 => 15.8162, std. dev.: 0.0350) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.17% (0.8498 => 0.8767, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.58% (0.5587 => 0.5731, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 2.57% (8.5113 => 8.7303, std. dev.: 0.0570) SingleSource/Benchmarks/Shootout-C++/hash: 2.08% (0.6308 => 0.6439, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.99% (5.1938 => 5.2973, std. dev.: 0.0161) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (2.4455 => 2.4898, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.42% (22.3381 => 22.6558, std. dev.: 0.0355) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5317, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6663, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (4.6414 => 4.6915, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.03% (6.2244 => 6.2884, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.52% (0.3497 => 0.2045, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.33% (5.2665 => 4.1431, std. dev.: 0.1046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.98% (1.1647 => 0.9902, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std. dev.: 0.0291) MultiSource/Applications/SIBsim4/SIBsim4: -9.04% (3.4230 => 3.1137, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.64% (3.2007 => 2.9561, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -6.54% (9.2503 => 8.6455, std. dev.: 0.1112) SingleSource/Benchmarks/Misc/pi: -6.18% (1.6538 => 1.5516, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -4.90% (1.4441 => 1.3733, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4106, std. dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (3.9413 => 3.7631, std. dev.: 0.0530) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -3.97% (8.5323 => 8.1934, std. dev.: 0.1281) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.59% (1.7361 => 1.6737, std. dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: -3.12% (7.6833 => 7.4436, std. dev.: 0.0134) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.05% (1.2722 => 1.2334, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.03% (45.4683 => 44.0915, std. dev.: 0.2274) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.85% (1.1683 => 1.1350, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.80% (1.2959 => 1.2596, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -2.76% (92.7467 => 90.1902, std. dev.: 0.9481) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.59% (3.7496 => 3.6526, std. dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.56% (61.1734 => 59.6091, std. dev.: 0.3112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2276, std. dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -1.37% (1.7330 => 1.7093, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3172, std. dev.: 0.0578) SingleSource/Benchmarks/Misc/oourafft: -1.29% (3.8200 => 3.7708, std. dev.: 0.0147) MultiSource/Benchmarks/sim/sim: -1.24% (3.8907 => 3.8425, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 07:33:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 09:33:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906143317.8B4E82A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3483?compare_to=3480&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3483, Order: 163312, Start Time: 2012-09-06 13:19:14, End Time: 2012-09-06 14:33:40 To: 3480, Order: 163307, Start Time: 2012-09-06 11:36:03, End Time: 2012-09-06 12:50:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.36% (3.8864 => 3.7946, std. dev.: 0.0298) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.36% (2.0176 => 2.4082, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.63% (0.3578 => 0.4030, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3663 => 0.4118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3601 => 0.4048, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.41% (0.1072 => 0.1205, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.38% (0.5818 => 0.6538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3623 => 0.4071, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.34% (0.3646 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3650 => 0.4096, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3914 => 0.4390, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 12.14% (0.5748 => 0.6446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.09% (0.3789 => 0.4247, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.94% (0.7061 => 0.7904, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.89% (0.4003 => 0.4479, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 11.70% (0.3940 => 0.4401, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.14% (0.7710 => 0.8569, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.99% (1.3693 => 1.5061, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.98% (3.9660 => 4.3617, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.94% (0.2596 => 0.2854, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.5265 => 0.5771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.52% (0.4328 => 0.4740, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.21% (0.2781 => 0.3037, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.15% (0.9199 => 1.0041, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.13% (0.2782 => 0.3036, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.08% (0.7038 => 0.7677, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.01% (1.2193 => 1.3292, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.01% (0.6959 => 0.7586, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 8.86% (0.4062 => 0.4422, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.75% (0.3899 => 0.4240, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.75% (0.2607 => 0.2835, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.71% (0.3489 => 0.3793, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.70% (0.2655 => 0.2886, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.70% (0.2690 => 0.2924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.68% (0.2628 => 0.2856, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.66% (1.9828 => 2.1545, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.64% (0.3022 => 0.3283, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 8.59% (0.2760 => 0.2997, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.58% (1.4563 => 1.5812, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 8.53% (0.3293 => 0.3574, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.52% (0.3756 => 0.4076, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.50% (1.1364 => 1.2330, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.44% (0.2937 => 0.3185, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.44% (13.8202 => 14.9869, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2127 => 0.2306, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.41% (0.3485 => 0.3778, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.40% (0.2966 => 0.3215, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2765 => 0.2997, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.38% (0.3580 => 0.3880, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 8.33% (0.2726 => 0.2953, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.32% (0.5577 => 0.6041, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.31% (0.1588 => 0.1720, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.31% (0.2696 => 0.2920, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.29% (0.2761 => 0.2990, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.24% (7.2180 => 7.8125, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.13% (0.4379 => 0.4735, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.05% (0.7506 => 0.8110, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.05% (0.3107 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.03% (0.3149 => 0.3402, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.97% (0.4016 => 0.4336, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.97% (0.2988 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.96% (0.3192 => 0.3446, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.81% (0.4390 => 0.4733, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 7.79% (0.3453 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.79% (0.4791 => 0.5164, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 7.73% (0.3868 => 0.4167, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.68% (1.1061 => 1.1910, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.3534 => 0.3802, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.52% (1.0313 => 1.1089, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.47% (0.5637 => 0.6058, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6283 => 0.6751, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.31% (0.2995 => 0.3214, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.30% (13.2842 => 14.2538, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.19% (3.8646 => 4.1426, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.09% (0.8310 => 0.8899, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 7.03% (0.2945 => 0.3152, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 6.85% (2.1791 => 2.3284, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.77% (1.3245 => 1.4142, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.65% (1.9270 => 2.0552, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.4113 => 0.4380, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.46% (16.6129 => 17.6857, std. dev.: 0.0155) MultiSource/Applications/minisat/minisat: 6.45% (0.6744 => 0.7179, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3755 => 0.3997, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.40% (3.6692 => 3.9040, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.36% (3.1889 => 3.3917, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (1.2749 => 1.3544, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.0594 => 1.1252, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2504 => 0.2659, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.19% (0.8698 => 0.9236, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.18% (4.3801 => 4.6506, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6135 => 0.6511, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.12% (4.4433 => 4.7154, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.99% (1.3813 => 1.4640, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.96% (1.3819 => 1.4643, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 5.84% (0.3131 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (8.4961 => 8.9891, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 5.76% (14.8535 => 15.7097, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 5.76% (1.2292 => 1.3000, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.74% (0.2859 => 0.3023, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.73% (0.3245 => 0.3431, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.69% (14.5298 => 15.3560, std. dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1974, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.25% (0.8818 => 0.9281, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8885, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.78% (0.6250 => 0.6549, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.77% (6.5754 => 6.8890, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.71% (3.2742 => 3.4284, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.62% (0.4805 => 0.5027, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.61% (4.9865 => 5.2166, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (1.5188 => 1.5818, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 4.14% (16.2614 => 16.9342, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.11% (0.9108 => 0.9482, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.05% (3.7467 => 3.8985, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.95% (2.1007 => 2.1836, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.79% (6.2785 => 6.5164, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 2.94% (33.2944 => 34.2717, std. dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 25.35% (1.8175 => 2.2782, std. dev.: 0.0395) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.03% (1.1560 => 1.2257, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.29% (0.3139 => 0.3305, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.75% (10.7476 => 11.1510, std. dev.: 0.0297) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5963, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.96% (1.5824 => 1.6134, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.19% (1.4298 => 1.4468, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5989, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.77% (0.4657 => 0.4109, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.19% (22.5627 => 21.6181, std. dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.99% (20.3410 => 18.3093, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9237, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5906, std. dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2478, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2263, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.23% (4.1080 => 4.0576, std. dev.: 0.0033) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1941, std. dev.: 0.0182) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2364, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -1.02% (4.5928 => 4.5461, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 07:51:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 09:51:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906145115.8E9312A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3484?compare_to=3477&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3484, Order: 163309, Start Time: 2012-09-06 12:09:04, End Time: 2012-09-06 14:52:24 To: 3477, Order: 163295, Start Time: 2012-09-06 08:57:13, End Time: 2012-09-06 11:40:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (124 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/siod/siod: 1.53% (0.6848 => 0.6953, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.39% (0.2098 => 0.2253, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 15.98% (0.3442 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.93% (0.3446 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.84% (0.3465 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.80% (0.3488 => 0.4039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.78% (0.3460 => 0.4006, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 15.76% (0.3496 => 0.4047, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.65% (0.3469 => 0.4012, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.23% (0.3643 => 0.4198, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 15.04% (0.3650 => 0.4199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.88% (0.3724 => 0.4278, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5826 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5889 => 0.6444, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.1620 => 0.1762, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7171 => 0.7744, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.76% (1.5932 => 1.7168, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (3.5627 => 3.8317, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (1.6211 => 1.7418, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.5900 => 0.6335, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.29% (1.3152 => 1.4111, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.15% (0.4361 => 0.4673, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.69% (0.5026 => 0.5362, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.65% (0.2738 => 0.2920, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2875 => 0.3066, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (0.3930 => 0.4186, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.43% (0.3792 => 0.4036, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.3004 => 0.3195, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2729 => 0.2901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.27% (0.2823 => 0.3000, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2813 => 0.2989, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (0.5000 => 0.5312, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.23% (0.3195 => 0.3394, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.23% (0.9909 => 1.0526, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.23% (2.7292 => 2.8991, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2750 => 0.2921, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.21% (1.0781 => 1.1450, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 6.21% (4.2109 => 4.4722, std. dev.: 0.0161) MultiSource/Applications/spiff/spiff: 6.18% (0.4029 => 0.4278, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2803 => 0.2976, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2792 => 0.2964, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.07% (0.3096 => 0.3284, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.02% (0.3124 => 0.3312, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2811 => 0.2980, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (2.0673 => 2.1913, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.1968 => 0.2085, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.2736 => 0.2898, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.91% (0.2911 => 0.3083, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.78% (0.3060 => 0.3237, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: 5.74% (0.3258 => 0.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.73% (0.3348 => 0.3540, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3267 => 0.3454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.64% (0.3477 => 0.3673, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 5.60% (5.5417 => 5.8521, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3362 => 0.3550, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.58% (0.3726 => 0.3934, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3317 => 0.3502, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (0.3890 => 0.4104, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3625 => 0.3824, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.47% (1.9694 => 2.0772, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3282 => 0.3461, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3678 => 0.3876, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (0.4658 => 0.4906, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 5.30% (0.2566 => 0.2702, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (1.9966 => 2.1016, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.26% (0.3690 => 0.3884, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.15% (2.1013 => 2.2096, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.09% (0.4146 => 0.4357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (0.4251 => 0.4464, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.00% (0.3903 => 0.4098, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (4.4195 => 4.6397, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.90% (0.3981 => 0.4176, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.89% (23.5202 => 24.6702, std. dev.: 0.0141) MultiSource/Applications/hbd/hbd: 4.87% (0.9697 => 1.0169, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.82% (4.6177 => 4.8405, std. dev.: 0.0075) MultiSource/Applications/siod/siod: 4.81% (0.6634 => 0.6953, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.77% (1.8794 => 1.9690, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 4.71% (2.1653 => 2.2673, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.3271 => 0.3425, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.71% (0.3845 => 0.4026, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 4.68% (1.4269 => 1.4937, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.48% (0.7875 => 0.8228, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.4139 => 0.4322, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.5012 => 0.5230, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.30% (0.6435 => 0.6712, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.27% (0.2737 => 0.2854, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.26% (0.5546 => 0.5782, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.3084 => 0.3215, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 4.23% (0.3336 => 0.3477, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.2969 => 0.3093, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 2.87% (0.4847 => 0.4986, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.82% (2.0346 => 2.0920, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (0.5361 => 0.5477, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (0.7426 => 0.7576, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (11.6398 => 11.8212, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (4.6926 => 4.7643, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6712, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1651, std. dev.: 0.0322) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6314, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std. dev.: 0.0145) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5012, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4435, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2913, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5999, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5169, std. dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7886, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7914, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -2.02% (17.2379 => 16.8901, std. dev.: 0.0282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5721, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9648, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 08:37:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 10:37:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906153755.739402A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3485?compare_to=3481&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3485, Order: 163312, Start Time: 2012-09-06 14:19:10, End Time: 2012-09-06 15:38:49 To: 3481, Order: 163309, Start Time: 2012-09-06 12:30:44, End Time: 2012-09-06 13:50:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (141 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.69% (0.5335 => 0.5532, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.26% (78.2390 => 80.0049, std. dev.: 0.5388) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.76% (14.1381 => 13.7479, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.61% (10.3673 => 13.7479, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 25.89% (0.1622 => 0.2042, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3473 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.47% (0.3497 => 0.4038, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.47% (0.3543 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.44% (0.3516 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.38% (0.3543 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.30% (0.3561 => 0.4106, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.92% (0.3694 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.52% (0.3828 => 0.4384, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.29% (0.3927 => 0.4488, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.20% (0.3886 => 0.4438, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.29% (0.1432 => 0.1608, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.11% (2.2022 => 2.4689, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.05% (1.1194 => 1.2543, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.69% (1.7609 => 1.9491, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.05% (0.6030 => 0.6576, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.04% (0.3282 => 0.3546, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.90% (0.7326 => 0.7905, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.57% (7.0540 => 7.5883, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.47% (0.3817 => 0.4102, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.8172 => 0.8779, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.19% (0.7835 => 0.8398, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.95% (0.3307 => 0.3537, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.67% (0.4615 => 0.4923, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.67% (0.2758 => 0.2942, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.64% (0.5569 => 0.5939, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (8.1363 => 8.6646, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2554 => 0.2719, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.42% (9.4845 => 10.0936, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (0.7433 => 0.7909, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 6.31% (0.7115 => 0.7564, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (10.4361 => 11.0793, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (4.2646 => 4.5239, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 5.99% (0.3423 => 0.3628, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.96% (1.5415 => 1.6334, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.96% (0.5860 => 0.6209, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.3050 => 1.3819, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.8067 => 0.8542, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.5105 => 0.5401, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.79% (0.3109 => 0.3289, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.63% (3.3354 => 3.5232, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.50% (5.0018 => 5.2767, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.48% (4.9449 => 5.2159, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.41% (0.6675 => 0.7036, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.3422 => 0.3607, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.40% (1.5603 => 1.6446, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9765 => 1.0289, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.23% (0.3441 => 0.3621, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.20% (0.4636 => 0.4877, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.4064 => 0.4275, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.19% (0.4103 => 0.4316, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.19% (0.2891 => 0.3041, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.10% (1.1642 => 1.2236, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2725 => 0.2863, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (14.3668 => 15.0940, std. dev.: 0.0133) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2905 => 0.3051, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.98% (0.5020 => 0.5270, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.95% (0.4203 => 0.4411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2831 => 0.2971, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.94% (0.3865 => 0.4056, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (1.1861 => 1.2447, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.89% (0.2700 => 0.2832, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.88% (0.3136 => 0.3289, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.6456 => 0.6770, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.85% (0.6450 => 0.6763, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.85% (0.3650 => 0.3827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.84% (0.2871 => 0.3010, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.82% (3.8723 => 4.0589, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2714 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.79% (0.2756 => 0.2888, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2872 => 0.3008, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.71% (0.3098 => 0.3244, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 4.71% (0.4289 => 0.4491, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.70% (0.3826 => 0.4006, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.70% (2.0665 => 2.1636, std. dev.: 0.0114) MultiSource/Applications/treecc/treecc: 4.68% (2.0273 => 2.1221, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.65% (0.3162 => 0.3309, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.61% (0.3232 => 0.3381, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.61% (0.3603 => 0.3769, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2877 => 0.3009, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.59% (0.3052 => 0.3192, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.58% (0.2793 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2802 => 0.2930, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 4.51% (0.3684 => 0.3850, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.49% (0.3387 => 0.3539, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3283 => 0.3430, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.4048 => 0.4229, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.47% (1.0722 => 1.1201, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 4.43% (5.7591 => 6.0145, std. dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3935 => 0.4109, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.36% (2.2969 => 2.3970, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 4.29% (0.4620 => 0.4818, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.03% (0.5981 => 0.6222, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 4.02% (0.3379 => 0.3515, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8921 => 0.9280, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.4186 => 1.4749, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.38% (1.5859 => 1.6395, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.30% (1.2842 => 1.3266, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 3.13% (17.1811 => 17.7196, std. dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.2024 => 2.2708, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.1840 => 1.2169, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.60% (21.9371 => 22.5085, std. dev.: 0.0242) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (7.9617 => 8.1555, std. dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.8101 => 0.8296, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.13% (0.2944 => 0.3301, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3831, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 4.63% (1.1396 => 1.1924, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (4.2280 => 4.3620, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: 2.20% (0.5413 => 0.5532, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2345, std. dev.: 0.0255) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7892, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.33% (5.2763 => 3.2010, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.98% (5.3855 => 3.8250, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.55% (5.3526 => 3.8246, std. dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1086, std. dev.: 0.0270) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.44% (2.9384 => 2.5729, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.45% (22.1758 => 20.3012, std. dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (19.9488 => 18.2337, std. dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.19% (1.8329 => 1.7195, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5056, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4274, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9968, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9648, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -2.30% (12.4730 => 12.1860, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -2.21% (1.2373 => 1.2100, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2315, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 08:41:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 10:41:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906154138.0C38A2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3486?compare_to=3482&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3486, Order: 163312, Start Time: 2012-09-06 14:30:19, End Time: 2012-09-06 15:42:25 To: 3482, Order: 163309, Start Time: 2012-09-06 13:01:13, End Time: 2012-09-06 14:12:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (59 on baseline) Performance Improvements: 1 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 878 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.0385 => 2.1099, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (12.9133 => 13.2063, std. dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.88% (1.2029 => 1.2255, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.29% (6.2744 => 6.3555, std. dev.: 0.0293) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.09% (1.1794 => 1.1922, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.90% (0.3226 => 0.3513, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.28% (2.5312 => 2.7155, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.58% (0.7397 => 0.7810, std. dev.: 0.0100) SingleSource/Benchmarks/McGill/misr: 3.11% (0.4729 => 0.4876, std. dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.99% (2.7193 => 2.7735, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.85% (2.4446 => 2.4898, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (39.0294 => 39.4748, std. dev.: 0.1440) SingleSource/Benchmarks/Shootout/hash: 1.12% (4.3089 => 4.3570, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.67% (22.6558 => 22.2782, std. dev.: 0.1083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (12.6413 => 13.2063, std. dev.: 0.0204) MultiSource/Applications/SIBsim4/SIBsim4: 4.39% (1.1653 => 1.2164, std. dev.: 0.0117) MultiSource/Benchmarks/PAQ8p/paq8p: 4.21% (2.1763 => 2.2679, std. dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (2.0317 => 2.1099, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: 3.64% (0.6173 => 0.6398, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.46% (0.7722 => 0.7989, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.18% (1.5150 => 1.5632, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.4248 => 0.4373, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.82% (2.0972 => 2.1564, std. dev.: 0.0172) MultiSource/Applications/d/make_dparser: 2.30% (3.0225 => 3.0920, std. dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.7639 => 0.7808, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1672 => 1.1922, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.95% (1.2021 => 1.2255, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 1.83% (13.3238 => 13.5680, std. dev.: 0.0882) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.61% (6.2546 => 6.3555, std. dev.: 0.0293) MultiSource/Benchmarks/nbench/nbench: 1.16% (1.0821 => 1.0946, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.18% (3.4629 => 4.2310, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: 14.80% (1.7426 => 2.0005, std. dev.: 0.0148) SingleSource/Benchmarks/Stanford/Puzzle: 14.45% (0.1433 => 0.1640, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.72% (4.0101 => 4.5601, std. dev.: 0.0070) SingleSource/Benchmarks/McGill/misr: 13.50% (0.4296 => 0.4876, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.30% (0.0917 => 0.1039, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 12.86% (3.4406 => 3.8831, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1253, std. dev.: 0.0465) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.54% (0.2694 => 0.2978, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.09% (1.0063 => 1.1078, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 8.89% (7.0025 => 7.6249, std. dev.: 0.0264) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std. dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 8.27% (1.0194 => 1.1037, std. dev.: 0.0248) MultiSource/Applications/siod/siod: 8.20% (3.5520 => 3.8432, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout/methcall: 7.24% (8.5566 => 9.1760, std. dev.: 0.0235) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3301 => 0.3513, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.30% (3.4876 => 3.7073, std. dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.98% (27.1724 => 28.7961, std. dev.: 0.0651) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.69% (40.4792 => 42.7817, std. dev.: 0.3523) SingleSource/Benchmarks/Misc/dt: 4.52% (0.9851 => 1.0296, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (2.5984 => 2.7155, std. dev.: 0.0102) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.05% (2.6656 => 2.7735, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5423, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.70% (6.6312 => 6.8766, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 3.58% (15.2242 => 15.7696, std. dev.: 0.0873) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (2.4042 => 2.4898, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5113 => 8.7555, std. dev.: 0.0471) MultiSource/Benchmarks/BitBench/five11/five11: 2.62% (5.1938 => 5.3299, std. dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.6308 => 0.6465, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.33% (0.5876 => 0.6013, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.6127 => 4.7071, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4834, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5338, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.41% (38.9255 => 39.4748, std. dev.: 0.1440) SingleSource/Benchmarks/Shootout/hash: 1.29% (4.3016 => 4.3570, std. dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6714, std. dev.: 0.0145) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.23% (4.0659 => 4.1160, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/em3d/em3d: 1.18% (4.6414 => 4.6961, std. dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.13% (3.6254 => 3.6664, std. dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.04% (1.5803 => 1.5967, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.02% (5.2665 => 4.1597, std. dev.: 0.0756) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9897, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: -12.17% (8.1594 => 7.1663, std. dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -8.90% (3.4230 => 3.1184, std. dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std. dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.20% (3.2007 => 2.9703, std. dev.: 0.0284) SingleSource/Benchmarks/Misc/richards_benchmark: -6.81% (1.4441 => 1.3458, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5503, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: -5.47% (9.2503 => 8.7443, std. dev.: 0.0422) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (4.6355 => 4.4029, std. dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.84% (0.4140 => 0.3981, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.12% (1.7361 => 1.6820, std. dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: -3.00% (7.6833 => 7.4529, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.85% (1.1683 => 1.1350, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.80% (3.7496 => 3.6446, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2862, std. dev.: 0.0257) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.33% (2.8964 => 2.8288, std. dev.: 0.0237) MultiSource/Benchmarks/PAQ8p/paq8p: -2.15% (92.7467 => 90.7524, std. dev.: 0.4802) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2302, std. dev.: 0.0215) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -1.57% (3.4286 => 3.3748, std. dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std. dev.: 0.0516) MultiSource/Applications/JM/lencod/lencod: -1.38% (6.7458 => 6.6525, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/oourafft: -1.14% (3.8200 => 3.7764, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: -1.00% (2.8599 => 2.8312, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 09:16:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 11:16:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906161647.E65092A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3487?compare_to=3483&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3487, Order: 163316, Start Time: 2012-09-06 15:03:06, End Time: 2012-09-06 16:17:38 To: 3483, Order: 163312, Start Time: 2012-09-06 13:19:14, End Time: 2012-09-06 14:33:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.03% (0.5381 => 0.5490, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.68% (4.0576 => 4.1256, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.29% (2.0176 => 2.4067, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3578 => 0.4028, std. dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.50% (0.1072 => 0.1206, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3601 => 0.4049, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.37% (0.3646 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3663 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.34% (0.5818 => 0.6536, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3623 => 0.4066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3650 => 0.4095, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 12.14% (0.5748 => 0.6446, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.03% (0.3789 => 0.4245, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.96% (0.3914 => 0.4382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.4003 => 0.4480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.85% (0.3940 => 0.4407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.61% (0.7061 => 0.7881, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.71% (0.7710 => 0.8536, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 10.09% (1.3693 => 1.5074, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.98% (3.9660 => 4.3619, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.65% (0.5265 => 0.5773, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.40% (0.4328 => 0.4735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2782 => 0.3040, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.21% (0.2781 => 0.3037, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.17% (0.9199 => 1.0043, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.14% (0.7038 => 0.7681, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.03% (1.2193 => 1.3294, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.00% (0.6959 => 0.7585, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.89% (0.4062 => 0.4423, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.78% (0.2607 => 0.2836, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.74% (0.2690 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.74% (1.9828 => 2.1560, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.72% (0.3899 => 0.4239, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.70% (0.2655 => 0.2886, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.68% (0.3756 => 0.4082, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.67% (0.3022 => 0.3284, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 8.62% (0.3293 => 0.3577, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.60% (0.2628 => 0.2854, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.51% (1.4563 => 1.5803, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.51% (0.3489 => 0.3786, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.47% (1.1364 => 1.2326, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 8.44% (0.2937 => 0.3185, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.44% (0.2760 => 0.2993, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.43% (0.2966 => 0.3216, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.41% (0.3485 => 0.3778, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.38% (13.8202 => 14.9785, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.38% (0.3580 => 0.3880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.35% (0.2765 => 0.2996, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.34% (0.5577 => 0.6042, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 8.33% (0.2761 => 0.2991, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.33% (0.2726 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.27% (0.2696 => 0.2919, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.22% (0.7506 => 0.8123, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (7.2180 => 7.8106, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.19% (0.1588 => 0.1718, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.08% (0.4379 => 0.4733, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.97% (0.2988 => 0.3226, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.95% (0.3107 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.94% (0.4016 => 0.4335, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 7.93% (0.3192 => 0.3445, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.91% (0.3149 => 0.3398, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.82% (0.3453 => 0.3723, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.78% (0.3868 => 0.4169, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.74% (0.4791 => 0.5162, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 7.61% (0.3534 => 0.3803, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.52% (0.4390 => 0.4720, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.45% (0.5637 => 0.6057, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.45% (1.0313 => 1.1081, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.6283 => 0.6749, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.41% (0.2023 => 0.2173, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 7.41% (1.1061 => 1.1881, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8310 => 0.8908, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (13.2842 => 14.2384, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 7.16% (0.2945 => 0.3156, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (3.8646 => 4.1408, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.86% (0.7460 => 0.7972, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.74% (1.3245 => 1.4138, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 6.66% (1.9270 => 2.0554, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 6.64% (2.1791 => 2.3239, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.47% (0.3755 => 0.3998, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.41% (3.6692 => 3.9043, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 6.39% (0.4113 => 0.4376, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.38% (3.1889 => 3.3922, std. dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 6.37% (16.6129 => 17.6707, std. dev.: 0.0205) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (1.2749 => 1.3551, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.21% (0.6135 => 0.6516, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.19% (0.8698 => 0.9236, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.10% (1.0594 => 1.1240, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.08% (4.3801 => 4.6462, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (1.3813 => 1.4644, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.00% (4.4433 => 4.7101, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.96% (1.3819 => 1.4642, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 5.82% (1.2292 => 1.3008, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.75% (0.3131 => 0.3311, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.74% (14.8535 => 15.7067, std. dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9783, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.64% (0.3245 => 0.3428, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (1.1333 => 1.1968, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.54% (14.5298 => 15.3348, std. dev.: 0.0211) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.26% (0.8818 => 0.9282, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.91% (0.4805 => 0.5041, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (6.5754 => 6.8936, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.78% (3.2742 => 3.4308, std. dev.: 0.0150) MultiSource/Applications/oggenc/oggenc: 4.78% (4.6629 => 4.8858, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 4.54% (0.6250 => 0.6534, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (4.9865 => 5.2100, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.31% (16.2614 => 16.9618, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (1.5188 => 1.5834, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (0.9108 => 0.9484, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.01% (2.1007 => 2.1849, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 4.01% (3.7467 => 3.8968, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (6.2785 => 6.5192, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 2.81% (33.2944 => 34.2302, std. dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.11% (1.1560 => 1.2266, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 5.89% (1.2998 => 1.3763, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.13% (0.3139 => 0.3300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.74% (10.7476 => 11.1491, std. dev.: 0.0312) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6041, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6135, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.15% (1.4298 => 1.4463, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5917, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.85% (0.4657 => 0.4105, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.20% (22.5627 => 21.6155, std. dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2549, std. dev.: 0.0461) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3216, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1494, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.47% (3.0263 => 2.9214, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7079, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5907, std. dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6615 => 0.6489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2421, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3305 => 7.2096, std. dev.: 0.0233) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.05% (4.5928 => 4.5444, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 10:11:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 12:11:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906171102.141812A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3488?compare_to=3486&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3488, Order: 163323, Start Time: 2012-09-06 16:00:26, End Time: 2012-09-06 17:11:57 To: 3486, Order: 163312, Start Time: 2012-09-06 14:30:19, End Time: 2012-09-06 15:42:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (50 on baseline) Performance Improvements: 8 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 878 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.35% (0.3560 => 0.3715, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.05% (0.6491 => 0.6754, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (0.7567 => 0.7676, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.19% (15.2985 => 17.1638, std. dev.: 0.1478) SingleSource/Benchmarks/Shootout/heapsort: 6.86% (3.3868 => 3.6190, std. dev.: 0.0520) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.69% (2.8288 => 2.9048, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2176 => 0.2046, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.18% (2.1099 => 2.0429, std. dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/football/football: -2.05% (0.8528 => 0.8353, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.94% (1.4730 => 1.4444, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: -1.89% (1.0946 => 1.0739, std. dev.: 0.0062) MultiSource/Applications/siod/siod: -1.27% (2.1564 => 2.1291, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/siod/siod: -9.65% (3.8432 => 3.4725, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.85% (4.6820 => 4.5018, std. dev.: 0.0247) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.37% (0.6410 => 0.6754, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 4.95% (1.1653 => 1.2230, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.36% (2.1763 => 2.2711, std. dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3582 => 0.3715, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 3.55% (1.0046 => 1.0403, std. dev.: 0.0102) MultiSource/Applications/d/make_dparser: 2.35% (3.0225 => 3.0934, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.54% (0.7639 => 0.7757, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.52% (2.0972 => 2.1291, std. dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (6.2546 => 6.3480, std. dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 1.46% (15.3105 => 15.5337, std. dev.: 0.0274) MultiSource/Benchmarks/mafft/pairlocalalign: 1.31% (8.2186 => 8.3264, std. dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 1.27% (13.3238 => 13.4924, std. dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (1.3935 => 1.4086, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.2021 => 1.2150, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.53% (0.0263 => 0.0388, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout/ary3: 16.58% (1.7426 => 2.0315, std. dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.73% (4.0101 => 4.5605, std. dev.: 0.0081) SingleSource/Benchmarks/McGill/misr: 13.34% (0.4296 => 0.4869, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8804, std. dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: 12.53% (3.2159 => 3.6190, std. dev.: 0.0520) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1061, std. dev.: 0.0442) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6099, std. dev.: 0.0074) SingleSource/Benchmarks/Stanford/Puzzle: 8.58% (0.1433 => 0.1556, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.42% (15.8312 => 17.1638, std. dev.: 0.1478) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.94% (0.2694 => 0.2908, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/methcall: 7.28% (8.5566 => 9.1793, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.4876 => 3.7217, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (0.3301 => 0.3521, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.42% (1.0063 => 1.0709, std. dev.: 0.0164) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7394, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.33% (4.2129 => 4.4374, std. dev.: 0.0732) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.86% (40.4792 => 42.4449, std. dev.: 0.4485) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8565, std. dev.: 0.0268) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.49% (2.6656 => 2.7587, std. dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 3.08% (5.1938 => 5.3537, std. dev.: 0.0167) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.91% (0.3508 => 0.3610, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 2.70% (8.5113 => 8.7413, std. dev.: 0.0387) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 1.90% (0.6308 => 0.6428, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6664, std. dev.: 0.0484) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6907, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.6254 => 3.6627, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.39% (0.7784 => 0.7676, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.68% (5.2665 => 4.2828, std. dev.: 0.0527) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.08% (1.1647 => 0.9891, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1617, std. dev.: 0.0327) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.99% (1.4034 => 1.2773, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -8.95% (3.4230 => 3.1165, std. dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.56% (3.2007 => 2.9588, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/richards_benchmark: -7.20% (1.4441 => 1.3401, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: -5.77% (9.2503 => 8.7166, std. dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4080, std. dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0190) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.99% (0.4140 => 0.3975, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.97% (1.2959 => 1.2444, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.57% (1.7361 => 1.6742, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2304, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.15% (2.4457 => 2.3686, std. dev.: 0.0266) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4508, std. dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.80% (3.7496 => 3.6446, std. dev.: 0.0276) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1361, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2888, std. dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -2.58% (92.7467 => 90.3548, std. dev.: 0.5190) MultiSource/Applications/siod/siod: -2.24% (3.5520 => 3.4725, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3636, std. dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6119 => 0.6005, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2336, std. dev.: 0.0181) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8323, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: -1.40% (6.7458 => 6.6514, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -1.38% (1.7330 => 1.7090, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3150, std. dev.: 0.0781) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7680, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.15% (1.1116 => 1.0988, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 10:26:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 12:26:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906172636.DC8E22A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3489?compare_to=3485&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3489, Order: 163323, Start Time: 2012-09-06 16:07:23, End Time: 2012-09-06 17:27:17 To: 3485, Order: 163312, Start Time: 2012-09-06 14:19:10, End Time: 2012-09-06 15:38:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 12 (144 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 937 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.29% (7.5883 => 8.0653, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.84% (8.1555 => 8.3874, std. dev.: 0.0128) MultiSource/Benchmarks/PAQ8p/paq8p: 2.34% (13.7479 => 14.0701, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 2.32% (22.5085 => 23.0317, std. dev.: 0.0280) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.07% (2.4689 => 2.5199, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.05% (11.0793 => 11.3066, std. dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 1.77% (6.0145 => 6.1210, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (3.8250 => 3.8818, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.47% (3.8246 => 3.8810, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.22% (3.2010 => 3.2402, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (10.0936 => 10.2019, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.35% (55.3644 => 56.6679, std. dev.: 0.0661) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6154 => 4.5514, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.72% (10.3673 => 14.0701, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: 26.94% (0.1622 => 0.2059, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 16.12% (0.3473 => 0.4033, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.89% (0.3543 => 0.4106, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.87% (0.3497 => 0.4052, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.84% (0.3516 => 0.4073, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.78% (0.3561 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.78% (0.3543 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.35% (0.3694 => 0.4261, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 14.86% (0.3828 => 0.4397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.67% (0.3927 => 0.4503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.51% (0.3886 => 0.4450, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.43% (2.2022 => 2.5199, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.34% (7.0540 => 8.0653, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.52% (1.1194 => 1.2596, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.60% (1.7609 => 1.9652, std. dev.: 0.0112) SingleSource/UnitTests/ObjC++/property-reference-object: 9.77% (0.6030 => 0.6619, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5925 => 0.6501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.69% (0.3282 => 0.3600, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7326 => 0.7989, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1625 => 0.1767, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 8.34% (10.4361 => 11.3066, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.93% (0.8172 => 0.8820, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.81% (0.3817 => 0.4115, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1555 => 0.1674, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 7.56% (9.4845 => 10.2019, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.43% (0.1695 => 0.1821, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.4879 => 0.5241, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.17% (0.3307 => 0.3544, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2554 => 0.2735, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.02% (0.4615 => 0.4939, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (8.1363 => 8.7011, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.89% (0.2700 => 0.2886, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.62% (0.7115 => 0.7586, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7433 => 0.7923, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 6.51% (0.3423 => 0.3646, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.50% (0.5860 => 0.6241, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: 6.47% (0.7835 => 0.8342, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.41% (0.6675 => 0.7103, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (1.5415 => 1.6400, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (4.2646 => 4.5355, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.34% (0.1940 => 0.2063, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (5.0018 => 5.3180, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 6.29% (3.3354 => 3.5452, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.5105 => 0.5426, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.28% (5.7591 => 6.1210, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (4.9449 => 5.2553, std. dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.3050 => 1.3856, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2758 => 0.2928, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.8067 => 0.8540, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 5.82% (0.3422 => 0.3621, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4299 => 0.4548, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (14.3668 => 15.1915, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 5.74% (1.5603 => 1.6498, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (0.4064 => 0.4295, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.63% (0.3180 => 0.3359, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.60% (0.9765 => 1.0312, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.60% (0.3162 => 0.3339, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.58% (0.4103 => 0.4332, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.50% (0.5020 => 0.5296, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.46% (0.4636 => 0.4889, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.44% (0.3826 => 0.4034, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (7.9617 => 8.3874, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.33% (1.1861 => 1.2493, std. dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 5.30% (0.2905 => 0.3059, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.23% (1.1642 => 1.2251, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.20% (0.3441 => 0.3620, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.18% (0.3650 => 0.3839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.15% (0.2891 => 0.3040, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.11% (0.3387 => 0.3560, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.10% (0.3136 => 0.3296, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 5.10% (0.6456 => 0.6785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.09% (2.0665 => 2.1716, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.04% (0.4203 => 0.4415, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 5.02% (3.8723 => 4.0665, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 5.01% (0.4289 => 0.4504, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.99% (0.3865 => 0.4058, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.99% (21.9371 => 23.0317, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2831 => 0.2971, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3603 => 0.3780, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.90% (0.2756 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.87% (0.3098 => 0.3249, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.87% (1.0722 => 1.1244, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3232 => 0.3389, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3935 => 0.4126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.78% (0.3052 => 0.3198, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2872 => 0.3009, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.6450 => 0.6757, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.74% (0.2871 => 0.3007, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2877 => 0.3013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2793 => 0.2925, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.72% (2.0273 => 2.1230, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 4.72% (0.4048 => 0.4239, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2714 => 0.2842, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2802 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3684 => 0.3856, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.66% (0.3283 => 0.3436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.52% (0.4620 => 0.4829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.38% (0.3379 => 0.3527, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.27% (2.2969 => 2.3949, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 4.26% (0.8921 => 0.9301, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.23% (0.5981 => 0.6234, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.4186 => 1.4754, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 3.84% (17.1811 => 17.8409, std. dev.: 0.0523) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.52% (1.5859 => 1.6418, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2842 => 1.3260, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2738, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.1840 => 1.2194, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.8101 => 0.8280, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.16% (0.2944 => 0.3302, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3805, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 4.66% (1.1396 => 1.1927, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3727, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7469, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2380, std. dev.: 0.0303) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3045 => 1.3192, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.59% (5.2763 => 3.2402, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.92% (5.3855 => 3.8818, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.49% (5.3526 => 3.8810, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1500, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.81% (2.9384 => 2.5915, std. dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: -7.83% (22.1758 => 20.4402, std. dev.: 0.0493) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2585, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.20% (1.8329 => 1.7193, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6141, std. dev.: 0.0032) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std. dev.: 0.0147) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5011, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4276, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9850, std. dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9620, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: -2.34% (1.2373 => 1.2084, std. dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: -2.29% (12.4730 => 12.1872, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -2.00% (4.6441 => 4.5514, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.32% (6.2999 => 6.2167, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 10:59:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 12:59:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906175950.882D82A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3490?compare_to=3487&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3490, Order: 163325, Start Time: 2012-09-06 16:46:05, End Time: 2012-09-06 18:00:42 To: 3487, Order: 163316, Start Time: 2012-09-06 15:03:06, End Time: 2012-09-06 16:17:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (172 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.53% (0.6602 => 0.6967, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.65% (0.3504 => 0.3632, std. dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.24% (2.0176 => 2.4057, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.59% (0.1072 => 0.1207, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.50% (0.5818 => 0.6545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.28% (0.5748 => 0.6454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3578 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.15% (0.7061 => 0.7919, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.97% (0.3601 => 0.4032, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.96% (0.3646 => 0.4082, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3663 => 0.4096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.78% (0.3650 => 0.4080, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.76% (0.3623 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3789 => 0.4231, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3914 => 0.4368, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.42% (0.3940 => 0.4390, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.42% (0.4003 => 0.4460, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.87% (0.7710 => 0.8548, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.01% (1.3693 => 1.5063, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.00% (3.9660 => 4.3627, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.67% (0.2596 => 0.2847, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.5265 => 0.5771, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 9.12% (0.7038 => 0.7680, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.06% (1.2193 => 1.3298, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.98% (0.9199 => 1.0025, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.92% (0.4328 => 0.4714, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.91% (0.6959 => 0.7579, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.70% (0.2781 => 0.3023, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.52% (0.2782 => 0.3019, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.4563 => 1.5800, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.46% (0.3899 => 0.4229, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.33% (1.1364 => 1.2311, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.2721 => 0.2947, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.27% (0.4062 => 0.4398, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 8.24% (0.1589 => 0.1720, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.23% (0.3756 => 0.4065, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 8.20% (0.3293 => 0.3563, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.17% (0.3022 => 0.3269, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.14% (0.5577 => 0.6031, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.13% (0.4379 => 0.4735, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 8.12% (13.8202 => 14.9425, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.10% (0.2655 => 0.2870, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.10% (7.2180 => 7.8023, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.2607 => 0.2818, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.08% (1.9828 => 2.1430, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/random: 8.07% (0.2690 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.94% (0.7506 => 0.8102, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.94% (0.3489 => 0.3766, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.91% (0.3580 => 0.3863, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2760 => 0.2978, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.86% (0.4390 => 0.4735, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.85% (0.2726 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.83% (0.2937 => 0.3167, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.81% (0.2765 => 0.2981, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.81% (0.4791 => 0.5165, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.79% (0.2696 => 0.2906, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.79% (0.2966 => 0.3197, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.76% (0.3107 => 0.3348, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2761 => 0.2975, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.73% (0.3246 => 0.3497, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.67% (0.2243 => 0.2415, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4016 => 0.4323, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.62% (1.0313 => 1.1099, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 7.46% (0.2988 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.43% (0.5637 => 0.6056, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.41% (0.2023 => 0.2173, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3192 => 0.3427, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.33% (0.3534 => 0.3793, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.31% (3.6692 => 3.9375, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 7.31% (0.2995 => 0.3214, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.3868 => 0.4150, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.28% (1.1061 => 1.1866, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.18% (3.8646 => 4.1422, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (13.2842 => 14.2180, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 6.90% (0.8310 => 0.8883, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.89% (0.2945 => 0.3148, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.4113 => 0.4390, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 6.69% (1.9270 => 2.0559, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 6.60% (3.1889 => 3.3993, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.3245 => 1.4111, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 6.44% (2.1791 => 2.3194, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 6.44% (0.2859 => 0.3043, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 6.44% (0.6744 => 0.7178, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.30% (4.3801 => 4.6559, std. dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (1.2749 => 1.3549, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.23% (14.8535 => 15.7793, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.22% (4.4433 => 4.7197, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.21% (0.6135 => 0.6516, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.20% (16.6129 => 17.6424, std. dev.: 0.0205) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2504 => 0.2658, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (1.3813 => 1.4661, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.13% (1.3819 => 1.4666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.13% (0.3755 => 0.3985, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.08% (1.0594 => 1.1238, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.06% (0.8698 => 0.9225, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 6.01% (8.4961 => 9.0069, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.95% (0.6576 => 0.6967, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.78% (0.3131 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.74% (0.8818 => 0.9324, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.64% (1.1333 => 1.1972, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.3245 => 0.3426, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.55% (14.5298 => 15.3356, std. dev.: 0.0167) MultiSource/Applications/JM/ldecod/ldecod: 5.46% (6.5754 => 6.9344, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.2292 => 1.2936, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.89% (4.6629 => 4.8911, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.4805 => 0.5031, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.67% (3.2742 => 3.4271, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.60% (16.2614 => 17.0099, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.31% (4.9865 => 5.2015, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 4.22% (0.6250 => 0.6514, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.06% (0.9108 => 0.9478, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (6.2785 => 6.5316, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.5188 => 1.5795, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.98% (3.7467 => 3.8959, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.78% (2.1007 => 2.1802, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.45% (0.3511 => 0.3632, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 3.25% (33.2944 => 34.3758, std. dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2680, std. dev.: 0.0454) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4159, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.06% (1.1560 => 1.2260, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.22% (0.3139 => 0.3303, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.61% (10.7476 => 11.1356, std. dev.: 0.0544) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6086, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.97% (1.5824 => 1.6136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5952, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.15% (0.4657 => 0.4091, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.55% (22.5627 => 21.7609, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.38% (20.3410 => 18.2297, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.30% (2.6470 => 2.5067, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.85% (1.3780 => 1.3250, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1494, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9243, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5990, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2363, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2130, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.09% (1.0310 => 1.0198, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.06% (4.5928 => 4.5440, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2369, std. dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 11:03:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 13:03:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906180326.90FB22A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3491?compare_to=3484&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3491, Order: 163319, Start Time: 2012-09-06 15:20:27, End Time: 2012-09-06 18:04:21 To: 3484, Order: 163309, Start Time: 2012-09-06 12:09:04, End Time: 2012-09-06 14:52:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 32.52% (56.5067 => 74.8820, std. dev.: 0.0276) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 16.80% (0.3446 => 0.4025, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 16.76% (0.3442 => 0.4019, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 16.74% (0.3465 => 0.4045, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.69% (0.3488 => 0.4070, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 16.65% (0.3496 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 16.65% (0.3460 => 0.4036, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 16.58% (0.3469 => 0.4044, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 16.00% (0.3650 => 0.4234, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 15.95% (0.3643 => 0.4224, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 15.71% (0.3724 => 0.4309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.71% (0.5826 => 0.6450, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.53% (0.5889 => 0.6509, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.83% (0.1620 => 0.1763, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.69% (0.7171 => 0.7794, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (3.5627 => 3.8307, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.30% (1.6211 => 1.7395, std. dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 7.19% (1.5932 => 1.7078, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.12% (0.3792 => 0.4062, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.5900 => 0.6313, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.96% (0.2875 => 0.3075, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (1.3152 => 1.4060, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.2014 => 0.2152, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.3004 => 0.3209, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.76% (0.5000 => 0.5338, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.63% (0.4361 => 0.4650, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.63% (0.2792 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.62% (0.2750 => 0.2932, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.61% (0.2813 => 0.2999, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.59% (0.2823 => 0.3009, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3195 => 0.3404, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.54% (0.2738 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2803 => 0.2986, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.45% (0.5026 => 0.5350, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 6.40% (0.2811 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.40% (0.2780 => 0.2958, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.37% (0.4994 => 0.5312, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.36% (0.2911 => 0.3096, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.3096 => 0.3292, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.32% (0.3258 => 0.3464, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.32% (0.9909 => 1.0535, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (2.0673 => 2.1968, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.18% (0.4029 => 0.4278, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.13% (2.7292 => 2.8966, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (0.3930 => 0.4171, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.09% (4.2109 => 4.4674, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3267 => 0.3466, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.05% (0.3060 => 0.3245, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3124 => 0.3310, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.93% (1.0781 => 1.1420, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.86% (0.3362 => 0.3559, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.85% (0.3348 => 0.3544, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3282 => 0.3471, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.72% (0.3726 => 0.3939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (0.3625 => 0.3831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.61% (0.3477 => 0.3672, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.2866 => 0.3026, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.46% (0.3678 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.41% (0.2736 => 0.2884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.39% (0.3690 => 0.3889, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.30% (5.5417 => 5.8355, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 5.26% (0.4146 => 0.4364, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.25% (1.9694 => 2.0727, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.16% (1.9966 => 2.0996, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.3981 => 0.4186, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.10% (0.4251 => 0.4468, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.06% (0.9697 => 1.0188, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.05% (0.3845 => 0.4039, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (0.4658 => 0.4893, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.86% (0.3890 => 0.4079, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.79% (2.1013 => 2.2019, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (4.4195 => 4.6290, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (1.8794 => 1.9671, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.3903 => 0.4081, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 4.53% (23.5202 => 24.5847, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.5012 => 0.5238, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.49% (0.2737 => 0.2860, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.48% (4.6177 => 4.8245, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 4.45% (2.1653 => 2.2617, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 4.45% (1.4269 => 1.4904, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.27% (0.7875 => 0.8211, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.3271 => 0.3410, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.15% (0.6435 => 0.6702, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.05% (0.3336 => 0.3471, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.2969 => 0.3088, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.4139 => 0.4304, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.96% (0.3084 => 0.3206, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.86% (0.5546 => 0.5760, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.77% (0.6634 => 0.6884, std. dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (0.4847 => 0.4961, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.19% (2.0346 => 2.0792, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (0.7426 => 0.7559, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.21% (4.6926 => 4.7492, std. dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (11.6398 => 11.7706, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std. dev.: 0.1438) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6348, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std. dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5015, std. dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4557, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2817, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5858, std. dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5621, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9568, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std. dev.: 0.0128) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7727, std. dev.: 0.0501) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9564, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 11:38:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 13:38:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906183837.E2D202A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3492?compare_to=3488&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3492, Order: 163331, Start Time: 2012-09-06 17:28:37, End Time: 2012-09-06 18:39:39 To: 3488, Order: 163323, Start Time: 2012-09-06 16:00:26, End Time: 2012-09-06 17:11:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (57 on baseline) Performance Improvements: 3 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 7.00% (0.1429 => 0.1529, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2046 => 0.2148, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.85% (0.5607 => 0.5711, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.2672 => 1.2902, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8353 => 0.8499, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8521 => 3.9179, std. dev.: 0.0203) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.40% (1.1677 => 1.1841, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.19% (0.9361 => 0.9472, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.14% (4.2874 => 4.3361, std. dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 6.08% (3.2888 => 3.4886, std. dev.: 0.0340) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.81% (1.3529 => 1.3909, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (1.0709 => 1.0897, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -16.05% (3.6190 => 3.0382, std. dev.: 0.2217) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.43% (2.5229 => 2.4615, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel-2: -1.38% (4.3888 => 4.3282, std. dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.28% (0.1414 => 0.1517, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.21% (0.6410 => 0.6680, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.96% (1.1653 => 1.2114, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3217 => 0.3337, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 3.42% (0.6173 => 0.6384, std. dev.: 0.0043) MultiSource/Applications/lemon/lemon: 3.36% (1.0046 => 1.0384, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (12.6413 => 12.9542, std. dev.: 0.0728) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.4248 => 0.4348, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.32% (15.3105 => 15.6661, std. dev.: 0.0516) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.03% (0.7226 => 0.7373, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5309 => 0.5415, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 1.96% (3.0225 => 3.0816, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.7639 => 0.7775, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.72% (4.0318 => 4.1013, std. dev.: 0.0232) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.45% (1.1672 => 1.1841, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.0689 => 1.0843, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.37% (6.2546 => 6.3406, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2616 => 4.3159, std. dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.26% (1.2742 => 1.2902, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.03% (1.2021 => 1.2145, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 1.02% (3.5980 => 3.6348, std. dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0237) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.56% (0.0917 => 0.1078, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.10% (0.0766 => 0.0897, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 15.25% (1.7426 => 2.0083, std. dev.: 0.0303) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5544, std. dev.: 0.0732) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (62.4126 => 69.1210, std. dev.: 0.0420) MultiSource/Applications/sgefa/sgefa: 10.49% (0.3746 => 0.4139, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1433 => 0.1581, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6221, std. dev.: 0.0550) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.29% (1.0063 => 1.0897, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout/methcall: 7.71% (8.5566 => 9.2163, std. dev.: 0.0163) SingleSource/Benchmarks/McGill/chomp: 7.43% (1.0194 => 1.0951, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (3.4876 => 3.7102, std. dev.: 0.0289) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (27.1724 => 28.7441, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.3301 => 0.3465, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: 3.96% (15.2242 => 15.8271, std. dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: 3.83% (0.9851 => 1.0228, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.58% (6.6312 => 6.8688, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.33% (2.6656 => 2.7544, std. dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 2.42% (8.5113 => 8.7176, std. dev.: 0.0673) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (2.4042 => 2.4615, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.08% (0.5876 => 0.5998, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: 1.82% (5.1938 => 5.2884, std. dev.: 0.0274) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.50% (4.6127 => 4.6821, std. dev.: 0.0148) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4455 => 2.4780, std. dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5302, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6719, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.07% (3.6254 => 3.6643, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.07% (2.9152 => 2.9463, std. dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.64% (5.2665 => 4.1797, std. dev.: 0.2130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.78% (1.1647 => 0.9925, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std. dev.: 0.0231) MultiSource/Applications/SIBsim4/SIBsim4: -8.87% (3.4230 => 3.1194, std. dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9436, std. dev.: 0.0535) SingleSource/Benchmarks/Misc/richards_benchmark: -7.00% (1.4441 => 1.3430, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/pi: -6.31% (1.6538 => 1.5494, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.24% (9.2503 => 8.6731, std. dev.: 0.0592) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.15% (0.4140 => 0.3968, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.94% (3.9413 => 3.7859, std. dev.: 0.0412) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.19% (1.7361 => 1.6808, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.16% (3.6023 => 3.4886, std. dev.: 0.0340) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (7.6833 => 7.4509, std. dev.: 0.0365) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.89% (1.1683 => 1.1345, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -2.76% (92.7467 => 90.1912, std. dev.: 0.8419) MultiSource/Applications/siod/siod: -2.34% (3.5520 => 3.4690, std. dev.: 0.0100) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.29% (1.2722 => 1.2431, std. dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.89% (3.7496 => 3.6788, std. dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2338, std. dev.: 0.0310) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.54% (1.0686 => 1.0521, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.45% (1.0926 => 1.0768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7660, std. dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std. dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.12% (1.1116 => 1.0991, std. dev.: 0.0018) MultiSource/Applications/aha/aha: -1.11% (3.4286 => 3.3904, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 12:15:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 14:15:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906191500.439A32A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3493?compare_to=3489&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3493, Order: 163331, Start Time: 2012-09-06 17:56:16, End Time: 2012-09-06 19:15:59 To: 3489, Order: 163323, Start Time: 2012-09-06 16:07:23, End Time: 2012-09-06 17:27:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (139 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (712 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.55% (1.2084 => 1.2271, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.20% (11.3066 => 11.1713, std. dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.44% (10.3673 => 14.1448, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 26.94% (0.1622 => 0.2059, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 16.04% (0.3473 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.70% (0.3497 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.67% (0.3516 => 0.4067, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.61% (0.3543 => 0.4096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.61% (0.3543 => 0.4096, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 15.59% (0.3561 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.27% (0.3694 => 0.4258, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.73% (0.3828 => 0.4392, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.51% (0.3927 => 0.4497, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.41% (0.3886 => 0.4446, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.28% (7.0540 => 8.0612, std. dev.: 0.0207) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.86% (2.2022 => 2.5075, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.19% (1.1194 => 1.2558, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.74% (1.7609 => 1.9677, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.05% (0.3282 => 0.3579, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.6030 => 0.6546, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std. dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1555 => 0.1676, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 7.78% (0.7326 => 0.7896, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.68% (0.3817 => 0.4110, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.65% (0.8172 => 0.8797, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.17% (9.4845 => 10.1642, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.05% (0.4879 => 0.5223, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 7.04% (10.4361 => 11.1713, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (8.1363 => 8.6990, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.62% (0.7835 => 0.8354, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.60% (0.2107 => 0.2246, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3423 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.45% (0.5860 => 0.6238, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (0.7433 => 0.7909, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.37% (0.7115 => 0.7568, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (4.2646 => 4.5358, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.34% (0.5569 => 0.5922, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.34% (0.6675 => 0.7098, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.31% (5.0018 => 5.3172, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.30% (3.3354 => 3.5456, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (4.9449 => 5.2552, std. dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 6.23% (5.7591 => 6.1179, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.23% (1.3050 => 1.3863, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (1.5415 => 1.6360, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.01% (0.5105 => 0.5412, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.8067 => 0.8534, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 5.75% (0.4299 => 0.4546, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.61% (0.2603 => 0.2749, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.59% (0.9765 => 1.0311, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.3180 => 0.3357, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (14.3668 => 15.1470, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 5.31% (1.1642 => 1.2260, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (1.1861 => 1.2482, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 5.23% (0.3387 => 0.3564, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.22% (1.5603 => 1.6417, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.14% (0.5020 => 0.5278, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.03% (0.3422 => 0.3594, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (7.9617 => 8.3605, std. dev.: 0.0154) MultiSource/Applications/lua/lua: 4.94% (3.8723 => 4.0634, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.4064 => 0.4263, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4636 => 0.4863, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.78% (0.4103 => 0.4299, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3826 => 0.4008, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.75% (1.0722 => 1.1231, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.73% (0.6450 => 0.6755, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.71% (2.0273 => 2.1228, std. dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 4.61% (0.2905 => 0.3039, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.60% (0.3650 => 0.3818, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.58% (0.6456 => 0.6752, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.48% (21.9371 => 22.9196, std. dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.48% (0.3865 => 0.4038, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.43% (0.5981 => 0.6246, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4289 => 0.4479, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.37% (2.0665 => 2.1569, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.31% (0.2831 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4203 => 0.4382, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.24% (2.2969 => 2.3944, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.20% (0.3098 => 0.3228, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3935 => 0.4100, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 4.13% (0.4048 => 0.4215, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.09% (0.8921 => 0.9286, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3684 => 0.3834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 4.00% (0.2877 => 0.2992, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.93% (0.3052 => 0.3172, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.93% (0.3283 => 0.3412, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.4186 => 1.4742, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.85% (17.1811 => 17.8429, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2802 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3379 => 0.3503, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.46% (1.5859 => 1.6408, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.2024 => 2.2742, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1840 => 1.2197, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.70% (1.2842 => 1.3189, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.8101 => 0.8302, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.13% (0.2944 => 0.3301, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0006) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3821, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 4.55% (1.1396 => 1.1914, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3735, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7517, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.54% (0.9540 => 0.9687, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5847, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7621, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.92% (5.2763 => 3.2230, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.70% (5.3855 => 3.8936, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.29% (5.3526 => 3.8920, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1154, std. dev.: 0.0442) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.23% (2.9384 => 2.5789, std. dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: -7.72% (22.1758 => 20.4644, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3096, std. dev.: 0.1460) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.26% (1.8329 => 1.7181, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.6805 => 1.6142, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.93% (3.2827 => 3.1536, std. dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4990, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4230, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9822, std. dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9621, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -2.31% (12.4730 => 12.1847, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -2.03% (4.6441 => 4.5500, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2312, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 12:42:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 14:42:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906194226.006472A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3494?compare_to=3490&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3494, Order: 163333, Start Time: 2012-09-06 18:29:04, End Time: 2012-09-06 19:43:35 To: 3490, Order: 163325, Start Time: 2012-09-06 16:46:05, End Time: 2012-09-06 18:00:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5230 => 56.5467, std. dev.: 0.0398) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.34% (1.3250 => 1.3427, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.40% (2.0176 => 2.4091, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.83% (0.3578 => 0.4037, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.74% (0.5818 => 0.6559, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.72% (0.5748 => 0.6479, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.66% (0.3601 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3646 => 0.4103, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.45% (0.3663 => 0.4119, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3650 => 0.4103, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 12.38% (0.7061 => 0.7935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3623 => 0.4071, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3789 => 0.4251, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.11% (0.3914 => 0.4388, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.4003 => 0.4486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.95% (0.3940 => 0.4411, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.02% (0.7710 => 0.8560, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.42% (0.1986 => 0.2193, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.24% (3.9660 => 4.3721, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.05% (0.2596 => 0.2857, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.04% (1.3693 => 1.5068, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.5265 => 0.5771, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.31% (0.9199 => 1.0055, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 9.27% (0.4328 => 0.4729, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.26% (0.7038 => 0.7690, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.19% (1.2193 => 1.3314, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.07% (0.6959 => 0.7590, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.92% (1.4563 => 1.5862, std. dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2781 => 0.3029, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.87% (0.3899 => 0.4245, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1276 => 0.1387, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.64% (0.5577 => 0.6059, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.54% (0.4062 => 0.4409, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.53% (13.8202 => 14.9990, std. dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.51% (1.1364 => 1.2331, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.50% (0.3022 => 0.3279, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.48% (0.2782 => 0.3018, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.46% (0.2127 => 0.2307, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.44% (0.3293 => 0.3571, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.37% (0.3489 => 0.3781, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.35% (0.3580 => 0.3879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.33% (0.3756 => 0.4069, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.29% (0.3485 => 0.3774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2655 => 0.2874, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.24% (0.4379 => 0.4740, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.20% (0.4390 => 0.4750, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 8.19% (0.7506 => 0.8121, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.19% (1.9828 => 2.1452, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (7.2180 => 7.8087, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.18% (0.6283 => 0.6797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.17% (0.2607 => 0.2820, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.17% (0.2914 => 0.3152, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2761 => 0.2985, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2628 => 0.2841, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.09% (0.2966 => 0.3206, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2760 => 0.2983, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.2937 => 0.3174, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 8.02% (0.2243 => 0.2423, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3246 => 0.3506, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.00% (0.2726 => 0.2944, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.99% (0.2765 => 0.2986, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.94% (0.1435 => 0.1549, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.93% (0.4791 => 0.5171, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 7.84% (1.0313 => 1.1122, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.82% (0.3107 => 0.3350, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.80% (0.3192 => 0.3441, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.79% (0.4016 => 0.4329, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.79% (0.2696 => 0.2906, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.69% (0.2925 => 0.3150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3149 => 0.3391, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.68% (3.6692 => 3.9511, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2988 => 0.3216, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.63% (0.3868 => 0.4163, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.58% (1.1061 => 1.1899, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.56% (0.3453 => 0.3714, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.51% (0.2995 => 0.3220, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 7.39% (3.8646 => 4.1501, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3534 => 0.3794, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.34% (0.5637 => 0.6051, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3220 => 0.3456, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.30% (13.2842 => 14.2539, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 7.27% (0.8310 => 0.8914, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 7.03% (0.4113 => 0.4402, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.93% (0.2945 => 0.3149, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.91% (1.9270 => 2.0601, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.86% (3.1889 => 3.4075, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.3245 => 1.4150, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 6.78% (2.1791 => 2.3269, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.3813 => 1.4749, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (1.3819 => 1.4748, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.64% (0.6744 => 0.7192, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.60% (4.3801 => 4.6694, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.56% (4.4433 => 4.7350, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 6.49% (1.2749 => 1.3577, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 6.48% (16.6129 => 17.6887, std. dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 6.45% (1.0594 => 1.1277, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.35% (14.8535 => 15.7971, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.34% (0.6135 => 0.6524, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.33% (0.2859 => 0.3040, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.30% (0.8698 => 0.9246, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.20% (0.6576 => 0.6984, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (8.4961 => 9.0221, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.15% (0.3755 => 0.3986, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.91% (14.5298 => 15.3888, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.82% (1.1333 => 1.1993, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.65% (0.8818 => 0.9316, std. dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 5.59% (1.2292 => 1.2979, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.53% (6.5754 => 6.9388, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.3245 => 0.3424, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.88% (3.2742 => 3.4340, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.79% (0.4805 => 0.5035, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 4.78% (16.2614 => 17.0389, std. dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 4.72% (4.6629 => 4.8830, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.42% (4.9865 => 5.2071, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.41% (0.9108 => 0.9510, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (1.5188 => 1.5833, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (6.2785 => 6.5432, std. dev.: 0.0123) MultiSource/Applications/lua/lua: 4.21% (3.7467 => 3.9046, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (2.1007 => 2.1883, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.73% (0.3511 => 0.3642, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.47% (33.2944 => 34.4498, std. dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std. dev.: 0.0335) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (3.1736 => 3.4174, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.08% (1.1560 => 1.2263, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.19% (0.3139 => 0.3302, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1151, std. dev.: 0.0618) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5996, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.95% (1.5824 => 1.6133, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5894, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4443, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.75% (0.4657 => 0.4110, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.64% (0.2670 => 0.2546, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.49% (22.5627 => 21.7761, std. dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2688, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5110, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1492, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9232, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.82% (1.9762 => 1.9204, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5906, std. dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.56% (1.3780 => 1.3427, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.92% (0.6615 => 0.6488, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2055, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2531, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0221) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.05% (4.5928 => 4.5446, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 14:02:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 16:02:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120906210252.3370C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3495?compare_to=3493&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3495, Order: 163339, Start Time: 2012-09-06 19:44:16, End Time: 2012-09-06 21:04:02 To: 3493, Order: 163331, Start Time: 2012-09-06 17:56:16, End Time: 2012-09-06 19:15:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 9 (144 on baseline) Performance Improvements: 4 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 937 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.29% (14.1448 => 14.4686, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.30% (1.6417 => 1.6631, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.1569 => 2.1816, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.05% (1.3189 => 1.3327, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.11% (12.1847 => 12.5637, std. dev.: 0.0021) MultiSource/Benchmarks/llubenchmark/llu: 2.34% (3.7857 => 3.8744, std. dev.: 0.0283) SingleSource/Benchmarks/Misc/richards_benchmark: 1.94% (1.1914 => 1.2145, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (80.0364 => 81.1665, std. dev.: 0.0660) MultiSource/Applications/lemon/lemon: 1.04% (1.4333 => 1.4482, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.69% (0.3533 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.34% (1.6142 => 1.5765, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.05% (1.3188 => 1.2917, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0556 => 1.0443, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.56% (10.3673 => 14.4686, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 27.81% (0.1622 => 0.2073, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.81% (0.3473 => 0.4022, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.50% (0.3497 => 0.4039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.47% (0.3561 => 0.4112, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.47% (0.3543 => 0.4091, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 15.44% (0.3543 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.42% (0.3516 => 0.4058, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.81% (0.3694 => 0.4241, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.50% (0.3828 => 0.4383, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.39% (0.3927 => 0.4492, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.33% (2.2022 => 2.5177, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 14.20% (0.3886 => 0.4438, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.01% (7.0540 => 8.0426, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (1.7609 => 1.9773, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.28% (1.1194 => 1.2569, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.49% (0.5925 => 0.6487, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.41% (0.3282 => 0.3591, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7326 => 0.7963, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.79% (10.4361 => 11.2490, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1555 => 0.1676, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.71% (9.4845 => 10.2162, std. dev.: 0.0243) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.4879 => 0.5254, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.8172 => 0.8779, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.41% (0.3817 => 0.4100, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2554 => 0.2743, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.38% (0.7835 => 0.8413, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.14% (0.3307 => 0.3543, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.11% (0.4615 => 0.4943, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (8.1363 => 8.7119, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7433 => 0.7947, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.60% (0.3423 => 0.3649, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.59% (0.3109 => 0.3314, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.59% (1.5603 => 1.6631, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 6.55% (0.7115 => 0.7581, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.50% (4.2646 => 4.5417, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (0.6675 => 0.7108, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.48% (0.5860 => 0.6240, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (1.5415 => 1.6412, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.43% (4.9449 => 5.2631, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.39% (5.0018 => 5.3213, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.36% (1.3050 => 1.3880, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.35% (0.2758 => 0.2933, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.34% (0.5569 => 0.5922, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.28% (0.3422 => 0.3637, std. dev.: 0.0079) MultiSource/Applications/d/make_dparser: 6.25% (3.3354 => 3.5439, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3121 => 0.3315, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.4103 => 0.4358, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.4064 => 0.4314, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.11% (0.5105 => 0.5417, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.98% (0.3162 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.8067 => 0.8547, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 5.92% (5.7591 => 6.0999, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.91% (0.3826 => 0.4052, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.85% (0.2891 => 0.3060, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.4636 => 0.4907, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.74% (7.9617 => 8.4185, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.73% (0.9765 => 1.0325, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.70% (0.4299 => 0.4544, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2603 => 0.2751, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.68% (14.3668 => 15.1834, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.58% (0.3136 => 0.3311, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2872 => 0.3032, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (2.0665 => 2.1816, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3650 => 0.3853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.55% (0.3098 => 0.3270, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2871 => 0.3030, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2756 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.48% (0.2831 => 0.2986, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.43% (1.1642 => 1.2274, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 5.42% (0.6456 => 0.6806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.40% (1.1861 => 1.2502, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3865 => 0.4073, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.36% (0.4289 => 0.4519, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 5.36% (0.4048 => 0.4265, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.35% (0.2877 => 0.3031, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 5.34% (0.3052 => 0.3215, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3283 => 0.3458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.32% (0.3232 => 0.3404, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3935 => 0.4143, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.26% (0.2793 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.26% (0.4203 => 0.4424, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.26% (0.3387 => 0.3565, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.25% (0.2802 => 0.2949, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.25% (0.3603 => 0.3792, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 5.21% (3.8723 => 4.0739, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.16% (0.5020 => 0.5279, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 5.16% (0.3684 => 0.3874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (0.4620 => 0.4852, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.98% (1.0722 => 1.1256, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.88% (0.3379 => 0.3544, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.87% (2.0273 => 2.1261, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.79% (0.6450 => 0.6759, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.71% (21.9371 => 22.9708, std. dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/football/football: 4.41% (0.8921 => 0.9314, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.35% (2.2969 => 2.3968, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5981 => 0.6239, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.4186 => 1.4773, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 3.89% (17.1811 => 17.8491, std. dev.: 0.0206) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2842 => 1.3327, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5859 => 1.6432, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.2024 => 2.2780, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.1840 => 1.2193, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.8101 => 0.8301, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3809, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.32% (4.2280 => 4.3683, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std. dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 2.55% (3.7781 => 3.8744, std. dev.: 0.0283) SingleSource/Benchmarks/Misc/fbench: 1.84% (2.2771 => 2.3189, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2397, std. dev.: 0.0285) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2493, std. dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.69% (5.3855 => 3.8944, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.29% (5.3526 => 3.8919, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1055, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.03% (2.9384 => 2.5848, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -7.74% (22.1758 => 20.4600, std. dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2846, std. dev.: 0.1158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0005) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5034, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4189, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9851, std. dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.42% (1.2373 => 1.2073, std. dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.98% (4.6441 => 4.5521, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9994, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5131, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2227, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 14:15:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 16:15:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120906211509.D015D2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3496?compare_to=3491&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3496, Order: 163333, Start Time: 2012-09-06 18:32:41, End Time: 2012-09-06 21:16:20 To: 3491, Order: 163319, Start Time: 2012-09-06 15:20:27, End Time: 2012-09-06 18:04:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.73% (2.5134 => 2.4698, std. dev.: 0.0158) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 17.06% (0.3446 => 0.4034, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 17.06% (0.3465 => 0.4056, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 17.05% (0.3442 => 0.4029, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 16.94% (0.3460 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 16.93% (0.3496 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 16.92% (0.3469 => 0.4056, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.92% (0.3488 => 0.4078, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 16.28% (0.3643 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 16.27% (0.3650 => 0.4244, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.95% (0.3724 => 0.4318, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.77% (0.5826 => 0.6395, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.59% (0.5889 => 0.6454, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.95% (0.1620 => 0.1765, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7171 => 0.7750, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.90% (1.6211 => 1.7491, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (3.5627 => 3.8401, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.52% (1.3152 => 1.4141, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.36% (0.3792 => 0.4071, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.29% (0.4361 => 0.4679, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.25% (0.2014 => 0.2160, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.5900 => 0.6316, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 6.92% (0.4029 => 0.4308, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.91% (1.5932 => 1.7033, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.67% (0.4994 => 0.5327, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.66% (0.2866 => 0.3057, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.59% (0.3930 => 0.4189, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 6.56% (4.2109 => 4.4872, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2875 => 0.3061, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.46% (0.5000 => 0.5323, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.43% (2.7292 => 2.9047, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 6.42% (0.3004 => 0.3197, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (0.5026 => 0.5346, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 6.23% (1.0781 => 1.1453, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.19% (0.9909 => 1.0522, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.13% (0.3195 => 0.3391, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.13% (0.2823 => 0.2996, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.11% (0.2750 => 0.2918, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2738 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2729 => 0.2895, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2813 => 0.2984, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2792 => 0.2960, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.01% (0.2911 => 0.3086, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.00% (5.5417 => 5.8742, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2803 => 0.2969, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.90% (0.2780 => 0.2944, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.83% (2.0673 => 2.1878, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.2736 => 0.2895, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2811 => 0.2974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.78% (0.3096 => 0.3275, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.77% (1.9694 => 2.0830, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3060 => 0.3234, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.3267 => 0.3452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.62% (0.3258 => 0.3441, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3362 => 0.3550, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.46% (1.9966 => 2.1056, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 5.46% (0.3317 => 0.3498, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.38% (0.3124 => 0.3292, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3625 => 0.3819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.35% (0.3348 => 0.3527, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3477 => 0.3662, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.31% (0.3726 => 0.3924, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3282 => 0.3456, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3678 => 0.3870, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (0.4658 => 0.4901, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.22% (2.1013 => 2.2109, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.18% (0.2566 => 0.2699, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (1.8794 => 1.9748, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.04% (0.3890 => 0.4086, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.3271 => 0.3435, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3690 => 0.3875, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.98% (4.6177 => 4.8477, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 4.98% (1.4269 => 1.4979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4146 => 0.4350, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.3903 => 0.4095, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.85% (0.3981 => 0.4174, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.79% (0.3845 => 0.4029, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (4.4195 => 4.6305, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.75% (0.6634 => 0.6949, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.71% (23.5202 => 24.6277, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 4.70% (0.4251 => 0.4451, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (2.1653 => 2.2662, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 4.57% (0.7875 => 0.8235, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.54% (0.9697 => 1.0137, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.4139 => 0.4326, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.38% (0.5546 => 0.5789, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.27% (0.2737 => 0.2854, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.24% (0.2969 => 0.3095, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.5012 => 0.5216, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.05% (0.3084 => 0.3209, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.6435 => 0.6692, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.99% (0.3336 => 0.3469, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.60% (2.0346 => 2.0876, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (0.4847 => 0.4965, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (0.5361 => 0.5466, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (0.7426 => 0.7569, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.35% (11.6398 => 11.7969, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.31% (4.6926 => 4.7543, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6796, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std. dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6424, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1962, std. dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std. dev.: 0.0264) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4487, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2828, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5388, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5879, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4742, std. dev.: 0.0520) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5644, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7948, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.78% (11.2080 => 10.7840, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7759, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -2.82% (17.2379 => 16.7510, std. dev.: 0.0950) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5688, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.43% (16.2163 => 15.9843, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 14:25:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 16:25:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906212513.34B972A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3497?compare_to=3494&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3497, Order: 163342, Start Time: 2012-09-06 20:11:46, End Time: 2012-09-06 21:26:23 To: 3494, Order: 163333, Start Time: 2012-09-06 18:29:04, End Time: 2012-09-06 19:43:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (175 on baseline) Performance Improvements: 4 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 964 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.1641 => 12.5491, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 2.38% (1.2263 => 1.2555, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.69% (0.3533 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.95% (1.3427 => 1.3031, std. dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.91% (1.6133 => 1.5825, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0541 => 1.0432, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.05% (2.0176 => 2.4222, std. dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.60% (0.5818 => 0.6551, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.41% (0.1072 => 0.1205, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 12.39% (0.5748 => 0.6460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.21% (0.7061 => 0.7923, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3578 => 0.3981, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.00% (0.3601 => 0.3997, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.97% (0.7710 => 0.8556, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 10.97% (0.3646 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.96% (0.3650 => 0.4050, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3663 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.4003 => 0.4438, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-3: 10.82% (0.3623 => 0.4015, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3914 => 0.4335, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.74% (0.3789 => 0.4196, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.66% (0.3940 => 0.4360, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.57% (0.1986 => 0.2196, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.56% (0.1013 => 0.1120, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.52% (3.9660 => 4.3832, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.25% (1.3693 => 1.5096, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.21% (0.2596 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.90% (0.5265 => 0.5786, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 9.58% (0.7038 => 0.7712, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 9.54% (0.4328 => 0.4741, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.51% (1.2193 => 1.3353, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.50% (0.1327 => 0.1453, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.42% (0.9199 => 1.0066, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 9.42% (0.2781 => 0.3043, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.31% (0.6959 => 0.7607, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.26% (0.3899 => 0.4260, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.24% (0.2782 => 0.3039, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.2721 => 0.2966, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.99% (1.4563 => 1.5872, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 8.89% (0.4062 => 0.4423, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.77% (0.3022 => 0.3287, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.71% (1.1364 => 1.2354, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 8.70% (13.8202 => 15.0231, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.66% (0.5577 => 0.6060, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3489 => 0.3791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.65% (0.3293 => 0.3578, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.63% (0.3580 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.59% (1.9828 => 2.1532, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 8.59% (0.2607 => 0.2831, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.59% (0.2655 => 0.2883, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 8.59% (0.2690 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.58% (0.2761 => 0.2998, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.55% (0.3485 => 0.3783, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.55% (0.3756 => 0.4077, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.53% (0.2966 => 0.3219, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.51% (0.2760 => 0.2995, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.48% (0.2914 => 0.3161, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 8.47% (0.2726 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.46% (0.2765 => 0.2999, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.45% (0.2628 => 0.2850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.44% (0.2937 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.41% (7.2180 => 7.8250, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.40% (0.6283 => 0.6811, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.37% (0.4016 => 0.4352, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.35% (0.7506 => 0.8133, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.21% (0.3107 => 0.3362, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2696 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 8.19% (0.3149 => 0.3407, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.14% (0.3453 => 0.3734, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.12% (0.4791 => 0.5180, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 8.11% (0.2243 => 0.2425, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.10% (0.3246 => 0.3509, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.10% (0.1865 => 0.2016, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.07% (0.3868 => 0.4180, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.07% (0.2988 => 0.3229, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.99% (0.3192 => 0.3447, std. dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.94% (1.0313 => 1.1132, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 7.90% (0.2925 => 0.3156, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 7.85% (0.1657 => 0.1787, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.81% (0.2995 => 0.3229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.75% (0.3534 => 0.3808, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.74% (0.4390 => 0.4730, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 7.73% (1.1061 => 1.1916, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.68% (3.6692 => 3.9511, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 7.59% (0.8310 => 0.8941, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.59% (0.5637 => 0.6065, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.58% (0.3220 => 0.3464, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.57% (13.2842 => 14.2902, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 7.56% (3.8646 => 4.1567, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/objinst: 7.37% (0.2945 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.4113 => 0.4413, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.18% (1.9270 => 2.0653, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.12% (3.1889 => 3.4158, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.09% (0.7460 => 0.7989, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.09% (1.3245 => 1.4184, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 7.03% (2.1791 => 2.3322, std. dev.: 0.0139) MultiSource/Applications/minisat/minisat: 6.81% (0.6744 => 0.7203, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.73% (1.2749 => 1.3607, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.71% (16.6129 => 17.7279, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.64% (4.3801 => 4.6709, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.63% (0.6135 => 0.6542, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.61% (0.8698 => 0.9273, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.58% (0.3755 => 0.4002, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.57% (4.4433 => 4.7351, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.56% (1.3819 => 1.4725, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 6.49% (1.0594 => 1.1282, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.47% (14.8535 => 15.8138, std. dev.: 0.0190) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.2140 => 0.2278, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.44% (1.3813 => 1.4702, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 6.44% (0.2859 => 0.3043, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.35% (0.2504 => 0.2663, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.32% (8.4961 => 9.0328, std. dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 6.13% (0.3131 => 0.3323, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.10% (0.3245 => 0.3443, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.04% (14.5298 => 15.4081, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.1333 => 1.2014, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 5.85% (1.2292 => 1.3011, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.82% (0.2321 => 0.2456, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (6.5754 => 6.9512, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.64% (0.6576 => 0.6947, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.61% (0.8818 => 0.9313, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.13% (4.6629 => 4.9021, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.08% (0.4805 => 0.5049, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.97% (3.2742 => 3.4370, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 4.94% (16.2614 => 17.0649, std. dev.: 0.0176) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.73% (4.9865 => 5.2225, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 4.69% (0.6250 => 0.6543, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (1.5188 => 1.5871, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.48% (0.9108 => 0.9516, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.39% (3.7467 => 3.9113, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.39% (2.1007 => 2.1929, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (6.2785 => 6.5441, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 3.65% (33.2944 => 34.5084, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3511 => 0.3615, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2680, std. dev.: 0.0501) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (3.1736 => 3.4119, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5491, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.16% (10.7476 => 11.0876, std. dev.: 0.0539) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (0.5184 => 0.5331, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.5998, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6871, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5713, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5865, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.93% (0.4657 => 0.4055, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.76% (0.2670 => 0.2543, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.29% (22.5627 => 21.8196, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2549, std. dev.: 0.0168) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3031, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.86% (0.4867 => 0.4679, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -3.70% (3.2729 => 3.1518, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9259, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5896, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2501, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.53% (4.5928 => 4.5224, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2377, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.5254 => 2.4965, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4312, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2384, std. dev.: 0.0372) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 14:50:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 16:50:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906215018.E29772A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3498?compare_to=3492&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3498, Order: 163346, Start Time: 2012-09-06 20:40:05, End Time: 2012-09-06 21:51:30 To: 3492, Order: 163331, Start Time: 2012-09-06 17:28:37, End Time: 2012-09-06 18:39:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (53 on baseline) Performance Improvements: 9 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 869 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.52% (0.1849 => 0.1988, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.69% (1.5410 => 1.5671, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.66% (1.8872 => 1.9185, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 50.41% (1.5494 => 2.3305, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 7.89% (3.5947 => 3.8785, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.73% (0.7401 => 0.7899, std. dev.: 0.0179) MultiSource/Applications/siod/siod: 3.88% (3.4690 => 3.6036, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/methcall: 3.83% (8.6731 => 9.0051, std. dev.: 0.0164) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (7.4509 => 7.6744, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash: 2.88% (0.6392 => 0.6576, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.3066 => 2.3728, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 2.23% (1.3430 => 1.3730, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 2.07% (1.4352 => 1.4649, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.41% (21.9604 => 22.2690, std. dev.: 0.0298) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.20% (2.0666 => 2.0417, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.07% (1.4080 => 1.3930, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.02% (1.2902 => 1.2770, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -29.69% (4.3282 => 3.0432, std. dev.: 0.0214) MultiSource/Benchmarks/mafft/pairlocalalign: -11.51% (69.1210 => 61.1675, std. dev.: 0.1566) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -8.19% (3.6643 => 3.3641, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/methcall: -7.57% (9.2163 => 8.5186, std. dev.: 0.0150) MultiSource/Applications/aha/aha: -1.78% (3.3904 => 3.3302, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.3598 => 2.3322, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.42% (0.1414 => 0.1533, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.07% (0.6410 => 0.6735, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.44% (0.3582 => 0.3741, std. dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 4.26% (2.1763 => 2.2690, std. dev.: 0.0280) MultiSource/Applications/SIBsim4/SIBsim4: 4.22% (1.1653 => 1.2145, std. dev.: 0.0172) MultiSource/Applications/minisat/minisat: 3.76% (0.6173 => 0.6405, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.5150 => 1.5671, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (12.6413 => 13.0177, std. dev.: 0.1032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.79% (0.3901 => 0.4010, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.06% (1.8798 => 1.9185, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 1.77% (13.3238 => 13.5590, std. dev.: 0.0770) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.64% (1.2021 => 1.2218, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.7639 => 0.7744, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.30% (4.2616 => 4.3168, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (8.2186 => 8.3141, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 1.16% (1.3268 => 1.3422, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.15% (3.5980 => 3.6392, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (4.0318 => 4.0758, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.92% (1.6538 => 2.3305, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0351) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.89% (0.0766 => 0.0926, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9962, std. dev.: 0.0227) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.46% (4.0101 => 4.5500, std. dev.: 0.0264) MultiSource/Applications/sgefa/sgefa: 13.19% (0.3746 => 0.4240, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8785, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std. dev.: 0.0021) SingleSource/Benchmarks/Stanford/Puzzle: 11.30% (0.1433 => 0.1595, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.13% (0.2694 => 0.2940, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.48% (7.0025 => 7.5965, std. dev.: 0.0794) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.99% (1.0063 => 1.0867, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.00% (0.2857 => 0.3057, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 6.61% (1.0194 => 1.0868, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8104, std. dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (3.4876 => 3.6879, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.61% (40.4792 => 42.7510, std. dev.: 0.4122) SingleSource/Benchmarks/Shootout-C++/hash: 4.25% (0.6308 => 0.6576, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8121, std. dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 3.28% (1.4184 => 1.4649, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 2.58% (8.5113 => 8.7310, std. dev.: 0.0489) MultiSource/Benchmarks/BitBench/five11/five11: 2.49% (5.1938 => 5.3231, std. dev.: 0.0244) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.94% (4.6127 => 4.7022, std. dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.87% (2.4042 => 2.4492, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4455 => 2.4851, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.61% (1.6110 => 1.6370, std. dev.: 0.0083) MultiSource/Applications/siod/siod: 1.45% (3.5520 => 3.6036, std. dev.: 0.0175) MultiSource/Applications/hexxagon/hexxagon: 1.36% (14.4877 => 14.6846, std. dev.: 0.0617) MultiSource/Benchmarks/Olden/bh/bh: 1.30% (2.5166 => 2.5494, std. dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (2.4971 => 2.5266, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.18% (0.3497 => 0.2092, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.33% (5.2665 => 4.0903, std. dev.: 0.0934) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.93% (1.1647 => 0.9908, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1606, std. dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.47% (3.2007 => 2.9297, std. dev.: 0.0512) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3641, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -6.86% (3.4230 => 3.1881, std. dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.37% (0.4564 => 0.4319, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -4.92% (1.4441 => 1.3730, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0593) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.34% (45.4683 => 43.4946, std. dev.: 0.7658) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.57% (0.4140 => 0.3992, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.21% (1.7361 => 1.6803, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.98% (2.4457 => 2.3728, std. dev.: 0.0105) MultiSource/Applications/aha/aha: -2.87% (3.4286 => 3.3302, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2865, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -2.65% (9.2503 => 9.0051, std. dev.: 0.0164) MultiSource/Benchmarks/PAQ8p/paq8p: -2.56% (92.7467 => 90.3733, std. dev.: 0.8060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.46% (1.1683 => 1.1396, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.99% (62.4126 => 61.1675, std. dev.: 0.1566) MultiSource/Benchmarks/Olden/tsp/tsp: -1.78% (1.7330 => 1.7022, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2328, std. dev.: 0.0150) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.42% (3.8907 => 3.8356, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.41% (1.0120 => 0.9977, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3064, std. dev.: 0.0631) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7684, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.05% (2.3569 => 2.3322, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 16:07:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 18:07:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120906230755.E16892A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3499?compare_to=3497&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3499, Order: 163349, Start Time: 2012-09-06 21:54:33, End Time: 2012-09-06 23:09:06 To: 3497, Order: 163342, Start Time: 2012-09-06 20:11:46, End Time: 2012-09-06 21:26:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.89% (0.5388 => 0.5490, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.36% (2.0176 => 2.4284, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.96% (0.1410 => 0.1635, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.10% (0.5818 => 0.6522, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.04% (0.5748 => 0.6440, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 11.88% (0.7061 => 0.7900, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.75% (0.1072 => 0.1198, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.10% (0.3578 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.94% (0.3646 => 0.4045, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 10.94% (0.3601 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3663 => 0.4059, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.81% (0.3914 => 0.4337, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.79% (0.3650 => 0.4044, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.76% (0.3623 => 0.4013, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.74% (0.7710 => 0.8538, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3789 => 0.4194, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.4003 => 0.4429, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.58% (0.3940 => 0.4357, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.43% (3.9660 => 4.3798, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.95% (1.3693 => 1.5056, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.72% (0.5265 => 0.5777, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.50% (0.1327 => 0.1453, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.46% (0.7038 => 0.7704, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.38% (0.6959 => 0.7612, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.33% (1.2193 => 1.3331, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.30% (0.2721 => 0.2974, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.29% (0.9199 => 1.0054, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.10% (0.4328 => 0.4722, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.89% (1.4563 => 1.5857, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.83% (1.1364 => 1.2368, std. dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 8.65% (13.8202 => 15.0159, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.61% (0.5577 => 0.6057, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.59% (0.3130 => 0.3399, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.56% (0.2781 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.50% (0.3022 => 0.3279, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.49% (0.3899 => 0.4230, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2782 => 0.3017, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.39% (0.7506 => 0.8136, std. dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.34% (0.2914 => 0.3157, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.32% (0.6283 => 0.6806, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 8.32% (0.4062 => 0.4400, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.27% (0.4379 => 0.4741, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.24% (0.3485 => 0.3772, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.23% (7.2180 => 7.8124, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.12% (0.4791 => 0.5180, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.03% (0.2628 => 0.2839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.02% (0.3293 => 0.3557, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.02% (0.2607 => 0.2816, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.01% (0.1435 => 0.1550, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3489 => 0.3768, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.99% (1.0313 => 1.1137, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.96% (0.3580 => 0.3865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2690 => 0.2904, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 7.94% (0.2243 => 0.2421, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.93% (0.3756 => 0.4054, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2761 => 0.2980, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2760 => 0.2978, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.89% (1.9828 => 2.1392, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2726 => 0.2941, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.87% (0.2937 => 0.3168, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.86% (0.2966 => 0.3199, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2023 => 0.2181, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 7.79% (0.2925 => 0.3153, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1478 => 0.1593, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.72% (0.4016 => 0.4326, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.66% (1.1061 => 1.1908, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.66% (13.2842 => 14.3014, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.60% (0.2696 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.60% (0.3107 => 0.3343, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.59% (3.6692 => 3.9478, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.57% (0.5637 => 0.6064, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3149 => 0.3387, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.3220 => 0.3462, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 7.48% (3.8646 => 4.1537, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 7.48% (0.2995 => 0.3219, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.44% (0.3534 => 0.3797, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.2988 => 0.3209, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.37% (0.3868 => 0.4153, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.34% (0.8310 => 0.8920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.21% (0.3453 => 0.3702, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4390 => 0.4706, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 7.06% (3.1889 => 3.4140, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 7.01% (2.1791 => 2.3319, std. dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.97% (0.7460 => 0.7980, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.96% (1.9270 => 2.0611, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.95% (0.4113 => 0.4399, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.95% (1.3245 => 1.4165, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 6.89% (0.2945 => 0.3148, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.81% (0.6744 => 0.7203, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.73% (1.2749 => 1.3607, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.69% (0.1569 => 0.1674, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.62% (0.6135 => 0.6541, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.61% (1.0594 => 1.1294, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.58% (16.6129 => 17.7067, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.55% (4.4433 => 4.7345, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.54% (0.2140 => 0.2280, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.54% (1.3813 => 1.4716, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.52% (4.3801 => 4.6655, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.50% (1.3819 => 1.4717, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 6.43% (14.8535 => 15.8087, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.30% (0.8698 => 0.9246, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.18% (0.8818 => 0.9363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.15% (0.3755 => 0.3986, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.13% (8.4961 => 9.0169, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 5.88% (14.5298 => 15.3839, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.86% (1.1333 => 1.1997, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.84% (0.3131 => 0.3314, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (6.5754 => 6.9457, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.61% (0.3245 => 0.3427, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.57% (0.6576 => 0.6942, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.34% (1.2292 => 1.2949, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.18% (4.6629 => 4.9046, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 5.02% (16.2614 => 17.0779, std. dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.02% (0.4805 => 0.5046, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.92% (3.2742 => 3.4352, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.61% (4.9865 => 5.2163, std. dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.45% (0.9108 => 0.9513, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.36% (3.7467 => 3.9100, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6250 => 0.6522, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (1.5188 => 1.5848, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.1007 => 2.1869, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (6.2785 => 6.5275, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 3.82% (33.2944 => 34.5668, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.05% (0.3511 => 0.3618, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.38% (5.7573 => 7.5064, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2603, std. dev.: 0.0437) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5471, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.99% (10.7476 => 11.0685, std. dev.: 0.0215) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (0.5184 => 0.5334, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6067, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2066, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5850, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.95% (0.4657 => 0.4054, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.91% (0.2670 => 0.2539, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.40% (22.5627 => 21.7959, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2660, std. dev.: 0.0349) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3023, std. dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9237, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6151, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2457, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5208, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2406, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2294, std. dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4316, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 16:16:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 18:16:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120906231645.CDBA12A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3500?compare_to=3498&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3500, Order: 163349, Start Time: 2012-09-06 22:07:14, End Time: 2012-09-06 23:17:58 To: 3498, Order: 163346, Start Time: 2012-09-06 20:40:05, End Time: 2012-09-06 21:51:30 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (53 on baseline) Performance Improvements: 0 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.7622 => 0.7999, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2913 => 0.3048, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.44% (0.3231 => 0.3342, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.74% (0.7584 => 0.7792, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 2.52% (0.7526 => 0.7716, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4188 => 0.4290, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.35% (1.3942 => 1.4270, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.2564 => 8.3738, std. dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (1.3930 => 1.4096, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (2.5630 => 2.6141, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.37% (1.2746 => 1.2921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 1.30% (8.7310 => 8.8446, std. dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.63% (0.6410 => 0.6771, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 4.32% (1.1653 => 1.2156, std. dev.: 0.0157) MultiSource/Applications/minisat/minisat: 4.02% (0.6173 => 0.6421, std. dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 3.96% (2.1763 => 2.2624, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 3.89% (0.3217 => 0.3342, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.7722 => 0.7999, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3582 => 0.3709, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.5150 => 1.5609, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1672 => 1.1953, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.1827 => 1.2060, std. dev.: 0.0055) MultiSource/Applications/Burg/burg: 1.70% (1.1440 => 1.1634, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 1.61% (1.8798 => 1.9101, std. dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.54% (6.2546 => 6.3508, std. dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.2559 => 8.3738, std. dev.: 0.0243) MultiSource/Benchmarks/Bullet/bullet: 1.42% (29.3170 => 29.7323, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (4.0318 => 4.0868, std. dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.16% (1.3935 => 1.4096, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.25% (15.8312 => 18.4040, std. dev.: 0.8527) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std. dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5443, std. dev.: 0.0162) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: 12.10% (0.4296 => 0.4816, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.23% (0.0917 => 0.1020, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 9.89% (3.4406 => 3.7810, std. dev.: 0.0410) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.02% (0.2694 => 0.2937, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.40% (7.0025 => 7.5905, std. dev.: 0.0538) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.85% (1.0063 => 1.0853, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.00% (0.2857 => 0.3057, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 6.86% (1.0194 => 1.0893, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7995, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (3.4876 => 3.6937, std. dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.53% (0.7609 => 0.8030, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.58% (40.4792 => 42.3338, std. dev.: 0.1663) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8334, std. dev.: 0.0459) SingleSource/Benchmarks/Misc/dt: 3.93% (0.9851 => 1.0238, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 3.92% (8.5113 => 8.8446, std. dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (2.5687 => 2.6141, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: 1.66% (2.3453 => 2.3843, std. dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.62% (4.6127 => 4.6874, std. dev.: 0.0210) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4455 => 2.4851, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.53% (1.2726 => 1.2921, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.39% (3.5520 => 3.6013, std. dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5313, std. dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6671, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.75% (0.3497 => 0.2072, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.62% (5.2665 => 4.0750, std. dev.: 0.0651) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.81% (1.1647 => 0.9922, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.74% (3.6023 => 3.2873, std. dev.: 0.0862) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9443, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.20% (3.6254 => 3.3644, std. dev.: 0.0208) MultiSource/Applications/SIBsim4/SIBsim4: -6.84% (3.4230 => 3.1889, std. dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: -5.88% (1.4441 => 1.3592, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.19% (0.4140 => 0.3925, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4077, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0597) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: -4.20% (0.2664 => 0.2552, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6728, std. dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2308, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: -3.04% (9.2503 => 8.9695, std. dev.: 0.0316) MultiSource/Applications/aha/aha: -2.90% (3.4286 => 3.3293, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.80% (1.1683 => 1.1356, std. dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -2.77% (92.7467 => 90.1789, std. dev.: 0.3716) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2855, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.68% (3.7496 => 3.6492, std. dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -2.05% (62.4126 => 61.1351, std. dev.: 0.1976) MultiSource/Benchmarks/Olden/tsp/tsp: -1.99% (1.7330 => 1.6985, std. dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.77% (2.3569 => 2.3153, std. dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2233, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std. dev.: 0.0610) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7696, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/lists: -1.30% (16.5617 => 16.3461, std. dev.: 0.0718) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 19:33:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 21:33:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907023327.401172A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3501?compare_to=3495&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3501, Order: 163363, Start Time: 2012-09-07 01:14:58, End Time: 2012-09-07 02:34:36 To: 3495, Order: 163339, Start Time: 2012-09-06 19:44:16, End Time: 2012-09-06 21:04:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 8 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 941 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.63% (54.3322 => 55.7630, std. dev.: 0.3533) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.97% (0.7963 => 0.7806, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.87% (2.1816 => 2.1409, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -1.60% (0.6487 => 0.6383, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.37% (14.4686 => 14.2701, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: -1.35% (1.3327 => 1.3147, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: -1.29% (1.6631 => 1.6417, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.26% (1.9773 => 1.9524, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.07% (2.5177 => 2.4908, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.65% (10.3673 => 14.2701, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: 26.08% (0.1622 => 0.2045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.17% (0.3473 => 0.3965, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 13.81% (0.3497 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.80% (0.3543 => 0.4032, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.80% (0.3543 => 0.4032, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.68% (0.3516 => 0.3997, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 13.65% (0.3561 => 0.4047, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.44% (7.0540 => 8.0018, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: 13.29% (0.3694 => 0.4185, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.11% (2.2022 => 2.4908, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.99% (0.3927 => 0.4437, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3828 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.74% (0.3886 => 0.4381, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.87% (1.1194 => 1.2523, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.88% (1.7609 => 1.9524, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 8.19% (0.1440 => 0.1558, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.18% (0.8172 => 0.8759, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 7.01% (10.4361 => 11.1676, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 6.99% (9.4845 => 10.1471, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 6.97% (0.2554 => 0.2732, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7433 => 0.7930, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 6.55% (0.7326 => 0.7806, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.53% (8.1363 => 8.6674, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3423 => 0.3642, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 6.27% (0.7835 => 0.8326, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 6.25% (0.7115 => 0.7560, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (4.2646 => 4.5283, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.16% (0.5860 => 0.6221, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.16% (1.5415 => 1.6364, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.5569 => 0.5911, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.11% (1.3050 => 1.3848, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.07% (0.5105 => 0.5415, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.02% (5.0018 => 5.3031, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.01% (0.6675 => 0.7076, std. dev.: 0.0087) MultiSource/Applications/d/make_dparser: 6.00% (3.3354 => 3.5354, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.9449 => 5.2403, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.87% (0.3817 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.66% (0.3180 => 0.3360, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.55% (0.9765 => 1.0307, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.48% (0.8067 => 0.8509, std. dev.: 0.0086) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.41% (5.7591 => 6.0704, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (14.3668 => 15.1177, std. dev.: 0.0082) MultiSource/Applications/hbd/hbd: 5.22% (1.5603 => 1.6417, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 5.20% (1.1642 => 1.2247, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.13% (1.1861 => 1.2470, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.88% (3.8723 => 4.0612, std. dev.: 0.0124) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.78% (7.9617 => 8.3422, std. dev.: 0.0073) MultiSource/Applications/lemon/lemon: 4.73% (1.0722 => 1.1229, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.5020 => 0.5256, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.66% (0.4103 => 0.4294, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.53% (2.0273 => 2.1192, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.53% (0.6450 => 0.6742, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4636 => 0.4844, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9371 => 22.9136, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.4064 => 0.4240, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.6456 => 0.6728, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3921, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8921 => 0.9290, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3865 => 0.4019, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.97% (0.4203 => 0.4370, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3826 => 0.3978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.3650 => 0.3793, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.90% (1.4186 => 1.4739, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.4289 => 0.4455, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3684 => 0.3824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.3098 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.70% (0.3136 => 0.3252, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 3.69% (0.3603 => 0.3736, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.66% (0.2756 => 0.2857, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.65% (17.1811 => 17.8078, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/strcat: 3.64% (0.2831 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0665 => 2.1409, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.55% (1.5859 => 1.6422, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.3052 => 0.3158, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.41% (0.3283 => 0.3395, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.2024 => 2.2760, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.28% (0.3379 => 0.3490, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.1840 => 1.2169, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2842 => 1.3147, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3811, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7587, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (4.2280 => 4.3601, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2419, std. dev.: 0.0200) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5818, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.97% (5.2763 => 3.2201, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.25% (5.3855 => 3.8641, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.89% (5.3526 => 3.8595, std. dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0829, std. dev.: 0.0404) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.94% (2.9384 => 2.5876, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -8.12% (22.1758 => 20.3757, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2509, std. dev.: 0.1027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (1.8329 => 1.7167, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.14% (1.6805 => 1.5773, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5115, std. dev.: 0.0023) MultiSource/Applications/siod/siod: -4.04% (3.2827 => 3.1501, std. dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5061, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4227, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9881, std. dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5530, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0159, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2299, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std. dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 19:34:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 21:34:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907023421.3A1C02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3502?compare_to=3499&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3502, Order: 163363, Start Time: 2012-09-07 01:21:08, End Time: 2012-09-07 02:35:31 To: 3499, Order: 163349, Start Time: 2012-09-06 21:54:33, End Time: 2012-09-06 23:09:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (172 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.60% (1.3023 => 1.3231, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 1.11% (1.2203 => 1.2338, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.28% (34.5668 => 34.1234, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.68% (2.0176 => 2.4146, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.61% (0.5818 => 0.6435, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7061 => 0.7809, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.57% (1.3693 => 1.5140, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.49% (0.5748 => 0.6351, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.23% (0.7710 => 0.8499, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.81% (3.9660 => 4.3551, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.26% (0.7038 => 0.7690, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5265 => 0.5746, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.06% (1.2193 => 1.3298, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.06% (0.4328 => 0.4720, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.06% (0.9199 => 1.0032, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2781 => 0.3026, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.65% (0.6959 => 0.7561, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.4563 => 1.5800, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.39% (1.1364 => 1.2318, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.3899 => 0.4224, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.27% (0.4062 => 0.4398, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (0.3485 => 0.3769, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.06% (0.2655 => 0.2869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.06% (0.2607 => 0.2817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.04% (0.2761 => 0.2983, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.02% (13.8202 => 14.9286, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5577 => 0.6024, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.01% (0.3756 => 0.4057, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.01% (0.3022 => 0.3264, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.99% (1.9828 => 2.1413, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.99% (0.3580 => 0.3866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.99% (0.3293 => 0.3556, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 7.95% (0.2628 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.94% (0.3489 => 0.3766, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.92% (0.2966 => 0.3201, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.90% (0.2127 => 0.2295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.6283 => 0.6779, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.88% (0.4390 => 0.4736, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 7.88% (0.2690 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2760 => 0.2977, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 7.85% (0.2726 => 0.2940, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.2937 => 0.3166, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (7.2180 => 7.7802, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.76% (0.4379 => 0.4719, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.3246 => 0.3498, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.72% (0.3107 => 0.3347, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.4791 => 0.5161, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.64% (0.2696 => 0.2902, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.63% (0.7506 => 0.8079, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.61% (1.0313 => 1.1098, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3149 => 0.3388, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.52% (0.2914 => 0.3133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3192 => 0.3431, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.47% (0.3868 => 0.4157, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.43% (0.2988 => 0.3210, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4016 => 0.4314, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.21% (0.8310 => 0.8909, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 7.13% (0.3534 => 0.3786, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1848, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.11% (13.2842 => 14.2293, std. dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.10% (3.6692 => 3.9296, std. dev.: 0.0164) MultiSource/Benchmarks/MallocBench/gs/gs: 7.06% (3.8646 => 4.1373, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 7.04% (0.2243 => 0.2401, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.99% (0.3220 => 0.3445, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.86% (0.2945 => 0.3147, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.66% (3.1889 => 3.4012, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.55% (0.7460 => 0.7949, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 6.53% (2.1791 => 2.3213, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 6.49% (1.9270 => 2.0520, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (1.3245 => 1.4100, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 6.45% (1.2749 => 1.3571, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 6.37% (0.4113 => 0.4375, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 6.35% (0.6744 => 0.7172, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.18% (1.0594 => 1.1249, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.11% (0.6135 => 0.6510, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 6.05% (14.8535 => 15.7515, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.01% (1.3813 => 1.4643, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.99% (4.3801 => 4.6426, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.98% (1.3819 => 1.4646, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.96% (0.8698 => 0.9216, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.95% (4.4433 => 4.7078, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 5.88% (0.3131 => 0.3315, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.2859 => 0.3027, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.86% (0.3755 => 0.3975, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (8.4961 => 8.9935, std. dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 5.83% (16.6129 => 17.5818, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.76% (0.8818 => 0.9326, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.67% (1.1333 => 1.1976, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 5.65% (14.5298 => 15.3511, std. dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 5.37% (1.2292 => 1.2952, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (6.5754 => 6.9202, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.03% (0.6576 => 0.6907, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.86% (16.2614 => 17.0520, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 4.85% (4.6629 => 4.8890, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.83% (3.2742 => 3.4322, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.56% (0.4805 => 0.5024, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.30% (0.9108 => 0.9500, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.98% (1.5188 => 1.5793, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (2.1007 => 2.1823, std. dev.: 0.0201) MultiSource/Applications/lua/lua: 3.86% (3.7467 => 3.8914, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1750, std. dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (6.2785 => 6.4943, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.08% (0.3511 => 0.3619, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.49% (33.2944 => 34.1234, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0489) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7330, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5469, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9833, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0785, std. dev.: 0.0504) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.5184 => 0.5332, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6052, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0063) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5155, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (1.9433 => 1.9708, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5956, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.12% (1.4298 => 1.4458, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5746, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.52% (0.4657 => 0.3981, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.7017, std. dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2575, std. dev.: 0.0399) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.98% (1.3780 => 1.3231, std. dev.: 0.0028) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1510, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std. dev.: 0.0178) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9244, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5735, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2362, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.60% (4.5928 => 4.5193, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2246, std. dev.: 0.0347) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8733, std. dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4342, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2613, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2549, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 20:26:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 22:26:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907032657.73E002A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3503?compare_to=3500&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3503, Order: 163363, Start Time: 2012-09-07 02:17:07, End Time: 2012-09-07 03:28:10 To: 3500, Order: 163349, Start Time: 2012-09-06 22:07:14, End Time: 2012-09-06 23:17:58 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (57 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 889 (796 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.96% (2.4260 => 2.5706, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/sieve: 2.61% (3.7810 => 3.8798, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.88% (18.4040 => 16.9533, std. dev.: 0.4959) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.07% (0.1414 => 0.1514, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.01% (0.6410 => 0.6731, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 4.13% (1.1653 => 1.2134, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.91% (0.3582 => 0.3722, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (2.1763 => 2.2573, std. dev.: 0.0281) MultiSource/Applications/lemon/lemon: 3.60% (1.0046 => 1.0408, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5150 => 1.5562, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 2.57% (1.1440 => 1.1734, std. dev.: 0.0078) MultiSource/Applications/d/make_dparser: 2.50% (3.0225 => 3.0980, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (12.6413 => 12.9427, std. dev.: 0.0194) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.1672 => 1.1894, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.83% (1.1827 => 1.2044, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.79% (0.5937 => 0.6043, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.79% (0.7226 => 0.7355, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (0.7639 => 0.7758, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.43% (2.0972 => 2.1271, std. dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2546 => 6.3384, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (8.2559 => 8.3607, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 1.26% (14.6079 => 14.7918, std. dev.: 0.0508) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (1.2021 => 1.2172, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (4.0318 => 4.0766, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (1.4189 => 1.4340, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.01% (1.6538 => 2.3321, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.75% (0.0766 => 0.0902, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.94% (0.0917 => 0.1054, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0262) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.33% (4.0101 => 4.5445, std. dev.: 0.0305) SingleSource/Benchmarks/Stanford/Puzzle: 13.05% (0.1433 => 0.1620, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (3.4406 => 3.8798, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 8.78% (7.0025 => 7.6170, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.91% (1.0063 => 1.0859, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (3.4876 => 3.6998, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7955, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 4.20% (15.2242 => 15.8643, std. dev.: 0.0362) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.01% (0.8498 => 0.8839, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5420, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (4.2129 => 4.3537, std. dev.: 0.0380) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3508 => 0.3612, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5113 => 8.7617, std. dev.: 0.0377) MultiSource/Benchmarks/BitBench/five11/five11: 2.75% (5.1938 => 5.3365, std. dev.: 0.0249) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.84% (4.6127 => 4.6976, std. dev.: 0.0100) MultiSource/Applications/siod/siod: 1.34% (3.5520 => 3.5997, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.34% (1.2726 => 1.2896, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6698, std. dev.: 0.0246) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4455 => 2.4753, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 1.16% (2.5166 => 2.5459, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.09% (0.3497 => 0.2060, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.42% (5.2665 => 4.0858, std. dev.: 0.0492) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.09% (1.1647 => 0.9890, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.34% (8.1594 => 7.1528, std. dev.: 0.0308) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.51% (3.2007 => 2.9604, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3639, std. dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: -6.73% (3.4230 => 3.1925, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3503, std. dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7962, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4093, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0200) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.04% (1.2959 => 1.2435, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.02% (2.4457 => 2.3474, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.01% (1.7361 => 1.6664, std. dev.: 0.0094) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2303, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.18% (3.7496 => 3.6302, std. dev.: 0.0125) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.04% (0.4140 => 0.4014, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9788, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.83% (1.1683 => 1.1352, std. dev.: 0.0012) MultiSource/Applications/aha/aha: -2.78% (3.4286 => 3.3332, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (92.7467 => 90.3252, std. dev.: 0.5112) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.24% (2.8964 => 2.8314, std. dev.: 0.0216) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.24% (1.8739 => 1.8320, std. dev.: 0.0142) MultiSource/Benchmarks/mafft/pairlocalalign: -2.23% (62.4126 => 61.0234, std. dev.: 0.1502) MultiSource/Benchmarks/FreeBench/neural/neural: -2.13% (1.0926 => 1.0693, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -1.89% (1.7330 => 1.7002, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2278, std. dev.: 0.0500) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.57% (3.8907 => 3.8297, std. dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: -1.44% (6.7458 => 6.6488, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std. dev.: 0.0172) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3569 => 2.3250, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7687, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.09% (1.1116 => 1.0995, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.07% (16.5617 => 16.3840, std. dev.: 0.0684) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 20:41:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 22:41:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907034132.9CAB02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3504?compare_to=3496&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3504, Order: 163363, Start Time: 2012-09-07 00:59:08, End Time: 2012-09-07 03:42:43 To: 3496, Order: 163333, Start Time: 2012-09-06 18:32:41, End Time: 2012-09-06 21:16:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (119 on baseline) Performance Improvements: 24 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 944 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.22% (127.6747 => 130.5126, std. dev.: 0.6523) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.89% (2.0654 => 2.1045, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: -3.53% (0.4056 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.52% (0.4088 => 0.3944, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.51% (0.4071 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.50% (0.4056 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.50% (0.4029 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.4046 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.45% (0.4034 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.44% (0.4244 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.4236 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.41% (0.4078 => 0.3939, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: -3.40% (0.4318 => 0.4171, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.87% (0.7750 => 0.7605, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.85% (0.6395 => 0.6277, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.84% (0.6454 => 0.6335, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (2.9047 => 2.8578, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -1.51% (5.8742 => 5.7853, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.31% (2.0830 => 2.0557, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.26% (1.7491 => 1.7270, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.22% (24.6277 => 24.3262, std. dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: -1.14% (4.8477 => 4.7924, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.10% (3.8401 => 3.7977, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.10% (2.1056 => 2.0825, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -1.06% (1.9748 => 1.9538, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -1.03% (4.4872 => 4.4410, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3488 => 0.3939, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3465 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.81% (0.3496 => 0.3944, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.27% (0.3650 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.00% (0.3724 => 0.4171, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.38% (0.1620 => 0.1772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.74% (0.5826 => 0.6277, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.57% (0.5889 => 0.6335, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 6.63% (1.5932 => 1.6989, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.60% (3.5627 => 3.7977, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.55% (1.3152 => 1.4013, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.53% (1.6211 => 1.7270, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (0.2014 => 0.2136, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7171 => 0.7605, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2875 => 0.3046, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.94% (0.4361 => 0.4620, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2813 => 0.2979, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2823 => 0.2986, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (0.4994 => 0.5282, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.76% (0.5900 => 0.6240, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.71% (0.2750 => 0.2907, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2738 => 0.2894, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.67% (0.3195 => 0.3376, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.3267 => 0.3452, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2729 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.60% (0.2803 => 0.2960, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2911 => 0.3074, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.59% (0.2792 => 0.2948, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.58% (0.9909 => 1.0462, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (0.3930 => 0.4149, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.54% (0.5000 => 0.5277, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.54% (0.2780 => 0.2934, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (2.0673 => 2.1804, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.46% (4.2109 => 4.4410, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 5.46% (0.3096 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.40% (0.3317 => 0.3496, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 5.38% (1.0781 => 1.1361, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.38% (0.3124 => 0.3292, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 5.37% (0.2811 => 0.2962, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3258 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3060 => 0.3222, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.26% (0.4029 => 0.4241, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (0.5026 => 0.5289, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.15% (0.3282 => 0.3451, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3477 => 0.3654, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3362 => 0.3530, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 4.98% (0.9697 => 1.0180, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.97% (0.2736 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3726 => 0.3910, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.2866 => 0.3007, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 4.87% (0.3348 => 0.3511, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.87% (0.3678 => 0.3857, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.3625 => 0.3799, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (2.7292 => 2.8578, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3690 => 0.3863, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 4.54% (0.4251 => 0.4444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4146 => 0.4334, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.46% (0.3271 => 0.3417, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 4.40% (5.5417 => 5.7853, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.38% (1.9694 => 2.0557, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.32% (0.3981 => 0.4153, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.32% (0.3890 => 0.4058, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.30% (1.9966 => 2.0825, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.29% (0.4658 => 0.4858, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.3845 => 0.4009, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (2.1013 => 2.1868, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (4.4195 => 4.5987, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (1.8794 => 1.9538, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.5012 => 0.5203, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.78% (4.6177 => 4.7924, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 3.77% (2.1653 => 2.2470, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.70% (0.4139 => 0.4292, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 3.66% (1.4269 => 1.4791, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3792 => 0.3928, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.6435 => 0.6665, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.52% (0.7875 => 0.8152, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 3.51% (0.3336 => 0.3453, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.3084 => 0.3191, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.43% (23.5202 => 24.3262, std. dev.: 0.0180) MultiSource/Applications/siod/siod: 3.27% (0.6634 => 0.6851, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.17% (0.5546 => 0.5722, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.02% (2.0346 => 2.0757, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (0.7426 => 0.7532, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.27% (0.2122 => 0.2255, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8909, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std. dev.: 0.0427) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6440, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1921, std. dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5057, std. dev.: 0.0238) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4431, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2819, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (2.0820 => 2.1045, std. dev.: 0.0068) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5912, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.05% (105.3826 => 106.4870, std. dev.: 0.0244) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5319, std. dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/ary2: -9.53% (0.2402 => 0.2173, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7861, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8016, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.14% (17.2379 => 16.8688, std. dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9736, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 21:16:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 23:16:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907041652.EC09C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3505?compare_to=3502&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3505, Order: 163369, Start Time: 2012-09-07 03:03:36, End Time: 2012-09-07 04:18:02 To: 3502, Order: 163363, Start Time: 2012-09-07 01:21:08, End Time: 2012-09-07 02:35:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (172 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.03% (34.1234 => 34.4750, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.07% (55.8541 => 56.4531, std. dev.: 0.0451) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.63% (1.3231 => 1.2883, std. dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.76% (2.0176 => 2.4163, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1410 => 0.1636, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.69% (0.7061 => 0.7816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.64% (0.5818 => 0.6437, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.58% (1.3693 => 1.5142, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.46% (0.5748 => 0.6349, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.23% (3.9660 => 4.3718, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.18% (0.7710 => 0.8495, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.71% (0.2596 => 0.2848, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 9.62% (0.7038 => 0.7715, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.38% (0.9199 => 1.0062, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.33% (1.2193 => 1.3331, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.19% (0.2721 => 0.2971, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.11% (0.6959 => 0.7593, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 9.08% (0.4328 => 0.4721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.86% (1.1364 => 1.2371, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.78% (1.4563 => 1.5841, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3601 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.66% (0.3789 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.64% (0.3623 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.36% (13.8202 => 14.9755, std. dev.: 0.0153) SingleSource/Regression/C++/ofstream_ctor: 8.34% (0.2781 => 0.3013, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.34% (0.6283 => 0.6807, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.33% (1.0313 => 1.1172, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.28% (0.3899 => 0.4222, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 8.27% (0.7506 => 0.8127, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.25% (0.5577 => 0.6037, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4062 => 0.4395, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2782 => 0.3010, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.11% (0.3022 => 0.3267, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.07% (0.3580 => 0.3869, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.02% (0.4791 => 0.5175, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.96% (0.2966 => 0.3202, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.90% (0.3293 => 0.3553, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.88% (0.2995 => 0.3231, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.82% (0.3489 => 0.3762, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (7.2180 => 7.7827, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.80% (1.9828 => 2.1375, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 7.79% (0.2607 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.76% (0.2937 => 0.3165, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.75% (0.3756 => 0.4047, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2726 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.73% (0.2690 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.72% (0.2655 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2761 => 0.2974, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4390 => 0.4728, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 7.65% (0.8310 => 0.8946, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 7.65% (0.2628 => 0.2829, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.61% (1.1061 => 1.1903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2765 => 0.2975, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.54% (3.6692 => 3.9458, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 7.53% (0.2243 => 0.2412, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.53% (0.3149 => 0.3386, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.45% (13.2842 => 14.2742, std. dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 7.40% (3.8646 => 4.1506, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4016 => 0.4313, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3192 => 0.3427, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.36% (0.3220 => 0.3457, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.31% (0.5637 => 0.6049, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.3868 => 0.4148, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3534 => 0.3788, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.12% (0.3453 => 0.3699, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.04% (1.9270 => 2.0626, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 7.00% (1.2749 => 1.3642, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.97% (1.3245 => 1.4168, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 6.96% (3.1889 => 3.4109, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: 6.94% (0.6744 => 0.7212, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.93% (2.1791 => 2.3301, std. dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.82% (0.7460 => 0.7969, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 6.69% (0.2945 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.68% (1.3819 => 1.4742, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.57% (0.6135 => 0.6538, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 6.56% (1.0594 => 1.1289, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.53% (0.8818 => 0.9394, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.49% (14.8535 => 15.8170, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.49% (1.3813 => 1.4709, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.36% (4.4433 => 4.7259, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.3801 => 4.6556, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.25% (0.8698 => 0.9242, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.21% (16.6129 => 17.6443, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (8.4961 => 9.0182, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.12% (0.2859 => 0.3034, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.04% (0.3131 => 0.3320, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.00% (1.1333 => 1.2013, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.95% (14.5298 => 15.3948, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.91% (0.3755 => 0.3977, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 5.60% (6.5754 => 6.9436, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.38% (4.6629 => 4.9138, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 5.34% (16.2614 => 17.1293, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.32% (3.2742 => 3.4485, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 5.23% (1.2292 => 1.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.03% (0.6576 => 0.6907, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.87% (0.4805 => 0.5039, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.75% (0.9108 => 0.9541, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.56% (1.5188 => 1.5881, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.42% (4.9865 => 5.2071, std. dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6250 => 0.6522, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.28% (2.1007 => 2.1906, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 4.28% (3.7467 => 3.9069, std. dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (6.2785 => 6.5019, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 3.55% (33.2944 => 34.4750, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.30% (0.3511 => 0.3627, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5490, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1001, std. dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5984, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9705, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6020, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.69% (0.4657 => 0.3973, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.37% (22.5627 => 21.8014, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2714, std. dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.51% (1.3780 => 1.2883, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -5.26% (2.6470 => 2.5078, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9238, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6028, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2443, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5216, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2399, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2329, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2628, std. dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4358, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 21:21:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 23:21:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907042107.C07512A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3506?compare_to=3501&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3506, Order: 163369, Start Time: 2012-09-07 03:02:45, End Time: 2012-09-07 04:22:18 To: 3501, Order: 163363, Start Time: 2012-09-07 01:14:58, End Time: 2012-09-07 02:34:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (139 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.51% (10.3673 => 14.2557, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 27.00% (0.1622 => 0.2060, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.08% (2.2022 => 2.4903, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.07% (7.0540 => 7.9759, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.46% (0.3561 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.08% (1.7609 => 1.9560, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.53% (0.1584 => 0.1735, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 8.26% (0.3282 => 0.3553, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.40% (0.3177 => 0.3412, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.08% (0.7433 => 0.7959, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.8172 => 0.8748, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.05% (9.4845 => 10.1528, std. dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.95% (10.4361 => 11.1617, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.70% (0.5925 => 0.6322, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.63% (0.6030 => 0.6430, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (0.4615 => 0.4921, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.58% (0.7115 => 0.7583, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2271 => 0.2416, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.31% (0.3423 => 0.3639, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (8.1363 => 8.6479, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.26% (0.6675 => 0.7093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.5860 => 0.6220, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 6.10% (0.7835 => 0.8313, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5388, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.09% (0.5105 => 0.5416, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.09% (1.3050 => 1.3845, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (1.5415 => 1.6354, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (4.2646 => 4.5240, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (5.0018 => 5.3043, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5569 => 0.5903, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.90% (0.3121 => 0.3305, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.9449 => 5.2356, std. dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 5.83% (5.7591 => 6.0946, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.2758 => 0.2915, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.64% (1.5603 => 1.6483, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.64% (0.7326 => 0.7739, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.8067 => 0.8520, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.61% (0.2603 => 0.2749, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9765 => 1.0304, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (14.3668 => 15.1224, std. dev.: 0.0120) MultiSource/Benchmarks/McCat/05-eks/eks: 5.26% (0.4299 => 0.4525, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.23% (0.3441 => 0.3621, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.19% (1.1642 => 1.2246, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (1.1861 => 1.2467, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 5.08% (3.8723 => 4.0692, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.08% (1.0722 => 1.1267, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 5.01% (21.9371 => 23.0359, std. dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.90% (0.5020 => 0.5266, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.75% (0.4103 => 0.4298, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.72% (2.0273 => 2.1230, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.60% (0.6450 => 0.6747, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (7.9617 => 8.3210, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.47% (0.4636 => 0.4843, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.4064 => 0.4245, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.45% (0.8921 => 0.9318, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.45% (0.6456 => 0.6743, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 4.44% (2.2969 => 2.3988, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.34% (0.4289 => 0.4475, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.30% (0.3136 => 0.3271, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3826 => 0.3988, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.3650 => 0.3803, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.15% (0.5981 => 0.6229, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.5859 => 1.6494, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3865 => 0.4019, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.4186 => 1.4738, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.2905 => 0.3018, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.85% (17.1811 => 17.8426, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (2.0665 => 2.1445, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4203 => 0.4361, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.3098 => 0.3214, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.73% (0.4048 => 0.4199, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.2024 => 2.2840, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.70% (0.4620 => 0.4791, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.62% (0.2871 => 0.2975, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3283 => 0.3401, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.37% (0.3052 => 0.3155, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1840 => 1.2198, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.33% (1.2842 => 1.3141, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.30% (0.8101 => 0.8287, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3861, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7595, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.18% (4.2280 => 4.3626, std. dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 1.48% (3.7781 => 3.8339, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2133, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/fbench: 1.04% (2.2771 => 2.3007, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7606, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2297, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.43% (5.3855 => 3.8543, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.04% (5.3526 => 3.8517, std. dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1783, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.97% (2.9384 => 2.5867, std. dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: -8.02% (22.1758 => 20.3971, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2611, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.48% (1.8329 => 1.7142, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0023) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -3.10% (1.2373 => 1.1990, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5113, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4245, std. dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3295, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9956, std. dev.: 0.0165) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5547, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2302, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 21:53:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Sep 2012 23:53:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907045314.BDE512A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3507?compare_to=3503&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3507, Order: 163369, Start Time: 2012-09-07 03:43:44, End Time: 2012-09-07 04:54:26 To: 3503, Order: 163363, Start Time: 2012-09-07 02:17:07, End Time: 2012-09-07 03:28:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (61 on baseline) Performance Improvements: 2 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 876 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.7563 => 0.7757, std. dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.72% (4.7668 => 4.8489, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (6.5434 => 6.6310, std. dev.: 0.0320) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 26.60% (0.0470 => 0.0595, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.10% (3.0516 => 3.3902, std. dev.: 0.0391) SingleSource/Benchmarks/Shootout/heapsort: 9.32% (3.0157 => 3.2967, std. dev.: 0.0676) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.32% (0.5912 => 0.6108, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 2.61% (1.3771 => 1.4131, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.40% (43.2151 => 44.2521, std. dev.: 0.3500) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.16% (1.6107 => 1.6294, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.16% (1.8320 => 1.8532, std. dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 1.06% (1.9953 => 2.0165, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.04% (5.8785 => 5.9396, std. dev.: 0.0091) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.02% (4.0712 => 4.1129, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.40% (1.4340 => 1.4139, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -3.73% (22.9691 => 22.1116, std. dev.: 0.2102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.57% (0.6410 => 0.6767, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.94% (0.3582 => 0.3759, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 4.64% (1.1653 => 1.2194, std. dev.: 0.0067) MultiSource/Applications/lemon/lemon: 4.09% (1.0046 => 1.0457, std. dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: 3.88% (2.1763 => 2.2608, std. dev.: 0.0166) MultiSource/Applications/minisat/minisat: 3.58% (0.6173 => 0.6394, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (12.6413 => 13.0255, std. dev.: 0.0438) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5150 => 1.5539, std. dev.: 0.0116) MultiSource/Applications/d/make_dparser: 2.38% (3.0225 => 3.0944, std. dev.: 0.0274) MultiSource/Applications/oggenc/oggenc: 2.18% (4.7455 => 4.8489, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.4908 => 6.6310, std. dev.: 0.0320) MultiSource/Benchmarks/Bullet/bullet: 1.97% (29.3170 => 29.8957, std. dev.: 0.0523) MultiSource/Applications/JM/lencod/lencod: 1.72% (14.7256 => 14.9783, std. dev.: 0.0777) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (1.3935 => 1.4172, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.65% (0.7639 => 0.7765, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 1.50% (14.6079 => 14.8264, std. dev.: 0.0749) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.38% (1.1672 => 1.1833, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (8.2186 => 8.3313, std. dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 1.32% (15.3105 => 15.5123, std. dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (8.2559 => 8.3583, std. dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (4.0318 => 4.0798, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.11% (0.0263 => 0.0379, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 22.17% (3.4629 => 4.2307, std. dev.: 0.0288) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.47% (0.0917 => 0.1068, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 15.84% (1.7426 => 2.0187, std. dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.00% (4.0101 => 4.5717, std. dev.: 0.0230) SingleSource/Benchmarks/McGill/misr: 13.55% (0.4296 => 0.4878, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 12.82% (3.4406 => 3.8817, std. dev.: 0.0181) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.05% (3.0256 => 3.3902, std. dev.: 0.0391) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std. dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 10.12% (0.1433 => 0.1578, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 9.46% (7.0025 => 7.6652, std. dev.: 0.0275) SingleSource/Benchmarks/McGill/chomp: 7.51% (1.0194 => 1.0960, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.49% (0.2857 => 0.3071, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.42% (40.4792 => 43.0762, std. dev.: 0.3380) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8168, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (3.4876 => 3.6935, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/dt: 4.66% (0.9851 => 1.0310, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.44% (21.1721 => 22.1116, std. dev.: 0.2102) SingleSource/Benchmarks/Misc/fp-convert: 4.17% (15.2242 => 15.8585, std. dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.95% (0.5876 => 0.6108, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.56% (0.5587 => 0.5786, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 3.06% (5.1938 => 5.3529, std. dev.: 0.0465) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.47% (2.6656 => 2.7315, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash: 1.79% (0.6308 => 0.6421, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.79% (4.6127 => 4.6951, std. dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4835, std. dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (2.4971 => 2.5358, std. dev.: 0.0116) MultiSource/Applications/siod/siod: 1.50% (3.5520 => 3.6052, std. dev.: 0.0084) MultiSource/Applications/lua/lua: 1.41% (29.5232 => 29.9382, std. dev.: 0.1585) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.5166 => 2.5505, std. dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 1.31% (14.4877 => 14.6768, std. dev.: 0.0340) MultiSource/Benchmarks/Bullet/bullet: 1.28% (6.9722 => 7.0612, std. dev.: 0.0333) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.20% (38.9255 => 39.3907, std. dev.: 0.0811) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.16% (4.0659 => 4.1129, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.14% (1.6110 => 1.6294, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.65% (5.2665 => 4.1263, std. dev.: 0.0670) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.77% (1.1647 => 0.9927, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1650, std. dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2878, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.08% (3.2007 => 2.9420, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3655, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -6.48% (3.4230 => 3.2011, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -6.00% (1.4441 => 1.3575, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4103, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.53% (1.7361 => 1.6749, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -3.43% (9.2503 => 8.9332, std. dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.77% (1.1683 => 1.1359, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2917, std. dev.: 0.0027) MultiSource/Applications/aha/aha: -2.68% (3.4286 => 3.3368, std. dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.67% (45.4683 => 44.2521, std. dev.: 0.3500) MultiSource/Benchmarks/PAQ8p/paq8p: -2.40% (92.7467 => 90.5212, std. dev.: 0.3312) MultiSource/Benchmarks/mafft/pairlocalalign: -2.13% (62.4126 => 61.0808, std. dev.: 0.1412) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.99% (3.7496 => 3.6751, std. dev.: 0.0222) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2281, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.60% (3.8907 => 3.8286, std. dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0766, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7646, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -1.29% (1.7330 => 1.7106, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.22% (25.6658 => 25.3517, std. dev.: 0.0229) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.10% (1.8739 => 1.8532, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 23:46:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 01:46:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907064623.7CD672A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3508?compare_to=3507&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3508, Order: 163370, Start Time: 2012-09-07 05:36:36, End Time: 2012-09-07 06:47:35 To: 3507, Order: 163369, Start Time: 2012-09-07 03:43:44, End Time: 2012-09-07 04:54:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (50 on baseline) Performance Improvements: 6 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (0.3340 => 0.3487, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.23% (0.8535 => 0.8811, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.77% (6.6310 => 6.5136, std. dev.: 0.0291) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6767 => 0.6661, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: -1.10% (4.8489 => 4.7955, std. dev.: 0.0207) MultiSource/Applications/JM/lencod/lencod: -1.01% (14.9783 => 14.8268, std. dev.: 0.0371) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.73% (1.2520 => 1.2304, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: -1.42% (1.4131 => 1.3931, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.31% (1.1653 => 1.2155, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.92% (0.6410 => 0.6661, std. dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 3.91% (2.1763 => 2.2615, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.77% (0.3582 => 0.3717, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 3.60% (1.0046 => 1.0408, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3217 => 0.3321, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 3.05% (0.6173 => 0.6361, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.5150 => 1.5580, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 2.59% (3.0225 => 3.1009, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (12.6413 => 12.9592, std. dev.: 0.0368) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.3935 => 1.4216, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.93% (1.1440 => 1.1661, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 1.91% (29.3170 => 29.8760, std. dev.: 0.0866) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.63% (0.7226 => 0.7344, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.55% (2.0972 => 2.1297, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.39% (13.3238 => 13.5090, std. dev.: 0.0393) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (4.0318 => 4.0849, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.1827 => 1.1978, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 1.20% (14.6079 => 14.7838, std. dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.20% (1.2021 => 1.2165, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5558, std. dev.: 0.0109) SingleSource/Benchmarks/McGill/misr: 13.31% (0.4296 => 0.4868, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 13.13% (0.3746 => 0.4238, std. dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8793, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.59% (0.2857 => 0.3131, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6215, std. dev.: 0.1288) SingleSource/Benchmarks/McGill/chomp: 7.83% (1.0194 => 1.0992, std. dev.: 0.0267) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8069, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (3.4876 => 3.6936, std. dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.73% (40.4792 => 42.8001, std. dev.: 0.2267) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8214, std. dev.: 0.0694) SingleSource/Benchmarks/Misc/ReedSolomon: 3.90% (8.5113 => 8.8433, std. dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.68% (0.8498 => 0.8811, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/dt: 3.39% (0.9851 => 1.0185, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 2.90% (1.4184 => 1.4596, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.67% (2.6656 => 2.7368, std. dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.54% (0.5876 => 0.6025, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/five11/five11: 2.32% (5.1938 => 5.3145, std. dev.: 0.0288) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (2.4455 => 2.4827, std. dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5310, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6734, std. dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (2.4042 => 2.4321, std. dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.16% (5.2665 => 4.0997, std. dev.: 0.0862) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.50% (1.1647 => 0.9842, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std. dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.86% (3.2007 => 2.9491, std. dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3670, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: -6.11% (3.4230 => 3.2139, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.4441 => 1.3564, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.99% (1.7361 => 1.6494, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.77% (3.9413 => 3.7533, std. dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.21% (0.4564 => 0.4372, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.4140 => 0.3988, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (9.2503 => 8.9268, std. dev.: 0.0491) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2304, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.02% (2.4457 => 2.3718, std. dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.98% (3.7496 => 3.6380, std. dev.: 0.0318) MultiSource/Applications/aha/aha: -2.78% (3.4286 => 3.3334, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -2.76% (62.4126 => 60.6885, std. dev.: 0.3448) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2877, std. dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -2.62% (92.7467 => 90.3208, std. dev.: 0.4697) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2250, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -1.55% (1.7330 => 1.7061, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.52% (2.8964 => 2.8524, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.40% (1.8739 => 1.8476, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3188, std. dev.: 0.0289) SingleSource/Benchmarks/Misc/ffbench: -1.32% (1.4117 => 1.3931, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 6 23:52:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 01:52:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907065258.944422A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3509?compare_to=3504&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3509, Order: 163369, Start Time: 2012-09-07 04:10:44, End Time: 2012-09-07 06:54:10 To: 3504, Order: 163363, Start Time: 2012-09-07 00:59:08, End Time: 2012-09-07 03:42:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.97% (0.6098 => 0.6218, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.61% (130.5126 => 124.4937, std. dev.: 0.4080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.01% (0.3465 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.96% (0.3446 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.81% (0.3496 => 0.3909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.73% (0.3488 => 0.3897, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3442 => 0.3845, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.71% (0.3460 => 0.3865, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.67% (0.3469 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.32% (0.3650 => 0.4063, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3724 => 0.4133, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.16% (1.5932 => 1.7073, std. dev.: 0.0141) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5826 => 0.6235, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.89% (0.5889 => 0.6295, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (1.6211 => 1.7254, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (3.5627 => 3.7891, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (0.4361 => 0.4629, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.01% (1.3152 => 1.3942, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.2014 => 0.2131, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.60% (0.2875 => 0.3036, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.58% (0.5000 => 0.5279, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.57% (4.2109 => 4.4456, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (0.4994 => 0.5270, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (0.3930 => 0.4147, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.49% (0.3004 => 0.3169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2738 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.44% (0.5900 => 0.6221, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 5.42% (0.9909 => 1.0446, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.39% (0.2725 => 0.2872, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (0.5026 => 0.5297, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 5.37% (0.2813 => 0.2964, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.35% (0.3195 => 0.3366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.35% (0.2823 => 0.2974, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.34% (1.0781 => 1.1357, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.22% (2.0673 => 2.1752, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2780 => 0.2925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2803 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.16% (0.2792 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.13% (0.2750 => 0.2891, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 5.10% (0.3096 => 0.3254, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.09% (0.2811 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3267 => 0.3432, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.05% (0.2911 => 0.3058, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.03% (0.9697 => 1.0185, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 4.97% (0.3258 => 0.3420, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3060 => 0.3211, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.90% (0.3124 => 0.3277, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.2736 => 0.2869, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3362 => 0.3525, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3317 => 0.3477, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.81% (0.3282 => 0.3440, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.2866 => 0.3003, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.75% (5.5417 => 5.8051, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: 4.70% (0.3678 => 0.3851, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.69% (0.3348 => 0.3505, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.67% (0.3726 => 0.3900, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.60% (0.3477 => 0.3637, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3625 => 0.3791, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (0.3890 => 0.4068, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.56% (0.2566 => 0.2683, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4146 => 0.4334, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (0.4658 => 0.4866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.35% (0.4251 => 0.4436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3690 => 0.3846, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (2.7292 => 2.8442, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.3903 => 0.4066, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (1.9694 => 2.0510, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (1.9966 => 2.0776, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 4.04% (23.5202 => 24.4702, std. dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (2.1013 => 2.1860, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.3981 => 0.4141, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (4.4195 => 4.5944, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.3845 => 0.3997, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 3.95% (4.6177 => 4.8000, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (1.8794 => 1.9533, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.3084 => 0.3205, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (2.1653 => 2.2499, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.89% (0.6634 => 0.6892, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.5012 => 0.5206, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.86% (0.7875 => 0.8179, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.74% (1.4269 => 1.4803, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.6435 => 0.6672, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.4139 => 0.4288, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.42% (0.3336 => 0.3450, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 3.35% (0.5546 => 0.5732, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.72% (2.0346 => 2.0899, std. dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (0.4847 => 0.4962, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (0.5361 => 0.5471, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (0.7426 => 0.7573, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.35% (11.6398 => 11.7968, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (4.6926 => 4.7432, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6733, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8977, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6502, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1986, std. dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5074, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4356, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6014, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5709, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9733, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std. dev.: 0.0033) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8345, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5709, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9597, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 00:03:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 02:03:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907070336.6F1912A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3510?compare_to=3505&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3510, Order: 163370, Start Time: 2012-09-07 05:48:54, End Time: 2012-09-07 07:04:46 To: 3505, Order: 163369, Start Time: 2012-09-07 03:03:36, End Time: 2012-09-07 04:18:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.67% (2.0176 => 2.4144, std. dev.: 0.0629) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1410 => 0.1636, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std. dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.75% (0.1072 => 0.1198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.66% (0.5748 => 0.6361, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 10.61% (0.7061 => 0.7810, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.51% (0.7710 => 0.8520, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.18% (3.9660 => 4.3699, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.02% (1.3693 => 1.5065, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.71% (0.2596 => 0.2848, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 9.56% (0.7038 => 0.7711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.32% (1.2193 => 1.3329, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.29% (0.5265 => 0.5754, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.13% (0.9199 => 1.0039, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.98% (0.6959 => 0.7584, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.97% (0.2721 => 0.2965, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 8.80% (0.3578 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.75% (1.4563 => 1.5837, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.71% (1.1364 => 1.2354, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.53% (0.3914 => 0.4248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.44% (0.4003 => 0.4341, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.40% (0.3940 => 0.4271, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.34% (0.5577 => 0.6042, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.15% (0.6283 => 0.6795, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.08% (0.4791 => 0.5178, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.07% (13.8202 => 14.9358, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.99% (0.4379 => 0.4729, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3022 => 0.3263, std. dev.: 0.0079) MultiSource/Applications/lemon/lemon: 7.97% (1.0313 => 1.1135, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.92% (0.3246 => 0.3503, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.85% (7.2180 => 7.7847, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.81% (0.2995 => 0.3229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.76% (0.2782 => 0.2998, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2243 => 0.2416, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 7.59% (0.8310 => 0.8941, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.52% (0.4390 => 0.4720, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.49% (0.5637 => 0.6059, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3489 => 0.3750, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.47% (3.6692 => 3.9433, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.3756 => 0.4035, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3293 => 0.3537, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.40% (13.2842 => 14.2677, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.36% (1.1061 => 1.1875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2760 => 0.2963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.25% (3.8646 => 4.1447, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.25% (1.9828 => 2.1265, std. dev.: 0.0435) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.96% (1.3245 => 1.4167, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 6.95% (0.3192 => 0.3414, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.95% (0.4113 => 0.4399, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.93% (2.1791 => 2.3302, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3868 => 0.4134, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (1.2749 => 1.3621, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3534 => 0.3775, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.81% (0.7460 => 0.7968, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.77% (3.1889 => 3.4047, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.73% (1.9270 => 2.0567, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.55% (1.3819 => 1.4724, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.54% (0.8818 => 0.9395, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.52% (0.6135 => 0.6535, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.52% (4.3801 => 4.6655, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 6.51% (1.0594 => 1.1284, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.51% (0.6744 => 0.7183, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.47% (14.8535 => 15.8145, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.43% (1.3813 => 1.4701, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.32% (0.2945 => 0.3131, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.29% (4.4433 => 4.7227, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 6.26% (0.2859 => 0.3038, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.22% (16.6129 => 17.6455, std. dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: 6.17% (8.4961 => 9.0199, std. dev.: 0.1575) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2140 => 0.2271, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 6.07% (0.3131 => 0.3321, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.05% (0.6576 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.97% (0.8698 => 0.9217, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.91% (1.1333 => 1.2003, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 5.83% (14.5298 => 15.3773, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 5.52% (6.5754 => 6.9381, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.47% (0.2321 => 0.2448, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 5.39% (4.6629 => 4.9143, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.34% (3.2742 => 3.4489, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.95% (16.2614 => 17.0657, std. dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.93% (0.9108 => 0.9557, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2895, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.79% (0.4805 => 0.5035, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.33% (0.3511 => 0.3663, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.29% (1.5188 => 1.5839, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.19% (4.9865 => 5.1955, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.1007 => 2.1868, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 4.06% (3.7467 => 3.8987, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.64% (6.2785 => 6.5069, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0548) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.53% (1.1560 => 1.2546, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (0.2093 => 0.2201, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5497, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.19% (10.7476 => 11.0902, std. dev.: 0.0668) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6017, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 1.70% (3.7731 => 3.8374, std. dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5121, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.19% (12.4560 => 12.6041, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.86% (0.4657 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.83% (0.2670 => 0.2541, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.29% (20.3410 => 18.2474, std. dev.: 0.0458) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.70% (3.2729 => 3.1519, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6017, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2330, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5214, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0150) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2239, std. dev.: 0.0116) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4332, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 00:09:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 02:09:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907070945.9D0622A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3511?compare_to=3506&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3511, Order: 163370, Start Time: 2012-09-07 05:48:55, End Time: 2012-09-07 07:10:56 To: 3506, Order: 163369, Start Time: 2012-09-07 03:02:45, End Time: 2012-09-07 04:22:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (735 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.43% (10.3673 => 14.2479, std. dev.: 0.1456) SingleSource/Benchmarks/Misc/richards_benchmark: 26.45% (0.1622 => 0.2051, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.72% (7.0540 => 8.0217, std. dev.: 0.1519) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.66% (2.2022 => 2.5031, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.32% (1.1194 => 1.2573, std. dev.: 0.0279) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.14% (1.7609 => 1.9570, std. dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.98% (0.1625 => 0.1771, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5925 => 0.6342, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 7.03% (10.4361 => 11.1696, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.01% (9.4845 => 10.1495, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std. dev.: 0.0131) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.6030 => 0.6448, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7433 => 0.7932, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.58% (0.2554 => 0.2722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3307 => 0.3521, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.39% (0.7115 => 0.7570, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (8.1363 => 8.6523, std. dev.: 0.1397) MultiSource/Applications/d/make_dparser: 6.20% (3.3354 => 3.5422, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.17% (0.6675 => 0.7087, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.09% (1.5603 => 1.6553, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.04% (0.7835 => 0.8308, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (4.2646 => 4.5194, std. dev.: 0.0127) SingleSource/UnitTests/ObjC++/property-reference: 5.94% (0.7326 => 0.7761, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 5.85% (5.7591 => 6.0961, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.49% (0.2603 => 0.2746, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.47% (0.3092 => 0.3261, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.3136 => 0.3303, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.05% (1.1642 => 1.2230, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.03% (1.1861 => 1.2458, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.91% (3.8723 => 4.0626, std. dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.82% (0.3422 => 0.3587, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.81% (1.0722 => 1.1238, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.77% (0.4636 => 0.4857, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.71% (0.6456 => 0.6760, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.64% (0.2756 => 0.2884, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.57% (2.0273 => 2.1200, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9371 => 22.9052, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4289 => 0.4474, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.22% (0.3865 => 0.4028, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.16% (2.2969 => 2.3924, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.15% (0.2891 => 0.3011, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.4203 => 0.4376, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3603 => 0.3750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.4048 => 0.4212, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.05% (0.4620 => 0.4807, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.3098 => 0.3223, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.01% (0.2871 => 0.2986, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.97% (17.1811 => 17.8624, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.91% (0.3684 => 0.3828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3283 => 0.3411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.90% (0.3232 => 0.3358, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 3.83% (0.3052 => 0.3169, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.75% (0.3817 => 0.3960, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.69% (0.2793 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.68% (0.2802 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (1.5859 => 1.6415, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.39% (2.2024 => 2.2771, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.61% (1.2842 => 1.3177, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.8101 => 0.8266, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0020) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3829, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2143, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (4.2280 => 4.3644, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2209, std. dev.: 0.0130) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std. dev.: 0.0317) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.76% (5.2763 => 3.2312, std. dev.: 0.0573) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.17% (5.3855 => 3.8685, std. dev.: 0.0541) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.79% (5.3526 => 3.8652, std. dev.: 0.0580) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0867, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.88% (2.9384 => 2.5894, std. dev.: 0.0662) MultiSource/Applications/ClamAV/clamscan: -7.88% (22.1758 => 20.4276, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2585, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7152, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5075, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4294, std. dev.: 0.0805) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9875, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.62% (1.2373 => 1.2049, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -1.91% (4.6441 => 4.5552, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0040, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2346, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 01:20:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 03:20:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907082027.31F902A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3512?compare_to=3508&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3512, Order: 163371, Start Time: 2012-09-07 07:10:37, End Time: 2012-09-07 08:21:39 To: 3508, Order: 163370, Start Time: 2012-09-07 05:36:36, End Time: 2012-09-07 06:47:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (51 on baseline) Performance Improvements: 1 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.08% (0.4409 => 0.4589, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.40% (2.2708 => 2.3480, std. dev.: 0.0244) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.40% (4.3500 => 4.4978, std. dev.: 0.0224) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.63% (1.6494 => 1.6763, std. dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 1.54% (1.9921 => 2.0227, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/dt: 1.13% (1.0185 => 1.0300, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.04% (1.3931 => 1.4076, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -1.82% (3.9072 => 3.8360, std. dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.23% (0.6410 => 0.6681, std. dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 4.21% (1.1653 => 1.2144, std. dev.: 0.0185) MultiSource/Benchmarks/PAQ8p/paq8p: 3.90% (2.1763 => 2.2611, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 3.58% (1.0046 => 1.0406, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.46% (0.3582 => 0.3706, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5150 => 1.5631, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (12.6413 => 12.9910, std. dev.: 0.0914) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.7639 => 0.7829, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 2.07% (2.0972 => 2.1406, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (1.3935 => 1.4199, std. dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 1.73% (29.3170 => 29.8235, std. dev.: 0.0510) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.65% (0.6069 => 0.6169, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.53% (1.1672 => 1.1851, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (4.0318 => 4.0765, std. dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.2186 => 8.3028, std. dev.: 0.0310) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3397, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2297, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 14.80% (1.7426 => 2.0005, std. dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.86% (4.0101 => 4.5661, std. dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8804, std. dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 12.77% (0.1433 => 0.1616, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 12.66% (0.4296 => 0.4840, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 12.55% (0.3746 => 0.4216, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.12% (0.0917 => 0.1019, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6343, std. dev.: 0.0257) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.65% (0.2694 => 0.2927, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.14% (0.2857 => 0.3061, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 6.93% (1.0194 => 1.0900, std. dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.91% (1.0063 => 1.0758, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.76% (4.2129 => 4.4978, std. dev.: 0.0224) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.40% (27.1724 => 28.9108, std. dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.83% (40.4792 => 42.8405, std. dev.: 0.4214) SingleSource/Benchmarks/Shootout-C++/hash2: 5.77% (3.4876 => 3.6889, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/dt: 4.56% (0.9851 => 1.0300, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 3.90% (15.2242 => 15.8187, std. dev.: 0.0576) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5395, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (6.6312 => 6.8752, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5113 => 8.7611, std. dev.: 0.0548) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.85% (0.3508 => 0.3608, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: 2.84% (5.1938 => 5.3414, std. dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.79% (0.5876 => 0.6040, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.61% (2.6656 => 2.7353, std. dev.: 0.0180) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.93% (4.6127 => 4.7017, std. dev.: 0.0308) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (2.4971 => 2.5369, std. dev.: 0.0136) MultiSource/Applications/siod/siod: 1.48% (3.5520 => 3.6047, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: 1.47% (2.5166 => 2.5536, std. dev.: 0.0078) MultiSource/Applications/lua/lua: 1.34% (29.5232 => 29.9182, std. dev.: 0.1425) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.31% (4.0659 => 4.1193, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6715, std. dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.35% (0.3497 => 0.2051, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.62% (5.2665 => 4.1279, std. dev.: 0.0448) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9896, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1621, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.83% (3.2007 => 2.9500, std. dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3729, std. dev.: 0.0270) MultiSource/Applications/SIBsim4/SIBsim4: -6.23% (3.4230 => 3.2096, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4085, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -4.90% (1.4441 => 1.3734, std. dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (1.4021 => 1.3398, std. dev.: 0.0235) MultiSource/Benchmarks/FreeBench/distray/distray: -4.43% (0.2664 => 0.2546, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (3.9413 => 3.7684, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.80% (3.7496 => 3.6073, std. dev.: 0.0252) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.46% (1.8739 => 1.8091, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.44% (1.7361 => 1.6763, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9451, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -2.61% (9.5474 => 9.2978, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -2.59% (3.4286 => 3.3399, std. dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: -2.17% (92.7467 => 90.7374, std. dev.: 0.1578) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (62.4126 => 61.2727, std. dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2254, std. dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -1.41% (3.8907 => 3.8360, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/oourafft: -1.29% (3.8200 => 3.7706, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -1.28% (6.7458 => 6.6594, std. dev.: 0.0296) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.28% (25.6658 => 25.3378, std. dev.: 0.0262) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.12% (1.1116 => 1.0992, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -1.08% (1.7330 => 1.7142, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 01:50:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 03:50:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907085000.D722D2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3513?compare_to=3510&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3513, Order: 163374, Start Time: 2012-09-07 07:36:30, End Time: 2012-09-07 08:51:11 To: 3510, Order: 163370, Start Time: 2012-09-07 05:48:54, End Time: 2012-09-07 07:04:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.10% (78.1771 => 79.8184, std. dev.: 0.4911) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.73% (2.0176 => 2.4156, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.96% (0.1410 => 0.1635, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.12% (0.5818 => 0.6465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.96% (0.5748 => 0.6378, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.65% (1.3693 => 1.5151, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.07% (0.7061 => 0.7772, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.02% (3.9660 => 4.3632, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.00% (0.7710 => 0.8481, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 9.63% (0.7038 => 0.7716, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.39% (1.2193 => 1.3338, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.23% (0.5265 => 0.5751, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 9.15% (0.4328 => 0.4724, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.10% (0.9199 => 1.0036, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.98% (0.6959 => 0.7584, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2781 => 0.3030, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.4003 => 0.4359, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.77% (0.3022 => 0.3287, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.72% (0.3899 => 0.4239, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2782 => 0.3024, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.65% (1.4563 => 1.5822, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.59% (1.1364 => 1.2340, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 8.52% (0.4062 => 0.4408, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.44% (0.2655 => 0.2879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.32% (0.2607 => 0.2824, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.27% (0.5577 => 0.6038, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.2937 => 0.3179, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.22% (0.2690 => 0.2911, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 8.19% (0.2761 => 0.2987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.17% (0.3489 => 0.3774, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.16% (0.6283 => 0.6796, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.16% (0.3580 => 0.3872, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (0.3485 => 0.3769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.14% (0.3293 => 0.3561, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2760 => 0.2984, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.11% (13.8202 => 14.9410, std. dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.07% (1.9828 => 2.1429, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 8.07% (0.2726 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.04% (0.3756 => 0.4058, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.99% (0.2966 => 0.3203, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.97% (0.4791 => 0.5173, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.95% (0.4379 => 0.4727, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.91% (0.2995 => 0.3232, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 7.91% (1.0313 => 1.1129, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.88% (0.2765 => 0.2983, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.85% (0.3107 => 0.3351, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.83% (0.2696 => 0.2907, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.3246 => 0.3500, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.81% (7.2180 => 7.7814, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.79% (0.4016 => 0.4329, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.75% (0.3149 => 0.3393, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.70% (0.7506 => 0.8084, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.68% (0.3192 => 0.3437, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.63% (0.8310 => 0.8944, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.58% (3.6692 => 3.9475, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: 7.56% (0.2988 => 0.3214, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.56% (0.4390 => 0.4722, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 7.55% (0.3868 => 0.4160, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.50% (0.3453 => 0.3712, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 7.47% (0.3534 => 0.3798, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.39% (0.3220 => 0.3458, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.37% (13.2842 => 14.2638, std. dev.: 0.0144) MultiSource/Benchmarks/McCat/09-vor/vor: 7.35% (0.2925 => 0.3140, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.31% (1.1061 => 1.1870, std. dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 7.18% (3.8646 => 4.1421, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.08% (0.4113 => 0.4404, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 6.99% (0.2945 => 0.3151, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.86% (1.3245 => 1.4153, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 6.84% (2.1791 => 2.3281, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 6.81% (1.2749 => 1.3617, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.73% (0.6744 => 0.7198, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 6.67% (3.1889 => 3.4016, std. dev.: 0.0065) MultiSource/Applications/treecc/treecc: 6.60% (1.9270 => 2.0541, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.59% (0.6135 => 0.6539, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 6.52% (1.0594 => 1.1285, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.51% (0.8818 => 0.9392, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.39% (0.2504 => 0.2664, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.33% (1.3813 => 1.4688, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.33% (1.3819 => 1.4694, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 6.33% (14.8535 => 15.7935, std. dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.29% (0.8698 => 0.9245, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.3801 => 4.6555, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.2140 => 0.2274, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.24% (4.4433 => 4.7204, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.23% (0.3755 => 0.3989, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.15% (16.6129 => 17.6353, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.07% (8.4961 => 9.0122, std. dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 6.00% (0.3131 => 0.3319, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.80% (14.5298 => 15.3722, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.76% (1.1333 => 1.1986, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 5.48% (1.2292 => 1.2966, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.47% (6.5754 => 6.9349, std. dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.44% (0.6576 => 0.6934, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.30% (0.2321 => 0.2444, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.29% (3.2742 => 3.4474, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 5.09% (4.6629 => 4.9004, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 5.00% (16.2614 => 17.0743, std. dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.75% (0.9108 => 0.9541, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.4805 => 0.5032, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.40% (1.5188 => 1.5856, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.38% (0.6250 => 0.6524, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.23% (4.9865 => 5.1973, std. dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.19% (2.1007 => 2.1888, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 4.02% (3.7467 => 3.8975, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.70% (0.3511 => 0.3641, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (6.2785 => 6.5050, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 3.37% (33.2944 => 34.4176, std. dev.: 0.0286) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2683, std. dev.: 0.0472) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7329, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0774, std. dev.: 0.0346) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.76% (0.5184 => 0.5327, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5961, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5747, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5941, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.76% (0.2670 => 0.2543, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.60% (22.5627 => 21.7501, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.28% (20.3410 => 18.2509, std. dev.: 0.0233) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5100, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0009) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9242, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5821, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2472, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.61% (4.5928 => 4.5189, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2308, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2313, std. dev.: 0.0362) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std. dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4334, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 01:58:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 03:58:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907085826.DC5C82A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3514?compare_to=3511&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3514, Order: 163374, Start Time: 2012-09-07 07:39:19, End Time: 2012-09-07 08:59:37 To: 3511, Order: 163370, Start Time: 2012-09-07 05:48:55, End Time: 2012-09-07 07:10:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (141 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.67% (77.8939 => 79.9768, std. dev.: 0.6000) MultiSource/Benchmarks/llubenchmark/llu: 1.59% (3.7877 => 3.8480, std. dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.72% (10.3673 => 14.2775, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.15% (7.0540 => 8.0518, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.05% (2.2022 => 2.5117, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.24% (0.3497 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.15% (1.1194 => 1.2554, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.68% (1.7609 => 1.9665, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.84% (0.3282 => 0.3572, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.34% (0.3177 => 0.3442, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.70% (0.7433 => 0.8005, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 7.61% (0.6030 => 0.6489, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.38% (0.8172 => 0.8775, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 7.14% (10.4361 => 11.1814, std. dev.: 0.0205) MultiSource/Benchmarks/mafft/pairlocalalign: 7.10% (9.4845 => 10.1579, std. dev.: 0.0186) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.07% (0.4879 => 0.5224, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.67% (0.4615 => 0.4923, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 6.57% (0.7326 => 0.7807, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.55% (0.1940 => 0.2067, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5569 => 0.5930, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.41% (0.7835 => 0.8337, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (8.1363 => 8.6534, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.35% (0.2758 => 0.2933, std. dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.28% (3.3354 => 3.5448, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.25% (0.5860 => 0.6226, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.24% (1.5415 => 1.6377, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.12% (1.5603 => 1.6558, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (1.3050 => 1.3839, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.04% (4.9449 => 5.2435, std. dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.02% (4.2646 => 4.5212, std. dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.01% (5.0018 => 5.3023, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.92% (0.5105 => 0.5407, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (0.3121 => 0.3301, std. dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 5.61% (5.7591 => 6.0822, std. dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.3180 => 0.3357, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.57% (0.8067 => 0.8516, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.3092 => 0.3264, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.34% (1.1642 => 1.2264, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.34% (0.9765 => 1.0286, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.32% (14.3668 => 15.1310, std. dev.: 0.0082) MultiSource/Applications/lemon/lemon: 5.04% (1.0722 => 1.1262, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (1.1861 => 1.2455, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 4.99% (3.8723 => 4.0654, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.97% (0.3441 => 0.3612, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 4.91% (0.3422 => 0.3590, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.4103 => 0.4302, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.80% (0.6456 => 0.6766, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.4064 => 0.4259, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5020 => 0.5257, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 4.66% (2.0273 => 2.1217, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.60% (0.6450 => 0.6747, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.56% (7.9617 => 8.3250, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.55% (0.2793 => 0.2920, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 4.54% (21.9371 => 22.9333, std. dev.: 0.0312) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3817 => 0.3988, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3826 => 0.3997, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3865 => 0.4036, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3650 => 0.3811, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.4289 => 0.4476, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.34% (2.0665 => 2.1562, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.32% (0.2891 => 0.3016, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 4.31% (2.2969 => 2.3958, std. dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.30% (0.3136 => 0.3271, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.29% (0.8921 => 0.9304, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.24% (0.4620 => 0.4816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.21% (0.3684 => 0.3839, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.4636 => 0.4829, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5981 => 0.6226, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.09% (0.3935 => 0.4096, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.07% (0.3098 => 0.3224, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3232 => 0.3363, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.4048 => 0.4212, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/except: 4.04% (0.2871 => 0.2987, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.03% (0.3052 => 0.3175, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 4.02% (0.3603 => 0.3748, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 4.02% (17.1811 => 17.8713, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.4186 => 1.4753, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2756 => 0.2866, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.96% (0.3283 => 0.3413, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.93% (0.2877 => 0.2990, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.76% (0.3379 => 0.3506, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (1.5859 => 1.6427, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (2.2024 => 2.2792, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.1840 => 1.2193, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.61% (1.2842 => 1.3177, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.8101 => 0.8289, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (3.1578 => 3.3839, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.29% (4.2280 => 4.3671, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7587, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 1.85% (3.7781 => 3.8480, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2465, std. dev.: 0.0222) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.10% (2.2771 => 2.3022, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7615, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1297, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.84% (5.2763 => 3.2271, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.81% (5.3855 => 3.8877, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.41% (5.3526 => 3.8857, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0453, std. dev.: 0.0263) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.21% (2.9384 => 2.5796, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -7.71% (22.1758 => 20.4656, std. dev.: 0.0551) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2592, std. dev.: 0.1338) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.46% (1.8329 => 1.7145, std. dev.: 0.0172) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0021) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1491, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4296, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9975, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.14% (8.1563 => 7.9817, std. dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: -2.01% (4.6441 => 4.5508, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5114, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2331, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 02:47:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 04:47:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907094736.CBBE42A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3515?compare_to=3512&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3515, Order: 163377, Start Time: 2012-09-07 08:37:23, End Time: 2012-09-07 09:48:49 To: 3512, Order: 163371, Start Time: 2012-09-07 07:10:37, End Time: 2012-09-07 08:21:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (51 on baseline) Performance Improvements: 0 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.22% (0.7704 => 0.7952, std. dev.: 0.0059) MultiSource/Applications/hbd/hbd: 2.01% (1.3254 => 1.3521, std. dev.: 0.0064) MultiSource/Applications/lua/lua: 1.21% (3.5926 => 3.6360, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (0.3361 => 0.3544, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.45% (1.8091 => 1.8534, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.46% (4.1279 => 4.1881, std. dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.0758 => 1.0887, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 5.20% (1.1653 => 1.2259, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.6410 => 0.6743, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 4.73% (2.1763 => 2.2792, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 4.46% (1.0046 => 1.0494, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3582 => 0.3723, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 3.89% (0.6173 => 0.6413, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 3.71% (2.0972 => 2.1750, std. dev.: 0.0264) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.5150 => 1.5656, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 3.23% (3.0225 => 3.1202, std. dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (12.6413 => 13.0215, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.98% (0.7722 => 0.7952, std. dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 2.56% (13.3238 => 13.6654, std. dev.: 0.1011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.7639 => 0.7829, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.91% (1.3268 => 1.3521, std. dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 1.86% (14.6079 => 14.8795, std. dev.: 0.0474) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.85% (0.7226 => 0.7360, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.4113 => 1.4291, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 1.06% (3.5980 => 3.6360, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2292, std. dev.: 0.0639) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.06% (0.0766 => 0.0889, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 14.78% (1.7426 => 2.0002, std. dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.08% (4.0101 => 4.5747, std. dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 11.21% (0.3746 => 0.4166, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/misr: 11.13% (0.4296 => 0.4774, std. dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 9.42% (0.1433 => 0.1568, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.70% (7.0025 => 7.6115, std. dev.: 0.0594) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.19% (1.0063 => 1.0887, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.13% (0.2694 => 0.2913, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.3301 => 0.3544, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 7.18% (1.0194 => 1.0926, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (3.4876 => 3.7020, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.08% (4.2129 => 4.4690, std. dev.: 0.0613) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8024, std. dev.: 0.0933) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.50% (40.4792 => 42.7066, std. dev.: 0.3483) SingleSource/Benchmarks/Shootout-C++/hash: 4.50% (0.6308 => 0.6592, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8279, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.63% (3.4080 => 3.5316, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/dt: 3.61% (0.9851 => 1.0207, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 3.21% (1.4184 => 1.4639, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 2.78% (5.1938 => 5.3382, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.57% (4.6127 => 4.7314, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: 2.42% (8.5113 => 8.7172, std. dev.: 0.0596) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.23% (0.5876 => 0.6007, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (2.4455 => 2.4914, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 1.51% (2.5166 => 2.5547, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5349, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 1.34% (14.4877 => 14.6823, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.74% (0.2080 => 0.1919, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.48% (5.2665 => 4.1881, std. dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.06% (1.1647 => 0.9893, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1630, std. dev.: 0.0344) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2877, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.40% (3.2007 => 2.9640, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3668, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3499, std. dev.: 0.0185) MultiSource/Applications/SIBsim4/SIBsim4: -6.36% (3.4230 => 3.2053, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4059, std. dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.57% (1.7361 => 1.6741, std. dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.20% (61.1734 => 59.2174, std. dev.: 0.5303) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (9.2503 => 8.9592, std. dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6438, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/flops: -2.67% (9.5474 => 9.2924, std. dev.: 0.0265) MultiSource/Applications/aha/aha: -2.38% (3.4286 => 3.3470, std. dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (92.7467 => 90.6111, std. dev.: 0.7536) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.21% (1.1683 => 1.1425, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.96% (62.4126 => 61.1877, std. dev.: 0.1992) MultiSource/Benchmarks/Olden/tsp/tsp: -1.70% (1.7330 => 1.7035, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3174, std. dev.: 0.0745) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.27% (9.3855 => 9.2660, std. dev.: 0.0175) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.09% (1.8739 => 1.8534, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: -1.01% (16.5617 => 16.3938, std. dev.: 0.0262) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 03:10:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 05:10:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907101052.8E83E2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3516?compare_to=3509&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3516, Order: 163371, Start Time: 2012-09-07 07:28:00, End Time: 2012-09-07 10:11:40 To: 3509, Order: 163369, Start Time: 2012-09-07 04:10:44, End Time: 2012-09-07 06:54:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -4.50% (0.2243 => 0.2142, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3465 => 0.3912, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 12.83% (0.3446 => 0.3888, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3442 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.69% (0.3460 => 0.3899, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3488 => 0.3930, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3496 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.60% (0.3469 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.16% (0.3650 => 0.4094, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 12.13% (0.3643 => 0.4085, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5826 => 0.6275, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.45% (0.5889 => 0.6328, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.04% (1.5932 => 1.7054, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.87% (1.6211 => 1.7324, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.71% (3.5627 => 3.8018, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.42% (0.4361 => 0.4641, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.35% (1.3152 => 1.3987, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7171 => 0.7613, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (0.3930 => 0.4167, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (0.4994 => 0.5286, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 5.84% (4.2109 => 4.4568, std. dev.: 0.0164) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.5900 => 0.6239, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.69% (1.0781 => 1.1394, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (0.5026 => 0.5308, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2875 => 0.3035, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.3004 => 0.3171, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.37% (5.5417 => 5.8394, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.30% (0.2566 => 0.2702, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2738 => 0.2882, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.26% (0.3195 => 0.3363, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.25% (0.9909 => 1.0429, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 5.23% (0.9697 => 1.0204, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (2.0673 => 2.1748, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.2866 => 0.3013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.13% (0.2750 => 0.2891, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.05% (0.2811 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.05% (0.2911 => 0.3058, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.3096 => 0.3251, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.00% (0.2780 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.99% (0.2803 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3267 => 0.3430, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2792 => 0.2930, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.89% (1.9694 => 2.0657, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 4.88% (0.3258 => 0.3417, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.79% (0.3362 => 0.3523, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (0.4658 => 0.4881, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3060 => 0.3206, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.77% (0.3124 => 0.3273, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3317 => 0.3474, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.67% (0.3726 => 0.3900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4146 => 0.4339, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3678 => 0.3849, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.63% (0.3282 => 0.3434, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.3903 => 0.4081, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (2.7292 => 2.8535, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3625 => 0.3790, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.3348 => 0.3500, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (4.4195 => 4.6195, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (1.9966 => 2.0868, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 4.52% (0.3477 => 0.3634, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.49% (2.1013 => 2.1957, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3690 => 0.3852, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.36% (0.6634 => 0.6923, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 4.35% (23.5202 => 24.5423, std. dev.: 0.0363) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (1.8794 => 1.9600, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4251 => 0.4432, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.23% (4.6177 => 4.8128, std. dev.: 0.0062) MultiSource/Applications/treecc/treecc: 4.20% (0.7875 => 0.8206, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.4139 => 0.4312, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.14% (2.1653 => 2.2550, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 4.14% (1.4269 => 1.4860, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.09% (0.3084 => 0.3210, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.07% (0.3271 => 0.3404, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.3845 => 0.4001, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 4.02% (0.3336 => 0.3470, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.5012 => 0.5209, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.73% (0.5546 => 0.5753, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.6435 => 0.6669, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3792 => 0.3920, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.10% (2.0346 => 2.0977, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.3498 => 0.3598, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 2.66% (0.4847 => 0.4976, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (0.5361 => 0.5493, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (0.7426 => 0.7602, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.01% (0.5584 => 0.5696, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (11.6398 => 11.8363, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.59% (4.6926 => 4.7674, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1692, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6501, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std. dev.: 0.0167) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5017, std. dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4419, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std. dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4618, std. dev.: 0.4061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5270, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary2: -10.82% (0.2402 => 0.2142, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7910, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7930, std. dev.: 0.0077) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (17.2379 => 16.8374, std. dev.: 0.0162) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.89% (0.6293 => 0.6174, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9651, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 03:32:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 05:32:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907103248.7ADD72A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3517?compare_to=3513&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3517, Order: 163378, Start Time: 2012-09-07 09:19:22, End Time: 2012-09-07 10:33:58 To: 3513, Order: 163374, Start Time: 2012-09-07 07:36:30, End Time: 2012-09-07 08:51:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (174 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.57% (79.8184 => 81.8719, std. dev.: 0.2680) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.96% (2.0176 => 2.4203, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1410 => 0.1636, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std. dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.26% (0.5818 => 0.6473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 10.41% (1.3693 => 1.5118, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.31% (0.7710 => 0.8505, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 10.14% (0.7061 => 0.7777, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.04% (3.9660 => 4.3640, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.55% (0.7038 => 0.7710, std. dev.: 0.0182) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.33% (0.9199 => 1.0057, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.30% (1.2193 => 1.3327, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.25% (0.5265 => 0.5752, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.14% (0.3623 => 0.3954, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.03% (0.3789 => 0.4131, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.4003 => 0.4362, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.96% (0.3940 => 0.4293, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.85% (0.6959 => 0.7575, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 8.80% (0.4328 => 0.4709, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.62% (1.4563 => 1.5819, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.62% (1.1364 => 1.2344, std. dev.: 0.0090) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4062 => 0.4404, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.3899 => 0.4224, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.21% (0.3022 => 0.3270, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.18% (0.5577 => 0.6033, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.15% (0.1435 => 0.1552, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.15% (0.6283 => 0.6795, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.13% (0.3246 => 0.3510, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 8.11% (0.3293 => 0.3560, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9389, std. dev.: 0.0166) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 7.95% (1.0313 => 1.1133, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.91% (0.4791 => 0.5170, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.90% (0.2607 => 0.2813, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.85% (0.3580 => 0.3861, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.85% (0.2995 => 0.3230, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.82% (0.3489 => 0.3762, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2761 => 0.2977, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.2914 => 0.3141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.77% (0.3756 => 0.4048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2655 => 0.2861, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.76% (0.3107 => 0.3348, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 7.75% (0.7506 => 0.8088, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.74% (1.9828 => 2.1362, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.73% (0.2690 => 0.2898, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.73% (7.2180 => 7.7757, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 7.69% (0.2937 => 0.3163, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.67% (0.2765 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2726 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.65% (0.3149 => 0.3390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.64% (0.2760 => 0.2971, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.57% (0.8310 => 0.8939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.49% (0.2696 => 0.2898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4016 => 0.4316, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.46% (3.6692 => 3.9428, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.35% (13.2842 => 14.2605, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3192 => 0.3426, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.2988 => 0.3207, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.3868 => 0.4150, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.27% (1.1061 => 1.1865, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 7.22% (3.8646 => 4.1437, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 7.17% (0.3220 => 0.3451, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.15% (0.3453 => 0.3700, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.13% (0.3534 => 0.3786, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.02% (0.4390 => 0.4698, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.88% (0.4113 => 0.4396, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.3245 => 1.4150, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.81% (0.7460 => 0.7968, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.81% (1.2749 => 1.3617, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 6.78% (2.1791 => 2.3268, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.77% (3.1889 => 3.4049, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 6.72% (0.2945 => 0.3143, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.63% (0.8818 => 0.9403, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.63% (1.9270 => 2.0548, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 6.60% (0.6744 => 0.7189, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.55% (1.0594 => 1.1288, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.47% (0.6135 => 0.6532, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 6.41% (14.8535 => 15.8056, std. dev.: 0.0156) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.39% (0.2504 => 0.2664, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.36% (1.3813 => 1.4691, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.33% (4.3801 => 4.6574, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.30% (1.3819 => 1.4690, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.25% (4.4433 => 4.7212, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.17% (0.8698 => 0.9235, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.11% (8.4961 => 9.0156, std. dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 6.10% (0.3131 => 0.3322, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.06% (16.6129 => 17.6190, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.89% (0.3755 => 0.3976, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.73% (1.1333 => 1.1982, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 5.69% (14.5298 => 15.3559, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 5.53% (6.5754 => 6.9388, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.28% (0.6576 => 0.6923, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.27% (3.2742 => 3.4466, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 5.15% (1.2292 => 1.2925, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.14% (4.6629 => 4.9025, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.92% (0.9108 => 0.9556, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.88% (16.2614 => 17.0557, std. dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.4805 => 0.5031, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.37% (1.5188 => 1.5852, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6250 => 0.6518, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.16% (4.9865 => 5.1938, std. dev.: 0.0112) MultiSource/Applications/lua/lua: 4.07% (3.7467 => 3.8992, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.97% (2.1007 => 2.1842, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.87% (0.3511 => 0.3647, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4998, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 3.12% (33.2944 => 34.3347, std. dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std. dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4122, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7336, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0761, std. dev.: 0.0133) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (0.5184 => 0.5331, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5973, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.09% (7.9275 => 8.0136, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5912, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.28% (0.4657 => 0.3992, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.87% (0.2670 => 0.2540, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.71% (22.5627 => 21.7256, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.35% (20.3410 => 18.2363, std. dev.: 0.0516) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.74% (0.3458 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5095, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.64% (1.7688 => 1.7044, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.31% (3.0263 => 2.9261, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2489, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5219, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std. dev.: 0.0338) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2285, std. dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std. dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4331, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 03:46:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 05:46:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907104621.BE33C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3518?compare_to=3514&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3518, Order: 163378, Start Time: 2012-09-07 09:27:48, End Time: 2012-09-07 10:47:33 To: 3514, Order: 163374, Start Time: 2012-09-07 07:39:19, End Time: 2012-09-07 08:59:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (141 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -12.54% (0.4595 => 0.4019, std. dev.: 0.0197) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.59% (79.9768 => 78.7055, std. dev.: 0.3158) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.91% (10.3673 => 14.4007, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.21% (7.0540 => 8.0564, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.21% (2.2022 => 2.5151, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.56% (1.1194 => 1.2600, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.45% (0.1566 => 0.1761, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.44% (0.3473 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.97% (1.7609 => 1.9717, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.58% (0.5925 => 0.6374, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.6030 => 0.6483, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.33% (9.4845 => 10.1800, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.19% (10.4361 => 11.1862, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.11% (0.3121 => 0.3343, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.96% (0.7433 => 0.7950, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.77% (0.3307 => 0.3531, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.8172 => 0.8715, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 6.62% (0.7115 => 0.7586, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.50% (8.1363 => 8.6655, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (0.6675 => 0.7108, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.45% (0.7835 => 0.8340, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.37% (0.7326 => 0.7793, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.36% (1.5415 => 1.6396, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 6.25% (0.3423 => 0.3637, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.25% (0.5860 => 0.6226, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.23% (4.9449 => 5.2531, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 6.21% (3.3354 => 3.5426, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.15% (0.5105 => 0.5419, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (4.2646 => 4.5251, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 6.11% (1.5603 => 1.6556, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.03% (1.3050 => 1.3837, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5569 => 0.5902, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.96% (5.0018 => 5.3000, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 5.92% (5.7591 => 6.1003, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.8067 => 0.8525, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.65% (0.2603 => 0.2750, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.57% (0.9765 => 1.0309, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 5.38% (0.3180 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (14.3668 => 15.1384, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 5.31% (0.3387 => 0.3567, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 5.29% (1.1642 => 1.2258, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4299 => 0.4526, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.13% (1.1861 => 1.2469, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.08% (0.5020 => 0.5275, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 5.07% (3.8723 => 4.0688, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.07% (0.4103 => 0.4311, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 4.93% (1.0722 => 1.1251, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (7.9617 => 8.3544, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists: 4.85% (0.3422 => 0.3588, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6450 => 0.6761, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.82% (0.6456 => 0.6767, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.4064 => 0.4259, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1238, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 4.51% (2.2969 => 2.4005, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.47% (21.9371 => 22.9172, std. dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2891 => 0.3020, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4289 => 0.4479, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3826 => 0.3995, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.41% (0.8921 => 0.9314, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.38% (0.3650 => 0.3810, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.32% (0.3817 => 0.3982, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.32% (0.3865 => 0.4032, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.25% (0.3603 => 0.3756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.24% (0.4203 => 0.4381, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.2905 => 0.3028, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.22% (0.4048 => 0.4219, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (2.0665 => 2.1532, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.3136 => 0.3267, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.5981 => 0.6227, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.3098 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3684 => 0.3835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4620 => 0.4809, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3232 => 0.3363, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.05% (0.3283 => 0.3416, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.04% (0.2871 => 0.2987, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2756 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3935 => 0.4092, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.98% (17.1811 => 17.8647, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (1.4186 => 1.4746, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5859 => 1.6477, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wc: 3.87% (0.3052 => 0.3170, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.69% (0.2793 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.66% (2.2024 => 2.2829, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.1840 => 1.2202, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.75% (1.2842 => 1.3195, std. dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.8101 => 0.8275, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4144, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3835, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.29% (4.2280 => 4.3669, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2420, std. dev.: 0.0124) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7612, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1304, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2298, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.75% (5.3855 => 3.8909, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.40% (5.3526 => 3.8858, std. dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1004, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.22% (2.9384 => 2.5792, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.74% (22.1758 => 20.4587, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4186, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2752, std. dev.: 0.0621) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5112, std. dev.: 0.0034) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5077, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4198, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.38% (1.2373 => 1.2079, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5543, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0089, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4229, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2294, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 04:19:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 06:19:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907111931.154E62A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3519?compare_to=3515&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3519, Order: 163382, Start Time: 2012-09-07 10:09:58, End Time: 2012-09-07 11:20:43 To: 3515, Order: 163377, Start Time: 2012-09-07 08:37:23, End Time: 2012-09-07 09:48:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (46 on baseline) Performance Improvements: 6 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.30% (0.4416 => 0.4650, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.04% (4.4619 => 4.8207, std. dev.: 0.0732) SingleSource/Benchmarks/Shootout-C++/sieve: 5.78% (3.6351 => 3.8453, std. dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.47% (2.3398 => 2.3977, std. dev.: 0.0141) SingleSource/Benchmarks/McGill/misr: 2.22% (0.4774 => 0.4880, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -2.56% (2.1750 => 2.1193, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: -1.90% (1.9132 => 1.8769, std. dev.: 0.0132) MultiSource/Applications/d/make_dparser: -1.49% (3.1202 => 3.0738, std. dev.: 0.0135) MultiSource/Applications/oggenc/oggenc: -1.38% (4.8651 => 4.7979, std. dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: -1.31% (13.6654 => 13.4861, std. dev.: 0.0669) MultiSource/Applications/JM/lencod/lencod: -1.28% (14.9822 => 14.7902, std. dev.: 0.0696) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.50% (0.1414 => 0.1520, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.65% (0.6410 => 0.6708, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 3.69% (2.1763 => 2.2566, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 3.61% (0.6173 => 0.6396, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 3.16% (1.0046 => 1.0363, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.79% (0.3582 => 0.3682, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.70% (3.0225 => 3.0738, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.59% (1.1672 => 1.1858, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.43% (1.3935 => 1.4134, std. dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.6079 => 14.7898, std. dev.: 0.0699) MultiSource/Applications/oggenc/oggenc: 1.10% (4.7455 => 4.7979, std. dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: 1.09% (29.3170 => 29.6355, std. dev.: 0.0494) MultiSource/Applications/siod/siod: 1.05% (2.0972 => 2.1193, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3397, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: 15.11% (1.7426 => 2.0059, std. dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.60% (4.0101 => 4.5555, std. dev.: 0.1052) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 13.11% (0.3746 => 0.4237, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 11.76% (3.4406 => 3.8453, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: 8.72% (7.0025 => 7.6131, std. dev.: 0.0392) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.15% (1.0063 => 1.0783, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.99% (4.5056 => 4.8207, std. dev.: 0.0732) MultiSource/Benchmarks/BitBench/drop3/drop3: 6.83% (0.2694 => 0.2878, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8103, std. dev.: 0.0726) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.89% (40.4792 => 42.8645, std. dev.: 0.4141) SingleSource/Benchmarks/Shootout-C++/hash2: 5.88% (3.4876 => 3.6925, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/fp-convert: 4.61% (15.2242 => 15.9266, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.06% (0.7609 => 0.7918, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5369, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: 3.22% (1.4184 => 1.4641, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.50% (0.5876 => 0.6023, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 2.47% (8.5113 => 8.7214, std. dev.: 0.0500) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (2.6656 => 2.7252, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/five11/five11: 1.82% (5.1938 => 5.2883, std. dev.: 0.0262) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4455 => 2.4807, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.28% (29.5232 => 29.9013, std. dev.: 0.1251) MultiSource/Applications/siod/siod: 1.25% (3.5520 => 3.5963, std. dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: 1.20% (14.4877 => 14.6622, std. dev.: 0.0629) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (2.4971 => 2.5253, std. dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 1.09% (6.9722 => 7.0480, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.60% (5.2665 => 4.1288, std. dev.: 0.0581) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.07% (1.1647 => 0.9892, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0259) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.55% (3.2007 => 2.9592, std. dev.: 0.0506) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.01% (3.6254 => 3.3712, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (3.4230 => 3.1900, std. dev.: 0.0286) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3532, std. dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/fibo: -5.03% (4.6355 => 4.4023, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.55% (1.7361 => 1.6571, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -4.51% (9.2503 => 8.8333, std. dev.: 0.0755) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.49% (0.4564 => 0.4359, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.35% (1.8739 => 1.8111, std. dev.: 0.0238) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.16% (1.2722 => 1.2320, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.7496 => 3.6389, std. dev.: 0.0244) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.80% (0.4140 => 0.4024, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0093) MultiSource/Applications/aha/aha: -2.71% (3.4286 => 3.3358, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.41% (2.8964 => 2.8265, std. dev.: 0.0240) MultiSource/Benchmarks/mafft/pairlocalalign: -2.10% (62.4126 => 61.1002, std. dev.: 0.1323) MultiSource/Benchmarks/PAQ8p/paq8p: -2.04% (92.7467 => 90.8512, std. dev.: 0.0718) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.96% (2.4457 => 2.3977, std. dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (9.3855 => 9.2211, std. dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.45% (3.8907 => 3.8341, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7676, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3172, std. dev.: 0.0626) SingleSource/Benchmarks/Shootout-C++/lists: -1.11% (16.5617 => 16.3774, std. dev.: 0.0617) MultiSource/Applications/JM/lencod/lencod: -1.06% (6.7458 => 6.6744, std. dev.: 0.0222) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 05:15:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 07:15:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907121539.31C522A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3520?compare_to=3517&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3520, Order: 163383, Start Time: 2012-09-07 11:02:16, End Time: 2012-09-07 12:16:50 To: 3517, Order: 163378, Start Time: 2012-09-07 09:19:22, End Time: 2012-09-07 10:33:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (174 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 964 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.04% (2.1362 => 2.1584, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 1.02% (1.5118 => 1.5272, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.10% (54.3092 => 55.9932, std. dev.: 0.3135) SingleSource/Benchmarks/Shootout/ary3: 1.51% (3.6840 => 3.7397, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.27% (2.6761 => 2.7101, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.61% (81.8719 => 79.7368, std. dev.: 0.3263) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.92% (2.0176 => 2.4195, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1410 => 0.1636, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 11.53% (1.3693 => 1.5272, std. dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.34% (0.5818 => 0.6478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.95% (0.7061 => 0.7834, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.25% (3.9660 => 4.3726, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.18% (0.7710 => 0.8495, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 9.90% (0.3646 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.86% (0.3601 => 0.3956, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3663 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3623 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.79% (0.3914 => 0.4297, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 9.78% (0.7038 => 0.7726, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.77% (0.4328 => 0.4751, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.75% (0.3650 => 0.4006, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3789 => 0.4156, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.67% (0.4003 => 0.4390, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.53% (0.2781 => 0.3046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.49% (0.3940 => 0.4314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.42% (0.2782 => 0.3044, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.38% (1.2193 => 1.3337, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.28% (0.9199 => 1.0053, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.23% (0.3022 => 0.3301, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 9.21% (0.4062 => 0.4436, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.3899 => 0.4256, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.04% (1.4563 => 1.5879, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.2721 => 0.2966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.98% (0.2607 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.96% (0.2655 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.95% (0.2937 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.92% (0.6959 => 0.7580, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.91% (1.1364 => 1.2376, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 8.88% (0.2690 => 0.2929, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.87% (0.2761 => 0.3006, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.87% (0.2628 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.86% (1.9828 => 2.1584, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 8.84% (0.2726 => 0.2967, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.84% (0.3293 => 0.3584, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.81% (0.3485 => 0.3792, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.80% (0.2760 => 0.3003, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.77% (0.2966 => 0.3226, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.75% (0.3107 => 0.3379, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.72% (0.3580 => 0.3892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.68% (0.3489 => 0.3792, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2765 => 0.3004, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.63% (0.3756 => 0.4080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.61% (0.3149 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.56% (0.1589 => 0.1725, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.53% (0.2696 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.53% (0.6283 => 0.6819, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.43% (0.2988 => 0.3240, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.40% (0.3192 => 0.3460, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.38% (13.8202 => 14.9783, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.34% (0.5577 => 0.6042, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 8.29% (0.7506 => 0.8128, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.29% (0.4791 => 0.5188, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.20% (0.3453 => 0.3736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.20% (0.3868 => 0.4185, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.17% (0.4016 => 0.4344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.15% (0.3534 => 0.3822, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.08% (1.0313 => 1.1146, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.07% (0.3246 => 0.3508, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.06% (0.4379 => 0.4732, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.01% (0.2995 => 0.3235, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (7.2180 => 7.7936, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.93% (0.4390 => 0.4738, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.81% (0.2945 => 0.3175, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.68% (0.8310 => 0.8948, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.64% (3.6692 => 3.9494, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 7.58% (1.1061 => 1.1899, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.54% (0.5637 => 0.6062, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.54% (13.2842 => 14.2856, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3220 => 0.3456, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.29% (3.8646 => 4.1464, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std. dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 7.20% (0.4113 => 0.4409, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.02% (0.8818 => 0.9437, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.95% (1.2749 => 1.3635, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.3245 => 1.4164, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.91% (0.6744 => 0.7210, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.87% (3.1889 => 3.4080, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 6.87% (2.1791 => 2.3287, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 6.83% (1.9270 => 2.0587, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 6.73% (1.0594 => 1.1307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.68% (0.8698 => 0.9279, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.66% (0.3755 => 0.4005, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.65% (14.8535 => 15.8410, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.62% (0.6135 => 0.6541, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.60% (1.3813 => 1.4725, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.57% (1.3819 => 1.4727, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.53% (4.3801 => 4.6663, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.44% (4.4433 => 4.7295, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.39% (0.2504 => 0.2664, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.28% (16.6129 => 17.6554, std. dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: 6.23% (8.4961 => 9.0255, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2140 => 0.2271, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.10% (0.3131 => 0.3322, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.04% (1.2292 => 1.3035, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 5.87% (14.5298 => 15.3833, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.85% (1.1333 => 1.1996, std. dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (6.5754 => 6.9481, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3245 => 0.3423, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.41% (3.2742 => 3.4514, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.22% (0.6576 => 0.6919, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.20% (4.6629 => 4.9055, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 5.10% (16.2614 => 17.0913, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.08% (0.9108 => 0.9571, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.91% (0.4805 => 0.5041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.78% (0.6250 => 0.6549, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.41% (4.9865 => 5.2065, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.36% (1.5188 => 1.5850, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 4.24% (3.7467 => 3.9054, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.18% (2.1007 => 2.1885, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.04% (0.3511 => 0.3653, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (6.2785 => 6.5237, std. dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 3.33% (33.2944 => 34.4045, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 25.12% (1.8175 => 2.2741, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7333, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5459, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0925, std. dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5919, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 1.14% (3.6975 => 3.7397, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5953, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.79% (0.4657 => 0.4015, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.46% (22.5627 => 21.7810, std. dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2751, std. dev.: 0.0151) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.84% (0.4867 => 0.4680, std. dev.: 0.0009) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7057, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9246, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2436, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5198, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2399, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2356, std. dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4332, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2600, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 05:34:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 07:34:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907123416.580142A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3521?compare_to=3518&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3521, Order: 163383, Start Time: 2012-09-07 11:15:51, End Time: 2012-09-07 12:35:28 To: 3518, Order: 163378, Start Time: 2012-09-07 09:27:48, End Time: 2012-09-07 10:47:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.00% (1.2079 => 1.2200, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (14.4007 => 14.1218, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.15% (3.8668 => 3.7835, std. dev.: 0.0269) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.21% (10.3673 => 14.1218, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.94% (7.0540 => 8.0373, std. dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.56% (2.2022 => 2.5008, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3543 => 0.3995, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.18% (1.1194 => 1.2557, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.07% (1.7609 => 1.9735, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3828 => 0.4263, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 8.74% (0.3282 => 0.3569, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.30% (0.4879 => 0.5235, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 7.26% (0.5925 => 0.6355, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.18% (0.6030 => 0.6463, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.18% (10.4361 => 11.1853, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 7.14% (9.4845 => 10.1620, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.90% (0.7433 => 0.7946, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8172 => 0.8717, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 6.63% (0.7115 => 0.7587, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.44% (0.6675 => 0.7105, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.43% (0.2271 => 0.2417, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3307 => 0.3519, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (8.1363 => 8.6519, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3423 => 0.3638, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.26% (0.5860 => 0.6227, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.22% (4.9449 => 5.2523, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7326 => 0.7777, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 6.13% (3.3354 => 3.5398, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.09% (0.5105 => 0.5416, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (1.3050 => 1.3844, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5569 => 0.5904, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (4.2646 => 4.5200, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.97% (0.7835 => 0.8303, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.88% (1.5415 => 1.6322, std. dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.88% (5.0018 => 5.2958, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.87% (0.2758 => 0.2920, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3121 => 0.3303, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 5.78% (5.7591 => 6.0917, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 5.77% (1.5603 => 1.6503, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.57% (0.8067 => 0.8516, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.3092 => 0.3262, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9765 => 1.0298, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4299 => 0.4526, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (14.3668 => 15.1152, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.05% (1.1861 => 1.2460, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.01% (1.1642 => 1.2225, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (0.4064 => 0.4267, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.99% (1.0722 => 1.1257, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.97% (0.3441 => 0.3612, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 4.95% (3.8723 => 4.0640, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.5020 => 0.5267, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.4103 => 0.4297, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.71% (0.6450 => 0.6754, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (7.9617 => 8.3292, std. dev.: 0.0086) MultiSource/Applications/treecc/treecc: 4.58% (2.0273 => 2.1201, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3422 => 0.3578, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2871 => 0.3000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6456 => 0.6745, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8921 => 0.9316, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.4048 => 0.4225, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.36% (21.9371 => 22.8946, std. dev.: 0.0229) MultiSource/Applications/siod/siod: 4.36% (2.2969 => 2.3971, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.32% (0.3817 => 0.3982, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.29% (0.3826 => 0.3990, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5981 => 0.6225, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.06% (0.3865 => 0.4022, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.2905 => 0.3023, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.3136 => 0.3263, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4289 => 0.4462, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.94% (2.0665 => 2.1480, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4203 => 0.4366, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.88% (17.1811 => 17.8474, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4729, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4620 => 0.4796, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.80% (1.5859 => 1.6461, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.75% (0.3684 => 0.3822, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3603 => 0.3737, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.3232 => 0.3351, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.61% (2.2024 => 2.2818, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.51% (0.3052 => 0.3159, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.1840 => 1.2195, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.45% (1.2842 => 1.3157, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.8101 => 0.8270, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0006) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.24% (3.1578 => 3.3865, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.36% (4.2280 => 4.3702, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2220, std. dev.: 0.0161) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7617, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5746, std. dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1298, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.75% (5.2763 => 3.2318, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.07% (5.3855 => 3.8736, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.61% (5.3526 => 3.8750, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0822, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.20% (2.9384 => 2.5800, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -7.78% (22.1758 => 20.4498, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2807, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.97% (3.2827 => 3.1524, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5114, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4138, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9877, std. dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9888, std. dev.: 0.0272) MultiSource/Applications/sqlite3/sqlite3: -1.90% (4.6441 => 4.5558, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: -1.40% (1.2373 => 1.2200, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 05:45:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 07:45:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907124542.1B6402A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3522?compare_to=3519&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3522, Order: 163383, Start Time: 2012-09-07 11:36:19, End Time: 2012-09-07 12:46:55 To: 3519, Order: 163382, Start Time: 2012-09-07 10:09:58, End Time: 2012-09-07 11:20:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (61 on baseline) Performance Improvements: 2 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.97% (0.7463 => 0.7983, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.14% (1.2106 => 1.2244, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (3.2396 => 3.5617, std. dev.: 0.0939) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.97% (21.4095 => 22.6874, std. dev.: 0.0975) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.47% (2.5390 => 2.6271, std. dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.49% (2.3790 => 2.4144, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/methcall: 1.49% (8.8333 => 8.9646, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.28% (1.6571 => 1.6783, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 1.11% (5.2883 => 5.3470, std. dev.: 0.0227) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (1.4134 => 1.3981, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.98% (4.8207 => 4.5325, std. dev.: 0.0501) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.60% (0.6410 => 0.6705, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 4.30% (2.1763 => 2.2699, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.1653 => 1.2122, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.93% (1.5150 => 1.5745, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3582 => 0.3719, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 3.26% (1.0046 => 1.0374, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (12.6413 => 13.0199, std. dev.: 0.0417) MultiSource/Applications/d/make_dparser: 1.87% (3.0225 => 3.0790, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.86% (1.2021 => 1.2244, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.74% (1.1672 => 1.1875, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.67% (1.1440 => 1.1631, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (4.0318 => 4.0980, std. dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.45% (0.7639 => 0.7750, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.18% (29.3170 => 29.6623, std. dev.: 0.0415) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (8.2186 => 8.3076, std. dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 1.08% (14.6079 => 14.7656, std. dev.: 0.0508) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.97% (0.0766 => 0.0896, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: 15.11% (1.7426 => 2.0059, std. dev.: 0.0365) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.05% (0.0917 => 0.1055, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.01% (4.0101 => 4.5721, std. dev.: 0.0561) SingleSource/Benchmarks/McGill/misr: 12.76% (0.4296 => 0.4844, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8794, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.21% (0.2694 => 0.2942, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 9.18% (7.0025 => 7.6452, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 8.23% (1.0194 => 1.1033, std. dev.: 0.0128) SingleSource/Benchmarks/Stanford/Puzzle: 7.75% (0.1433 => 0.1544, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.64% (1.0063 => 1.0832, std. dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (27.1724 => 28.8436, std. dev.: 0.1340) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.10% (40.4792 => 42.9482, std. dev.: 0.1989) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (3.4876 => 3.6948, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.20% (4.2129 => 4.3900, std. dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5378, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 3.68% (15.2242 => 15.7838, std. dev.: 0.0842) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 3.08% (8.5113 => 8.7736, std. dev.: 0.0478) MultiSource/Benchmarks/BitBench/five11/five11: 2.95% (5.1938 => 5.3470, std. dev.: 0.0227) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.88% (2.6656 => 2.7423, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.53% (4.6127 => 4.7296, std. dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.39% (2.3580 => 2.4144, std. dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.83% (2.4042 => 2.4481, std. dev.: 0.0164) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4455 => 2.4841, std. dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.56% (22.3381 => 22.6874, std. dev.: 0.0975) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (2.4971 => 2.5334, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 1.41% (2.5166 => 2.5522, std. dev.: 0.0129) MultiSource/Applications/siod/siod: 1.40% (3.5520 => 3.6018, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 1.37% (4.6414 => 4.7050, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 1.32% (14.4877 => 14.6783, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.26% (4.0659 => 4.1171, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout/hash: 1.26% (4.3016 => 4.3556, std. dev.: 0.0179) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.21% (1.2726 => 1.2880, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.10% (2.5984 => 2.6271, std. dev.: 0.0107) MultiSource/Applications/lua/lua: 1.08% (29.5232 => 29.8419, std. dev.: 0.1038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.89% (0.3497 => 0.2137, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.76% (5.2665 => 4.1203, std. dev.: 0.1213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.81% (1.1647 => 0.9922, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1604, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9427, std. dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.11% (3.6254 => 3.3675, std. dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: -6.56% (3.4230 => 3.1983, std. dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/richards_benchmark: -5.68% (1.4441 => 1.3621, std. dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/fibo: -5.11% (4.6355 => 4.3986, std. dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (3.9413 => 3.7630, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.33% (1.7361 => 1.6783, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2322, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: -3.09% (9.2503 => 8.9646, std. dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.83% (61.1734 => 59.4392, std. dev.: 0.6570) MultiSource/Applications/aha/aha: -2.78% (3.4286 => 3.3334, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.71% (1.1683 => 1.1366, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2942, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.28% (2.8964 => 2.8303, std. dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -2.23% (92.7467 => 90.6740, std. dev.: 0.1438) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.20% (9.3855 => 9.1793, std. dev.: 0.0247) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.15% (1.8739 => 1.8337, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: -2.00% (62.4126 => 61.1657, std. dev.: 0.0521) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.99% (1.4021 => 1.3742, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3173, std. dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -1.35% (3.8907 => 3.8383, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/lists: -1.32% (16.5617 => 16.3434, std. dev.: 0.0419) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 06:23:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 08:23:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907132304.963162A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3523?compare_to=3516&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3523, Order: 163383, Start Time: 2012-09-07 10:40:23, End Time: 2012-09-07 13:24:16 To: 3516, Order: 163371, Start Time: 2012-09-07 07:28:00, End Time: 2012-09-07 10:11:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.47% (120.4882 => 127.0829, std. dev.: 1.9156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.09% (0.3446 => 0.3897, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.44% (0.3650 => 0.4104, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5826 => 0.6295, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.5889 => 0.6349, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.67% (3.5627 => 3.8005, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (1.6211 => 1.7293, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 6.41% (0.7171 => 0.7631, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.19% (0.4361 => 0.4631, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 6.19% (1.5932 => 1.6918, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.15% (1.3152 => 1.3961, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.2014 => 0.2137, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.05% (0.4994 => 0.5296, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 5.92% (4.2109 => 4.4600, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 5.89% (0.3004 => 0.3181, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2738 => 0.2898, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2875 => 0.3042, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.81% (0.4029 => 0.4263, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3362 => 0.3551, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3195 => 0.3374, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.5900 => 0.6230, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.59% (0.5026 => 0.5307, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 5.59% (0.9909 => 1.0463, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.2823 => 0.2978, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2813 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (2.0673 => 2.1801, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.41% (0.2792 => 0.2943, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.40% (1.0781 => 1.1363, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2803 => 0.2954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.39% (0.1968 => 0.2074, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.38% (0.2750 => 0.2898, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.36% (0.5000 => 0.5268, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 5.36% (0.2780 => 0.2929, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2911 => 0.3067, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.34% (0.2811 => 0.2961, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.26% (0.3096 => 0.3259, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.19% (0.3124 => 0.3286, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.17% (0.3267 => 0.3436, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (0.3625 => 0.3810, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.10% (0.3258 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.07% (0.3060 => 0.3215, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.06% (0.3317 => 0.3485, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.02% (0.2866 => 0.3010, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.02% (0.9697 => 1.0184, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.2736 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3477 => 0.3650, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.94% (5.5417 => 5.8154, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/moments: 4.92% (0.3678 => 0.3859, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (0.3890 => 0.4081, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3726 => 0.3908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.88% (0.3282 => 0.3442, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.87% (0.3348 => 0.3511, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4146 => 0.4347, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.63% (0.3690 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.63% (1.9694 => 2.0605, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.60% (0.2566 => 0.2684, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 4.59% (0.4251 => 0.4446, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (0.4658 => 0.4870, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.3845 => 0.4019, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (2.7292 => 2.8526, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 4.44% (2.1013 => 2.1945, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.3903 => 0.4072, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (1.9966 => 2.0821, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (4.4195 => 4.6076, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (1.8794 => 1.9592, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 4.19% (0.6634 => 0.6912, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.17% (0.3981 => 0.4147, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.11% (0.5012 => 0.5218, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.10% (4.6177 => 4.8068, std. dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: 3.97% (23.5202 => 24.4532, std. dev.: 0.0155) MultiSource/Applications/JM/ldecod/ldecod: 3.96% (2.1653 => 2.2511, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.86% (1.4269 => 1.4820, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.85% (0.7875 => 0.8178, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.77% (0.4139 => 0.4295, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.3271 => 0.3394, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.73% (0.6435 => 0.6675, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.67% (0.3792 => 0.3931, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.75% (2.0346 => 2.0906, std. dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (0.4847 => 0.4967, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (0.7426 => 0.7585, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (0.5361 => 0.5470, std. dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.41% (11.6398 => 11.8039, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (4.6926 => 4.7447, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.48% (0.2122 => 0.2302, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6728, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std. dev.: 0.0372) SingleSource/Benchmarks/Misc/flops-2: 4.54% (1.8057 => 1.8876, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6300, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2008, std. dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5067, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4439, std. dev.: 0.0219) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5995, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4448, std. dev.: 0.0593) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5551, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary2: -9.74% (0.2402 => 0.2168, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7964, std. dev.: 0.0094) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.72% (17.2379 => 16.7689, std. dev.: 0.0470) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.18% (0.6293 => 0.6156, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5726, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9722, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 07:18:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 09:18:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907141811.AF6242A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3524?compare_to=3522&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3524, Order: 163385, Start Time: 2012-09-07 13:08:36, End Time: 2012-09-07 14:19:24 To: 3522, Order: 163383, Start Time: 2012-09-07 11:36:19, End Time: 2012-09-07 12:46:55 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (57 on baseline) Performance Improvements: 2 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 5.33% (6.2114 => 6.5422, std. dev.: 0.0669) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.36% (2.8303 => 2.8972, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/whetstone: 2.04% (2.3476 => 2.3954, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.64% (1.8337 => 1.8638, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -2.56% (2.4107 => 2.3489, std. dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.76% (42.9482 => 42.1941, std. dev.: 0.1707) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.6410 => 0.6749, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 4.88% (1.1653 => 1.2222, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.05% (0.3582 => 0.3727, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 3.76% (2.1763 => 2.2582, std. dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.47% (0.7722 => 0.7990, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.5150 => 1.5641, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.88% (1.1672 => 1.2008, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (12.6413 => 12.9842, std. dev.: 0.0752) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.5937 => 0.6095, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.1827 => 1.2093, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.80% (1.4113 => 1.4367, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 1.75% (29.3170 => 29.8293, std. dev.: 0.0856) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (4.0318 => 4.0992, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.2021 => 1.2203, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (0.7639 => 0.7753, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (8.2186 => 8.3345, std. dev.: 0.0435) MultiSource/Applications/SPASS/SPASS: 1.37% (13.3238 => 13.5063, std. dev.: 0.0460) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2546 => 6.3384, std. dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.0317 => 2.0579, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.26% (8.2559 => 8.3603, std. dev.: 0.0253) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.19% (4.2616 => 4.3125, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (1.4408 => 1.4569, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.0689 => 1.0803, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.00% (3.4629 => 4.2246, std. dev.: 0.0177) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.54% (0.0766 => 0.0931, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std. dev.: 0.0428) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5558, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.30% (0.0917 => 0.1039, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 12.68% (0.3746 => 0.4221, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 12.62% (0.4296 => 0.4838, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 11.10% (3.4406 => 3.8226, std. dev.: 0.0370) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 9.19% (7.0025 => 7.6458, std. dev.: 0.0421) SingleSource/Benchmarks/Stanford/Puzzle: 9.14% (0.1433 => 0.1564, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 6.45% (1.0194 => 1.0852, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 6.18% (3.4876 => 3.7030, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8162, std. dev.: 0.0187) MultiSource/Applications/minisat/minisat: 5.11% (6.2244 => 6.5422, std. dev.: 0.0669) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (0.3301 => 0.3464, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.24% (40.4792 => 42.1941, std. dev.: 0.1707) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8372, std. dev.: 0.0669) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8714, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 2.58% (1.4184 => 1.4550, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 2.14% (2.3453 => 2.3954, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.11% (0.5876 => 0.6000, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.04% (2.6656 => 2.7199, std. dev.: 0.0167) MultiSource/Applications/lua/lua: 1.98% (29.5232 => 30.1063, std. dev.: 0.1123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (2.4455 => 2.4888, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 1.56% (3.5520 => 3.6073, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6728, std. dev.: 0.0507) SingleSource/Benchmarks/Dhrystone/dry: 1.05% (2.4013 => 2.4265, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.66% (0.3497 => 0.2040, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.23% (5.2665 => 4.0960, std. dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.65% (1.1647 => 0.9941, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1612, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.02% (3.2007 => 2.9441, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.04% (3.6254 => 3.3703, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3503, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -5.72% (3.4230 => 3.2271, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4092, std. dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7628, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.96% (2.4457 => 2.3489, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/methcall: -3.65% (9.2503 => 8.9128, std. dev.: 0.0512) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.84% (1.2722 => 1.2361, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2894, std. dev.: 0.0221) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.55% (1.2959 => 1.2629, std. dev.: 0.0105) MultiSource/Applications/aha/aha: -2.53% (3.4286 => 3.3417, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (92.7467 => 90.4306, std. dev.: 0.0882) MultiSource/Applications/SPASS/SPASS: -2.49% (8.5323 => 8.3198, std. dev.: 0.0785) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.32% (1.1683 => 1.1412, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -2.20% (62.4126 => 61.0383, std. dev.: 0.2144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.05% (1.0686 => 1.0467, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.80% (3.7496 => 3.6822, std. dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2346, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7645, std. dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3128, std. dev.: 0.0794) SingleSource/Benchmarks/Shootout-C++/lists: -1.20% (16.5617 => 16.3622, std. dev.: 0.0681) MultiSource/Applications/JM/lencod/lencod: -1.04% (6.7458 => 6.6759, std. dev.: 0.0218) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 07:34:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 09:34:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907143450.7D2572A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3525?compare_to=3520&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3525, Order: 163385, Start Time: 2012-09-07 13:21:22, End Time: 2012-09-07 14:36:01 To: 3520, Order: 163383, Start Time: 2012-09-07 11:02:16, End Time: 2012-09-07 12:16:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.08% (55.9932 => 56.5973, std. dev.: 0.0472) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.29% (3.7397 => 3.6915, std. dev.: 0.0186) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.83% (2.0176 => 2.4176, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.38% (0.0826 => 0.0953, std. dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.41% (1.3693 => 1.5255, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.68% (0.7061 => 0.7815, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.58% (0.1588 => 0.1756, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.32% (3.9660 => 4.3754, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.26% (0.7710 => 0.8501, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 10.15% (0.3578 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.91% (0.3601 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3650 => 0.4010, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3663 => 0.4023, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.80% (0.4328 => 0.4752, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.79% (0.7038 => 0.7727, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.72% (0.3623 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.71% (0.3789 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.71% (0.3914 => 0.4294, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.67% (0.2596 => 0.2847, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 9.64% (0.4003 => 0.4389, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.55% (0.5265 => 0.5768, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 9.49% (0.2781 => 0.3045, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.44% (0.3940 => 0.4312, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.40% (1.2193 => 1.3339, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.33% (0.9199 => 1.0057, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.24% (0.2782 => 0.3039, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.3899 => 0.4256, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.14% (0.6959 => 0.7595, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.13% (0.3022 => 0.3298, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.05% (0.2607 => 0.2843, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.2721 => 0.2966, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.96% (1.4563 => 1.5868, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 8.94% (0.4062 => 0.4425, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.91% (1.1364 => 1.2377, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 8.91% (0.2760 => 0.3006, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.89% (0.2937 => 0.3198, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.88% (0.2690 => 0.2929, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.88% (1.9828 => 2.1588, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.87% (0.2628 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.85% (0.2655 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2726 => 0.2965, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.76% (0.2761 => 0.3003, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.75% (0.3485 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.75% (0.3293 => 0.3581, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3489 => 0.3794, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.70% (0.2966 => 0.3224, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.68% (0.2765 => 0.3005, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.62% (0.1589 => 0.1726, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.60% (0.3580 => 0.3888, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 8.59% (0.3107 => 0.3374, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.55% (0.3756 => 0.4077, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 8.54% (0.3149 => 0.3418, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.53% (0.2696 => 0.2926, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.52% (0.4390 => 0.4764, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.48% (0.6283 => 0.6816, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.46% (0.3192 => 0.3462, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 8.36% (13.8202 => 14.9762, std. dev.: 0.0176) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.36% (0.5577 => 0.6043, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.2988 => 0.3237, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.33% (0.7506 => 0.8131, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.20% (0.4791 => 0.5184, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.18% (0.4379 => 0.4737, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.17% (0.4016 => 0.4344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.12% (0.3868 => 0.4182, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.12% (1.0313 => 1.1150, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 8.02% (0.3453 => 0.3730, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3246 => 0.3506, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.99% (7.2180 => 7.7946, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists1: 7.98% (0.3534 => 0.3816, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.95% (0.2995 => 0.3233, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.79% (3.6692 => 3.9552, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 7.67% (0.2945 => 0.3171, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.52% (0.5637 => 0.6061, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.51% (1.1061 => 1.1892, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.50% (13.2842 => 14.2802, std. dev.: 0.0171) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.30% (0.3220 => 0.3455, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.29% (3.8646 => 4.1463, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (0.8818 => 0.9458, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.17% (0.4113 => 0.4408, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 7.01% (1.9270 => 2.0621, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.98% (1.3245 => 1.4169, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (1.2749 => 1.3636, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.92% (0.7460 => 0.7976, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 6.89% (2.1791 => 2.3292, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 6.86% (3.1889 => 3.4076, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.76% (1.3819 => 1.4753, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 6.75% (14.8535 => 15.8566, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 6.73% (1.0594 => 1.1307, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.67% (0.6744 => 0.7194, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.66% (0.8698 => 0.9277, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.65% (0.6135 => 0.6543, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.60% (0.3755 => 0.4003, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.59% (1.3813 => 1.4723, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.3801 => 4.6625, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.43% (4.4433 => 4.7291, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.28% (16.6129 => 17.6555, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 6.27% (8.4961 => 9.0284, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.04% (1.2292 => 1.3034, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.95% (14.5298 => 15.3950, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (1.1333 => 1.2005, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 5.70% (6.5754 => 6.9503, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.54% (3.2742 => 3.4555, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.39% (0.3245 => 0.3420, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.32% (0.6576 => 0.6926, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.22% (4.6629 => 4.9064, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.08% (0.9108 => 0.9571, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.2008 => 0.2110, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 5.02% (16.2614 => 17.0774, std. dev.: 0.0342) SingleSource/Benchmarks/Misc-C++/bigfib: 4.98% (0.6250 => 0.6561, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.87% (0.4805 => 0.5039, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.49% (4.9865 => 5.2105, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.44% (1.5188 => 1.5863, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 4.22% (3.7467 => 3.9047, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.21% (2.1007 => 2.1891, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.07% (0.3511 => 0.3654, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.85% (6.2785 => 6.5204, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 3.41% (33.2944 => 34.4313, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0504) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7340, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0793, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6017, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5156, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.17% (1.4298 => 1.4465, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.87% (0.4657 => 0.4011, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.44% (22.5627 => 21.7868, std. dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2933, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5097, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9242, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9180, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5980, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2477, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5223, std. dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2380, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2242, std. dev.: 0.0256) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4312, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2632, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 07:39:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 09:39:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907143947.963722A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3526?compare_to=3521&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3526, Order: 163385, Start Time: 2012-09-07 13:21:20, End Time: 2012-09-07 14:40:59 To: 3521, Order: 163383, Start Time: 2012-09-07 11:15:51, End Time: 2012-09-07 12:35:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.00% (78.0975 => 79.6557, std. dev.: 0.2446) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.33% (10.3673 => 14.1334, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.80% (7.0540 => 8.0274, std. dev.: 0.0161) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.53% (2.2022 => 2.5001, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.37% (1.1194 => 1.2579, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.15% (0.3497 => 0.3922, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.11% (1.7609 => 1.9742, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-3: 11.95% (0.3516 => 0.3936, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.75% (0.3121 => 0.3363, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.21% (0.4879 => 0.5231, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5925 => 0.6351, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.19% (10.4361 => 11.1862, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 7.12% (9.4845 => 10.1602, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.8172 => 0.8748, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7433 => 0.7947, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.63% (0.7115 => 0.7587, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.6675 => 0.7097, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.23% (1.5415 => 1.6376, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.23% (0.5105 => 0.5423, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.21% (3.3354 => 3.5425, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (8.1363 => 8.6390, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.16% (0.5860 => 0.6221, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (4.2646 => 4.5239, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 6.06% (0.7326 => 0.7770, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.3050 => 1.3838, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5569 => 0.5903, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.96% (4.9449 => 5.2398, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.89% (5.0018 => 5.2966, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 5.87% (1.5603 => 1.6519, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.85% (0.7835 => 0.8293, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 5.77% (5.7591 => 6.0914, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.73% (0.2758 => 0.2916, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.8067 => 0.8527, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.42% (0.9765 => 1.0294, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.23% (0.4299 => 0.4524, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (14.3668 => 15.1095, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (1.1861 => 1.2461, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.06% (0.3441 => 0.3615, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.00% (1.1642 => 1.2224, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 4.93% (3.8723 => 4.0631, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.5020 => 0.5267, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.88% (1.0722 => 1.1245, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (7.9617 => 8.3434, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.4103 => 0.4296, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.67% (0.6450 => 0.6751, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.62% (2.0273 => 2.1209, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 4.62% (0.6456 => 0.6754, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4636 => 0.4847, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.53% (0.3422 => 0.3577, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.48% (0.4064 => 0.4246, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2756 => 0.2876, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8921 => 0.9307, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4289 => 0.4474, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 4.31% (2.2969 => 2.3959, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 4.29% (21.9371 => 22.8783, std. dev.: 0.0190) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.27% (0.3817 => 0.3980, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3650 => 0.3802, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.11% (0.3865 => 0.4024, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.3098 => 0.3225, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.08% (0.3826 => 0.3982, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (1.4186 => 1.4752, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.94% (2.0665 => 2.1480, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.91% (17.1811 => 17.8522, std. dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.4048 => 0.4206, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.90% (0.4203 => 0.4367, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.84% (0.3283 => 0.3409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.82% (0.3379 => 0.3508, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.2831 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6463, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3232 => 0.3353, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3162 => 0.3280, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.2024 => 2.2823, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.60% (0.3052 => 0.3162, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.1840 => 1.2193, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 2.51% (1.2842 => 1.3164, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (0.8101 => 0.8269, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.65% (0.2944 => 0.3287, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.29% (4.2280 => 4.3672, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2379, std. dev.: 0.0300) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5818, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 1.10% (2.2771 => 2.3021, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7615, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1300, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2356, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.05% (5.3855 => 3.8748, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.66% (5.3526 => 3.8719, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0907, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.10% (2.9384 => 2.5830, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -7.80% (22.1758 => 20.4457, std. dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3129, std. dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5764, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std. dev.: 0.0007) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1497, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5048, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4317, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0016, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.11% (1.2373 => 1.2112, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5531, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0110, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4231, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 08:44:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 10:44:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907154417.410E42A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3527?compare_to=3524&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3527, Order: 163389, Start Time: 2012-09-07 14:34:41, End Time: 2012-09-07 15:45:29 To: 3524, Order: 163385, Start Time: 2012-09-07 13:08:36, End Time: 2012-09-07 14:19:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (55 on baseline) Performance Improvements: 5 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.48% (0.7301 => 0.7409, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 8.66% (0.1294 => 0.1406, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.44% (16.0601 => 17.4149, std. dev.: 0.1233) MultiSource/Applications/SPASS/SPASS: 2.69% (8.3198 => 8.5434, std. dev.: 0.0693) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.12% (4.6747 => 4.7269, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.03% (1.2222 => 1.2096, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -4.65% (6.5422 => 6.2377, std. dev.: 0.0388) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.92% (0.2577 => 0.2476, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.40% (2.3954 => 2.3619, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.28% (1.8638 => 1.8399, std. dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.80% (1.1653 => 1.2096, std. dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 3.65% (2.1763 => 2.2557, std. dev.: 0.0285) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3582 => 0.3709, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.53% (0.6173 => 0.6391, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 3.50% (1.0046 => 1.0398, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.5150 => 1.5586, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (12.6413 => 12.9857, std. dev.: 0.1259) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.7226 => 0.7409, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.7722 => 0.7914, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.1827 => 1.2103, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.4113 => 1.4396, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.90% (3.0225 => 3.0800, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.73% (8.2559 => 8.3991, std. dev.: 0.0408) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.68% (0.5937 => 0.6037, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 1.41% (14.6079 => 14.8135, std. dev.: 0.0162) MultiSource/Applications/siod/siod: 1.30% (2.0972 => 2.1245, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.30% (1.3935 => 1.4116, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.30% (29.3170 => 29.6973, std. dev.: 0.0806) MultiSource/Applications/SPASS/SPASS: 1.26% (13.3238 => 13.4920, std. dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (8.2186 => 8.3214, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.89% (0.0766 => 0.0926, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.34% (0.0917 => 0.1076, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9995, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: 13.69% (0.4296 => 0.4884, std. dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.29% (4.0101 => 4.5431, std. dev.: 0.0201) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.00% (15.8312 => 17.4149, std. dev.: 0.1233) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6225, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sieve: 8.77% (3.4406 => 3.7425, std. dev.: 0.0657) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.24% (1.0063 => 1.0892, std. dev.: 0.0142) SingleSource/Benchmarks/McGill/chomp: 8.04% (1.0194 => 1.1014, std. dev.: 0.0109) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.57% (0.2694 => 0.2898, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7996, std. dev.: 0.1013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.73% (3.4876 => 3.6874, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.51% (4.2129 => 4.4450, std. dev.: 0.0539) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (0.3301 => 0.3479, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.39% (40.4792 => 42.2566, std. dev.: 0.6322) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8245, std. dev.: 0.0575) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: 3.64% (0.9851 => 1.0210, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.15% (0.8498 => 0.8766, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5113 => 8.7615, std. dev.: 0.0470) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.48% (4.6127 => 4.7269, std. dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.43% (0.5876 => 0.6019, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 2.23% (5.1938 => 5.3097, std. dev.: 0.0319) MultiSource/Applications/siod/siod: 1.52% (3.5520 => 3.6061, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4455 => 2.4805, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5312, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 1.19% (2.5166 => 2.5466, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.74% (0.7738 => 0.7603, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.75% (0.3497 => 0.2072, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.34% (5.2665 => 4.1427, std. dev.: 0.2312) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.00% (1.1647 => 0.9900, std. dev.: 0.0296) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1620, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9437, std. dev.: 0.0334) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.28% (3.6254 => 3.3613, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: -6.79% (0.2664 => 0.2483, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -6.64% (3.4230 => 3.1957, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -5.75% (1.4441 => 1.3611, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.77% (2.4457 => 2.3291, std. dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/methcall: -4.57% (9.2503 => 8.8273, std. dev.: 0.0715) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.66% (1.2959 => 1.2485, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.50% (1.7361 => 1.6753, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.39% (1.2722 => 1.2291, std. dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.08% (3.7496 => 3.6340, std. dev.: 0.0235) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.93% (1.1683 => 1.1341, std. dev.: 0.0121) MultiSource/Applications/aha/aha: -2.81% (3.4286 => 3.3324, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2918, std. dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (92.7467 => 90.3247, std. dev.: 0.6390) MultiSource/Benchmarks/mafft/pairlocalalign: -2.44% (62.4126 => 60.8871, std. dev.: 0.2215) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.81% (1.8739 => 1.8399, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2273, std. dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3133, std. dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: -1.32% (6.7458 => 6.6568, std. dev.: 0.0294) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7697, std. dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 09:17:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 11:17:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907161742.834B12A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3528?compare_to=3525&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3528, Order: 163389, Start Time: 2012-09-07 15:04:12, End Time: 2012-09-07 16:18:54 To: 3525, Order: 163385, Start Time: 2012-09-07 13:21:22, End Time: 2012-09-07 14:36:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.92% (2.0176 => 2.4195, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.30% (0.1410 => 0.1654, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.54% (1.3693 => 1.5273, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 11.16% (0.5818 => 0.6467, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 10.86% (0.5748 => 0.6372, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 10.69% (0.7061 => 0.7816, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.21% (3.9660 => 4.3709, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.19% (0.7710 => 0.8496, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 9.98% (0.4328 => 0.4760, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 9.95% (0.7038 => 0.7738, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.75% (0.3578 => 0.3927, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.66% (0.3022 => 0.3314, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 9.64% (0.2781 => 0.3049, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.61% (0.3663 => 0.4015, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 9.57% (0.3646 => 0.3995, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.57% (0.1327 => 0.1454, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.53% (0.9199 => 1.0076, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.53% (0.3601 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.52% (0.3623 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.42% (0.2782 => 0.3044, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.40% (0.5265 => 0.5760, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 9.40% (0.3789 => 0.4145, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.39% (1.2193 => 1.3338, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 9.38% (0.3914 => 0.4281, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.34% (0.4003 => 0.4377, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.31% (0.3899 => 0.4262, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 9.29% (0.3940 => 0.4306, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.18% (1.4563 => 1.5900, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.17% (0.6959 => 0.7597, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 9.09% (0.2607 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.08% (0.4062 => 0.4431, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.04% (0.2655 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.02% (0.2760 => 0.3009, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.02% (0.2761 => 0.3010, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.02% (0.2628 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.00% (0.2690 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.99% (0.2726 => 0.2971, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.96% (1.1364 => 1.2382, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.95% (0.2937 => 0.3200, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.95% (0.3485 => 0.3797, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.94% (1.9828 => 2.1601, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.90% (0.2765 => 0.3011, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.87% (0.3293 => 0.3585, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.83% (0.3489 => 0.3797, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.82% (0.3107 => 0.3381, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.80% (0.3149 => 0.3426, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.77% (0.3580 => 0.3894, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.77% (0.2966 => 0.3226, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.68% (0.2696 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.63% (0.3756 => 0.4080, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 8.60% (0.2988 => 0.3245, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.60% (13.8202 => 15.0087, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: 8.58% (0.3192 => 0.3466, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.48% (0.6283 => 0.6816, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.34% (0.5577 => 0.6042, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.32% (0.3868 => 0.4190, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.27% (0.4791 => 0.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.24% (0.4016 => 0.4347, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.20% (0.3453 => 0.3736, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.13% (0.7506 => 0.8116, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.10% (1.0313 => 1.1148, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 8.06% (0.3534 => 0.3819, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.05% (0.2995 => 0.3236, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.02% (0.4390 => 0.4742, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.99% (0.4379 => 0.4729, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (7.2180 => 7.7936, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 7.88% (0.2945 => 0.3177, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.79% (3.6692 => 3.9549, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 7.75% (0.8310 => 0.8954, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/18-imp/imp: 7.64% (0.3220 => 0.3466, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.53% (1.1061 => 1.1894, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.48% (13.2842 => 14.2773, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 7.35% (3.8646 => 4.1488, std. dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4113 => 0.4406, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 7.07% (2.1791 => 2.3331, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 7.03% (1.2749 => 1.3645, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.01% (0.8818 => 0.9436, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.97% (0.7460 => 0.7980, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.91% (1.3245 => 1.4160, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.90% (0.3755 => 0.4014, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.90% (1.9270 => 2.0599, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.85% (3.1889 => 3.4074, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: 6.82% (0.6744 => 0.7204, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.78% (1.0594 => 1.1312, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.72% (0.6135 => 0.6547, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.69% (0.8698 => 0.9280, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.68% (1.3819 => 1.4742, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.67% (14.8535 => 15.8449, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.52% (1.3813 => 1.4714, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.3801 => 4.6624, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.41% (4.4433 => 4.7282, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (8.4961 => 9.0300, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 6.22% (16.6129 => 17.6455, std. dev.: 0.0208) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 6.13% (0.3131 => 0.3323, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.13% (1.2292 => 1.3045, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.97% (14.5298 => 15.3979, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.89% (1.1333 => 1.2001, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (6.5754 => 6.9525, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.52% (3.2742 => 3.4549, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.23% (4.6629 => 4.9069, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.6576 => 0.6918, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.10% (16.2614 => 17.0909, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.08% (0.9108 => 0.9571, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.93% (0.6250 => 0.6558, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.85% (0.4805 => 0.5038, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.48% (1.5188 => 1.5869, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.31% (4.9865 => 5.2014, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 4.25% (3.7467 => 3.9058, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.25% (2.1007 => 2.1899, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.87% (0.3511 => 0.3647, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.86% (6.2785 => 6.5210, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 3.36% (33.2944 => 34.4130, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5189, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0514) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (0.2093 => 0.2196, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0733, std. dev.: 0.0264) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6025, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.23% (1.4298 => 1.4474, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std. dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.04% (0.4657 => 0.4003, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.76% (0.2670 => 0.2543, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.48% (22.5627 => 21.7780, std. dev.: 0.0218) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2751, std. dev.: 0.0332) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1508, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6148, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2426, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9932, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5220, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2390, std. dev.: 0.0271) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2270, std. dev.: 0.0117) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 09:27:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 11:27:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907162731.2244C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3529?compare_to=3526&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3529, Order: 163389, Start Time: 2012-09-07 15:09:11, End Time: 2012-09-07 16:28:42 To: 3526, Order: 163385, Start Time: 2012-09-07 13:21:20, End Time: 2012-09-07 14:40:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (141 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.07% (55.0563 => 54.4658, std. dev.: 0.1137) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.23% (10.3673 => 14.1236, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.73% (7.0540 => 8.0223, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.53% (2.2022 => 2.5002, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.29% (1.1194 => 1.2570, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.12% (1.7609 => 1.9744, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-4: 12.08% (0.3543 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.08% (0.3543 => 0.3971, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.91% (0.3121 => 0.3368, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.31% (0.2065 => 0.2216, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.27% (10.4361 => 11.1951, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.23% (0.1438 => 0.1542, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.8172 => 0.8761, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.13% (9.4845 => 10.1604, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.4879 => 0.5225, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.01% (0.6030 => 0.6453, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 6.99% (0.5925 => 0.6339, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.86% (0.7433 => 0.7943, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.2700 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.65% (0.3307 => 0.3527, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4615 => 0.4922, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.55% (0.7115 => 0.7581, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 6.52% (0.7835 => 0.8346, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.47% (0.6675 => 0.7107, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.28% (1.5603 => 1.6583, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.28% (0.5860 => 0.6228, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.23% (8.1363 => 8.6432, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 6.13% (0.3423 => 0.3633, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.11% (0.5105 => 0.5417, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (1.5415 => 1.6357, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.08% (3.3354 => 3.5382, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (4.2646 => 4.5229, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.3050 => 1.3838, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5569 => 0.5902, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.92% (4.9449 => 5.2374, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.91% (5.0018 => 5.2973, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2107 => 0.2231, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.3092 => 0.3271, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.78% (5.7591 => 6.0922, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.2758 => 0.2915, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.8067 => 0.8510, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9765 => 1.0297, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.23% (0.3387 => 0.3564, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.19% (0.4103 => 0.4316, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (14.3668 => 15.1114, std. dev.: 0.0148) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.11% (0.3422 => 0.3597, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.10% (1.1861 => 1.2466, std. dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.07% (0.4636 => 0.4871, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.07% (1.1642 => 1.2232, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.4064 => 0.4265, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.94% (0.5020 => 0.5268, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.90% (1.0722 => 1.1247, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.89% (3.8723 => 4.0618, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6456 => 0.6765, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (7.9617 => 8.3408, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.68% (0.3650 => 0.3821, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.63% (0.3826 => 0.4003, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.61% (2.0273 => 2.1207, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.61% (0.3865 => 0.4043, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.58% (0.2905 => 0.3038, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.57% (0.6450 => 0.6745, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.57% (0.4203 => 0.4395, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2891 => 0.3022, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.52% (0.4289 => 0.4483, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.52% (0.2831 => 0.2959, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (2.0665 => 2.1594, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3817 => 0.3986, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.3098 => 0.3234, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.36% (2.2969 => 2.3970, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 4.35% (0.8921 => 0.9309, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.35% (0.4048 => 0.4224, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.33% (21.9371 => 22.8870, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3162 => 0.3298, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3232 => 0.3370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.26% (0.3283 => 0.3423, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.26% (0.3684 => 0.3841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.25% (0.3603 => 0.3756, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.21% (0.2872 => 0.2993, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.21% (0.2756 => 0.2872, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.20% (0.4620 => 0.4814, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3935 => 0.4099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3052 => 0.3178, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.12% (0.2793 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.07% (0.2877 => 0.2994, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.4186 => 1.4756, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.5981 => 0.6218, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2802 => 0.2913, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.89% (17.1811 => 17.8487, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6464, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3379 => 0.3507, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.2024 => 2.2833, std. dev.: 0.0205) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1840 => 1.2200, std. dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: 2.90% (1.2842 => 1.3215, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.30% (0.8101 => 0.8287, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (4.2280 => 4.3745, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2331, std. dev.: 0.0123) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5828, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7612, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2304, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.08% (5.3855 => 3.8730, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.68% (5.3526 => 3.8709, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0916, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.13% (2.9384 => 2.5819, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -7.74% (22.1758 => 20.4597, std. dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2537, std. dev.: 0.1610) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7169, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0026) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5014, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4116, std. dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.60% (10.2830 => 10.0159, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: -2.17% (1.2373 => 1.2104, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9906, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5533, std. dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -1.85% (2.5528 => 2.5055, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2269, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 09:35:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 11:35:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907163505.633202A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3530?compare_to=3523&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3530, Order: 163387, Start Time: 2012-09-07 13:52:22, End Time: 2012-09-07 16:36:17 To: 3523, Order: 163383, Start Time: 2012-09-07 10:40:23, End Time: 2012-09-07 13:24:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.58% (127.0829 => 131.6311, std. dev.: 0.2469) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.99% (0.3488 => 0.3941, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 12.97% (0.3446 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3465 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3442 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.72% (0.3460 => 0.3900, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5826 => 0.6293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.76% (0.5889 => 0.6346, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.60% (0.1619 => 0.1742, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (1.6211 => 1.7303, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (3.5627 => 3.8012, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.55% (1.3152 => 1.4013, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.44% (0.5900 => 0.6280, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.31% (0.4361 => 0.4636, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.26% (0.7171 => 0.7620, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.25% (1.5932 => 1.6927, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.86% (4.2109 => 4.4577, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.75% (1.0781 => 1.1401, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.74% (0.2875 => 0.3040, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.69% (0.3004 => 0.3175, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 5.60% (0.9909 => 1.0464, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.55% (2.0673 => 2.1821, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2738 => 0.2890, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.55% (0.2813 => 0.2969, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.54% (0.2725 => 0.2876, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (0.5026 => 0.5304, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 5.49% (0.3096 => 0.3266, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.49% (0.4029 => 0.4250, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.43% (0.2780 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.42% (0.2823 => 0.2976, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.40% (0.5000 => 0.5270, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.38% (0.2750 => 0.2898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2803 => 0.2953, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.27% (0.2811 => 0.2959, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2911 => 0.3064, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.23% (0.3267 => 0.3438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3060 => 0.3219, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.15% (0.3124 => 0.3285, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.15% (0.3362 => 0.3535, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.12% (5.5417 => 5.8257, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 5.06% (0.3258 => 0.3423, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.2866 => 0.3011, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 4.97% (0.3317 => 0.3482, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.93% (0.9697 => 1.0175, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.91% (0.3625 => 0.3803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3726 => 0.3908, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3282 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3678 => 0.3855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.80% (0.3477 => 0.3644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.75% (0.3348 => 0.3507, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.73% (0.4146 => 0.4342, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (2.7292 => 2.8553, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (0.4658 => 0.4873, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.57% (2.1013 => 2.1974, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.43% (0.3903 => 0.4076, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.3845 => 0.4014, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.39% (1.9694 => 2.0559, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3690 => 0.3852, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (0.4251 => 0.4437, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 4.30% (0.6634 => 0.6919, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.26% (1.9966 => 2.0817, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.18% (1.4269 => 1.4865, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.17% (0.3981 => 0.4147, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.15% (4.6177 => 4.8093, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 4.14% (1.8794 => 1.9573, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (4.4195 => 4.6026, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (2.1653 => 2.2530, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 4.05% (23.5202 => 24.4728, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/bigfib: 3.99% (0.5012 => 0.5212, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.4139 => 0.4304, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.85% (0.7875 => 0.8178, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.2969 => 0.3077, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.6435 => 0.6669, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.61% (0.3792 => 0.3929, std. dev.: 0.0051) MultiSource/Applications/Burg/burg: 3.61% (0.5546 => 0.5746, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.83% (2.0346 => 2.0922, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.52% (0.4847 => 0.4969, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (0.5361 => 0.5478, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (0.7426 => 0.7586, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (0.5584 => 0.5688, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.42% (11.6398 => 11.8048, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.15% (4.6926 => 4.7464, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 5.16% (1.8057 => 1.8989, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6660, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1656, std. dev.: 0.0287) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6426, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1936, std. dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5054, std. dev.: 0.0249) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4561, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5999, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4404, std. dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5736, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7885, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0063) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7757, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8437, std. dev.: 0.0602) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9719, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 10:10:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 12:10:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907171051.02A362A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3531?compare_to=3527&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3531, Order: 163390, Start Time: 2012-09-07 16:01:16, End Time: 2012-09-07 17:12:04 To: 3527, Order: 163389, Start Time: 2012-09-07 14:34:41, End Time: 2012-09-07 15:45:29 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (51 on baseline) Performance Improvements: 1 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.5884 => 0.6006, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (3.0747 => 3.1145, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.40% (0.0486 => 0.0590, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.52% (3.0591 => 3.3197, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (3.7425 => 3.8803, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.52% (0.2898 => 0.3000, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/mason/mason: 2.23% (0.4890 => 0.4999, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.78% (2.6893 => 2.7371, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 1.35% (8.8273 => 8.9469, std. dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.91% (22.6328 => 21.5225, std. dev.: 0.3174) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.87% (0.6410 => 0.6722, std. dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 4.10% (1.1653 => 1.2131, std. dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (2.1763 => 2.2621, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 3.42% (1.0046 => 1.0390, std. dev.: 0.0095) MultiSource/Applications/minisat/minisat: 3.16% (0.6173 => 0.6368, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.64% (0.5937 => 0.6094, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5740 => 0.5864, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.79% (3.0225 => 3.0765, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.7639 => 0.7763, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.61% (13.3238 => 13.5377, std. dev.: 0.0498) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.26% (3.0758 => 3.1145, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.25% (2.0972 => 2.1234, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (8.2186 => 8.3173, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.17% (29.3170 => 29.6610, std. dev.: 0.1065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.73% (0.0263 => 0.0378, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2293, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.45% (0.0766 => 0.0892, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: 14.78% (1.7426 => 2.0001, std. dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.72% (4.0101 => 4.5604, std. dev.: 0.0130) SingleSource/Benchmarks/McGill/misr: 13.57% (0.4296 => 0.4879, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8803, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.36% (0.2694 => 0.3000, std. dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 10.96% (0.1433 => 0.1590, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.72% (3.0256 => 3.3197, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6341, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 8.15% (1.0194 => 1.1025, std. dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.77% (1.0063 => 1.0845, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3301 => 0.3504, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8132, std. dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (3.4876 => 3.6974, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: 4.38% (15.2242 => 15.8912, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8742, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 3.00% (5.1938 => 5.3495, std. dev.: 0.0264) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7577, std. dev.: 0.0198) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.68% (2.6656 => 2.7371, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.25% (4.6127 => 4.7166, std. dev.: 0.0059) MultiSource/Applications/siod/siod: 1.63% (3.5520 => 3.6099, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.63% (29.5232 => 30.0043, std. dev.: 0.0503) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4845, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5310, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6714, std. dev.: 0.0237) MultiSource/Benchmarks/Bullet/bullet: 1.13% (6.9722 => 7.0507, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/whetstone: 1.01% (2.3453 => 2.3689, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.47% (0.7738 => 0.7624, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.44% (5.2665 => 4.1899, std. dev.: 0.0474) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.49% (1.1647 => 0.9843, std. dev.: 0.0313) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.82% (3.2007 => 2.9505, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3655, std. dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: -6.87% (3.4230 => 3.1879, std. dev.: 0.0617) MultiSource/Benchmarks/FreeBench/distray/distray: -6.64% (0.2664 => 0.2487, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -6.35% (1.4441 => 1.3524, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4074, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7629, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.33% (45.4683 => 43.9545, std. dev.: 0.3918) SingleSource/Benchmarks/Shootout-C++/methcall: -3.28% (9.2503 => 8.9469, std. dev.: 0.0216) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.23% (1.7361 => 1.6800, std. dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.19% (3.7496 => 3.6301, std. dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.17% (2.4457 => 2.3681, std. dev.: 0.0281) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.14% (1.2959 => 1.2552, std. dev.: 0.0127) MultiSource/Applications/aha/aha: -2.79% (3.4286 => 3.3329, std. dev.: 0.0208) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.71% (0.4140 => 0.4028, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2915, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.64% (1.1683 => 1.1375, std. dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (92.7467 => 90.5751, std. dev.: 0.3845) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.22% (61.1734 => 59.8163, std. dev.: 0.5241) MultiSource/Benchmarks/mafft/pairlocalalign: -1.97% (62.4126 => 61.1861, std. dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2433, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: -1.47% (3.8200 => 3.7637, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3160, std. dev.: 0.0124) MultiSource/Benchmarks/sim/sim: -1.34% (3.8907 => 3.8384, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: -1.28% (1.7330 => 1.7108, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.16% (1.8739 => 1.8521, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 11:00:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 13:00:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907180033.DC81C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3532?compare_to=3528&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3532, Order: 163390, Start Time: 2012-09-07 16:47:08, End Time: 2012-09-07 18:01:45 To: 3528, Order: 163389, Start Time: 2012-09-07 15:04:12, End Time: 2012-09-07 16:18:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.22% (2.0176 => 2.4054, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.74% (1.3693 => 1.5164, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.47% (0.5818 => 0.6427, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.96% (0.7710 => 0.8478, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.95% (0.1588 => 0.1746, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.91% (0.7061 => 0.7761, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.88% (3.9660 => 4.3577, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.51% (0.2596 => 0.2843, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 9.36% (0.7038 => 0.7697, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.33% (0.5265 => 0.5756, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 9.20% (0.4328 => 0.4726, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.14% (0.6959 => 0.7595, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 9.00% (0.3578 => 0.3900, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.99% (1.2193 => 1.3289, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.98% (0.9199 => 1.0025, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.78% (1.4563 => 1.5842, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.63% (0.3789 => 0.4116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.57% (0.3899 => 0.4233, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.54% (0.4062 => 0.4409, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.52% (0.2782 => 0.3019, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.50% (0.3022 => 0.3279, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.41% (1.1364 => 1.2320, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2607 => 0.2823, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.26% (0.3485 => 0.3773, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.23% (0.3293 => 0.3564, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.21% (0.2655 => 0.2873, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.15% (0.2761 => 0.2986, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2760 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2690 => 0.2908, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9385, std. dev.: 0.0145) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.07% (0.3580 => 0.3869, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.2937 => 0.3174, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.07% (0.6283 => 0.6790, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.07% (0.5577 => 0.6027, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.07% (0.3756 => 0.4059, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.06% (1.9828 => 2.1426, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 8.03% (0.2726 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.03% (0.3489 => 0.3769, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.99% (0.2966 => 0.3203, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.96% (0.2765 => 0.2985, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.3107 => 0.3353, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.90% (0.4379 => 0.4725, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.90% (0.2127 => 0.2295, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.83% (0.4791 => 0.5166, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.81% (1.0313 => 1.1118, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.2914 => 0.3141, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.79% (0.2696 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.75% (0.3149 => 0.3393, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.71% (0.3192 => 0.3438, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (7.2180 => 7.7717, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 7.66% (0.2988 => 0.3217, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.59% (0.7506 => 0.8076, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.58% (0.2995 => 0.3222, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.57% (0.4016 => 0.4320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.42% (0.3868 => 0.4155, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.38% (1.1061 => 1.1877, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3534 => 0.3794, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.35% (0.2925 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.33% (0.3453 => 0.3706, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.32% (0.8310 => 0.8918, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4390 => 0.4711, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.31% (0.5637 => 0.6049, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.24% (3.6692 => 3.9350, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.19% (13.2842 => 14.2398, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 7.16% (3.8646 => 4.1414, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.89% (0.2945 => 0.3148, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.76% (0.4113 => 0.4391, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.75% (2.1791 => 2.3262, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.63% (1.3245 => 1.4123, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 6.61% (1.9270 => 2.0544, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (1.2749 => 1.3581, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3970, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (1.3819 => 1.4708, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.41% (0.6744 => 0.7176, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.36% (1.3813 => 1.4691, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.31% (1.0594 => 1.1262, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.26% (0.6135 => 0.6519, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.23% (0.8818 => 0.9367, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.22% (14.8535 => 15.7770, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.17% (0.8698 => 0.9235, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.14% (4.3801 => 4.6490, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3755 => 0.3984, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.08% (16.6129 => 17.6224, std. dev.: 0.0167) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.99% (4.4433 => 4.7096, std. dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 5.91% (0.3131 => 0.3316, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.88% (8.4961 => 8.9960, std. dev.: 0.0146) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.84% (0.2140 => 0.2265, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.59% (14.5298 => 15.3425, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1333 => 1.1964, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.48% (1.2292 => 1.2965, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.25% (6.5754 => 6.9207, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.11% (3.2742 => 3.4415, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.82% (16.2614 => 17.0447, std. dev.: 0.0168) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.71% (0.9108 => 0.9537, std. dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 4.67% (4.6629 => 4.8808, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.62% (0.4805 => 0.5027, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.6576 => 0.6868, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (1.5188 => 1.5846, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.6250 => 0.6517, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.11% (2.1007 => 2.1870, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3511 => 0.3655, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1864, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 3.94% (3.7467 => 3.8944, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (6.2785 => 6.4955, std. dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: 2.98% (33.2944 => 34.2878, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.43% (5.7573 => 7.5092, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std. dev.: 0.0516) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.53% (1.1560 => 1.2546, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.35% (0.2093 => 0.2226, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0804, std. dev.: 0.0383) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (0.5184 => 0.5333, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5891, std. dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5856, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.02% (7.9275 => 8.0080, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.62% (0.4657 => 0.3976, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.91% (0.2670 => 0.2539, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.72% (22.5627 => 21.7224, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.36% (20.3410 => 18.2331, std. dev.: 0.0302) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2940, std. dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.70% (3.2729 => 3.1517, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.34% (3.0263 => 2.9252, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5880, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2461, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.62% (4.5928 => 4.5186, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2434, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2325, std. dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.08% (1.0310 => 1.0199, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 11:16:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 13:16:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907181602.2E35B2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3533?compare_to=3529&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3533, Order: 163394, Start Time: 2012-09-07 16:57:30, End Time: 2012-09-07 18:17:13 To: 3529, Order: 163389, Start Time: 2012-09-07 15:09:11, End Time: 2012-09-07 16:28:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (140 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.93% (54.4658 => 56.6064, std. dev.: 0.0584) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (77.8558 => 79.5791, std. dev.: 0.5654) MultiSource/Benchmarks/llubenchmark/llu: 1.47% (3.7824 => 3.8381, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.77% (10.3673 => 14.1795, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 26.63% (0.1622 => 0.2054, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.90% (2.2022 => 2.5082, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.85% (7.0540 => 8.0312, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2576, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (1.7609 => 1.9737, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.45% (10.4361 => 11.2137, std. dev.: 0.0166) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5925 => 0.6360, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.31% (0.6030 => 0.6471, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.31% (0.2065 => 0.2216, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.21% (9.4845 => 10.1680, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.8172 => 0.8741, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 6.81% (0.2554 => 0.2728, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7433 => 0.7937, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.68% (0.3307 => 0.3528, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.65% (0.7115 => 0.7588, std. dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 6.36% (0.7326 => 0.7792, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.6675 => 0.7097, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.30% (8.1363 => 8.6490, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.21% (0.5105 => 0.5422, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.15% (1.5603 => 1.6562, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5860 => 0.6219, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.09% (3.3354 => 3.5384, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.3050 => 1.3833, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (4.2646 => 4.5196, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 5.93% (0.7835 => 0.8300, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.89% (0.5569 => 0.5897, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2107 => 0.2231, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.86% (4.9449 => 5.2349, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.5415 => 1.6319, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.83% (5.0018 => 5.2933, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 5.79% (5.7591 => 6.0925, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.8067 => 0.8517, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.44% (0.2758 => 0.2908, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9765 => 1.0289, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.34% (0.4103 => 0.4322, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (14.3668 => 15.1232, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3422 => 0.3602, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.21% (0.4299 => 0.4523, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.11% (0.4636 => 0.4873, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1861 => 1.2463, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 5.06% (1.1642 => 1.2231, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.97% (0.3441 => 0.3612, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 4.89% (3.8723 => 4.0616, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.85% (0.2905 => 0.3046, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.85% (1.0722 => 1.1242, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.84% (0.3865 => 0.4052, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.4289 => 0.4493, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.3136 => 0.3285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.74% (0.6456 => 0.6762, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.71% (0.3650 => 0.3822, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (7.9617 => 8.3331, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3826 => 0.4004, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (2.0665 => 2.1619, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.57% (0.6450 => 0.6745, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 4.56% (0.2871 => 0.3002, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.52% (0.3052 => 0.3190, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.52% (2.0273 => 2.1189, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (0.3935 => 0.4112, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.49% (0.2831 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.48% (0.3684 => 0.3849, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.46% (0.2756 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.4048 => 0.4228, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.43% (0.3162 => 0.3302, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3098 => 0.3235, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.42% (0.2872 => 0.2999, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.42% (0.2714 => 0.2834, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.3232 => 0.3374, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2877 => 0.3003, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4203 => 0.4387, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3817 => 0.3984, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9371 => 22.8882, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 4.33% (0.3603 => 0.3759, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4620 => 0.4817, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8921 => 0.9300, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 4.23% (0.3283 => 0.3422, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.22% (0.2793 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.18% (0.2802 => 0.2919, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.11% (0.3379 => 0.3518, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.09% (2.2969 => 2.3909, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.96% (17.1811 => 17.8616, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6463, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (1.4186 => 1.4725, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.44% (2.2024 => 2.2782, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 2.94% (1.2842 => 1.3219, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.1840 => 1.2182, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.8101 => 0.8275, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (4.2280 => 4.3675, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7475, std. dev.: 0.0079) MultiSource/Benchmarks/llubenchmark/llu: 1.59% (3.7781 => 3.8381, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2187, std. dev.: 0.0179) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7608, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2294, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.04% (5.3855 => 3.8752, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.70% (5.3526 => 3.8698, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0923, std. dev.: 0.0769) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.19% (2.9384 => 2.5801, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -7.84% (22.1758 => 20.4363, std. dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.44% (1.5373 => 1.3768, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2688, std. dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.12% (1.6805 => 1.5776, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std. dev.: 0.0019) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5088, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4169, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9970, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.22% (1.2373 => 1.2098, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9834, std. dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: -1.99% (4.6441 => 4.5518, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5066, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 11:37:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 13:37:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907183755.D4AD62A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3534?compare_to=3531&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3534, Order: 163394, Start Time: 2012-09-07 17:27:33, End Time: 2012-09-07 18:39:09 To: 3531, Order: 163390, Start Time: 2012-09-07 16:01:16, End Time: 2012-09-07 17:12:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (49 on baseline) Performance Improvements: 4 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5496 => 1.5673, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 7.60% (3.0334 => 3.2640, std. dev.: 0.0621) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.77% (21.5225 => 22.3333, std. dev.: 0.2120) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.20% (1.2552 => 1.2954, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: 1.75% (1.3524 => 1.3760, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ffbench: 1.60% (1.3979 => 1.4202, std. dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.51% (7.0507 => 7.1571, std. dev.: 0.0295) SingleSource/Benchmarks/Misc/ReedSolomon: 1.15% (8.7577 => 8.8587, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.30% (0.4690 => 0.4535, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.78% (3.1145 => 3.0592, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.41% (0.0590 => 0.0446, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: -12.06% (23.1765 => 20.3812, std. dev.: 0.3332) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.14% (0.1414 => 0.1515, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 4.86% (2.1763 => 2.2820, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.71% (0.6410 => 0.6712, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.67% (1.1653 => 1.2081, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.5150 => 1.5673, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.13% (0.3582 => 0.3694, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.00% (0.6173 => 0.6358, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (12.6413 => 13.0093, std. dev.: 0.0766) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.7639 => 0.7763, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (6.2546 => 6.3489, std. dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: 1.47% (29.3170 => 29.7485, std. dev.: 0.1292) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.2559 => 8.3615, std. dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (1.3935 => 1.4094, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.53% (1.6538 => 2.3406, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9975, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: 14.13% (0.4296 => 0.4903, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.03% (4.0101 => 4.5728, std. dev.: 0.1158) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.58% (0.0766 => 0.0870, std. dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 12.00% (0.1433 => 0.1605, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.56% (0.0917 => 0.1023, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 11.08% (0.3746 => 0.4161, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 11.02% (3.4406 => 3.8197, std. dev.: 0.0361) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.66% (7.0025 => 7.6092, std. dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.48% (1.0063 => 1.0916, std. dev.: 0.0284) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.20% (0.2694 => 0.2915, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.33% (4.2129 => 4.5215, std. dev.: 0.0676) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.79% (0.3301 => 0.3525, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (3.4876 => 3.7035, std. dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8037, std. dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.13% (40.4792 => 42.1524, std. dev.: 0.3581) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 4.08% (8.5113 => 8.8587, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: 3.98% (15.2242 => 15.8298, std. dev.: 0.0681) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.69% (3.4080 => 3.5339, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 3.34% (1.4184 => 1.4658, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 2.95% (5.1938 => 5.3471, std. dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 2.65% (6.9722 => 7.1571, std. dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.26% (0.5876 => 0.6009, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 2.02% (29.5232 => 30.1209, std. dev.: 0.0680) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (2.4455 => 2.4882, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.56% (4.6127 => 4.6846, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5324, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6698, std. dev.: 0.0285) MultiSource/Applications/siod/siod: 1.18% (3.5520 => 3.5940, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: 1.03% (2.4013 => 2.4261, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.55% (0.3497 => 0.2079, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.65% (5.2665 => 4.1263, std. dev.: 0.0268) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.83% (1.1647 => 0.9920, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1643, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.56% (1.4034 => 1.2832, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.35% (3.2007 => 2.9654, std. dev.: 0.0562) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3640, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7929, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.72% (3.4230 => 3.2271, std. dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4054, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -4.72% (1.4441 => 1.3760, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.15% (2.4457 => 2.3441, std. dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/methcall: -3.53% (9.2503 => 8.9239, std. dev.: 0.0127) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2309, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.24% (1.7361 => 1.6798, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.05% (1.1683 => 1.1327, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -2.80% (9.5474 => 9.2797, std. dev.: 0.0230) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -2.76% (3.4286 => 3.3341, std. dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -2.35% (62.4126 => 60.9437, std. dev.: 0.2444) MultiSource/Benchmarks/PAQ8p/paq8p: -2.33% (92.7467 => 90.5897, std. dev.: 0.4781) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.23% (3.7496 => 3.6659, std. dev.: 0.0183) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.72% (2.8964 => 2.8466, std. dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2426, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: -1.50% (3.8200 => 3.7627, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -1.35% (1.7330 => 1.7096, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3251, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 12:43:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 14:43:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907194332.225B72A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3535?compare_to=3532&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3535, Order: 163397, Start Time: 2012-09-07 18:30:00, End Time: 2012-09-07 19:44:42 To: 3532, Order: 163390, Start Time: 2012-09-07 16:47:08, End Time: 2012-09-07 18:01:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (79.6279 => 80.9355, std. dev.: 0.1739) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.60% (2.0176 => 2.4131, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.73% (0.5818 => 0.6442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.58% (0.5748 => 0.6356, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.41% (0.7061 => 0.7796, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.14% (0.7710 => 0.8492, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.01% (3.9660 => 4.3629, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.98% (1.3693 => 1.5059, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.39% (0.7038 => 0.7699, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.25% (0.5265 => 0.5752, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.22% (0.9199 => 1.0047, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.17% (1.2193 => 1.3311, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.2721 => 0.2967, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.87% (0.6959 => 0.7576, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.69% (1.1364 => 1.2351, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.58% (1.4563 => 1.5812, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.26% (13.8202 => 14.9622, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.18% (0.5577 => 0.6033, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.05% (0.2782 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3246 => 0.3506, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.98% (0.2995 => 0.3234, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.93% (0.6283 => 0.6781, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.86% (1.0313 => 1.1124, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.81% (7.2180 => 7.7815, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.2914 => 0.3141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 7.69% (0.7506 => 0.8083, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.67% (0.2607 => 0.2807, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.66% (0.4791 => 0.5158, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3293 => 0.3541, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: 7.52% (0.8310 => 0.8935, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.49% (3.6692 => 3.9439, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.48% (0.3756 => 0.4037, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.47% (0.2690 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.46% (0.2760 => 0.2966, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.45% (0.5637 => 0.6057, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (1.9828 => 2.1301, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2761 => 0.2965, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.33% (1.1061 => 1.1872, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.3220 => 0.3454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.21% (3.8646 => 4.1433, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.19% (13.2842 => 14.2393, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std. dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.92% (0.3192 => 0.3413, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.83% (0.4113 => 0.4394, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.80% (1.3245 => 1.4145, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4390 => 0.4688, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.7460 => 0.7963, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 6.74% (2.1791 => 2.3259, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.66% (3.1889 => 3.4013, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 6.66% (1.9270 => 2.0553, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 6.63% (1.2749 => 1.3594, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.59% (0.8818 => 0.9399, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: 6.54% (0.6744 => 0.7185, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.43% (14.8535 => 15.8093, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 6.36% (1.0594 => 1.1268, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.34% (0.6135 => 0.6524, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.3801 => 4.6554, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: 6.26% (0.2859 => 0.3038, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (1.3813 => 1.4675, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.23% (4.4433 => 4.7199, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (1.3819 => 1.4678, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2504 => 0.2659, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.11% (8.4961 => 9.0149, std. dev.: 0.0112) MultiSource/Benchmarks/sim/sim: 6.10% (0.3131 => 0.3322, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.97% (16.6129 => 17.6051, std. dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (1.1333 => 1.1994, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.8698 => 0.9205, std. dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: 5.70% (14.5298 => 15.3577, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.47% (6.5754 => 6.9352, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.47% (0.2321 => 0.2448, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.19% (3.2742 => 3.4442, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.02% (0.6576 => 0.6906, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.98% (4.6629 => 4.8950, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2895, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.86% (16.2614 => 17.0509, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.82% (0.9108 => 0.9547, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.4805 => 0.5028, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (1.5188 => 1.5845, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.05% (2.1007 => 2.1857, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.02% (0.3511 => 0.3652, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.00% (3.7467 => 3.8964, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6250 => 0.6495, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (4.9865 => 5.1803, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (6.2785 => 6.5059, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 2.74% (33.2944 => 34.2074, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std. dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (3.1736 => 3.4173, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5493, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1023, std. dev.: 0.0465) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.5184 => 0.5328, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5917, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5717, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.64% (0.4657 => 0.3975, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.68% (0.2670 => 0.2545, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.66% (22.5627 => 21.7366, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2638, std. dev.: 0.0150) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.34% (1.3780 => 1.3044, std. dev.: 0.0106) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1506, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7057, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9226, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5860, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9919, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.60% (4.5928 => 4.5194, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2289, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4349, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2416, std. dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 12:47:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 14:47:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907194700.4C7662A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3536?compare_to=3530&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3536, Order: 163394, Start Time: 2012-09-07 17:04:17, End Time: 2012-09-07 19:48:11 To: 3530, Order: 163387, Start Time: 2012-09-07 13:52:22, End Time: 2012-09-07 16:36:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.2085 => 0.2227, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.57% (1.3472 => 1.3683, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (54.1581 => 54.7869, std. dev.: 0.0498) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3442 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.99% (0.3465 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.84% (0.3496 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3460 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.27% (0.3650 => 0.4098, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.16% (0.3724 => 0.4177, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 7.79% (0.5826 => 0.6280, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.5889 => 0.6331, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.1619 => 0.1738, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.64% (1.6211 => 1.7287, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.61% (0.1968 => 0.2098, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (3.5627 => 3.7917, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.2014 => 0.2140, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (0.4361 => 0.4629, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.14% (1.5932 => 1.6911, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.14% (1.3152 => 1.3959, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.05% (0.2875 => 0.3049, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 6.03% (0.4029 => 0.4272, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7171 => 0.7601, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.5900 => 0.6238, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 5.72% (0.9909 => 1.0476, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 5.72% (4.2109 => 4.4517, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (0.3930 => 0.4151, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.61% (0.9697 => 1.0241, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2738 => 0.2891, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (0.4994 => 0.5272, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (0.5026 => 0.5304, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3195 => 0.3371, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.49% (0.2803 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.2823 => 0.2978, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.47% (0.2725 => 0.2874, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.46% (0.3004 => 0.3168, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 5.45% (0.2750 => 0.2900, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.40% (0.2780 => 0.2930, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (2.0673 => 2.1786, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.38% (1.0781 => 1.1361, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.37% (0.2792 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.37% (0.2811 => 0.2962, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.37% (0.2813 => 0.2964, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.35% (0.2729 => 0.2875, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2911 => 0.3065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.23% (0.3096 => 0.3258, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.15% (0.3362 => 0.3535, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3267 => 0.3435, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.10% (0.3258 => 0.3424, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.07% (0.3060 => 0.3215, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.2866 => 0.3011, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.00% (0.3317 => 0.3483, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.99% (0.3124 => 0.3280, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.97% (0.2736 => 0.2872, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.95% (5.5417 => 5.8159, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/moments: 4.84% (0.3678 => 0.3856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (0.4658 => 0.4881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3726 => 0.3903, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3477 => 0.3642, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.72% (0.3282 => 0.3437, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.3348 => 0.3506, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3625 => 0.3795, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.68% (0.2566 => 0.2686, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (0.3890 => 0.4071, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.56% (0.4146 => 0.4335, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (2.7292 => 2.8522, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.50% (1.8794 => 1.9639, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (0.4251 => 0.4437, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.37% (0.3271 => 0.3414, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (1.9694 => 2.0525, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (2.1013 => 2.1899, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (1.9966 => 2.0807, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.3845 => 0.4004, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 4.08% (1.4269 => 1.4851, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 4.07% (0.6634 => 0.6904, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.3981 => 0.4143, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (0.2691 => 0.2799, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.01% (23.5202 => 24.4629, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 4.00% (2.1653 => 2.2519, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (4.4195 => 4.5959, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.5012 => 0.5211, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.95% (4.6177 => 4.8000, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.4139 => 0.4302, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.90% (0.7875 => 0.8182, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.73% (0.3084 => 0.3199, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.69% (0.3336 => 0.3459, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.61% (0.3792 => 0.3929, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.52% (0.5546 => 0.5741, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.6435 => 0.6661, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.66% (2.0346 => 2.0888, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (0.4847 => 0.4962, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (0.5361 => 0.5472, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (0.7426 => 0.7566, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (11.6398 => 11.7817, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1719, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6396, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2004, std. dev.: 0.0568) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5054, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4517, std. dev.: 0.0210) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5154, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5880, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5508, std. dev.: 0.0234) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8072, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8057, std. dev.: 0.0039) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.32% (0.6293 => 0.6147, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -1.99% (17.2379 => 16.8954, std. dev.: 0.0463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.46% (16.2163 => 15.9791, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 13:03:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 15:03:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907200350.835332A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3537?compare_to=3533&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3537, Order: 163397, Start Time: 2012-09-07 18:45:27, End Time: 2012-09-07 20:05:02 To: 3533, Order: 163394, Start Time: 2012-09-07 16:57:30, End Time: 2012-09-07 18:17:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (137 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (712 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.35% (79.5791 => 80.6562, std. dev.: 0.1842) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.01% (2.3258 => 2.3024, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.84% (10.3673 => 14.0827, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: 27.99% (0.1622 => 0.2076, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.55% (2.2022 => 2.5005, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.26% (7.0540 => 7.9894, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.61% (0.3561 => 0.4010, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.37% (1.1194 => 1.2579, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3828 => 0.4281, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3927 => 0.4387, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.65% (1.7609 => 1.9661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.50% (0.3282 => 0.3561, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.4879 => 0.5229, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.8172 => 0.8747, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 7.03% (9.4845 => 10.1513, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5925 => 0.6340, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.72% (10.4361 => 11.1371, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7433 => 0.7919, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.37% (0.5105 => 0.5430, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (8.1363 => 8.6482, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.10% (0.6675 => 0.7082, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 6.08% (0.3423 => 0.3631, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.5860 => 0.6214, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (0.3121 => 0.3308, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.98% (0.7326 => 0.7764, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (4.2646 => 4.5193, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.92% (1.5415 => 1.6327, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.91% (3.3354 => 3.5325, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 5.90% (1.5603 => 1.6524, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.3050 => 1.3819, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.88% (0.7835 => 0.8296, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.85% (4.9449 => 5.2342, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.78% (0.5569 => 0.5891, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (5.0018 => 5.2908, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.66% (0.3092 => 0.3267, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 5.50% (5.7591 => 6.0761, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.43% (0.8067 => 0.8505, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9765 => 1.0285, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.25% (0.3180 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.19% (14.3668 => 15.1122, std. dev.: 0.0146) MultiSource/Benchmarks/McCat/05-eks/eks: 5.14% (0.4299 => 0.4520, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.06% (1.1642 => 1.2231, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.95% (1.1861 => 1.2448, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.84% (0.3387 => 0.3551, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.82% (3.8723 => 4.0588, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.80% (0.5020 => 0.5261, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (7.9617 => 8.3404, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.72% (0.3817 => 0.3997, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.70% (0.4636 => 0.4854, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.63% (0.4103 => 0.4293, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3422 => 0.3580, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.62% (1.0722 => 1.1217, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.45% (0.6456 => 0.6743, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.40% (2.0273 => 2.1165, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.31% (0.6450 => 0.6728, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.26% (21.9371 => 22.8713, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/football/football: 4.13% (0.8921 => 0.9289, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 4.12% (2.2969 => 2.3916, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash: 4.06% (0.4289 => 0.4463, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3865 => 0.4021, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3826 => 0.3978, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.4048 => 0.4207, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5981 => 0.6214, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.89% (0.3136 => 0.3258, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.83% (0.4620 => 0.4797, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4203 => 0.4364, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.81% (2.0665 => 2.1453, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (0.3935 => 0.4085, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.4186 => 1.4719, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.72% (0.3684 => 0.3821, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2872 => 0.2978, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.68% (17.1811 => 17.8140, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2871 => 0.2976, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (1.5859 => 1.6430, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (2.2024 => 2.2763, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3379 => 0.3489, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2178, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.37% (1.2842 => 1.3146, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.8101 => 0.8267, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3827, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (4.2280 => 4.3691, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2630, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.11% (2.2771 => 2.3024, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5790, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2356, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.15% (5.3855 => 3.8697, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.78% (5.3526 => 3.8657, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1558, std. dev.: 0.0348) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.78% (2.9384 => 2.5923, std. dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: -7.80% (22.1758 => 20.4464, std. dev.: 0.0227) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (19.9488 => 18.2311, std. dev.: 0.0419) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7161, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.12% (1.6805 => 1.5776, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1498, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5056, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4132, std. dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0121, std. dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: -2.31% (1.2373 => 1.2087, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: -1.91% (4.6441 => 4.5553, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0069, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 13:04:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 15:04:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907200441.61D942A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3538?compare_to=3534&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3538, Order: 163401, Start Time: 2012-09-07 18:54:41, End Time: 2012-09-07 20:05:53 To: 3534, Order: 163394, Start Time: 2012-09-07 17:27:33, End Time: 2012-09-07 18:39:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (45 on baseline) Performance Improvements: 2 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (814 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 2.13% (1.2081 => 1.2338, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.44% (1.1687 => 1.1855, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.4129 => 1.4326, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 34.08% (0.0446 => 0.0598, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/distray/distray: 4.17% (0.2492 => 0.2596, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.53% (43.0889 => 44.6082, std. dev.: 0.2201) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.45% (2.6770 => 2.7159, std. dev.: 0.0134) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.38% (1.2650 => 1.2825, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.02% (1.5673 => 1.5513, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -1.08% (8.8587 => 8.7628, std. dev.: 0.0359) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (1.1653 => 1.2338, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.6410 => 0.6743, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (2.1763 => 2.2693, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.69% (0.3582 => 0.3714, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 3.47% (1.0046 => 1.0395, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 3.35% (0.6173 => 0.6380, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (12.6413 => 12.9748, std. dev.: 0.0891) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5150 => 1.5513, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.7639 => 0.7786, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.61% (14.6079 => 14.8426, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.57% (1.1672 => 1.1855, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.44% (1.2021 => 1.2194, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.21% (1.3935 => 1.4103, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 14.69% (1.7426 => 1.9986, std. dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.54% (4.0101 => 4.5530, std. dev.: 0.0280) SingleSource/Benchmarks/McGill/misr: 13.29% (0.4296 => 0.4867, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.65% (0.2694 => 0.2954, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6078, std. dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.20% (1.0063 => 1.0788, std. dev.: 0.0199) SingleSource/Benchmarks/McGill/chomp: 7.14% (1.0194 => 1.0922, std. dev.: 0.0201) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.76% (0.2857 => 0.3050, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8076, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (3.4876 => 3.6950, std. dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.3301 => 0.3484, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/dt: 4.37% (0.9851 => 1.0281, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.17% (15.2242 => 15.8589, std. dev.: 0.0287) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5420, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 2.95% (8.5113 => 8.7628, std. dev.: 0.0359) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.53% (4.6127 => 4.7296, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/five11/five11: 1.98% (5.1938 => 5.2968, std. dev.: 0.0159) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.89% (2.6656 => 2.7159, std. dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.86% (0.5876 => 0.5985, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4455 => 2.4830, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5348, std. dev.: 0.0082) MultiSource/Applications/siod/siod: 1.42% (3.5520 => 3.6026, std. dev.: 0.0168) MultiSource/Benchmarks/Olden/bh/bh: 1.40% (2.5166 => 2.5518, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 1.31% (14.4877 => 14.6782, std. dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.04% (5.2665 => 4.1058, std. dev.: 0.1128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.06% (1.1647 => 0.9893, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1617, std. dev.: 0.1189) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.21% (1.4034 => 1.2882, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.95% (3.2007 => 2.9463, std. dev.: 0.0245) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.10% (3.6254 => 3.3679, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -6.57% (3.4230 => 3.1982, std. dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: -4.72% (1.4441 => 1.3759, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0556) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.13% (0.4140 => 0.3969, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.15% (3.7496 => 3.6315, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/methcall: -3.04% (9.2503 => 8.9695, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.02% (1.7361 => 1.6836, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.01% (1.1683 => 1.1331, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std. dev.: 0.0069) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3363, std. dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -2.62% (92.7467 => 90.3210, std. dev.: 0.3962) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.33% (2.8964 => 2.8288, std. dev.: 0.0218) MultiSource/Benchmarks/mafft/pairlocalalign: -2.29% (62.4126 => 60.9832, std. dev.: 0.2434) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.99% (0.6119 => 0.5997, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.89% (45.4683 => 44.6082, std. dev.: 0.2201) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2263, std. dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3174, std. dev.: 0.1263) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7690, std. dev.: 0.0188) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.3569 => 2.3260, std. dev.: 0.0092) MultiSource/Benchmarks/sim/sim: -1.18% (3.8907 => 3.8449, std. dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 14:26:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 16:26:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907212617.8723C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3539?compare_to=3535&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3539, Order: 163407, Start Time: 2012-09-07 20:13:02, End Time: 2012-09-07 21:27:28 To: 3535, Order: 163397, Start Time: 2012-09-07 18:30:00, End Time: 2012-09-07 19:44:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 3 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 965 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.70% (28.8867 => 29.6652, std. dev.: 0.0243) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.2159 => 1.2311, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.08% (80.9355 => 78.4461, std. dev.: 0.8994) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.79% (1.3249 => 1.3012, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.05% (1.5144 => 1.4985, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.85% (2.0176 => 2.4181, std. dev.: 0.0125) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.91% (0.5818 => 0.6453, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.72% (0.5748 => 0.6364, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.31% (0.7061 => 0.7789, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.84% (3.9660 => 4.3562, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.74% (1.3693 => 1.5027, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.66% (0.7710 => 0.8455, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.28% (0.2596 => 0.2837, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.27% (0.1327 => 0.1450, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.24% (0.7038 => 0.7688, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.11% (1.2193 => 1.3304, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.08% (0.2721 => 0.2968, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.02% (0.9199 => 1.0029, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.02% (0.5265 => 0.5740, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.71% (0.6959 => 0.7565, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.57% (1.1364 => 1.2338, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.46% (1.4563 => 1.5795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3578 => 0.3880, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.22% (0.3601 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.09% (0.3623 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.08% (0.3650 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.01% (13.8202 => 14.9269, std. dev.: 0.0202) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.98% (0.5577 => 0.6022, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.94% (0.1435 => 0.1549, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.6283 => 0.6779, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.86% (0.3246 => 0.3501, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.80% (1.0313 => 1.1117, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.76% (0.4791 => 0.5163, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4379 => 0.4718, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.68% (0.3022 => 0.3254, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.65% (0.2914 => 0.3137, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.65% (0.2995 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.57% (7.2180 => 7.7643, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 7.57% (0.7506 => 0.8074, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3293 => 0.3541, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.46% (0.3580 => 0.3847, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.45% (0.3489 => 0.3749, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.42% (0.8310 => 0.8927, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.35% (0.3756 => 0.4032, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.4390 => 0.4712, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.32% (13.2842 => 14.2565, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.24% (0.2761 => 0.2961, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.23% (3.6692 => 3.9344, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 7.22% (1.1061 => 1.1860, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.22% (1.9828 => 2.1260, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.21% (3.8646 => 4.1431, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.15% (0.2925 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.13% (0.5637 => 0.6039, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.02% (0.4016 => 0.4298, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.97% (0.2023 => 0.2164, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.96% (0.3220 => 0.3444, std. dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.70% (0.6744 => 0.7196, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3534 => 0.3770, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.63% (1.3245 => 1.4123, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.61% (0.7460 => 0.7953, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.60% (3.1889 => 3.3993, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 6.59% (2.1791 => 2.3228, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 6.57% (1.2749 => 1.3586, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.52% (0.4113 => 0.4381, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.48% (1.9270 => 2.0518, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.36% (0.8818 => 0.9379, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.29% (1.0594 => 1.1260, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.28% (1.3819 => 1.4687, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (1.3813 => 1.4678, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.26% (14.8535 => 15.7827, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.11% (4.3801 => 4.6478, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.6135 => 0.6509, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (4.4433 => 4.7121, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.95% (16.6129 => 17.6006, std. dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (8.4961 => 8.9999, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.91% (0.3131 => 0.3316, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.2859 => 0.3027, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.8698 => 0.9208, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.71% (14.5298 => 15.3596, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.68% (1.1333 => 1.1977, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.40% (0.6576 => 0.6931, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (6.5754 => 6.9270, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.23% (3.2742 => 3.4453, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.20% (4.6629 => 4.9054, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.05% (0.3245 => 0.3409, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4.84% (16.2614 => 17.0479, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.77% (0.9108 => 0.9542, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.4805 => 0.5025, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (1.5188 => 1.5833, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.02% (0.6250 => 0.6501, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.00% (2.1007 => 2.1847, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.97% (4.9865 => 5.1846, std. dev.: 0.0100) MultiSource/Applications/lua/lua: 3.86% (3.7467 => 3.8914, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.73% (0.3511 => 0.3642, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (6.2785 => 6.4829, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 3.22% (33.2944 => 34.3658, std. dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std. dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.07% (1.2998 => 1.3787, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7333, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5460, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.27% (1.9199 => 1.9826, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0787, std. dev.: 0.0366) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.5184 => 0.5332, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5987, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5924, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.03% (7.9275 => 8.0090, std. dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.10% (0.4657 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.76% (0.2670 => 0.2543, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.70% (22.5627 => 21.7272, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2592, std. dev.: 0.0284) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.94% (1.3780 => 1.2961, std. dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1515, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9250, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6039, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2451, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.60% (4.5928 => 4.5192, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std. dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4313, std. dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2613, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2419, std. dev.: 0.0335) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 14:33:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 16:33:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907213330.8B6922A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3540?compare_to=3538&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3540, Order: 163410, Start Time: 2012-09-07 20:22:51, End Time: 2012-09-07 21:34:43 To: 3538, Order: 163401, Start Time: 2012-09-07 18:54:41, End Time: 2012-09-07 20:05:53 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (57 on baseline) Performance Improvements: 1 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.37% (0.4553 => 0.4661, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.94% (15.4035 => 15.7026, std. dev.: 0.0530) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (3.8334 => 3.9051, std. dev.: 0.0215) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.8638 => 0.8787, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.3055 => 8.4232, std. dev.: 0.0439) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2728 => 4.3326, std. dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: 1.24% (29.6080 => 29.9762, std. dev.: 0.1092) MultiSource/Applications/hexxagon/hexxagon: 1.11% (0.9361 => 0.9465, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 7.79% (3.5971 => 3.8773, std. dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.59% (2.3637 => 2.4959, std. dev.: 0.0365) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.17% (2.8288 => 2.8902, std. dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.70% (1.6272 => 1.5996, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.69% (0.3582 => 0.3750, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.40% (1.0046 => 1.0488, std. dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 4.03% (2.1763 => 2.2641, std. dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.84% (0.2654 => 0.2756, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3.78% (1.1653 => 1.2094, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.76% (0.6410 => 0.6651, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: 3.58% (0.6173 => 0.6394, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (12.6413 => 13.0154, std. dev.: 0.1141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.5150 => 1.5589, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.78% (0.5937 => 0.6102, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.64% (0.5309 => 0.5449, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 2.56% (15.3105 => 15.7026, std. dev.: 0.0530) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.54% (0.8569 => 0.8787, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.25% (29.3170 => 29.9762, std. dev.: 0.1092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.03% (8.2559 => 8.4232, std. dev.: 0.0439) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (4.2616 => 4.3326, std. dev.: 0.0174) MultiSource/Applications/ClamAV/clamscan: 1.14% (14.6079 => 14.7745, std. dev.: 0.0560) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.52% (1.6538 => 2.3404, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.85% (0.0766 => 0.0941, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/ary3: 14.96% (1.7426 => 2.0033, std. dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.49% (4.0101 => 4.5509, std. dev.: 0.1024) MultiSource/Applications/sgefa/sgefa: 12.81% (0.3746 => 0.4226, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 12.69% (3.4406 => 3.8773, std. dev.: 0.0165) SingleSource/Benchmarks/McGill/misr: 12.15% (0.4296 => 0.4818, std. dev.: 0.0034) SingleSource/Benchmarks/Stanford/Puzzle: 12.07% (0.1433 => 0.1606, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 9.90% (7.0025 => 7.6960, std. dev.: 0.1048) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.43% (0.2694 => 0.2948, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.26% (1.0063 => 1.0894, std. dev.: 0.0143) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.95% (0.2857 => 0.3084, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 7.40% (1.0194 => 1.0948, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.33% (27.1724 => 28.8915, std. dev.: 0.0855) MultiSource/Benchmarks/Olden/bisort/bisort: 6.29% (0.6459 => 0.6865, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 6.22% (3.4876 => 3.7047, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.85% (2.3580 => 2.4959, std. dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.58% (40.4792 => 42.7391, std. dev.: 0.6710) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.83% (15.2242 => 15.8068, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/dt: 3.76% (0.9851 => 1.0221, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8739, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.28% (0.3508 => 0.3623, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: 3.10% (8.5113 => 8.7753, std. dev.: 0.0500) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.6308 => 0.6480, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.49% (2.6656 => 2.7321, std. dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.16% (4.6127 => 4.7122, std. dev.: 0.0296) MultiSource/Applications/lua/lua: 2.05% (29.5232 => 30.1295, std. dev.: 0.0840) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4455 => 2.4877, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 1.69% (2.5166 => 2.5591, std. dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 1.66% (6.9722 => 7.0879, std. dev.: 0.0349) MultiSource/Applications/siod/siod: 1.48% (3.5520 => 3.6047, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5329, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6756, std. dev.: 0.0166) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.20% (4.0659 => 4.1148, std. dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2080 => 0.1942, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.66% (0.3497 => 0.2110, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.28% (5.2665 => 4.0929, std. dev.: 0.1061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.02% (1.1647 => 0.9898, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/sieve: -12.01% (8.1594 => 7.1794, std. dev.: 0.0322) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.96% (1.4034 => 1.2776, std. dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.58% (3.2007 => 2.9580, std. dev.: 0.0564) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.09% (3.6254 => 3.3683, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -6.37% (3.4230 => 3.2050, std. dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.90% (2.9728 => 2.7975, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -5.26% (1.4441 => 1.3682, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std. dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.47% (3.9413 => 3.7651, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.28% (2.4457 => 2.3655, std. dev.: 0.0280) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.26% (1.2959 => 1.2537, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.06% (1.7361 => 1.6830, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -3.03% (9.2503 => 8.9703, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: -2.89% (62.4126 => 60.6094, std. dev.: 0.3431) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.86% (1.1683 => 1.1349, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.70% (1.2722 => 1.2378, std. dev.: 0.0107) MultiSource/Applications/aha/aha: -2.67% (3.4286 => 3.3369, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: -2.53% (9.5474 => 9.3055, std. dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: -2.42% (92.7467 => 90.5010, std. dev.: 0.7238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.21% (3.7496 => 3.6666, std. dev.: 0.0284) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2286, std. dev.: 0.0338) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.54% (1.0686 => 1.0521, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -1.47% (6.7458 => 6.6468, std. dev.: 0.0281) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3198, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/oourafft: -1.30% (3.8200 => 3.7702, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 14:51:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 16:51:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907215158.180212A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3541?compare_to=3537&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3541, Order: 163410, Start Time: 2012-09-07 20:33:27, End Time: 2012-09-07 21:53:03 To: 3537, Order: 163397, Start Time: 2012-09-07 18:45:27, End Time: 2012-09-07 20:05:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (140 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (14.0827 => 14.2683, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.36% (7.9505 => 8.0588, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.49% (56.7136 => 55.8713, std. dev.: 0.3169) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.63% (10.3673 => 14.2683, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 27.87% (0.1622 => 0.2074, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.72% (2.2022 => 2.5044, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.08% (7.0540 => 7.9765, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.84% (1.1194 => 1.2519, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.14% (1.7609 => 1.9571, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.05% (9.4845 => 10.1534, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.8172 => 0.8744, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.6030 => 0.6448, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.92% (10.4361 => 11.1578, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5925 => 0.6334, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.77% (0.7433 => 0.7936, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.58% (0.5105 => 0.5441, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.2554 => 0.2721, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.6675 => 0.7096, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.25% (0.5860 => 0.6226, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.22% (8.1363 => 8.6425, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 6.19% (0.7835 => 0.8320, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.10% (4.2646 => 4.5247, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.08% (0.3423 => 0.3631, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.07% (3.3354 => 3.5380, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (1.3050 => 1.3842, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.98% (5.7591 => 6.1035, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.94% (1.5415 => 1.6331, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.89% (0.5569 => 0.5897, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.86% (4.9449 => 5.2346, std. dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3121 => 0.3303, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (5.0018 => 5.2910, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 5.77% (1.5603 => 1.6504, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.73% (0.2758 => 0.2916, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.8067 => 0.8520, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.59% (0.9765 => 1.0311, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.57% (0.2603 => 0.2748, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.40% (14.3668 => 15.1419, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.24% (0.4103 => 0.4318, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.23% (1.1642 => 1.2251, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1861 => 1.2464, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4299 => 0.4517, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.03% (0.3422 => 0.3594, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.94% (3.8723 => 4.0635, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 4.93% (0.6456 => 0.6774, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.5020 => 0.5267, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.91% (1.0722 => 1.1248, std. dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4636 => 0.4862, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.4064 => 0.4260, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.65% (2.0273 => 2.1215, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (7.9617 => 8.3177, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6450 => 0.6738, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3650 => 0.3811, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.40% (0.2725 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.4289 => 0.4476, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.35% (0.3865 => 0.4033, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9371 => 22.8901, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8921 => 0.9306, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.31% (0.3826 => 0.3991, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.31% (2.2969 => 2.3958, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.30% (0.3136 => 0.3271, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.26% (0.3098 => 0.3230, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.24% (0.4203 => 0.4381, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3052 => 0.3181, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.22% (0.2891 => 0.3013, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3935 => 0.4101, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 4.17% (0.4048 => 0.4217, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3603 => 0.3752, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (2.0665 => 2.1514, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4620 => 0.4809, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5981 => 0.6225, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3232 => 0.3363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.3684 => 0.3833, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2756 => 0.2866, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.97% (0.2872 => 0.2986, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.88% (1.4186 => 1.4736, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3283 => 0.3410, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.83% (17.1811 => 17.8386, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.76% (0.2793 => 0.2898, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2802 => 0.2907, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (1.5859 => 1.6447, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.2024 => 2.2780, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.1840 => 1.2193, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 2.65% (1.2842 => 1.3182, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (3.1578 => 3.3795, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.38% (4.2280 => 4.3708, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7461, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2302, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.18% (5.3855 => 3.8679, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.79% (5.3526 => 3.8653, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1389, std. dev.: 0.0428) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.19% (2.9384 => 2.5802, std. dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: -7.91% (22.1758 => 20.4217, std. dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2751, std. dev.: 0.1430) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5025, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1504, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4089, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5098, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.84% (1.3677 => 1.3288, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9974, std. dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.90% (4.6441 => 4.5558, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5084, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0218, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 15:58:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 17:58:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120907225842.228FF2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3542?compare_to=3536&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3542, Order: 163407, Start Time: 2012-09-07 20:16:15, End Time: 2012-09-07 22:59:51 To: 3536, Order: 163394, Start Time: 2012-09-07 17:04:17, End Time: 2012-09-07 19:48:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.44% (1.6911 => 1.7155, std. dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.59% (0.3488 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.57% (0.3442 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3643 => 0.4118, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.89% (0.1620 => 0.1764, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5826 => 0.6333, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5889 => 0.6386, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.68% (1.5932 => 1.7155, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.1619 => 0.1741, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.10% (0.7171 => 0.7680, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (1.6211 => 1.7352, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.75% (1.3152 => 1.4040, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (3.5627 => 3.8011, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.41% (0.5026 => 0.5348, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (0.4361 => 0.4640, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2875 => 0.3054, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.18% (0.3060 => 0.3249, std. dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.3004 => 0.3189, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.11% (0.4029 => 0.4275, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (0.4994 => 0.5294, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (0.3930 => 0.4165, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.94% (4.2109 => 4.4612, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.2866 => 0.3036, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (0.5000 => 0.5296, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3195 => 0.3383, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2738 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.84% (0.2792 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2803 => 0.2966, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 5.80% (1.0781 => 1.1406, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 5.79% (0.9909 => 1.0483, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2823 => 0.2985, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2813 => 0.2974, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2780 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.72% (0.2729 => 0.2885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.71% (0.2750 => 0.2907, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.71% (2.0673 => 2.1853, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.68% (0.3096 => 0.3272, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2811 => 0.2969, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2911 => 0.3074, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.57% (0.3267 => 0.3449, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.56% (5.5417 => 5.8496, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary: 5.52% (0.3258 => 0.3438, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3362 => 0.3545, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (0.4658 => 0.4910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.34% (0.3317 => 0.3494, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3124 => 0.3289, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3282 => 0.3455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.23% (0.3348 => 0.3523, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.22% (0.9697 => 1.0203, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3726 => 0.3920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.19% (0.3678 => 0.3869, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.18% (0.2566 => 0.2699, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3477 => 0.3657, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (0.3890 => 0.4091, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.3845 => 0.4043, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 5.14% (0.4146 => 0.4359, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.3625 => 0.3809, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.91% (2.1013 => 2.2044, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.84% (1.9694 => 2.0647, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3690 => 0.3868, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.81% (0.6634 => 0.6953, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.66% (1.9966 => 2.0896, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 4.66% (0.4251 => 0.4449, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (2.7292 => 2.8563, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.62% (0.3271 => 0.3422, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.57% (0.3981 => 0.4163, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.51% (0.3903 => 0.4079, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (1.8794 => 1.9635, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 4.47% (23.5202 => 24.5712, std. dev.: 0.0167) SingleSource/Benchmarks/Misc-C++/bigfib: 4.41% (0.5012 => 0.5233, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (4.4195 => 4.6099, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.28% (0.3084 => 0.3216, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.24% (0.2737 => 0.2853, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.23% (4.6177 => 4.8131, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3792 => 0.3951, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 4.17% (2.1653 => 2.2555, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 4.16% (1.4269 => 1.4863, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 4.14% (0.7875 => 0.8201, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 4.08% (0.3336 => 0.3472, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.4139 => 0.4307, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.01% (0.6435 => 0.6693, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.79% (0.5546 => 0.5756, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.28% (2.0346 => 2.1014, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 3.09% (0.4847 => 0.4997, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (0.7426 => 0.7614, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.37% (0.5361 => 0.5488, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (11.6398 => 11.8336, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.50% (4.6926 => 4.7632, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6687, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6254, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1949, std. dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std. dev.: 0.0105) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4303, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5948, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5675, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: -9.58% (0.2402 => 0.2172, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7934, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7927, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0008) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7487, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9608, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 16:01:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 18:01:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120907230110.F33CA2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3543?compare_to=3540&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3543, Order: 163422, Start Time: 2012-09-07 21:51:00, End Time: 2012-09-07 23:02:22 To: 3540, Order: 163410, Start Time: 2012-09-07 20:22:51, End Time: 2012-09-07 21:34:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (46 on baseline) Performance Improvements: 8 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.38% (0.4364 => 0.4555, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 1.37% (3.5952 => 3.6445, std. dev.: 0.0161) MultiSource/Applications/treecc/treecc: 1.16% (1.8831 => 1.9050, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.84% (1.3455 => 1.3971, std. dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (60.6094 => 61.2384, std. dev.: 0.1154) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.05% (0.6102 => 0.5916, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.25% (0.4661 => 0.4556, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -2.09% (0.8624 => 0.8444, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -2.07% (0.5449 => 0.5336, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.8787 => 0.8630, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.16% (8.4232 => 8.3256, std. dev.: 0.0254) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.70% (2.4959 => 2.4036, std. dev.: 0.0082) MultiSource/Benchmarks/sim/sim: -1.47% (3.8821 => 3.8249, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.93% (0.6410 => 0.6726, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.02% (0.3582 => 0.3726, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 3.97% (2.1763 => 2.2628, std. dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: 3.76% (1.1653 => 1.2091, std. dev.: 0.0123) MultiSource/Applications/minisat/minisat: 2.93% (0.6173 => 0.6354, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.5150 => 1.5547, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (12.6413 => 12.9392, std. dev.: 0.0579) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.64% (1.3935 => 1.4163, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.45% (29.3170 => 29.7431, std. dev.: 0.0534) MultiSource/Applications/SPASS/SPASS: 1.37% (13.3238 => 13.5070, std. dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.35% (1.1827 => 1.1987, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 1.34% (1.8798 => 1.9050, std. dev.: 0.0062) MultiSource/Applications/lua/lua: 1.29% (3.5980 => 3.6445, std. dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.0766 => 0.0903, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 14.96% (1.7426 => 2.0033, std. dev.: 0.0299) SingleSource/Benchmarks/McGill/misr: 13.62% (0.4296 => 0.4881, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.52% (0.0917 => 0.1041, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.03% (4.0101 => 4.5328, std. dev.: 0.1207) SingleSource/Benchmarks/Shootout-C++/sieve: 12.70% (3.4406 => 3.8775, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 12.44% (0.3746 => 0.4212, std. dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 10.75% (0.1433 => 0.1587, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.00% (1.0063 => 1.0969, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 8.99% (7.0025 => 7.6318, std. dev.: 0.0286) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 6.90% (1.0194 => 1.0897, std. dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (3.4876 => 3.7132, std. dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8113, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3301 => 0.3492, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.27% (4.2129 => 4.3927, std. dev.: 0.0656) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 3.91% (15.2242 => 15.8192, std. dev.: 0.0541) SingleSource/Benchmarks/Misc/ReedSolomon: 3.88% (8.5113 => 8.8417, std. dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.70% (3.4080 => 3.5341, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.11% (0.3508 => 0.3617, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.6127 => 4.7121, std. dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.93% (2.3580 => 2.4036, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (2.4455 => 2.4906, std. dev.: 0.0145) MultiSource/Applications/siod/siod: 1.39% (3.5520 => 3.6012, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5316, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 1.30% (2.5166 => 2.5492, std. dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6701, std. dev.: 0.0344) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.09% (0.3497 => 0.2095, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.25% (5.2665 => 4.1999, std. dev.: 0.0554) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.06% (1.1647 => 0.9893, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1611, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.65% (3.2007 => 2.9557, std. dev.: 0.0588) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.02% (3.6254 => 3.3710, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -6.60% (3.4230 => 3.1972, std. dev.: 0.0485) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -4.84% (1.4441 => 1.3742, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0588) MultiSource/Benchmarks/FreeBench/distray/distray: -3.98% (0.2664 => 0.2558, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.91% (1.7361 => 1.6683, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (9.2503 => 8.9418, std. dev.: 0.0337) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.19% (1.2722 => 1.2316, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -2.86% (3.4286 => 3.3305, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6425, std. dev.: 0.0333) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2875, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.72% (1.1683 => 1.1365, std. dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -2.57% (92.7467 => 90.3677, std. dev.: 0.2436) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.38% (61.1734 => 59.7189, std. dev.: 0.1328) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (62.4126 => 61.2384, std. dev.: 0.1154) MultiSource/Benchmarks/sim/sim: -1.69% (3.8907 => 3.8249, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2292, std. dev.: 0.0447) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: -1.37% (1.7330 => 1.7093, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3151, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7688, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 16:09:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 18:09:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120907230905.5CF582A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3544?compare_to=3539&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3544, Order: 163420, Start Time: 2012-09-07 21:55:39, End Time: 2012-09-07 23:10:16 To: 3539, Order: 163407, Start Time: 2012-09-07 20:13:02, End Time: 2012-09-07 21:27:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5848 => 56.5275, std. dev.: 0.0541) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.62% (78.4461 => 80.5010, std. dev.: 0.1118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.62% (2.0176 => 2.4135, std. dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.76% (0.5818 => 0.6444, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.66% (0.7061 => 0.7814, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 10.58% (0.5748 => 0.6356, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.08% (0.1588 => 0.1748, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.88% (3.9660 => 4.3578, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.7710 => 0.8466, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 9.79% (1.3693 => 1.5034, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.34% (0.7038 => 0.7695, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.15% (0.5265 => 0.5747, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.01% (1.2193 => 1.3292, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.00% (0.9199 => 1.0027, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.84% (0.6959 => 0.7574, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.53% (1.1364 => 1.2333, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.43% (1.4563 => 1.5790, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.24% (0.6283 => 0.6801, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.15% (0.3646 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9377, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5577 => 0.6024, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.01% (0.1435 => 0.1550, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.93% (0.2914 => 0.3145, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.93% (0.3899 => 0.4208, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.92% (1.0313 => 1.1130, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.89% (0.3246 => 0.3502, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.83% (0.4379 => 0.4722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.83% (0.4791 => 0.5166, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2127 => 0.2293, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.78% (0.2995 => 0.3228, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.60% (7.2180 => 7.7664, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 7.56% (0.8310 => 0.8938, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 7.55% (0.7506 => 0.8073, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.54% (0.3580 => 0.3850, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.49% (1.1061 => 1.1890, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3756 => 0.4036, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 7.44% (0.3293 => 0.3538, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2761 => 0.2965, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.38% (0.4390 => 0.4714, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (1.9828 => 2.1270, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (13.2842 => 14.2459, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.20% (3.6692 => 3.9335, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.17% (0.5637 => 0.6041, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (3.8646 => 4.1411, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.05% (0.3220 => 0.3447, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.90% (2.1791 => 2.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.78% (1.3245 => 1.4143, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3534 => 0.3772, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.71% (0.4113 => 0.4389, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.68% (0.7460 => 0.7958, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.66% (3.1889 => 3.4014, std. dev.: 0.0156) MultiSource/Applications/SIBsim4/SIBsim4: 6.64% (1.2749 => 1.3595, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.58% (0.6744 => 0.7188, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.54% (1.9270 => 2.0531, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.29% (1.0594 => 1.1260, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.26% (0.8818 => 0.9370, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 6.21% (14.8535 => 15.7765, std. dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2504 => 0.2659, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.19% (1.3819 => 1.4674, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.16% (0.3131 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.16% (4.4433 => 4.7168, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.15% (1.3813 => 1.4663, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 6.10% (16.6129 => 17.6264, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.07% (4.3801 => 4.6459, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (8.4961 => 8.9979, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.8698 => 0.9205, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.78% (1.1333 => 1.1988, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.65% (0.2140 => 0.2261, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 5.57% (14.5298 => 15.3398, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (6.5754 => 6.9284, std. dev.: 0.0159) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.25% (4.6629 => 4.9078, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.24% (3.2742 => 3.4457, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.90% (16.2614 => 17.0589, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.88% (0.6576 => 0.6897, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2292 => 1.2887, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.83% (0.4805 => 0.5037, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.74% (0.9108 => 0.9540, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.40% (1.5188 => 1.5857, std. dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.15% (4.9865 => 5.1933, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.1007 => 2.1869, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 4.02% (3.7467 => 3.8975, std. dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6250 => 0.6500, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.47% (0.3511 => 0.3633, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.34% (6.2785 => 6.4884, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 3.30% (33.2944 => 34.3921, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5133, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2627, std. dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7333, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.95% (10.7476 => 11.0646, std. dev.: 0.0172) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.76% (0.5184 => 0.5327, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6032, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0060) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5907, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.14% (0.4657 => 0.3952, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.61% (0.2670 => 0.2547, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.57% (22.5627 => 21.7570, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2832, std. dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.78% (1.3780 => 1.2983, std. dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.22% (2.6470 => 2.5088, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0010) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1515, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9208, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6021, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2509, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5208, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2394, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: -1.14% (4.4810 => 4.4298, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2355, std. dev.: 0.0229) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2596, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 16:39:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 18:39:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120907233956.D62472A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3545?compare_to=3541&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3545, Order: 163424, Start Time: 2012-09-07 22:21:20, End Time: 2012-09-07 23:41:07 To: 3541, Order: 163410, Start Time: 2012-09-07 20:33:27, End Time: 2012-09-07 21:53:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (143 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.47% (14.2683 => 14.4779, std. dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.06% (78.3099 => 79.9243, std. dev.: 0.2510) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.65% (10.3673 => 14.4779, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.09% (2.2022 => 2.5124, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.54% (7.0540 => 8.0092, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops: 13.13% (0.1432 => 0.1620, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.55% (0.3516 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.30% (1.7609 => 1.9598, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 9.08% (0.3282 => 0.3580, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.3177 => 0.3428, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.38% (10.4361 => 11.2061, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.29% (9.4845 => 10.1762, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.19% (0.4879 => 0.5230, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.8172 => 0.8747, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.84% (0.5925 => 0.6330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.4615 => 0.4929, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.77% (0.7433 => 0.7936, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 6.66% (0.3109 => 0.3316, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.59% (0.7115 => 0.7584, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.50% (0.7326 => 0.7802, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.41% (8.1363 => 8.6580, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3423 => 0.3642, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.40% (0.6675 => 0.7102, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (4.2646 => 4.5351, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.5105 => 0.5426, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (1.3050 => 1.3867, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.23% (0.5860 => 0.6225, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 6.21% (3.3354 => 3.5424, std. dev.: 0.0135) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.16% (4.9449 => 5.2494, std. dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 6.11% (5.7591 => 6.1109, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.07% (1.5415 => 1.6350, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 6.04% (0.7835 => 0.8308, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.99% (5.0018 => 5.3016, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5569 => 0.5900, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.83% (1.5603 => 1.6512, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.76% (0.2603 => 0.2753, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2758 => 0.2914, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.65% (0.9765 => 1.0317, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.64% (0.8067 => 0.8522, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (14.3668 => 15.1461, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 5.39% (1.1642 => 1.2269, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.24% (0.5020 => 0.5283, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1861 => 1.2478, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.17% (0.3441 => 0.3619, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.11% (1.0722 => 1.1270, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.11% (0.3387 => 0.3560, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4636 => 0.4863, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.85% (0.3422 => 0.3588, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.4103 => 0.4302, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 4.84% (3.8723 => 4.0598, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: 4.77% (0.6456 => 0.6764, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.72% (2.0273 => 2.1229, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.70% (0.6450 => 0.6753, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.68% (0.4064 => 0.4254, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.66% (0.3650 => 0.3820, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.64% (21.9371 => 22.9557, std. dev.: 0.0239) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (7.9617 => 8.3302, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 4.53% (0.8921 => 0.9325, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3826 => 0.3996, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.30% (2.2969 => 2.3957, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.22% (0.2891 => 0.3013, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.20% (0.2905 => 0.3027, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5981 => 0.6232, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 4.16% (0.3098 => 0.3227, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.4048 => 0.4213, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.08% (0.2871 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3935 => 0.4095, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3603 => 0.3749, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.05% (2.0665 => 2.1502, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.03% (1.4186 => 1.4758, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.00% (0.4203 => 0.4371, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.99% (1.5859 => 1.6492, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3684 => 0.3831, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.98% (0.3162 => 0.3288, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.90% (17.1811 => 17.8506, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.85% (0.2756 => 0.2862, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.84% (0.3283 => 0.3409, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3232 => 0.3356, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.82% (0.2877 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.80% (0.3052 => 0.3168, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.2024 => 2.2850, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2802 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.1840 => 1.2224, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.65% (1.2842 => 1.3182, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.8101 => 0.8291, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (3.8922 => 3.9366, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3837, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (4.2280 => 4.3644, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2381, std. dev.: 0.0065) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.72% (5.2763 => 3.2333, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.08% (5.3855 => 3.8734, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.69% (5.3526 => 3.8702, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.0996, std. dev.: 0.0319) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.00% (2.9384 => 2.5859, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: -7.94% (22.1758 => 20.4147, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2856, std. dev.: 0.0626) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.46% (1.8329 => 1.7145, std. dev.: 0.0185) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0011) MultiSource/Applications/siod/siod: -3.98% (3.2827 => 3.1519, std. dev.: 0.0225) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5058, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4196, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9981, std. dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.92% (4.6441 => 4.5550, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0219, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4193, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 17:27:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 19:27:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908002750.5D2202A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3546?compare_to=3543&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3546, Order: 163429, Start Time: 2012-09-07 23:17:52, End Time: 2012-09-08 00:29:03 To: 3543, Order: 163422, Start Time: 2012-09-07 21:51:00, End Time: 2012-09-07 23:02:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (56 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1859 => 0.2001, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.25% (0.7596 => 0.8071, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.4053 => 1.4392, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.35% (0.5654 => 0.5787, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.0731 => 1.0842, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 4.67% (0.6547 => 0.6853, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.58% (1.7756 => 1.8392, std. dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.09% (41.3687 => 42.6453, std. dev.: 0.4601) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.65% (2.7016 => 2.7463, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.37% (4.0761 => 4.1319, std. dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.26% (1.4256 => 1.4435, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.00% (1.6045 => 1.6206, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.52% (0.7722 => 0.8071, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 4.42% (0.6173 => 0.6446, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.33% (0.3582 => 0.3737, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 4.17% (0.3217 => 0.3351, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.02% (1.0046 => 1.0450, std. dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 3.84% (1.1653 => 1.2101, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 3.46% (2.1763 => 2.2516, std. dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (1.3935 => 1.4324, std. dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.15% (0.7639 => 0.7803, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.12% (1.1440 => 1.1683, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.06% (0.6069 => 0.6194, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.98% (1.4113 => 1.4392, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 1.88% (29.3170 => 29.8668, std. dev.: 0.1255) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (4.2616 => 4.3378, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.1827 => 1.2035, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.55% (8.2559 => 8.3842, std. dev.: 0.0358) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.0689 => 1.0842, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.17% (3.5980 => 3.6402, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.50% (1.6538 => 2.3402, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.93% (0.0766 => 0.0888, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0018, std. dev.: 0.0333) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.83% (4.0101 => 4.6047, std. dev.: 0.0366) SingleSource/Benchmarks/McGill/misr: 13.92% (0.4296 => 0.4894, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8802, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 12.44% (0.3746 => 0.4212, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.56% (0.0917 => 0.1023, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.91% (0.2857 => 0.3140, std. dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.28% (0.1433 => 0.1566, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 9.16% (7.0025 => 7.6440, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.14% (1.0063 => 1.0983, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 7.03% (1.0194 => 1.0911, std. dev.: 0.0173) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.13% (27.1724 => 28.8392, std. dev.: 0.0408) MultiSource/Benchmarks/Olden/bisort/bisort: 6.10% (0.6459 => 0.6853, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (3.4876 => 3.6976, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.35% (40.4792 => 42.6453, std. dev.: 0.4601) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: 4.18% (15.2242 => 15.8610, std. dev.: 0.0577) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8737, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4651, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.28% (0.5587 => 0.5770, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.03% (2.6656 => 2.7463, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 2.25% (5.1938 => 5.3106, std. dev.: 0.0294) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.10% (4.6127 => 4.7094, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash: 1.76% (0.6308 => 0.6419, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 1.67% (2.5166 => 2.5586, std. dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4854, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.62% (4.0659 => 4.1319, std. dev.: 0.0169) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5339, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 1.44% (3.5520 => 3.6032, std. dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.42% (1.2726 => 1.2907, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.37% (14.4877 => 14.6868, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.6110 => 1.6298, std. dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: 1.01% (2.4013 => 2.4255, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.38% (0.3497 => 0.2120, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.37% (5.2665 => 4.1938, std. dev.: 0.0328) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.89% (1.1647 => 0.9913, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1623, std. dev.: 0.0344) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.03% (1.4034 => 1.2907, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.94% (3.2007 => 2.9467, std. dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3666, std. dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: -6.77% (3.4230 => 3.1913, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3568, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.89% (2.9728 => 2.7977, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4064, std. dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7628, std. dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.07% (1.2722 => 1.2331, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -3.07% (9.2503 => 8.9663, std. dev.: 0.0252) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.06% (1.7361 => 1.6829, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.02% (1.1683 => 1.1330, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.02% (2.4457 => 2.3719, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.62% (1.2959 => 1.2619, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -2.60% (9.5474 => 9.2993, std. dev.: 0.0050) MultiSource/Applications/aha/aha: -2.60% (3.4286 => 3.3396, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (92.7467 => 90.6226, std. dev.: 0.6089) MultiSource/Benchmarks/mafft/pairlocalalign: -2.25% (62.4126 => 61.0055, std. dev.: 0.1643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.23% (3.7496 => 3.6660, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.85% (1.8739 => 1.8392, std. dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2305, std. dev.: 0.0249) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.3569 => 2.3221, std. dev.: 0.0132) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7661, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3180, std. dev.: 0.0662) MultiSource/Applications/JM/lencod/lencod: -1.35% (6.7458 => 6.6547, std. dev.: 0.0259) MultiSource/Benchmarks/sim/sim: -1.27% (3.8907 => 3.8414, std. dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 17:51:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 19:51:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908005143.32F4E2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3547?compare_to=3544&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3547, Order: 163429, Start Time: 2012-09-07 23:38:25, End Time: 2012-09-08 00:52:54 To: 3544, Order: 163420, Start Time: 2012-09-07 21:55:39, End Time: 2012-09-07 23:10:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.29% (1.5034 => 1.5228, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.52% (56.5275 => 54.5352, std. dev.: 0.3495) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.45% (80.5010 => 78.5256, std. dev.: 0.6460) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.01% (2.0176 => 2.4214, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.21% (1.3693 => 1.5228, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.76% (0.7061 => 0.7821, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 10.74% (0.5818 => 0.6443, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.51% (0.5748 => 0.6352, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.14% (0.7710 => 0.8492, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.07% (3.9660 => 4.3653, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.45% (0.4328 => 0.4737, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 9.43% (0.7038 => 0.7702, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.25% (0.5265 => 0.5752, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.16% (0.4062 => 0.4434, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.14% (1.2193 => 1.3307, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.08% (0.9199 => 1.0034, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.97% (0.2721 => 0.2965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.92% (0.3914 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 8.80% (0.3623 => 0.3942, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.80% (1.1364 => 1.2364, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.74% (0.6959 => 0.7567, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.73% (0.2782 => 0.3025, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.71% (1.4563 => 1.5831, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.56% (0.1589 => 0.1725, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.54% (0.3899 => 0.4232, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.50% (0.3022 => 0.3279, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.40% (13.8202 => 14.9813, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.6283 => 0.6809, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2607 => 0.2825, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 8.29% (0.2690 => 0.2913, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.27% (0.5577 => 0.6038, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2655 => 0.2874, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.2937 => 0.3179, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.24% (0.3485 => 0.3772, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 8.22% (0.2760 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 8.20% (0.3293 => 0.3563, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.17% (1.9828 => 2.1448, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.16% (0.4791 => 0.5182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.13% (0.3580 => 0.3871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.2966 => 0.3207, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3489 => 0.3772, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.08% (0.2761 => 0.2984, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 8.07% (0.2726 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.07% (0.3756 => 0.4059, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.00% (0.4390 => 0.4741, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.99% (0.2765 => 0.2986, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.99% (0.4379 => 0.4729, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.96% (7.2180 => 7.7926, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.94% (0.1435 => 0.1549, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.94% (1.0313 => 1.1132, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 7.89% (0.3107 => 0.3352, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.88% (0.2995 => 0.3231, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.86% (0.2696 => 0.2908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.81% (0.3149 => 0.3395, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 7.76% (0.2988 => 0.3220, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.75% (0.7506 => 0.8088, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.72% (0.4016 => 0.4326, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: 7.64% (0.3192 => 0.3436, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.61% (13.2842 => 14.2956, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/moments: 7.60% (0.3868 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.57% (3.6692 => 3.9470, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.52% (0.8310 => 0.8935, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3453 => 0.3711, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.47% (0.3534 => 0.3798, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.42% (1.1061 => 1.1882, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.27% (0.5637 => 0.6047, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.16% (3.8646 => 4.1413, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.05% (0.4113 => 0.4403, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.2945 => 0.3150, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.7460 => 0.7975, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.86% (1.2749 => 1.3624, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 6.86% (3.1889 => 3.4077, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.79% (1.3245 => 1.4144, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 6.69% (1.9270 => 2.0559, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 6.67% (0.6744 => 0.7194, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 6.67% (2.1791 => 2.3245, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.67% (0.6135 => 0.6544, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 6.65% (1.0594 => 1.1299, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.58% (0.8818 => 0.9398, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.51% (14.8535 => 15.8198, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.50% (0.8698 => 0.9263, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.47% (0.3755 => 0.3998, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.40% (4.3801 => 4.6604, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.39% (0.2504 => 0.2664, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.37% (4.4433 => 4.7264, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.30% (1.3813 => 1.4683, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.24% (1.3819 => 1.4681, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 6.23% (0.2859 => 0.3037, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.17% (8.4961 => 9.0201, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 6.01% (14.5298 => 15.4037, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.95% (0.6576 => 0.6967, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.91% (0.3131 => 0.3316, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 5.90% (16.6129 => 17.5936, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.78% (1.1333 => 1.1988, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.66% (4.6629 => 4.9267, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 5.62% (6.5754 => 6.9448, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 5.51% (1.2292 => 1.2969, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.24% (3.2742 => 3.4458, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 5.15% (16.2614 => 17.0992, std. dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.4805 => 0.5032, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (0.9108 => 0.9528, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6250 => 0.6532, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (1.5188 => 1.5849, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.30% (4.9865 => 5.2011, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.14% (2.1007 => 2.1876, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 4.10% (3.7467 => 3.9002, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (6.2785 => 6.5159, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.50% (0.3511 => 0.3634, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.34% (33.2944 => 34.4080, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5121, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.72% (1.1560 => 1.2568, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5456, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0752, std. dev.: 0.0283) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (0.5184 => 0.5333, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5964, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9704, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5928, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4442, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.00% (3.6469 => 3.6834, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.87% (0.2670 => 0.2540, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.34% (22.5627 => 21.8095, std. dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.28% (20.3410 => 18.2502, std. dev.: 0.0251) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.15% (1.3780 => 1.2933, std. dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1515, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: -3.33% (3.0263 => 2.9254, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6053, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5203, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2403, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4314, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: -1.09% (3.9173 => 3.8745, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 18:27:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 20:27:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908012745.36BB72A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3548?compare_to=3545&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3548, Order: 163431, Start Time: 2012-09-08 00:09:18, End Time: 2012-09-08 01:28:56 To: 3545, Order: 163424, Start Time: 2012-09-07 22:21:20, End Time: 2012-09-07 23:41:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.10% (10.3673 => 14.5247, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 28.30% (0.1622 => 0.2081, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.21% (2.2022 => 2.5151, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.76% (7.0540 => 8.0247, std. dev.: 0.0126) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3473 => 0.3937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.13% (0.1432 => 0.1620, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.10% (0.3497 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3543 => 0.4007, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3543 => 0.4007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3561 => 0.4024, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.00% (0.3516 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.48% (0.3694 => 0.4155, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3828 => 0.4300, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3927 => 0.4410, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.17% (1.7609 => 1.9752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 11.97% (0.3886 => 0.4351, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.08% (0.3282 => 0.3580, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 8.19% (0.1440 => 0.1558, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.62% (0.4879 => 0.5251, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (10.4361 => 11.2307, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5925 => 0.6360, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.27% (9.4845 => 10.1738, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.6030 => 0.6464, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7433 => 0.7939, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.8172 => 0.8725, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 6.70% (0.2554 => 0.2725, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.67% (0.4615 => 0.4923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.52% (0.7835 => 0.8346, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.52% (0.2271 => 0.2419, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (8.1363 => 8.6657, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.44% (0.2700 => 0.2874, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.40% (0.6675 => 0.7102, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.31% (0.7326 => 0.7788, std. dev.: 0.0102) MultiSource/Applications/minisat/minisat: 6.28% (0.7115 => 0.7562, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3423 => 0.3635, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.14% (4.2646 => 4.5264, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.13% (5.7591 => 6.1124, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.13% (0.5105 => 0.5418, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5860 => 0.6218, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.06% (5.0018 => 5.3051, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 6.05% (3.3354 => 3.5371, std. dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.01% (4.9449 => 5.2423, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.99% (1.3050 => 1.3832, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (1.5415 => 1.6329, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 5.78% (1.5603 => 1.6505, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.73% (0.5569 => 0.5888, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.8067 => 0.8520, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2758 => 0.2911, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.3092 => 0.3263, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (14.3668 => 15.1593, std. dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9765 => 1.0297, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4299 => 0.4532, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 5.26% (0.3387 => 0.3565, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.21% (0.3817 => 0.4016, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (1.1861 => 1.2465, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.07% (1.1642 => 1.2232, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.96% (0.4636 => 0.4866, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 4.94% (1.0722 => 1.1252, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.84% (3.8723 => 4.0598, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.84% (0.5020 => 0.5263, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.4103 => 0.4297, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.4064 => 0.4256, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3422 => 0.3581, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.63% (0.6456 => 0.6755, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.58% (7.9617 => 8.3260, std. dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 4.57% (21.9371 => 22.9400, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.56% (0.6450 => 0.6744, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 4.51% (2.0273 => 2.1188, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3826 => 0.3997, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.3650 => 0.3813, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8921 => 0.9316, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.29% (0.2891 => 0.3015, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.20% (0.2905 => 0.3027, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.14% (0.4203 => 0.4377, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.13% (0.2831 => 0.2948, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.13% (2.2969 => 2.3917, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 4.11% (0.3603 => 0.3751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.06% (0.3052 => 0.3176, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.3098 => 0.3223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3232 => 0.3361, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.4048 => 0.4209, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.92% (2.0665 => 2.1476, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.92% (0.4620 => 0.4801, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3283 => 0.3411, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.89% (17.1811 => 17.8490, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.88% (0.5981 => 0.6213, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.87% (1.4186 => 1.4735, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3684 => 0.3825, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.5859 => 1.6454, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 3.68% (0.2802 => 0.2905, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.46% (0.3379 => 0.3496, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (2.2024 => 2.2758, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.1840 => 1.2206, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3819, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.27% (0.4162 => 0.4298, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7561, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (4.2280 => 4.3601, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2212, std. dev.: 0.0162) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7608, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.53% (5.2763 => 3.2432, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.99% (5.3855 => 3.8780, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.56% (5.3526 => 3.8774, std. dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1484, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.71% (2.9384 => 2.5942, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -7.91% (22.1758 => 20.4206, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2968, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7175, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5058, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4247, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9959, std. dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.51% (1.2373 => 1.2063, std. dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5544, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0052, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std. dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8543, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 18:54:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 20:54:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908015442.A231A2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3549?compare_to=3546&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3549, Order: 163438, Start Time: 2012-09-08 00:44:40, End Time: 2012-09-08 01:55:55 To: 3546, Order: 163429, Start Time: 2012-09-07 23:17:52, End Time: 2012-09-08 00:29:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (53 on baseline) Performance Improvements: 2 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.99% (0.1665 => 0.1848, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: 3.34% (8.8871 => 9.1840, std. dev.: 0.0180) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.2516 => 2.2759, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 1.03% (8.7511 => 8.8414, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -4.65% (0.6853 => 0.6534, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.34% (3.0977 => 3.0251, std. dev.: 0.0273) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.51% (0.6410 => 0.6763, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 4.58% (2.1763 => 2.2759, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.47% (0.3582 => 0.3742, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 4.45% (1.1653 => 1.2172, std. dev.: 0.0132) MultiSource/Applications/minisat/minisat: 4.21% (0.6173 => 0.6433, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3217 => 0.3332, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.15% (12.6413 => 13.0389, std. dev.: 0.0190) MultiSource/Applications/d/make_dparser: 2.14% (3.0225 => 3.0871, std. dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: 2.07% (8.9977 => 9.1840, std. dev.: 0.0180) MultiSource/Applications/ClamAV/clamscan: 1.92% (14.6079 => 14.8883, std. dev.: 0.1002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.88% (1.2021 => 1.2247, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.74% (1.1827 => 1.2033, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 1.54% (13.3238 => 13.5284, std. dev.: 0.0365) MultiSource/Applications/oggenc/oggenc: 1.53% (4.7455 => 4.8183, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.7639 => 0.7756, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (8.2186 => 8.3436, std. dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.45% (1.0689 => 1.0844, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 1.18% (14.7256 => 14.8996, std. dev.: 0.0517) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.12% (1.6538 => 2.3338, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0103) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.15% (0.0766 => 0.0905, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.88% (1.7426 => 2.0019, std. dev.: 0.0565) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5515, std. dev.: 0.0596) SingleSource/Benchmarks/Shootout-C++/sieve: 12.81% (3.4406 => 3.8812, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 12.47% (0.3746 => 0.4213, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 12.36% (0.4296 => 0.4827, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 8.92% (7.0025 => 7.6268, std. dev.: 0.0266) SingleSource/Benchmarks/Stanford/Puzzle: 8.09% (0.1433 => 0.1549, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.93% (1.0063 => 1.0861, std. dev.: 0.0088) SingleSource/Benchmarks/McGill/chomp: 7.47% (1.0194 => 1.0955, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.35% (0.2857 => 0.3067, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.16% (0.2694 => 0.2887, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (0.3301 => 0.3511, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.00% (3.4876 => 3.6967, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.95% (27.1724 => 28.7897, std. dev.: 0.0649) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.52% (40.4792 => 42.7121, std. dev.: 0.2741) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 3.88% (8.5113 => 8.8414, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/fp-convert: 3.81% (15.2242 => 15.8041, std. dev.: 0.0610) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 2.55% (5.1938 => 5.3263, std. dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.44% (4.6127 => 4.7253, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.42% (0.5876 => 0.6018, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.40% (0.5587 => 0.5721, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (2.6656 => 2.7254, std. dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (2.4971 => 2.5344, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4455 => 2.4818, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.39% (14.4877 => 14.6893, std. dev.: 0.0382) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.01% (1.6110 => 1.6272, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.87% (0.2080 => 0.1958, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.98% (5.2665 => 4.1089, std. dev.: 0.0715) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.84% (1.1647 => 0.9919, std. dev.: 0.0291) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1611, std. dev.: 0.0619) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.07% (3.2007 => 2.9425, std. dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3668, std. dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: -6.55% (3.4230 => 3.1987, std. dev.: 0.0530) SingleSource/Benchmarks/Misc/richards_benchmark: -6.42% (1.4441 => 1.3514, std. dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7621, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.11% (1.7361 => 1.6821, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.10% (3.7496 => 3.6334, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/methcall: -3.04% (9.2503 => 8.9691, std. dev.: 0.0268) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2896, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.57% (1.2722 => 1.2395, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.56% (0.4140 => 0.4034, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.53% (1.1683 => 1.1387, std. dev.: 0.0052) MultiSource/Applications/aha/aha: -2.51% (3.4286 => 3.3427, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.18% (2.8964 => 2.8334, std. dev.: 0.0203) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.08% (1.8739 => 1.8350, std. dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: -1.94% (62.4126 => 61.2039, std. dev.: 0.0727) MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (92.7467 => 91.0358, std. dev.: 0.4975) MultiSource/Benchmarks/FreeBench/neural/neural: -1.83% (1.0926 => 1.0726, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (9.3855 => 9.2453, std. dev.: 0.0279) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.3569 => 2.3233, std. dev.: 0.0085) MultiSource/Benchmarks/sim/sim: -1.35% (3.8907 => 3.8380, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3207, std. dev.: 0.0665) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7693, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.12% (16.5617 => 16.3762, std. dev.: 0.0579) MultiSource/Benchmarks/Olden/tsp/tsp: -1.10% (1.7330 => 1.7139, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 19:10:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 21:10:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908021030.8FC542A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3550?compare_to=3542&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3550, Order: 163429, Start Time: 2012-09-07 23:27:59, End Time: 2012-09-08 02:11:42 To: 3542, Order: 163407, Start Time: 2012-09-07 20:16:15, End Time: 2012-09-07 22:59:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.13% (0.3446 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 12.09% (0.3465 => 0.3884, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 12.08% (0.3460 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3442 => 0.3857, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.04% (0.3488 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3469 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.61% (0.3643 => 0.4066, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.51% (0.3650 => 0.4070, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.78% (0.5826 => 0.6279, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.54% (0.5889 => 0.6333, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.51% (1.5932 => 1.7129, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.1619 => 0.1738, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.1505 => 0.1608, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (1.6211 => 1.7312, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.59% (3.5627 => 3.7974, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 6.51% (0.7171 => 0.7638, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.50% (1.3152 => 1.4007, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.42% (0.4361 => 0.4641, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (0.4994 => 0.5307, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2738 => 0.2908, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (0.5000 => 0.5306, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.09% (0.3004 => 0.3187, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (0.5026 => 0.5332, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.03% (0.5900 => 0.6256, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.2014 => 0.2133, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.85% (0.3060 => 0.3239, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.83% (1.0781 => 1.1410, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.79% (0.9697 => 1.0258, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.78% (4.2109 => 4.4544, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.70% (0.2875 => 0.3039, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 5.62% (0.2813 => 0.2971, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.57% (0.2566 => 0.2709, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.57% (0.2729 => 0.2881, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.55% (0.9909 => 1.0459, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (2.0673 => 2.1817, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2911 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2823 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.48% (0.2792 => 0.2945, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.47% (0.3362 => 0.3546, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.42% (0.2750 => 0.2899, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.40% (0.2780 => 0.2930, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3625 => 0.3820, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3267 => 0.3441, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2803 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (0.4658 => 0.4905, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.30% (0.2811 => 0.2960, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 5.16% (0.3258 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.12% (0.3124 => 0.3284, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.2866 => 0.3012, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.03% (0.3477 => 0.3652, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.00% (0.3317 => 0.3483, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4146 => 0.4352, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.95% (0.3678 => 0.3860, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.3282 => 0.3444, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.3348 => 0.3513, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3726 => 0.3909, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (0.3890 => 0.4080, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.85% (5.5417 => 5.8104, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.72% (1.9694 => 2.0623, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (2.7292 => 2.8571, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (2.1653 => 2.2655, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (2.1013 => 2.1977, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.56% (1.9966 => 2.0876, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3690 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (4.4195 => 4.6206, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (1.8794 => 1.9648, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 4.54% (0.4251 => 0.4444, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.50% (0.3845 => 0.4018, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.3271 => 0.3418, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.3903 => 0.4072, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.30% (0.3981 => 0.4152, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.28% (4.6177 => 4.8153, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 4.15% (1.4269 => 1.4861, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.13% (23.5202 => 24.4919, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 4.13% (0.5012 => 0.5219, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.13% (0.7875 => 0.8200, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 4.09% (0.6634 => 0.6905, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.75% (0.6435 => 0.6676, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.68% (0.5546 => 0.5750, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: 3.66% (0.3336 => 0.3458, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.04% (2.0346 => 2.0964, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.82% (0.3792 => 0.3899, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.68% (0.4847 => 0.4977, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (0.5361 => 0.5474, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (0.7426 => 0.7571, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (11.6398 => 11.7806, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6673, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std. dev.: 0.0409) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6516, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1982, std. dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std. dev.: 0.0222) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4473, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5875, std. dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4508, std. dev.: 0.0544) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5384, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7933, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7982, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0053) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (17.2379 => 16.8607, std. dev.: 0.0518) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9593, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 19:34:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 21:34:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908023427.0C2F22A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3551?compare_to=3547&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3551, Order: 163438, Start Time: 2012-09-08 01:21:11, End Time: 2012-09-08 02:35:38 To: 3547, Order: 163429, Start Time: 2012-09-07 23:38:25, End Time: 2012-09-08 00:52:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.10% (1.5228 => 1.5060, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.98% (2.0176 => 2.4207, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.05% (0.5748 => 0.6383, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.58% (0.7061 => 0.7808, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.7710 => 0.8512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.05% (3.9660 => 4.3645, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.98% (1.3693 => 1.5060, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.69% (0.7038 => 0.7720, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.30% (0.3646 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.23% (0.3663 => 0.4001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.08% (0.3789 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.02% (0.9199 => 1.0029, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.02% (1.2193 => 1.3293, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.85% (0.6959 => 0.7575, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.60% (1.4563 => 1.5816, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.59% (1.1364 => 1.2340, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.39% (0.3899 => 0.4226, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.31% (13.8202 => 14.9692, std. dev.: 0.0190) SingleSource/Regression/C++/ofstream_ctor: 8.31% (0.2781 => 0.3012, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.25% (0.5577 => 0.6037, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std. dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.99% (0.2127 => 0.2297, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.96% (0.3580 => 0.3865, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3485 => 0.3762, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.94% (7.2180 => 7.7909, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.93% (1.0313 => 1.1131, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.91% (0.3489 => 0.3765, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.91% (0.3022 => 0.3261, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.91% (0.2782 => 0.3002, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.90% (0.4379 => 0.4725, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6283 => 0.6778, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.3246 => 0.3500, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.80% (0.3756 => 0.4049, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.78% (0.7506 => 0.8090, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.77% (0.4390 => 0.4731, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.74% (0.3293 => 0.3548, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.74% (0.4791 => 0.5162, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.66% (0.2925 => 0.3149, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.65% (0.2914 => 0.3137, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.60% (1.9828 => 2.1335, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2607 => 0.2805, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.57% (13.2842 => 14.2903, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.57% (0.2655 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1865 => 0.2006, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.50% (0.2628 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.47% (0.2690 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.46% (0.2760 => 0.2966, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.46% (0.2761 => 0.2967, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4016 => 0.4314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.41% (0.2765 => 0.2970, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.2726 => 0.2928, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.40% (1.1061 => 1.1880, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 7.37% (3.8646 => 4.1494, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.34% (0.8310 => 0.8920, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.31% (3.6692 => 3.9376, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.2988 => 0.3205, std. dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 7.24% (0.3220 => 0.3453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3107 => 0.3329, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.14% (0.3192 => 0.3420, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.06% (0.3868 => 0.4141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3453 => 0.3693, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.92% (2.1791 => 2.3299, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.77% (1.3245 => 1.4142, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.76% (3.1889 => 3.4045, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 6.74% (1.9270 => 2.0568, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 6.66% (0.6744 => 0.7193, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.59% (0.4113 => 0.4384, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.52% (0.6135 => 0.6535, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 6.45% (1.2749 => 1.3571, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 6.38% (0.2945 => 0.3133, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.36% (16.6129 => 17.6703, std. dev.: 0.0159) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.26% (14.8535 => 15.7826, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.23% (4.3801 => 4.6530, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.20% (4.4433 => 4.7187, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.03% (1.3813 => 1.4646, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.00% (0.8818 => 0.9347, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.97% (1.3819 => 1.4644, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (8.4961 => 9.0008, std. dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 5.88% (0.3131 => 0.3315, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.8698 => 0.9208, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.76% (1.1333 => 1.1986, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.74% (14.5298 => 15.3634, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.67% (0.3755 => 0.3968, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2321 => 0.2451, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (6.5754 => 6.9337, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.32% (0.6576 => 0.6926, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.13% (1.2292 => 1.2923, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.05% (4.6629 => 4.8985, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 5.03% (16.2614 => 17.0792, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.85% (3.2742 => 3.4329, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.4805 => 0.5028, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.51% (0.9108 => 0.9519, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.24% (1.5188 => 1.5832, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.21% (4.9865 => 5.1966, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 4.11% (0.6250 => 0.6507, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 4.11% (3.7467 => 3.9006, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.02% (2.1007 => 2.1851, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2785 => 6.5079, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.59% (0.3511 => 0.3637, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.00% (33.2944 => 34.2947, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5067, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std. dev.: 0.0465) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.03% (1.2998 => 1.3782, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5469, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0878, std. dev.: 0.0791) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5929, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.28% (0.4657 => 0.3992, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.45% (22.5627 => 21.7846, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2583, std. dev.: 0.0175) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.15% (1.3780 => 1.2933, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.7688 => 1.7053, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9248, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.41% (8.8259 => 8.6134, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2393, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.60% (4.5928 => 4.5193, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2449, std. dev.: 0.0190) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4314, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2408, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 20:15:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 22:15:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908031538.0B5382A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3552?compare_to=3548&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3552, Order: 163438, Start Time: 2012-09-08 01:57:13, End Time: 2012-09-08 03:16:49 To: 3548, Order: 163431, Start Time: 2012-09-08 00:09:18, End Time: 2012-09-08 01:28:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (141 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.84% (14.5247 => 14.9371, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.01% (55.0374 => 56.6948, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.08% (10.3673 => 14.9371, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 25.71% (0.1622 => 0.2039, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.21% (2.2022 => 2.5152, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3516 => 0.4002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.70% (0.3561 => 0.4049, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.69% (7.0540 => 8.0198, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3497 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.63% (0.3543 => 0.4026, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3694 => 0.4180, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3828 => 0.4322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.83% (0.3927 => 0.4431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.79% (0.3886 => 0.4383, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.08% (1.7609 => 1.9560, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 7.65% (10.4361 => 11.2343, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.10% (0.8172 => 0.8752, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 7.05% (9.4845 => 10.1533, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.81% (0.2554 => 0.2728, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.4879 => 0.5211, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.4615 => 0.4929, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7433 => 0.7938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.77% (0.3307 => 0.3531, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (8.1363 => 8.6662, std. dev.: 0.0094) MultiSource/Applications/minisat/minisat: 6.47% (0.7115 => 0.7575, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.32% (1.5415 => 1.6389, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (4.2646 => 4.5336, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.6675 => 0.7096, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.25% (0.5105 => 0.5424, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5860 => 0.6223, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.19% (3.3354 => 3.5420, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.08% (0.7835 => 0.8311, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.07% (0.5569 => 0.5907, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (1.3050 => 1.3842, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.04% (4.9449 => 5.2436, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.93% (5.0018 => 5.2986, std. dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 5.93% (5.7591 => 6.1004, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.74% (0.3817 => 0.4036, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (14.3668 => 15.1753, std. dev.: 0.0182) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.53% (0.4103 => 0.4330, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.48% (0.8067 => 0.8509, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9765 => 1.0297, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.29% (1.5603 => 1.6429, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.23% (1.1642 => 1.2251, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1861 => 1.2481, std. dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 5.11% (0.3387 => 0.3560, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.09% (0.4299 => 0.4518, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.09% (0.3441 => 0.3616, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.08% (0.5020 => 0.5275, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 5.04% (1.0722 => 1.1262, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.89% (3.8723 => 4.0617, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.79% (0.4636 => 0.4858, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 4.76% (0.3422 => 0.3585, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.72% (2.0273 => 2.1229, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.64% (0.6450 => 0.6749, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (7.9617 => 8.3230, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6456 => 0.6747, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9371 => 22.9050, std. dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8921 => 0.9312, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.31% (2.2969 => 2.3960, std. dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.25% (0.3650 => 0.3805, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3826 => 0.3988, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.22% (0.2891 => 0.3013, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.22% (0.3865 => 0.4028, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.16% (0.4203 => 0.4378, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.5981 => 0.6227, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.3136 => 0.3264, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.07% (0.3098 => 0.3224, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.3684 => 0.3833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.94% (0.2793 => 0.2903, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 3.92% (0.2831 => 0.2942, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.90% (2.0665 => 2.1471, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4620 => 0.4800, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.4048 => 0.4205, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.87% (0.3052 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.81% (17.1811 => 17.8349, std. dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.80% (0.3162 => 0.3282, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3283 => 0.3407, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.4186 => 1.4721, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 3.75% (0.2877 => 0.2985, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3232 => 0.3350, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5859 => 1.6432, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2802 => 0.2903, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.37% (0.3379 => 0.3493, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (2.2024 => 2.2761, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.1840 => 1.2206, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 2.57% (1.2842 => 1.3172, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.8101 => 0.8270, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3835, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.38% (4.2280 => 4.3707, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.38% (2.2771 => 2.3086, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2259, std. dev.: 0.0110) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7618, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.90% (5.2763 => 3.2239, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.18% (5.3855 => 3.8681, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.79% (5.3526 => 3.8650, std. dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1208, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.98% (2.9384 => 2.5863, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -8.06% (22.1758 => 20.3879, std. dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2750, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7174, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5032, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4225, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9967, std. dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.38% (1.2373 => 1.2079, std. dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: -1.92% (4.6441 => 4.5551, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (8.1563 => 8.0251, std. dev.: 0.0119) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2229, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 20:20:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 22:20:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908032021.BAA6D2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3553?compare_to=3549&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3553, Order: 163449, Start Time: 2012-09-08 02:11:11, End Time: 2012-09-08 03:21:35 To: 3549, Order: 163438, Start Time: 2012-09-08 00:44:40, End Time: 2012-09-08 01:55:55 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (53 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (806 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.27% (0.7399 => 0.7937, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.94% (0.5418 => 0.5740, std. dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.61% (0.2964 => 0.3071, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.07% (1.1704 => 1.2063, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: 3.02% (0.7488 => 0.7714, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.82% (0.7592 => 0.7806, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.5338 => 0.5452, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.47% (1.4276 => 1.4486, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.46% (19.7348 => 21.9967, std. dev.: 0.7944) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.64% (0.2887 => 0.2992, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 3.49% (3.0251 => 3.1308, std. dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.07% (4.1089 => 4.1938, std. dev.: 0.0286) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (2.4304 => 2.4551, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.50% (0.1414 => 0.1520, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.67% (0.3582 => 0.3785, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6410 => 0.6769, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 4.33% (1.1653 => 1.2157, std. dev.: 0.0054) MultiSource/Applications/lemon/lemon: 3.94% (1.0046 => 1.0442, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: 3.56% (0.6173 => 0.6393, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.35% (1.1672 => 1.2063, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.21% (1.5150 => 1.5636, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (12.6413 => 12.9949, std. dev.: 0.1074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.7722 => 0.7937, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.5309 => 0.5452, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (1.4113 => 1.4486, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (1.3935 => 1.4238, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.13% (3.0225 => 3.0868, std. dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.7639 => 0.7788, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.0689 => 1.0857, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.39% (29.3170 => 29.7245, std. dev.: 0.0595) MultiSource/Benchmarks/mafft/pairlocalalign: 1.09% (8.2186 => 8.3085, std. dev.: 0.0192) MultiSource/Applications/hbd/hbd: 1.06% (1.3268 => 1.3408, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 1.04% (3.5980 => 3.6354, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0174) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.45% (0.0766 => 0.0892, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9994, std. dev.: 0.0102) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.27% (4.0101 => 4.5421, std. dev.: 0.0214) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.87% (0.0917 => 0.1035, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.06% (0.2694 => 0.2992, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 10.49% (0.3746 => 0.4139, std. dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 9.98% (0.1433 => 0.1576, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.89% (7.0025 => 7.6247, std. dev.: 0.0458) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.98% (0.2857 => 0.3085, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.46% (1.0063 => 1.0814, std. dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: 6.39% (1.0194 => 1.0845, std. dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.33% (40.4792 => 43.0430, std. dev.: 0.1541) SingleSource/Benchmarks/Shootout-C++/hash2: 6.07% (3.4876 => 3.6993, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8103, std. dev.: 0.0519) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.47% (15.2242 => 15.9048, std. dev.: 0.0403) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8731, std. dev.: 0.0432) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 2.51% (8.5113 => 8.7248, std. dev.: 0.0592) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.12% (2.4042 => 2.4551, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.06% (4.6127 => 4.7078, std. dev.: 0.0107) MultiSource/Benchmarks/BitBench/five11/five11: 1.97% (5.1938 => 5.2960, std. dev.: 0.0215) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6083, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4455 => 2.4786, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.5166 => 2.5505, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6702, std. dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (2.4971 => 2.5273, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.37% (5.2665 => 4.1938, std. dev.: 0.0286) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std. dev.: 0.0341) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9447, std. dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.24% (3.6254 => 3.3631, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -6.70% (3.4230 => 3.1938, std. dev.: 0.0317) SingleSource/Benchmarks/Misc/richards_benchmark: -6.17% (1.4441 => 1.3550, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7922, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4086, std. dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0536) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.94% (1.2959 => 1.2449, std. dev.: 0.0166) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.42% (1.2722 => 1.2287, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.20% (1.7361 => 1.6806, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: -3.03% (9.2503 => 8.9699, std. dev.: 0.0516) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1353, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std. dev.: 0.0032) MultiSource/Applications/aha/aha: -2.66% (3.4286 => 3.3373, std. dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: -2.65% (92.7467 => 90.2910, std. dev.: 0.4087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.63% (3.7496 => 3.6508, std. dev.: 0.0260) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.44% (0.4140 => 0.4039, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -2.09% (1.0926 => 1.0698, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.94% (62.4126 => 61.2023, std. dev.: 0.0847) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.94% (1.0686 => 1.0479, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.91% (61.1734 => 60.0047, std. dev.: 0.2729) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.74% (1.8739 => 1.8413, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2263, std. dev.: 0.0157) MultiSource/Benchmarks/sim/sim: -1.47% (3.8907 => 3.8336, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3139, std. dev.: 0.0383) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7680, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 21:17:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 23:17:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908041722.4DCCD2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3554?compare_to=3551&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3554, Order: 163451, Start Time: 2012-09-08 03:03:55, End Time: 2012-09-08 04:18:31 To: 3551, Order: 163438, Start Time: 2012-09-08 01:21:11, End Time: 2012-09-08 02:35:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.8324 => 56.5643, std. dev.: 0.0533) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.05% (78.0496 => 80.4295, std. dev.: 0.4663) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.74% (2.0176 => 2.4159, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.82% (0.1410 => 0.1633, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.00% (0.5818 => 0.6516, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.97% (0.7061 => 0.7906, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.86% (0.5748 => 0.6430, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3578 => 0.3951, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.29% (3.9660 => 4.3741, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.29% (0.7710 => 0.8503, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 10.26% (0.3663 => 0.4039, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.22% (0.3601 => 0.3969, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3623 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.12% (0.3646 => 0.4015, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 10.08% (0.3789 => 0.4171, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3650 => 0.4017, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.05% (1.3693 => 1.5069, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 9.99% (0.3914 => 0.4305, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.95% (0.1588 => 0.1746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.87% (0.4003 => 0.4398, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.71% (0.5265 => 0.5776, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.70% (0.3940 => 0.4322, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.39% (0.7038 => 0.7699, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.36% (0.9199 => 1.0060, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.31% (1.2193 => 1.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.14% (0.6959 => 0.7595, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.08% (0.2721 => 0.2968, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.97% (1.4563 => 1.5870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.85% (0.4328 => 0.4711, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.76% (1.1364 => 1.2360, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.45% (0.5577 => 0.6048, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.42% (13.8202 => 14.9845, std. dev.: 0.0079) SingleSource/Regression/C++/ofstream_ctor: 8.38% (0.2781 => 0.3014, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (7.2180 => 7.8207, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.31% (0.4379 => 0.4743, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2782 => 0.3012, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4062 => 0.4395, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.19% (0.3246 => 0.3512, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 8.09% (1.0313 => 1.1147, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.07% (0.7506 => 0.8112, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.97% (0.3489 => 0.3767, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3485 => 0.3762, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.6283 => 0.6782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.87% (0.4791 => 0.5168, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.87% (0.3293 => 0.3552, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.86% (0.2607 => 0.2812, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.85% (0.3756 => 0.4051, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.80% (0.2243 => 0.2418, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2655 => 0.2862, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.77% (1.9828 => 2.1368, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2761 => 0.2975, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.74% (1.1061 => 1.1917, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.71% (13.2842 => 14.3082, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 7.69% (0.2925 => 0.3150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (0.2628 => 0.2830, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.63% (0.2937 => 0.3161, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.62% (0.8310 => 0.8943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2726 => 0.2933, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.58% (0.2995 => 0.3222, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (3.6692 => 3.9456, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 7.52% (3.8646 => 4.1551, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 7.48% (0.3220 => 0.3461, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.46% (0.2696 => 0.2897, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.45% (0.5637 => 0.6057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.4016 => 0.4315, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 7.36% (0.2988 => 0.3208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3149 => 0.3380, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.21% (0.3192 => 0.3422, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.3868 => 0.4146, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.12% (0.3453 => 0.3699, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.12% (0.7460 => 0.7991, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.05% (3.1889 => 3.4138, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 7.01% (2.1791 => 2.3318, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.98% (1.3245 => 1.4170, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.97% (1.9270 => 2.0613, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3534 => 0.3780, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.90% (0.4113 => 0.4397, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.68% (1.2749 => 1.3601, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.67% (0.6744 => 0.7194, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 6.59% (0.2945 => 0.3139, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.52% (1.0594 => 1.1285, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.6135 => 0.6534, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.47% (4.3801 => 4.6637, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.47% (0.2504 => 0.2666, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.41% (1.3819 => 1.4705, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.38% (4.4433 => 4.7268, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 6.38% (16.6129 => 17.6728, std. dev.: 0.0246) MultiSource/Applications/JM/lencod/lencod: 6.37% (14.8535 => 15.7995, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 6.33% (0.2859 => 0.3040, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.31% (1.3813 => 1.4685, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.2140 => 0.2274, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 6.14% (8.4961 => 9.0174, std. dev.: 0.0170) MultiSource/Benchmarks/sim/sim: 6.13% (0.3131 => 0.3323, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.8698 => 0.9230, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (1.1333 => 1.2022, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.04% (0.8818 => 0.9351, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.01% (14.5298 => 15.4027, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.83% (0.3755 => 0.3974, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.55% (6.5754 => 6.9405, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.45% (0.3245 => 0.3422, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.40% (0.6576 => 0.6931, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.28% (1.2292 => 1.2941, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.24% (16.2614 => 17.1134, std. dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 5.19% (4.6629 => 4.9050, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.05% (3.2742 => 3.4394, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.87% (0.4805 => 0.5039, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.64% (0.9108 => 0.9531, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.49% (1.5188 => 1.5870, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 4.34% (3.7467 => 3.9093, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6250 => 0.6520, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.20% (2.1007 => 2.1890, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.19% (4.9865 => 5.1953, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (6.2785 => 6.5245, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.3511 => 0.3630, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.39% (33.2944 => 34.4217, std. dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 25.30% (1.8175 => 2.2773, std. dev.: 0.0437) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.74% (1.1560 => 1.2570, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4171, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.06% (1.2998 => 1.3786, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7332, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5488, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0977, std. dev.: 0.0551) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6062, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6023, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4442, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.59% (0.4657 => 0.4024, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.60% (22.5627 => 21.7511, std. dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.31% (20.3410 => 18.2436, std. dev.: 0.0357) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.16% (1.3780 => 1.2931, std. dev.: 0.0198) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std. dev.: 0.0167) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9248, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.8259 => 8.5522, std. dev.: 0.0255) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.5928 => 4.5210, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.29% (0.8342 => 0.8234, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8703, std. dev.: 0.0157) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2263, std. dev.: 0.0233) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4356, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2631, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 4.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 21:47:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Sep 2012 23:47:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908044705.35E282A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3555?compare_to=3553&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3555, Order: 163451, Start Time: 2012-09-08 03:36:59, End Time: 2012-09-08 04:48:18 To: 3553, Order: 163449, Start Time: 2012-09-08 02:11:11, End Time: 2012-09-08 03:21:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (49 on baseline) Performance Improvements: 2 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 2.07% (15.4337 => 15.7534, std. dev.: 0.1079) MultiSource/Applications/oggenc/oggenc: 1.83% (4.8088 => 4.8970, std. dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.36% (3.1561 => 3.4515, std. dev.: 0.0970) SingleSource/Benchmarks/Shootout-C++/sieve: 5.62% (3.6721 => 3.8784, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.36% (21.1828 => 22.1064, std. dev.: 0.2028) SingleSource/Benchmarks/Shootout/heapsort: 3.33% (3.1752 => 3.2810, std. dev.: 0.0369) MultiSource/Applications/SPASS/SPASS: 3.29% (8.3678 => 8.6435, std. dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.16% (1.4234 => 1.4541, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (3.1938 => 3.2409, std. dev.: 0.0115) MultiSource/Applications/lua/lua: 1.01% (29.8136 => 30.1159, std. dev.: 0.0785) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.79% (1.4486 => 1.4226, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.36% (1.2063 => 1.1899, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.6410 => 0.6776, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.42% (0.3582 => 0.3776, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.32% (1.0046 => 1.0580, std. dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 4.28% (1.1653 => 1.2152, std. dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 4.14% (2.1763 => 2.2663, std. dev.: 0.0208) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3217 => 0.3332, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.19% (4.7455 => 4.8970, std. dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (12.6413 => 13.0149, std. dev.: 0.0970) MultiSource/Applications/kimwitu++/kc: 2.89% (15.3105 => 15.7534, std. dev.: 0.1079) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.1827 => 1.2107, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (1.3935 => 1.4246, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.7639 => 0.7805, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.09% (29.3170 => 29.9293, std. dev.: 0.1882) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1672 => 1.1899, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.53% (4.2616 => 4.3270, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.2021 => 1.2203, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.33% (4.0318 => 4.0854, std. dev.: 0.0202) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.91% (1.6538 => 2.3304, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2291, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout/ary3: 15.00% (1.7426 => 2.0040, std. dev.: 0.0172) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.23% (4.0101 => 4.5406, std. dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/sieve: 12.72% (3.4406 => 3.8784, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 11.80% (0.3746 => 0.4188, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.54% (0.2694 => 0.2978, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 8.99% (7.0025 => 7.6323, std. dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.79% (1.0063 => 1.0847, std. dev.: 0.0223) SingleSource/Benchmarks/McGill/chomp: 6.44% (1.0194 => 1.0850, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3301 => 0.3513, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (27.1724 => 28.8191, std. dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/hash2: 5.86% (3.4876 => 3.6919, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: 4.58% (15.2242 => 15.9217, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.16% (40.4792 => 42.1624, std. dev.: 0.4637) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: 3.88% (0.9851 => 1.0233, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 2.49% (8.5113 => 8.7235, std. dev.: 0.0738) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.46% (2.6656 => 2.7311, std. dev.: 0.0234) MultiSource/Applications/lua/lua: 2.01% (29.5232 => 30.1159, std. dev.: 0.0785) MultiSource/Benchmarks/Olden/bh/bh: 1.87% (2.5166 => 2.5636, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4845, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 1.56% (14.4877 => 14.7134, std. dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5352, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.51% (1.4324 => 1.4541, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.49% (3.5520 => 3.6049, std. dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 1.30% (8.5323 => 8.6435, std. dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.29% (0.3497 => 0.2088, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.83% (5.2665 => 4.1167, std. dev.: 0.0705) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.82% (1.1647 => 0.9921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std. dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.04% (3.2007 => 2.9434, std. dev.: 0.0703) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3671, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std. dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: -5.32% (3.4230 => 3.2409, std. dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.11% (0.4564 => 0.4331, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4091, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/richards_benchmark: -4.88% (1.4441 => 1.3736, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.77% (1.7361 => 1.6707, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.72% (2.4457 => 2.3548, std. dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: -3.57% (62.4126 => 60.1819, std. dev.: 0.5195) SingleSource/Benchmarks/Shootout-C++/methcall: -3.56% (9.2503 => 8.9206, std. dev.: 0.0298) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.27% (3.7496 => 3.6269, std. dev.: 0.0382) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.90% (1.1683 => 1.1344, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2871, std. dev.: 0.0102) MultiSource/Benchmarks/PAQ8p/paq8p: -2.60% (92.7467 => 90.3313, std. dev.: 0.2522) MultiSource/Applications/aha/aha: -2.28% (3.4286 => 3.3503, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (9.3855 => 9.2381, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7658, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.37% (3.8907 => 3.8374, std. dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3329, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/tsp/tsp: -1.19% (1.7330 => 1.7124, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1116 => 1.1002, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 22:03:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 00:03:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908050316.E26962A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3556?compare_to=3552&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3556, Order: 163451, Start Time: 2012-09-08 03:44:53, End Time: 2012-09-08 05:04:28 To: 3552, Order: 163438, Start Time: 2012-09-08 01:57:13, End Time: 2012-09-08 03:16:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (139 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.45% (78.2374 => 80.1556, std. dev.: 0.1475) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.53% (14.9371 => 14.5595, std. dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.44% (10.3673 => 14.5595, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.65% (2.2022 => 2.5029, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.35% (7.0540 => 7.9958, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 12.97% (0.3516 => 0.3972, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.93% (0.3497 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.92% (0.3561 => 0.4021, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3543 => 0.3999, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.17% (0.3828 => 0.4294, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.50% (1.7609 => 1.9634, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.62% (0.3282 => 0.3565, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.37% (0.1625 => 0.1761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.6030 => 0.6500, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.8172 => 0.8747, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 7.03% (10.4361 => 11.1693, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7326 => 0.7832, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 6.89% (9.4845 => 10.1376, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 6.58% (0.2554 => 0.2722, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.52% (0.2271 => 0.2419, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.47% (8.1363 => 8.6627, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.30% (0.2700 => 0.2870, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.27% (0.7115 => 0.7561, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.26% (0.5860 => 0.6227, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.22% (0.7835 => 0.8322, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (1.5415 => 1.6344, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.99% (1.3050 => 1.3832, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (4.2646 => 4.5201, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.98% (0.6675 => 0.7074, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.89% (4.9449 => 5.2363, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5569 => 0.5896, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.85% (5.0018 => 5.2942, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 5.84% (3.3354 => 3.5303, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.84% (0.5105 => 0.5403, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2758 => 0.2914, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.52% (5.7591 => 6.0771, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.8067 => 0.8507, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.40% (1.5603 => 1.6445, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.4103 => 0.4324, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9765 => 1.0287, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.34% (0.3092 => 0.3257, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4299 => 0.4527, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (14.3668 => 15.1242, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 5.25% (0.3180 => 0.3347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.00% (0.3817 => 0.4008, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.00% (0.5020 => 0.5271, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.97% (0.3136 => 0.3292, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.96% (0.4636 => 0.4866, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.87% (1.1642 => 1.2209, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (1.1861 => 1.2434, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.73% (0.3422 => 0.3584, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.68% (3.8723 => 4.0536, std. dev.: 0.0120) MultiSource/Applications/lemon/lemon: 4.66% (1.0722 => 1.1222, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3826 => 0.4000, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (7.9617 => 8.3223, std. dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6450 => 0.6738, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.38% (2.0273 => 2.1160, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6456 => 0.6730, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.22% (0.3865 => 0.4028, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8921 => 0.9294, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.11% (21.9371 => 22.8381, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4289 => 0.4464, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.99% (2.2969 => 2.3886, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3684 => 0.3830, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.95% (0.4203 => 0.4369, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.89% (2.0665 => 2.1469, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2831 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4048 => 0.4203, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2872 => 0.2981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.79% (0.2877 => 0.2986, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.5981 => 0.6207, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 3.77% (0.3603 => 0.3739, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3162 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.72% (0.3283 => 0.3405, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3232 => 0.3352, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.70% (0.4620 => 0.4791, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.68% (1.4186 => 1.4708, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.61% (17.1811 => 17.8006, std. dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2802 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.29% (1.5859 => 1.6381, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.28% (0.3379 => 0.3490, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.2024 => 2.2679, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2177, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.54% (1.2842 => 1.3168, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.8101 => 0.8255, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 6.74% (1.1396 => 1.2164, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7579, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3618, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2191, std. dev.: 0.0180) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5752, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7604, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2307, std. dev.: 0.0223) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.10% (5.3855 => 3.8721, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.78% (5.3526 => 3.8659, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1258, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.03% (2.9384 => 2.5848, std. dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -7.98% (22.1758 => 20.4059, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4182, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2976, std. dev.: 0.1114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std. dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5769, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std. dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5066, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4313, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0055, std. dev.: 0.0169) SingleSource/Benchmarks/McGill/chomp: -2.13% (1.2373 => 1.2109, std. dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5534, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0085, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std. dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 22:22:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 00:22:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908052234.6B5A02A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3557?compare_to=3550&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3557, Order: 163449, Start Time: 2012-09-08 02:39:52, End Time: 2012-09-08 05:23:46 To: 3550, Order: 163429, Start Time: 2012-09-07 23:27:59, End Time: 2012-09-08 02:11:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.96% (123.6215 => 129.7522, std. dev.: 0.9894) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.42% (0.3446 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.39% (0.3488 => 0.3990, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3496 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3469 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.56% (0.3650 => 0.4145, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5826 => 0.6339, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5889 => 0.6399, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.27% (1.6211 => 1.7389, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (3.5627 => 3.8184, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7171 => 0.7682, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.67% (1.3152 => 1.4029, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.55% (0.2014 => 0.2146, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.48% (1.5932 => 1.6965, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.46% (0.5900 => 0.6281, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.35% (0.4361 => 0.4638, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (0.3930 => 0.4175, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.13% (0.4994 => 0.5300, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 6.12% (4.2109 => 4.4684, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.5000 => 0.5305, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.08% (0.4029 => 0.4274, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (0.5026 => 0.5321, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.3004 => 0.3179, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.74% (0.2875 => 0.3040, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.65% (0.9909 => 1.0469, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.2866 => 0.3027, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.53% (1.0781 => 1.1377, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2813 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.41% (0.2738 => 0.2886, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.38% (0.2823 => 0.2975, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.38% (0.2750 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.35% (0.3195 => 0.3366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.34% (0.2792 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.31% (0.2729 => 0.2874, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.28% (0.4658 => 0.4904, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2780 => 0.2926, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.25% (2.7292 => 2.8725, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2803 => 0.2950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.23% (2.0673 => 2.1754, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 5.16% (0.2811 => 0.2956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3096 => 0.3255, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.10% (5.5417 => 5.8241, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (0.3890 => 0.4088, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.08% (0.2911 => 0.3059, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3060 => 0.3214, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3267 => 0.3431, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.3258 => 0.3421, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.95% (0.9697 => 1.0177, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.94% (1.9694 => 2.0666, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 4.87% (0.2566 => 0.2691, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (1.9966 => 2.0938, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.87% (0.3124 => 0.3276, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.83% (0.3477 => 0.3645, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3317 => 0.3476, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.75% (2.1013 => 2.2012, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.74% (0.3903 => 0.4088, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.73% (0.3845 => 0.4027, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.3271 => 0.3425, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3625 => 0.3795, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (1.8794 => 1.9672, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 4.67% (0.3726 => 0.3900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.63% (0.3348 => 0.3503, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.3678 => 0.3847, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.54% (0.3282 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (4.4195 => 4.6147, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.36% (0.3690 => 0.3851, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.36% (2.1653 => 2.2597, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.4139 => 0.4318, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 4.31% (4.6177 => 4.8167, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4146 => 0.4324, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4251 => 0.4432, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.21% (1.4269 => 1.4870, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.14% (0.2969 => 0.3092, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.13% (0.7875 => 0.8200, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.10% (23.5202 => 24.4845, std. dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.3981 => 0.4141, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.98% (0.6634 => 0.6898, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.88% (0.5546 => 0.5761, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.5012 => 0.5191, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.6435 => 0.6661, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.59% (2.0346 => 2.0873, std. dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.46% (0.4847 => 0.4966, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (0.7426 => 0.7549, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (11.6398 => 11.7947, std. dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (4.6926 => 4.7423, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6740, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6366, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1970, std. dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5066, std. dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4526, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5877, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5451, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9743, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.10% (0.6293 => 0.6161, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -1.92% (17.2379 => 16.9061, std. dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9559, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.4998, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 23:00:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 01:00:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908060005.8E8572A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3558?compare_to=3554&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3558, Order: 163453, Start Time: 2012-09-08 04:46:47, End Time: 2012-09-08 06:01:17 To: 3554, Order: 163451, Start Time: 2012-09-08 03:03:55, End Time: 2012-09-08 04:18:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.57% (2.0176 => 2.4124, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.48% (0.5818 => 0.6486, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.06% (0.7061 => 0.7842, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3578 => 0.3948, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.19% (0.7710 => 0.8496, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-4: 10.18% (0.3646 => 0.4017, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.14% (0.3601 => 0.3966, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.08% (3.9660 => 4.3657, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.08% (0.1588 => 0.1748, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3663 => 0.4026, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.77% (0.4003 => 0.4394, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.75% (0.2596 => 0.2849, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.63% (1.3693 => 1.5012, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.62% (0.3940 => 0.4319, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.52% (0.5265 => 0.5766, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.31% (0.9199 => 1.0055, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.14% (1.2193 => 1.3308, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.12% (0.7038 => 0.7680, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.98% (0.6959 => 0.7584, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.72% (1.4563 => 1.5833, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.63% (1.1364 => 1.2345, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 8.38% (13.8202 => 14.9787, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.32% (0.5577 => 0.6041, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.11% (7.2180 => 7.8032, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.4379 => 0.4728, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.6283 => 0.6782, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.93% (0.4791 => 0.5171, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.93% (0.3899 => 0.4208, std. dev.: 0.0110) MultiSource/Applications/lemon/lemon: 7.91% (1.0313 => 1.1129, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.81% (0.2995 => 0.3229, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.68% (13.2842 => 14.3039, std. dev.: 0.0096) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.65% (0.3489 => 0.3756, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.51% (0.3756 => 0.4038, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.50% (1.1061 => 1.1891, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.50% (0.3293 => 0.3540, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.42% (0.8310 => 0.8927, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.40% (3.6692 => 3.9408, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3220 => 0.3456, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.32% (1.9828 => 2.1280, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.28% (3.8646 => 4.1458, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.22% (0.2937 => 0.3149, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.7460 => 0.7975, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 6.89% (0.3192 => 0.3412, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.88% (3.1889 => 3.4084, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.82% (1.3245 => 1.4148, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.81% (0.4390 => 0.4689, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.79% (2.1791 => 2.3270, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 6.78% (0.3453 => 0.3687, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.68% (1.9270 => 2.0557, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.58% (0.6744 => 0.7188, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.56% (0.4113 => 0.4383, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (1.2749 => 1.3573, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 6.38% (1.0594 => 1.1270, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.34% (14.8535 => 15.7955, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.29% (0.6135 => 0.6521, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.27% (4.3801 => 4.6549, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.23% (4.4433 => 4.7202, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2504 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.16% (0.3131 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.12% (0.8818 => 0.9358, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.07% (1.3813 => 1.4652, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.06% (1.3819 => 1.4656, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.04% (16.6129 => 17.6168, std. dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (8.4961 => 9.0095, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.98% (0.6576 => 0.6969, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.96% (0.8698 => 0.9216, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.87% (1.1333 => 1.1998, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.78% (14.5298 => 15.3691, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.65% (0.3755 => 0.3967, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (6.5754 => 6.9455, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.30% (0.3245 => 0.3417, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.07% (16.2614 => 17.0855, std. dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 4.91% (4.6629 => 4.8920, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.86% (3.2742 => 3.4333, std. dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2292 => 1.2888, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.75% (0.4805 => 0.5033, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.52% (0.9108 => 0.9520, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (1.5188 => 1.5830, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.16% (3.7467 => 3.9027, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (2.1007 => 2.1867, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.09% (4.9865 => 5.1904, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.02% (6.2785 => 6.5311, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6250 => 0.6498, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.59% (0.3511 => 0.3637, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.86% (33.2944 => 34.2464, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5150, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (3.1736 => 3.4178, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0770, std. dev.: 0.0640) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5844, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5157, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std. dev.: 0.0075) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.01% (7.9275 => 8.0076, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.76% (0.4657 => 0.4016, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.66% (22.5627 => 21.7360, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2907, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3034, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1515, std. dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: -3.31% (3.0263 => 2.9260, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5902, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2387, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5199, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2439, std. dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: -1.15% (4.4810 => 4.4295, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2589, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2392, std. dev.: 0.0335) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5643, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 23:14:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 01:14:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908061425.5D9052A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3559?compare_to=3555&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3559, Order: 163457, Start Time: 2012-09-08 05:04:09, End Time: 2012-09-08 06:15:37 To: 3555, Order: 163451, Start Time: 2012-09-08 03:36:59, End Time: 2012-09-08 04:48:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (44 on baseline) Performance Improvements: 8 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.23% (2.2847 => 2.3584, std. dev.: 0.0202) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (60.1819 => 61.2076, std. dev.: 0.1505) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.17% (0.3252 => 0.3084, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.26% (0.6103 => 0.5904, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.77% (0.9063 => 0.8812, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.56% (0.5752 => 0.5605, std. dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: -2.46% (4.8970 => 4.7766, std. dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.02% (1.2841 => 1.2582, std. dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: -1.96% (15.7534 => 15.4443, std. dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.37% (8.3906 => 8.2753, std. dev.: 0.0332) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.30% (0.6410 => 0.6750, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.00% (0.3582 => 0.3761, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 4.13% (1.1653 => 1.2134, std. dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 3.96% (2.1763 => 2.2625, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.80% (3.0225 => 3.0770, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (1.3935 => 1.4167, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.65% (0.6069 => 0.6169, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.42% (29.3170 => 29.7325, std. dev.: 0.0929) MultiSource/Applications/siod/siod: 1.37% (2.0972 => 2.1260, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.30% (1.6538 => 2.3369, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.84% (0.0766 => 0.0918, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 14.89% (1.7426 => 2.0021, std. dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.62% (4.0101 => 4.5564, std. dev.: 0.0078) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8804, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/misr: 11.73% (0.4296 => 0.4800, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6241, std. dev.: 0.0372) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.77% (1.0063 => 1.0946, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.09% (0.2857 => 0.3088, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 7.29% (1.0194 => 1.0937, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (3.4876 => 3.7003, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.07% (4.2129 => 4.4685, std. dev.: 0.0759) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8083, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 3.70% (15.2242 => 15.7874, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.29% (0.8498 => 0.8778, std. dev.: 0.0074) MultiSource/Benchmarks/BitBench/five11/five11: 3.21% (5.1938 => 5.3604, std. dev.: 0.0495) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.05% (0.3508 => 0.3615, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 2.64% (1.4184 => 1.4558, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.54% (0.5876 => 0.6025, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 2.46% (8.5113 => 8.7211, std. dev.: 0.0745) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.42% (2.6656 => 2.7302, std. dev.: 0.0153) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.55% (4.6127 => 4.6842, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 1.32% (2.5166 => 2.5497, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.31% (3.5520 => 3.5985, std. dev.: 0.0109) MultiSource/Applications/lua/lua: 1.31% (29.5232 => 29.9091, std. dev.: 0.0552) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6745, std. dev.: 0.0240) MultiSource/Benchmarks/Bullet/bullet: 1.17% (6.9722 => 7.0537, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.40% (0.9029 => 0.8812, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.35% (0.5740 => 0.5605, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.95% (0.3497 => 0.2065, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.30% (5.2665 => 4.1975, std. dev.: 0.2476) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.07% (1.1647 => 0.9892, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1570, std. dev.: 0.0350) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9454, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.06% (3.6254 => 3.3696, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -6.80% (3.4230 => 3.1902, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3510, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/strcat: -6.31% (0.1727 => 0.1618, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.09% (2.4457 => 2.3211, std. dev.: 0.0375) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.83% (4.6355 => 4.4115, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.64% (0.4140 => 0.3948, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7619, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.49% (1.2959 => 1.2377, std. dev.: 0.0213) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.33% (45.4683 => 43.9551, std. dev.: 0.4953) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: -3.24% (9.2503 => 8.9510, std. dev.: 0.0355) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.14% (1.1683 => 1.1316, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.87% (1.7361 => 1.6863, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2865, std. dev.: 0.0058) MultiSource/Applications/aha/aha: -2.63% (3.4286 => 3.3385, std. dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -2.57% (92.7467 => 90.3597, std. dev.: 0.2061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.32% (3.7496 => 3.6627, std. dev.: 0.0260) MultiSource/Benchmarks/mafft/pairlocalalign: -1.93% (62.4126 => 61.2076, std. dev.: 0.1505) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2301, std. dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.39% (3.8907 => 3.8365, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7678, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3154, std. dev.: 0.0359) MultiSource/Benchmarks/Olden/tsp/tsp: -1.34% (1.7330 => 1.7097, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 7 23:51:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 01:51:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908065133.7800E2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3560?compare_to=3556&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3560, Order: 163458, Start Time: 2012-09-08 05:33:09, End Time: 2012-09-08 06:52:44 To: 3556, Order: 163451, Start Time: 2012-09-08 03:44:53, End Time: 2012-09-08 05:04:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (133 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (14.5595 => 14.7063, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.45% (1.2968 => 1.3156, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.85% (10.3673 => 14.7063, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: 26.51% (0.1622 => 0.2052, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.74% (2.2022 => 2.5048, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 13.50% (0.3473 => 0.3942, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.35% (7.0540 => 7.9959, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3543 => 0.4013, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.24% (0.3543 => 0.4012, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.13% (0.3497 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3561 => 0.4025, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.00% (0.3516 => 0.3973, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 12.92% (0.1432 => 0.1617, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.51% (0.3694 => 0.4156, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.36% (0.3828 => 0.4301, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3927 => 0.4410, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.18% (1.1194 => 1.2557, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.07% (0.3886 => 0.4355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.32% (1.7609 => 1.9603, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.92% (0.1440 => 0.1554, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.55% (10.4361 => 11.2242, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.40% (0.4879 => 0.5240, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.37% (9.4845 => 10.1836, std. dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.8172 => 0.8761, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.85% (0.2700 => 0.2885, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.84% (0.5860 => 0.6261, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7433 => 0.7939, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.4615 => 0.4929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.77% (0.3307 => 0.3531, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.69% (0.7326 => 0.7816, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.56% (0.7115 => 0.7582, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.56% (8.1363 => 8.6698, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.51% (0.3423 => 0.3646, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.44% (0.5105 => 0.5434, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.43% (0.6675 => 0.7104, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (1.3050 => 1.3881, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (4.2646 => 4.5359, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.34% (0.1940 => 0.2063, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.34% (1.5415 => 1.6392, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 6.27% (0.7835 => 0.8326, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.5569 => 0.5917, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.22% (5.0018 => 5.3130, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 6.21% (3.3354 => 3.5425, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.15% (4.9449 => 5.2490, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.75% (5.7591 => 6.0904, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (14.3668 => 15.1894, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.8067 => 0.8526, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.68% (0.9765 => 1.0320, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4299 => 0.4537, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.50% (1.5603 => 1.6461, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 5.42% (1.1642 => 1.2273, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3441 => 0.3624, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1861 => 1.2491, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.24% (0.3817 => 0.4017, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.23% (0.3387 => 0.3564, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 5.02% (1.0722 => 1.1260, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 5.02% (3.8723 => 4.0666, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.90% (0.5020 => 0.5266, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.78% (2.0273 => 2.1243, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.78% (0.6450 => 0.6758, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (7.9617 => 8.3375, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.48% (2.2969 => 2.3998, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/football/football: 4.45% (0.8921 => 0.9318, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.4103 => 0.4285, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4636 => 0.4840, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.3422 => 0.3572, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5981 => 0.6240, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6456 => 0.6735, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.29% (21.9371 => 22.8787, std. dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (0.4064 => 0.4238, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.03% (0.2905 => 0.3022, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.95% (0.4048 => 0.4208, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (1.4186 => 1.4746, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.90% (0.4203 => 0.4367, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.89% (17.1811 => 17.8488, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sieve: 3.83% (0.3603 => 0.3741, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.79% (0.3136 => 0.3255, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.76% (0.2871 => 0.2979, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.69% (0.3684 => 0.3820, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.64% (1.5859 => 1.6437, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.59% (0.4620 => 0.4786, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.52% (2.0665 => 2.1393, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.2024 => 2.2760, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.23% (0.3283 => 0.3389, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.1840 => 1.2220, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3125, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.8101 => 0.8276, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.72% (0.2944 => 0.3289, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (3.1578 => 3.3839, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (4.2280 => 4.3730, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7522, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2230, std. dev.: 0.0231) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.10% (2.2771 => 2.3021, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5796, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7606, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.43% (5.2763 => 3.2487, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.26% (5.3855 => 3.8634, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.90% (5.3526 => 3.8593, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2054, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.53% (2.9384 => 2.5997, std. dev.: 0.0167) MultiSource/Applications/ClamAV/clamscan: -7.87% (22.1758 => 20.4311, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (19.9488 => 18.2429, std. dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7162, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.08% (1.5835 => 1.5030, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.07% (3.2827 => 3.1492, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.16% (8.6802 => 8.4061, std. dev.: 0.0282) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5085, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0048, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.23% (1.2373 => 1.2097, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5530, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6779, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0140, std. dev.: 0.0115) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5087, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 00:41:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 02:41:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908074123.9EB562A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3561?compare_to=3559&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3561, Order: 163458, Start Time: 2012-09-08 06:31:07, End Time: 2012-09-08 07:42:37 To: 3559, Order: 163457, Start Time: 2012-09-08 05:04:09, End Time: 2012-09-08 06:15:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (48 on baseline) Performance Improvements: 2 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 878 (814 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3084 => 0.3201, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.32% (0.4461 => 0.4609, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5605 => 0.5763, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7604 => 0.7761, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.85% (0.5904 => 0.6013, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.76% (0.7573 => 0.7706, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.39% (1.1731 => 1.1894, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.32% (1.3230 => 1.3404, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.3211 => 2.3864, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.78% (4.1975 => 4.2723, std. dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 1.34% (8.3483 => 8.4598, std. dev.: 0.0362) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.20% (1.2377 => 1.2526, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -1.62% (4.4685 => 4.3962, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.28% (1.6863 => 1.6647, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.56% (0.6410 => 0.6702, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 4.23% (0.3217 => 0.3353, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 4.22% (2.1763 => 2.2682, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3.88% (1.1653 => 1.2105, std. dev.: 0.0072) MultiSource/Applications/lemon/lemon: 3.60% (1.0046 => 1.0408, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: 3.48% (0.6173 => 0.6388, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.28% (3.0225 => 3.0915, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (12.6413 => 12.9262, std. dev.: 0.0540) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.7639 => 0.7788, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.1672 => 1.1894, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.1827 => 1.2035, std. dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.65% (13.3238 => 13.5431, std. dev.: 0.0122) MultiSource/Applications/Burg/burg: 1.63% (1.1440 => 1.1627, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.46% (1.2021 => 1.2196, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (4.0318 => 4.0825, std. dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 1.21% (29.3170 => 29.6722, std. dev.: 0.0921) MultiSource/Applications/siod/siod: 1.13% (2.0972 => 2.1209, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 1.03% (1.3268 => 1.3404, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (6.2546 => 6.3186, std. dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std. dev.: 0.0014) SingleSource/Benchmarks/Stanford/Bubblesort: 41.06% (0.0263 => 0.0371, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 15.43% (1.7426 => 2.0115, std. dev.: 0.0287) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.16% (0.0917 => 0.1056, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.85% (4.0101 => 4.5654, std. dev.: 0.0182) SingleSource/Benchmarks/McGill/misr: 13.55% (0.4296 => 0.4878, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 12.70% (3.4406 => 3.8776, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0055) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.87% (0.2694 => 0.2933, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6237, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.16% (1.0063 => 1.0884, std. dev.: 0.0142) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8141, std. dev.: 0.0767) SingleSource/Benchmarks/Shootout-C++/hash2: 5.86% (3.4876 => 3.6918, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.3301 => 0.3481, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.35% (4.2129 => 4.3962, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5421, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.85% (15.2242 => 15.8105, std. dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 3.20% (1.4184 => 1.4638, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5113 => 8.7559, std. dev.: 0.0396) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.40% (0.5587 => 0.5721, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.79% (4.6127 => 4.6952, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 1.43% (3.5520 => 3.6027, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (2.4971 => 2.5296, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6708, std. dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.03% (0.3497 => 0.2097, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.88% (5.2665 => 4.2723, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.78% (1.1647 => 0.9926, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.80% (3.2007 => 2.9509, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.43% (3.6254 => 3.3560, std. dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: -6.78% (3.4230 => 3.1909, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/richards_benchmark: -6.53% (1.4441 => 1.3498, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.03% (4.6355 => 4.4024, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.67% (3.9413 => 3.7572, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.11% (1.7361 => 1.6647, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (9.2503 => 8.9014, std. dev.: 0.0577) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.34% (1.2959 => 1.2526, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.17% (1.1683 => 1.1313, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -3.15% (62.4126 => 60.4442, std. dev.: 0.3925) MultiSource/Applications/aha/aha: -2.86% (3.4286 => 3.3306, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2867, std. dev.: 0.0257) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4140 => 0.4030, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.42% (2.4457 => 2.3864, std. dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.7967, std. dev.: 0.5614) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2168, std. dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.68% (3.7496 => 3.6867, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3143, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: -1.20% (3.8200 => 3.7740, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 00:45:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 02:45:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908074530.41F072A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3562?compare_to=3558&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3562, Order: 163458, Start Time: 2012-09-08 06:29:35, End Time: 2012-09-08 07:46:42 To: 3558, Order: 163453, Start Time: 2012-09-08 04:46:47, End Time: 2012-09-08 06:01:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.82% (2.0176 => 2.4175, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.09% (0.5818 => 0.6463, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.93% (0.5748 => 0.6376, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.68% (0.7061 => 0.7815, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.46% (3.9660 => 4.3809, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.7710 => 0.8512, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.20% (0.3578 => 0.3943, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.07% (0.3663 => 0.4032, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.01% (0.3646 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.00% (0.3601 => 0.3961, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.99% (1.3693 => 1.5061, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.83% (0.3623 => 0.3979, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 9.66% (0.7038 => 0.7718, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 9.64% (0.4003 => 0.4389, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.63% (0.5265 => 0.5772, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/property: 9.62% (0.3940 => 0.4319, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.55% (1.2193 => 1.3357, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.49% (0.9199 => 1.0072, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.17% (0.6959 => 0.7597, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.11% (0.2721 => 0.2969, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.07% (1.4563 => 1.5884, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.93% (1.1364 => 1.2379, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.62% (0.5577 => 0.6058, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.53% (13.8202 => 14.9984, std. dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.31% (1.0313 => 1.1170, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (7.2180 => 7.8165, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.29% (0.4379 => 0.4742, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.29% (0.7506 => 0.8128, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.24% (0.6283 => 0.6801, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.23% (0.3246 => 0.3513, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.14% (0.4791 => 0.5181, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.05% (0.2995 => 0.3236, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 7.77% (0.8310 => 0.8956, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.77% (13.2842 => 14.3162, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/18-imp/imp: 7.76% (0.3220 => 0.3470, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 7.76% (0.2925 => 0.3152, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.74% (1.1061 => 1.1917, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: 7.67% (0.2243 => 0.2415, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.2781 => 0.2994, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 7.64% (3.8646 => 4.1600, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (3.6692 => 3.9492, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.41% (0.3022 => 0.3246, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4390 => 0.4715, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.40% (0.7460 => 0.8012, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.40% (0.5637 => 0.6054, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3580 => 0.3844, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 7.26% (2.1791 => 2.3374, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.3756 => 0.4026, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.3245 => 1.4195, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 7.17% (0.4113 => 0.4408, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3293 => 0.3528, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.13% (1.9270 => 2.0643, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2966 => 0.3177, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.09% (3.1889 => 3.4150, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.99% (1.9828 => 2.1214, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.98% (0.6744 => 0.7215, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.93% (1.2749 => 1.3632, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4016 => 0.4294, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (1.0594 => 1.1306, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.66% (1.3819 => 1.4740, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.65% (4.4433 => 4.7390, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.65% (4.3801 => 4.6712, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.3868 => 0.4124, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.60% (1.3813 => 1.4724, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 6.59% (14.8535 => 15.8321, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.58% (0.8818 => 0.9398, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.57% (0.6135 => 0.6538, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.2859 => 0.3044, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 6.33% (16.6129 => 17.6652, std. dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 6.31% (8.4961 => 9.0322, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 6.26% (0.3131 => 0.3327, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.17% (14.5298 => 15.4264, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (1.1333 => 1.2031, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.05% (0.8698 => 0.9224, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.85% (0.6576 => 0.6961, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.82% (0.2321 => 0.2456, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (6.5754 => 6.9528, std. dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 5.38% (16.2614 => 17.1363, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.3245 => 0.3418, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.09% (4.6629 => 4.9002, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (0.9108 => 0.9550, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.80% (1.2292 => 1.2882, std. dev.: 0.0112) MultiSource/Applications/lua/lua: 4.76% (3.7467 => 3.9251, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.73% (1.5188 => 1.5906, std. dev.: 0.0213) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (6.2785 => 6.5476, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.67% (0.3511 => 0.3640, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.13% (33.2944 => 34.3360, std. dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5138, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0460) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.54% (3.1736 => 3.4130, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7324, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5484, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.52% (10.7476 => 11.1256, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5997, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0081) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4459, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5938, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.10% (7.9275 => 8.0146, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.70% (0.4657 => 0.4019, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.34% (22.5627 => 21.8089, std. dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.33% (20.3410 => 18.2394, std. dev.: 0.0447) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2936, std. dev.: 0.0304) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5156, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1513, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9229, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6077, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.5928 => 4.5212, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2336, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2225, std. dev.: 0.0392) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 01:36:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 03:36:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908083657.44C922A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3563?compare_to=3557&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3563, Order: 163458, Start Time: 2012-09-08 05:51:58, End Time: 2012-09-08 08:38:08 To: 3557, Order: 163449, Start Time: 2012-09-08 02:39:52, End Time: 2012-09-08 05:23:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.24% (1.0177 => 1.0303, std. dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.64% (0.3469 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/property: 13.04% (0.3650 => 0.4126, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5826 => 0.6344, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.83% (0.5889 => 0.6409, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (3.5627 => 3.8236, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.19% (0.4994 => 0.5353, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (1.6211 => 1.7376, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.17% (0.7171 => 0.7685, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 6.97% (1.5932 => 1.7043, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (0.3930 => 0.4202, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.88% (0.5900 => 0.6306, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.86% (0.4361 => 0.4660, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.80% (1.3152 => 1.4046, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.67% (0.5026 => 0.5361, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.66% (0.1968 => 0.2099, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (0.2014 => 0.2147, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.50% (0.5000 => 0.5325, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.25% (0.9697 => 1.0303, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2875 => 0.3053, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.19% (4.2109 => 4.4716, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2738 => 0.2902, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.98% (0.3195 => 0.3386, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 5.96% (0.9909 => 1.0500, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.3004 => 0.3179, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2729 => 0.2886, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.74% (0.2803 => 0.2964, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.73% (1.0781 => 1.1399, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2823 => 0.2984, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.68% (0.3096 => 0.3272, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.62% (0.2792 => 0.2949, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2811 => 0.2969, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.61% (0.2780 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2813 => 0.2970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.56% (0.2750 => 0.2903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.2866 => 0.3025, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.53% (2.7292 => 2.8802, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.50% (2.0673 => 2.1810, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2911 => 0.3071, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.46% (0.2566 => 0.2706, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.44% (0.3124 => 0.3294, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3060 => 0.3225, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (1.9694 => 2.0751, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.2736 => 0.2882, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3267 => 0.3441, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.33% (5.5417 => 5.8368, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3258 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (0.4658 => 0.4902, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (1.9966 => 2.0998, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.13% (0.3317 => 0.3487, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.3362 => 0.3533, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 5.05% (0.3726 => 0.3914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.03% (0.3678 => 0.3863, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.00% (0.3282 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (0.3890 => 0.4084, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.96% (0.3348 => 0.3514, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3477 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.3625 => 0.3804, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.89% (2.1013 => 2.2041, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.3903 => 0.4090, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (1.8794 => 1.9681, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.72% (0.3690 => 0.3864, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.71% (4.4195 => 4.6276, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash: 4.68% (0.4146 => 0.4340, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.59% (0.4139 => 0.4329, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.59% (0.4251 => 0.4446, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.3271 => 0.3418, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 4.46% (1.4269 => 1.4906, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 4.45% (4.6177 => 4.8230, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.44% (0.3336 => 0.3484, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.42% (23.5202 => 24.5598, std. dev.: 0.0266) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.3845 => 0.4014, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 4.36% (2.1653 => 2.2598, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 4.36% (0.6634 => 0.6923, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.32% (0.3981 => 0.4153, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.31% (0.2691 => 0.2807, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.23% (0.7875 => 0.8208, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.22% (0.5546 => 0.5780, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.2969 => 0.3093, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.67% (2.0346 => 2.0889, std. dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 2.56% (0.4847 => 0.4971, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.48% (11.6398 => 11.8120, std. dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6779, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8963, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1752, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6436, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2041, std. dev.: 0.0109) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5058, std. dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4547, std. dev.: 0.0283) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.46% (1.0927 => 1.1087, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5843, std. dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5439, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary2: -10.24% (0.2402 => 0.2156, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8036, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std. dev.: 0.0053) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.77% (17.2379 => 16.7611, std. dev.: 0.0541) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5760, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.46% (16.2163 => 15.9789, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 02:08:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 04:08:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908090857.4F2A12A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3564?compare_to=3561&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3564, Order: 163461, Start Time: 2012-09-08 07:58:43, End Time: 2012-09-08 09:10:10 To: 3561, Order: 163458, Start Time: 2012-09-08 06:31:07, End Time: 2012-09-08 07:42:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (40 on baseline) Performance Improvements: 2 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (818 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.26% (2.2682 => 2.2967, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (2.4569 => 2.5796, std. dev.: 0.0246) MultiSource/Benchmarks/Bullet/bullet: 1.93% (7.0029 => 7.1383, std. dev.: 0.0314) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.77% (2.7092 => 2.7572, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 1.03% (8.7559 => 8.8460, std. dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4030 => 0.3923, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.56% (4.5744 => 4.4575, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.53% (2.1763 => 2.2967, std. dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 4.51% (1.1653 => 1.2179, std. dev.: 0.0201) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.17% (0.6410 => 0.6677, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 3.97% (0.6173 => 0.6418, std. dev.: 0.0063) MultiSource/Applications/lemon/lemon: 3.95% (1.0046 => 1.0443, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3582 => 0.3709, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1672 => 1.1922, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 2.02% (29.3170 => 29.9105, std. dev.: 0.1413) MultiSource/Applications/d/make_dparser: 1.78% (3.0225 => 3.0763, std. dev.: 0.0139) MultiSource/Applications/siod/siod: 1.61% (2.0972 => 2.1310, std. dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (8.2186 => 8.3276, std. dev.: 0.0366) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3394, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/ary3: 16.97% (1.7426 => 2.0384, std. dev.: 0.0141) SingleSource/Benchmarks/McGill/misr: 13.76% (0.4296 => 0.4887, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5568, std. dev.: 0.0450) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8802, std. dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 12.21% (0.1433 => 0.1608, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 8.99% (7.0025 => 7.6320, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.27% (0.3301 => 0.3541, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.72% (0.2857 => 0.3049, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 6.14% (3.4876 => 3.7018, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (27.1724 => 28.8210, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.17% (15.2242 => 15.8590, std. dev.: 0.0308) SingleSource/Benchmarks/Misc/ReedSolomon: 3.93% (8.5113 => 8.8460, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8733, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.44% (2.6656 => 2.7572, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.40% (0.5587 => 0.5777, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 3.28% (1.4184 => 1.4649, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 2.56% (5.1938 => 5.3269, std. dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: 2.38% (6.9722 => 7.1383, std. dev.: 0.0314) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4455 => 2.4815, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5322, std. dev.: 0.0129) MultiSource/Applications/siod/siod: 1.39% (3.5520 => 3.6014, std. dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 1.32% (14.4877 => 14.6787, std. dev.: 0.0466) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.15% (0.3497 => 0.2058, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.10% (5.2665 => 4.1555, std. dev.: 0.0512) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.18% (8.1594 => 7.1657, std. dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2007 => 2.9419, std. dev.: 0.0530) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.19% (3.6254 => 3.3647, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -5.96% (3.4230 => 3.2189, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/richards_benchmark: -5.80% (1.4441 => 1.3603, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.24% (0.4140 => 0.3923, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4063, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.37% (9.2503 => 8.8457, std. dev.: 0.0658) MultiSource/Benchmarks/FreeBench/distray/distray: -4.35% (0.2664 => 0.2548, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.00% (1.7361 => 1.6666, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2303, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1332, std. dev.: 0.0091) MultiSource/Applications/aha/aha: -2.66% (3.4286 => 3.3373, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -2.56% (9.5474 => 9.3032, std. dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: -2.31% (62.4126 => 60.9719, std. dev.: 0.1143) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.31% (2.4457 => 2.3893, std. dev.: 0.0117) MultiSource/Benchmarks/PAQ8p/paq8p: -2.07% (92.7467 => 90.8258, std. dev.: 0.3777) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6119 => 0.6019, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.56% (1.0686 => 1.0519, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -1.47% (3.8200 => 3.7640, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3305, std. dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: -1.28% (6.7458 => 6.6594, std. dev.: 0.0331) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.27% (9.3855 => 9.2659, std. dev.: 0.0446) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.07% (4.5056 => 4.4575, std. dev.: 0.0123) MultiSource/Benchmarks/sim/sim: -1.02% (3.8907 => 3.8509, std. dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 02:10:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 04:10:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908091042.55EF12A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3565?compare_to=3560&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3565, Order: 163460, Start Time: 2012-09-08 07:51:55, End Time: 2012-09-08 09:11:54 To: 3560, Order: 163458, Start Time: 2012-09-08 05:33:09, End Time: 2012-09-08 06:52:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.96% (10.3673 => 14.7170, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 28.42% (0.1622 => 0.2083, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.09% (2.2022 => 2.5124, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.00% (7.0540 => 8.0417, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 13.73% (0.3473 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3497 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.55% (0.3543 => 0.4023, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3561 => 0.4038, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 13.34% (0.3516 => 0.3985, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.94% (0.3694 => 0.4172, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 12.75% (0.3828 => 0.4316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.43% (0.3886 => 0.4369, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.99% (1.1194 => 1.2536, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.85% (1.7609 => 1.9696, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7326 => 0.7900, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 7.49% (10.4361 => 11.2174, std. dev.: 0.0221) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.4879 => 0.5241, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.8172 => 0.8770, std. dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 7.30% (9.4845 => 10.1772, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.22% (0.2271 => 0.2435, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (8.1363 => 8.7054, std. dev.: 0.0767) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5105 => 0.5450, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7433 => 0.7935, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: 6.62% (0.7115 => 0.7586, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.5860 => 0.6243, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.53% (1.5415 => 1.6422, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.51% (4.2646 => 4.5424, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3423 => 0.3644, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.35% (5.0018 => 5.3196, std. dev.: 0.0151) MultiSource/Applications/spiff/spiff: 6.32% (0.7835 => 0.8330, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.6675 => 0.7096, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.9449 => 5.2557, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.25% (1.3050 => 1.3866, std. dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 6.15% (3.3354 => 3.5406, std. dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std. dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 6.02% (5.7591 => 6.1057, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.8067 => 0.8550, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.65% (0.9765 => 1.0317, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.4299 => 0.4542, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.63% (0.3817 => 0.4032, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (14.3668 => 15.1713, std. dev.: 0.0230) MultiSource/Benchmarks/McCat/09-vor/vor: 5.60% (0.3180 => 0.3358, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.51% (1.5603 => 1.6463, std. dev.: 0.0085) MultiSource/Applications/Burg/burg: 5.48% (1.1642 => 1.2280, std. dev.: 0.0092) MultiSource/Applications/lua/lua: 5.34% (3.8723 => 4.0790, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3441 => 0.3624, std. dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 5.31% (0.3387 => 0.3567, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (1.1861 => 1.2474, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.00% (0.5020 => 0.5271, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 4.98% (1.0722 => 1.1256, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (7.9617 => 8.3518, std. dev.: 0.0120) MultiSource/Applications/treecc/treecc: 4.66% (2.0273 => 2.1218, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3422 => 0.3581, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.64% (21.9371 => 22.9556, std. dev.: 0.0285) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.4064 => 0.4252, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.59% (0.6450 => 0.6746, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.58% (0.4103 => 0.4291, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4636 => 0.4846, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.5981 => 0.6249, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 4.47% (0.8921 => 0.9320, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 4.38% (0.6456 => 0.6739, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.29% (2.2969 => 2.3955, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3650 => 0.3802, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.14% (0.3865 => 0.4025, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.08% (0.3826 => 0.3982, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.3136 => 0.3263, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.90% (17.1811 => 17.8517, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.85% (2.0665 => 2.1460, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4048 => 0.4203, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4203 => 0.4363, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 3.76% (0.2871 => 0.2979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4620 => 0.4792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.70% (0.2756 => 0.2858, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.66% (0.3684 => 0.3819, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.54% (1.5859 => 1.6420, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.3052 => 0.3158, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.40% (0.3379 => 0.3494, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.2024 => 2.2767, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.1840 => 1.2216, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.8101 => 0.8296, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.32% (1.2842 => 1.3140, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3813, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3733, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.27% (0.4162 => 0.4298, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2259, std. dev.: 0.0072) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5747, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.58% (5.2763 => 3.2406, std. dev.: 0.0182) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.63% (5.3855 => 3.8973, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.32% (5.3526 => 3.8903, std. dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0634, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.77% (2.9384 => 2.5926, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -7.88% (22.1758 => 20.4282, std. dev.: 0.0458) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (19.9488 => 18.2454, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5770, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5080, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4261, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9993, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9944, std. dev.: 0.0161) MultiSource/Applications/sqlite3/sqlite3: -1.97% (4.6441 => 4.5524, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6779, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5111, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4227, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2354, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 02:28:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 04:28:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908092837.1956A2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3566?compare_to=3562&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3566, Order: 163461, Start Time: 2012-09-08 08:15:14, End Time: 2012-09-08 09:29:49 To: 3562, Order: 163458, Start Time: 2012-09-08 06:29:35, End Time: 2012-09-08 07:46:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (173 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.35% (2.2612 => 2.3369, std. dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.17% (54.8029 => 56.5400, std. dev.: 0.0735) SingleSource/Benchmarks/Misc/lowercase: 1.17% (7.9537 => 8.0468, std. dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.06% (1.4920 => 1.4762, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.52% (2.0176 => 2.4115, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.88% (0.5818 => 0.6451, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.79% (0.5748 => 0.6368, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.22% (0.7710 => 0.8498, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.12% (0.3578 => 0.3940, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.05% (1.3693 => 1.5069, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.05% (3.9660 => 4.3645, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.00% (0.3601 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3663 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.91% (0.3623 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.82% (0.3789 => 0.4161, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.81% (0.3650 => 0.4008, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 9.76% (0.7061 => 0.7750, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 9.71% (0.3914 => 0.4294, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.62% (0.4003 => 0.4388, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.57% (0.3940 => 0.4317, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.36% (0.5265 => 0.5758, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.19% (0.9199 => 1.0044, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 9.15% (0.7038 => 0.7682, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.05% (1.2193 => 1.3297, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.2721 => 0.2966, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.87% (1.4563 => 1.5855, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.59% (1.1364 => 1.2340, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.50% (0.5577 => 0.6051, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.18% (13.8202 => 14.9509, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.13% (0.2127 => 0.2300, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.06% (0.4379 => 0.4732, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3489 => 0.3770, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.02% (0.2782 => 0.3005, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.93% (7.2180 => 7.7903, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.6283 => 0.6779, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.89% (1.0313 => 1.1127, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.89% (0.3246 => 0.3502, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.87% (0.4791 => 0.5168, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.85% (0.3580 => 0.3861, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.75% (0.7506 => 0.8088, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.74% (0.3293 => 0.3548, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.3756 => 0.4045, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.68% (0.2995 => 0.3225, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 7.63% (0.2607 => 0.2806, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.59% (1.9828 => 2.1333, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.51% (0.2690 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.51% (0.8310 => 0.8934, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.47% (13.2842 => 14.2771, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 7.46% (0.2760 => 0.2966, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.45% (3.6692 => 3.9426, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.45% (1.1061 => 1.1885, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.2726 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.32% (0.4016 => 0.4310, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2761 => 0.2963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.31% (0.3107 => 0.3334, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.24% (0.3149 => 0.3377, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.14% (0.3192 => 0.3420, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.14% (0.3220 => 0.3450, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (3.8646 => 4.1378, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 7.06% (0.2988 => 0.3199, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.03% (0.3868 => 0.4140, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4390 => 0.4696, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.74% (1.3245 => 1.4138, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 6.74% (2.1791 => 2.3259, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 6.67% (1.9270 => 2.0555, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.67% (0.6135 => 0.6544, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 6.66% (3.1889 => 3.4013, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.61% (0.8818 => 0.9401, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.59% (1.3813 => 1.4723, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.52% (0.6744 => 0.7184, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 6.48% (1.2749 => 1.3575, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (1.3819 => 1.4707, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.38% (1.0594 => 1.1270, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 6.32% (0.2945 => 0.3131, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.30% (14.8535 => 15.7899, std. dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.27% (4.3801 => 4.6546, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.27% (4.4433 => 4.7217, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.13% (8.4961 => 9.0167, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 6.12% (0.2859 => 0.3034, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.01% (0.8698 => 0.9221, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.00% (0.3131 => 0.3319, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.87% (16.6129 => 17.5888, std. dev.: 0.0184) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.84% (0.2140 => 0.2265, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.79% (0.6576 => 0.6957, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.79% (1.1333 => 1.1989, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.73% (14.5298 => 15.3625, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.65% (0.3755 => 0.3967, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.53% (6.5754 => 6.9393, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.07% (4.6629 => 4.8994, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 5.05% (1.2292 => 1.2913, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.93% (16.2614 => 17.0639, std. dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (3.2742 => 3.4335, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.60% (0.4805 => 0.5026, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (0.9108 => 0.9524, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5188 => 1.5822, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6250 => 0.6506, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.08% (3.7467 => 3.8994, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1853, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.98% (2.1007 => 2.1843, std. dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.87% (6.2785 => 6.5214, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.56% (0.3511 => 0.3636, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.76% (33.2944 => 34.2133, std. dev.: 0.0254) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 28.58% (1.8175 => 2.3369, std. dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.01% (1.2998 => 1.3779, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0703, std. dev.: 0.0257) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (0.5184 => 0.5334, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6025, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5119, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.27% (1.4298 => 1.4479, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5965, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.10% (7.9275 => 8.0147, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6865, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.76% (0.4657 => 0.4016, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.66% (22.5627 => 21.7372, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2770, std. dev.: 0.0231) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -5.23% (2.6470 => 2.5086, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7054, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5893, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2498, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5200, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8695, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2448, std. dev.: 0.0204) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2350, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 03:35:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 05:35:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908103519.B5DEF2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3567?compare_to=3564&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3567, Order: 163467, Start Time: 2012-09-08 09:25:56, End Time: 2012-09-08 10:36:32 To: 3564, Order: 163461, Start Time: 2012-09-08 07:58:43, End Time: 2012-09-08 09:10:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (58 on baseline) Performance Improvements: 4 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 871 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.7473 => 0.7989, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.95% (0.4400 => 0.4662, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.54% (0.2761 => 0.2914, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.34% (0.5603 => 0.5846, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7485 => 0.7801, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.55% (0.5458 => 0.5597, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8369 => 3.9225, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.5341 => 0.5453, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.8919 => 0.9104, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.4106 => 1.4374, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.78% (0.7586 => 0.7721, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 1.66% (1.3231 => 1.3451, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (0.7717 => 0.7833, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.4183 => 1.4363, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (8.3137 => 8.3990, std. dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.56% (15.9297 => 16.8149, std. dev.: 0.1344) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.40% (2.3007 => 2.3560, std. dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -6.01% (3.3563 => 3.1547, std. dev.: 0.0610) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.92% (2.9042 => 2.8194, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout/ary3: -2.05% (2.0384 => 1.9967, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary3: -1.63% (1.7616 => 1.7328, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.50% (0.1414 => 0.1520, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 5.01% (2.1763 => 2.2853, std. dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: 4.90% (1.1653 => 1.2224, std. dev.: 0.0170) MultiSource/Applications/lemon/lemon: 3.76% (1.0046 => 1.0424, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/18-imp/imp: 3.61% (0.3217 => 0.3333, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.23% (0.4248 => 0.4385, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.5150 => 1.5613, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.74% (0.3901 => 0.4008, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.5309 => 0.5453, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.7639 => 0.7833, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.1827 => 1.2097, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.26% (0.5937 => 0.6071, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 2.10% (3.0225 => 3.0859, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.06% (0.7226 => 0.7375, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (1.3935 => 1.4221, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 2.02% (1.1440 => 1.1671, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.4113 => 1.4374, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.85% (0.5740 => 0.5846, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.83% (0.5636 => 0.5739, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.73% (8.2559 => 8.3990, std. dev.: 0.0192) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.65% (1.1672 => 1.1865, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.23% (1.4189 => 1.4363, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.18% (4.2616 => 4.3118, std. dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 1.11% (3.8796 => 3.9225, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0118) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.23% (0.0766 => 0.0921, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std. dev.: 0.0148) SingleSource/Benchmarks/McGill/misr: 13.83% (0.4296 => 0.4890, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.30% (4.0101 => 4.5436, std. dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (3.4406 => 3.8801, std. dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.95% (1.0063 => 1.0964, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6102, std. dev.: 0.0092) SingleSource/Benchmarks/McGill/chomp: 8.29% (1.0194 => 1.1039, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.91% (0.2857 => 0.3083, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (15.8312 => 16.8149, std. dev.: 0.1344) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (3.4876 => 3.7027, std. dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7943, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8538, std. dev.: 0.0373) SingleSource/Benchmarks/Misc/dt: 3.97% (0.9851 => 1.0242, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8394, std. dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5392, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8733, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 3.27% (1.4184 => 1.4648, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.16% (0.3508 => 0.3619, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.22% (2.6656 => 2.7249, std. dev.: 0.0130) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2996, std. dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.96% (4.6127 => 4.7032, std. dev.: 0.0069) MultiSource/Applications/siod/siod: 1.55% (3.5520 => 3.6070, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.4455 => 2.4801, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.33% (29.5232 => 29.9173, std. dev.: 0.1252) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (2.4971 => 2.5296, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6642, std. dev.: 0.0186) MultiSource/Benchmarks/Olden/bh/bh: 1.15% (2.5166 => 2.5456, std. dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: 1.05% (2.4013 => 2.4264, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.60% (5.2665 => 4.0761, std. dev.: 0.0568) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.84% (1.1647 => 0.9919, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9388, std. dev.: 0.0579) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3664, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -6.69% (3.4230 => 3.1939, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3509, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4096, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.35% (0.4140 => 0.3960, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.87% (2.4457 => 2.3511, std. dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.51% (3.7496 => 3.6181, std. dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (9.2503 => 8.9294, std. dev.: 0.0431) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2309, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.94% (1.1683 => 1.1339, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2857, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (62.4126 => 60.7359, std. dev.: 0.3576) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.66% (2.8964 => 2.8194, std. dev.: 0.0211) MultiSource/Applications/aha/aha: -2.60% (3.4286 => 3.3393, std. dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (92.7467 => 90.6269, std. dev.: 0.1899) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (9.3855 => 9.2373, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -1.56% (1.7330 => 1.7059, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.3569 => 2.3240, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3142, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.22% (13.4743 => 13.3101, std. dev.: 0.0244) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 03:58:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 05:58:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908105856.D94E02A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3568?compare_to=3565&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3568, Order: 163467, Start Time: 2012-09-08 09:40:19, End Time: 2012-09-08 11:00:09 To: 3565, Order: 163460, Start Time: 2012-09-08 07:51:55, End Time: 2012-09-08 09:11:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.7636 => 56.4875, std. dev.: 0.1319) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.23% (14.7170 => 14.5355, std. dev.: 0.0131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.21% (10.3673 => 14.5355, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/richards_benchmark: 25.96% (0.1622 => 0.2043, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.54% (2.2022 => 2.5004, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3473 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.21% (0.3497 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.18% (0.3543 => 0.4010, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.14% (0.3516 => 0.3978, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.09% (7.0540 => 7.9771, std. dev.: 0.0119) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3543 => 0.4005, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 12.92% (0.1432 => 0.1617, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3694 => 0.4161, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3828 => 0.4303, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3927 => 0.4409, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.48% (1.7609 => 1.9631, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.92% (0.1440 => 0.1554, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 7.59% (0.5925 => 0.6375, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.44% (0.4879 => 0.5242, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.38% (0.6030 => 0.6475, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.36% (10.4361 => 11.2046, std. dev.: 0.0162) MultiSource/Benchmarks/Olden/em3d/em3d: 7.32% (0.1695 => 0.1819, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.31% (9.4845 => 10.1775, std. dev.: 0.0116) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.23% (0.8172 => 0.8763, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (0.4615 => 0.4942, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.64% (0.5860 => 0.6249, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.50% (0.3109 => 0.3311, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (8.1363 => 8.6610, std. dev.: 0.0147) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7326 => 0.7797, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7433 => 0.7910, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 6.27% (0.7115 => 0.7561, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.25% (0.3423 => 0.3637, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.14% (4.2646 => 4.5264, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.13% (1.3050 => 1.3850, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.6675 => 0.7079, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.05% (0.5569 => 0.5906, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 6.02% (0.7835 => 0.8307, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.96% (4.9449 => 5.2396, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.96% (5.0018 => 5.2997, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.95% (3.3354 => 3.5339, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.87% (0.2758 => 0.2920, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (1.5415 => 1.6308, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 5.70% (5.7591 => 6.0872, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 5.53% (1.5603 => 1.6466, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.51% (0.4299 => 0.4536, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.43% (0.8067 => 0.8505, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.43% (0.9765 => 1.0295, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (14.3668 => 15.1370, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 5.35% (0.3180 => 0.3350, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.34% (0.3817 => 0.4021, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.17% (1.1642 => 1.2244, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (1.1861 => 1.2471, std. dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 5.05% (0.3387 => 0.3558, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.84% (7.9617 => 8.3474, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.84% (0.5020 => 0.5263, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 4.75% (3.8723 => 4.0564, std. dev.: 0.0165) MultiSource/Applications/lemon/lemon: 4.68% (1.0722 => 1.1224, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4636 => 0.4850, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6450 => 0.6743, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.4103 => 0.4288, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.50% (2.0273 => 2.1186, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.4064 => 0.4243, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6456 => 0.6733, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 4.23% (0.8921 => 0.9298, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.16% (21.9371 => 22.8490, std. dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.15% (0.5981 => 0.6229, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3826 => 0.3984, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4760, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.01% (2.2969 => 2.3890, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.85% (0.4048 => 0.4204, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.4289 => 0.4453, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (2.0665 => 2.1429, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 3.67% (17.1811 => 17.8121, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.66% (0.4620 => 0.4789, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2872 => 0.2976, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.58% (0.3684 => 0.3816, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.57% (1.5859 => 1.6425, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.3052 => 0.3157, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2737, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.1840 => 1.2214, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2842 => 1.3132, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.8101 => 0.8276, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.65% (0.2944 => 0.3287, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4144, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3834, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7580, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (4.2280 => 4.3652, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2232, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.46% (5.2763 => 3.2470, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.25% (5.3855 => 3.8640, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.88% (5.3526 => 3.8605, std. dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1567, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.67% (2.9384 => 2.5954, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -8.08% (22.1758 => 20.3833, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2669, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.40% (1.8329 => 1.7156, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5090, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4139, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0078, std. dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9957, std. dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5535, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -1.69% (1.2373 => 1.2164, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2274, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 04:13:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 06:13:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908111328.653A32A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3569?compare_to=3566&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3569, Order: 163467, Start Time: 2012-09-08 09:58:12, End Time: 2012-09-08 11:14:40 To: 3566, Order: 163461, Start Time: 2012-09-08 08:15:14, End Time: 2012-09-08 09:29:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 26.33% (0.3962 => 0.5005, std. dev.: 0.0380) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.27% (28.4989 => 29.7170, std. dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.70% (2.0176 => 2.4151, std. dev.: 0.0444) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.82% (0.7710 => 0.8544, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 10.11% (0.5818 => 0.6406, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.04% (0.5748 => 0.6325, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.03% (3.9660 => 4.3637, std. dev.: 0.0320) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.71% (0.2596 => 0.2848, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.63% (1.3693 => 1.5012, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 9.22% (0.7061 => 0.7712, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.20% (1.4563 => 1.5903, std. dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.20% (0.6959 => 0.7599, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.14% (1.2193 => 1.3307, std. dev.: 0.0122) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.11% (0.3646 => 0.3978, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.08% (0.7038 => 0.7677, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.89% (0.3623 => 0.3945, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.87% (0.9199 => 1.0015, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.53% (1.1364 => 1.2333, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.5577 => 0.6034, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 8.17% (13.8202 => 14.9487, std. dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.15% (0.4379 => 0.4736, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (0.4328 => 0.4680, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.99% (1.0313 => 1.1137, std. dev.: 0.0144) MultiSource/Applications/spiff/spiff: 7.94% (0.7506 => 0.8102, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (7.2180 => 7.7852, std. dev.: 0.0716) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.86% (0.3246 => 0.3501, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.74% (0.4791 => 0.5162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.46% (1.1061 => 1.1886, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 7.36% (0.8310 => 0.8922, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.33% (0.5637 => 0.6050, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.28% (3.6692 => 3.9365, std. dev.: 0.0403) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.24% (0.3756 => 0.4028, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.23% (3.8646 => 4.1440, std. dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.17% (13.2842 => 14.2373, std. dev.: 0.2738) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3485 => 0.3734, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3580 => 0.3833, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.06% (0.7460 => 0.7987, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 7.05% (0.3220 => 0.3447, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.96% (1.9828 => 2.1209, std. dev.: 0.0428) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 6.86% (2.1791 => 2.3286, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.78% (3.1889 => 3.4050, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.75% (1.3245 => 1.4139, std. dev.: 0.0091) MultiSource/Applications/treecc/treecc: 6.73% (1.9270 => 2.0566, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2765 => 0.2949, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.65% (1.0594 => 1.1298, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.57% (0.2937 => 0.3130, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.55% (0.6135 => 0.6537, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.48% (1.2749 => 1.3575, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.47% (0.2504 => 0.2666, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.4113 => 0.4379, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.45% (0.6744 => 0.7179, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.38% (0.2696 => 0.2868, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.3801 => 4.6564, std. dev.: 0.0360) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.30% (1.3819 => 1.4689, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 6.25% (14.8535 => 15.7812, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (1.3813 => 1.4669, std. dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.16% (4.4433 => 4.7171, std. dev.: 0.0378) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.02% (0.8818 => 0.9349, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.2859 => 0.3031, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 5.88% (0.3131 => 0.3315, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 5.87% (8.4961 => 8.9949, std. dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 5.86% (16.6129 => 17.5866, std. dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.77% (1.1333 => 1.1987, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.75% (0.2140 => 0.2263, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.73% (0.8698 => 0.9196, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.70% (0.6576 => 0.6951, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 5.69% (14.5298 => 15.3570, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (6.5754 => 6.9284, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3755 => 0.3946, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3245 => 0.3407, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.87% (16.2614 => 17.0535, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.84% (3.2742 => 3.4327, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 4.73% (4.6629 => 4.8833, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.4805 => 0.5032, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2292 => 1.2853, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (1.5188 => 1.5827, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 4.12% (3.7467 => 3.9009, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (2.1007 => 2.1867, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1859, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 3.66% (0.6250 => 0.6479, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5065, std. dev.: 0.0715) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (0.3511 => 0.3624, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 2.47% (33.2944 => 34.1164, std. dev.: 0.0250) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std. dev.: 0.0557) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4170, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.98% (0.2093 => 0.2239, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5480, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.32% (10.7476 => 11.1047, std. dev.: 0.0570) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6034, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0291) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.26% (1.4298 => 1.4478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5954, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (22.5627 => 21.7151, std. dev.: 0.0391) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.30% (20.3410 => 18.2458, std. dev.: 0.0178) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.63% (1.3780 => 1.3004, std. dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5120, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1514, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9223, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.60% (4.5928 => 4.5191, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2399, std. dev.: 0.0096) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2227, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2581, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 04:49:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 06:49:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908114940.F0AF12A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/3570?compare_to=3563&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3570, Order: 163465, Start Time: 2012-09-08 09:06:32, End Time: 2012-09-08 11:50:53 To: 3563, Order: 163458, Start Time: 2012-09-08 05:51:58, End Time: 2012-09-08 08:38:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.27% (1.7043 => 1.7259, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 13.15% (0.3460 => 0.3915, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3469 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.63% (0.3643 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.46% (0.3724 => 0.4188, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.33% (1.5932 => 1.7259, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5826 => 0.6282, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.71% (0.5889 => 0.6343, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.49% (1.6211 => 1.7425, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (3.5627 => 3.8199, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.21% (0.4994 => 0.5354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.06% (1.3152 => 1.4080, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.5900 => 0.6310, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (0.4361 => 0.4658, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.71% (0.5026 => 0.5363, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.46% (0.3930 => 0.4184, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.40% (0.5000 => 0.5320, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 6.38% (4.2109 => 4.4797, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 6.28% (0.7171 => 0.7621, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.00% (1.0781 => 1.1428, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.1968 => 0.2083, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 5.79% (0.6634 => 0.7018, std. dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (0.2691 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.2866 => 0.3030, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.62% (2.7292 => 2.8826, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 5.54% (5.5417 => 5.8486, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.41% (0.2736 => 0.2884, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (0.4658 => 0.4905, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.25% (1.9966 => 2.1014, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 5.23% (2.1013 => 2.2112, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.3903 => 0.4107, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (0.3890 => 0.4091, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (1.8794 => 1.9759, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.12% (0.4139 => 0.4351, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.08% (0.2875 => 0.3021, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (1.9694 => 2.0691, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.01% (0.3195 => 0.3355, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.94% (0.9909 => 1.0399, std. dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 4.93% (0.3004 => 0.3152, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 4.82% (0.9697 => 1.0164, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.76% (0.2729 => 0.2859, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 4.74% (1.4269 => 1.4946, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.71% (0.2823 => 0.2956, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.70% (0.2725 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.69% (0.2813 => 0.2945, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 4.68% (0.3336 => 0.3492, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2750 => 0.2877, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 4.60% (0.2780 => 0.2908, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (2.0673 => 2.1622, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.57% (2.1653 => 2.2642, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 4.53% (0.7875 => 0.8232, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.52% (0.3362 => 0.3514, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.51% (0.2792 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.51% (0.3060 => 0.3198, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (4.4195 => 4.6180, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 4.46% (4.6177 => 4.8238, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2803 => 0.2928, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.3096 => 0.3234, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.44% (0.3267 => 0.3412, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.43% (0.3271 => 0.3416, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.29% (0.3124 => 0.3258, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 4.28% (23.5202 => 24.5279, std. dev.: 0.0119) MultiSource/Applications/Burg/burg: 4.26% (0.5546 => 0.5782, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3678 => 0.3832, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.17% (0.3282 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3726 => 0.3881, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3792 => 0.3944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4146 => 0.4310, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4251 => 0.4418, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.2969 => 0.3084, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.85% (0.3845 => 0.3993, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.3981 => 0.4124, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.55% (0.5012 => 0.5190, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.34% (0.6435 => 0.6650, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.15% (2.0346 => 2.0987, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 3.14% (0.3498 => 0.3608, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.66% (0.4847 => 0.4976, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (0.7426 => 0.7600, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (0.5361 => 0.5482, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.84% (11.6398 => 11.8535, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6759, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std. dev.: 0.1443) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8904, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6470, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2116, std. dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5067, std. dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4452, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.42% (1.0927 => 1.1082, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5162, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6018, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5531, std. dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8039, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7954, std. dev.: 0.0069) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.69% (0.6293 => 0.6124, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -2.17% (17.2379 => 16.8635, std. dev.: 0.0377) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9599, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 06:40:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 08:40:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908134059.39EF22A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3571?compare_to=3567&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3571, Order: 163469, Start Time: 2012-09-08 12:31:24, End Time: 2012-09-08 13:42:13 To: 3567, Order: 163467, Start Time: 2012-09-08 09:25:56, End Time: 2012-09-08 10:36:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (54 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.00% (1.3451 => 1.3586, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.94% (0.3168 => 0.3483, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (41.3821 => 42.8394, std. dev.: 0.2053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.99% (58.4890 => 60.2391, std. dev.: 0.5236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.84% (1.4194 => 1.4455, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: 1.35% (4.3030 => 4.3610, std. dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.00% (1.6047 => 1.6208, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -1.86% (6.8003 => 6.6739, std. dev.: 0.0275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.68% (0.6410 => 0.6774, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3582 => 0.3783, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.30% (2.1763 => 2.2699, std. dev.: 0.0155) MultiSource/Applications/SIBsim4/SIBsim4: 4.20% (1.1653 => 1.2142, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: 4.03% (0.6173 => 0.6422, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 3.79% (1.0046 => 1.0427, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (12.6413 => 13.0140, std. dev.: 0.0654) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5150 => 1.5558, std. dev.: 0.0115) MultiSource/Applications/hbd/hbd: 2.40% (1.3268 => 1.3586, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.06% (1.2021 => 1.2269, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.05% (29.3170 => 29.9189, std. dev.: 0.1265) MultiSource/Applications/SPASS/SPASS: 1.88% (13.3238 => 13.5744, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6069 => 0.6178, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.59% (1.3935 => 1.4157, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (4.0318 => 4.0953, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (6.2546 => 6.3503, std. dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.0689 => 1.0843, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (0.8569 => 0.8679, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (8.2186 => 8.3227, std. dev.: 0.0357) MultiSource/Applications/hexxagon/hexxagon: 1.06% (0.9425 => 0.9525, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9966, std. dev.: 0.0343) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.72% (4.0101 => 4.5603, std. dev.: 0.0728) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std. dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8789, std. dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 12.55% (0.3746 => 0.4216, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.98% (0.2857 => 0.3142, std. dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.06% (1.0063 => 1.0975, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6237, std. dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.32% (15.8312 => 17.1487, std. dev.: 0.2702) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8105, std. dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.83% (40.4792 => 42.8394, std. dev.: 0.2053) SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (3.4876 => 3.6882, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (0.3301 => 0.3483, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8547, std. dev.: 0.0409) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 3.21% (1.4184 => 1.4640, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.97% (2.6656 => 2.7449, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/ReedSolomon: 2.52% (8.5113 => 8.7259, std. dev.: 0.0459) SingleSource/Benchmarks/Shootout-C++/hash: 2.14% (0.6308 => 0.6443, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2996, std. dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.74% (2.4042 => 2.4460, std. dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4856, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6084, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/hash: 1.38% (4.3016 => 4.3610, std. dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6732, std. dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: 1.15% (2.5166 => 2.5455, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.38% (0.3497 => 0.2085, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.49% (5.2665 => 4.1872, std. dev.: 0.1127) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.91% (1.1647 => 0.9910, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1649, std. dev.: 0.0379) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0266) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9383, std. dev.: 0.0554) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3664, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -6.77% (3.4230 => 3.1914, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: -6.48% (1.4441 => 1.3505, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4069, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.38% (0.4564 => 0.4364, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9448, std. dev.: 0.0227) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.15% (1.7361 => 1.6814, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2880, std. dev.: 0.0116) MultiSource/Applications/aha/aha: -2.67% (3.4286 => 3.3369, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -2.60% (62.4126 => 60.7921, std. dev.: 0.1928) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.52% (1.1683 => 1.1389, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2313, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8322, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.36% (1.8739 => 1.8484, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3171, std. dev.: 0.0367) SingleSource/Benchmarks/Misc/oourafft: -1.27% (3.8200 => 3.7715, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -1.16% (1.7330 => 1.7129, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: -1.07% (6.7458 => 6.6739, std. dev.: 0.0275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 06:56:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 08:56:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908135630.762A42A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3572?compare_to=3569&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3572, Order: 163469, Start Time: 2012-09-08 12:43:19, End Time: 2012-09-08 13:57:43 To: 3569, Order: 163467, Start Time: 2012-09-08 09:58:12, End Time: 2012-09-08 11:14:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -21.34% (0.5005 => 0.3937, std. dev.: 0.0165) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.67% (2.0176 => 2.4144, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.54% (0.1072 => 0.1185, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.7710 => 0.8512, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 10.11% (0.5748 => 0.6329, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 10.11% (0.5818 => 0.6406, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.92% (3.9660 => 4.3594, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.51% (0.2596 => 0.2843, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.51% (1.3693 => 1.4995, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.40% (0.5265 => 0.5760, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.13% (0.7061 => 0.7706, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7038 => 0.7679, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.05% (1.2193 => 1.3296, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.00% (0.9199 => 1.0027, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 8.87% (0.4003 => 0.4358, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.84% (0.6959 => 0.7574, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.73% (0.3940 => 0.4284, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.61% (1.4563 => 1.5817, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.52% (1.1364 => 1.2332, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.20% (0.4328 => 0.4683, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.10% (0.5577 => 0.6029, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9337, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.88% (7.2180 => 7.7867, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.84% (1.0313 => 1.1122, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.77% (0.6283 => 0.6771, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.73% (0.3246 => 0.3497, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.58% (0.4062 => 0.4370, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.57% (0.3899 => 0.4194, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.55% (0.7506 => 0.8073, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.53% (0.4791 => 0.5152, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.48% (0.2914 => 0.3132, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 7.41% (1.1061 => 1.1881, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 7.41% (0.8310 => 0.8926, std. dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.35% (0.2925 => 0.3140, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.27% (3.6692 => 3.9360, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.22% (13.2842 => 14.2429, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3580 => 0.3838, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3293 => 0.3528, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.14% (0.3756 => 0.4024, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3485 => 0.3732, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.00% (3.8646 => 4.1352, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.87% (0.4016 => 0.4292, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.87% (1.9828 => 2.1190, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.85% (1.3245 => 1.4152, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.84% (0.2966 => 0.3169, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 6.70% (3.1889 => 3.4025, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.64% (1.9270 => 2.0550, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 6.61% (2.1791 => 2.3231, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4390 => 0.4678, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.4113 => 0.4382, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.2988 => 0.3181, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.44% (0.6744 => 0.7178, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (1.2749 => 1.3563, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.34% (0.3453 => 0.3672, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.30% (1.0594 => 1.1261, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 6.21% (14.8535 => 15.7759, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.18% (0.6135 => 0.6514, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.15% (4.3801 => 4.6495, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.13% (4.4433 => 4.7157, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4658, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.08% (1.3819 => 1.4659, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (0.2859 => 0.3028, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.89% (0.8818 => 0.9337, std. dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 5.88% (8.4961 => 8.9960, std. dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 5.84% (16.6129 => 17.5827, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (1.1333 => 1.1985, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.75% (0.3131 => 0.3311, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.2140 => 0.2262, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.68% (14.5298 => 15.3545, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.37% (0.6576 => 0.6929, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.31% (6.5754 => 6.9247, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3755 => 0.3946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.88% (16.2614 => 17.0552, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.85% (3.2742 => 3.4330, std. dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 4.74% (4.6629 => 4.8838, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.41% (0.4805 => 0.5017, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (0.9108 => 0.9506, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (1.5188 => 1.5830, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.01% (3.7467 => 3.8971, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.97% (2.1007 => 2.1842, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (4.9865 => 5.1798, std. dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/bigfib: 3.79% (0.6250 => 0.6487, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (6.2785 => 6.5054, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.3511 => 0.3631, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.50% (33.2944 => 34.1263, std. dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.05% (1.8175 => 2.2546, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7339, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0882, std. dev.: 0.0630) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (0.5184 => 0.5331, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5993, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5873, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.41% (0.4657 => 0.3986, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.87% (22.5627 => 21.6888, std. dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2557, std. dev.: 0.0558) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.20% (2.6470 => 2.5093, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std. dev.: 0.0007) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1508, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std. dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9238, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5888, std. dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5208, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std. dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2447, std. dev.: 0.0171) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2301, std. dev.: 0.0148) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4334, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0310 => 1.0203, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 07:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 09:02:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908140204.C9CC22A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3573?compare_to=3568&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3573, Order: 163469, Start Time: 2012-09-08 12:43:14, End Time: 2012-09-08 14:03:16 To: 3568, Order: 163467, Start Time: 2012-09-08 09:40:19, End Time: 2012-09-08 11:00:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.19% (10.3673 => 14.5334, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 26.02% (0.1622 => 0.2044, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.61% (2.2022 => 2.5020, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 13.50% (0.3473 => 0.3942, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.30% (0.3497 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.24% (0.3543 => 0.4012, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.22% (7.0540 => 7.9864, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 13.21% (0.3543 => 0.4011, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 13.20% (0.3516 => 0.3980, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3561 => 0.4030, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.92% (0.1432 => 0.1617, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.70% (0.3828 => 0.4314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.33% (0.3886 => 0.4365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.32% (0.3927 => 0.4411, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.27% (1.7609 => 1.9594, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.3177 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.55% (0.8172 => 0.8789, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.6030 => 0.6481, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.34% (10.4361 => 11.2016, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 7.29% (9.4845 => 10.1760, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.4615 => 0.4932, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5569 => 0.5950, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.2700 => 0.2880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.60% (0.2758 => 0.2940, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.7433 => 0.7922, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 6.56% (0.7835 => 0.8349, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (8.1363 => 8.6637, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3307 => 0.3519, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.38% (0.3121 => 0.3320, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.36% (0.7326 => 0.7792, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30% (0.5860 => 0.6229, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.29% (4.2646 => 4.5330, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3423 => 0.3638, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.19% (0.6675 => 0.7088, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5387, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.99% (1.3050 => 1.3832, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.95% (4.9449 => 5.2393, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.94% (5.0018 => 5.2987, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.88% (1.5415 => 1.6321, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.84% (0.8067 => 0.8538, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.82% (0.4299 => 0.4549, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.76% (5.7591 => 6.0911, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.66% (0.3092 => 0.3267, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.66% (1.5603 => 1.6486, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.53% (0.3817 => 0.4028, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (0.9765 => 1.0293, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.39% (1.1642 => 1.2269, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (14.3668 => 15.1332, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2603 => 0.2738, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1861 => 1.2463, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.83% (3.8723 => 4.0595, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.78% (7.9617 => 8.3420, std. dev.: 0.0159) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1237, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 4.72% (1.0722 => 1.1228, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.68% (0.4636 => 0.4853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.61% (0.4103 => 0.4292, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.60% (0.5020 => 0.5251, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.4064 => 0.4247, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.48% (0.6450 => 0.6739, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8921 => 0.9294, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.18% (2.2969 => 2.3928, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.16% (0.5981 => 0.6230, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.16% (21.9371 => 22.8493, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.15% (0.3136 => 0.3266, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.03% (0.3650 => 0.3797, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3826 => 0.3980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.97% (0.3098 => 0.3221, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3865 => 0.4018, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.2905 => 0.3018, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.86% (0.2872 => 0.2983, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.4186 => 1.4732, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4203 => 0.4364, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.4289 => 0.4453, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.4048 => 0.4202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.73% (2.0665 => 2.1436, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4620 => 0.4792, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.64% (1.5859 => 1.6437, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.59% (17.1811 => 17.7986, std. dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 3.55% (0.2871 => 0.2973, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.51% (0.2877 => 0.2978, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.2024 => 2.2751, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2178, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.8101 => 0.8299, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.29% (1.2842 => 1.3136, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.09% (1.1145 => 1.3718, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3809, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (4.2280 => 4.3663, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7454, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2236, std. dev.: 0.0180) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.47% (5.2763 => 3.2466, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.27% (5.3855 => 3.8632, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.89% (5.3526 => 3.8596, std. dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1803, std. dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.64% (2.9384 => 2.5965, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.10% (22.1758 => 20.3793, std. dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3116, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7169, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.15% (1.6805 => 1.5771, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0014) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5015, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4109, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0025, std. dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5530, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0035, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6781, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2289, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 08:02:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 10:02:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908150215.7C4F32A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3574?compare_to=3570&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3574, Order: 163467, Start Time: 2012-09-08 12:19:26, End Time: 2012-09-08 15:03:28 To: 3570, Order: 163465, Start Time: 2012-09-08 09:06:32, End Time: 2012-09-08 11:50:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (124 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.46% (54.0857 => 54.8753, std. dev.: 0.0927) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.63% (0.3643 => 0.4103, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.33% (0.3724 => 0.4183, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.23% (1.5932 => 1.7244, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.1620 => 0.1751, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.91% (0.5826 => 0.6287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.74% (0.5889 => 0.6345, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (3.5627 => 3.8238, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.24% (1.3152 => 1.4104, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.16% (1.6211 => 1.7372, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (0.4994 => 0.5336, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.82% (0.7171 => 0.7660, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.70% (0.5000 => 0.5335, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.47% (0.4361 => 0.4643, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.35% (0.2866 => 0.3048, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 6.28% (0.4029 => 0.4282, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (0.3930 => 0.4174, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 6.17% (4.2109 => 4.4709, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 6.04% (0.2566 => 0.2721, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (0.5900 => 0.6249, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 5.83% (1.0781 => 1.1410, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (0.5026 => 0.5319, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.1968 => 0.2080, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.67% (2.7292 => 2.8840, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.43% (0.4658 => 0.4911, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.42% (5.5417 => 5.8422, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3362 => 0.3544, std. dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (1.9966 => 2.0986, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2738 => 0.2877, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.02% (1.9694 => 2.0683, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (0.3890 => 0.4085, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.98% (0.3195 => 0.3354, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.94% (0.9909 => 1.0399, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 4.92% (1.8794 => 1.9719, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.88% (2.1013 => 2.2038, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 4.81% (0.6634 => 0.6953, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 4.80% (0.9697 => 1.0162, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.70% (0.2725 => 0.2853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2714 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.68% (0.2823 => 0.2955, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.3903 => 0.4085, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.2780 => 0.2909, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.63% (1.4269 => 1.4930, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.62% (0.2813 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.62% (0.2729 => 0.2855, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.60% (0.2803 => 0.2932, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (2.0673 => 2.1621, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.58% (0.2750 => 0.2876, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (2.1653 => 2.2645, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.54% (0.3060 => 0.3199, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.53% (0.5546 => 0.5797, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.3845 => 0.4019, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.51% (0.2792 => 0.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.48% (0.2811 => 0.2937, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.47% (0.2911 => 0.3041, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.3096 => 0.3234, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (4.4195 => 4.6163, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 4.44% (4.6177 => 4.8226, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3625 => 0.3784, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.32% (0.3124 => 0.3259, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3267 => 0.3408, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.30% (0.7875 => 0.8214, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.4139 => 0.4317, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.3271 => 0.3411, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3678 => 0.3832, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.19% (0.3726 => 0.3882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.16% (0.3317 => 0.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3348 => 0.3487, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 4.15% (23.5202 => 24.4964, std. dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3282 => 0.3418, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.3477 => 0.3620, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.96% (0.3084 => 0.3206, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.93% (0.3336 => 0.3467, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.88% (0.3792 => 0.3939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.86% (0.4146 => 0.4306, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.86% (0.4251 => 0.4415, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3690 => 0.3831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.69% (0.3981 => 0.4128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.6435 => 0.6661, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.5012 => 0.5180, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.89% (2.0346 => 2.0935, std. dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 2.72% (0.4847 => 0.4979, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (0.5361 => 0.5495, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (0.7426 => 0.7594, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.95% (0.5584 => 0.5693, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.73% (11.6398 => 11.8417, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.34% (4.6926 => 4.7554, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8979, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6455, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std. dev.: 0.0454) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5073, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4553, std. dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.49% (3.1722 => 3.2195, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5947, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5442, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary2: -9.66% (0.2402 => 0.2170, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7907, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8000, std. dev.: 0.0122) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7965, std. dev.: 0.0525) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.91% (0.6293 => 0.6173, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9617, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 11:14:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 13:14:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908181423.D90F22A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3575?compare_to=3574&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3575, Order: 163469, Start Time: 2012-09-08 15:31:40, End Time: 2012-09-08 18:15:36 To: 3574, Order: 163467, Start Time: 2012-09-08 12:19:26, End Time: 2012-09-08 15:03:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.16% (2.0301 => 2.1146, std. dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.42% (125.4861 => 127.2718, std. dev.: 0.5479) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.25% (0.3488 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3469 => 0.3921, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.60% (0.3643 => 0.4102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3724 => 0.4187, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 8.21% (1.5932 => 1.7240, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1620 => 0.1753, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.84% (0.5826 => 0.6283, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.69% (0.5889 => 0.6342, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.12% (3.5627 => 3.8163, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (1.6211 => 1.7364, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.81% (1.3152 => 1.4048, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.4994 => 0.5334, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 6.76% (0.7171 => 0.7656, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.59% (0.5900 => 0.6289, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.56% (0.4361 => 0.4647, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.45% (0.4029 => 0.4289, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.44% (0.5000 => 0.5322, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 6.01% (4.2109 => 4.4640, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 5.88% (0.2566 => 0.2717, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (0.5026 => 0.5319, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.74% (1.0781 => 1.1400, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.2866 => 0.3030, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.64% (2.7292 => 2.8832, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.2736 => 0.2889, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.23% (5.5417 => 5.8317, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (0.4658 => 0.4900, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.10% (2.1013 => 2.2084, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.02% (1.9694 => 2.0683, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (0.3890 => 0.4084, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (1.9966 => 2.0961, std. dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 4.97% (0.9909 => 1.0401, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3195 => 0.3352, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.86% (0.3004 => 0.3150, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2738 => 0.2869, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.73% (0.2725 => 0.2854, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 4.73% (0.9697 => 1.0156, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2714 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.3362 => 0.3520, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (1.8794 => 1.9676, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 4.69% (0.2813 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.3903 => 0.4085, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 4.65% (0.2750 => 0.2878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.64% (0.2823 => 0.2954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.62% (0.2729 => 0.2855, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.60% (0.2780 => 0.2908, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.57% (0.6634 => 0.6937, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2803 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.55% (0.2792 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.54% (2.0673 => 2.1611, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wc: 4.52% (0.3096 => 0.3236, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.52% (1.4269 => 1.4914, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.4139 => 0.4324, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.47% (0.3267 => 0.3413, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (4.4195 => 4.6154, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (2.1653 => 2.2611, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.2911 => 0.3039, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.35% (0.3060 => 0.3193, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.33% (4.6177 => 4.8178, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.3271 => 0.3412, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.29% (0.7875 => 0.8213, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.24% (0.3726 => 0.3884, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3124 => 0.3256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3678 => 0.3833, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (0.3625 => 0.3777, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3348 => 0.3488, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.18% (23.5202 => 24.5036, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3282 => 0.3418, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.05% (0.4146 => 0.4314, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.04% (0.5546 => 0.5770, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.2969 => 0.3088, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.3084 => 0.3205, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4251 => 0.4417, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.90% (0.3336 => 0.3466, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3690 => 0.3833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.2737 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.3981 => 0.4123, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.3845 => 0.3980, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.5012 => 0.5186, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.87% (2.0346 => 2.0929, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (0.4847 => 0.4972, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (0.5361 => 0.5485, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (0.7426 => 0.7591, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (11.6398 => 11.8368, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.24% (4.6926 => 4.7509, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.88% (0.2122 => 0.2268, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6768, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8973, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1629, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6422, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2019, std. dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std. dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (2.0820 => 2.1146, std. dev.: 0.0126) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4378, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2902, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5892, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5811, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9738, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7985, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std. dev.: 0.0062) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.07% (17.2379 => 16.8814, std. dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9743, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 12:16:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 14:16:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120908191649.E85332A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3576?compare_to=3571&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3576, Order: 163473, Start Time: 2012-09-08 18:07:27, End Time: 2012-09-08 19:18:04 To: 3571, Order: 163469, Start Time: 2012-09-08 12:31:24, End Time: 2012-09-08 13:42:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (51 on baseline) Performance Improvements: 0 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.61% (0.4341 => 0.4628, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3209 => 0.3313, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.8790 => 0.9046, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.82% (0.7573 => 0.7938, std. dev.: 0.0109) MultiSource/Benchmarks/FreeBench/distray/distray: 4.07% (0.2484 => 0.2585, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.90% (21.5367 => 22.3771, std. dev.: 0.1856) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (4.3693 => 4.4602, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/whetstone: 1.33% (2.3605 => 2.3919, std. dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.27% (0.1414 => 0.1531, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.78% (0.3582 => 0.3789, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.55% (0.6410 => 0.6766, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (1.1653 => 1.2107, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: 3.66% (0.6173 => 0.6399, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.5150 => 1.5603, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.72% (0.3901 => 0.4007, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.7639 => 0.7802, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.09% (1.1827 => 1.2074, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.85% (29.3170 => 29.8606, std. dev.: 0.1638) MultiSource/Applications/Burg/burg: 1.81% (1.1440 => 1.1647, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 1.54% (1.3268 => 1.3472, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (8.2186 => 8.3314, std. dev.: 0.0397) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.0689 => 1.0824, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.0317 => 2.0525, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0255) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std. dev.: 0.0689) SingleSource/Benchmarks/McGill/misr: 13.76% (0.4296 => 0.4887, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5575, std. dev.: 0.0182) MultiSource/Applications/sgefa/sgefa: 12.44% (0.3746 => 0.4212, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.12% (1.0063 => 1.0981, std. dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/sieve: 9.01% (3.4406 => 3.7505, std. dev.: 0.0667) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6054, std. dev.: 0.0281) SingleSource/Benchmarks/Stanford/Puzzle: 8.37% (0.1433 => 0.1553, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.63% (0.2857 => 0.3075, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 7.31% (1.0194 => 1.0939, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (3.4876 => 3.7011, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.3301 => 0.3500, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.98% (27.1724 => 28.7967, std. dev.: 0.0511) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.87% (4.2129 => 4.4602, std. dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.17% (40.4792 => 42.5702, std. dev.: 0.3742) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.32% (0.7609 => 0.7938, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8772, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/dt: 4.10% (0.9851 => 1.0255, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5397, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std. dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.91% (0.3508 => 0.3610, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7572, std. dev.: 0.0450) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.38% (0.5876 => 0.6016, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: 1.99% (2.3453 => 2.3919, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/five11/five11: 1.87% (5.1938 => 5.2911, std. dev.: 0.0278) MultiSource/Applications/siod/siod: 1.51% (3.5520 => 3.6056, std. dev.: 0.0163) MultiSource/Applications/lua/lua: 1.30% (29.5232 => 29.9070, std. dev.: 0.0281) MultiSource/Benchmarks/Olden/bh/bh: 1.26% (2.5166 => 2.5483, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6677, std. dev.: 0.0243) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4455 => 2.4753, std. dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: 1.09% (2.4971 => 2.5243, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.06% (0.3497 => 0.2096, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0916, std. dev.: 0.2253) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.02% (1.1647 => 0.9898, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.31% (8.1594 => 7.1553, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9413, std. dev.: 0.0272) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.23% (3.6254 => 3.3633, std. dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: -6.83% (3.4230 => 3.1893, std. dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -5.74% (1.4441 => 1.3612, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0580) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.91% (1.1683 => 1.1226, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.74% (1.7361 => 1.6712, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.60% (45.4683 => 43.8299, std. dev.: 0.2283) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.22% (1.2959 => 1.2542, std. dev.: 0.0114) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.99% (1.2722 => 1.2342, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6387, std. dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/methcall: -2.89% (9.2503 => 8.9830, std. dev.: 0.0506) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0051) MultiSource/Applications/aha/aha: -2.65% (3.4286 => 3.3377, std. dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (92.7467 => 90.3269, std. dev.: 0.9197) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.14% (1.0686 => 1.0457, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -2.05% (62.4126 => 61.1355, std. dev.: 0.1188) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.72% (1.8739 => 1.8416, std. dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2330, std. dev.: 0.0229) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.54% (3.8907 => 3.8308, std. dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: -1.54% (6.7458 => 6.6422, std. dev.: 0.0308) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3096, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7674, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1116 => 1.1002, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 12:32:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 14:32:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120908193239.97D742A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3577?compare_to=3572&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3577, Order: 163473, Start Time: 2012-09-08 18:19:19, End Time: 2012-09-08 19:33:52 To: 3572, Order: 163469, Start Time: 2012-09-08 12:43:19, End Time: 2012-09-08 13:57:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.59% (2.0176 => 2.4128, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.22% (0.7710 => 0.8498, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.11% (0.5748 => 0.6329, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.09% (1.3693 => 1.5075, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.87% (3.9660 => 4.3574, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.40% (0.2596 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.27% (0.5265 => 0.5753, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7061 => 0.7713, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.19% (0.3646 => 0.3981, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7038 => 0.7683, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.05% (1.2193 => 1.3296, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9199 => 1.0019, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.81% (0.6959 => 0.7572, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.73% (0.4328 => 0.4706, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.69% (1.4563 => 1.5828, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.47% (1.1364 => 1.2326, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.23% (0.2781 => 0.3010, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.23% (0.3899 => 0.4220, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.14% (0.5577 => 0.6031, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.02% (0.2782 => 0.3005, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.01% (13.8202 => 14.9268, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash: 7.95% (0.4062 => 0.4385, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.95% (0.2127 => 0.2296, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.86% (0.6283 => 0.6777, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.84% (0.3022 => 0.3259, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (7.2180 => 7.7832, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.80% (0.3756 => 0.4049, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.79% (1.0313 => 1.1116, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.77% (0.3489 => 0.3760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.77% (0.3580 => 0.3858, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.62% (0.2914 => 0.3136, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.61% (0.7506 => 0.8077, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.60% (1.9828 => 2.1334, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.53% (0.2655 => 0.2855, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2761 => 0.2968, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.46% (0.2760 => 0.2966, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2765 => 0.2971, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.4016 => 0.4315, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.42% (0.2628 => 0.2823, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.2726 => 0.2928, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.36% (0.8310 => 0.8922, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.3868 => 0.4150, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.29% (1.1061 => 1.1867, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (13.2842 => 14.2461, std. dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.20% (3.6692 => 3.9333, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.20% (0.2696 => 0.2890, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.18% (0.5637 => 0.6042, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.18% (0.3453 => 0.3701, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2023 => 0.2168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.05% (0.3220 => 0.3447, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 7.00% (3.8646 => 4.1350, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3534 => 0.3775, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 6.69% (2.1791 => 2.3249, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 6.61% (1.9270 => 2.0543, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.58% (1.3245 => 1.4116, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 6.58% (3.1889 => 3.3986, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 6.39% (0.4113 => 0.4376, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (1.2749 => 1.3558, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 6.33% (0.6744 => 0.7171, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.0594 => 1.1259, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.18% (0.6135 => 0.6514, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.13% (14.8535 => 15.7634, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.08% (4.3801 => 4.6462, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (4.4433 => 4.7120, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.00% (0.8698 => 0.9220, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.91% (1.3813 => 1.4630, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.89% (16.6129 => 17.5915, std. dev.: 0.0185) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.2859 => 0.3027, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.85% (0.8818 => 0.9334, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.3819 => 1.4625, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (8.4961 => 8.9884, std. dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 5.78% (0.3131 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.2140 => 0.2262, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.63% (1.1333 => 1.1971, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6576 => 0.6944, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.55% (14.5298 => 15.3364, std. dev.: 0.0143) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.25% (6.5754 => 6.9208, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 5.17% (1.2292 => 1.2928, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.95% (16.2614 => 17.0658, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (3.2742 => 3.4336, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 4.76% (4.6629 => 4.8849, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.4805 => 0.5029, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (0.9108 => 0.9506, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.18% (1.5188 => 1.5823, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6250 => 0.6506, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (4.9865 => 5.1888, std. dev.: 0.0145) MultiSource/Applications/lua/lua: 4.02% (3.7467 => 3.8974, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.93% (2.1007 => 2.1832, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.74% (6.2785 => 6.5132, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.59% (33.2944 => 34.1559, std. dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2678, std. dev.: 0.0365) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.54% (3.1736 => 3.4128, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5471, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0797, std. dev.: 0.0338) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (0.5184 => 0.5331, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5976, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2065, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5864, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.34% (0.4657 => 0.3989, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.7002, std. dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2631, std. dev.: 0.0191) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.63% (1.3780 => 1.2867, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0005) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1510, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.47% (3.0263 => 2.9212, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5747, std. dev.: 0.0280) MultiSource/Benchmarks/Olden/bh/bh: -2.82% (1.9762 => 1.9204, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.52% (4.5928 => 4.5231, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2396, std. dev.: 0.0261) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2229, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8733, std. dev.: 0.0123) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4308, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2632, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 12:37:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 14:37:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120908193750.1A0EE2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3578?compare_to=3573&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3578, Order: 163473, Start Time: 2012-09-08 18:19:19, End Time: 2012-09-08 19:39:03 To: 3573, Order: 163469, Start Time: 2012-09-08 12:43:14, End Time: 2012-09-08 14:03:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (130 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.25% (14.5334 => 14.7157, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.18% (27.6669 => 29.6541, std. dev.: 0.0228) SingleSource/Benchmarks/Misc/lowercase: 1.49% (7.9364 => 8.0546, std. dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.94% (10.3673 => 14.7157, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 26.39% (0.1622 => 0.2050, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.64% (2.2022 => 2.5025, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.31% (7.0540 => 7.9931, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 12.92% (0.1432 => 0.1617, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.87% (0.3473 => 0.3920, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3543 => 0.3993, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.66% (0.3561 => 0.4012, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.64% (0.3497 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3516 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3543 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.92% (1.1194 => 1.2528, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.24% (1.7609 => 1.9589, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.33% (10.4361 => 11.2009, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.8172 => 0.8768, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.17% (9.4845 => 10.1641, std. dev.: 0.0080) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5925 => 0.6343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.03% (0.4879 => 0.5222, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7433 => 0.7917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.33% (8.1363 => 8.6513, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.25% (0.3423 => 0.3637, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.8067 => 0.8569, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5860 => 0.6223, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (4.2646 => 4.5283, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.16% (0.7115 => 0.7553, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.06% (1.3050 => 1.3841, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.03% (0.5569 => 0.5905, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 6.01% (0.7835 => 0.8306, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 5.98% (0.7326 => 0.7764, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.5415 => 1.6336, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.97% (0.5105 => 0.5410, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.88% (5.0018 => 5.2958, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.86% (4.9449 => 5.2349, std. dev.: 0.0123) MultiSource/Applications/d/make_dparser: 5.86% (3.3354 => 3.5310, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 5.72% (5.7591 => 6.0888, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 5.66% (0.3180 => 0.3360, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 5.66% (1.5603 => 1.6486, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.9765 => 1.0305, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.51% (0.4299 => 0.4536, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.49% (0.2603 => 0.2746, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.29% (0.4103 => 0.4320, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.28% (1.1642 => 1.2257, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (14.3668 => 15.1184, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6450 => 0.6778, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (1.1861 => 1.2461, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 4.87% (0.3387 => 0.3552, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.82% (0.3817 => 0.4001, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.75% (1.0722 => 1.1231, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.74% (0.5020 => 0.5258, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 4.68% (3.8723 => 4.0535, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (7.9617 => 8.3337, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 4.55% (2.0273 => 2.1195, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.4064 => 0.4241, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.34% (0.4636 => 0.4837, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.29% (2.2969 => 2.3954, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8921 => 0.9297, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3422 => 0.3565, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.08% (21.9371 => 22.8321, std. dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.05% (0.3162 => 0.3290, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6456 => 0.6716, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.4186 => 1.4733, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3650 => 0.3785, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3865 => 0.4006, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4289 => 0.4443, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.58% (17.1811 => 17.7957, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.53% (1.5859 => 1.6419, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.4203 => 0.4349, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.31% (2.0665 => 2.1350, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.28% (0.3935 => 0.4064, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.4048 => 0.4180, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3603 => 0.3718, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.2024 => 2.2717, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.1840 => 1.2181, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.8101 => 0.8300, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.03% (1.2842 => 1.3103, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8966, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2142, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (4.2280 => 4.3586, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7474, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2457, std. dev.: 0.0348) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7608, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.50% (5.2763 => 3.2449, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.28% (5.3855 => 3.8624, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.92% (5.3526 => 3.8580, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1543, std. dev.: 0.0269) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.67% (2.9384 => 2.5955, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -8.20% (22.1758 => 20.3569, std. dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2929, std. dev.: 0.1497) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.87% (0.3463 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (1.8329 => 1.7155, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.14% (1.6805 => 1.5774, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std. dev.: 0.0008) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5098, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4169, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9903, std. dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -2.41% (1.2373 => 1.2075, std. dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.94% (4.6441 => 4.5542, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6783, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (8.1563 => 8.0229, std. dev.: 0.0178) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2296, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 8 14:26:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Sep 2012 16:26:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120908212617.878AA2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3579?compare_to=3575&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3579, Order: 163473, Start Time: 2012-09-08 18:43:43, End Time: 2012-09-08 21:27:30 To: 3575, Order: 163469, Start Time: 2012-09-08 15:31:40, End Time: 2012-09-08 18:15:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.74% (0.4522 => 0.4827, std. dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.47% (2.2744 => 2.3078, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 1.30% (2.7853 => 2.8216, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 1.02% (2.2542 => 2.2773, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.86% (0.3446 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.78% (0.3465 => 0.3908, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3488 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.75% (0.3442 => 0.3881, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.63% (0.3469 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 12.24% (0.3643 => 0.4089, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.95% (0.3724 => 0.4169, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5826 => 0.6275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.57% (0.5889 => 0.6335, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.19% (1.5932 => 1.7078, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (1.6211 => 1.7358, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (3.5627 => 3.8039, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.60% (0.5000 => 0.5330, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.52% (1.3152 => 1.4009, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.1968 => 0.2094, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.5900 => 0.6264, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (0.4994 => 0.5299, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (0.4361 => 0.4627, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.07% (0.7171 => 0.7606, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 5.55% (4.2109 => 4.4446, std. dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2738 => 0.2884, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.29% (1.0781 => 1.1351, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.2866 => 0.3013, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.11% (0.2875 => 0.3022, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.3004 => 0.3155, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (2.7292 => 2.8626, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3195 => 0.3350, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.81% (0.2725 => 0.2856, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.78% (5.5417 => 5.8068, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2803 => 0.2935, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 4.70% (0.9909 => 1.0375, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.69% (1.9694 => 2.0617, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2714 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.64% (0.2823 => 0.2954, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (0.4658 => 0.4874, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.58% (0.2792 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.58% (0.2729 => 0.2854, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3625 => 0.3791, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.53% (0.2780 => 0.2906, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.51% (0.2813 => 0.2940, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.3903 => 0.4078, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (1.9966 => 2.0860, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0673 => 2.1596, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 4.44% (0.9697 => 1.0128, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2750 => 0.2872, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3096 => 0.3232, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.3362 => 0.3508, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.34% (2.1013 => 2.1925, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3267 => 0.3408, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.28% (4.4195 => 4.6088, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.26% (0.2911 => 0.3035, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.25% (0.3060 => 0.3190, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (1.8794 => 1.9591, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3124 => 0.3256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.3258 => 0.3394, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3282 => 0.3416, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.3678 => 0.3827, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 4.03% (1.4269 => 1.4844, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3726 => 0.3876, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.97% (0.3477 => 0.3615, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.95% (4.6177 => 4.8002, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3690 => 0.3835, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.3845 => 0.3995, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.87% (0.6634 => 0.6891, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 3.86% (0.5546 => 0.5760, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.85% (0.7875 => 0.8178, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.81% (0.4146 => 0.4304, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.80% (2.1653 => 2.2475, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.3271 => 0.3394, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 3.65% (0.4251 => 0.4406, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.63% (23.5202 => 24.3746, std. dev.: 0.0150) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.45% (0.3792 => 0.3923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.39% (0.3336 => 0.3449, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.15% (0.5012 => 0.5170, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.6435 => 0.6634, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.43% (2.0346 => 2.0840, std. dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (0.4847 => 0.4952, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (0.7426 => 0.7558, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (11.6398 => 11.8001, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6426, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std. dev.: 0.0109) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5018, std. dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4475, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2912, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.42% (2.0820 => 2.1115, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.07% (105.3826 => 106.5123, std. dev.: 0.0394) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5537, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary2: -10.70% (0.2402 => 0.2145, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7939, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/tsp/tsp: -7.12% (2.1113 => 1.9609, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7945, std. dev.: 0.0065) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7509, std. dev.: 0.0608) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.16% (0.6293 => 0.6157, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9595, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 04:44:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 06:44:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909114452.D9E6E2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3580?compare_to=3576&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3580, Order: 163476, Start Time: 2012-09-09 10:35:23, End Time: 2012-09-09 11:46:07 To: 3576, Order: 163473, Start Time: 2012-09-08 18:07:27, End Time: 2012-09-08 19:18:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (51 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (3.7505 => 3.8785, std. dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 2.31% (7.0501 => 7.2127, std. dev.: 0.0264) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.70% (1.2717 => 1.2933, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.34% (2.6872 => 2.7231, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 1.23% (3.0641 => 3.1017, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.11% (1.1226 => 1.1351, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.88% (0.6410 => 0.6723, std. dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: 4.62% (2.1763 => 2.2769, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 4.20% (1.1653 => 1.2142, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3217 => 0.3346, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 3.60% (1.0046 => 1.0408, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.60% (0.3582 => 0.3711, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.53% (0.6173 => 0.6391, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.5150 => 1.5603, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.3935 => 1.4217, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.95% (3.0225 => 3.0814, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6069 => 0.6177, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.7639 => 0.7763, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.48% (6.2546 => 6.3474, std. dev.: 0.0341) MultiSource/Applications/ClamAV/clamscan: 1.47% (14.6079 => 14.8232, std. dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 1.39% (13.3238 => 13.5093, std. dev.: 0.0398) MultiSource/Applications/oggenc/oggenc: 1.14% (4.7455 => 4.7996, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std. dev.: 0.0498) SingleSource/Benchmarks/McGill/misr: 13.73% (0.4296 => 0.4886, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (4.0101 => 4.5521, std. dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8785, std. dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3746 => 0.4200, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6177, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.93% (0.2857 => 0.3055, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.57% (0.3301 => 0.3518, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (3.4876 => 3.7139, std. dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8093, std. dev.: 0.0663) SingleSource/Benchmarks/Misc/fp-convert: 4.69% (15.2242 => 15.9383, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5422, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 3.76% (8.5113 => 8.8315, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.45% (6.9722 => 7.2127, std. dev.: 0.0264) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3508 => 0.3612, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.16% (2.6656 => 2.7231, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bisort/bisort: 2.07% (0.6459 => 0.6593, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.6127 => 4.6989, std. dev.: 0.0124) MultiSource/Benchmarks/BitBench/five11/five11: 1.79% (5.1938 => 5.2866, std. dev.: 0.0352) SingleSource/Benchmarks/Dhrystone/fldry: 1.68% (2.4971 => 2.5390, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2726 => 1.2933, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (2.4455 => 2.4788, std. dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6761, std. dev.: 0.0239) MultiSource/Applications/minisat/minisat: 1.30% (6.2244 => 6.3051, std. dev.: 0.0254) MultiSource/Benchmarks/Olden/bh/bh: 1.24% (2.5166 => 2.5479, std. dev.: 0.0082) MultiSource/Applications/siod/siod: 1.19% (3.5520 => 3.5941, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.04% (4.0659 => 4.1080, std. dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.62% (0.7738 => 0.7613, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.69% (0.3497 => 0.2109, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.51% (5.2665 => 4.0809, std. dev.: 0.0485) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9917, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std. dev.: 0.1933) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.05% (3.2007 => 2.9430, std. dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3640, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -6.68% (3.4230 => 3.1943, std. dev.: 0.0607) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -5.57% (1.4441 => 1.3637, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4104, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.67% (45.4683 => 43.3439, std. dev.: 0.6195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.61% (1.2959 => 1.2361, std. dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7621, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.21% (9.2503 => 8.8605, std. dev.: 0.0801) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.11% (2.4457 => 2.3452, std. dev.: 0.0187) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.34% (1.2722 => 1.2297, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.08% (1.7361 => 1.6827, std. dev.: 0.0036) MultiSource/Applications/aha/aha: -2.92% (3.4286 => 3.3285, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -2.87% (62.4126 => 60.6230, std. dev.: 0.3928) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.84% (1.1683 => 1.1351, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2850, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.70% (1.4021 => 1.3642, std. dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: -2.65% (92.7467 => 90.2870, std. dev.: 0.2076) MultiSource/Benchmarks/Olden/tsp/tsp: -1.76% (1.7330 => 1.7025, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2347, std. dev.: 0.0296) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3119, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7696, std. dev.: 0.0173) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 05:01:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 07:01:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120909120114.773DD2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3581?compare_to=3577&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3581, Order: 163476, Start Time: 2012-09-09 10:47:53, End Time: 2012-09-09 12:02:25 To: 3577, Order: 163473, Start Time: 2012-09-08 18:19:19, End Time: 2012-09-08 19:33:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.85% (55.3170 => 56.3402, std. dev.: 0.0890) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (2.0176 => 2.4140, std. dev.: 0.0141) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.02% (0.5818 => 0.6401, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.97% (1.3693 => 1.5058, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/Hello: 9.95% (0.5748 => 0.6320, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.94% (0.7710 => 0.8476, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.84% (3.9660 => 4.3564, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.36% (0.2596 => 0.2839, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5265 => 0.5746, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7038 => 0.7679, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.89% (0.9199 => 1.0017, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.2193 => 1.3275, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.85% (0.6959 => 0.7575, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.71% (0.3940 => 0.4283, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.4563 => 1.5796, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.41% (1.1364 => 1.2320, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9335, std. dev.: 0.0155) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.78% (1.0313 => 1.1115, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (7.2180 => 7.7774, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.73% (0.3246 => 0.3497, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.72% (0.4379 => 0.4717, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.69% (0.6283 => 0.6766, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3580 => 0.3855, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.59% (0.7506 => 0.8076, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.58% (0.2914 => 0.3135, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.53% (0.4791 => 0.5152, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.53% (1.1061 => 1.1894, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.37% (0.3756 => 0.4033, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 7.32% (0.8310 => 0.8918, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.31% (13.2842 => 14.2559, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists: 7.29% (0.3293 => 0.3533, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (1.9828 => 2.1269, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.22% (3.8646 => 4.1435, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.15% (0.5637 => 0.6040, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.11% (3.6692 => 3.9301, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4390 => 0.4688, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.73% (0.3107 => 0.3316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.70% (0.3192 => 0.3406, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 6.62% (2.1791 => 2.3234, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.61% (1.3245 => 1.4120, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.60% (3.1889 => 3.3994, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.59% (0.4113 => 0.4384, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.53% (0.2988 => 0.3183, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.49% (0.6744 => 0.7182, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 6.46% (1.9270 => 2.0515, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.36% (1.2749 => 1.3560, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.32% (0.6135 => 0.6523, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.23% (1.0594 => 1.1254, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2504 => 0.2658, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.09% (14.8535 => 15.7579, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (4.4433 => 4.7120, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.04% (4.3801 => 4.6445, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 5.93% (16.6129 => 17.5978, std. dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.89% (1.3813 => 1.4627, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.8698 => 0.9208, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (8.4961 => 8.9933, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.84% (1.3819 => 1.4626, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.82% (0.8818 => 0.9331, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.2859 => 0.3025, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.69% (0.3131 => 0.3309, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.66% (14.5298 => 15.3519, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1974, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.47% (0.6576 => 0.6936, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 5.29% (6.5754 => 6.9231, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.92% (16.2614 => 17.0617, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.82% (3.2742 => 3.4320, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2292 => 1.2874, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.73% (4.6629 => 4.8835, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.43% (0.4805 => 0.5018, std. dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.22% (1.5188 => 1.5829, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.03% (2.1007 => 2.1853, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 4.00% (3.7467 => 3.8965, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1858, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6250 => 0.6493, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.82% (6.2785 => 6.5181, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.46% (33.2944 => 34.1126, std. dev.: 0.0274) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5195, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std. dev.: 0.0293) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7330, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0948, std. dev.: 0.0518) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.5184 => 0.5332, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5867, std. dev.: 0.0095) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.41% (0.4657 => 0.3986, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7095, std. dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2703, std. dev.: 0.0294) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.99% (1.3780 => 1.2955, std. dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std. dev.: 0.0010) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1514, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9225, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5925, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2419, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5203, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0183) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std. dev.: 0.0217) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2286, std. dev.: 0.0362) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.12% (6.6320 => 6.5577, std. dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 05:06:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 07:06:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120909120650.B36122A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3582?compare_to=3578&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3582, Order: 163476, Start Time: 2012-09-09 10:48:12, End Time: 2012-09-09 12:08:04 To: 3578, Order: 163473, Start Time: 2012-09-08 18:19:19, End Time: 2012-09-08 19:39:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.51% (3.7808 => 3.8379, std. dev.: 0.0198) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.80% (10.3673 => 14.7011, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (2.2022 => 2.5045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.34% (7.0540 => 7.9948, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3473 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 12.50% (0.3561 => 0.4006, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.87% (1.1194 => 1.2523, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.76% (1.7609 => 1.9679, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.96% (0.3282 => 0.3576, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.2065 => 0.2222, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 7.23% (10.4361 => 11.1904, std. dev.: 0.0193) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 7.08% (9.4845 => 10.1562, std. dev.: 0.0184) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.03% (0.4879 => 0.5222, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 6.85% (0.2554 => 0.2729, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5925 => 0.6328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.80% (0.6030 => 0.6440, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.72% (0.8172 => 0.8721, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4615 => 0.4922, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (8.1363 => 8.6523, std. dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7433 => 0.7895, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.13% (0.6675 => 0.7084, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5860 => 0.6219, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (4.2646 => 4.5231, std. dev.: 0.0122) MultiSource/Applications/minisat/minisat: 6.06% (0.7115 => 0.7546, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.95% (0.5105 => 0.5409, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.3050 => 1.3826, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.89% (0.5569 => 0.5897, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 5.87% (0.7835 => 0.8295, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.87% (5.0018 => 5.2952, std. dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3121 => 0.3303, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.80% (4.9449 => 5.2318, std. dev.: 0.0195) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (1.5415 => 1.6308, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 5.77% (3.3354 => 3.5279, std. dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.73% (0.2758 => 0.2916, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7326 => 0.7743, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 5.66% (5.7591 => 6.0850, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.3092 => 0.3264, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.8067 => 0.8506, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4299 => 0.4531, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 5.35% (0.3180 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.31% (0.9765 => 1.0284, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 5.28% (1.1642 => 1.2257, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.20% (0.3441 => 0.3620, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (14.3668 => 15.1087, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1861 => 1.2457, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 4.97% (1.5603 => 1.6378, std. dev.: 0.0110) MultiSource/Benchmarks/sim/sim: 4.84% (0.3387 => 0.3551, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5020 => 0.5257, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 4.68% (3.8723 => 4.0534, std. dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (7.9617 => 8.3336, std. dev.: 0.0158) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.66% (0.3817 => 0.3995, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.64% (0.6450 => 0.6749, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 4.62% (1.0722 => 1.1217, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.37% (2.0273 => 2.1158, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.5981 => 0.6227, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 4.08% (21.9371 => 22.8317, std. dev.: 0.0480) MultiSource/Applications/siod/siod: 4.07% (2.2969 => 2.3903, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 4.05% (0.8921 => 0.9282, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3422 => 0.3558, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.4103 => 0.4266, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.4064 => 0.4223, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.68% (1.4186 => 1.4708, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (1.5859 => 1.6433, std. dev.: 0.0183) MultiSource/Applications/sqlite3/sqlite3: 3.55% (17.1811 => 17.7905, std. dev.: 0.0407) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.53% (0.3826 => 0.3961, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.45% (0.3650 => 0.3776, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.4636 => 0.4792, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.32% (0.3098 => 0.3201, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2730, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4203 => 0.4336, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4048 => 0.4174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3684 => 0.3792, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.92% (2.0665 => 2.1269, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2178, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.8101 => 0.8273, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3066, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0008) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3826, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (4.2280 => 4.3628, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7535, std. dev.: 0.0062) MultiSource/Benchmarks/llubenchmark/llu: 1.58% (3.7781 => 3.8379, std. dev.: 0.0198) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2352, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.12% (5.3855 => 3.8710, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.78% (5.3526 => 3.8658, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1357, std. dev.: 0.0366) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.02% (2.9384 => 2.5851, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -8.16% (22.1758 => 20.3672, std. dev.: 0.0504) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4269, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2767, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0216) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5017, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4221, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9981, std. dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (8.1563 => 7.9805, std. dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5530, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.77% (2.5528 => 2.5075, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2321, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 06:10:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 08:10:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909131058.AEDEB2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3583?compare_to=3580&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3583, Order: 163477, Start Time: 2012-09-09 12:01:28, End Time: 2012-09-09 13:12:14 To: 3580, Order: 163476, Start Time: 2012-09-09 10:35:23, End Time: 2012-09-09 11:46:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (52 on baseline) Performance Improvements: 2 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.7763 => 0.7934, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.41% (1.1814 => 1.1980, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 9.18% (0.8035 => 0.8773, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.24% (1.2361 => 1.2638, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -2.37% (7.2127 => 7.0415, std. dev.: 0.0642) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.57% (39.9181 => 39.2905, std. dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.23% (0.6410 => 0.6745, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.89% (0.3582 => 0.3757, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 4.55% (0.6173 => 0.6454, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.14% (2.1763 => 2.2665, std. dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 4.12% (1.1653 => 1.2133, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.86% (0.7639 => 0.7934, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3217 => 0.3340, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 3.66% (1.0046 => 1.0414, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.5150 => 1.5633, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3412 => 0.3516, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.64% (1.1672 => 1.1980, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (12.6413 => 12.9429, std. dev.: 0.0988) MultiSource/Applications/d/make_dparser: 2.38% (3.0225 => 3.0943, std. dev.: 0.0237) MultiSource/Applications/Burg/burg: 2.27% (1.1440 => 1.1700, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6069 => 0.6190, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.99% (1.2021 => 1.2260, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (1.3935 => 1.4200, std. dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 1.84% (29.3170 => 29.8556, std. dev.: 0.1563) MultiSource/Applications/SPASS/SPASS: 1.80% (13.3238 => 13.5639, std. dev.: 0.0193) MultiSource/Applications/oggenc/oggenc: 1.32% (4.7455 => 4.8081, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.34% (0.0917 => 0.1076, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std. dev.: 0.0183) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.38% (4.0101 => 4.5467, std. dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/sieve: 12.80% (3.4406 => 3.8810, std. dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 12.42% (0.1433 => 0.1611, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.67% (1.0194 => 1.1078, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6081, std. dev.: 0.0263) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.08% (27.1724 => 28.8243, std. dev.: 0.0666) SingleSource/Benchmarks/Shootout-C++/hash2: 5.77% (3.4876 => 3.6890, std. dev.: 0.0233) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.39% (4.2129 => 4.3979, std. dev.: 0.0580) SingleSource/Benchmarks/Misc/fp-convert: 4.33% (15.2242 => 15.8838, std. dev.: 0.0489) SingleSource/Benchmarks/Misc/dt: 4.21% (0.9851 => 1.0266, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.17% (40.4792 => 42.1667, std. dev.: 0.4177) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.71% (6.6312 => 6.8770, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.24% (0.8498 => 0.8773, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 3.21% (1.4184 => 1.4639, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 2.59% (0.6459 => 0.6626, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 2.53% (8.5113 => 8.7266, std. dev.: 0.0673) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.52% (0.5876 => 0.6024, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.49% (0.5587 => 0.5726, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 2.23% (5.1938 => 5.3094, std. dev.: 0.0307) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.86% (4.6127 => 4.6986, std. dev.: 0.0319) MultiSource/Applications/siod/siod: 1.66% (3.5520 => 3.6109, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.5166 => 2.5576, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6657, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.55% (0.3497 => 0.2079, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.04% (5.2665 => 4.1058, std. dev.: 0.1489) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9896, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std. dev.: 0.0673) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.03% (3.6254 => 3.3706, std. dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: -6.83% (3.4230 => 3.1891, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3519, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.91% (1.7361 => 1.6508, std. dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4080, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (9.2503 => 8.8734, std. dev.: 0.0749) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.98% (2.4457 => 2.3483, std. dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.96% (1.1683 => 1.1337, std. dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.94% (1.2722 => 1.2348, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.93% (3.7496 => 3.6399, std. dev.: 0.0126) MultiSource/Applications/aha/aha: -2.81% (3.4286 => 3.3323, std. dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -2.55% (92.7467 => 90.3861, std. dev.: 0.7194) MultiSource/Benchmarks/mafft/pairlocalalign: -2.49% (62.4126 => 60.8593, std. dev.: 0.2129) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.48% (1.2959 => 1.2638, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -2.36% (9.5474 => 9.3222, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.87% (1.8739 => 1.8389, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (9.3855 => 9.2418, std. dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: -1.45% (1.0926 => 1.0768, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -1.44% (6.7458 => 6.6488, std. dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3122, std. dev.: 0.0439) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7675, std. dev.: 0.0200) MultiSource/Benchmarks/Olden/tsp/tsp: -1.31% (1.7330 => 1.7103, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 06:30:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 08:30:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120909133033.EB8402A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3584?compare_to=3579&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3584, Order: 163476, Start Time: 2012-09-09 10:47:49, End Time: 2012-09-09 13:31:47 To: 3579, Order: 163473, Start Time: 2012-09-08 18:43:43, End Time: 2012-09-08 21:27:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.12% (123.8118 => 131.3885, std. dev.: 0.0449) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 12.48% (0.3469 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.13% (0.3643 => 0.4085, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.00% (0.3650 => 0.4088, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3724 => 0.4160, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.57% (0.5826 => 0.6267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.44% (0.5889 => 0.6327, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.1421 => 0.1524, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.92% (1.5932 => 1.7035, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (3.5627 => 3.8023, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (1.6211 => 1.7284, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.18% (1.3152 => 1.3965, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (0.4994 => 0.5295, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (0.4361 => 0.4621, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7171 => 0.7589, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (0.3930 => 0.4159, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.80% (0.5000 => 0.5290, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.5900 => 0.6239, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.69% (0.5026 => 0.5312, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.58% (0.4029 => 0.4254, std. dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 5.42% (4.2109 => 4.4393, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.2866 => 0.3018, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.24% (1.0781 => 1.1346, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2738 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (2.7292 => 2.8630, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.56% (1.9966 => 2.0876, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2714 => 0.2837, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.51% (5.5417 => 5.7918, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (0.3890 => 0.4064, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (1.9694 => 2.0572, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.44% (0.3195 => 0.3337, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.42% (0.9909 => 1.0347, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.39% (0.3004 => 0.3136, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.33% (0.2792 => 0.2913, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.30% (0.2813 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.29% (0.4658 => 0.4858, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (1.8794 => 1.9594, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.2823 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.25% (0.2803 => 0.2922, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.24% (2.0673 => 2.1550, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (2.1013 => 2.1896, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 4.20% (0.9697 => 1.0104, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (0.3625 => 0.3777, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (4.4195 => 4.6042, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: 4.16% (0.2811 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3267 => 0.3402, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.12% (0.3348 => 0.3486, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3258 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.96% (0.3362 => 0.3495, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.92% (2.1653 => 2.2502, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3317 => 0.3447, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.88% (1.4269 => 1.4823, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.86% (0.3678 => 0.3820, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3282 => 0.3408, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.76% (4.6177 => 4.7915, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.3271 => 0.3393, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.68% (0.6634 => 0.6878, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 3.67% (0.7875 => 0.8164, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.2969 => 0.3077, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.60% (0.3477 => 0.3602, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.57% (0.5546 => 0.5744, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.54% (23.5202 => 24.3524, std. dev.: 0.0338) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.3845 => 0.3981, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3690 => 0.3820, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4251 => 0.4399, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3792 => 0.3922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4146 => 0.4287, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.17% (0.3981 => 0.4107, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.01% (0.5012 => 0.5163, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.6435 => 0.6626, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.29% (2.0346 => 2.0812, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (0.7426 => 0.7548, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (11.6398 => 11.7826, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6694, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6358, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2011, std. dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5067, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std. dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4633, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5949, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5452, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7904, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8000, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: -3.09% (17.2379 => 16.7053, std. dev.: 0.0741) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std. dev.: 0.0045) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5722, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9579, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 06:43:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 08:43:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120909134339.99FDC2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3585?compare_to=3581&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3585, Order: 163477, Start Time: 2012-09-09 12:30:37, End Time: 2012-09-09 13:44:52 To: 3581, Order: 163476, Start Time: 2012-09-09 10:47:53, End Time: 2012-09-09 12:02:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (172 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.66% (2.0176 => 2.4143, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.07% (0.5818 => 0.6404, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.93% (0.5748 => 0.6319, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.93% (1.3693 => 1.5053, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.91% (3.9660 => 4.3591, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.88% (0.7710 => 0.8472, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.76% (0.1588 => 0.1743, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.40% (0.2596 => 0.2840, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.17% (0.5265 => 0.5748, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7038 => 0.7683, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.95% (1.2193 => 1.3284, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.94% (0.9199 => 1.0021, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.4003 => 0.4360, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.87% (0.6959 => 0.7576, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.4563 => 1.5797, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.42% (1.1364 => 1.2321, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9346, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5577 => 0.6024, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.86% (0.4379 => 0.4723, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.77% (7.2180 => 7.7786, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.71% (0.4062 => 0.4375, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.70% (0.3246 => 0.3496, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.69% (1.0313 => 1.1106, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3580 => 0.3855, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.59% (0.7506 => 0.8076, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.4791 => 0.5153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3489 => 0.3750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.45% (0.2914 => 0.3131, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3293 => 0.3537, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.40% (0.3756 => 0.4034, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.31% (1.9828 => 2.1277, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std. dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.24% (1.1061 => 1.1862, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.22% (13.2842 => 14.2429, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.18% (0.8310 => 0.8907, std. dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.13% (3.6692 => 3.9308, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2761 => 0.2956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.05% (3.8646 => 4.1370, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.83% (0.3192 => 0.3410, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.72% (0.4390 => 0.4685, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.64% (2.1791 => 2.3239, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.63% (3.1889 => 3.4002, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.61% (1.9270 => 2.0544, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.3245 => 1.4111, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.49% (0.7460 => 0.7944, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.41% (0.6744 => 0.7176, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (1.2749 => 1.3563, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.24% (0.6135 => 0.6518, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.0594 => 1.1252, std. dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 6.12% (14.8535 => 15.7630, std. dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.05% (4.3801 => 4.6450, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.03% (4.4433 => 4.7112, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 5.95% (16.6129 => 17.6012, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.2945 => 0.3120, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (0.2859 => 0.3028, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.89% (0.8698 => 0.9210, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.89% (1.3813 => 1.4626, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.86% (0.8818 => 0.9335, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.86% (1.3819 => 1.4629, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.86% (8.4961 => 8.9937, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 5.72% (0.3131 => 0.3310, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.2140 => 0.2262, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.64% (1.1333 => 1.1972, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.59% (14.5298 => 15.3418, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.46% (0.6576 => 0.6935, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (6.5754 => 6.9182, std. dev.: 0.0126) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.96% (16.2614 => 17.0682, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.91% (3.2742 => 3.4351, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.76% (4.6629 => 4.8849, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4805 => 0.5021, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.12% (1.5188 => 1.5814, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.10% (4.9865 => 5.1909, std. dev.: 0.0227) MultiSource/Applications/lua/lua: 4.04% (3.7467 => 3.8980, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (2.1007 => 2.1838, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (6.2785 => 6.5143, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 2.54% (33.2944 => 34.1394, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0468) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7333, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.31% (1.9199 => 1.9835, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0751, std. dev.: 0.0290) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (0.5184 => 0.5335, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4271 => 7.6128, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.13% (7.9275 => 8.0169, std. dev.: 0.0098) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.37% (0.4657 => 0.3988, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (22.5627 => 21.7063, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2609, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.74% (0.3458 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3020, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5155, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1516, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9231, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5962, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5216, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2414, std. dev.: 0.0197) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4310, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2338, std. dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 06:54:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 08:54:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120909135418.861E52A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3586?compare_to=3582&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3586, Order: 163478, Start Time: 2012-09-09 12:36:13, End Time: 2012-09-09 13:55:32 To: 3582, Order: 163476, Start Time: 2012-09-09 10:48:12, End Time: 2012-09-09 12:08:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (130 on baseline) Performance Improvements: 4 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (718 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -2.91% (17.7905 => 17.2733, std. dev.: 0.0197) MultiSource/Benchmarks/PAQ8p/paq8p: -2.48% (14.7011 => 14.3365, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.21% (15.1087 => 14.9253, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.02% (1.3181 => 1.3046, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.29% (10.3673 => 14.3365, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 26.57% (0.1622 => 0.2053, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.14% (2.2022 => 2.5136, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.91% (7.0540 => 8.0352, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.01% (1.1194 => 1.2538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3828 => 0.4283, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.61% (0.3886 => 0.4337, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.41% (1.7609 => 1.9618, std. dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 8.19% (0.1440 => 0.1558, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.27% (9.4845 => 10.1744, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.19% (0.4879 => 0.5230, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 7.14% (10.4361 => 11.1808, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.11% (0.8172 => 0.8753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5925 => 0.6343, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.96% (0.4615 => 0.4936, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7433 => 0.7923, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.53% (8.1363 => 8.6677, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.50% (0.3109 => 0.3311, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3423 => 0.3645, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.47% (0.7115 => 0.7575, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (4.2646 => 4.5341, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5860 => 0.6230, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.22% (1.3050 => 1.3862, std. dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3121 => 0.3315, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.20% (0.7835 => 0.8321, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.6675 => 0.7086, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.14% (5.0018 => 5.3090, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.09% (4.9449 => 5.2458, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.07% (0.5105 => 0.5415, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7326 => 0.7767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.95% (1.5415 => 1.6332, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.90% (3.3354 => 3.5321, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.8067 => 0.8542, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.84% (5.7591 => 6.0952, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.66% (0.3180 => 0.3360, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4299 => 0.4537, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.9765 => 1.0305, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 5.45% (1.1642 => 1.2277, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 5.34% (1.5603 => 1.6436, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1861 => 1.2478, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.15% (7.9617 => 8.3714, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.09% (0.3441 => 0.3616, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.91% (3.8723 => 4.0626, std. dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 4.84% (0.3387 => 0.3551, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.82% (1.0722 => 1.1239, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.82% (0.5020 => 0.5262, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.74% (0.6450 => 0.6756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.74% (0.3817 => 0.3998, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.73% (0.5981 => 0.6264, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.60% (2.0273 => 2.1206, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.53% (0.4103 => 0.4289, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.45% (0.6456 => 0.6743, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8921 => 0.9312, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 4.32% (0.3422 => 0.3570, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.20% (21.9371 => 22.8588, std. dev.: 0.0161) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3919, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3826 => 0.3980, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (1.4186 => 1.4755, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4636 => 0.4821, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (14.3668 => 14.9253, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.2905 => 0.3017, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3650 => 0.3790, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.76% (1.5859 => 1.6456, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4203 => 0.4359, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.3098 => 0.3209, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.48% (0.3162 => 0.3272, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.3052 => 0.3158, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.47% (0.3603 => 0.3728, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.44% (2.0665 => 2.1376, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.29% (2.2024 => 2.2749, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.05% (0.3379 => 0.3482, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1840 => 1.2199, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.8101 => 0.8290, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.19% (1.2842 => 1.3123, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.75% (0.2944 => 0.3290, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3616, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std. dev.: 0.0117) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7607, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.83% (5.2763 => 3.2276, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.80% (5.3855 => 3.8886, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.42% (5.3526 => 3.8849, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1171, std. dev.: 0.0584) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.88% (2.9384 => 2.5892, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -8.09% (22.1758 => 20.3818, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (19.9488 => 18.2307, std. dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.40% (1.8329 => 1.7156, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5114, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -4.04% (3.2827 => 3.1500, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5052, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4210, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0040, std. dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.35% (1.2373 => 1.2082, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5535, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9973, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 07:38:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 09:38:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909143815.4C5792A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3587?compare_to=3583&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3587, Order: 163478, Start Time: 2012-09-09 13:27:55, End Time: 2012-09-09 14:39:30 To: 3583, Order: 163477, Start Time: 2012-09-09 12:01:28, End Time: 2012-09-09 13:12:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (60 on baseline) Performance Improvements: 3 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 876 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.57% (0.7724 => 0.8077, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 3.02% (0.9341 => 0.9623, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.7709 => 0.7900, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 1.82% (1.1700 => 1.1913, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.42% (1.8957 => 1.9226, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5105 => 6.5870, std. dev.: 0.0280) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 55.00% (0.0200 => 0.0310, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (0.3327 => 0.3490, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (1.3204 => 1.3636, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.86% (1.6508 => 1.6815, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.58% (1.6093 => 1.6347, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: 1.19% (8.8734 => 8.9793, std. dev.: 0.0136) MultiSource/Applications/aha/aha: 1.04% (3.3323 => 3.3671, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.90% (0.7934 => 0.7783, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (4.6518 => 4.4421, std. dev.: 0.0549) SingleSource/Benchmarks/McGill/chomp: -1.07% (1.1078 => 1.0959, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.6410 => 0.6748, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.7722 => 0.8077, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 4.23% (1.1653 => 1.2146, std. dev.: 0.0126) MultiSource/Benchmarks/McCat/18-imp/imp: 4.20% (0.3217 => 0.3352, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.13% (1.1440 => 1.1913, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.95% (0.6173 => 0.6417, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.5150 => 1.5717, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 3.69% (2.1763 => 2.2566, std. dev.: 0.0222) MultiSource/Applications/lemon/lemon: 3.63% (1.0046 => 1.0411, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.74% (13.3238 => 13.6889, std. dev.: 0.1242) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.66% (0.4248 => 0.4361, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.28% (1.8798 => 1.9226, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.10% (0.9425 => 0.9623, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1672 => 1.1903, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.7639 => 0.7783, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 1.80% (1.3268 => 1.3507, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.67% (1.1827 => 1.2025, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (12.6413 => 12.8525, std. dev.: 0.0245) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.60% (1.2021 => 1.2213, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (4.0318 => 4.0957, std. dev.: 0.0189) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7784 => 0.7900, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (6.4908 => 6.5870, std. dev.: 0.0280) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (6.2546 => 6.3461, std. dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: 1.45% (15.3105 => 15.5321, std. dev.: 0.0448) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.4113 => 1.4317, std. dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.7256 => 14.9005, std. dev.: 0.0591) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 48.67% (0.0263 => 0.0391, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3394, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout/ary3: 14.90% (1.7426 => 2.0022, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.88% (0.0766 => 0.0880, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/misr: 14.01% (0.4296 => 0.4898, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.97% (4.0101 => 4.5702, std. dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/sieve: 12.76% (3.4406 => 3.8795, std. dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0114) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.95% (0.2694 => 0.2989, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6179, std. dev.: 0.0384) SingleSource/Benchmarks/Stanford/Puzzle: 8.03% (0.1433 => 0.1548, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 7.50% (1.0194 => 1.0959, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.70% (1.0063 => 1.0737, std. dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (3.4876 => 3.6960, std. dev.: 0.0269) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7924, std. dev.: 0.0505) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.3301 => 0.3490, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.43% (40.4792 => 42.6760, std. dev.: 0.7012) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8117, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8718, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 2.86% (8.5113 => 8.7550, std. dev.: 0.0444) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.38% (4.6127 => 4.7224, std. dev.: 0.0368) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.29% (2.6656 => 2.7267, std. dev.: 0.0234) MultiSource/Benchmarks/BitBench/five11/five11: 2.19% (5.1938 => 5.3077, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (2.4971 => 2.5342, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.6110 => 1.6347, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.5166 => 2.5506, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6717, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.07% (5.2665 => 4.1567, std. dev.: 0.0253) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.91% (1.1647 => 0.9911, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.71% (3.2007 => 2.9218, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.05% (3.6254 => 3.3697, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.4441 => 1.3562, std. dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: -6.07% (3.4230 => 3.2153, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std. dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.72% (4.6355 => 4.4168, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.94% (0.4140 => 0.3977, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.14% (1.7361 => 1.6815, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.12% (2.4457 => 2.3694, std. dev.: 0.0276) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.06% (1.1683 => 1.1325, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -2.93% (9.2503 => 8.9793, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.89% (3.7496 => 3.6411, std. dev.: 0.0306) MultiSource/Benchmarks/PAQ8p/paq8p: -2.75% (92.7467 => 90.1933, std. dev.: 0.8435) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2857, std. dev.: 0.0376) MultiSource/Benchmarks/mafft/pairlocalalign: -2.55% (62.4126 => 60.8216, std. dev.: 0.3726) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3671, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2236, std. dev.: 0.0396) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -1.48% (3.8200 => 3.7636, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3219, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.21% (1.8739 => 1.8512, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: -1.07% (1.7330 => 1.7145, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 08:25:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 10:25:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120909152550.5EFCD2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3588?compare_to=3585&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3588, Order: 163478, Start Time: 2012-09-09 14:12:52, End Time: 2012-09-09 15:27:03 To: 3585, Order: 163477, Start Time: 2012-09-09 12:30:37, End Time: 2012-09-09 13:44:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -3.48% (17.0682 => 16.4741, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.55% (14.2429 => 14.0228, std. dev.: 0.0166) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.86% (2.0176 => 2.4182, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.55% (0.5818 => 0.6432, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.54% (0.5748 => 0.6354, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (0.7710 => 0.8497, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.93% (3.9660 => 4.3600, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3601 => 0.3950, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.67% (0.2596 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.47% (0.3663 => 0.4010, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.45% (0.3650 => 0.3995, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.43% (0.7061 => 0.7727, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.39% (1.3693 => 1.4979, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 9.37% (0.4003 => 0.4378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3623 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.30% (0.3914 => 0.4278, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.5265 => 0.5749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.09% (0.3940 => 0.4298, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.99% (0.7038 => 0.7671, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.95% (0.6959 => 0.7582, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.92% (0.9199 => 1.0020, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.86% (1.2193 => 1.3273, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.40% (1.1364 => 1.2319, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.39% (1.4563 => 1.5785, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 8.23% (0.4328 => 0.4684, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.10% (0.5577 => 0.6029, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.94% (13.8202 => 14.9179, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.77% (7.2180 => 7.7789, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.70% (0.7506 => 0.8084, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.69% (0.2914 => 0.3138, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.66% (0.4791 => 0.5158, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.53% (0.2243 => 0.2412, std. dev.: 0.0063) MultiSource/Applications/lemon/lemon: 7.50% (1.0313 => 1.1086, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.42% (0.3246 => 0.3487, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.40% (0.5637 => 0.6054, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4062 => 0.4361, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.31% (1.1061 => 1.1870, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 7.23% (3.8646 => 4.1440, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (3.6692 => 3.9316, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.08% (0.3489 => 0.3736, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.06% (0.8310 => 0.8897, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.99% (0.3220 => 0.3445, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3580 => 0.3830, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3756 => 0.4013, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.80% (0.3293 => 0.3517, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (1.9828 => 2.1170, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.7460 => 0.7963, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2765 => 0.2949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.62% (0.2690 => 0.2868, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.60% (0.4016 => 0.4281, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.3245 => 1.4114, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.48% (1.9270 => 2.0519, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 6.47% (3.1889 => 3.3951, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 6.41% (2.1791 => 2.3187, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3107 => 0.3306, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.33% (0.6744 => 0.7171, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4113 => 0.4372, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.26% (0.3868 => 0.4110, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.0594 => 1.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4390 => 0.4660, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6135 => 0.6511, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.11% (4.3801 => 4.6479, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.11% (4.4433 => 4.7148, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (1.3819 => 1.4663, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3525, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.07% (1.3813 => 1.4652, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.89% (14.8535 => 15.7282, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.82% (0.8818 => 0.9331, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.72% (0.6576 => 0.6952, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 5.72% (8.4961 => 8.9818, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 5.68% (16.6129 => 17.5561, std. dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.8698 => 0.9189, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (13.2842 => 14.0228, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.44% (1.1333 => 1.1950, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.22% (14.5298 => 15.2880, std. dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 5.17% (6.5754 => 6.9156, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.3755 => 0.3941, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.73% (3.2742 => 3.4291, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 4.58% (4.6629 => 4.8765, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (0.9108 => 0.9502, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2815, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.08% (1.5188 => 1.5808, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.93% (3.7467 => 3.8941, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.89% (2.1007 => 2.1824, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1769, std. dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (6.2785 => 6.5125, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.6250 => 0.6473, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.68% (33.2944 => 34.1854, std. dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 1.31% (16.2614 => 16.4741, std. dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 25.11% (1.8175 => 2.2739, std. dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.72% (1.1560 => 1.2568, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7337, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0788, std. dev.: 0.0440) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.76% (0.5184 => 0.5327, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6043, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (7.9275 => 8.0184, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5971, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.04% (0.4657 => 0.4003, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.71% (22.5627 => 21.7261, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2615, std. dev.: 0.0315) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.98% (1.3780 => 1.2956, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1513, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std. dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9258, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6125, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2500, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5201, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2382, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2628, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 09:28:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 11:28:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909162800.BEB272A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3589?compare_to=3587&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3589, Order: 163479, Start Time: 2012-09-09 15:18:34, End Time: 2012-09-09 16:29:16 To: 3587, Order: 163478, Start Time: 2012-09-09 13:27:55, End Time: 2012-09-09 14:39:30 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (55 on baseline) Performance Improvements: 10 (27 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.29% (0.5468 => 0.5593, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.34% (0.9020 => 0.9141, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.15% (21.4555 => 24.0632, std. dev.: 0.8019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (2.3720 => 2.5080, std. dev.: 0.0528) SingleSource/Benchmarks/Misc/ffbench: 1.84% (1.3830 => 1.4085, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -1.73% (1.1913 => 1.1707, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: -1.64% (0.9623 => 0.9465, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: -1.57% (1.9226 => 1.8925, std. dev.: 0.0063) MultiSource/Applications/siod/siod: -1.51% (2.1596 => 2.1269, std. dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: -1.30% (13.6889 => 13.5109, std. dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.29% (1.4359 => 1.4174, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: -1.24% (3.1199 => 3.0811, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.62% (1.6233 => 1.5970, std. dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (2.4426 => 2.4158, std. dev.: 0.0084) MultiSource/Applications/aha/aha: -1.01% (3.3671 => 3.3332, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.21% (0.6410 => 0.6744, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3582 => 0.3729, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.08% (0.7722 => 0.8037, std. dev.: 0.0072) MultiSource/Applications/lemon/lemon: 3.90% (1.0046 => 1.0438, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: 3.79% (0.6173 => 0.6407, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.78% (1.1653 => 1.2094, std. dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 3.62% (2.1763 => 2.2550, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.5150 => 1.5684, std. dev.: 0.0122) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3217 => 0.3319, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.4248 => 0.4381, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5309 => 0.5435, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.33% (1.1440 => 1.1707, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.94% (3.0225 => 3.0811, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.86% (1.1672 => 1.1889, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.83% (1.4113 => 1.4371, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.72% (1.3935 => 1.4174, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.57% (6.2546 => 6.3527, std. dev.: 0.0170) MultiSource/Applications/siod/siod: 1.42% (2.0972 => 2.1269, std. dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 1.40% (13.3238 => 13.5109, std. dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (4.0318 => 4.0837, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9029 => 0.9141, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.4189 => 1.4352, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.89% (0.0766 => 0.0926, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9988, std. dev.: 0.0876) SingleSource/Benchmarks/McGill/misr: 13.85% (0.4296 => 0.4891, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 13.66% (21.1721 => 24.0632, std. dev.: 0.8019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.35% (4.0101 => 4.5453, std. dev.: 0.0711) SingleSource/Benchmarks/Shootout-C++/sieve: 12.64% (3.4406 => 3.8754, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6097, std. dev.: 0.0370) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.56% (1.0063 => 1.0824, std. dev.: 0.0178) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.39% (0.2857 => 0.3068, std. dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 6.87% (1.0194 => 1.0894, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (3.4876 => 3.6998, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7999, std. dev.: 0.0209) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (0.3301 => 0.3483, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.20% (40.4792 => 42.5837, std. dev.: 0.2860) SingleSource/Benchmarks/Misc/dt: 4.23% (0.9851 => 1.0268, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8388, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/fp-convert: 3.81% (15.2242 => 15.8037, std. dev.: 0.0656) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.76% (3.4080 => 3.5363, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.54% (0.5876 => 0.6084, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 3.28% (1.4184 => 1.4649, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 3.13% (5.1938 => 5.3564, std. dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.54% (3.5520 => 3.6066, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5316, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 1.27% (2.5166 => 2.5485, std. dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6661, std. dev.: 0.0254) MultiSource/Applications/lua/lua: 1.13% (29.5232 => 29.8571, std. dev.: 0.0865) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (3.6388 => 3.6753, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.58% (0.3497 => 0.2078, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.59% (5.2665 => 4.0766, std. dev.: 0.3354) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.83% (1.1647 => 0.9920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.63% (3.2007 => 2.9566, std. dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3667, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -6.50% (3.4230 => 3.2006, std. dev.: 0.0505) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.11% (1.7361 => 1.6821, std. dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -2.89% (92.7467 => 90.0703, std. dev.: 0.7383) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.87% (2.4457 => 2.3755, std. dev.: 0.0248) MultiSource/Applications/aha/aha: -2.78% (3.4286 => 3.3332, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.69% (1.1683 => 1.1369, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -2.62% (9.2503 => 9.0083, std. dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.57% (3.7496 => 3.6533, std. dev.: 0.0308) MultiSource/Benchmarks/mafft/pairlocalalign: -1.91% (62.4126 => 61.2182, std. dev.: 0.0661) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.69% (1.8739 => 1.8422, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2346, std. dev.: 0.0391) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -1.44% (3.8200 => 3.7649, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3075, std. dev.: 0.0619) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 09:42:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 11:42:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120909164237.C0D922A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3590?compare_to=3584&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3590, Order: 163478, Start Time: 2012-09-09 14:00:05, End Time: 2012-09-09 16:43:51 To: 3584, Order: 163476, Start Time: 2012-09-09 10:47:49, End Time: 2012-09-09 13:31:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.41% (0.3446 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.33% (0.3488 => 0.3953, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.27% (0.3496 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 13.21% (0.3460 => 0.3917, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5826 => 0.6299, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.00% (0.5889 => 0.6360, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.92% (1.5932 => 1.7035, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (1.6211 => 1.7318, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.78% (3.5627 => 3.8044, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.53% (0.4994 => 0.5320, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.51% (1.3152 => 1.4008, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.45% (0.5026 => 0.5350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.23% (0.7171 => 0.7618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (0.4361 => 0.4627, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.88% (0.5900 => 0.6247, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.62% (0.5000 => 0.5281, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 5.58% (4.2109 => 4.4460, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 5.24% (1.0781 => 1.1346, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 5.18% (0.2566 => 0.2699, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (0.3890 => 0.4091, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.16% (0.3004 => 0.3159, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.15% (0.2738 => 0.2879, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (2.7292 => 2.8675, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.04% (0.2736 => 0.2874, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.81% (1.9694 => 2.0641, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3060 => 0.3204, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.63% (1.9966 => 2.0891, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.59% (0.2875 => 0.3007, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2792 => 0.2915, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 4.40% (2.1013 => 2.1938, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (4.4195 => 4.6140, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.37% (0.9909 => 1.0342, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.3903 => 0.4073, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.31% (5.5417 => 5.7804, std. dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (1.8794 => 1.9599, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (0.4658 => 0.4857, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.23% (0.2813 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (0.3625 => 0.3778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.2823 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.19% (0.2911 => 0.3033, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.17% (0.2780 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2750 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3096 => 0.3224, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.12% (2.0673 => 2.1525, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.11% (0.7875 => 0.8199, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (2.1653 => 2.2538, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.4139 => 0.4306, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 4.00% (4.6177 => 4.8024, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.99% (0.3362 => 0.3496, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.98% (0.2811 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.3271 => 0.3401, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3792 => 0.3942, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 3.95% (1.4269 => 1.4832, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3317 => 0.3447, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.90% (0.3258 => 0.3385, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.89% (0.9697 => 1.0074, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3477 => 0.3609, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (0.3348 => 0.3473, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3678 => 0.3815, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.72% (0.3282 => 0.3404, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4146 => 0.4300, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.71% (23.5202 => 24.3918, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3690 => 0.3824, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.57% (0.5546 => 0.5744, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (0.3845 => 0.3982, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.51% (0.6634 => 0.6867, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 3.39% (0.4251 => 0.4395, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.24% (0.3084 => 0.3184, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.15% (0.3336 => 0.3441, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.5012 => 0.5152, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.6435 => 0.6614, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.21% (2.0346 => 2.0795, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (0.7426 => 0.7529, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6710, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 4.78% (15.4430 => 16.1805, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6248, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std. dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5021, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.64% (41.7953 => 42.4806, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5801, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4718, std. dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5791, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8052, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0064) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8293, std. dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5835, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.62% (0.6293 => 0.6191, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9630, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 09:49:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 11:49:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120909164935.8EEA92A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3591?compare_to=3586&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3591, Order: 163479, Start Time: 2012-09-09 15:31:17, End Time: 2012-09-09 16:50:47 To: 3586, Order: 163478, Start Time: 2012-09-09 12:36:13, End Time: 2012-09-09 13:55:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (121 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (14.3365 => 14.5232, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7862 => 3.8448, std. dev.: 0.0137) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.09% (10.3673 => 14.5232, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 25.28% (0.1622 => 0.2032, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.36% (2.2022 => 2.4965, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.22% (7.0540 => 7.9867, std. dev.: 0.0295) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.97% (0.3516 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.95% (0.3497 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3543 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3543 => 0.4001, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3561 => 0.4020, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.37% (0.3694 => 0.4151, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 12.17% (0.3828 => 0.4294, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.75% (1.1194 => 1.2509, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.50% (1.7609 => 1.9634, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.29% (0.3282 => 0.3554, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.03% (0.4879 => 0.5222, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.93% (0.8172 => 0.8738, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 6.90% (10.4361 => 11.1563, std. dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 6.88% (9.4845 => 10.1374, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5925 => 0.6331, std. dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.6030 => 0.6441, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.41% (0.2700 => 0.2873, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (8.1363 => 8.6564, std. dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7433 => 0.7902, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.21% (0.7115 => 0.7557, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3423 => 0.3635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (4.2646 => 4.5250, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.08% (0.7835 => 0.8311, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.06% (0.5860 => 0.6215, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (1.5415 => 1.6338, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.3050 => 1.3817, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5569 => 0.5895, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.81% (5.0018 => 5.2926, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7326 => 0.7751, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.76% (3.3354 => 3.5276, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.74% (4.9449 => 5.2289, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.71% (0.6675 => 0.7056, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.5105 => 0.5394, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 5.28% (5.7591 => 6.0631, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9765 => 1.0279, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 5.26% (0.4299 => 0.4525, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.8067 => 0.8491, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2241, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.13% (0.3817 => 0.4013, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.13% (1.5603 => 1.6404, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1861 => 1.2463, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.87% (3.8723 => 4.0607, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (7.9617 => 8.3372, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std. dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 4.64% (0.3387 => 0.3544, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.50% (1.0722 => 1.1205, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.40% (0.6450 => 0.6734, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.34% (2.0273 => 2.1153, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.4064 => 0.4223, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.89% (21.9371 => 22.7900, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.4186 => 1.4732, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 3.82% (2.2969 => 2.3846, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3422 => 0.3552, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.62% (14.3668 => 14.8873, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3865 => 0.4003, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (1.5859 => 1.6398, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4203 => 0.4338, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.4289 => 0.4425, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.12% (0.3684 => 0.3799, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.4048 => 0.4167, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (2.2024 => 2.2667, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (2.0665 => 2.1245, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.1840 => 1.2169, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.8101 => 0.8271, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3125, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3805, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (4.2280 => 4.3729, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7513, std. dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 1.77% (3.7781 => 3.8448, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2297, std. dev.: 0.0174) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std. dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.70% (5.2763 => 3.2342, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.04% (5.3855 => 3.8752, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.68% (5.3526 => 3.8709, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1401, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.90% (2.9384 => 2.5888, std. dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -8.25% (22.1758 => 20.3466, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.59% (1.6925 => 1.4286, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2967, std. dev.: 0.0971) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std. dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0010) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1503, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5022, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4221, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0009, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.99% (4.6441 => 4.5519, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.89% (2.5528 => 2.5045, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0054, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -1.66% (1.2373 => 1.2168, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std. dev.: 0.0132) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 10:08:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 12:08:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120909170806.553922A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3592?compare_to=3588&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3592, Order: 163479, Start Time: 2012-09-09 15:55:05, End Time: 2012-09-09 17:09:20 To: 3588, Order: 163478, Start Time: 2012-09-09 14:12:52, End Time: 2012-09-09 15:27:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.36% (2.0176 => 2.4082, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.50% (0.5818 => 0.6429, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.46% (0.5748 => 0.6349, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.14% (0.7710 => 0.8492, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.98% (3.9660 => 4.3619, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.64% (0.3578 => 0.3923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.50% (0.7061 => 0.7732, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3650 => 0.3992, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.36% (1.3693 => 1.4975, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3914 => 0.4277, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.27% (0.3623 => 0.3959, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.27% (0.5265 => 0.5753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3789 => 0.4137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.14% (0.4003 => 0.4369, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.01% (0.9199 => 1.0028, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 8.98% (0.3940 => 0.4294, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.96% (1.2193 => 1.3285, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.91% (0.7038 => 0.7665, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.50% (1.1364 => 1.2330, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.4563 => 1.5800, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.46% (0.4328 => 0.4694, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.91% (13.8202 => 14.9138, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (7.2180 => 7.7881, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.88% (0.4379 => 0.4724, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.4791 => 0.5161, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2243 => 0.2416, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4062 => 0.4373, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.64% (0.3246 => 0.3494, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.62% (0.2914 => 0.3136, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 7.57% (0.7506 => 0.8074, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.56% (0.5637 => 0.6063, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.52% (1.0313 => 1.1089, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3489 => 0.3751, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.25% (3.6692 => 3.9353, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.24% (0.3756 => 0.4028, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.22% (1.1061 => 1.1860, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8310 => 0.8908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.17% (1.9828 => 2.1249, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3293 => 0.3528, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.06% (3.8646 => 4.1375, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.93% (0.4113 => 0.4398, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.90% (0.4016 => 0.4293, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3107 => 0.3315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3149 => 0.3359, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.3868 => 0.4124, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.55% (0.7460 => 0.7949, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3972, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3192 => 0.3399, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.47% (1.9270 => 2.0516, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (1.3245 => 1.4101, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.26% (0.6135 => 0.6519, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 6.25% (2.1791 => 2.3153, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.0594 => 1.1253, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.18% (4.3801 => 4.6510, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.14% (4.4433 => 4.7162, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.14% (0.8818 => 0.9359, std. dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3525, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.04% (14.8535 => 15.7511, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (1.3813 => 1.4642, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.97% (1.3819 => 1.4644, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (8.4961 => 9.0027, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.79% (0.8698 => 0.9202, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 5.66% (16.6129 => 17.5536, std. dev.: 0.0145) MultiSource/Benchmarks/sim/sim: 5.62% (0.3131 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.55% (0.2504 => 0.2643, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.53% (1.1333 => 1.1960, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.49% (13.2842 => 14.0139, std. dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.36% (14.5298 => 15.3079, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 5.26% (6.5754 => 6.9211, std. dev.: 0.0189) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.3245 => 0.3411, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.11% (0.6576 => 0.6912, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.91% (3.2742 => 3.4350, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.4805 => 0.5028, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.2292 => 1.2856, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.55% (4.6629 => 4.8752, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (1.5188 => 1.5834, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1854, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.88% (3.7467 => 3.8921, std. dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.85% (6.2785 => 6.5200, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.6250 => 0.6486, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (2.1007 => 2.1796, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.93% (0.3511 => 0.3614, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 2.66% (33.2944 => 34.1812, std. dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4929, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7329, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0750, std. dev.: 0.0496) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.5184 => 0.5328, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6135, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5187, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5913, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6864, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.72% (22.5627 => 21.7236, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2652, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.24% (1.3780 => 1.2920, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.28% (2.6470 => 2.5073, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1505, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9246, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.94% (1.9762 => 1.9181, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5926, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5207, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4963, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2478, std. dev.: 0.0224) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4310, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2606, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 11:21:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 13:21:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909182100.E3B652A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3593?compare_to=3589&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3593, Order: 163480, Start Time: 2012-09-09 17:11:12, End Time: 2012-09-09 18:22:16 To: 3589, Order: 163479, Start Time: 2012-09-09 15:18:34, End Time: 2012-09-09 16:29:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (58 on baseline) Performance Improvements: 1 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (4.3208 => 4.3706, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.62% (2.5080 => 2.5987, std. dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.87% (0.7725 => 0.7947, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.76% (2.3757 => 2.4175, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.67% (2.6929 => 2.7379, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.66% (1.2739 => 1.2951, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -13.43% (24.0632 => 20.8305, std. dev.: 1.2357) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.24% (0.6410 => 0.6746, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.15% (0.7722 => 0.8120, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.55% (0.3582 => 0.3745, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 4.19% (2.1763 => 2.2674, std. dev.: 0.0125) MultiSource/Applications/lemon/lemon: 3.86% (1.0046 => 1.0434, std. dev.: 0.0076) MultiSource/Applications/minisat/minisat: 3.84% (0.6173 => 0.6410, std. dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.1653 => 1.2095, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.62% (1.5150 => 1.5698, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 3.20% (0.3217 => 0.3320, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.49% (1.4113 => 1.4465, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (8.2186 => 8.4180, std. dev.: 0.0599) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (1.3935 => 1.4253, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.7639 => 0.7804, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.10% (2.0972 => 2.1412, std. dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 2.02% (29.3170 => 29.9081, std. dev.: 0.2040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.87% (1.1827 => 1.2048, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.85% (0.5937 => 0.6047, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (4.0318 => 4.1039, std. dev.: 0.0133) MultiSource/Applications/Burg/burg: 1.78% (1.1440 => 1.1644, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.76% (0.6069 => 0.6176, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.0689 => 1.0857, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (8.2559 => 8.3638, std. dev.: 0.0236) MultiSource/Applications/SPASS/SPASS: 1.25% (13.3238 => 13.4904, std. dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.15% (2.0317 => 2.0551, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.11% (0.0766 => 0.0943, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.34% (0.0917 => 0.1076, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0010, std. dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.80% (4.0101 => 4.5634, std. dev.: 0.0173) MultiSource/Applications/sgefa/sgefa: 12.49% (0.3746 => 0.4214, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: 12.38% (0.4296 => 0.4828, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sieve: 12.31% (3.4406 => 3.8643, std. dev.: 0.0073) SingleSource/Benchmarks/Stanford/Puzzle: 11.24% (0.1433 => 0.1594, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.65% (0.2694 => 0.2981, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.17% (0.2857 => 0.3119, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 8.86% (7.0025 => 7.6231, std. dev.: 0.0228) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8046, std. dev.: 0.0623) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (3.4876 => 3.6940, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.53% (3.0256 => 3.1627, std. dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.44% (0.7609 => 0.7947, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8514, std. dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 3.12% (5.1938 => 5.3561, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/whetstone: 3.08% (2.3453 => 2.4175, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5113 => 8.7564, std. dev.: 0.0466) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.71% (2.6656 => 2.7379, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.92% (4.6127 => 4.7014, std. dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.77% (1.2726 => 1.2951, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 1.49% (3.5520 => 3.6050, std. dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5316, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.38% (14.4877 => 14.6873, std. dev.: 0.0239) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4455 => 2.4754, std. dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.41% (0.3497 => 0.2084, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.28% (5.2665 => 4.0933, std. dev.: 0.0382) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.93% (1.1647 => 0.9908, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1630, std. dev.: 0.0224) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.59% (1.4034 => 1.2829, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.30% (3.2007 => 2.9351, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.15% (3.6254 => 3.3661, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: -6.56% (3.4230 => 3.1984, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (4.6355 => 4.4014, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -4.90% (1.4441 => 1.3734, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.53% (1.7361 => 1.6574, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.16% (2.4457 => 2.3439, std. dev.: 0.0238) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.00% (1.2959 => 1.2440, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.82% (1.4021 => 1.3485, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (9.2503 => 8.9371, std. dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6276, std. dev.: 0.0376) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.09% (1.2722 => 1.2329, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1361, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -2.74% (3.4286 => 3.3345, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2870, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -2.37% (62.4126 => 60.9335, std. dev.: 0.1351) MultiSource/Benchmarks/PAQ8p/paq8p: -2.17% (92.7467 => 90.7336, std. dev.: 0.5451) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2168, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.68% (1.8739 => 1.8425, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: -1.58% (1.7330 => 1.7056, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3130, std. dev.: 0.0284) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7675, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.22% (6.7458 => 6.6632, std. dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 11:41:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 13:41:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120909184124.0721E2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3594?compare_to=3591&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3594, Order: 163480, Start Time: 2012-09-09 17:23:17, End Time: 2012-09-09 18:42:37 To: 3591, Order: 163479, Start Time: 2012-09-09 15:31:17, End Time: 2012-09-09 16:50:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.61% (10.3673 => 14.4739, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: 24.85% (0.1622 => 0.2025, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.90% (2.2022 => 2.5084, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.85% (7.0540 => 8.0309, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.79% (0.3543 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 12.61% (0.3561 => 0.4010, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.60% (1.1194 => 1.2605, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3516 => 0.3955, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 12.29% (0.3694 => 0.4148, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (1.7609 => 1.9722, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 11.96% (0.3828 => 0.4286, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.08% (0.3282 => 0.3580, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.21% (0.4879 => 0.5231, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.06% (9.4845 => 10.1541, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.8172 => 0.8741, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 6.92% (10.4361 => 11.1584, std. dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.63% (0.5925 => 0.6318, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.6030 => 0.6427, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7433 => 0.7919, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.43% (0.3109 => 0.3309, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.33% (8.1363 => 8.6516, std. dev.: 0.0132) MultiSource/Benchmarks/McCat/18-imp/imp: 6.31% (0.3423 => 0.3639, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (4.2646 => 4.5311, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 6.17% (0.7115 => 0.7554, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.13% (5.0018 => 5.3086, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.02% (0.7835 => 0.8307, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5569 => 0.5903, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.99% (0.6675 => 0.7075, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.98% (1.5415 => 1.6337, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5860 => 0.6210, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.9449 => 5.2355, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (1.3050 => 1.3813, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.5105 => 0.5401, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.70% (3.3354 => 3.5256, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.54% (5.7591 => 6.0781, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 5.53% (1.5603 => 1.6466, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 5.51% (0.4299 => 0.4536, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.38% (0.3180 => 0.3351, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.8067 => 0.8496, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9765 => 1.0283, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.16% (1.1642 => 1.2243, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1861 => 1.2454, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (7.9617 => 8.3449, std. dev.: 0.0090) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3817 => 0.3999, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.75% (3.8723 => 4.0562, std. dev.: 0.0038) MultiSource/Applications/lemon/lemon: 4.71% (1.0722 => 1.1227, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.61% (0.3387 => 0.3543, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.48% (2.0273 => 2.1181, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.39% (0.6450 => 0.6733, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.35% (0.5981 => 0.6241, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (0.4064 => 0.4238, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.17% (0.8921 => 0.9293, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.12% (0.3422 => 0.3563, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.07% (21.9371 => 22.8293, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.01% (2.2969 => 2.3890, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6456 => 0.6709, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.4186 => 1.4738, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.72% (1.5859 => 1.6449, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (14.3668 => 14.8860, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (0.4636 => 0.4799, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4289 => 0.4439, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2732, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.15% (0.3684 => 0.3800, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4620 => 0.4761, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.4048 => 0.4169, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.1840 => 1.2189, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0665 => 2.1259, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.8101 => 0.8271, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.8922 => 3.9326, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3819, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7568, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3631, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.36% (2.2771 => 2.3081, std. dev.: 0.0103) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2330, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7608, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2355, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.90% (5.3855 => 3.8827, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.56% (5.3526 => 3.8776, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2101, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.73% (2.9384 => 2.5936, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -8.16% (22.1758 => 20.3655, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2533, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7153, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.19% (8.6802 => 8.4029, std. dev.: 0.0299) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5067, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9936, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3295, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9889, std. dev.: 0.0226) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5536, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -1.91% (1.2373 => 1.2137, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -1.25% (6.2999 => 6.2209, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 11:50:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 13:50:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120909185038.26E3B2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3595?compare_to=3592&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3595, Order: 163480, Start Time: 2012-09-09 17:37:24, End Time: 2012-09-09 18:51:52 To: 3592, Order: 163479, Start Time: 2012-09-09 15:55:05, End Time: 2012-09-09 17:09:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.75% (2.0176 => 2.4160, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.40% (0.5818 => 0.6423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.26% (0.5748 => 0.6338, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.18% (0.7710 => 0.8495, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.82% (3.9660 => 4.3555, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 9.76% (1.3693 => 1.5030, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.51% (0.2596 => 0.2843, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3601 => 0.3940, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.35% (0.7061 => 0.7721, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3663 => 0.3998, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.14% (0.3623 => 0.3954, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5265 => 0.5746, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3650 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.05% (0.3789 => 0.4132, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.65% (1.2193 => 1.3248, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.62% (0.9199 => 0.9992, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.58% (0.6959 => 0.7556, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.25% (0.4328 => 0.4685, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.16% (1.4563 => 1.5751, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.15% (1.1364 => 1.2290, std. dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.85% (0.5577 => 0.6015, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.79% (0.4379 => 0.4720, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (7.2180 => 7.7712, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 7.66% (13.8202 => 14.8793, std. dev.: 0.0139) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.2781 => 0.2994, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.54% (0.7506 => 0.8072, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4062 => 0.4367, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6283 => 0.6751, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.32% (1.0313 => 1.1068, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.30% (0.3246 => 0.3483, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.24% (1.1061 => 1.1862, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2023 => 0.2168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.17% (0.3293 => 0.3529, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.9828 => 2.1231, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.05% (3.6692 => 3.9280, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3756 => 0.4020, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.98% (3.8646 => 4.1343, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.96% (0.3220 => 0.3444, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.85% (0.8310 => 0.8879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.66% (0.4113 => 0.4387, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.56% (0.2988 => 0.3184, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.53% (0.7460 => 0.7947, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3192 => 0.3399, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.44% (0.3868 => 0.4117, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.40% (0.3453 => 0.3674, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.38% (0.4390 => 0.4670, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.37% (2.1791 => 2.3179, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.36% (1.3245 => 1.4087, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.27% (0.6744 => 0.7167, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.27% (3.1889 => 3.3887, std. dev.: 0.0142) MultiSource/Applications/treecc/treecc: 6.24% (1.9270 => 2.0473, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.09% (1.3819 => 1.4661, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.09% (4.3801 => 4.6468, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.08% (1.3813 => 1.4653, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.08% (1.0594 => 1.1238, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.98% (4.4433 => 4.7091, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (1.2749 => 1.3503, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.87% (0.6135 => 0.6495, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.86% (0.8818 => 0.9335, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.77% (14.8535 => 15.7104, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.70% (8.4961 => 8.9805, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 5.69% (16.6129 => 17.5584, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.63% (0.8698 => 0.9188, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (1.1333 => 1.1944, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (13.2842 => 13.9862, std. dev.: 0.0088) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.16% (0.6576 => 0.6915, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (6.5754 => 6.9136, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 5.03% (14.5298 => 15.2612, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.77% (3.2742 => 3.4303, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.50% (1.2292 => 1.2845, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 4.48% (4.6629 => 4.8719, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.20% (0.4805 => 0.5007, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.06% (1.5188 => 1.5805, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1749, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.71% (3.7467 => 3.8858, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.69% (2.1007 => 2.1783, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.66% (0.6250 => 0.6479, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (6.2785 => 6.5051, std. dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 2.90% (33.2944 => 34.2614, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.12% (16.2614 => 16.4431, std. dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0510) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.99% (3.1736 => 3.4271, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7332, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.24% (10.7476 => 11.0954, std. dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.5184 => 0.5328, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6006, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0512, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5746, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5885, std. dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4443, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.67% (22.5627 => 21.7342, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2510, std. dev.: 0.0625) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1506, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9234, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.79% (1.9762 => 1.9211, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5855, std. dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2400, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5199, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2427, std. dev.: 0.0235) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2359, std. dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4354, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2635, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 12:54:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 14:54:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120909195426.814102A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3596?compare_to=3590&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3596, Order: 163479, Start Time: 2012-09-09 17:12:00, End Time: 2012-09-09 19:55:40 To: 3590, Order: 163478, Start Time: 2012-09-09 14:00:05, End Time: 2012-09-09 16:43:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.65% (0.4102 => 0.4785, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.72% (2.0821 => 2.1180, std. dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.82% (0.3488 => 0.3970, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.76% (0.3496 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.69% (0.3469 => 0.3944, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.02% (0.3724 => 0.4209, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5826 => 0.6293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.95% (0.5889 => 0.6357, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (1.6211 => 1.7369, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (3.5627 => 3.8161, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 6.70% (1.5932 => 1.7000, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.63% (1.3152 => 1.4024, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.55% (0.4994 => 0.5321, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.35% (0.4361 => 0.4638, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 6.33% (0.7171 => 0.7625, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.32% (0.5000 => 0.5316, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (0.3930 => 0.4175, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.15% (0.5900 => 0.6263, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 6.08% (0.4029 => 0.4274, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 6.06% (4.2109 => 4.4662, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.58% (1.0781 => 1.1383, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (2.7292 => 2.8754, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (1.9694 => 2.0726, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (0.4658 => 0.4901, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.16% (0.3004 => 0.3159, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (1.9966 => 2.0977, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.05% (5.5417 => 5.8213, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.00% (0.2738 => 0.2875, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.92% (1.8794 => 1.9718, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (0.3903 => 0.4093, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.85% (2.1013 => 2.2032, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 4.70% (0.9909 => 1.0375, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.63% (0.2875 => 0.3008, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.54% (0.3195 => 0.3340, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2714 => 0.2837, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.51% (0.3792 => 0.3963, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.44% (0.9697 => 1.0128, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 4.39% (1.4269 => 1.4896, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 4.37% (0.2813 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.33% (0.2792 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.3271 => 0.3412, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (4.4195 => 4.6090, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.29% (0.2729 => 0.2846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.29% (0.2823 => 0.2944, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.4139 => 0.4316, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 4.27% (2.1653 => 2.2577, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.26% (2.0673 => 2.1554, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.25% (0.2750 => 0.2867, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.25% (0.2803 => 0.2922, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.23% (0.7875 => 0.8208, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.19% (4.6177 => 4.8110, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 4.17% (0.2780 => 0.2896, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.17% (0.3096 => 0.3225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.2969 => 0.3091, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.3362 => 0.3500, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.09% (0.5546 => 0.5773, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.08% (0.3336 => 0.3472, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.01% (0.3267 => 0.3398, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3317 => 0.3449, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.98% (0.3845 => 0.3998, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3625 => 0.3769, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.95% (0.3726 => 0.3873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.91% (0.3477 => 0.3613, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.88% (0.3348 => 0.3478, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.84% (0.6634 => 0.6889, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3282 => 0.3407, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.81% (0.3678 => 0.3818, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.80% (23.5202 => 24.4135, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4146 => 0.4299, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4251 => 0.4407, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3690 => 0.3824, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.3981 => 0.4117, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.6435 => 0.6648, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.5012 => 0.5169, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.53% (2.0346 => 2.0860, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (0.4847 => 0.4959, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (0.5361 => 0.5475, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (0.7426 => 0.7578, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (11.6398 => 11.8330, std. dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.36% (4.6926 => 4.7565, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.24% (0.2122 => 0.2318, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8974, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std. dev.: 0.1477) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6436, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1948, std. dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5039, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (2.0820 => 2.1180, std. dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4461, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5155, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6020, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5878, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std. dev.: 0.0177) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0036) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7919, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0043) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.7995, std. dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9645, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 15:11:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 17:11:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909221104.6B5DB2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3597?compare_to=3593&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3597, Order: 163481, Start Time: 2012-09-09 21:01:04, End Time: 2012-09-09 22:12:19 To: 3593, Order: 163480, Start Time: 2012-09-09 17:11:12, End Time: 2012-09-09 18:22:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (64 on baseline) Performance Improvements: 4 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (791 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/treecc/treecc: 1.15% (1.8894 => 1.9112, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 2.87% (4.0933 => 4.2107, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/mandel-2: 1.91% (3.0747 => 3.1333, std. dev.: 0.0183) SingleSource/Benchmarks/Misc/ffbench: 1.48% (1.4069 => 1.4277, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.92% (0.3113 => 0.2991, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.04% (0.8120 => 0.7954, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: -1.27% (8.4180 => 8.3112, std. dev.: 0.0290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.18% (4.5753 => 4.4756, std. dev.: 0.0202) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.21% (0.6410 => 0.6744, std. dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 4.54% (2.1763 => 2.2751, std. dev.: 0.0103) MultiSource/Applications/lemon/lemon: 3.96% (1.0046 => 1.0444, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (1.1653 => 1.2099, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.53% (0.6173 => 0.6391, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3217 => 0.3329, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (0.7722 => 0.7954, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.5150 => 1.5587, std. dev.: 0.0094) MultiSource/Applications/d/make_dparser: 2.58% (3.0225 => 3.1005, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.45% (0.4248 => 0.4352, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.1827 => 1.2060, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.85% (0.5937 => 0.6047, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.4113 => 1.4359, std. dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 1.68% (13.3238 => 13.5477, std. dev.: 0.0129) MultiSource/Applications/treecc/treecc: 1.67% (1.8798 => 1.9112, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (4.0318 => 4.0931, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.47% (0.7226 => 0.7332, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.35% (1.1672 => 1.1830, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 1.32% (4.7455 => 4.8083, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 1.28% (15.3105 => 15.5062, std. dev.: 0.0558) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.0317 => 2.0558, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (8.2186 => 8.3112, std. dev.: 0.0290) MultiSource/Applications/ClamAV/clamscan: 1.10% (14.6079 => 14.7687, std. dev.: 0.0278) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.07% (4.2616 => 4.3072, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.4908 => 6.5563, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.26% (3.4629 => 4.2339, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.84% (0.0766 => 0.0918, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.25% (0.0917 => 0.1066, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.90% (1.7426 => 2.0023, std. dev.: 0.0062) SingleSource/Benchmarks/McGill/misr: 14.15% (0.4296 => 0.4904, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.89% (4.0101 => 4.5672, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 10.83% (3.4406 => 3.8132, std. dev.: 0.0337) SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1433 => 0.1583, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 10.44% (0.3746 => 0.4137, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6242, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.40% (1.0063 => 1.0908, std. dev.: 0.0126) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.39% (0.2694 => 0.2893, std. dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 7.29% (1.0194 => 1.0937, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.00% (0.2857 => 0.3057, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.99% (3.0256 => 3.2370, std. dev.: 0.0337) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (27.1724 => 28.8426, std. dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/hash2: 5.99% (3.4876 => 3.6966, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.3301 => 0.3481, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.45% (4.2129 => 4.4423, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/dt: 4.42% (0.9851 => 1.0286, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8495, std. dev.: 0.0612) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std. dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.07% (2.6656 => 2.7475, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: 2.95% (8.5113 => 8.7628, std. dev.: 0.0455) MultiSource/Benchmarks/BitBench/five11/five11: 2.66% (5.1938 => 5.3322, std. dev.: 0.0351) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.23% (4.6127 => 4.7154, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.18% (0.5876 => 0.6004, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (2.4455 => 2.4826, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.45% (4.0659 => 4.1248, std. dev.: 0.0120) MultiSource/Applications/lua/lua: 1.41% (29.5232 => 29.9409, std. dev.: 0.0530) MultiSource/Applications/hexxagon/hexxagon: 1.32% (14.4877 => 14.6785, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.16% (2.4013 => 2.4291, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.13% (1.4117 => 1.4277, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 1.12% (2.5166 => 2.5448, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.12% (5.8830 => 5.9489, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.75% (0.3497 => 0.2107, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.05% (5.2665 => 4.2107, std. dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.07% (1.1647 => 0.9892, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1622, std. dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.38% (3.2007 => 2.9325, std. dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.07% (3.6254 => 3.3691, std. dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: -6.83% (3.4230 => 3.1893, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -5.78% (1.4441 => 1.3606, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4073, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.30% (1.7361 => 1.6615, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.08% (2.4457 => 2.3459, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/methcall: -3.22% (9.2503 => 8.9522, std. dev.: 0.0212) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.14% (1.2959 => 1.2552, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.12% (1.2722 => 1.2325, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.87% (3.7496 => 3.6421, std. dev.: 0.0313) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.77% (1.1683 => 1.1359, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2887, std. dev.: 0.0107) MultiSource/Applications/aha/aha: -2.53% (3.4286 => 3.3419, std. dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: -2.52% (92.7467 => 90.4114, std. dev.: 0.3905) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.31% (2.8964 => 2.8295, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.25% (1.8739 => 1.8318, std. dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: -2.19% (62.4126 => 61.0457, std. dev.: 0.1774) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.13% (1.0686 => 1.0458, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -1.72% (1.7330 => 1.7032, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2331, std. dev.: 0.0288) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -1.41% (3.8907 => 3.8360, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: -1.40% (6.7458 => 6.6514, std. dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3218, std. dev.: 0.0427) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7691, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.14% (16.5617 => 16.3734, std. dev.: 0.0492) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.08% (2.3569 => 2.3314, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 15:26:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 17:26:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120909222612.D32422A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3598?compare_to=3595&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3598, Order: 163481, Start Time: 2012-09-09 21:13:09, End Time: 2012-09-09 22:27:27 To: 3595, Order: 163480, Start Time: 2012-09-09 17:37:24, End Time: 2012-09-09 18:51:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.74% (55.0078 => 56.5176, std. dev.: 0.0113) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5342 => 0.5451, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.58% (3.8592 => 3.7984, std. dev.: 0.0154) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.69% (2.0176 => 2.4148, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.43% (0.5818 => 0.6425, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.19% (0.5748 => 0.6334, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.99% (0.7710 => 0.8480, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.89% (3.9660 => 4.3584, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 9.69% (1.3693 => 1.5020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.40% (0.2596 => 0.2840, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 9.26% (0.7061 => 0.7715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.12% (0.3914 => 0.4271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.11% (0.3623 => 0.3953, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.10% (0.5265 => 0.5744, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.77% (1.2193 => 1.3262, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 8.74% (0.7038 => 0.7653, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.63% (0.9199 => 0.9993, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.23% (1.1364 => 1.2299, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.15% (1.4563 => 1.5750, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.86% (0.3246 => 0.3501, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.84% (0.5577 => 0.6014, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.83% (0.4379 => 0.4722, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.64% (0.3899 => 0.4197, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.62% (0.2914 => 0.3136, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (7.2180 => 7.7678, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 7.61% (13.8202 => 14.8718, std. dev.: 0.0104) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 7.46% (0.7506 => 0.8066, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6283 => 0.6751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 7.32% (1.0313 => 1.1068, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3293 => 0.3531, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2023 => 0.2168, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.08% (0.3756 => 0.4022, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.08% (0.5637 => 0.6036, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.08% (3.6692 => 3.9288, std. dev.: 0.0158) MultiSource/Applications/Burg/burg: 7.06% (1.1061 => 1.1842, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.06% (1.9828 => 2.1227, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.90% (3.8646 => 4.1312, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8310 => 0.8878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.2937 => 0.3136, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.75% (0.4016 => 0.4287, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.56% (0.4113 => 0.4383, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.53% (0.2988 => 0.3183, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.49% (0.7460 => 0.7944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.3245 => 1.4096, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.39% (0.3868 => 0.4115, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.34% (0.3534 => 0.3758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.31% (0.4390 => 0.4667, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 6.25% (3.1889 => 3.3883, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 6.19% (2.1791 => 2.3140, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 6.18% (1.9270 => 2.0461, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4659, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.12% (1.3819 => 1.4665, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.03% (4.3801 => 4.6441, std. dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 6.01% (1.0594 => 1.1231, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.99% (4.4433 => 4.7093, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (1.2749 => 1.3509, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.2859 => 0.3027, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.86% (0.8818 => 0.9335, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.86% (14.8535 => 15.7235, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.6135 => 0.6490, std. dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 5.74% (16.6129 => 17.5669, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.66% (8.4961 => 8.9769, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.63% (0.8698 => 0.9188, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (1.1333 => 1.1951, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.30% (0.2321 => 0.2444, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (13.2842 => 13.9820, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.11% (6.5754 => 6.9114, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.6576 => 0.6910, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.07% (14.5298 => 15.2666, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.79% (3.2742 => 3.4311, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.55% (4.6629 => 4.8752, std. dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: 4.46% (1.2292 => 1.2840, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (1.5188 => 1.5811, std. dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1746, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 3.73% (3.7467 => 3.8864, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6250 => 0.6483, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (6.2785 => 6.5039, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.52% (2.1007 => 2.1747, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.92% (33.2944 => 34.2655, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.05% (16.2614 => 16.4322, std. dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0496) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4126, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.36% (1.2998 => 1.3825, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5480, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.16% (10.7476 => 11.0867, std. dev.: 0.0534) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.5184 => 0.5337, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6042, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.18% (12.4560 => 12.6025, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.28% (0.4657 => 0.3992, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.72% (22.5627 => 21.7241, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3014, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.58% (1.3780 => 1.3011, std. dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5104, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1508, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std. dev.: 0.0170) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.30% (3.0263 => 2.9263, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5820, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5203, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2266, std. dev.: 0.0300) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0103) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4344, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2618, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 15:31:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 17:31:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120909223118.ACC592A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3599?compare_to=3594&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3599, Order: 163481, Start Time: 2012-09-09 21:13:04, End Time: 2012-09-09 22:32:32 To: 3594, Order: 163480, Start Time: 2012-09-09 17:23:17, End Time: 2012-09-09 18:42:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (122 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.11% (54.5690 => 56.2652, std. dev.: 0.2016) SingleSource/Benchmarks/Misc/lowercase: 1.37% (7.9478 => 8.0568, std. dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.73% (10.3673 => 14.4858, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 24.91% (0.1622 => 0.2026, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.87% (2.2022 => 2.5077, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.82% (7.0540 => 8.0292, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.01% (0.3543 => 0.4004, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.92% (0.1432 => 0.1617, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.87% (0.3473 => 0.3920, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3516 => 0.3965, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.67% (1.1194 => 1.2612, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 12.66% (0.3561 => 0.4012, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3543 => 0.3990, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.61% (0.3497 => 0.3938, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.99% (1.7609 => 1.9721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3828 => 0.4283, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.3177 => 0.3431, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.16% (9.4845 => 10.1638, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.01% (0.4879 => 0.5221, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.91% (10.4361 => 11.1573, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.8172 => 0.8732, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 6.85% (0.2554 => 0.2729, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4615 => 0.4927, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5925 => 0.6324, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.6030 => 0.6429, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.61% (0.7835 => 0.8353, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7433 => 0.7908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.37% (8.1363 => 8.6546, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.34% (0.7115 => 0.7566, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.31% (0.3423 => 0.3639, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (4.2646 => 4.5307, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5860 => 0.6212, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.3050 => 1.3827, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.6675 => 0.7069, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.88% (0.5105 => 0.5405, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.87% (4.9449 => 5.2352, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.84% (5.0018 => 5.2940, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.82% (0.5569 => 0.5893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (1.5415 => 1.6307, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 5.70% (0.4299 => 0.4544, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.68% (3.3354 => 3.5249, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7326 => 0.7740, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.60% (5.7591 => 6.0814, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 5.54% (1.5603 => 1.6468, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.3092 => 0.3263, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.8067 => 0.8508, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.35% (0.3180 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.31% (0.9765 => 1.0284, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.31% (1.1642 => 1.2260, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1861 => 1.2456, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.82% (7.9617 => 8.3457, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.79% (0.3817 => 0.4000, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.78% (3.8723 => 4.0574, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5020 => 0.5259, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.69% (0.3387 => 0.3546, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.68% (1.0722 => 1.1224, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.43% (2.0273 => 2.1171, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.5981 => 0.6233, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.4103 => 0.4274, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 4.11% (2.2969 => 2.3914, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 4.08% (0.8921 => 0.9285, std. dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 4.06% (21.9371 => 22.8275, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.4064 => 0.4223, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.90% (0.6456 => 0.6708, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3422 => 0.3554, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.4186 => 1.4721, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.73% (1.5859 => 1.6451, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (14.3668 => 14.8824, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3865 => 0.3996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4289 => 0.4434, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3826 => 0.3955, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.4636 => 0.4792, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.2024 => 2.2754, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3935 => 0.4058, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4620 => 0.4761, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.1840 => 1.2201, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0665 => 2.1263, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.8922 => 3.9326, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3829, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.55% (4.2280 => 4.3779, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7534, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7608, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2353, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.88% (5.3855 => 3.8839, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.56% (5.3526 => 3.8773, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1821, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.68% (2.9384 => 2.5953, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -8.16% (22.1758 => 20.3664, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (19.9488 => 18.2459, std. dev.: 0.0821) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (1.8329 => 1.7167, std. dev.: 0.0173) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.56% (1.9577 => 1.8488, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std. dev.: 0.0036) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -3.23% (1.2373 => 1.1973, std. dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5047, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4258, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.92% (4.6441 => 4.5548, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0181, std. dev.: 0.0066) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.09% (1.0313 => 1.0201, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2333, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 16:06:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 18:06:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120909230618.A622C2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3600?compare_to=3596&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3600, Order: 163480, Start Time: 2012-09-09 20:23:45, End Time: 2012-09-09 23:07:33 To: 3596, Order: 163479, Start Time: 2012-09-09 17:12:00, End Time: 2012-09-09 19:55:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (111 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (782 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.84% (70.8103 => 74.9448, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.62% (124.8244 => 129.3409, std. dev.: 1.0164) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.05% (0.3446 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.82% (0.3488 => 0.3970, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 13.79% (0.3496 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.75% (0.3469 => 0.3946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.10% (0.3724 => 0.4212, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.08% (0.5826 => 0.6297, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.88% (0.5889 => 0.6353, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (3.5627 => 3.8139, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (1.6211 => 1.7329, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 6.81% (1.5932 => 1.7017, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.34% (1.3152 => 1.3986, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 6.33% (0.7171 => 0.7625, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.10% (0.5900 => 0.6260, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (0.4361 => 0.4627, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (0.4994 => 0.5293, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (0.3930 => 0.4164, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.90% (0.5000 => 0.5295, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.77% (4.2109 => 4.4539, std. dev.: 0.0129) MultiSource/Applications/spiff/spiff: 5.61% (0.4029 => 0.4255, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 5.40% (1.0781 => 1.1363, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.39% (0.1968 => 0.2074, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.2866 => 0.3018, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (2.7292 => 2.8728, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.14% (0.3890 => 0.4090, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.81% (1.9694 => 2.0642, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 4.74% (0.9909 => 1.0379, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.66% (0.4658 => 0.4875, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.65% (2.1013 => 2.1991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.63% (1.9966 => 2.0890, std. dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 4.60% (0.2566 => 0.2684, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.3004 => 0.3140, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.41% (0.2813 => 0.2937, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.41% (1.8794 => 1.9622, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.4139 => 0.4320, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.33% (5.5417 => 5.7814, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (4.4195 => 4.6102, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/objinst: 4.29% (0.2823 => 0.2944, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.21% (0.9697 => 1.0105, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (2.0673 => 2.1541, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.17% (0.3096 => 0.3225, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.16% (0.2811 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.16% (0.2911 => 0.3032, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.14% (0.2780 => 0.2895, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.13% (2.1653 => 2.2548, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3124 => 0.3252, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.09% (4.6177 => 4.8064, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.3271 => 0.3402, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.99% (0.3060 => 0.3182, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.94% (0.7875 => 0.8185, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.93% (0.3845 => 0.3996, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.93% (0.3362 => 0.3494, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.91% (1.4269 => 1.4827, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3317 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.3726 => 0.3868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3258 => 0.3382, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3678 => 0.3816, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3477 => 0.3607, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.3625 => 0.3760, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.71% (0.5546 => 0.5752, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3348 => 0.3471, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4146 => 0.4292, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.38% (0.6634 => 0.6858, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 3.33% (23.5202 => 24.3028, std. dev.: 0.0189) MultiSource/Applications/minisat/minisat: 3.21% (0.3336 => 0.3443, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.17% (0.3981 => 0.4107, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.97% (0.5012 => 0.5161, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.6435 => 0.6620, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.07% (2.0346 => 2.0768, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8979, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1709, std. dev.: 0.0320) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6419, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std. dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5032, std. dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2275, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4494, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5957, std. dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.89% (25.4195 => 16.2969, std. dev.: 0.1346) SingleSource/Benchmarks/Shootout-C++/ary2: -10.74% (0.2402 => 0.2144, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7925, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7915, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7660, std. dev.: 0.0731) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.81% (0.6293 => 0.6179, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9591, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 16:37:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 18:37:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120909233734.4FB972A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3601?compare_to=3597&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3601, Order: 163482, Start Time: 2012-09-09 22:27:45, End Time: 2012-09-09 23:38:48 To: 3597, Order: 163481, Start Time: 2012-09-09 21:01:04, End Time: 2012-09-09 22:12:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (56 on baseline) Performance Improvements: 1 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.8937 => 0.9129, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5534 => 0.5644, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 3.15% (0.8564 => 0.8834, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: 2.80% (2.3479 => 2.4136, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.73% (3.3981 => 3.4569, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/sieve: 1.72% (3.8132 => 3.8787, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 1.61% (1.0937 => 1.1113, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 1.57% (6.6514 => 6.7557, std. dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -3.07% (1.4277 => 1.3839, std. dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.79% (0.6410 => 0.6781, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.66% (0.3582 => 0.3749, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 4.07% (1.1653 => 1.2127, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 3.99% (0.6173 => 0.6419, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 3.68% (2.1763 => 2.2564, std. dev.: 0.0171) MultiSource/Applications/lemon/lemon: 3.62% (1.0046 => 1.0410, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5150 => 1.5557, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.5309 => 0.5443, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.46% (1.1440 => 1.1721, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 2.42% (3.0225 => 3.0956, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5520 => 0.5644, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.7639 => 0.7786, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (8.2559 => 8.4143, std. dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (4.2616 => 4.3371, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.68% (1.1672 => 1.1868, std. dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.65% (13.3238 => 13.5437, std. dev.: 0.0816) MultiSource/Benchmarks/Bullet/bullet: 1.58% (29.3170 => 29.7810, std. dev.: 0.0720) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (12.6413 => 12.8282, std. dev.: 0.0224) MultiSource/Applications/ClamAV/clamscan: 1.44% (14.6079 => 14.8181, std. dev.: 0.0195) MultiSource/Applications/kimwitu++/kc: 1.32% (15.3105 => 15.5121, std. dev.: 0.0210) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (8.2186 => 8.3182, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.14% (1.2021 => 1.2158, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.13% (4.0318 => 4.0773, std. dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2546 => 6.3238, std. dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0011, std. dev.: 0.0308) SingleSource/Benchmarks/McGill/misr: 14.13% (0.4296 => 0.4903, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.71% (4.0101 => 4.5599, std. dev.: 0.0645) MultiSource/Applications/sgefa/sgefa: 12.97% (0.3746 => 0.4232, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8787, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 10.05% (0.1433 => 0.1577, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 9.02% (1.0194 => 1.1113, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 8.91% (7.0025 => 7.6262, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.04% (0.2857 => 0.3058, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8157, std. dev.: 0.1012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (3.4876 => 3.6979, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.15% (40.4792 => 42.5634, std. dev.: 0.5116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3301 => 0.3470, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.95% (0.8498 => 0.8834, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: 3.82% (15.2242 => 15.8055, std. dev.: 0.0761) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5376, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.80% (4.2129 => 4.3730, std. dev.: 0.0584) SingleSource/Benchmarks/Misc/dt: 3.70% (0.9851 => 1.0215, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 2.91% (2.3453 => 2.4136, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: 2.54% (5.1938 => 5.3255, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/ReedSolomon: 2.45% (8.5113 => 8.7201, std. dev.: 0.0585) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.00% (4.6127 => 4.7049, std. dev.: 0.0332) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.96% (2.6656 => 2.7179, std. dev.: 0.0119) MultiSource/Applications/lua/lua: 1.70% (29.5232 => 30.0258, std. dev.: 0.0758) MultiSource/Applications/hexxagon/hexxagon: 1.20% (14.4877 => 14.6610, std. dev.: 0.0219) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (2.4971 => 2.5264, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.98% (0.3497 => 0.2134, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -17.67% (5.2665 => 4.3358, std. dev.: 0.1553) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.90% (1.1647 => 0.9912, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1605, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.97% (3.2007 => 2.9456, std. dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.19% (3.6254 => 3.3648, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -6.60% (3.4230 => 3.1972, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3522, std. dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7927, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/fibo: -5.01% (4.6355 => 4.4032, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7625, std. dev.: 0.0525) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.04% (3.6023 => 3.4569, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/methcall: -3.99% (9.2503 => 8.8808, std. dev.: 0.0909) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.45% (1.7361 => 1.6762, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2308, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.97% (3.7496 => 3.6384, std. dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (62.4126 => 60.6985, std. dev.: 0.2253) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.71% (1.1683 => 1.1366, std. dev.: 0.0052) MultiSource/Applications/aha/aha: -2.60% (3.4286 => 3.3393, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.46% (1.2959 => 1.2640, std. dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -2.18% (92.7467 => 90.7213, std. dev.: 0.4187) MultiSource/Benchmarks/FreeBench/neural/neural: -1.83% (1.0926 => 1.0726, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -1.81% (1.7330 => 1.7017, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: -1.66% (21.1721 => 20.8201, std. dev.: 0.1348) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2357, std. dev.: 0.0156) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.3569 => 2.3232, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.41% (1.8739 => 1.8475, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3085, std. dev.: 0.0337) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7681, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 17:08:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 19:08:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910000846.772AD2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3602?compare_to=3598&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3602, Order: 163482, Start Time: 2012-09-09 22:55:36, End Time: 2012-09-10 00:09:59 To: 3598, Order: 163481, Start Time: 2012-09-09 21:13:09, End Time: 2012-09-09 22:27:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.78% (78.0103 => 80.1819, std. dev.: 0.7190) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.63% (2.0176 => 2.4137, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.32% (0.1410 => 0.1626, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.30% (0.5818 => 0.6417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.18% (0.5748 => 0.6333, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.01% (1.3693 => 1.5064, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.91% (0.7710 => 0.8474, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.65% (3.9660 => 4.3487, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.13% (0.7061 => 0.7706, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-3: 9.11% (0.3623 => 0.3953, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3914 => 0.4266, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5265 => 0.5738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.87% (0.4003 => 0.4358, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.78% (0.7038 => 0.7656, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.73% (0.3940 => 0.4284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.71% (0.4062 => 0.4416, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3242, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.54% (0.6959 => 0.7553, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.45% (0.9199 => 0.9976, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.23% (1.4563 => 1.5761, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.11% (1.1364 => 1.2286, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.3899 => 0.4205, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5577 => 0.6011, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.76% (0.2127 => 0.2292, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4379 => 0.4718, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.72% (0.6283 => 0.6768, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.63% (13.8202 => 14.8742, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3756 => 0.4040, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.51% (7.2180 => 7.7599, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.49% (0.4390 => 0.4719, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2966 => 0.3187, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (1.9828 => 2.1302, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.34% (1.0313 => 1.1070, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.30% (0.7506 => 0.8054, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.12% (0.3246 => 0.3477, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.11% (0.3149 => 0.3373, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.06% (3.6692 => 3.9284, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3453 => 0.3693, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 6.91% (1.1061 => 1.1825, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.83% (3.8646 => 4.1287, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 6.83% (0.2988 => 0.3192, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 6.77% (0.8310 => 0.8873, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3220 => 0.3436, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.4113 => 0.4382, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.47% (0.7460 => 0.7943, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.26% (3.1889 => 3.3885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.26% (1.3245 => 1.4074, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 6.24% (2.1791 => 2.3151, std. dev.: 0.0136) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.12% (1.3819 => 1.4665, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 6.11% (1.9270 => 2.0448, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.07% (1.3813 => 1.4652, std. dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 6.03% (1.0594 => 1.1233, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.3801 => 4.6416, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.93% (4.4433 => 4.7069, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (1.2749 => 1.3502, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.89% (0.8818 => 0.9337, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.2859 => 0.3025, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.6135 => 0.6491, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 5.73% (14.8535 => 15.7041, std. dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 5.57% (8.4961 => 8.9694, std. dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 5.54% (16.6129 => 17.5339, std. dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.54% (0.3755 => 0.3963, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.53% (0.3131 => 0.3304, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1333 => 1.1939, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (13.2842 => 13.9923, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.31% (0.6576 => 0.6925, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.11% (6.5754 => 6.9113, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 5.04% (14.5298 => 15.2617, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.83% (4.6629 => 4.8879, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.78% (3.2742 => 3.4307, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 4.74% (1.2292 => 1.2875, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (1.5188 => 1.5790, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.6250 => 0.6491, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.71% (4.9865 => 5.1714, std. dev.: 0.0179) MultiSource/Applications/lua/lua: 3.59% (3.7467 => 3.8811, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.1007 => 2.1750, std. dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.45% (6.2785 => 6.4953, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2493, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4307, std. dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2730, std. dev.: 0.0420) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7337, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.18% (10.7476 => 11.0898, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.5184 => 0.5328, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5991, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5744, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6871, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5851, std. dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.43% (0.4657 => 0.3985, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7100, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2723, std. dev.: 0.0376) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.25% (1.3780 => 1.2919, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1513, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9242, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5982, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5197, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.15% (6.6320 => 6.5558, std. dev.: 0.0135) MultiSource/Applications/viterbi/viterbi: -1.14% (4.4810 => 4.4298, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 17:19:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 19:19:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910001921.CDEBE2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3603?compare_to=3599&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3603, Order: 163482, Start Time: 2012-09-09 23:00:51, End Time: 2012-09-10 00:20:36 To: 3599, Order: 163481, Start Time: 2012-09-09 21:13:04, End Time: 2012-09-09 22:32:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (126 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.67% (1.2963 => 1.3180, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.06% (1.9721 => 1.9512, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.45% (10.3673 => 14.4571, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 24.85% (0.1622 => 0.2025, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.42% (7.0540 => 8.0007, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.18% (2.2022 => 2.4924, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3473 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.66% (1.1194 => 1.2499, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.81% (1.7609 => 1.9512, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.71% (0.3282 => 0.3568, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.3177 => 0.3413, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.23% (0.1438 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.00% (9.4845 => 10.1487, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.4879 => 0.5211, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.8172 => 0.8723, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.71% (10.4361 => 11.1365, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.59% (0.4615 => 0.4919, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.2554 => 0.2721, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.48% (0.2700 => 0.2875, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7433 => 0.7910, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.20% (0.7115 => 0.7556, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (8.1363 => 8.6370, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 6.13% (0.3423 => 0.3633, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (4.2646 => 4.5258, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.95% (0.6675 => 0.7072, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5860 => 0.6208, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.93% (0.7835 => 0.8300, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.91% (1.3050 => 1.3821, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5569 => 0.5898, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (1.5415 => 1.6323, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.78% (4.9449 => 5.2309, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.72% (5.0018 => 5.2881, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 5.70% (3.3354 => 3.5254, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.2758 => 0.2915, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.59% (5.7591 => 6.0813, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9765 => 1.0291, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8067 => 0.8500, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.31% (1.5603 => 1.6432, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.22% (0.3180 => 0.3346, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 5.21% (0.7326 => 0.7708, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 5.16% (1.1642 => 1.2243, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (1.1861 => 1.2447, std. dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2603 => 0.2731, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.78% (0.3387 => 0.3549, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.71% (1.0722 => 1.1227, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 4.65% (3.8723 => 4.0525, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3441 => 0.3601, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (7.9617 => 8.3296, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.39% (0.6450 => 0.6733, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.37% (2.0273 => 2.1158, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.27% (0.4103 => 0.4278, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.4064 => 0.4234, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.15% (0.5981 => 0.6229, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3422 => 0.3562, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3817 => 0.3972, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6456 => 0.6718, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.99% (21.9371 => 22.8134, std. dev.: 0.0081) MultiSource/Applications/siod/siod: 3.97% (2.2969 => 2.3881, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4730, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4636 => 0.4808, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.66% (1.5859 => 1.6440, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.63% (0.3826 => 0.3965, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.59% (0.3650 => 0.3781, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (14.3668 => 14.8820, std. dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.35% (0.4203 => 0.4344, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4620 => 0.4772, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.4048 => 0.4180, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.26% (0.3098 => 0.3199, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.20% (2.2024 => 2.2729, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (2.0665 => 2.1323, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 3.16% (0.3603 => 0.3717, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1840 => 1.2184, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.8101 => 0.8267, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.01% (1.2842 => 1.3100, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.39% (4.2280 => 4.3714, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7483, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3045 => 1.3180, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7618, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.92% (5.2763 => 3.2227, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.48% (5.3855 => 3.8519, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.11% (5.3526 => 3.8481, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1536, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.16% (2.9384 => 2.5810, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: -8.41% (22.1758 => 20.3099, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2692, std. dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4911, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4336, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9967, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.15% (1.2373 => 1.2107, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: -1.90% (4.6441 => 4.5558, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0077, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6778, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2345, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 18:04:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 20:04:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910010403.D50EA2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3604?compare_to=3601&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3604, Order: 163483, Start Time: 2012-09-09 23:54:42, End Time: 2012-09-10 01:05:19 To: 3601, Order: 163482, Start Time: 2012-09-09 22:27:45, End Time: 2012-09-09 23:38:48 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (51 on baseline) Performance Improvements: 6 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.26% (0.1851 => 0.2041, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 17.38% (3.0342 => 3.5616, std. dev.: 0.1013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (2.3648 => 2.5892, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.02% (1.3262 => 1.4325, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.19% (1.1366 => 1.1501, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.50% (0.2888 => 0.2787, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.79% (0.5644 => 0.5543, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.21% (44.9584 => 43.5145, std. dev.: 0.4238) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.20% (2.3941 => 2.3415, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/whetstone: -1.97% (2.4136 => 2.3660, std. dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: -1.53% (6.7557 => 6.6523, std. dev.: 0.0237) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.6410 => 0.6748, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.66% (0.3582 => 0.3749, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.1653 => 1.2092, std. dev.: 0.0141) MultiSource/Applications/minisat/minisat: 3.68% (0.6173 => 0.6400, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 3.65% (2.1763 => 2.2558, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 3.43% (1.0046 => 1.0391, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 3.26% (0.3217 => 0.3322, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (1.5150 => 1.5556, std. dev.: 0.0146) MultiSource/Applications/d/make_dparser: 1.92% (3.0225 => 3.0805, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.82% (1.1672 => 1.1885, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.1827 => 1.2026, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.48% (1.2021 => 1.2199, std. dev.: 0.0062) MultiSource/Applications/Burg/burg: 1.46% (1.1440 => 1.1607, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.4113 => 1.4313, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.35% (1.3935 => 1.4123, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.4189 => 1.4380, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (8.2559 => 8.3589, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 1.23% (29.3170 => 29.6783, std. dev.: 0.1397) MultiSource/Applications/hbd/hbd: 1.00% (1.3268 => 1.3401, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 14.94% (1.7426 => 2.0030, std. dev.: 0.0711) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.36% (0.0766 => 0.0876, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5493, std. dev.: 0.0070) SingleSource/Benchmarks/McGill/misr: 13.36% (0.4296 => 0.4870, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 12.67% (3.4406 => 3.8764, std. dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 12.49% (0.3746 => 0.4214, std. dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 12.07% (0.1433 => 0.1606, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: 10.75% (3.2159 => 3.5616, std. dev.: 0.1013) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6257, std. dev.: 0.0286) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.86% (0.2857 => 0.3110, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.73% (1.0063 => 1.0941, std. dev.: 0.0243) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7943, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (3.4876 => 3.6907, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.3301 => 0.3490, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.79% (15.2242 => 15.8009, std. dev.: 0.0621) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.86% (8.5113 => 8.7548, std. dev.: 0.0478) MultiSource/Benchmarks/BitBench/five11/five11: 2.74% (5.1938 => 5.3361, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/hash: 2.30% (0.6308 => 0.6453, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.17% (1.4021 => 1.4325, std. dev.: 0.0087) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.10% (2.6656 => 2.7216, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4455 => 2.4786, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6725, std. dev.: 0.0297) MultiSource/Benchmarks/Olden/bh/bh: 1.27% (2.5166 => 2.5485, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout/hash: 1.05% (4.3016 => 4.3466, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.43% (0.3497 => 0.2083, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.22% (5.2665 => 4.2016, std. dev.: 0.0568) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.08% (1.1647 => 0.9891, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.92% (1.4034 => 1.2782, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.17% (3.2007 => 2.9392, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.07% (3.6254 => 3.3691, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -6.96% (3.4230 => 3.1846, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.59% (61.1734 => 57.1445, std. dev.: 1.3916) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3525, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4096, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7620, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.30% (45.4683 => 43.5145, std. dev.: 0.4238) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.26% (2.4457 => 2.3415, std. dev.: 0.0197) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.99% (1.2959 => 1.2442, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/distray/distray: -3.90% (0.2664 => 0.2560, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.56% (1.7361 => 1.6743, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -3.53% (9.2503 => 8.9238, std. dev.: 0.0229) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2304, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.26% (0.4140 => 0.4005, std. dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -2.84% (92.7467 => 90.1081, std. dev.: 0.3530) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2903, std. dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.56% (3.7496 => 3.6536, std. dev.: 0.0147) MultiSource/Applications/aha/aha: -2.46% (3.4286 => 3.3443, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: -1.97% (62.4126 => 61.1847, std. dev.: 0.1186) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2326, std. dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (1.1683 => 1.1501, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7655, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -1.39% (6.7458 => 6.6523, std. dev.: 0.0237) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3130, std. dev.: 0.0230) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.18% (1.8739 => 1.8517, std. dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.18% (1.1116 => 1.0985, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 18:51:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 20:51:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910015115.982632A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3605?compare_to=3602&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3605, Order: 163485, Start Time: 2012-09-10 00:38:07, End Time: 2012-09-10 01:52:29 To: 3602, Order: 163482, Start Time: 2012-09-09 22:55:36, End Time: 2012-09-10 00:09:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.82% (54.8960 => 55.8934, std. dev.: 0.3477) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.2919 => 1.3071, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.47% (2.0176 => 2.4104, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 10.79% (0.5818 => 0.6446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.79% (0.5748 => 0.6368, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.22% (1.3693 => 1.5093, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.01% (0.7710 => 0.8482, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.85% (3.9660 => 4.3566, std. dev.: 0.0121) SingleSource/UnitTests/ObjC++/property-reference: 9.79% (0.7061 => 0.7752, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.67% (0.2596 => 0.2847, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.24% (0.3646 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.19% (0.3601 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.17% (0.3663 => 0.3999, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7038 => 0.7683, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.15% (0.5265 => 0.5747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.2721 => 0.2967, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.96% (0.4328 => 0.4716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.96% (0.3940 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.93% (1.2193 => 1.3282, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.4003 => 0.4359, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.85% (0.9199 => 1.0013, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 8.79% (0.4062 => 0.4419, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.6959 => 0.7564, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.46% (1.4563 => 1.5795, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.37% (1.1364 => 1.2315, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.23% (0.3899 => 0.4220, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.05% (0.2782 => 0.3006, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5577 => 0.6024, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.89% (0.3485 => 0.3760, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.88% (0.4379 => 0.4724, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.83% (0.2607 => 0.2811, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.81% (13.8202 => 14.8997, std. dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.80% (0.3489 => 0.3761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.77% (1.9828 => 2.1368, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.77% (0.3580 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.3246 => 0.3498, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.74% (0.4390 => 0.4730, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.74% (0.4791 => 0.5162, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.2966 => 0.3195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.68% (0.3293 => 0.3546, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.67% (1.0313 => 1.1104, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (7.2180 => 7.7711, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 7.64% (0.2760 => 0.2971, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.64% (0.3756 => 0.4043, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.63% (0.2937 => 0.3161, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.61% (0.2628 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.61% (0.2655 => 0.2857, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.60% (0.3107 => 0.3343, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.58% (0.2690 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2765 => 0.2974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.53% (0.2761 => 0.2969, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.51% (0.7506 => 0.8070, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3149 => 0.3384, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.37% (0.4016 => 0.4312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.2988 => 0.3207, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.31% (0.2696 => 0.2893, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.3220 => 0.3454, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.25% (1.1061 => 1.1863, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.24% (3.6692 => 3.9350, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8310 => 0.8908, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (3.8646 => 4.1408, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.06% (0.3868 => 0.4141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3534 => 0.3779, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.82% (0.7460 => 0.7969, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.55% (3.1889 => 3.3979, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.53% (1.3245 => 1.4110, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.52% (0.2945 => 0.3137, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 6.49% (2.1791 => 2.3205, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.48% (0.6744 => 0.7181, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.36% (1.3813 => 1.4691, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.33% (1.9270 => 2.0490, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.32% (1.3819 => 1.4693, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.21% (0.8698 => 0.9238, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.15% (1.2749 => 1.3533, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6135 => 0.6511, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.12% (4.3801 => 4.6483, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.11% (0.8818 => 0.9357, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.10% (4.4433 => 4.7143, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.07% (0.6576 => 0.6975, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.05% (14.8535 => 15.7525, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.3755 => 0.3978, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.88% (16.6129 => 17.5893, std. dev.: 0.0221) MultiSource/Benchmarks/mafft/pairlocalalign: 5.84% (8.4961 => 8.9922, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (13.2842 => 14.0420, std. dev.: 0.0121) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.63% (0.2504 => 0.2645, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.59% (0.3131 => 0.3306, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.59% (1.1333 => 1.1966, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.33% (6.5754 => 6.9256, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 5.32% (14.5298 => 15.3034, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.16% (1.2292 => 1.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.89% (3.2742 => 3.4344, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8885, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.60% (0.9108 => 0.9527, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.4805 => 0.5023, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.19% (0.6250 => 0.6512, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (1.5188 => 1.5818, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (4.9865 => 5.1875, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8907, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.77% (2.1007 => 2.1800, std. dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5065, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.3511 => 0.3630, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.89% (33.2944 => 34.2564, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 1.45% (16.2614 => 16.4975, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3824, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7337, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5468, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.93% (10.7476 => 11.0622, std. dev.: 0.0422) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (0.5184 => 0.5331, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6024, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0063) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5935, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5712, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.04% (7.9275 => 8.0100, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.37% (0.4657 => 0.3988, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.49% (0.2670 => 0.2550, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.54% (22.5627 => 21.7644, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2717, std. dev.: 0.0143) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1510, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9221, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5782, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5218, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2376, std. dev.: 0.0234) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4310, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2595, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 19:07:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 21:07:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910020701.93B282A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3606?compare_to=3603&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3606, Order: 163485, Start Time: 2012-09-10 00:48:48, End Time: 2012-09-10 02:08:15 To: 3603, Order: 163482, Start Time: 2012-09-09 23:00:51, End Time: 2012-09-10 00:20:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (140 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.45% (14.4571 => 14.8117, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 1.34% (0.7708 => 0.7811, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.71% (3.8881 => 3.7828, std. dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.46% (1.3180 => 1.2988, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.87% (10.3673 => 14.8117, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 26.82% (0.1622 => 0.2057, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.30% (2.2022 => 2.5172, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.52% (7.0540 => 8.0074, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.45% (0.1566 => 0.1761, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.25% (1.1194 => 1.2565, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (1.7609 => 1.9493, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.54% (0.3282 => 0.3595, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (10.4361 => 11.2306, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.41% (0.5925 => 0.6364, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 7.37% (9.4845 => 10.1831, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.17% (0.7433 => 0.7966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.01% (0.8172 => 0.8745, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.00% (0.2700 => 0.2889, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.4615 => 0.4938, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.75% (0.3423 => 0.3654, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.71% (8.1363 => 8.6821, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: 6.70% (0.7115 => 0.7592, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.68% (0.3307 => 0.3528, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.66% (0.7835 => 0.8357, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 6.62% (0.7326 => 0.7811, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.53% (0.6675 => 0.7111, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.46% (4.2646 => 4.5402, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.35% (0.5860 => 0.6232, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.32% (1.3050 => 1.3875, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.30% (3.3354 => 3.5454, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.29% (5.0018 => 5.3164, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.25% (4.9449 => 5.2541, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (1.5415 => 1.6372, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.19% (0.5105 => 0.5421, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.17% (5.7591 => 6.1143, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.5569 => 0.5911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.99% (1.5603 => 1.6537, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.3092 => 0.3277, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.3180 => 0.3367, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.8067 => 0.8539, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.73% (0.9765 => 1.0325, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 5.70% (0.4299 => 0.4544, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.53% (1.1642 => 1.2286, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (1.1861 => 1.2503, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 5.21% (3.8723 => 4.0741, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.12% (0.4103 => 0.4313, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.11% (1.0722 => 1.1270, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.10% (0.5020 => 0.5276, std. dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 5.08% (0.3387 => 0.3559, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.88% (0.3422 => 0.3589, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.87% (0.6450 => 0.6764, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (7.9617 => 8.3486, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.4064 => 0.4261, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1239, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 4.68% (0.6456 => 0.6758, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.53% (2.2969 => 2.4009, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 4.49% (21.9371 => 22.9228, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8921 => 0.9316, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.38% (0.3650 => 0.3810, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5981 => 0.6243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3817 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.31% (0.3826 => 0.3991, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.20% (0.2905 => 0.3027, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.4186 => 1.4777, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.4636 => 0.4828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.12% (0.2891 => 0.3010, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (14.3668 => 14.9533, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.07% (0.2872 => 0.2989, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3603 => 0.3749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.4203 => 0.4372, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.00% (0.3098 => 0.3222, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 4.00% (0.4048 => 0.4210, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0665 => 2.1491, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.96% (0.3283 => 0.3413, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.88% (1.5859 => 1.6475, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.87% (0.3052 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2831 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3684 => 0.3824, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.76% (0.2871 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.72% (0.2877 => 0.2984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.70% (0.2756 => 0.2858, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.55% (0.3379 => 0.3499, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.48% (2.2024 => 2.2790, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.1840 => 1.2232, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 2.71% (1.2842 => 1.3190, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.43% (0.8101 => 0.8298, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.03% (17.1811 => 17.3578, std. dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.01% (3.1595 => 3.4126, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3813, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.62% (4.2280 => 4.3810, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7579, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2284, std. dev.: 0.0169) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.74% (5.2763 => 3.2324, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.16% (5.3855 => 3.8689, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.80% (5.3526 => 3.8645, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2036, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.66% (2.9384 => 2.5958, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -8.06% (22.1758 => 20.3879, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3773, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2717, std. dev.: 0.0999) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5769, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0021) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5082, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4233, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9840, std. dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.94% (4.6441 => 4.5542, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0047, std. dev.: 0.0100) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5068, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 19:18:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 21:18:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910021818.2A9982A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3607?compare_to=3600&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3607, Order: 163482, Start Time: 2012-09-09 23:35:43, End Time: 2012-09-10 02:19:32 To: 3600, Order: 163480, Start Time: 2012-09-09 20:23:45, End Time: 2012-09-09 23:07:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 1.80% (16.2969 => 16.5910, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.72% (129.3409 => 131.5634, std. dev.: 0.0944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.31% (54.1403 => 54.8480, std. dev.: 0.1076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.74% (0.3465 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.64% (0.3460 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.64% (0.3469 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.78% (0.3724 => 0.4200, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5826 => 0.6291, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.5889 => 0.6352, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.15% (1.5932 => 1.7071, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (3.5627 => 3.8093, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (1.6211 => 1.7318, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.46% (1.3152 => 1.4001, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.36% (0.7171 => 0.7627, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.31% (0.4361 => 0.4636, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (0.5000 => 0.5307, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (0.4994 => 0.5299, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.5900 => 0.6253, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (0.3930 => 0.4164, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 5.80% (4.2109 => 4.4552, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (0.5026 => 0.5311, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 5.58% (0.4029 => 0.4254, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.55% (1.0781 => 1.1379, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.46% (0.3004 => 0.3168, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.37% (0.2738 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.3903 => 0.4103, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.2866 => 0.3012, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.00% (2.7292 => 2.8657, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.97% (0.2875 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3195 => 0.3349, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.81% (1.9694 => 2.0641, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (0.3890 => 0.4077, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 4.77% (0.2725 => 0.2855, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.75% (0.2714 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.74% (1.9966 => 2.0913, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.66% (0.4658 => 0.4875, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.62% (0.9909 => 1.0367, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.60% (0.2803 => 0.2932, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.60% (0.2566 => 0.2684, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2813 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.58% (0.2729 => 0.2854, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.55% (5.5417 => 5.7937, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2750 => 0.2874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.2823 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.50% (0.2780 => 0.2905, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (2.1013 => 2.1953, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0673 => 2.1595, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.43% (0.3362 => 0.3511, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.2911 => 0.3039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3267 => 0.3410, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (4.4195 => 4.6128, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.33% (2.1653 => 2.2590, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.32% (4.6177 => 4.8170, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 4.30% (0.2811 => 0.2932, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.28% (0.3060 => 0.3191, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.25% (0.7875 => 0.8210, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (1.8794 => 1.9588, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.4139 => 0.4312, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3124 => 0.3254, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.16% (0.3317 => 0.3455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3726 => 0.3881, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 4.13% (1.4269 => 1.4858, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 4.12% (0.9697 => 1.0097, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.3845 => 0.4001, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.03% (0.3477 => 0.3617, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.02% (0.3678 => 0.3826, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.02% (0.3282 => 0.3414, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3348 => 0.3481, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3690 => 0.3835, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.3271 => 0.3398, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.84% (0.5546 => 0.5759, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 3.84% (0.4146 => 0.4305, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.59% (0.6634 => 0.6872, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.3084 => 0.3188, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.34% (23.5202 => 24.3048, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: 3.27% (0.3336 => 0.3445, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.17% (0.5012 => 0.5171, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.6435 => 0.6632, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.26% (2.0346 => 2.0806, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (0.7426 => 0.7532, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8974, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std. dev.: 0.0138) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6375, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2012, std. dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std. dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4335, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5997, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5910, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7974, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std. dev.: 0.0024) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7803, std. dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5723, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.62% (0.6293 => 0.6191, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9551, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5008, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 19:30:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Sep 2012 21:30:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910023042.51CEB2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3608?compare_to=3604&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3608, Order: 163485, Start Time: 2012-09-10 01:21:04, End Time: 2012-09-10 02:31:57 To: 3604, Order: 163483, Start Time: 2012-09-09 23:54:42, End Time: 2012-09-10 01:05:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (68 on baseline) Performance Improvements: 4 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 874 (791 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 9.48% (0.1413 => 0.1547, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.42% (0.2988 => 0.3120, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.18% (0.7700 => 0.8022, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2787 => 0.2889, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.33% (0.8368 => 0.8479, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.23% (1.2636 => 1.2792, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.0849 => 3.1177, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.51% (15.4372 => 17.2139, std. dev.: 0.0307) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.10% (57.1445 => 60.0616, std. dev.: 0.6783) SingleSource/Benchmarks/Misc/mandel-2: 4.44% (2.9529 => 3.0839, std. dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.41% (0.7873 => 0.7984, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.27% (42.4716 => 43.0123, std. dev.: 0.2074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.16% (1.4165 => 1.4330, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.16% (2.3180 => 2.3450, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -13.08% (3.5616 => 3.0957, std. dev.: 0.1115) SingleSource/Benchmarks/Shootout-C++/heapsort: -7.08% (3.3620 => 3.1240, std. dev.: 0.0685) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.1501 => 1.1374, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (1.7484 => 1.7301, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.18% (0.6410 => 0.6742, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.83% (0.3582 => 0.3755, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.68% (1.1653 => 1.2198, std. dev.: 0.0107) MultiSource/Applications/lemon/lemon: 4.12% (1.0046 => 1.0460, std. dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 4.09% (2.1763 => 2.2654, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.7722 => 0.8022, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 3.87% (0.6173 => 0.6412, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3217 => 0.3340, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3008 => 0.3120, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.70% (0.4596 => 0.4720, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.69% (0.5937 => 0.6097, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1672 => 1.1953, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.37% (1.2021 => 1.2306, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.1827 => 1.2096, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.27% (0.7226 => 0.7390, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5740 => 0.5869, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.7639 => 0.7804, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.5309 => 0.5422, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.12% (6.2546 => 6.3873, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.08% (0.5636 => 0.5753, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.94% (1.3935 => 1.4206, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (4.0318 => 4.1089, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5520 => 0.5625, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.88% (1.4113 => 1.4379, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (12.6413 => 12.8557, std. dev.: 0.0407) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.58% (8.2559 => 8.3867, std. dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.0758 => 3.1177, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.20% (1.0689 => 1.0817, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (1.4408 => 1.4569, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.81% (0.0917 => 0.1062, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5525, std. dev.: 0.0475) MultiSource/Applications/sgefa/sgefa: 13.05% (0.3746 => 0.4235, std. dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 12.21% (0.1433 => 0.1608, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 12.20% (3.4406 => 3.8605, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.65% (0.2694 => 0.2981, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 9.03% (7.0025 => 7.6348, std. dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.73% (15.8312 => 17.2139, std. dev.: 0.0307) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.87% (1.0063 => 1.0855, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.56% (0.2857 => 0.3073, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 6.67% (1.0194 => 1.0874, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.26% (40.4792 => 43.0123, std. dev.: 0.2074) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (3.4876 => 3.6998, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8027, std. dev.: 0.0378) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.93% (0.7609 => 0.7984, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8526, std. dev.: 0.0661) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.94% (0.8498 => 0.8833, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5387, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.45% (0.5587 => 0.5780, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 3.27% (1.4184 => 1.4648, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.73% (2.6656 => 2.7385, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/ReedSolomon: 2.60% (8.5113 => 8.7328, std. dev.: 0.0444) MultiSource/Benchmarks/BitBench/five11/five11: 2.36% (5.1938 => 5.3165, std. dev.: 0.0423) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.55% (4.6127 => 4.6842, std. dev.: 0.0240) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5327, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6694, std. dev.: 0.0090) MultiSource/Applications/lua/lua: 1.09% (29.5232 => 29.8452, std. dev.: 0.1118) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.5166 => 2.5436, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.71% (5.2665 => 4.1233, std. dev.: 0.0493) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9917, std. dev.: 0.0271) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1617, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.32% (3.2007 => 2.9343, std. dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.60% (3.6023 => 3.3285, std. dev.: 0.0926) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.20% (3.6254 => 3.3645, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -6.39% (1.4441 => 1.3518, std. dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: -6.33% (3.4230 => 3.2064, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7965, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4066, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (3.9413 => 3.7644, std. dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.25% (2.4457 => 2.3418, std. dev.: 0.0297) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.78% (1.2959 => 1.2469, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.12% (1.7361 => 1.6820, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -3.05% (9.2503 => 8.9683, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2860, std. dev.: 0.0146) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3353, std. dev.: 0.0268) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.64% (1.1683 => 1.1374, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.49% (3.7496 => 3.6563, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.46% (0.4140 => 0.4038, std. dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -2.27% (92.7467 => 90.6374, std. dev.: 0.0281) MultiSource/Benchmarks/mafft/pairlocalalign: -2.23% (62.4126 => 61.0221, std. dev.: 0.1957) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.63% (1.8739 => 1.8433, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2387, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7674, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3141, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: -1.21% (16.5617 => 16.3615, std. dev.: 0.0497) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 9 22:29:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 00:29:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910052954.218632A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3609?compare_to=3607&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3609, Order: 163485, Start Time: 2012-09-10 02:47:48, End Time: 2012-09-10 05:31:08 To: 3607, Order: 163482, Start Time: 2012-09-09 23:35:43, End Time: 2012-09-10 02:19:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.23% (131.5634 => 123.3659, std. dev.: 3.1036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.33% (0.3488 => 0.3953, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.82% (0.3650 => 0.4118, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.79% (0.3643 => 0.4109, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5826 => 0.6291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.5889 => 0.6352, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.66% (1.6211 => 1.7291, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (3.5627 => 3.7938, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 6.48% (1.5932 => 1.6964, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.26% (1.3152 => 1.3975, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 6.18% (0.7171 => 0.7614, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.5900 => 0.6255, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (0.4994 => 0.5293, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (0.4361 => 0.4622, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (0.5026 => 0.5313, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.66% (0.4029 => 0.4257, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.42% (4.2109 => 4.4392, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 5.23% (1.0781 => 1.1345, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.2736 => 0.2871, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 4.75% (0.9909 => 1.0380, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (2.7292 => 2.8583, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.55% (5.5417 => 5.7936, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.52% (0.2875 => 0.3005, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (0.3890 => 0.4065, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (1.9694 => 2.0573, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (0.4658 => 0.4864, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.39% (0.3004 => 0.3136, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.37% (1.9966 => 2.0838, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2813 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.2823 => 0.2943, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.23% (0.3903 => 0.4068, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (2.0673 => 2.1539, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.14% (0.9697 => 1.0098, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.2780 => 0.2893, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.05% (1.8794 => 1.9556, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3792 => 0.3945, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 4.02% (1.4269 => 1.4843, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2811 => 0.2924, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.99% (0.3060 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.98% (0.4146 => 0.4311, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3267 => 0.3397, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (2.1013 => 2.1846, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.93% (0.6634 => 0.6895, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.91% (4.4195 => 4.5921, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.3845 => 0.3995, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.4139 => 0.4300, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3317 => 0.3446, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.87% (2.1653 => 2.2492, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.84% (4.6177 => 4.7952, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3678 => 0.3819, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.80% (23.5202 => 24.4128, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/lists: 3.76% (0.3348 => 0.3474, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3625 => 0.3761, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3477 => 0.3606, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.66% (0.3282 => 0.3402, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.2969 => 0.3076, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.60% (0.3084 => 0.3195, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.54% (0.7875 => 0.8154, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4251 => 0.4399, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.45% (0.3336 => 0.3451, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.29% (0.3981 => 0.4112, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.6435 => 0.6631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.89% (0.5012 => 0.5157, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 2.15% (0.4847 => 0.4951, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.09% (2.0346 => 2.0771, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (0.7426 => 0.7565, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.29% (11.6398 => 11.7895, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6709, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1626, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6402, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2118, std. dev.: 0.0407) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5094, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4412, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5119, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6002, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5162, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7834, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8052, std. dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5723, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9630, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 00:54:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 02:54:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910075434.72BDE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/3610?compare_to=3608&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3610, Order: 163489, Start Time: 2012-09-10 06:45:01, End Time: 2012-09-10 07:55:49 To: 3608, Order: 163485, Start Time: 2012-09-10 01:21:04, End Time: 2012-09-10 02:31:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (49 on baseline) Performance Improvements: 3 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.25% (8.8180 => 9.0164, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.46% (20.5344 => 21.6557, std. dev.: 0.3396) MultiSource/Benchmarks/Bullet/bullet: 1.58% (7.0283 => 7.1393, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.7328 => 8.8388, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.11% (2.3418 => 2.3679, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.15% (1.4206 => 1.4042, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.14% (4.1089 => 4.0621, std. dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.90% (1.4300 => 1.3886, std. dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.43% (0.6410 => 0.6758, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.55% (0.3582 => 0.3745, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.1653 => 1.2097, std. dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 3.74% (2.1763 => 2.2576, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 3.38% (1.0046 => 1.0386, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: 3.30% (0.6173 => 0.6377, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.25% (0.7722 => 0.7973, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.5150 => 1.5541, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.1827 => 1.2088, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.74% (8.2559 => 8.3994, std. dev.: 0.0106) MultiSource/Applications/d/make_dparser: 1.64% (3.0225 => 3.0721, std. dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 1.47% (13.3238 => 13.5195, std. dev.: 0.0363) MultiSource/Applications/siod/siod: 1.20% (2.0972 => 2.1224, std. dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (6.2546 => 6.3271, std. dev.: 0.0217) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.06% (12.6413 => 12.7752, std. dev.: 0.0246) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout/ary3: 14.49% (1.7426 => 1.9951, std. dev.: 0.0420) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.74% (4.0101 => 4.5611, std. dev.: 0.0606) SingleSource/Benchmarks/Shootout-C++/sieve: 12.70% (3.4406 => 3.8774, std. dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/misr: 11.78% (0.4296 => 0.4802, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.91% (0.1433 => 0.1575, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6259, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.91% (1.0063 => 1.0859, std. dev.: 0.0194) SingleSource/Benchmarks/McGill/chomp: 7.76% (1.0194 => 1.0985, std. dev.: 0.0154) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.56% (0.2857 => 0.3073, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.06% (3.4876 => 3.6990, std. dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8035, std. dev.: 0.0720) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.02% (0.7609 => 0.7991, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (0.3301 => 0.3460, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.26% (0.8498 => 0.8860, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: 4.02% (15.2242 => 15.8365, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8388, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: 3.84% (0.9851 => 1.0229, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.64% (3.4080 => 3.5322, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0270) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (4.2129 => 4.3622, std. dev.: 0.0539) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.12% (2.6656 => 2.7487, std. dev.: 0.0213) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.40% (6.9722 => 7.1393, std. dev.: 0.0316) MultiSource/Benchmarks/BitBench/five11/five11: 2.30% (5.1938 => 5.3133, std. dev.: 0.0179) MultiSource/Applications/siod/siod: 1.54% (3.5520 => 3.6068, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4455 => 2.4819, std. dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6753, std. dev.: 0.0079) MultiSource/Applications/lua/lua: 1.28% (29.5232 => 29.9021, std. dev.: 0.0384) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.15% (5.2665 => 4.1524, std. dev.: 0.0806) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.07% (1.1647 => 0.9892, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std. dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9406, std. dev.: 0.0289) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3660, std. dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: -6.92% (3.4230 => 3.1860, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.4441 => 1.3557, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.30% (3.9413 => 3.7717, std. dev.: 0.0402) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.58% (61.1734 => 58.9825, std. dev.: 0.4953) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6278, std. dev.: 0.0190) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2309, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.18% (2.4457 => 2.3679, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.04% (1.7361 => 1.6833, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -2.83% (9.5474 => 9.2774, std. dev.: 0.0151) MultiSource/Benchmarks/PAQ8p/paq8p: -2.82% (92.7467 => 90.1273, std. dev.: 0.4732) MultiSource/Benchmarks/mafft/pairlocalalign: -2.66% (62.4126 => 60.7502, std. dev.: 0.3146) MultiSource/Applications/aha/aha: -2.62% (3.4286 => 3.3386, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.39% (1.1683 => 1.1404, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -1.89% (1.7330 => 1.7003, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2265, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: -1.52% (6.7458 => 6.6434, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7660, std. dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3101, std. dev.: 0.0475) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3569 => 2.3251, std. dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.20% (2.3580 => 2.3296, std. dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 01:12:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 03:12:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910081227.CED662A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3611?compare_to=3605&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3611, Order: 163489, Start Time: 2012-09-10 06:57:30, End Time: 2012-09-10 08:13:42 To: 3605, Order: 163485, Start Time: 2012-09-10 00:38:07, End Time: 2012-09-10 01:52:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (155 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.14% (1.3070 => 1.2921, std. dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.63% (2.0176 => 2.4137, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.28% (0.1986 => 0.2210, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.04% (0.7710 => 0.8561, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.97% (0.5818 => 0.6456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.79% (0.5748 => 0.6368, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 10.73% (0.3578 => 0.3962, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.59% (0.3646 => 0.4032, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.49% (0.3650 => 0.4033, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.37% (0.3663 => 0.4043, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3623 => 0.3996, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.25% (0.3914 => 0.4315, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.24% (0.3789 => 0.4177, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.18% (1.3693 => 1.5087, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.17% (3.9660 => 4.3693, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.09% (0.4003 => 0.4407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.98% (0.7061 => 0.7766, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 9.95% (0.3940 => 0.4332, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.57% (0.5265 => 0.5769, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.52% (0.2721 => 0.2980, std. dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.47% (0.4328 => 0.4738, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.27% (0.1327 => 0.1450, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.12% (0.7038 => 0.7680, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 9.11% (0.4062 => 0.4432, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.08% (0.6959 => 0.7591, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.99% (1.2193 => 1.3289, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.86% (1.4563 => 1.5854, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.83% (0.9199 => 1.0011, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.67% (0.3899 => 0.4237, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.66% (0.2782 => 0.3023, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.64% (0.3022 => 0.3283, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 8.63% (0.2781 => 0.3021, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.55% (0.5577 => 0.6054, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 8.51% (0.1657 => 0.1798, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2023 => 0.2195, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.45% (1.1364 => 1.2324, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 8.29% (0.3293 => 0.3566, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2607 => 0.2823, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.2966 => 0.3211, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.22% (0.2690 => 0.2911, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 8.21% (13.8202 => 14.9546, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: 8.19% (0.2761 => 0.2987, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2628 => 0.2843, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2726 => 0.2949, std. dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 8.10% (0.2937 => 0.3175, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.09% (0.3485 => 0.3767, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2760 => 0.2983, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (7.2180 => 7.8009, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 8.05% (0.3107 => 0.3357, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3580 => 0.3867, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.00% (1.9828 => 2.1415, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 8.00% (0.3149 => 0.3401, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.95% (0.4390 => 0.4739, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.88% (0.3489 => 0.3764, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.75% (0.2696 => 0.2905, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.70% (0.3246 => 0.3496, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.70% (0.2988 => 0.3218, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3192 => 0.3434, std. dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1865 => 0.2006, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.52% (0.5637 => 0.6061, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/sieve: 7.50% (0.3453 => 0.3712, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.40% (3.6692 => 3.9409, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 7.39% (0.3868 => 0.4154, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 7.20% (1.1061 => 1.1857, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8310 => 0.8906, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.16% (3.8646 => 4.1413, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 7.10% (0.2945 => 0.3154, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.09% (0.7460 => 0.7989, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 7.07% (0.2859 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.90% (0.4113 => 0.4397, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.68% (1.3813 => 1.4736, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.66% (3.1889 => 3.4012, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.63% (1.3245 => 1.4123, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (1.3819 => 1.4735, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 6.60% (0.6744 => 0.7189, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.59% (0.2140 => 0.2281, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.57% (1.9270 => 2.0536, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 6.51% (1.0594 => 1.1284, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.36% (0.3755 => 0.3994, std. dev.: 0.0090) MultiSource/Applications/siod/siod: 6.34% (2.1791 => 2.3172, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.3801 => 4.6564, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.21% (4.4433 => 4.7194, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6135 => 0.6511, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (1.2749 => 1.3528, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 6.06% (14.8535 => 15.7532, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.04% (0.8818 => 0.9351, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (8.4961 => 8.9931, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 5.76% (16.6129 => 17.5694, std. dev.: 0.0220) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.70% (0.6576 => 0.6951, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1974, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (13.2842 => 14.0316, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.55% (0.2504 => 0.2643, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.43% (0.3131 => 0.3301, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.41% (14.5298 => 15.3160, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 5.29% (1.2292 => 1.2942, std. dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 5.28% (6.5754 => 6.9225, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 4.99% (4.6629 => 4.8956, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.39% (0.9108 => 0.9508, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 4.03% (3.7467 => 3.8977, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (6.2785 => 6.5275, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.33% (0.3511 => 0.3628, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.2944 => 34.3080, std. dev.: 0.0267) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4886, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std. dev.: 0.0262) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2572, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std. dev.: 0.0342) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5476, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0812, std. dev.: 0.0212) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6013, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.15% (1.4298 => 1.4462, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.12% (7.9275 => 8.0162, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0148) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.29% (0.4657 => 0.4038, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.08% (0.2670 => 0.2561, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.54% (22.5627 => 21.7640, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2747, std. dev.: 0.0160) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9233, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6003, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2399, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: -1.63% (7.1097 => 6.9936, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5208, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2434, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2264, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std. dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4313, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 01:17:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 03:17:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910081752.C12D82A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3612?compare_to=3606&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3612, Order: 163489, Start Time: 2012-09-10 06:57:27, End Time: 2012-09-10 08:19:07 To: 3606, Order: 163485, Start Time: 2012-09-10 00:48:48, End Time: 2012-09-10 02:08:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (114 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (737 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.20% (14.8117 => 14.3372, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.03% (1.5530 => 1.5370, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.29% (10.3673 => 14.3372, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-4: 14.25% (0.3543 => 0.4048, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.25% (0.3473 => 0.3968, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3516 => 0.4014, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.08% (0.3543 => 0.4042, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3497 => 0.3989, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.90% (0.3561 => 0.4056, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.75% (2.2022 => 2.5050, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.65% (7.0540 => 8.0168, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/for-in: 13.51% (0.3694 => 0.4193, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 13.22% (0.3828 => 0.4334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.14% (0.3927 => 0.4443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.92% (0.3886 => 0.4388, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.20% (1.1194 => 1.2560, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.75% (1.7609 => 1.9678, std. dev.: 0.0084) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.64% (0.2065 => 0.2264, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.47% (0.3177 => 0.3478, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.11% (0.1625 => 0.1773, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.79% (0.1695 => 0.1844, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5925 => 0.6422, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.28% (0.8172 => 0.8849, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.14% (0.1438 => 0.1555, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.4879 => 0.5259, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 7.67% (9.4845 => 10.2124, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.56% (0.5569 => 0.5990, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 7.42% (10.4361 => 11.2108, std. dev.: 0.0181) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.26% (0.4615 => 0.4950, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 7.18% (0.7326 => 0.7852, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.18% (0.2271 => 0.2434, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 7.17% (0.2554 => 0.2737, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.14% (0.2758 => 0.2955, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.10% (0.5860 => 0.6276, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.08% (0.3121 => 0.3342, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.00% (8.1363 => 8.7062, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.96% (0.2700 => 0.2888, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.89% (0.3423 => 0.3659, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 6.88% (0.3109 => 0.3323, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.86% (0.3307 => 0.3534, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: 6.83% (0.7835 => 0.8370, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 6.79% (0.3092 => 0.3302, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.68% (5.0018 => 5.3361, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.68% (1.5415 => 1.6444, std. dev.: 0.0093) MultiSource/Applications/minisat/minisat: 6.66% (0.7115 => 0.7589, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.64% (4.2646 => 4.5478, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.54% (4.9449 => 5.2685, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7433 => 0.7913, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4299 => 0.4576, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 6.40% (3.3354 => 3.5488, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.38% (1.3050 => 1.3882, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.8067 => 0.8576, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.10% (0.3817 => 0.4050, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 5.94% (0.3180 => 0.3369, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.83% (5.7591 => 6.0946, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.80% (0.9765 => 1.0331, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 5.51% (1.5603 => 1.6463, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.4103 => 0.4329, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.47% (1.1642 => 1.2279, std. dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1861 => 1.2496, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 5.25% (3.8723 => 4.0757, std. dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.23% (7.9617 => 8.3781, std. dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.20% (0.3387 => 0.3563, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6450 => 0.6778, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 5.03% (2.0273 => 2.1292, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 5.02% (1.0722 => 1.1260, std. dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.68% (0.3826 => 0.4005, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.62% (0.8921 => 0.9333, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5981 => 0.6254, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4636 => 0.4844, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 4.47% (21.9371 => 22.9183, std. dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (1.4186 => 1.4813, std. dev.: 0.0113) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.1840 => 1.2353, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 4.18% (2.2969 => 2.3929, std. dev.: 0.0161) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2905 => 0.3026, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (14.3668 => 14.9505, std. dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.95% (2.0665 => 2.1482, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3283 => 0.3402, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 3.55% (0.3379 => 0.3499, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.2024 => 2.2783, std. dev.: 0.0274) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.8101 => 0.8339, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3183, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0404) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0384) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.94% (1.1145 => 1.3702, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3848, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3740, std. dev.: 0.0251) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7567, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/fbench: 1.64% (2.2771 => 2.3145, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2407, std. dev.: 0.0240) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2306, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.04% (5.3855 => 3.8754, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.75% (5.3526 => 3.8673, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1264, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.13% (2.9384 => 2.5821, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -7.75% (22.1758 => 20.4582, std. dev.: 0.0402) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3706, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2570, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7165, std. dev.: 0.0153) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.12% (1.6805 => 1.5777, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5071, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.6802 => 8.4431, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.57% (10.2830 => 10.0183, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.2999 => 6.1651, std. dev.: 0.0354) MultiSource/Applications/sqlite3/sqlite3: -1.96% (4.6441 => 4.5531, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0021, std. dev.: 0.0129) SingleSource/UnitTests/Vector/multiplies: -1.83% (2.5528 => 2.5061, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 02:21:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 04:21:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910092138.88C872A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3613?compare_to=3610&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3613, Order: 163491, Start Time: 2012-09-10 08:11:54, End Time: 2012-09-10 09:22:53 To: 3610, Order: 163489, Start Time: 2012-09-10 06:45:01, End Time: 2012-09-10 07:55:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (40 on baseline) Performance Improvements: 4 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (818 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.19% (15.6509 => 17.7156, std. dev.: 0.4060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.73% (40.7958 => 43.1320, std. dev.: 0.0713) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.36% (2.3296 => 2.3846, std. dev.: 0.0144) MultiSource/Benchmarks/llubenchmark/llu: 2.13% (1.9915 => 2.0340, std. dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.45% (9.0164 => 8.5251, std. dev.: 0.1786) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.31% (0.7991 => 0.7567, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.27% (2.9623 => 2.9248, std. dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.02% (1.2923 => 1.2791, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.26% (0.6410 => 0.6747, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 3.45% (1.0046 => 1.0393, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.7639 => 0.7816, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.10% (8.2559 => 8.4290, std. dev.: 0.0292) MultiSource/Applications/SPASS/SPASS: 1.62% (13.3238 => 13.5397, std. dev.: 0.0538) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.67% (0.0766 => 0.0932, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9995, std. dev.: 0.0381) SingleSource/Benchmarks/McGill/misr: 13.71% (0.4296 => 0.4885, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.55% (4.0101 => 4.5536, std. dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/sieve: 12.87% (3.4406 => 3.8835, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.43% (0.0917 => 0.1031, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.90% (15.8312 => 17.7156, std. dev.: 0.4060) MultiSource/Applications/sgefa/sgefa: 10.30% (0.3746 => 0.4132, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6011, std. dev.: 0.0504) SingleSource/Benchmarks/McGill/chomp: 7.73% (1.0194 => 1.0982, std. dev.: 0.0195) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.61% (0.2694 => 0.2899, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.14% (1.0063 => 1.0782, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.55% (40.4792 => 43.1320, std. dev.: 0.0713) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (3.4876 => 3.7003, std. dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8124, std. dev.: 0.0271) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8510, std. dev.: 0.0332) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 2.82% (8.5113 => 8.7512, std. dev.: 0.0749) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.29% (2.6656 => 2.7267, std. dev.: 0.0211) MultiSource/Benchmarks/BitBench/five11/five11: 2.23% (5.1938 => 5.3094, std. dev.: 0.0311) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.21% (0.5876 => 0.6006, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.68% (29.5232 => 30.0193, std. dev.: 0.1091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.4455 => 2.4836, std. dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (2.4971 => 2.5345, std. dev.: 0.0057) MultiSource/Applications/siod/siod: 1.31% (3.5520 => 3.5985, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6767, std. dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.98% (0.2080 => 0.1914, std. dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -5.25% (8.9977 => 8.5251, std. dev.: 0.1786) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.66% (5.2665 => 4.1259, std. dev.: 0.0896) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.19% (1.1647 => 0.9878, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std. dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.83% (1.4034 => 1.2795, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.93% (3.2007 => 2.9468, std. dev.: 0.0274) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.10% (3.6254 => 3.3679, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: -6.50% (3.4230 => 3.2004, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3502, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7925, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4052, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.84% (1.7361 => 1.6695, std. dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: -3.81% (62.4126 => 60.0335, std. dev.: 0.5514) SingleSource/Benchmarks/Shootout-C++/methcall: -3.56% (9.2503 => 8.9208, std. dev.: 0.0389) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -2.67% (9.5474 => 9.2929, std. dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.65% (61.1734 => 59.5517, std. dev.: 0.2849) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.63% (1.1683 => 1.1376, std. dev.: 0.0077) MultiSource/Applications/aha/aha: -2.59% (3.4286 => 3.3397, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.57% (3.7496 => 3.6531, std. dev.: 0.0271) MultiSource/Benchmarks/PAQ8p/paq8p: -2.56% (92.7467 => 90.3704, std. dev.: 0.3153) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2357, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.50% (1.8739 => 1.8458, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3121, std. dev.: 0.0949) MultiSource/Applications/JM/lencod/lencod: -1.34% (6.7458 => 6.6554, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7695, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -1.16% (1.7330 => 1.7129, std. dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 02:42:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 04:42:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910094252.03E792A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3614?compare_to=3609&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3614, Order: 163489, Start Time: 2012-09-10 06:57:30, End Time: 2012-09-10 09:44:06 To: 3609, Order: 163485, Start Time: 2012-09-10 02:47:48, End Time: 2012-09-10 05:31:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (99 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (794 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.18% (1.0380 => 1.0502, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 25.97% (59.4748 => 74.9203, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.07% (2.0842 => 2.1274, std. dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.16% (117.1904 => 118.5478, std. dev.: 0.0952) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 14.48% (0.3488 => 0.3993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.12% (0.3442 => 0.3928, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.99% (0.3496 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.95% (0.3469 => 0.3953, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.35% (0.3724 => 0.4221, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.29% (0.3650 => 0.4135, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5826 => 0.6325, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1620 => 0.1757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5889 => 0.6375, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.03% (0.1619 => 0.1749, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.5900 => 0.6333, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (3.5627 => 3.8228, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.21% (1.6211 => 1.7380, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 6.97% (0.7171 => 0.7671, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (1.3152 => 1.4059, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.74% (0.4361 => 0.4655, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.55% (0.2014 => 0.2146, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.47% (0.4994 => 0.5317, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.36% (0.5000 => 0.5318, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 6.24% (4.2109 => 4.4738, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.2736 => 0.2906, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 6.08% (1.5932 => 1.6900, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 5.98% (0.9909 => 1.0502, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (0.5026 => 0.5326, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 5.86% (0.4029 => 0.4265, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.78% (1.0781 => 1.1404, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 5.73% (0.2566 => 0.2713, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.1968 => 0.2080, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.66% (2.7292 => 2.8838, std. dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.3004 => 0.3171, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.54% (0.2691 => 0.2840, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2875 => 0.3032, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.15% (0.3903 => 0.4104, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (0.3195 => 0.3359, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (1.9694 => 2.0689, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.00% (5.5417 => 5.8187, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.98% (2.0673 => 2.1702, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.94% (1.9966 => 2.0953, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.92% (0.4658 => 0.4887, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.91% (0.2911 => 0.3054, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.84% (0.3060 => 0.3208, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (2.1013 => 2.2027, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (4.4195 => 4.6281, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.61% (0.3124 => 0.3268, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (1.8794 => 1.9645, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 4.46% (4.6177 => 4.8237, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3282 => 0.3426, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.37% (0.3271 => 0.3414, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 4.37% (1.4269 => 1.4892, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.35% (0.4139 => 0.4319, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.34% (0.2969 => 0.3098, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.31% (2.1653 => 2.2586, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 4.28% (0.7875 => 0.8212, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 4.22% (0.6634 => 0.6914, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 4.18% (0.9697 => 1.0102, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.08% (0.3845 => 0.4002, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.86% (0.5546 => 0.5760, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 3.69% (23.5202 => 24.3870, std. dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.3084 => 0.3194, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.6435 => 0.6653, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.55% (2.0346 => 2.0865, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (0.4847 => 0.4965, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (0.5361 => 0.5463, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (0.7426 => 0.7547, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (11.6398 => 11.7678, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (12.0509 => 12.6516, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0263) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6399, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 4.15% (1.8057 => 1.8807, std. dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.18% (2.0820 => 2.1274, std. dev.: 0.0109) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5040, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 1.83% (15.8721 => 16.1619, std. dev.: 0.0201) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2262, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4411, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5979, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4694, std. dev.: 0.0197) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.06% (25.4195 => 16.2535, std. dev.: 0.1479) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7851, std. dev.: 0.0151) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7964, std. dev.: 0.0019) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7921, std. dev.: 0.0687) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.89% (0.6293 => 0.6174, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9725, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 02:56:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 04:56:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910095622.EC7682A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3615?compare_to=3611&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3615, Order: 163491, Start Time: 2012-09-10 08:42:04, End Time: 2012-09-10 09:56:52 To: 3611, Order: 163489, Start Time: 2012-09-10 06:57:30, End Time: 2012-09-10 08:13:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.05% (2.0176 => 2.4221, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.99% (0.7710 => 0.8557, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.91% (0.1072 => 0.1189, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.79% (0.5818 => 0.6446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.68% (0.7061 => 0.7815, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.58% (0.5748 => 0.6356, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.29% (0.3578 => 0.3946, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.26% (1.3693 => 1.5098, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.23% (0.3646 => 0.4019, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.19% (3.9660 => 4.3701, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 10.08% (0.3601 => 0.3964, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.99% (0.3663 => 0.4029, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.92% (0.3650 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.87% (0.3789 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.82% (0.4003 => 0.4396, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.78% (0.2596 => 0.2850, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.69% (0.5265 => 0.5775, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.67% (0.3940 => 0.4321, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.38% (0.7038 => 0.7698, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.27% (0.1327 => 0.1450, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.11% (0.6959 => 0.7593, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.09% (1.2193 => 1.3301, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.08% (0.2721 => 0.2968, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.07% (0.9199 => 1.0033, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.96% (0.4328 => 0.4716, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.80% (1.4563 => 1.5845, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2781 => 0.3024, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.68% (0.5577 => 0.6061, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.61% (1.1364 => 1.2343, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 8.44% (13.8202 => 14.9865, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.31% (0.3899 => 0.4223, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 8.25% (0.4062 => 0.4397, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 8.24% (0.1589 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.24% (0.3022 => 0.3271, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.09% (0.2782 => 0.3007, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 8.06% (0.7506 => 0.8111, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.03% (7.2180 => 7.7974, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.99% (0.1865 => 0.2014, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.94% (0.1435 => 0.1549, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2761 => 0.2980, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.87% (0.3293 => 0.3552, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.86% (0.2607 => 0.2812, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.83% (0.6283 => 0.6775, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.82% (0.3489 => 0.3762, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.78% (1.9828 => 2.1370, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 7.77% (0.2690 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.77% (0.3580 => 0.3858, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.73% (1.0313 => 1.1110, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.72% (0.3756 => 0.4046, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2243 => 0.2416, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.70% (1.1061 => 1.1913, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.70% (0.4791 => 0.5160, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 7.69% (0.2925 => 0.3150, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2760 => 0.2972, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.65% (0.4390 => 0.4726, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2726 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.61% (0.2628 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.61% (0.2655 => 0.2857, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.59% (0.5637 => 0.6065, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2765 => 0.2971, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.42% (3.8646 => 4.1514, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 7.40% (0.3149 => 0.3382, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.36% (3.6692 => 3.9394, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.32% (0.4016 => 0.4310, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.30% (0.3220 => 0.3455, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.29% (0.7460 => 0.8004, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2696 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.26% (0.8310 => 0.8913, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3192 => 0.3423, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2988 => 0.3202, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.16% (0.3868 => 0.4145, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.10% (0.3453 => 0.3698, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.07% (0.3534 => 0.3784, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 6.88% (2.1791 => 2.3291, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.86% (1.3245 => 1.4154, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.82% (1.9270 => 2.0585, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 6.81% (0.4113 => 0.4393, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.72% (3.1889 => 3.4031, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 6.69% (0.2945 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.66% (1.3819 => 1.4740, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.58% (1.3813 => 1.4722, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.54% (1.0594 => 1.1287, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.54% (0.6744 => 0.7185, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.2859 => 0.3044, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.3801 => 4.6624, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.34% (0.6135 => 0.6524, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (4.4433 => 4.7241, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (1.2749 => 1.3545, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.21% (0.8818 => 0.9366, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.16% (0.8698 => 0.9234, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.16% (0.6576 => 0.6981, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 6.13% (14.8535 => 15.7634, std. dev.: 0.0166) MultiSource/Applications/kimwitu++/kc: 6.07% (16.6129 => 17.6216, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.05% (0.3755 => 0.3982, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.88% (8.4961 => 8.9956, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.81% (1.1333 => 1.1992, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.72% (13.2842 => 14.0434, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.67% (0.2504 => 0.2646, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.54% (14.5298 => 15.3347, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 5.53% (0.3131 => 0.3304, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.44% (6.5754 => 6.9328, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2917, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.89% (3.2742 => 3.4344, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8885, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.4805 => 0.5029, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.55% (1.5188 => 1.5879, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.45% (0.9108 => 0.9513, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6250 => 0.6520, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 4.19% (3.7467 => 3.9038, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (2.1007 => 2.1875, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1860, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (6.2785 => 6.5244, std. dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 3.38% (33.2944 => 34.4213, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.05% (0.3511 => 0.3618, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5047, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (3.1736 => 3.4173, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.50% (0.2093 => 0.2250, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.00% (1.2998 => 1.3778, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7337, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0719, std. dev.: 0.0189) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5970, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4456, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5876, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.68% (0.4657 => 0.4020, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.68% (0.2670 => 0.2545, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.53% (22.5627 => 21.7655, std. dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2586, std. dev.: 0.0208) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.45% (1.3780 => 1.2891, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1514, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9235, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6019, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2388, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5217, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2373, std. dev.: 0.0275) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2191, std. dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8727, std. dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4330, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 03:06:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 05:06:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910100619.828DA2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3616?compare_to=3612&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3616, Order: 163491, Start Time: 2012-09-10 08:47:40, End Time: 2012-09-10 10:07:34 To: 3612, Order: 163489, Start Time: 2012-09-10 06:57:27, End Time: 2012-09-10 08:19:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (134 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.15% (1.2353 => 1.2211, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.99% (10.3673 => 14.2017, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 25.46% (0.1622 => 0.2035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.98% (2.2022 => 2.5101, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3543 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.77% (0.3516 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.76% (0.3561 => 0.4051, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.75% (0.3497 => 0.3978, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.67% (7.0540 => 8.0183, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 13.26% (0.3694 => 0.4184, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3828 => 0.4324, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3927 => 0.4432, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.71% (0.3886 => 0.4380, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.51% (1.1194 => 1.2594, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.52% (1.7609 => 1.9637, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.78% (0.3282 => 0.3603, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.21% (0.8172 => 0.8925, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.92% (0.1625 => 0.1770, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 7.67% (0.1695 => 0.1825, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 7.33% (9.4845 => 10.1795, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.19% (0.4879 => 0.5230, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.07% (0.7835 => 0.8389, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 7.00% (10.4361 => 11.1667, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.96% (0.2700 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1510 => 0.1612, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 6.75% (0.3109 => 0.3319, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.70% (0.7433 => 0.7931, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.70% (0.3121 => 0.3330, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 6.66% (0.3423 => 0.3651, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7326 => 0.7813, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.56% (8.1363 => 8.6702, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: 6.54% (0.7115 => 0.7580, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (4.2646 => 4.5398, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.44% (0.1940 => 0.2065, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.5860 => 0.6236, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.36% (1.5415 => 1.6396, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.35% (1.3050 => 1.3879, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.30% (4.9449 => 5.2563, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.29% (5.0018 => 5.3164, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5569 => 0.5918, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2758 => 0.2929, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 6.19% (3.3354 => 3.5417, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.11% (0.6675 => 0.7083, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.84% (0.3817 => 0.4040, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.83% (5.7591 => 6.0950, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 5.82% (0.4299 => 0.4549, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.74% (0.8067 => 0.8530, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.57% (0.9765 => 1.0309, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.49% (0.2603 => 0.2746, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.42% (1.1642 => 1.2273, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1861 => 1.2491, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.24% (0.4103 => 0.4318, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.17% (0.3441 => 0.3619, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 5.11% (1.5603 => 1.6400, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.10% (0.5020 => 0.5276, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.05% (1.0722 => 1.1263, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 5.03% (3.8723 => 4.0671, std. dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (7.9617 => 8.3571, std. dev.: 0.0145) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4636 => 0.4861, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6450 => 0.6761, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.74% (2.0273 => 2.1233, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.5981 => 0.6249, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.42% (0.8921 => 0.9315, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3826 => 0.3993, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.32% (0.3422 => 0.3570, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.32% (21.9371 => 22.8849, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 4.31% (0.6456 => 0.6734, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.30% (0.3136 => 0.3271, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.25% (2.2969 => 2.3946, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.4186 => 1.4778, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3865 => 0.4021, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (14.3668 => 14.9190, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5859 => 1.6466, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3650 => 0.3789, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4203 => 0.4357, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4620 => 0.4783, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3603 => 0.3730, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.52% (0.3098 => 0.3207, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0665 => 2.1389, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.2024 => 2.2779, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.4048 => 0.4186, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.20% (0.3283 => 0.3388, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.13% (1.1840 => 1.2211, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.8101 => 0.8291, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.2842 => 1.3113, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.8922 => 3.9324, std. dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3843, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2159, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.15% (4.2280 => 4.3613, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.32% (0.9540 => 0.9666, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2254, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5827, std. dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7621, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.59% (5.2763 => 3.2402, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.89% (5.3855 => 3.8836, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.52% (5.3526 => 3.8797, std. dev.: 0.0087) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2057, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.74% (2.9384 => 2.5934, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -8.01% (22.1758 => 20.4000, std. dev.: 0.0298) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2839, std. dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8046, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std. dev.: 0.0021) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5081, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4299, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0115, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -1.97% (1.2373 => 1.2129, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.94% (4.6441 => 4.5539, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0059, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.34% (6.2999 => 6.2156, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 03:48:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 05:48:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910104848.DB78F2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3617?compare_to=3613&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3617, Order: 163497, Start Time: 2012-09-10 09:39:12, End Time: 2012-09-10 10:50:04 To: 3613, Order: 163491, Start Time: 2012-09-10 08:11:54, End Time: 2012-09-10 09:22:53 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (54 on baseline) Performance Improvements: 0 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (806 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.67% (0.1873 => 0.1998, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.21% (1.2140 => 1.2408, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.2283 => 4.2995, std. dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (0.8601 => 0.8709, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.12% (3.0688 => 3.1032, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 4.55% (0.2484 => 0.2597, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (0.3329 => 0.3449, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (2.5829 => 2.6403, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.56% (1.3533 => 1.3744, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (60.0335 => 60.9503, std. dev.: 0.2025) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.11% (1.2791 => 1.2933, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.07% (1.4137 => 1.4288, std. dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.76% (0.6410 => 0.6779, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.44% (0.3582 => 0.3777, std. dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (2.1763 => 2.2692, std. dev.: 0.0270) MultiSource/Benchmarks/McCat/18-imp/imp: 3.95% (0.3217 => 0.3344, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 3.91% (1.0046 => 1.0439, std. dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (1.1653 => 1.2086, std. dev.: 0.0121) MultiSource/Applications/minisat/minisat: 3.55% (0.6173 => 0.6392, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.5150 => 1.5643, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.22% (1.2021 => 1.2408, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.67% (3.0225 => 3.1032, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (12.6413 => 12.8952, std. dev.: 0.0940) MultiSource/Applications/kimwitu++/kc: 1.81% (15.3105 => 15.5877, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.68% (0.6069 => 0.6171, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.63% (0.8569 => 0.8709, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (4.0318 => 4.0946, std. dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.48% (0.7639 => 0.7752, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.4408 => 1.4589, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.0689 => 1.0812, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9984, std. dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.22% (4.0101 => 4.5403, std. dev.: 0.0269) SingleSource/Benchmarks/McGill/misr: 13.22% (0.4296 => 0.4864, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 12.73% (0.3746 => 0.4223, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.68% (3.4406 => 3.8767, std. dev.: 0.0021) SingleSource/Benchmarks/Stanford/Puzzle: 12.63% (0.1433 => 0.1614, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.73% (7.0025 => 7.6141, std. dev.: 0.0154) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.41% (1.0063 => 1.0909, std. dev.: 0.0125) SingleSource/Benchmarks/McGill/chomp: 7.56% (1.0194 => 1.0965, std. dev.: 0.0134) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8121, std. dev.: 0.0670) SingleSource/Benchmarks/Shootout-C++/hash2: 5.77% (3.4876 => 3.6889, std. dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.08% (40.4792 => 42.5349, std. dev.: 0.4529) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (0.3301 => 0.3449, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 4.46% (15.2242 => 15.9030, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/dt: 4.27% (0.9851 => 1.0272, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std. dev.: 0.0229) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.83% (0.5587 => 0.5745, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.66% (2.6656 => 2.7364, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: 2.56% (8.5113 => 8.7291, std. dev.: 0.0622) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.35% (0.5876 => 0.6014, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 2.12% (5.1938 => 5.3037, std. dev.: 0.0300) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.09% (2.3580 => 2.4072, std. dev.: 0.0123) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2726 => 1.2933, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (2.5984 => 2.6403, std. dev.: 0.0161) MultiSource/Benchmarks/Olden/bh/bh: 1.58% (2.5166 => 2.5564, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5340, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.45% (3.5520 => 3.6036, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.41% (4.6127 => 4.6777, std. dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 1.33% (14.4877 => 14.6809, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/ffbench: 1.21% (1.4117 => 1.4288, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.97% (5.2665 => 4.1097, std. dev.: 0.0606) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9918, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/sieve: -12.30% (8.1594 => 7.1556, std. dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.22% (1.4034 => 1.2881, std. dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9437, std. dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.98% (3.6254 => 3.3725, std. dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: -6.38% (3.4230 => 3.2047, std. dev.: 0.0401) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3522, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4069, std. dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.21% (1.7361 => 1.6630, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/methcall: -3.18% (9.2503 => 8.9564, std. dev.: 0.0420) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std. dev.: 0.0042) MultiSource/Applications/aha/aha: -2.85% (3.4286 => 3.3308, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.61% (3.7496 => 3.6519, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.37% (2.4457 => 2.3878, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.35% (1.1683 => 1.1408, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -2.34% (62.4126 => 60.9503, std. dev.: 0.2025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.98% (1.4021 => 1.3744, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2296, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7648, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3119, std. dev.: 0.0214) MultiSource/Benchmarks/sim/sim: -1.31% (3.8907 => 3.8397, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/tsp/tsp: -1.16% (1.7330 => 1.7129, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists: -1.03% (16.5617 => 16.3916, std. dev.: 0.0430) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 04:39:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 06:39:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910113919.D46F52A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3618?compare_to=3615&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3618, Order: 163497, Start Time: 2012-09-10 10:26:03, End Time: 2012-09-10 11:40:33 To: 3615, Order: 163491, Start Time: 2012-09-10 08:42:04, End Time: 2012-09-10 09:56:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.4294 => 56.3904, std. dev.: 0.1082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.03% (34.4213 => 34.0669, std. dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.26% (2.0176 => 2.4061, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.68% (0.7061 => 0.7815, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.66% (0.5818 => 0.6438, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.52% (0.7710 => 0.8521, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.08% (0.1588 => 0.1748, std. dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.06% (3.9660 => 4.3649, std. dev.: 0.0100) SingleSource/UnitTests/ObjC/trivial-interface: 10.03% (0.3578 => 0.3937, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.90% (0.3646 => 0.4007, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3601 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3663 => 0.4021, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.73% (0.3650 => 0.4005, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.72% (0.3623 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.71% (0.3789 => 0.4157, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.64% (1.3693 => 1.5013, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.57% (0.4003 => 0.4386, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.51% (0.2596 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 9.42% (0.3940 => 0.4311, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.31% (0.5265 => 0.5755, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.95% (0.9199 => 1.0022, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.93% (1.2193 => 1.3282, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.78% (0.6959 => 0.7570, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.72% (1.4563 => 1.5833, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.46% (1.1364 => 1.2325, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.27% (0.4328 => 0.4686, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 8.18% (0.1589 => 0.1719, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.14% (0.5577 => 0.6031, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 8.03% (13.8202 => 14.9300, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.02% (0.4379 => 0.4730, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.93% (0.7506 => 0.8101, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (7.2180 => 7.7850, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3246 => 0.3495, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3899 => 0.4198, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 7.66% (1.0313 => 1.1103, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.6283 => 0.6764, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.58% (0.4062 => 0.4370, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.31% (3.6692 => 3.9374, std. dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 7.30% (1.1061 => 1.1868, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.22% (0.8310 => 0.8910, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (1.9828 => 2.1241, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.11% (0.3756 => 0.4023, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.05% (0.3293 => 0.3525, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 7.01% (3.8646 => 4.1356, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.2937 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.84% (1.3245 => 1.4151, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.7460 => 0.7959, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3107 => 0.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.52% (1.9270 => 2.0526, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 6.51% (2.1791 => 2.3209, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.50% (0.8818 => 0.9391, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3192 => 0.3399, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.43% (3.1889 => 3.3941, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (1.2749 => 1.3563, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.37% (0.3534 => 0.3759, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (1.3813 => 1.4689, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.34% (0.6135 => 0.6524, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (1.3819 => 1.4686, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.24% (4.3801 => 4.6536, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 6.24% (1.0594 => 1.1255, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.20% (0.6744 => 0.7162, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.14% (4.4433 => 4.7160, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.09% (14.8535 => 15.7578, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (8.4961 => 8.9988, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1974, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.65% (0.3131 => 0.3308, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.63% (16.6129 => 17.5480, std. dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (13.2842 => 14.0225, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.32% (14.5298 => 15.3025, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (6.5754 => 6.9199, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.19% (0.6576 => 0.6917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3755 => 0.3948, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.91% (3.2742 => 3.4348, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.81% (0.3245 => 0.3401, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.75% (4.6629 => 4.8844, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 4.57% (1.2292 => 1.2854, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.47% (0.4805 => 0.5020, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.40% (0.9108 => 0.9509, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.12% (1.5188 => 1.5814, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.89% (3.7467 => 3.8926, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.6250 => 0.6486, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (6.2785 => 6.5148, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.65% (2.1007 => 2.1774, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (4.9865 => 5.1610, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.32% (33.2944 => 34.0669, std. dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4789, std. dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4166, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7330, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0702, std. dev.: 0.0407) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.5184 => 0.5337, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6059, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.30% (7.9275 => 8.0306, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6000, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.83% (0.4657 => 0.4013, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.34% (0.2670 => 0.2554, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.89% (22.5627 => 21.6861, std. dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2692, std. dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0005) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1516, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7054, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9220, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5891, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2378, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5204, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2417, std. dev.: 0.0311) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2256, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2604, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 04:54:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 06:54:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910115440.74DC6352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3619?compare_to=3616&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3619, Order: 163497, Start Time: 2012-09-10 10:36:06, End Time: 2012-09-10 11:55:55 To: 3616, Order: 163491, Start Time: 2012-09-10 08:47:40, End Time: 2012-09-10 10:07:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (134 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (14.2017 => 14.5051, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.6515 => 56.4719, std. dev.: 0.1411) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.91% (10.3673 => 14.5051, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 26.76% (0.1622 => 0.2056, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.32% (2.2022 => 2.5175, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.66% (7.0540 => 8.0178, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3473 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.24% (0.3497 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.17% (0.3516 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.15% (0.3543 => 0.4009, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3561 => 0.4029, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.12% (0.3543 => 0.4008, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3694 => 0.4161, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3828 => 0.4308, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.22% (0.3886 => 0.4361, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.15% (1.1194 => 1.2554, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (1.7609 => 1.9519, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 9.51% (0.3282 => 0.3594, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.95% (0.8172 => 0.8903, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5925 => 0.6395, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 7.74% (0.6030 => 0.6497, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.73% (0.1695 => 0.1826, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.51% (10.4361 => 11.2201, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 7.31% (9.4845 => 10.1777, std. dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.4879 => 0.5229, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.89% (0.7326 => 0.7831, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.85% (0.2700 => 0.2885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (8.1363 => 8.6828, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7433 => 0.7932, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.60% (0.3423 => 0.3649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.48% (0.5860 => 0.6240, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.46% (4.2646 => 4.5399, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.45% (0.2107 => 0.2243, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.44% (0.7115 => 0.7573, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.34% (1.5415 => 1.6393, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.34% (5.0018 => 5.3190, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.27% (4.9449 => 5.2547, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (1.3050 => 1.3867, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.25% (0.7835 => 0.8325, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.21% (0.5105 => 0.5422, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.16% (0.5569 => 0.5912, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.14% (3.3354 => 3.5401, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.93% (5.7591 => 6.1004, std. dev.: 0.0216) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.74% (0.8067 => 0.8530, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.4299 => 0.4542, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.62% (0.9765 => 1.0314, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.47% (1.5603 => 1.6456, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 5.39% (1.1642 => 1.2269, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (1.1861 => 1.2494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.32% (0.3817 => 0.4020, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.23% (0.3387 => 0.3564, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 5.06% (3.8723 => 4.0683, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5020 => 0.5273, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.04% (1.0722 => 1.1262, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1239, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.75% (7.9617 => 8.3397, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.64% (0.6450 => 0.6749, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.63% (0.3826 => 0.4003, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.56% (0.4103 => 0.4290, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.5981 => 0.6249, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8921 => 0.9316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.41% (0.3422 => 0.3573, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.38% (0.4636 => 0.4839, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.4064 => 0.4240, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6456 => 0.6735, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.31% (21.9371 => 22.8828, std. dev.: 0.0191) MultiSource/Applications/siod/siod: 4.28% (2.2969 => 2.3953, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.4186 => 1.4775, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.4289 => 0.4458, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.3650 => 0.3793, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (14.3668 => 14.9268, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.82% (0.2905 => 0.3016, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.80% (0.3603 => 0.3740, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.74% (0.4620 => 0.4793, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.72% (1.5859 => 1.6449, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3935 => 0.4079, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.3098 => 0.3211, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (2.0665 => 2.1411, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.56% (0.3684 => 0.3815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.41% (0.3283 => 0.3395, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.38% (0.3162 => 0.3269, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.1840 => 1.2227, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2737, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3379 => 0.3486, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.34% (1.2842 => 1.3142, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.8101 => 0.8283, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.15% (4.2280 => 4.3610, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7477, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2418, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5832, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7621, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.74% (5.2763 => 3.2322, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.08% (5.3855 => 3.8735, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.74% (5.3526 => 3.8677, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.2004, std. dev.: 0.0403) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.62% (2.9384 => 2.5969, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.04% (22.1758 => 20.3927, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (19.9488 => 18.2295, std. dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7153, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5769, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0011) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1497, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5113, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4227, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0016, std. dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9946, std. dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5544, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5082, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2365, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 05:55:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 07:55:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910125531.2F9F7352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3620?compare_to=3614&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3620, Order: 163497, Start Time: 2012-09-10 10:12:31, End Time: 2012-09-10 12:56:45 To: 3614, Order: 163489, Start Time: 2012-09-10 06:57:30, End Time: 2012-09-10 09:44:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 1.88% (16.2535 => 16.5592, std. dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.34% (0.3465 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.33% (0.3496 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.31% (0.3446 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.30% (0.3469 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.25% (0.3488 => 0.3985, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.73% (0.3650 => 0.4151, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5826 => 0.6288, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.91% (0.1619 => 0.1747, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.90% (0.5889 => 0.6354, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.1421 => 0.1525, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (1.6211 => 1.7356, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (3.5627 => 3.8098, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.77% (1.3152 => 1.4043, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.65% (1.5932 => 1.6991, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.61% (0.1968 => 0.2098, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (0.4361 => 0.4646, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.45% (0.4994 => 0.5316, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 6.37% (0.7171 => 0.7628, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.5900 => 0.6276, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.32% (0.5000 => 0.5316, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 6.11% (4.2109 => 4.4681, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (0.3930 => 0.4165, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.93% (0.4029 => 0.4268, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 5.92% (0.2566 => 0.2718, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.28% (1.0781 => 1.1350, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 5.14% (5.5417 => 5.8266, std. dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (2.7292 => 2.8686, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 5.03% (1.8794 => 1.9739, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (1.9966 => 2.0960, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.96% (0.4658 => 0.4889, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.96% (0.9909 => 1.0400, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.86% (0.3890 => 0.4079, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.83% (0.2875 => 0.3014, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.83% (1.9694 => 2.0645, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 4.73% (0.6634 => 0.6948, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.73% (0.3004 => 0.3146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3195 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.3903 => 0.4085, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.64% (2.1013 => 2.1989, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.64% (0.2738 => 0.2865, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3625 => 0.3793, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.59% (0.2725 => 0.2850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.55% (0.2813 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.54% (0.2729 => 0.2853, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (0.2691 => 0.2813, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0673 => 2.1595, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.3845 => 0.4015, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2750 => 0.2871, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.37% (0.3362 => 0.3509, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2780 => 0.2901, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.35% (2.1653 => 2.2594, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 4.30% (0.2811 => 0.2932, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.30% (1.4269 => 1.4882, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.3271 => 0.3411, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.22% (0.7875 => 0.8207, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 4.20% (0.3096 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3267 => 0.3404, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.16% (0.3317 => 0.3455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.14% (0.3258 => 0.3393, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.3477 => 0.3621, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3678 => 0.3829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3348 => 0.3485, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 4.09% (4.6177 => 4.8066, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.4139 => 0.4308, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (4.4195 => 4.5999, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3726 => 0.3878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3124 => 0.3250, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.2969 => 0.3088, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.87% (0.9697 => 1.0072, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4251 => 0.4413, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.81% (0.3336 => 0.3463, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.74% (0.3690 => 0.3828, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4146 => 0.4299, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.3981 => 0.4126, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.54% (23.5202 => 24.3528, std. dev.: 0.0343) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.6435 => 0.6649, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.17% (0.5012 => 0.5171, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.52% (2.0346 => 2.0858, std. dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (0.4847 => 0.4961, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (0.7426 => 0.7586, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (11.6398 => 11.8361, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (4.6926 => 4.7514, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6708, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6347, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2008, std. dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5037, std. dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.72% (2.0820 => 2.1179, std. dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4319, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2807, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5988, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5592, std. dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7965, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.67% (0.6293 => 0.6125, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -2.47% (17.2379 => 16.8123, std. dev.: 0.0442) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9592, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 06:21:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 08:21:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910132148.CD812352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3621?compare_to=3618&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3621, Order: 163501, Start Time: 2012-09-10 12:08:40, End Time: 2012-09-10 13:23:03 To: 3618, Order: 163497, Start Time: 2012-09-10 10:26:03, End Time: 2012-09-10 11:40:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.29% (2.0176 => 2.4068, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.38% (0.5748 => 0.6402, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.24% (0.7061 => 0.7855, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.48% (0.7710 => 0.8518, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.20% (0.3578 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.14% (3.9660 => 4.3681, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.08% (0.1588 => 0.1748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.07% (0.3646 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3663 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.00% (0.3601 => 0.3961, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.98% (1.3693 => 1.5060, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 9.91% (0.3623 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.81% (0.3650 => 0.4008, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3789 => 0.4159, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.75% (0.2596 => 0.2849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.67% (0.4003 => 0.4390, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.54% (0.3940 => 0.4316, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.46% (0.5265 => 0.5763, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.21% (0.7038 => 0.7686, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.08% (0.6959 => 0.7591, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.03% (1.2193 => 1.3294, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.00% (0.9199 => 1.0027, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.61% (1.4563 => 1.5817, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.51% (1.1364 => 1.2331, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.31% (0.1589 => 0.1721, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.28% (0.5577 => 0.6039, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.27% (0.2127 => 0.2303, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.15% (0.4379 => 0.4736, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.08% (0.3899 => 0.4214, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.05% (13.8202 => 14.9321, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (7.2180 => 7.7935, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.91% (0.2995 => 0.3232, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.90% (0.7506 => 0.8099, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.89% (0.3246 => 0.3502, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.85% (0.2243 => 0.2419, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.80% (0.6283 => 0.6773, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.71% (1.0313 => 1.1108, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.60% (0.4791 => 0.5155, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.52% (0.3485 => 0.3747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.49% (0.5637 => 0.6059, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.49% (1.1061 => 1.1889, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 7.47% (0.3293 => 0.3539, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (0.1657 => 0.1780, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.40% (0.3756 => 0.4034, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.39% (0.3489 => 0.3747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (1.9828 => 2.1294, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.38% (3.8646 => 4.1500, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.37% (3.6692 => 3.9398, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.32% (0.8310 => 0.8918, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.3220 => 0.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 7.17% (0.4113 => 0.4408, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.96% (1.3245 => 1.4167, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.86% (0.7460 => 0.7972, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3534 => 0.3770, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.63% (1.9270 => 2.0548, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 6.55% (2.1791 => 2.3218, std. dev.: 0.0157) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3970, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.37% (0.6135 => 0.6526, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.36% (1.0594 => 1.1268, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.36% (0.6744 => 0.7173, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.32% (4.3801 => 4.6568, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (4.4433 => 4.7239, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (1.3813 => 1.4678, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 6.26% (0.2859 => 0.3038, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.26% (1.3819 => 1.4684, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (1.2749 => 1.3545, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.24% (0.8818 => 0.9368, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.20% (14.8535 => 15.7742, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2140 => 0.2271, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.07% (8.4961 => 9.0117, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.89% (0.8698 => 0.9210, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.84% (16.6129 => 17.5832, std. dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.1333 => 1.1984, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (13.2842 => 14.0469, std. dev.: 0.0163) MultiSource/Benchmarks/sim/sim: 5.72% (0.3131 => 0.3310, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.59% (0.2504 => 0.2644, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.37% (14.5298 => 15.3102, std. dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 5.33% (6.5754 => 6.9259, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.97% (3.2742 => 3.4369, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2292 => 1.2887, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 4.74% (4.6629 => 4.8838, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.4805 => 0.5028, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.64% (0.6576 => 0.6881, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.50% (0.9108 => 0.9518, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (1.5188 => 1.5828, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.01% (3.7467 => 3.8968, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6250 => 0.6493, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.84% (6.2785 => 6.5196, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1757, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.1007 => 2.1786, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.76% (33.2944 => 34.2133, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4925, std. dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2621, std. dev.: 0.0520) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4135, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.88% (1.2998 => 1.3762, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0792, std. dev.: 0.0408) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5933, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.21% (7.9275 => 8.0231, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5745, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5899, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.68% (0.4657 => 0.4020, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.27% (0.2670 => 0.2556, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.7003, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3018, std. dev.: 0.0369) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.54% (1.3780 => 1.3016, std. dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9241, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5834, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2415, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9919, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5197, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2450, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4349, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2624, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2422, std. dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 06:42:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 08:42:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910134233.137FD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3622?compare_to=3619&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3622, Order: 163501, Start Time: 2012-09-10 12:24:09, End Time: 2012-09-10 13:43:48 To: 3619, Order: 163497, Start Time: 2012-09-10 10:36:06, End Time: 2012-09-10 11:55:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (140 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (14.5051 => 14.6735, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.97% (56.4719 => 54.7948, std. dev.: 0.0584) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.54% (10.3673 => 14.6735, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.89% (2.2022 => 2.5301, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.73% (0.3543 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.68% (0.3473 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.38% (0.3497 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3543 => 0.4050, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.22% (7.0540 => 8.0568, std. dev.: 0.0140) SingleSource/UnitTests/ObjC/exceptions-3: 14.14% (0.3516 => 0.4013, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3561 => 0.4062, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.72% (0.3694 => 0.4201, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3927 => 0.4452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.32% (0.3828 => 0.4338, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.23% (0.3886 => 0.4400, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.39% (1.1194 => 1.2581, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.55% (1.7609 => 1.9643, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 9.78% (0.3282 => 0.3603, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5925 => 0.6485, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.25% (0.8172 => 0.8928, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 9.24% (0.6030 => 0.6587, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.40% (0.1440 => 0.1561, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 8.08% (0.7326 => 0.7918, std. dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 7.75% (10.4361 => 11.2450, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 7.73% (0.1695 => 0.1826, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.54% (9.4845 => 10.1999, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.48% (0.4879 => 0.5244, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.20% (0.2554 => 0.2738, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4615 => 0.4947, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.11% (0.1940 => 0.2078, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.09% (0.2271 => 0.2432, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (8.1363 => 8.6980, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.74% (0.7433 => 0.7934, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 6.69% (0.7115 => 0.7591, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 6.66% (0.3109 => 0.3316, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 6.63% (0.3423 => 0.3650, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.60% (0.2107 => 0.2246, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.50% (4.2646 => 4.5419, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 6.48% (0.7835 => 0.8343, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.5860 => 0.6239, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.43% (5.0018 => 5.3232, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.40% (4.9449 => 5.2615, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.35% (0.5105 => 0.5429, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.29% (0.3817 => 0.4057, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.5569 => 0.5919, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (1.5415 => 1.6382, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.6675 => 0.7091, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 6.21% (3.3354 => 3.5424, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.20% (1.3050 => 1.3859, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 6.10% (5.7591 => 6.1106, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.93% (0.4299 => 0.4554, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.3180 => 0.3366, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.77% (0.9765 => 1.0328, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.8067 => 0.8526, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.46% (1.5603 => 1.6455, std. dev.: 0.0063) MultiSource/Applications/Burg/burg: 5.45% (1.1642 => 1.2276, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.40% (1.1861 => 1.2501, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.32% (0.5020 => 0.5287, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.26% (0.2603 => 0.2740, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 5.17% (3.8723 => 4.0726, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.08% (1.0722 => 1.1267, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.08% (7.9617 => 8.3662, std. dev.: 0.0087) MultiSource/Benchmarks/sim/sim: 5.05% (0.3387 => 0.3558, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4636 => 0.4865, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6450 => 0.6767, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.4103 => 0.4303, std. dev.: 0.0057) MultiSource/Applications/treecc/treecc: 4.84% (2.0273 => 2.1255, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (0.4064 => 0.4257, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.70% (0.3422 => 0.3583, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.60% (0.6456 => 0.6753, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.53% (0.5981 => 0.6252, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.49% (21.9371 => 22.9224, std. dev.: 0.0187) SingleSource/Regression/C++/ofstream_ctor: 4.44% (0.2905 => 0.3034, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.44% (0.8921 => 0.9317, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4289 => 0.4474, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.31% (0.3826 => 0.3991, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 4.28% (2.2969 => 2.3952, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.25% (0.2891 => 0.3014, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.20% (1.4186 => 1.4782, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.17% (0.3865 => 0.4026, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3650 => 0.3802, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.4203 => 0.4376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.3136 => 0.3264, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.00% (0.3098 => 0.3222, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0665 => 2.1492, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (14.3668 => 14.9349, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.4048 => 0.4205, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.83% (0.3603 => 0.3741, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4620 => 0.4796, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6463, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3232 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.75% (0.3684 => 0.3822, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.72% (0.2877 => 0.2984, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.69% (0.3283 => 0.3404, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.2024 => 2.2784, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: 3.34% (0.3379 => 0.3492, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.1840 => 1.2232, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.72% (1.2842 => 1.3191, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.8101 => 0.8293, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3842, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (4.2280 => 4.3703, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2236, std. dev.: 0.0111) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5769, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.83% (5.2763 => 3.2275, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.62% (5.3855 => 3.8981, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.21% (5.3526 => 3.8960, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1671, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.71% (2.9384 => 2.5944, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -7.84% (22.1758 => 20.4367, std. dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2890, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std. dev.: 0.0015) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1497, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5109, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4171, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9821, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.04% (1.2373 => 1.2121, std. dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9945, std. dev.: 0.0215) MultiSource/Applications/sqlite3/sqlite3: -1.97% (4.6441 => 4.5525, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2306, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 06:49:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 08:49:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910134900.80F10352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3623?compare_to=3617&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3623, Order: 163506, Start Time: 2012-09-10 12:38:07, End Time: 2012-09-10 13:50:16 To: 3617, Order: 163497, Start Time: 2012-09-10 09:39:12, End Time: 2012-09-10 10:50:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (51 on baseline) Performance Improvements: 2 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.56% (44.1397 => 45.2675, std. dev.: 0.2511) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (4.3793 => 4.4470, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.27% (1.6630 => 1.6842, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.07% (1.6080 => 1.6252, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/five11/five11: 1.02% (5.3037 => 5.3578, std. dev.: 0.0181) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.51% (1.2408 => 1.2221, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.33% (2.4072 => 2.2790, std. dev.: 0.0487) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.51% (0.6410 => 0.6763, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3582 => 0.3736, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3.88% (1.1653 => 1.2105, std. dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: 3.85% (2.1763 => 2.2601, std. dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (0.7639 => 0.7914, std. dev.: 0.0071) MultiSource/Applications/lemon/lemon: 3.33% (1.0046 => 1.0381, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.21% (1.5150 => 1.5636, std. dev.: 0.0130) MultiSource/Applications/d/make_dparser: 2.13% (3.0225 => 3.0869, std. dev.: 0.0130) MultiSource/Applications/SPASS/SPASS: 2.02% (13.3238 => 13.5924, std. dev.: 0.0651) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.66% (1.2021 => 1.2221, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 1.52% (1.8798 => 1.9083, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (4.0318 => 4.0880, std. dev.: 0.0212) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (6.2546 => 6.3376, std. dev.: 0.0270) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3397, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2291, std. dev.: 0.0282) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.0766 => 0.0903, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.45% (0.0917 => 0.1077, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std. dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.41% (4.0101 => 4.5480, std. dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/sieve: 12.81% (3.4406 => 3.8813, std. dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 12.49% (0.1433 => 0.1612, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: 12.36% (0.4296 => 0.4827, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.56% (0.2857 => 0.3130, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6180, std. dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.76% (0.3301 => 0.3557, std. dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: 7.64% (1.0194 => 1.0973, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.58% (1.0063 => 1.0826, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.78% (40.4792 => 43.2217, std. dev.: 0.3370) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (3.4876 => 3.7012, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8126, std. dev.: 0.0435) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (4.2129 => 4.4470, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.14% (0.7609 => 0.7924, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8505, std. dev.: 0.0438) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5369, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (6.6312 => 6.8744, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.56% (2.6656 => 2.7605, std. dev.: 0.0190) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 3.16% (5.1938 => 5.3578, std. dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.03% (0.5876 => 0.6054, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 2.68% (8.5113 => 8.7396, std. dev.: 0.0614) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (2.4455 => 2.4899, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.64% (4.6127 => 4.6882, std. dev.: 0.0246) MultiSource/Applications/siod/siod: 1.62% (3.5520 => 3.6096, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5340, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 1.46% (14.4877 => 14.6991, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 1.22% (4.6414 => 4.6982, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.14% (4.0659 => 4.1123, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.21% (5.2665 => 4.1493, std. dev.: 0.1190) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.94% (1.1647 => 0.9907, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1648, std. dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9404, std. dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.03% (3.6254 => 3.3706, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -6.96% (3.4230 => 3.1846, std. dev.: 0.0277) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3549, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.91% (2.9728 => 2.7971, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4067, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.51% (3.9413 => 3.7636, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/methcall: -4.08% (9.2503 => 8.8731, std. dev.: 0.0475) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.69% (2.4457 => 2.3554, std. dev.: 0.0195) MultiSource/Benchmarks/mafft/pairlocalalign: -3.19% (62.4126 => 60.4190, std. dev.: 0.3419) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.99% (1.7361 => 1.6842, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.90% (0.4140 => 0.4020, std. dev.: 0.0033) MultiSource/Applications/aha/aha: -2.80% (3.4286 => 3.3325, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std. dev.: 0.0599) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.56% (1.4021 => 1.3662, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.44% (1.1683 => 1.1398, std. dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -2.38% (92.7467 => 90.5357, std. dev.: 0.3327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.37% (3.7496 => 3.6606, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2234, std. dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7674, std. dev.: 0.0195) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3210, std. dev.: 0.0296) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 08:06:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 10:06:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910150633.D735C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3624?compare_to=3621&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3624, Order: 163509, Start Time: 2012-09-10 13:53:27, End Time: 2012-09-10 15:07:48 To: 3621, Order: 163501, Start Time: 2012-09-10 12:08:40, End Time: 2012-09-10 13:23:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.12% (2.0176 => 2.4034, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.58% (0.7061 => 0.7879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.53% (0.5748 => 0.6411, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.51% (0.7710 => 0.8520, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3578 => 0.3951, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3623 => 0.3994, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.22% (0.3601 => 0.3969, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 10.20% (0.3646 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.07% (0.3663 => 0.4032, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.07% (0.3914 => 0.4308, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3650 => 0.4016, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.98% (0.3789 => 0.4167, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.80% (0.3940 => 0.4326, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.80% (3.9660 => 4.3545, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: 9.77% (0.4003 => 0.4394, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.76% (0.1588 => 0.1743, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.48% (0.2596 => 0.2842, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.46% (1.3693 => 1.4989, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.80% (1.2193 => 1.3266, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.77% (0.9199 => 1.0006, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 8.77% (0.7038 => 0.7655, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.72% (0.6959 => 0.7566, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.4563 => 1.5796, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.42% (1.1364 => 1.2321, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.07% (0.5577 => 0.6027, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.00% (0.4062 => 0.4387, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (7.2180 => 7.7827, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.78% (13.8202 => 14.8956, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.76% (0.4379 => 0.4719, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.65% (0.7506 => 0.8080, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.6283 => 0.6761, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3246 => 0.3490, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.52% (0.2914 => 0.3133, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.50% (0.3293 => 0.3540, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3489 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3022 => 0.3247, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.43% (0.3580 => 0.3846, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.42% (1.0313 => 1.1078, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.41% (1.9828 => 2.1298, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.40% (0.3756 => 0.4034, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.11% (0.2925 => 0.3133, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.07% (3.6692 => 3.9286, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 7.06% (1.1061 => 1.1842, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 7.05% (0.3220 => 0.3447, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2023 => 0.2165, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.88% (0.8310 => 0.8882, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.88% (3.8646 => 4.1305, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3534 => 0.3772, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3453 => 0.3685, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.70% (0.3192 => 0.3406, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.4390 => 0.4681, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.3245 => 1.4107, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (0.7460 => 0.7942, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4113 => 0.4378, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.38% (3.1889 => 3.3923, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.36% (1.9270 => 2.0496, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 6.17% (2.1791 => 2.3136, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 6.12% (0.2859 => 0.3034, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.12% (1.0594 => 1.1242, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.07% (4.3801 => 4.6461, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.03% (4.4433 => 4.7113, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (1.2749 => 1.3507, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.93% (0.6135 => 0.6499, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (1.3819 => 1.4633, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4620, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.84% (0.8818 => 0.9333, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.77% (14.8535 => 15.7111, std. dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 5.67% (8.4961 => 8.9782, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 5.60% (16.6129 => 17.5429, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.59% (0.8698 => 0.9184, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (1.1333 => 1.1959, std. dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.40% (13.2842 => 14.0022, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.19% (14.5298 => 15.2833, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.02% (6.5754 => 6.9052, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.96% (0.3245 => 0.3406, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.74% (1.2292 => 1.2875, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.42% (3.2742 => 3.4188, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 4.39% (4.6629 => 4.8674, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.26% (0.6576 => 0.6856, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.96% (0.9108 => 0.9469, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5781, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.79% (3.7467 => 3.8887, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1719, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.6250 => 0.6482, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.55% (6.2785 => 6.5011, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.44% (2.1007 => 2.1730, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.61% (33.2944 => 34.1647, std. dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4678, std. dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.88% (1.8175 => 2.2697, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.54% (1.1560 => 1.2547, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7325, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.12% (10.7476 => 11.0827, std. dev.: 0.0251) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5949, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5869, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.44% (0.4657 => 0.4031, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.06% (22.5627 => 21.6473, std. dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2659, std. dev.: 0.0245) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.03% (1.3780 => 1.2949, std. dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5158, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1516, std. dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9245, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.41% (8.8259 => 8.6129, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2492, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5208, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2424, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2276, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2606, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 08:16:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 10:16:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910151606.DE206352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3625?compare_to=3623&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3625, Order: 163510, Start Time: 2012-09-10 14:05:52, End Time: 2012-09-10 15:17:23 To: 3623, Order: 163506, Start Time: 2012-09-10 12:38:07, End Time: 2012-09-10 13:50:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (42 on baseline) Performance Improvements: 3 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (814 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.16% (15.2584 => 16.8089, std. dev.: 0.1804) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (60.4190 => 61.2902, std. dev.: 0.1928) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.42% (2.9404 => 2.9821, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/whetstone: 1.20% (2.3723 => 2.4008, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.69% (0.7914 => 0.7780, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.22% (1.2784 => 1.2372, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: -1.09% (16.5603 => 16.3800, std. dev.: 0.0488) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.51% (0.6410 => 0.6763, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.75% (0.3582 => 0.3752, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.44% (2.1763 => 2.2512, std. dev.: 0.0120) MultiSource/Applications/minisat/minisat: 3.37% (0.6173 => 0.6381, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.21% (3.0225 => 3.0892, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.7639 => 0.7780, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.62% (13.3238 => 13.5394, std. dev.: 0.0834) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0017, std. dev.: 0.0358) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.43% (4.0101 => 4.5889, std. dev.: 0.0473) SingleSource/Benchmarks/Stanford/Puzzle: 12.98% (0.1433 => 0.1619, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 12.70% (3.4406 => 3.8777, std. dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 11.72% (0.3746 => 0.4185, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: 11.24% (0.4296 => 0.4779, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6223, std. dev.: 0.0530) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.84% (0.2857 => 0.3081, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.28% (40.4792 => 43.4249, std. dev.: 0.1330) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (0.3301 => 0.3536, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 6.76% (1.0194 => 1.0883, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 6.29% (3.4876 => 3.7069, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (15.8312 => 16.8089, std. dev.: 0.1804) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8080, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8470, std. dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5422, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8731, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.64% (4.2129 => 4.3661, std. dev.: 0.0474) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.28% (0.5876 => 0.6069, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 2.92% (5.1938 => 5.3453, std. dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 2.85% (8.5113 => 8.7538, std. dev.: 0.0429) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.70% (2.6656 => 2.7377, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/whetstone: 2.37% (2.3453 => 2.4008, std. dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7147, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6086, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4455 => 2.4820, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.42% (4.0659 => 4.1237, std. dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.95% (5.2665 => 4.1104, std. dev.: 0.0464) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.77% (1.1647 => 0.9927, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout/sieve: -12.06% (8.1594 => 7.1750, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.23% (3.6254 => 3.3632, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.83% (3.2007 => 2.9821, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -6.44% (1.4441 => 1.3511, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: -6.25% (3.4230 => 3.2092, std. dev.: 0.0270) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.44% (2.4457 => 2.3127, std. dev.: 0.0419) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.98% (0.4140 => 0.3934, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (3.9413 => 3.7641, std. dev.: 0.0585) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6728, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -3.32% (9.2503 => 8.9429, std. dev.: 0.0266) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2839, std. dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.75% (1.2722 => 1.2372, std. dev.: 0.0043) MultiSource/Applications/aha/aha: -2.64% (3.4286 => 3.3382, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.45% (1.1683 => 1.1397, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.35% (3.7496 => 3.6613, std. dev.: 0.0126) MultiSource/Benchmarks/PAQ8p/paq8p: -2.24% (92.7467 => 90.6672, std. dev.: 0.7550) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.85% (1.4021 => 1.3762, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/neural/neural: -1.80% (1.0926 => 1.0729, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (62.4126 => 61.2902, std. dev.: 0.1928) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2257, std. dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.55% (1.8739 => 1.8448, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.50% (2.8964 => 2.8529, std. dev.: 0.0124) MultiSource/Benchmarks/sim/sim: -1.45% (3.8907 => 3.8342, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7660, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3133, std. dev.: 0.0862) SingleSource/Benchmarks/Shootout-C++/lists: -1.10% (16.5617 => 16.3800, std. dev.: 0.0488) MultiSource/Benchmarks/llubenchmark/llu: -1.01% (2.0192 => 1.9988, std. dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 08:30:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 10:30:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910153036.B8A13352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3626?compare_to=3622&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3626, Order: 163510, Start Time: 2012-09-10 14:12:18, End Time: 2012-09-10 15:31:52 To: 3622, Order: 163501, Start Time: 2012-09-10 12:24:09, End Time: 2012-09-10 13:43:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (140 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (14.6735 => 14.8429, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.79% (0.8928 => 0.8768, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.13% (2.5301 => 2.5015, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.17% (10.3673 => 14.8429, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 26.02% (0.1622 => 0.2044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.48% (0.3473 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3516 => 0.4017, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3561 => 0.4066, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.15% (0.3497 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3543 => 0.4043, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.03% (0.3543 => 0.4040, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.78% (0.3694 => 0.4203, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.59% (2.2022 => 2.5015, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.32% (0.3828 => 0.4338, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.24% (7.0540 => 7.9883, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 13.17% (0.3927 => 0.4444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.02% (0.3886 => 0.4392, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.45% (1.7609 => 1.9626, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7326 => 0.7961, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.58% (0.1940 => 0.2087, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.4879 => 0.5238, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.8172 => 0.8768, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.23% (10.4361 => 11.1904, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 7.01% (9.4845 => 10.1498, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.4615 => 0.4932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.80% (0.3307 => 0.3532, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (8.1363 => 8.6751, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.7433 => 0.7922, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.43% (0.3109 => 0.3309, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.35% (0.7115 => 0.7567, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (4.2646 => 4.5352, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3423 => 0.3640, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30% (0.5860 => 0.6229, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.3121 => 0.3316, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.24% (0.3817 => 0.4055, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.23% (0.7835 => 0.8323, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.17% (5.0018 => 5.3106, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.17% (4.9449 => 5.2500, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.05% (1.5415 => 1.6347, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.04% (0.6675 => 0.7078, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.03% (1.3050 => 1.3837, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.01% (0.5105 => 0.5412, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 5.98% (3.3354 => 3.5350, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.72% (0.3180 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.68% (0.4299 => 0.4543, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.67% (0.8067 => 0.8524, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.64% (5.7591 => 6.0838, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9765 => 1.0300, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.36% (1.5603 => 1.6440, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 5.29% (1.1642 => 1.2258, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1861 => 1.2478, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.09% (0.4636 => 0.4872, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.06% (0.3422 => 0.3595, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 5.00% (3.8723 => 4.0659, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.97% (0.4103 => 0.4307, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.5020 => 0.5267, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.4064 => 0.4263, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 4.82% (1.0722 => 1.1239, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (7.9617 => 8.3410, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.71% (0.6450 => 0.6754, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 4.69% (0.3387 => 0.3546, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.66% (0.3650 => 0.3820, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.63% (0.3826 => 0.4003, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.61% (0.3865 => 0.4043, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.58% (0.2905 => 0.3038, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.57% (0.6456 => 0.6751, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.52% (0.2831 => 0.2959, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.51% (2.0273 => 2.1187, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.43% (0.2891 => 0.3019, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8921 => 0.9311, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5981 => 0.6240, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.32% (2.0665 => 2.1557, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.26% (0.3098 => 0.3230, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.25% (0.2872 => 0.2994, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4203 => 0.4380, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2877 => 0.2997, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.16% (0.3052 => 0.3179, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.15% (2.2969 => 2.3922, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2756 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3232 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.11% (0.2871 => 0.2989, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.09% (21.9371 => 22.8339, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3684 => 0.3834, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4620 => 0.4808, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3603 => 0.3749, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.4048 => 0.4212, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4760, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 4.02% (0.3283 => 0.3415, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.94% (0.2793 => 0.2903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2802 => 0.2911, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (14.3668 => 14.9221, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (1.5859 => 1.6426, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.2024 => 2.2718, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.1840 => 1.2195, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.80% (1.2842 => 1.3202, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.8101 => 0.8282, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3852, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3727, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2259, std. dev.: 0.0109) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7605, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std. dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2308, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.12% (5.3855 => 3.8713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.74% (5.3526 => 3.8678, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1562, std. dev.: 0.0368) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.04% (2.9384 => 2.5846, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -8.18% (22.1758 => 20.3624, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2615, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5770, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8046, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std. dev.: 0.0016) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1498, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5053, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4165, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0083, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5545, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0040, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 09:07:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 11:07:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910160740.DA7BA352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3627?compare_to=3620&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3627, Order: 163508, Start Time: 2012-09-10 13:24:58, End Time: 2012-09-10 16:08:55 To: 3620, Order: 163497, Start Time: 2012-09-10 10:12:31, End Time: 2012-09-10 12:56:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.61% (71.5895 => 74.8914, std. dev.: 0.0285) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.19% (54.2390 => 54.8865, std. dev.: 0.0474) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.70% (0.3488 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.64% (0.3460 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.04% (0.3650 => 0.4126, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.96% (0.5826 => 0.6290, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.5889 => 0.6358, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.1619 => 0.1741, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.57% (3.5627 => 3.7968, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.50% (1.6211 => 1.7265, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 6.28% (0.7171 => 0.7621, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.25% (0.5026 => 0.5340, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.09% (0.4994 => 0.5298, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (1.3152 => 1.3930, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.2014 => 0.2133, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.86% (1.5932 => 1.6866, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.80% (0.3930 => 0.4158, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.80% (0.4361 => 0.4614, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 5.52% (4.2109 => 4.4432, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 5.49% (0.4029 => 0.4250, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (0.5000 => 0.5271, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.2866 => 0.3013, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.12% (0.2736 => 0.2876, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.98% (1.0781 => 1.1318, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.70% (5.5417 => 5.8020, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (2.7292 => 2.8564, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.2823 => 0.2952, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.56% (0.2566 => 0.2683, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.3004 => 0.3140, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.51% (0.9909 => 1.0356, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (1.9694 => 2.0576, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.45% (0.3890 => 0.4063, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.44% (0.3195 => 0.3337, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.37% (2.0673 => 2.1576, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.36% (1.9966 => 2.0836, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.3903 => 0.4073, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.29% (0.2729 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.26% (0.2911 => 0.3035, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.23% (0.2811 => 0.2930, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 4.21% (0.2780 => 0.2897, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.17% (2.1653 => 2.2557, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (0.3625 => 0.3775, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.12% (0.6634 => 0.6907, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3096 => 0.3223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3267 => 0.3401, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (2.1013 => 2.1871, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.00% (1.8794 => 1.9545, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.99% (0.3362 => 0.3496, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.4139 => 0.4302, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3258 => 0.3386, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3060 => 0.3180, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3317 => 0.3447, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.92% (0.3726 => 0.3872, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.87% (0.7875 => 0.8180, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 3.87% (1.4269 => 1.4821, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3282 => 0.3408, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3678 => 0.3819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3477 => 0.3610, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.80% (0.5546 => 0.5757, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (0.3348 => 0.3475, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 3.78% (0.9697 => 1.0064, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (4.4195 => 4.5838, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4146 => 0.4300, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 3.62% (4.6177 => 4.7848, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.55% (0.3690 => 0.3821, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.3084 => 0.3191, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3165, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.3845 => 0.3972, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.11% (0.6435 => 0.6635, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.91% (0.5012 => 0.5158, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.39% (2.0346 => 2.0833, std. dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (11.6398 => 11.7994, std. dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (4.6926 => 4.7450, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.2122 => 0.2248, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0985) SingleSource/Benchmarks/Misc/flops-2: 4.42% (1.8057 => 1.8856, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6517, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1988, std. dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5060, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.63% (2.0820 => 2.1159, std. dev.: 0.0091) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4453, std. dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5981, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4386, std. dev.: 0.0455) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5670, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7954, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std. dev.: 0.0022) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7815, std. dev.: 0.0519) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9669, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 09:42:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 11:42:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910164210.1466F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3628?compare_to=3625&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3628, Order: 163514, Start Time: 2012-09-10 15:32:48, End Time: 2012-09-10 16:43:26 To: 3625, Order: 163510, Start Time: 2012-09-10 14:05:52, End Time: 2012-09-10 15:17:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 23 (55 on baseline) Performance Improvements: 3 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 866 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.23% (0.0752 => 0.0859, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.66% (0.1306 => 0.1406, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.32% (0.5585 => 0.5938, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.82% (0.2157 => 0.2261, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.31% (0.2855 => 0.2978, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.10% (0.7687 => 0.8002, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.98% (0.4552 => 0.4733, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3018 => 0.3129, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.47% (0.7615 => 0.7879, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.8903 => 0.9196, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.00% (0.5471 => 0.5635, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.4110 => 1.4464, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.35% (0.7247 => 0.7417, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.93% (1.4090 => 1.4362, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 1.61% (0.8373 => 0.8508, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.99% (0.0473 => 0.0577, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 15.12% (0.0721 => 0.0830, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.72% (3.4010 => 3.6975, std. dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3556 => 0.3688, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.82% (0.3934 => 0.4045, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 2.34% (0.4779 => 0.4891, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: 2.18% (0.4905 => 0.5012, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.08% (1.8448 => 1.8648, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.45% (1.4180 => 1.3975, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.66% (1.4483 => 1.4242, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.13% (4.1237 => 4.0772, std. dev.: 0.0132) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.17% (0.3582 => 0.3803, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.6410 => 0.6748, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.27% (0.2996 => 0.3124, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.02% (0.3008 => 0.3129, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3217 => 0.3337, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.63% (0.7722 => 0.8002, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2072, std. dev.: 0.0108) MultiSource/Applications/minisat/minisat: 3.58% (0.6173 => 0.6394, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 3.46% (2.1763 => 2.2516, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.45% (0.5740 => 0.5938, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.99% (1.1672 => 1.2021, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.98% (0.4596 => 0.4733, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.7226 => 0.7417, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.20% (1.1440 => 1.1692, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5520 => 0.5635, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.1827 => 1.2064, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.94% (1.4189 => 1.4464, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.85% (0.9029 => 0.9196, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.4113 => 1.4362, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.49% (8.2559 => 8.3793, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/football/football: 1.23% (0.8405 => 0.8508, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.08% (4.2616 => 4.3077, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0199) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std. dev.: 0.0397) SingleSource/Benchmarks/McGill/misr: 13.85% (0.4296 => 0.4891, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5632, std. dev.: 0.0732) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.10% (0.2694 => 0.2993, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.03% (1.0063 => 1.1072, std. dev.: 0.0216) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.63% (15.8312 => 17.1970, std. dev.: 0.1833) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6056, std. dev.: 0.0419) SingleSource/Benchmarks/Shootout-C++/sieve: 7.46% (3.4406 => 3.6972, std. dev.: 0.0915) SingleSource/Benchmarks/McGill/chomp: 7.25% (1.0194 => 1.0933, std. dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 7.07% (21.1721 => 22.6685, std. dev.: 0.4367) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.76% (0.2857 => 0.3050, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (3.4876 => 3.7011, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8062, std. dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.95% (0.5876 => 0.6167, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (0.3301 => 0.3454, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8126, std. dev.: 0.0567) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.40% (0.5587 => 0.5777, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (4.2129 => 4.3517, std. dev.: 0.0509) MultiSource/Benchmarks/Olden/power/power: 3.28% (1.4184 => 1.4649, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 2.92% (5.1938 => 5.3452, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.64% (3.6023 => 3.6975, std. dev.: 0.0301) SingleSource/Benchmarks/Misc/ReedSolomon: 2.38% (8.5113 => 8.7139, std. dev.: 0.0506) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5310, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.33% (3.5520 => 3.5992, std. dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6643, std. dev.: 0.0452) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4455 => 2.4749, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.21% (8.9977 => 8.6190, std. dev.: 0.1105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.54% (5.2665 => 4.0793, std. dev.: 0.0585) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.87% (1.1647 => 0.9915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9427, std. dev.: 0.0312) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3666, std. dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: -6.34% (3.4230 => 3.2059, std. dev.: 0.0319) SingleSource/Benchmarks/Misc/richards_benchmark: -6.28% (1.4441 => 1.3534, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7921, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4074, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.89% (1.7361 => 1.6512, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (3.9413 => 3.7616, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.17% (9.2503 => 8.8647, std. dev.: 0.0864) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.79% (2.4457 => 2.3529, std. dev.: 0.0344) MultiSource/Benchmarks/FreeBench/distray/distray: -3.75% (0.2664 => 0.2564, std. dev.: 0.0035) MultiSource/Applications/aha/aha: -2.79% (3.4286 => 3.3328, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: -2.67% (92.7467 => 90.2734, std. dev.: 0.4895) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.66% (3.7496 => 3.6497, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.62% (1.1683 => 1.1377, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -1.82% (1.7330 => 1.7015, std. dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: -1.74% (62.4126 => 61.3277, std. dev.: 0.2038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2310, std. dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -1.64% (3.8907 => 3.8269, std. dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.53% (2.8964 => 2.8521, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3066, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.26% (4.5056 => 4.4489, std. dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/lists: -1.18% (16.5617 => 16.3666, std. dev.: 0.0753) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 09:49:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 11:49:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910164927.C7C97352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3629?compare_to=3624&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3629, Order: 163514, Start Time: 2012-09-10 15:36:13, End Time: 2012-09-10 16:50:42 To: 3624, Order: 163509, Start Time: 2012-09-10 13:53:27, End Time: 2012-09-10 15:07:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.81% (78.9889 => 81.2120, std. dev.: 0.5239) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.47% (2.0176 => 2.4105, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.53% (0.5748 => 0.6411, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3601 => 0.3987, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.70% (0.3578 => 0.3961, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.59% (0.3646 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3650 => 0.4036, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.52% (0.7710 => 0.8521, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 10.48% (0.3663 => 0.4047, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3789 => 0.4179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.25% (0.3914 => 0.4315, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.17% (0.4003 => 0.4410, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.13% (3.9660 => 4.3678, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 10.03% (0.3940 => 0.4335, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.82% (0.1588 => 0.1744, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.47% (1.3693 => 1.4990, std. dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.42% (0.1072 => 0.1173, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.29% (0.5265 => 0.5754, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 9.07% (0.7038 => 0.7676, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.05% (1.2193 => 1.3296, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9199 => 1.0019, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.91% (0.6959 => 0.7579, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.83% (0.4328 => 0.4710, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.73% (1.4563 => 1.5834, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.62% (0.4062 => 0.4412, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.51% (1.1364 => 1.2331, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.24% (13.8202 => 14.9585, std. dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.18% (0.5577 => 0.6033, std. dev.: 0.0068) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.02% (0.4379 => 0.4730, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.94% (0.2782 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.93% (7.2180 => 7.7906, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.83% (0.6283 => 0.6775, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.83% (0.4791 => 0.5166, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.74% (0.7506 => 0.8087, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.72% (0.3485 => 0.3754, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2243 => 0.2416, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.69% (0.2914 => 0.3138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3246 => 0.3495, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2761 => 0.2972, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.59% (1.0313 => 1.1096, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.57% (0.3580 => 0.3851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.56% (0.2937 => 0.3159, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.3756 => 0.4039, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.53% (0.2628 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3489 => 0.3750, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.45% (1.9828 => 2.1305, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2726 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.39% (1.1061 => 1.1878, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.28% (3.6692 => 3.9365, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 7.12% (0.8310 => 0.8902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1395, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3192 => 0.3417, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.90% (0.3534 => 0.3778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.7460 => 0.7974, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4390 => 0.4691, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.3245 => 1.4114, std. dev.: 0.0098) MultiSource/Applications/d/make_dparser: 6.54% (3.1889 => 3.3975, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.52% (0.6744 => 0.7184, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.52% (1.9270 => 2.0527, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.52% (0.6135 => 0.6535, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.38% (2.1791 => 2.3182, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (4.4433 => 4.7240, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.3801 => 4.6565, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 6.30% (1.2749 => 1.3552, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (1.3813 => 1.4681, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.0594 => 1.1259, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.16% (0.8818 => 0.9361, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 6.13% (14.8535 => 15.7634, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.09% (1.3819 => 1.4661, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.04% (0.8698 => 0.9223, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.2859 => 0.3029, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.84% (8.4961 => 8.9926, std. dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 5.70% (16.6129 => 17.5606, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.67% (13.2842 => 14.0369, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6576 => 0.6944, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.59% (1.1333 => 1.1966, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 5.56% (0.3131 => 0.3305, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.44% (14.5298 => 15.3197, std. dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 5.33% (6.5754 => 6.9258, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.25% (1.2292 => 1.2937, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.81% (3.2742 => 3.4316, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 4.60% (4.6629 => 4.8773, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4805 => 0.5021, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.36% (0.9108 => 0.9505, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.14% (1.5188 => 1.5817, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 4.00% (3.7467 => 3.8966, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.92% (4.9865 => 5.1818, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (6.2785 => 6.5228, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.1007 => 2.1777, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.08% (0.3511 => 0.3619, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.85% (33.2944 => 34.2417, std. dev.: 0.0194) MultiSource/Applications/sqlite3/sqlite3: 1.53% (16.2614 => 16.5100, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2607, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.2619 => 11.7344, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5455, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.29% (1.9199 => 1.9830, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0733, std. dev.: 0.0210) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.74% (0.5184 => 0.5326, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6048, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.05% (7.9275 => 8.0108, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5849, std. dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.27% (0.4657 => 0.4039, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (22.5627 => 21.7127, std. dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2764, std. dev.: 0.0149) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.99% (1.3780 => 1.2955, std. dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5095, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1507, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9244, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.52% (4.5928 => 4.5229, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2183, std. dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2391, std. dev.: 0.0267) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4308, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2614, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 10:18:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 12:18:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910171831.B0746352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3630?compare_to=3626&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3630, Order: 163515, Start Time: 2012-09-10 16:00:09, End Time: 2012-09-10 17:19:46 To: 3626, Order: 163510, Start Time: 2012-09-10 14:12:18, End Time: 2012-09-10 15:31:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (141 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (78.8395 => 80.3234, std. dev.: 0.3222) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (14.8429 => 14.6681, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.01% (1.2178 => 1.2055, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.00% (1.3063 => 1.2932, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.48% (10.3673 => 14.6681, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 15.03% (0.3473 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.76% (0.3497 => 0.4013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.73% (0.3543 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.70% (0.3516 => 0.4033, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.66% (0.3561 => 0.4083, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3543 => 0.4061, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3694 => 0.4220, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.05% (2.2022 => 2.5116, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 13.90% (0.3828 => 0.4360, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3927 => 0.4468, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.59% (0.3886 => 0.4414, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.45% (7.0540 => 8.0031, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 12.43% (0.1432 => 0.1610, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2512, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.03% (1.7609 => 1.9551, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.24% (0.6030 => 0.6587, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5925 => 0.6462, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7326 => 0.7961, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.3177 => 0.3438, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.02% (0.8172 => 0.8827, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.13% (9.4845 => 10.1605, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.04% (0.4615 => 0.4940, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.76% (0.3817 => 0.4075, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7433 => 0.7935, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (8.1363 => 8.6827, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 6.71% (10.4361 => 11.1363, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.65% (0.1625 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.63% (0.3423 => 0.3650, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.55% (0.5860 => 0.6244, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3121 => 0.3323, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (4.2646 => 4.5388, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 6.42% (0.7835 => 0.8338, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 6.35% (0.7115 => 0.7567, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.33% (5.0018 => 5.3184, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.24% (4.9449 => 5.2535, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2758 => 0.2929, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.17% (0.6675 => 0.7087, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.14% (1.5415 => 1.6361, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (1.3050 => 1.3839, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.01% (3.3354 => 3.5360, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.3180 => 0.3367, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 5.77% (0.4299 => 0.4547, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.8067 => 0.8521, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.57% (0.9765 => 1.0309, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.54% (5.7591 => 6.0783, std. dev.: 0.0063) MultiSource/Applications/Burg/burg: 5.54% (1.1642 => 1.2287, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.49% (1.5603 => 1.6459, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.38% (0.5020 => 0.5290, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (1.1861 => 1.2474, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.06% (0.3441 => 0.3615, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 4.99% (3.8723 => 4.0654, std. dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (7.9617 => 8.3521, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.4064 => 0.4263, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.87% (1.0722 => 1.1244, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.83% (0.4103 => 0.4301, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 4.82% (0.3422 => 0.3587, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.66% (2.0273 => 2.1217, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.62% (0.6450 => 0.6748, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2891 => 0.3023, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3865 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.50% (0.5981 => 0.6250, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.46% (0.6456 => 0.6744, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3650 => 0.3812, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.37% (0.2905 => 0.3032, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.31% (0.3826 => 0.3991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.25% (2.2969 => 2.3946, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8921 => 0.9300, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.23% (0.3098 => 0.3229, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.20% (0.2831 => 0.2950, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.4203 => 0.4379, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.18% (21.9371 => 22.8539, std. dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.4186 => 1.4778, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3232 => 0.3365, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.04% (0.2871 => 0.2987, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3935 => 0.4093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0665 => 2.1492, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3684 => 0.3830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.96% (0.3283 => 0.3413, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 3.94% (0.3603 => 0.3745, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.4048 => 0.4207, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 3.93% (0.2877 => 0.2990, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 3.92% (0.4620 => 0.4801, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (14.3668 => 14.9025, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.66% (1.5859 => 1.6440, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.49% (0.3379 => 0.3497, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.2024 => 2.2740, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.1840 => 1.2213, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.79% (1.2842 => 1.3200, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.8101 => 0.8300, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3740, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7454, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2231, std. dev.: 0.0175) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.04% (5.2763 => 3.2164, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.05% (5.3855 => 3.8748, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.67% (5.3526 => 3.8714, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1002, std. dev.: 0.0352) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.03% (2.9384 => 2.5849, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -8.05% (22.1758 => 20.3909, std. dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2589, std. dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7168, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0007) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5077, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4234, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9967, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.57% (1.2373 => 1.2055, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.91% (4.6441 => 4.5555, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0018, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 11:13:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 13:13:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910181343.9FAAE352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3631?compare_to=3628&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3631, Order: 163516, Start Time: 2012-09-10 17:01:34, End Time: 2012-09-10 18:15:00 To: 3628, Order: 163514, Start Time: 2012-09-10 15:32:48, End Time: 2012-09-10 16:43:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (47 on baseline) Performance Improvements: 8 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 873 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 3.62% (8.6190 => 8.9309, std. dev.: 0.0924) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.82% (0.8628 => 0.8871, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.37% (1.2214 => 1.2381, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 4.96% (3.6972 => 3.8804, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.08% (2.6750 => 2.7573, std. dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.95% (4.0793 => 4.1590, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.71% (1.6512 => 1.6795, std. dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.49% (4.4781 => 4.5449, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: 1.44% (8.7139 => 8.8393, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.42% (1.5969 => 1.6195, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: 1.06% (8.8647 => 8.9585, std. dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.41% (0.5938 => 0.5676, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.08% (0.7879 => 0.7715, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.61% (0.9196 => 0.9048, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: -1.57% (1.9075 => 1.8775, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -9.28% (3.6975 => 3.3543, std. dev.: 0.1228) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.08% (1.4038 => 1.3465, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.77% (1.1072 => 1.0655, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/bigfib: -3.47% (0.3688 => 0.3560, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.33% (0.6410 => 0.6816, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.81% (0.3582 => 0.3790, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 4.26% (2.1763 => 2.2690, std. dev.: 0.0104) MultiSource/Applications/lemon/lemon: 3.82% (1.0046 => 1.0430, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.52% (0.8569 => 0.8871, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 3.47% (0.6173 => 0.6387, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.99% (1.2021 => 1.2381, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (12.6413 => 12.9745, std. dev.: 0.0919) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.1827 => 1.2117, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8405 => 0.8603, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.04% (0.7639 => 0.7795, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.84% (0.5937 => 0.6046, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (4.2616 => 4.3367, std. dev.: 0.0266) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.0821 => 1.0989, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.0689 => 1.0807, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.15% (0.0766 => 0.0928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std. dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.03% (4.0101 => 4.5729, std. dev.: 0.0283) SingleSource/Benchmarks/McGill/misr: 13.64% (0.4296 => 0.4882, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8804, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0087) SingleSource/Benchmarks/Stanford/Puzzle: 10.68% (0.1433 => 0.1586, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 8.46% (7.0025 => 7.5950, std. dev.: 0.0801) SingleSource/Benchmarks/McGill/chomp: 7.62% (1.0194 => 1.0971, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.11% (0.2857 => 0.3060, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (27.1724 => 28.8346, std. dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (3.4876 => 3.6934, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.88% (1.0063 => 1.0655, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/dt: 4.65% (0.9851 => 1.0309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8523, std. dev.: 0.0602) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5422, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.93% (0.5876 => 0.6107, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8393, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8737, std. dev.: 0.0118) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.44% (2.6656 => 2.7573, std. dev.: 0.0170) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.11% (0.3508 => 0.3617, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 3.05% (1.4184 => 1.4616, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 2.59% (5.1938 => 5.3283, std. dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.4455 => 2.4870, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 1.59% (2.5166 => 2.5565, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.51% (2.3453 => 2.3807, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.37% (3.5520 => 3.6005, std. dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6747, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 1.06% (2.4013 => 2.4267, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.48% (0.2080 => 0.1966, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.75% (0.3497 => 0.2107, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.03% (5.2665 => 4.1590, std. dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.96% (1.1647 => 0.9905, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.61% (3.2007 => 2.9570, std. dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.03% (3.6254 => 3.3704, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: -6.90% (3.4230 => 3.1868, std. dev.: 0.0224) SingleSource/Benchmarks/Misc/richards_benchmark: -6.42% (1.4441 => 1.3514, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7959, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std. dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.60% (3.9413 => 3.7600, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.44% (0.4140 => 0.3956, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.97% (1.4021 => 1.3465, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.41% (2.4457 => 2.3622, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.26% (1.7361 => 1.6795, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (9.2503 => 8.9585, std. dev.: 0.0109) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.94% (1.2722 => 1.2348, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.91% (1.1683 => 1.1343, std. dev.: 0.0055) MultiSource/Applications/aha/aha: -2.90% (3.4286 => 3.3292, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std. dev.: 0.0175) MultiSource/Benchmarks/mafft/pairlocalalign: -2.13% (62.4126 => 61.0814, std. dev.: 0.1302) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.73% (2.8964 => 2.8463, std. dev.: 0.0175) MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (92.7467 => 91.1731, std. dev.: 0.1161) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2334, std. dev.: 0.0203) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -1.42% (6.7458 => 6.6501, std. dev.: 0.0251) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7677, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3238, std. dev.: 0.0277) MultiSource/Benchmarks/sim/sim: -1.27% (3.8907 => 3.8412, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -1.03% (1.7330 => 1.7151, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 11:31:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 13:31:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910183157.98CCD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3632?compare_to=3629&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3632, Order: 163516, Start Time: 2012-09-10 17:18:48, End Time: 2012-09-10 18:33:11 To: 3629, Order: 163514, Start Time: 2012-09-10 15:36:13, End Time: 2012-09-10 16:50:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.43% (55.4543 => 56.2457, std. dev.: 0.2019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.56% (81.2120 => 79.9448, std. dev.: 0.4336) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.52% (2.0176 => 2.4115, std. dev.: 0.0138) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.98% (0.3578 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.83% (0.7061 => 0.7826, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3646 => 0.4040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.80% (0.3601 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.71% (0.3650 => 0.4041, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.62% (0.3663 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.60% (0.3623 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3789 => 0.4187, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3914 => 0.4325, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.45% (0.7710 => 0.8516, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.4003 => 0.4420, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.18% (0.3940 => 0.4341, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.95% (0.1588 => 0.1746, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.91% (3.9660 => 4.3589, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.78% (0.2596 => 0.2850, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.61% (0.1072 => 0.1175, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.44% (1.3693 => 1.4985, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.42% (0.5265 => 0.5761, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.98% (1.2193 => 1.3288, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.7038 => 0.7663, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.83% (0.9199 => 1.0011, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.78% (0.4328 => 0.4708, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.62% (0.6959 => 0.7559, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.57% (1.4563 => 1.5811, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.51% (1.1364 => 1.2331, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.21% (0.5577 => 0.6035, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.20% (13.8202 => 14.9531, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.98% (0.7506 => 0.8105, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (7.2180 => 7.7881, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.83% (0.4379 => 0.4722, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6283 => 0.6765, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.58% (0.3246 => 0.3492, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.4791 => 0.5153, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 7.55% (0.2995 => 0.3221, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1087, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.38% (0.3293 => 0.3536, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.33% (0.5637 => 0.6050, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.27% (0.3756 => 0.4029, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.20% (1.9828 => 2.1256, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.17% (1.1061 => 1.1854, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 7.15% (0.2628 => 0.2816, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (3.6692 => 3.9316, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.12% (0.2937 => 0.3146, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.04% (0.8310 => 0.8895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.98% (3.8646 => 4.1345, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3534 => 0.3774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.72% (0.7460 => 0.7961, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.3868 => 0.4124, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.4113 => 0.4382, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.53% (1.9270 => 2.0529, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.52% (1.3245 => 1.4108, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.50% (3.1889 => 3.3963, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 6.44% (0.6744 => 0.7178, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (1.2749 => 1.3540, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 6.20% (2.1791 => 2.3143, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.19% (0.6135 => 0.6515, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.19% (1.0594 => 1.1250, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.19% (1.3813 => 1.4668, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.16% (4.4433 => 4.7171, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.16% (1.3819 => 1.4670, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.15% (4.3801 => 4.6496, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 6.03% (14.8535 => 15.7495, std. dev.: 0.0176) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.2859 => 0.3029, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.93% (0.8818 => 0.9341, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.8698 => 0.9205, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.74% (8.4961 => 8.9838, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 5.60% (16.6129 => 17.5437, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (13.2842 => 14.0245, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (1.1333 => 1.1959, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 5.44% (14.5298 => 15.3199, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (6.5754 => 6.9269, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.16% (0.6576 => 0.6915, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.74% (1.2292 => 1.2875, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.71% (4.6629 => 4.8825, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.67% (3.2742 => 3.4270, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4805 => 0.5022, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.22% (0.9108 => 0.9492, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.11% (1.5188 => 1.5812, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.91% (4.9865 => 5.1813, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 3.88% (3.7467 => 3.8921, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.79% (6.2785 => 6.5165, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.6250 => 0.6486, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.1007 => 2.1779, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.10% (0.3511 => 0.3620, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.85% (33.2944 => 34.2443, std. dev.: 0.0197) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4955, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.79% (1.8175 => 2.2498, std. dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4161, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3824, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0733, std. dev.: 0.0652) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.53% (3.7731 => 3.8310, std. dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6878, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5894, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5720, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.18% (0.4657 => 0.4043, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.7004, std. dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2618, std. dev.: 0.0407) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std. dev.: 0.0069) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1514, std. dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9246, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5917, std. dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2402, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.5928 => 4.5213, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0156) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2433, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4331, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2610, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 12:06:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 14:06:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910190637.2199A352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3633?compare_to=3630&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3633, Order: 163519, Start Time: 2012-09-10 17:48:13, End Time: 2012-09-10 19:07:51 To: 3630, Order: 163515, Start Time: 2012-09-10 16:00:09, End Time: 2012-09-10 17:19:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (142 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (14.6681 => 14.8398, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5038 => 56.4371, std. dev.: 0.1296) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.14% (10.3673 => 14.8398, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 26.14% (0.1622 => 0.2046, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.52% (0.3473 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.27% (0.3497 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.19% (0.3516 => 0.4050, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 15.18% (0.3543 => 0.4081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.16% (0.3543 => 0.4080, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 15.08% (0.3561 => 0.4098, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3694 => 0.4232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.29% (0.3828 => 0.4375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.13% (0.3927 => 0.4482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.97% (0.3886 => 0.4429, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.51% (2.2022 => 2.4998, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.27% (7.0540 => 7.9901, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.41% (1.1194 => 1.2583, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (1.7609 => 1.9596, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.93% (0.5925 => 0.6454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 8.74% (0.3282 => 0.3569, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.2065 => 0.2241, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.84% (0.3177 => 0.3426, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (0.8172 => 0.8803, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.18% (0.3817 => 0.4091, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.4879 => 0.5229, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 7.17% (0.2554 => 0.2737, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 7.05% (9.4845 => 10.1529, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 7.02% (10.4361 => 11.1687, std. dev.: 0.0100) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.75% (8.1363 => 8.6859, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3307 => 0.3530, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.70% (0.7835 => 0.8360, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (4.2646 => 4.5359, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.35% (0.5860 => 0.6232, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.7433 => 0.7903, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.21% (4.9449 => 5.2520, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.13% (0.2758 => 0.2927, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.12% (5.0018 => 5.3079, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.02% (1.3050 => 1.3836, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 6.01% (0.3109 => 0.3296, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.5415 => 1.6335, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.92% (3.3354 => 3.5328, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.92% (0.6675 => 0.7070, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.84% (0.5105 => 0.5403, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.79% (0.3180 => 0.3364, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.8067 => 0.8519, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.54% (0.9765 => 1.0306, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.41% (1.1642 => 1.2272, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.35% (1.5603 => 1.6437, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 5.34% (5.7591 => 6.0667, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.17% (0.4103 => 0.4315, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.10% (1.1861 => 1.2466, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 4.97% (3.8723 => 4.0648, std. dev.: 0.0139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.87% (0.3387 => 0.3552, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.84% (7.9617 => 8.3470, std. dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4636 => 0.4859, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 4.79% (0.3422 => 0.3586, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (0.4064 => 0.4257, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.75% (1.0722 => 1.1231, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.75% (2.0273 => 2.1235, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.58% (0.2905 => 0.3038, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.53% (0.5981 => 0.6252, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3865 => 0.4039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3650 => 0.3811, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.40% (0.6456 => 0.6740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3826 => 0.3993, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.36% (21.9371 => 22.8932, std. dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4203 => 0.4384, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.2831 => 0.2952, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.25% (0.2871 => 0.2993, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.24% (0.3136 => 0.3269, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.23% (0.3098 => 0.3229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.21% (0.2756 => 0.2872, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.20% (2.2969 => 2.3933, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.3052 => 0.3180, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.14% (0.2872 => 0.2991, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.14% (0.3162 => 0.3293, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 4.11% (0.3603 => 0.3751, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.10% (0.8921 => 0.9287, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.09% (2.0665 => 2.1511, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.08% (0.3232 => 0.3364, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.07% (0.2877 => 0.2994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3935 => 0.4093, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2793 => 0.2905, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.00% (0.4048 => 0.4210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3684 => 0.3831, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.4186 => 1.4751, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2802 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.96% (0.3283 => 0.3413, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.92% (0.4620 => 0.4801, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (14.3668 => 14.9241, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.53% (1.5859 => 1.6419, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.2024 => 2.2715, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.1840 => 1.2180, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3184, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.8101 => 0.8274, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3837, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (4.2280 => 4.3655, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7490, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5857, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2161, std. dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.66% (5.2763 => 3.2366, std. dev.: 0.0148) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.16% (5.3855 => 3.8691, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.78% (5.3526 => 3.8658, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1496, std. dev.: 0.0198) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.69% (2.9384 => 2.5949, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -8.08% (22.1758 => 20.3847, std. dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2745, std. dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7162, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5084, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4200, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9984, std. dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.42% (1.2373 => 1.2074, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5536, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0085, std. dev.: 0.0211) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5081, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std. dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 12:19:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 14:19:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910191943.7F0A0352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3634?compare_to=3627&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3634, Order: 163515, Start Time: 2012-09-10 16:37:29, End Time: 2012-09-10 19:20:58 To: 3627, Order: 163508, Start Time: 2012-09-10 13:24:58, End Time: 2012-09-10 16:08:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3465 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.06% (0.3442 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.96% (0.3488 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.96% (0.3460 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.87% (0.3469 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.40% (0.3650 => 0.4139, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5826 => 0.6303, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.5889 => 0.6362, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.47% (0.1619 => 0.1740, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (3.5627 => 3.8039, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 6.53% (0.7171 => 0.7639, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (1.6211 => 1.7263, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (0.5026 => 0.5346, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (0.4994 => 0.5299, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (0.4361 => 0.4626, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.95% (0.5900 => 0.6251, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (1.3152 => 1.3930, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 5.71% (1.5932 => 1.6841, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (0.3930 => 0.4148, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.44% (4.2109 => 4.4401, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.40% (0.5000 => 0.5270, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2875 => 0.3029, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.26% (0.3004 => 0.3162, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.10% (0.3195 => 0.3358, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2725 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.07% (0.9909 => 1.0411, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.06% (1.0781 => 1.1327, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2738 => 0.2876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2823 => 0.2964, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.98% (0.2729 => 0.2865, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.98% (0.2792 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.97% (0.2736 => 0.2872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.96% (0.2803 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.91% (0.3625 => 0.3803, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (2.0673 => 2.1685, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.87% (0.2811 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.86% (0.2780 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.83% (2.7292 => 2.8611, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.74% (0.2911 => 0.3049, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.71% (0.3124 => 0.3271, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.3362 => 0.3520, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3258 => 0.3409, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.61% (0.3060 => 0.3201, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (0.4658 => 0.4865, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (1.9694 => 2.0566, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.3348 => 0.3495, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3282 => 0.3426, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.37% (5.5417 => 5.7840, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 4.36% (0.2566 => 0.2678, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.35% (0.3726 => 0.3888, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (1.9966 => 2.0833, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.3903 => 0.4071, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3678 => 0.3834, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: 4.23% (0.3477 => 0.3624, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.3845 => 0.4006, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 4.18% (0.9697 => 1.0102, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (2.1013 => 2.1890, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4146 => 0.4315, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.05% (0.3084 => 0.3209, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3690 => 0.3839, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.00% (2.1653 => 2.2520, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (1.8794 => 1.9540, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4251 => 0.4418, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (4.4195 => 4.5931, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.4139 => 0.4301, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.87% (0.3981 => 0.4135, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.82% (4.6177 => 4.7941, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.68% (1.4269 => 1.4794, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 3.66% (0.7875 => 0.8163, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.3271 => 0.3386, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.5012 => 0.5183, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.35% (0.5546 => 0.5732, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.26% (0.6634 => 0.6850, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.11% (23.5202 => 24.2518, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.6435 => 0.6632, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.97% (2.0346 => 2.0746, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8975, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6599, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6310, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2071, std. dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5032, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.75% (2.0820 => 2.1184, std. dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4425, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5870, std. dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5637, std. dev.: 0.0165) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7827, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.46% (17.2379 => 16.8141, std. dev.: 0.0592) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9710, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 12:41:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 14:41:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910194128.B1428352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3635?compare_to=3631&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3635, Order: 163525, Start Time: 2012-09-10 18:30:45, End Time: 2012-09-10 19:42:45 To: 3631, Order: 163516, Start Time: 2012-09-10 17:01:34, End Time: 2012-09-10 18:15:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (40 on baseline) Performance Improvements: 12 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 875 (821 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.88% (1.8061 => 1.8581, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.37% (4.3591 => 4.4623, std. dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.37% (1.0655 => 1.0907, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.94% (44.5291 => 45.3933, std. dev.: 0.2931) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.5005 => 2.5337, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -3.08% (0.8603 => 0.8338, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.95% (0.8871 => 0.8609, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.16% (1.2381 => 1.2113, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.60% (0.9048 => 0.8903, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.54% (1.2117 => 1.1930, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: -1.41% (3.9059 => 3.8509, std. dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.3694 => 8.2792, std. dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.03% (23.6695 => 20.8227, std. dev.: 1.0706) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.77% (2.5259 => 2.4306, std. dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.23% (2.4778 => 2.4226, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -1.74% (0.6107 => 0.6001, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (8.8393 => 8.7115, std. dev.: 0.0210) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.1653 => 1.2095, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.71% (2.0972 => 2.1330, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.25% (1.4113 => 1.4290, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (8.2186 => 8.3017, std. dev.: 0.0250) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.15% (0.0263 => 0.0387, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3396, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std. dev.: 0.0122) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.58% (0.0917 => 0.1069, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.90% (1.7426 => 2.0023, std. dev.: 0.0531) MultiSource/Applications/sgefa/sgefa: 13.45% (0.3746 => 0.4250, std. dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.31% (4.0101 => 4.5438, std. dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/sieve: 12.63% (3.4406 => 3.8750, std. dev.: 0.0060) SingleSource/Benchmarks/McGill/misr: 12.17% (0.4296 => 0.4819, std. dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 11.10% (0.1433 => 0.1592, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 9.06% (7.0025 => 7.6370, std. dev.: 0.0682) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.50% (0.2694 => 0.2923, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.39% (1.0063 => 1.0907, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 7.62% (1.0194 => 1.0971, std. dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (0.3301 => 0.3538, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.00% (0.2857 => 0.3057, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (27.1724 => 28.7838, std. dev.: 0.0811) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.92% (4.2129 => 4.4623, std. dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (3.4876 => 3.6929, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.74% (40.4792 => 42.3964, std. dev.: 0.4801) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8445, std. dev.: 0.0403) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.73% (3.4080 => 3.5351, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.02% (0.3508 => 0.3614, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.74% (2.3580 => 2.4226, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/ReedSolomon: 2.35% (8.5113 => 8.7115, std. dev.: 0.0210) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.13% (0.5876 => 0.6001, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.85% (2.3453 => 2.3888, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6085, std. dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5337, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.39% (4.6127 => 4.6766, std. dev.: 0.0238) MultiSource/Applications/hexxagon/hexxagon: 1.30% (14.4877 => 14.6755, std. dev.: 0.0135) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.22% (2.9152 => 2.9508, std. dev.: 0.0122) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.54% (0.5740 => 0.5594, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: -2.31% (0.7738 => 0.7559, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.40% (0.9029 => 0.8903, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.35% (0.3497 => 0.2051, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.80% (5.2665 => 4.1185, std. dev.: 0.1012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.96% (1.1647 => 0.9905, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1618, std. dev.: 0.0723) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.27% (3.2007 => 2.9359, std. dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.15% (3.6254 => 3.3663, std. dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: -6.55% (3.4230 => 3.1989, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3509, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std. dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4092, std. dev.: 0.0140) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.83% (0.4140 => 0.3940, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.78% (2.4457 => 2.3287, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7622, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (9.2503 => 8.8621, std. dev.: 0.0501) MultiSource/Benchmarks/mafft/pairlocalalign: -3.43% (62.4126 => 60.2729, std. dev.: 0.5855) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.30% (1.7361 => 1.6788, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2865, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -2.52% (3.4286 => 3.3423, std. dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.45% (3.7496 => 3.6578, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/neural/neural: -2.22% (1.0926 => 1.0683, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.48% (3.8907 => 3.8332, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7687, std. dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (25.6658 => 25.3266, std. dev.: 0.0836) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.18% (9.3855 => 9.2748, std. dev.: 0.0215) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 13:14:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 15:14:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910201436.7D1CB352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3636?compare_to=3632&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3636, Order: 163525, Start Time: 2012-09-10 19:01:19, End Time: 2012-09-10 20:15:51 To: 3632, Order: 163516, Start Time: 2012-09-10 17:18:48, End Time: 2012-09-10 18:33:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.78% (2.0176 => 2.4166, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.89% (0.5818 => 0.6510, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 11.88% (0.7061 => 0.7900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.74% (0.5748 => 0.6423, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.98% (0.3578 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.83% (0.3646 => 0.4041, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3601 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.54% (0.3663 => 0.4049, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.52% (0.3650 => 0.4034, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3623 => 0.4003, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3789 => 0.4186, std. dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 10.37% (0.4003 => 0.4418, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.35% (0.3914 => 0.4319, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (0.7710 => 0.8497, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 10.20% (0.3940 => 0.4342, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.04% (3.9660 => 4.3641, std. dev.: 0.0076) MultiSource/Applications/hbd/hbd: 9.95% (1.3693 => 1.5055, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1986 => 0.2181, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.27% (0.1327 => 0.1450, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.17% (0.5265 => 0.5748, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 9.12% (0.7038 => 0.7680, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.03% (1.2193 => 1.3294, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.88% (0.6959 => 0.7577, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.78% (0.9199 => 1.0007, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.61% (1.1364 => 1.2342, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.58% (1.4563 => 1.5812, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.3899 => 0.4219, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.16% (0.5577 => 0.6032, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0078) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 8.11% (13.8202 => 14.9415, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.98% (7.2180 => 7.7941, std. dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.88% (0.4379 => 0.4724, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6283 => 0.6778, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.86% (0.3246 => 0.3501, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.71% (0.7506 => 0.8085, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2243 => 0.2416, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.61% (1.0313 => 1.1098, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.60% (0.4791 => 0.5155, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.59% (0.2925 => 0.3147, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.54% (0.3580 => 0.3850, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.40% (1.1061 => 1.1879, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.39% (0.3489 => 0.3747, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.35% (0.3756 => 0.4032, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.30% (3.6692 => 3.9369, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4390 => 0.4710, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (1.9828 => 2.1269, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.5637 => 0.6045, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.21% (3.8646 => 4.1432, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8310 => 0.8903, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.2988 => 0.3201, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.90% (0.4113 => 0.4397, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.75% (3.1889 => 3.4040, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary2: 6.74% (0.3192 => 0.3407, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3868 => 0.4128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3534 => 0.3770, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.64% (1.3245 => 1.4125, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.61% (0.7460 => 0.7953, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.57% (1.9270 => 2.0537, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 6.52% (2.1791 => 2.3211, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (1.2749 => 1.3572, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 6.45% (0.6744 => 0.7179, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.3801 => 4.6557, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.27% (4.4433 => 4.7218, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 6.23% (14.8535 => 15.7792, std. dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.23% (0.6135 => 0.6517, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 6.23% (0.2859 => 0.3037, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.20% (1.3819 => 1.4676, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (1.3813 => 1.4669, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.94% (16.6129 => 17.6004, std. dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (8.4961 => 8.9996, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.92% (0.8818 => 0.9340, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (0.8698 => 0.9211, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.87% (1.1333 => 1.1998, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (13.2842 => 14.0524, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.66% (0.6576 => 0.6948, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 5.65% (0.3131 => 0.3308, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.47% (0.2321 => 0.2448, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (6.5754 => 6.9336, std. dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 5.40% (14.5298 => 15.3146, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.13% (4.6629 => 4.9021, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.72% (3.2742 => 3.4289, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (0.9108 => 0.9503, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (1.5188 => 1.5827, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1950, std. dev.: 0.0080) MultiSource/Applications/lua/lua: 4.10% (3.7467 => 3.9003, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.79% (2.1007 => 2.1804, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (6.2785 => 6.5152, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.53% (0.3511 => 0.3635, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.41% (33.2944 => 34.4286, std. dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: 1.55% (16.2614 => 16.5135, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.40% (5.7573 => 7.5075, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0776, std. dev.: 0.0183) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5986, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5964, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.18% (0.4657 => 0.4043, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.87% (0.2670 => 0.2540, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.50% (22.5627 => 21.7739, std. dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2624, std. dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1516, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9245, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5889, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2439, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5204, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std. dev.: 0.0220) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2302, std. dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4326, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 13:54:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 15:54:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910205422.6B100352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3637?compare_to=3633&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3637, Order: 163530, Start Time: 2012-09-10 19:36:08, End Time: 2012-09-10 20:55:36 To: 3633, Order: 163519, Start Time: 2012-09-10 17:48:13, End Time: 2012-09-10 19:07:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (133 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (14.8398 => 14.4918, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.78% (10.3673 => 14.4918, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 25.83% (0.1622 => 0.2041, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3543 => 0.4043, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.05% (0.3473 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.95% (0.3497 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.91% (0.3516 => 0.4005, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.75% (0.3543 => 0.4030, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.73% (0.3561 => 0.4050, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.26% (0.3694 => 0.4184, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.06% (0.3828 => 0.4328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.01% (0.3927 => 0.4438, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.96% (2.2022 => 2.4877, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.95% (7.0540 => 7.9676, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/property: 12.79% (0.3886 => 0.4383, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.34% (1.1194 => 1.2463, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.31% (1.7609 => 1.9424, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 8.50% (0.3282 => 0.3561, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.6030 => 0.6513, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.43% (0.1695 => 0.1821, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7326 => 0.7865, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.35% (0.8172 => 0.8773, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.85% (9.4845 => 10.1342, std. dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.4615 => 0.4931, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.76% (10.4361 => 11.1415, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.64% (0.2758 => 0.2941, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 6.57% (0.7433 => 0.7921, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.4879 => 0.5198, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.50% (0.7835 => 0.8344, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3307 => 0.3521, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.46% (8.1363 => 8.6619, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3423 => 0.3640, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 6.34% (0.7115 => 0.7566, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.19% (4.2646 => 4.5287, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.18% (0.5860 => 0.6222, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.02% (1.5415 => 1.6343, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5569 => 0.5904, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.00% (0.3817 => 0.4046, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.96% (5.0018 => 5.3001, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.94% (1.3050 => 1.3825, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.6675 => 0.7069, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.89% (3.3354 => 3.5318, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.87% (4.9449 => 5.2352, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.73% (5.7591 => 6.0889, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.3180 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 5.48% (1.5603 => 1.6458, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.8067 => 0.8502, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9765 => 1.0291, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 5.38% (1.1642 => 1.2268, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (1.1861 => 1.2461, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.5020 => 0.5267, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.78% (3.8723 => 4.0574, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.63% (1.0722 => 1.1218, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.4064 => 0.4252, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4636 => 0.4849, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3422 => 0.3578, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6450 => 0.6743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.53% (0.4103 => 0.4289, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.50% (2.0273 => 2.1185, std. dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (7.9617 => 8.3170, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6456 => 0.6736, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.22% (0.3650 => 0.3804, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.20% (0.2905 => 0.3027, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.5981 => 0.6231, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.13% (21.9371 => 22.8427, std. dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/except: 4.11% (0.2871 => 0.2989, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.09% (0.8921 => 0.9286, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.06% (0.3865 => 0.4022, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.3136 => 0.3263, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.04% (0.4203 => 0.4373, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.02% (0.3603 => 0.3748, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.99% (2.2969 => 2.3885, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.98% (0.2891 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3826 => 0.3978, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (14.3668 => 14.9236, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 3.87% (0.4620 => 0.4799, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.4186 => 1.4731, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.73% (0.4048 => 0.4199, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.66% (0.3684 => 0.3819, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.66% (2.0665 => 2.1421, std. dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.3052 => 0.3157, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.41% (1.5859 => 1.6400, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2730, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.1840 => 1.2161, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.2842 => 1.3161, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.8101 => 0.8275, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (3.1578 => 3.3859, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3735, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2236, std. dev.: 0.0227) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.13% (5.2763 => 3.2118, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.65% (5.3855 => 3.8423, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.25% (5.3526 => 3.8407, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1388, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.27% (2.9384 => 2.5780, std. dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: -8.28% (22.1758 => 20.3389, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3764, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2829, std. dev.: 0.1044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.15% (1.6805 => 1.5772, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0020) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5025, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4280, std. dev.: 0.0110) SingleSource/Benchmarks/McGill/chomp: -2.81% (1.2373 => 1.2025, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9941, std. dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.97% (4.6441 => 4.5525, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0121, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2315, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 14:07:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 16:07:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910210756.5CDDA352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3638?compare_to=3635&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3638, Order: 163535, Start Time: 2012-09-10 19:58:27, End Time: 2012-09-10 21:09:12 To: 3635, Order: 163525, Start Time: 2012-09-10 18:30:45, End Time: 2012-09-10 19:42:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (46 on baseline) Performance Improvements: 1 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.50% (0.9314 => 0.9454, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.40% (0.7200 => 0.7301, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.29% (1.3171 => 1.3341, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 1.06% (3.5876 => 3.6257, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.56% (0.7584 => 0.8006, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.70% (8.4337 => 8.6612, std. dev.: 0.0741) SingleSource/Benchmarks/Shootout-C++/methcall: 1.02% (8.8621 => 8.9529, std. dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.51% (22.4664 => 22.1268, std. dev.: 0.1162) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.73% (0.6410 => 0.6777, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.44% (0.3582 => 0.3777, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.96% (1.1653 => 1.2115, std. dev.: 0.0119) MultiSource/Applications/minisat/minisat: 3.66% (0.6173 => 0.6399, std. dev.: 0.0068) MultiSource/Applications/lemon/lemon: 3.48% (1.0046 => 1.0396, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.5150 => 1.5603, std. dev.: 0.0138) MultiSource/Applications/d/make_dparser: 1.90% (3.0225 => 3.0798, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.7639 => 0.7778, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.62% (29.3170 => 29.7934, std. dev.: 0.0939) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.2021 => 1.2206, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (8.2186 => 8.3309, std. dev.: 0.0208) MultiSource/Applications/siod/siod: 1.24% (2.0972 => 2.1232, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.15% (1.4113 => 1.4275, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0013, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5444, std. dev.: 0.0264) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 13.11% (0.4296 => 0.4859, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (3.4406 => 3.8801, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 12.28% (0.3746 => 0.4206, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.07% (0.2857 => 0.3116, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.49% (7.0025 => 7.5970, std. dev.: 0.0155) SingleSource/Benchmarks/McGill/chomp: 7.48% (1.0194 => 1.0957, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.35% (3.0256 => 3.2481, std. dev.: 0.0557) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (0.3301 => 0.3526, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (3.4876 => 3.7009, std. dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.8011, std. dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.39% (40.4792 => 42.6592, std. dev.: 0.5196) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.22% (0.7609 => 0.8006, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 3.82% (15.2242 => 15.8063, std. dev.: 0.0718) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.16% (0.3508 => 0.3619, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.12% (0.8498 => 0.8763, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.93% (2.6656 => 2.7436, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 2.55% (8.5113 => 8.7280, std. dev.: 0.0692) MultiSource/Benchmarks/BitBench/five11/five11: 2.54% (5.1938 => 5.3255, std. dev.: 0.0083) MultiSource/Applications/siod/siod: 1.63% (3.5520 => 3.6098, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5324, std. dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 1.20% (14.4877 => 14.6616, std. dev.: 0.0274) MultiSource/Benchmarks/Olden/bh/bh: 1.09% (2.5166 => 2.5440, std. dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.91% (0.7738 => 0.7590, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.81% (0.3497 => 0.2035, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.09% (5.2665 => 4.1556, std. dev.: 0.0253) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.04% (1.1647 => 0.9895, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.07% (3.2007 => 2.9425, std. dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3659, std. dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: -6.78% (3.4230 => 3.1908, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -6.25% (1.4441 => 1.3538, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4079, std. dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.44% (2.4457 => 2.3370, std. dev.: 0.0309) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.96% (0.4140 => 0.3976, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -3.71% (62.4126 => 60.0944, std. dev.: 0.6486) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.54% (1.7361 => 1.6746, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2308, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -3.22% (9.2503 => 8.9529, std. dev.: 0.0125) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.02% (1.2959 => 1.2567, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.78% (1.1683 => 1.1358, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2897, std. dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -2.20% (92.7467 => 90.7048, std. dev.: 0.2181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.12% (3.7496 => 3.6700, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: -1.66% (1.7330 => 1.7043, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2313, std. dev.: 0.0460) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.56% (3.8907 => 3.8299, std. dev.: 0.0163) MultiSource/Applications/JM/lencod/lencod: -1.40% (6.7458 => 6.6512, std. dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7689, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.02% (1.8739 => 1.8547, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: -1.00% (16.5617 => 16.3958, std. dev.: 0.0224) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 14:57:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 16:57:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910215708.181A7352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3639?compare_to=3636&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3639, Order: 163537, Start Time: 2012-09-10 20:43:57, End Time: 2012-09-10 21:58:21 To: 3636, Order: 163525, Start Time: 2012-09-10 19:01:19, End Time: 2012-09-10 20:15:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.67% (3.7700 => 3.8329, std. dev.: 0.0233) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.25% (2.0176 => 2.4059, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.57% (0.7061 => 0.7878, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.46% (0.5748 => 0.6407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.43% (0.5818 => 0.6483, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.13% (0.7710 => 0.8491, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.84% (3.9660 => 4.3563, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.63% (1.3693 => 1.5011, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3601 => 0.3942, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3646 => 0.3991, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.44% (0.5265 => 0.5762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.43% (0.3914 => 0.4283, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3650 => 0.3992, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3623 => 0.3961, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.29% (0.7038 => 0.7692, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.4003 => 0.4374, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3789 => 0.4139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.94% (0.6959 => 0.7581, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.76% (0.9199 => 1.0005, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.73% (1.2193 => 1.3257, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.46% (1.4563 => 1.5795, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2310, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.18% (0.4328 => 0.4682, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.07% (0.5577 => 0.6027, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 7.79% (13.8202 => 14.8965, std. dev.: 0.0156) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 7.71% (0.7506 => 0.8085, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4379 => 0.4715, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (7.2180 => 7.7716, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.51% (0.6283 => 0.6755, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2966 => 0.3187, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 7.44% (1.0313 => 1.1080, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.42% (1.1061 => 1.1882, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.37% (0.4791 => 0.5144, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.3489 => 0.3744, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 7.16% (3.8646 => 4.1414, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (1.9828 => 2.1239, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.11% (0.4390 => 0.4702, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.99% (0.8310 => 0.8891, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.98% (3.6692 => 3.9253, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.2937 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.65% (0.4016 => 0.4283, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.52% (1.3245 => 1.4108, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 6.48% (2.1791 => 2.3203, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.46% (1.9270 => 2.0515, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.39% (0.4113 => 0.4376, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.39% (3.1889 => 3.3926, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.08% (1.3813 => 1.4653, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6135 => 0.6507, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.04% (4.3801 => 4.6445, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 6.01% (1.0594 => 1.1231, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (1.3819 => 1.4649, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.2749 => 1.3512, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.98% (4.4433 => 4.7091, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.95% (16.6129 => 17.6020, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.68% (14.8535 => 15.6969, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.63% (0.8698 => 0.9188, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (13.2842 => 14.0289, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 5.55% (8.4961 => 8.9677, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.51% (1.1333 => 1.1958, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.31% (14.5298 => 15.3008, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.25% (0.3755 => 0.3952, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.17% (0.8818 => 0.9274, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.92% (6.5754 => 6.8991, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.82% (0.6576 => 0.6893, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2292 => 1.2861, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.53% (3.2742 => 3.4225, std. dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 4.51% (4.6629 => 4.8734, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.06% (1.5188 => 1.5805, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.97% (4.9865 => 5.1843, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 3.96% (3.7467 => 3.8952, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.93% (0.9108 => 0.9466, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.1007 => 2.1770, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.6250 => 0.6473, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (6.2785 => 6.4876, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.99% (0.3511 => 0.3616, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.98% (33.2944 => 34.2854, std. dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4652, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std. dev.: 0.0279) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7338, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.74% (12.0921 => 12.5449, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.11% (10.7476 => 11.0815, std. dev.: 0.0433) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.97% (0.5184 => 0.5338, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5963, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6877, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5858, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.00% (0.4657 => 0.4005, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.83% (22.5627 => 21.6983, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2741, std. dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.69% (1.3780 => 1.2858, std. dev.: 0.0133) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1513, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5721, std. dev.: 0.0143) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2353, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5217, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: -1.19% (4.4810 => 4.4278, std. dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2440, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8732, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2353, std. dev.: 0.0330) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2615, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 15:31:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 17:31:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120910223131.5AE8C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3640?compare_to=3634&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3640, Order: 163534, Start Time: 2012-09-10 19:49:11, End Time: 2012-09-10 22:32:44 To: 3634, Order: 163515, Start Time: 2012-09-10 16:37:29, End Time: 2012-09-10 19:20:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.73% (0.3442 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.68% (0.3460 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.68% (0.3488 => 0.4000, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 14.67% (0.3496 => 0.4009, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.08% (0.3650 => 0.4164, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.05% (0.3643 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3724 => 0.4237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5826 => 0.6353, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5889 => 0.6420, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.24% (0.7171 => 0.7690, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.01% (3.5627 => 3.8126, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (1.6211 => 1.7329, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.83% (0.4994 => 0.5335, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.73% (0.5026 => 0.5364, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (0.3930 => 0.4186, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.42% (1.3152 => 1.3997, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.36% (0.2014 => 0.2142, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.28% (0.4361 => 0.4635, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 6.25% (0.4029 => 0.4281, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.03% (0.5900 => 0.6256, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 5.94% (1.5932 => 1.6878, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.74% (4.2109 => 4.4524, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (0.5000 => 0.5284, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.48% (0.2866 => 0.3023, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8785, std. dev.: 0.0092) MultiSource/Applications/d/make_dparser: 5.46% (1.0781 => 1.1370, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.25% (0.3792 => 0.3991, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.92% (1.9694 => 2.0662, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.90% (0.2875 => 0.3016, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (1.9966 => 2.0932, std. dev.: 0.0250) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.64% (0.2823 => 0.2954, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (0.4658 => 0.4873, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.60% (0.9909 => 1.0365, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (2.1013 => 2.1979, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.51% (0.2729 => 0.2852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.49% (0.2738 => 0.2861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2813 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3195 => 0.3338, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2803 => 0.2928, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (4.4195 => 4.6160, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.3903 => 0.4074, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.38% (4.6177 => 4.8200, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.32% (2.0673 => 2.1566, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 4.31% (5.5417 => 5.7805, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 4.29% (0.3267 => 0.3407, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.28% (2.1653 => 2.2580, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.3096 => 0.3228, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (1.8794 => 1.9583, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.19% (0.3362 => 0.3503, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (0.3625 => 0.3777, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.19% (0.2911 => 0.3033, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.12% (0.3060 => 0.3186, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.11% (0.3258 => 0.3392, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.02% (1.4269 => 1.4842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3317 => 0.3448, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.91% (0.9697 => 1.0076, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.4139 => 0.4300, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.89% (0.7875 => 0.8181, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 3.88% (0.3348 => 0.3478, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.3271 => 0.3395, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.76% (0.3726 => 0.3866, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.2969 => 0.3078, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.66% (0.3282 => 0.3402, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.62% (0.5546 => 0.5747, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.62% (0.3678 => 0.3811, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.55% (0.3690 => 0.3821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4146 => 0.4291, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.41% (0.4251 => 0.4396, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.39% (0.6634 => 0.6859, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.39% (0.3981 => 0.4116, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.24% (23.5202 => 24.2818, std. dev.: 0.0115) MultiSource/Applications/minisat/minisat: 3.03% (0.3336 => 0.3437, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.5012 => 0.5146, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.6435 => 0.6606, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.09% (2.0346 => 2.0771, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6668, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8963, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.1258) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6275, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2005, std. dev.: 0.0116) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5056, std. dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4496, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5949, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.05% (105.3826 => 106.4892, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5818, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7962, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8100, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std. dev.: 0.0053) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7753, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7654, std. dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5729, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9710, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 15:36:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 17:36:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120910223610.0ED10352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3641?compare_to=3638&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3641, Order: 163542, Start Time: 2012-09-10 21:25:15, End Time: 2012-09-10 22:37:26 To: 3638, Order: 163535, Start Time: 2012-09-10 19:58:27, End Time: 2012-09-10 21:09:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (51 on baseline) Performance Improvements: 2 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 4.82% (0.2595 => 0.2720, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 21.66% (3.1089 => 3.7822, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.08% (3.2481 => 3.8028, std. dev.: 0.1540) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.93% (15.5042 => 17.5089, std. dev.: 0.2181) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (1.7316 => 1.8420, std. dev.: 0.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.97% (59.7277 => 60.9055, std. dev.: 0.2444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.89% (22.1268 => 22.5451, std. dev.: 0.0994) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -4.74% (3.7009 => 3.5253, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.37% (1.0995 => 1.0734, std. dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 4.90% (0.2593 => 0.2720, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.82% (0.6410 => 0.6719, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.77% (0.3582 => 0.3753, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 4.74% (1.1653 => 1.2205, std. dev.: 0.0122) MultiSource/Applications/lemon/lemon: 4.30% (1.0046 => 1.0478, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3062 => 0.3169, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 3.47% (0.6173 => 0.6387, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.5150 => 1.5590, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.76% (0.7639 => 0.7850, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.27% (0.6069 => 0.6207, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 1.42% (14.6079 => 14.8149, std. dev.: 0.0712) MultiSource/Applications/Burg/burg: 1.38% (1.1440 => 1.1598, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.49% (0.0263 => 0.0380, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.18% (1.6538 => 2.3348, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 25.69% (3.0256 => 3.8028, std. dev.: 0.1540) SingleSource/Benchmarks/Shootout-C++/matrix: 22.19% (3.4629 => 4.2314, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/heapsort: 17.61% (3.2159 => 3.7822, std. dev.: 0.0240) SingleSource/Benchmarks/McGill/misr: 14.06% (0.4296 => 0.4900, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.04% (4.0101 => 4.5732, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sieve: 13.18% (3.4406 => 3.8939, std. dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 12.55% (0.3746 => 0.4216, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (15.8312 => 17.5089, std. dev.: 0.2181) SingleSource/Benchmarks/Stanford/Puzzle: 9.84% (0.1433 => 0.1574, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 9.55% (7.0025 => 7.6711, std. dev.: 0.0308) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.80% (0.2694 => 0.2931, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 7.83% (1.0194 => 1.0992, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.67% (1.0063 => 1.0734, std. dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.49% (40.4792 => 43.1068, std. dev.: 0.4179) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (0.3301 => 0.3515, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7988, std. dev.: 0.0386) SingleSource/Benchmarks/Shootout-C++/ary3: 5.42% (1.7473 => 1.8420, std. dev.: 0.0347) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.31% (4.2129 => 4.4368, std. dev.: 0.0460) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.06% (0.7609 => 0.7994, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/fp-convert: 4.17% (15.2242 => 15.8587, std. dev.: 0.0386) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5397, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: 3.78% (0.9851 => 1.0223, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (6.6312 => 6.8776, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/ReedSolomon: 3.41% (8.5113 => 8.8016, std. dev.: 0.0280) MultiSource/Benchmarks/Olden/power/power: 3.07% (1.4184 => 1.4619, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.40% (2.6656 => 2.7296, std. dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.37% (0.5876 => 0.6015, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (2.4455 => 2.4892, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.67% (2.5166 => 2.5587, std. dev.: 0.0132) MultiSource/Applications/siod/siod: 1.66% (3.5520 => 3.6110, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5314, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.34% (14.4877 => 14.6816, std. dev.: 0.0209) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.08% (4.0659 => 4.1099, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 1.08% (3.4876 => 3.5253, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.02% (38.9255 => 39.3209, std. dev.: 0.0520) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -24.88% (0.0414 => 0.0311, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -2.21% (0.7738 => 0.7567, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.78% (5.2665 => 4.2246, std. dev.: 0.1014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9918, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout/sieve: -12.14% (8.1594 => 7.1692, std. dev.: 0.0573) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.87% (3.2007 => 2.9488, std. dev.: 0.0494) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3728, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.40% (1.4441 => 1.3517, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std. dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: -5.87% (3.4230 => 3.2222, std. dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (4.6355 => 4.4029, std. dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: -4.37% (9.2503 => 8.8464, std. dev.: 0.0845) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.32% (0.4140 => 0.3961, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -3.65% (62.4126 => 60.1334, std. dev.: 0.5520) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.40% (2.4457 => 2.3625, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.99% (1.1683 => 1.1334, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.93% (1.7361 => 1.6852, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2855, std. dev.: 0.0231) MultiSource/Applications/aha/aha: -2.64% (3.4286 => 3.3380, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.45% (3.7496 => 3.6579, std. dev.: 0.0136) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.44% (1.2722 => 1.2412, std. dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: -2.19% (92.7467 => 90.7179, std. dev.: 0.4095) MultiSource/Benchmarks/FreeBench/neural/neural: -1.85% (1.0926 => 1.0724, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2282, std. dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3569 => 2.3256, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.31% (1.0120 => 0.9987, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.26% (25.6658 => 25.3417, std. dev.: 0.0795) SingleSource/Benchmarks/Misc/oourafft: -1.21% (3.8200 => 3.7737, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 15:42:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 17:42:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120910224227.34C4B352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3642?compare_to=3637&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3642, Order: 163540, Start Time: 2012-09-10 21:24:00, End Time: 2012-09-10 22:43:40 To: 3637, Order: 163530, Start Time: 2012-09-10 19:36:08, End Time: 2012-09-10 20:55:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (140 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (55.0240 => 56.4971, std. dev.: 0.1049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.14% (78.3601 => 80.0384, std. dev.: 0.2528) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.04% (4.6245 => 4.5764, std. dev.: 0.0183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.43% (10.3673 => 14.5588, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.34% (0.3473 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3497 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3516 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.03% (0.3543 => 0.4040, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.97% (0.3543 => 0.4038, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 13.96% (0.3561 => 0.4058, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.51% (0.3694 => 0.4193, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.38% (0.3828 => 0.4340, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.16% (7.0540 => 7.9824, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 13.14% (0.3927 => 0.4443, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (2.2022 => 2.4915, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.07% (0.3886 => 0.4394, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.43% (0.1432 => 0.1610, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.25% (1.1194 => 1.2453, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (1.7609 => 1.9468, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7326 => 0.7880, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.55% (0.8172 => 0.8789, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.40% (0.3177 => 0.3412, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.24% (10.4361 => 11.1921, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 7.22% (9.4845 => 10.1692, std. dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.00% (0.2271 => 0.2430, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.89% (0.5860 => 0.6264, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.4615 => 0.4932, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 6.85% (0.2554 => 0.2729, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.4879 => 0.5209, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (8.1363 => 8.6750, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 6.55% (0.7115 => 0.7581, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.54% (0.3423 => 0.3647, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.46% (0.6675 => 0.7106, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.45% (0.2758 => 0.2936, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7433 => 0.7910, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 6.39% (0.7835 => 0.8336, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (4.2646 => 4.5354, std. dev.: 0.0153) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.31% (0.3817 => 0.4058, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.31% (0.2107 => 0.2240, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (1.5415 => 1.6372, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.3050 => 1.3854, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.14% (3.3354 => 3.5401, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.14% (4.9449 => 5.2483, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.13% (5.0018 => 5.3083, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.09% (0.5569 => 0.5908, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.3092 => 0.3271, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.8067 => 0.8531, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.62% (5.7591 => 6.0825, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 5.58% (1.1642 => 1.2292, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9765 => 1.0304, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.42% (1.5603 => 1.6449, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1861 => 1.2478, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.06% (0.5020 => 0.5274, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.91% (3.8723 => 4.0625, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.88% (0.3441 => 0.3609, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4636 => 0.4861, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.82% (1.0722 => 1.1239, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.81% (0.6450 => 0.6760, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.71% (2.0273 => 2.1227, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.62% (0.6456 => 0.6754, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.56% (21.9371 => 22.9380, std. dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.4103 => 0.4288, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.48% (0.2905 => 0.3035, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (7.9617 => 8.3168, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.29% (0.3098 => 0.3231, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.29% (0.2891 => 0.3015, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.5981 => 0.6237, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.27% (0.3865 => 0.4030, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (14.3668 => 14.9800, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4203 => 0.4380, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.21% (2.2969 => 2.3935, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8921 => 0.9295, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.3650 => 0.3803, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.11% (0.2872 => 0.2990, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3826 => 0.3983, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.08% (0.3162 => 0.3291, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3603 => 0.3749, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4760, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.99% (0.3136 => 0.3261, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.4048 => 0.4209, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3935 => 0.4089, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.90% (2.0665 => 2.1471, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.88% (0.2756 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (1.5859 => 1.6471, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3232 => 0.3356, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.80% (0.3052 => 0.3168, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2802 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.43% (0.3379 => 0.3495, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.2024 => 2.2756, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.1840 => 1.2218, std. dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: 2.51% (1.2842 => 1.3164, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.08% (17.1811 => 17.3660, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3834, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2159, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7566, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3543, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2212, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/fbench: 1.13% (2.2771 => 2.3029, std. dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.96% (5.2763 => 3.2209, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.69% (5.3855 => 3.8403, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.32% (5.3526 => 3.8365, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1307, std. dev.: 0.0318) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.44% (2.9384 => 2.5730, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -8.07% (22.1758 => 20.3862, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2486, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1515, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5081, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4213, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9992, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.00% (1.2373 => 1.2126, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 8.0001, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.32% (4.6441 => 4.5827, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2313, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 16:39:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 18:39:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120910233938.40C122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3643?compare_to=3639&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3643, Order: 163550, Start Time: 2012-09-10 22:26:37, End Time: 2012-09-10 23:40:51 To: 3639, Order: 163537, Start Time: 2012-09-10 20:43:57, End Time: 2012-09-10 21:58:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.16% (1.2858 => 1.3136, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.28% (0.7878 => 0.7777, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.45% (2.0176 => 2.3898, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.82% (0.1410 => 0.1619, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.14% (0.7061 => 0.7777, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.95% (0.5818 => 0.6397, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.82% (0.7710 => 0.8467, std. dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.61% (0.1072 => 0.1175, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 9.30% (0.3601 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.27% (0.3646 => 0.3984, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.05% (3.9660 => 4.3251, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.94% (0.1588 => 0.1730, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 8.77% (1.3693 => 1.4894, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 8.45% (0.7038 => 0.7633, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.23% (1.2193 => 1.3196, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.16% (0.2721 => 0.2943, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.09% (0.9199 => 0.9943, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.06% (0.1327 => 0.1434, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.93% (0.6959 => 0.7511, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.4563 => 1.5708, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4328 => 0.4661, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.64% (1.1364 => 1.2232, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.50% (0.5577 => 0.5995, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.24% (0.2127 => 0.2281, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.22% (13.8202 => 14.8181, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.08% (0.4379 => 0.4689, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7266, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.03% (0.3899 => 0.4173, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 6.99% (0.1589 => 0.1700, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.94% (0.7506 => 0.8027, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.90% (0.3246 => 0.3470, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.86% (1.0313 => 1.1020, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.77% (0.4062 => 0.4337, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.6283 => 0.6708, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3489 => 0.3723, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.67% (0.5637 => 0.6013, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.65% (0.3580 => 0.3818, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.58% (0.3756 => 0.4003, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.57% (1.1061 => 1.1788, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4390 => 0.4678, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.56% (3.8646 => 4.1181, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 6.56% (0.3293 => 0.3509, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.54% (0.2690 => 0.2866, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.53% (0.4791 => 0.5104, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.2966 => 0.3159, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3220 => 0.3427, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.43% (1.9828 => 2.1102, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.40% (3.6692 => 3.9040, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.37% (0.2937 => 0.3124, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2760 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.33% (0.8310 => 0.8836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.24% (0.2995 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4016 => 0.4266, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3107 => 0.3294, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.00% (3.1889 => 3.3803, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 5.99% (2.1791 => 2.3097, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/moments: 5.97% (0.3868 => 0.4099, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.88% (0.7460 => 0.7899, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.86% (1.9270 => 2.0399, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.82% (0.6576 => 0.6959, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.75% (1.3245 => 1.4007, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (1.3819 => 1.4614, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.52% (0.6744 => 0.7116, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.3813 => 1.4574, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.41% (4.4433 => 4.6837, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.41% (4.3801 => 4.6170, std. dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 5.40% (1.2749 => 1.3437, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 5.39% (1.0594 => 1.1165, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.33% (0.6135 => 0.6462, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.25% (0.2859 => 0.3009, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.23% (0.4113 => 0.4328, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.19% (14.8535 => 15.6249, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.08% (13.2842 => 13.9584, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.06% (0.8698 => 0.9138, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.04% (16.6129 => 17.4509, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.93% (8.4961 => 8.9152, std. dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 4.89% (0.3131 => 0.3284, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.82% (1.1333 => 1.1879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3755 => 0.3933, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.70% (14.5298 => 15.2132, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.63% (0.2504 => 0.2620, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2321 => 0.2427, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.56% (0.8818 => 0.9220, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (6.5754 => 6.8660, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.31% (0.3245 => 0.3385, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.02% (1.2292 => 1.2786, std. dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 4.02% (4.6629 => 4.8502, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.81% (3.2742 => 3.3991, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.58% (0.4805 => 0.4977, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.48% (0.9108 => 0.9425, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.37% (1.5188 => 1.5700, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.33% (3.7467 => 3.8715, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (4.9865 => 5.1470, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.01% (0.6250 => 0.6438, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.89% (6.2785 => 6.4598, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.78% (2.1007 => 2.1592, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.18% (33.2944 => 34.0201, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0370) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5472, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0727, std. dev.: 0.0252) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.74% (0.5184 => 0.5326, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6046, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4459, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6875, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5929, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.41% (0.4657 => 0.3986, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.5627 => 21.5631, std. dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2744, std. dev.: 0.0214) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1515, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.64% (1.7688 => 1.7045, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9233, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5934, std. dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.29% (0.6589 => 0.6438, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2432, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5206, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.35% (0.8342 => 0.8229, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2394, std. dev.: 0.0215) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2322, std. dev.: 0.0313) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2617, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 17:04:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 19:04:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911000421.F0CD42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3644?compare_to=3641&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3644, Order: 163556, Start Time: 2012-09-10 22:53:41, End Time: 2012-09-11 00:05:37 To: 3641, Order: 163542, Start Time: 2012-09-10 21:25:15, End Time: 2012-09-10 22:37:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (54 on baseline) Performance Improvements: 7 (27 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 872 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.61% (0.5231 => 0.5629, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.68% (0.7562 => 0.7840, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.18% (1.2593 => 1.2741, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.01% (1.1734 => 1.1853, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 7.01% (6.2832 => 6.7237, std. dev.: 0.0732) SingleSource/Benchmarks/Shootout-C++/hash2: 4.82% (3.5253 => 3.6952, std. dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (4.5125 => 4.6664, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/mandel-2: 1.79% (3.0569 => 3.1117, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (60.1334 => 61.1601, std. dev.: 0.1230) SingleSource/Benchmarks/Misc/richards_benchmark: 1.46% (1.3517 => 1.3714, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.46% (1.2699 => 1.2884, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 1.20% (8.8464 => 8.9522, std. dev.: 0.0329) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (4.6613 => 4.7149, std. dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.2720 => 0.2601, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -3.51% (0.3964 => 0.3825, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: -1.35% (0.8507 => 0.8392, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.27% (0.7848 => 0.7748, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -20.06% (3.8028 => 3.0401, std. dev.: 0.2012) SingleSource/Benchmarks/Shootout/ary3: -3.61% (2.0728 => 1.9980, std. dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/sieve: -3.47% (3.8939 => 3.7589, std. dev.: 0.0495) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.03% (0.3582 => 0.3798, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.66% (0.6410 => 0.6709, std. dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.1653 => 1.2122, std. dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 4.02% (2.1763 => 2.2637, std. dev.: 0.0115) MultiSource/Applications/minisat/minisat: 3.74% (0.6173 => 0.6404, std. dev.: 0.0084) MultiSource/Applications/lemon/lemon: 3.44% (1.0046 => 1.0392, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.14% (0.7639 => 0.7879, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.5150 => 1.5564, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.38% (0.4248 => 0.4349, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5309 => 0.5434, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.11% (3.0225 => 3.0863, std. dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 1.70% (29.3170 => 29.8167, std. dev.: 0.0915) MultiSource/Applications/SPASS/SPASS: 1.58% (13.3238 => 13.5341, std. dev.: 0.0755) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.55% (1.1672 => 1.1853, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.45% (1.1440 => 1.1606, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (8.2186 => 8.3372, std. dev.: 0.0294) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.41% (12.6413 => 12.8190, std. dev.: 0.0313) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.38% (6.2546 => 6.3412, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (1.4113 => 1.4286, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.49% (1.6538 => 2.3399, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0427) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std. dev.: 0.0255) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.31% (4.0101 => 4.5838, std. dev.: 0.0398) SingleSource/Benchmarks/McGill/misr: 12.80% (0.4296 => 0.4846, std. dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 12.77% (0.1433 => 0.1616, std. dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.25% (3.4406 => 3.7589, std. dev.: 0.0495) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.76% (0.2694 => 0.2930, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6110, std. dev.: 0.0518) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.44% (0.2857 => 0.3098, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 8.02% (6.2244 => 6.7237, std. dev.: 0.0732) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (0.3301 => 0.3539, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.88% (40.4792 => 43.2629, std. dev.: 0.2567) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.98% (27.1724 => 28.7985, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (3.4876 => 3.6952, std. dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (15.8312 => 16.7643, std. dev.: 0.3081) SingleSource/Benchmarks/Misc/dt: 4.52% (0.9851 => 1.0296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8534, std. dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5396, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.70% (6.6312 => 6.8768, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.64% (4.2129 => 4.3661, std. dev.: 0.0586) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (4.5056 => 4.6664, std. dev.: 0.0327) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: 3.08% (8.5113 => 8.7735, std. dev.: 0.0353) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.03% (0.5876 => 0.6054, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.74% (2.6656 => 2.7386, std. dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.22% (4.6127 => 4.7149, std. dev.: 0.0118) MultiSource/Applications/siod/siod: 1.67% (3.5520 => 3.6113, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4455 => 2.4846, std. dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5327, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6677, std. dev.: 0.0329) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.24% (1.2726 => 1.2884, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.03% (4.0659 => 4.1077, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.04% (5.2665 => 4.1060, std. dev.: 0.1732) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.96% (1.1647 => 0.9905, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1567, std. dev.: 0.0462) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (1.4034 => 1.2853, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.62% (3.2007 => 2.9569, std. dev.: 0.0287) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: -6.79% (3.4230 => 3.1905, std. dev.: 0.0252) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7969, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -5.03% (1.4441 => 1.3714, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.77% (2.4457 => 2.3291, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.48% (3.9413 => 3.7648, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: -3.22% (9.2503 => 8.9522, std. dev.: 0.0329) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.12% (1.7361 => 1.6819, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.94% (1.1683 => 1.1339, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.77% (3.7496 => 3.6456, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2875, std. dev.: 0.0231) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3362, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -2.13% (92.7467 => 90.7682, std. dev.: 0.0325) MultiSource/Benchmarks/mafft/pairlocalalign: -2.01% (62.4126 => 61.1601, std. dev.: 0.1230) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (9.3855 => 9.2376, std. dev.: 0.0295) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.54% (1.0686 => 1.0521, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7682, std. dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.35% (3.8907 => 3.8383, std. dev.: 0.0193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 17:30:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 19:30:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911003019.3A3FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3645?compare_to=3642&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3645, Order: 163558, Start Time: 2012-09-10 23:12:08, End Time: 2012-09-11 00:31:33 To: 3642, Order: 163540, Start Time: 2012-09-10 21:24:00, End Time: 2012-09-10 22:43:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (130 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (718 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.41% (3.7880 => 3.8413, std. dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.96% (20.3862 => 19.9876, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.72% (56.4971 => 54.3970, std. dev.: 0.2178) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.64% (10.3673 => 14.4765, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 25.46% (0.1622 => 0.2035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.08% (0.3473 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.88% (0.3516 => 0.4004, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3497 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.73% (0.3561 => 0.4050, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.72% (0.3543 => 0.4029, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.43% (2.2022 => 2.4980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.40% (0.3694 => 0.4189, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.23% (7.0540 => 7.9874, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 12.88% (0.3828 => 0.4321, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.83% (0.3927 => 0.4431, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.50% (0.1432 => 0.1611, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.75% (1.1194 => 1.2509, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.62% (1.7609 => 1.9479, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.47% (0.3282 => 0.3560, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.6030 => 0.6537, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.48% (0.7326 => 0.7874, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.01% (0.8172 => 0.8745, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 6.81% (9.4845 => 10.1305, std. dev.: 0.0141) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 6.47% (10.4361 => 11.1118, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.31% (0.7835 => 0.8329, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7433 => 0.7900, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.23% (8.1363 => 8.6432, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.15% (4.2646 => 4.5268, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.06% (0.5860 => 0.6215, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.02% (0.7115 => 0.7543, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 5.92% (0.3109 => 0.3293, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.82% (0.5569 => 0.5893, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.79% (0.3817 => 0.4038, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.77% (1.3050 => 1.3803, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (5.0018 => 5.2893, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.74% (4.9449 => 5.2287, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.72% (3.3354 => 3.5262, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.69% (1.5415 => 1.6292, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.62% (0.2758 => 0.2913, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.57% (0.6675 => 0.7047, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.43% (0.3092 => 0.3260, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.39% (5.7591 => 6.0696, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8067 => 0.8500, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9765 => 1.0270, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.12% (0.4299 => 0.4519, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2234, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.90% (1.5603 => 1.6368, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.1861 => 1.2430, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.56% (0.5020 => 0.5249, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 4.54% (3.8723 => 4.0480, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.52% (0.3387 => 0.3540, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.49% (1.0722 => 1.1203, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 4.41% (0.3422 => 0.3573, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.4064 => 0.4240, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (7.9617 => 8.3019, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.27% (0.4103 => 0.4278, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.23% (2.0273 => 2.1131, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3826 => 0.3983, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3650 => 0.3799, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.08% (0.2891 => 0.3009, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.4289 => 0.4461, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 3.99% (21.9371 => 22.8117, std. dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.5981 => 0.6218, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.2905 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.84% (2.2969 => 2.3850, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 3.82% (0.8921 => 0.9262, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.3098 => 0.3212, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.68% (0.4620 => 0.4790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4203 => 0.4357, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.4186 => 1.4705, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.3684 => 0.3818, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.58% (0.3603 => 0.3732, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (2.0665 => 2.1402, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.56% (1.5859 => 1.6424, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (14.3668 => 14.8758, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.08% (2.2024 => 2.2703, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.1840 => 1.2170, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2842 => 1.3131, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.8101 => 0.8252, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.36% (4.2280 => 4.3701, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0017) MultiSource/Benchmarks/llubenchmark/llu: 1.67% (3.7781 => 3.8413, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2367, std. dev.: 0.0083) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7614, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.00% (5.2763 => 3.2186, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.25% (5.3855 => 3.8641, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.92% (5.3526 => 3.8582, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1203, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.40% (2.9384 => 2.5741, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -9.87% (22.1758 => 19.9876, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2834, std. dev.: 0.1479) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std. dev.: 0.0018) MultiSource/Applications/siod/siod: -4.04% (3.2827 => 3.1500, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5038, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4271, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0017, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.28% (1.2373 => 1.2091, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -1.94% (4.6441 => 4.5542, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0030, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2266, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 18:21:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 20:21:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911012159.B0E7A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3646?compare_to=3643&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3646, Order: 163566, Start Time: 2012-09-11 00:08:56, End Time: 2012-09-11 01:23:14 To: 3643, Order: 163550, Start Time: 2012-09-10 22:26:37, End Time: 2012-09-10 23:40:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.29% (1.4894 => 1.5086, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (21.5631 => 21.7855, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 1.01% (4.8502 => 4.8992, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.15% (0.5391 => 0.5507, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.86% (2.0176 => 2.3981, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.26% (0.7061 => 0.7856, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.18% (0.7710 => 0.8495, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 10.17% (1.3693 => 1.5086, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.79% (3.9660 => 4.3542, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 9.78% (0.3578 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.57% (0.3646 => 0.3995, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.50% (0.3663 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.50% (0.3601 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.44% (0.3623 => 0.3965, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3914 => 0.4280, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.29% (0.4003 => 0.4375, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.16% (0.3940 => 0.4301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.94% (0.7038 => 0.7667, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.2193 => 1.3274, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.72% (0.9199 => 1.0001, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.61% (1.4563 => 1.5817, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.56% (0.6959 => 0.7555, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2309, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9341, std. dev.: 0.0098) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.95% (0.3899 => 0.4209, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.94% (0.5577 => 0.6020, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3485 => 0.3758, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (7.2180 => 7.7834, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2243 => 0.2416, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.66% (0.7506 => 0.8081, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.64% (0.3756 => 0.4043, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.4379 => 0.4712, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.56% (0.3293 => 0.3542, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (0.2914 => 0.3134, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3246 => 0.3490, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.33% (1.9828 => 2.1282, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2761 => 0.2963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.30% (1.1061 => 1.1868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.17% (0.4016 => 0.4304, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.16% (3.6692 => 3.9319, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.15% (0.5637 => 0.6040, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.09% (3.8646 => 4.1387, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.08% (0.2995 => 0.3207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3192 => 0.3415, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 6.96% (0.8310 => 0.8888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3868 => 0.4136, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.81% (0.3453 => 0.3688, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.4390 => 0.4686, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.61% (3.1889 => 3.3997, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.52% (1.3245 => 1.4108, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.51% (1.9270 => 2.0524, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 6.51% (2.1791 => 2.3209, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.31% (0.6576 => 0.6991, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.30% (1.3819 => 1.4690, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.30% (0.6744 => 0.7169, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.25% (1.3813 => 1.4676, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.6135 => 0.6512, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.08% (0.4113 => 0.4363, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.07% (4.4433 => 4.7131, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.06% (4.3801 => 4.6457, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.2859 => 0.3032, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.00% (1.0594 => 1.1230, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.99% (14.8535 => 15.7434, std. dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.2749 => 1.3512, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.96% (0.8698 => 0.9216, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.84% (0.2140 => 0.2265, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.84% (8.4961 => 8.9923, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 5.83% (16.6129 => 17.5812, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (13.2842 => 14.0457, std. dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.61% (1.1333 => 1.1969, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.55% (0.8818 => 0.9307, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.43% (0.3131 => 0.3301, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.24% (14.5298 => 15.2909, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (6.5754 => 6.9181, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.07% (4.6629 => 4.8992, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.2292 => 1.2901, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.75% (3.2742 => 3.4296, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4805 => 0.5009, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (1.5188 => 1.5810, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.08% (4.9865 => 5.1898, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 4.06% (3.7467 => 3.8989, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.04% (0.9108 => 0.9476, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 4.02% (0.6250 => 0.6501, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (6.2785 => 6.5058, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.1007 => 2.1750, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.16% (33.2944 => 34.3478, std. dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5158, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 25.70% (1.8175 => 2.2846, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.03% (1.2998 => 1.3782, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0780, std. dev.: 0.0199) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (0.5184 => 0.5333, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5954, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5875, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.02% (0.4657 => 0.4004, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.83% (0.2670 => 0.2541, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.44% (22.5627 => 21.7855, std. dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.31% (20.3410 => 18.2438, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.87% (1.3780 => 1.2971, std. dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5155, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0010) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7058, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9235, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.8259 => 8.5644, std. dev.: 0.0240) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2395, std. dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: -1.66% (4.5928 => 4.5167, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2402, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2304, std. dev.: 0.0355) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4327, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5641, std. dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2628, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 18:31:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 20:31:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911013100.73CE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3647?compare_to=3644&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3647, Order: 163571, Start Time: 2012-09-11 00:21:28, End Time: 2012-09-11 01:32:16 To: 3644, Order: 163556, Start Time: 2012-09-10 22:53:41, End Time: 2012-09-11 00:05:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (45 on baseline) Performance Improvements: 5 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 878 (816 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 5.05% (0.2913 => 0.3060, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.49% (0.2341 => 0.2446, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5629 => 0.5772, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.50% (0.4514 => 0.4627, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7840 => 0.7998, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 5.84% (3.0627 => 3.2415, std. dev.: 0.0486) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.17% (0.7577 => 0.7893, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.11% (2.3291 => 2.4015, std. dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (3.7589 => 3.8716, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.33% (0.3067 => 0.2965, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.81% (60.9945 => 59.2801, std. dev.: 0.6619) SingleSource/Benchmarks/Misc/mandel-2: -2.60% (3.1117 => 3.0308, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/richards_benchmark: -1.16% (1.3714 => 1.3555, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.02% (2.9619 => 2.9317, std. dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.6410 => 0.6749, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3582 => 0.3723, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3.63% (1.1653 => 1.2076, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.57% (0.7722 => 0.7998, std. dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 3.51% (2.1763 => 2.2526, std. dev.: 0.0192) MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 3.11% (0.3217 => 0.3317, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.5150 => 1.5517, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.7639 => 0.7800, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 1.92% (15.3105 => 15.6042, std. dev.: 0.0633) MultiSource/Applications/d/make_dparser: 1.73% (3.0225 => 3.0748, std. dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6069 => 0.6174, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.52% (1.1672 => 1.1849, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.35% (1.1827 => 1.1987, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Bubblesort: 38.78% (0.0263 => 0.0365, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std. dev.: 0.0147) SingleSource/Benchmarks/McGill/misr: 13.73% (0.4296 => 0.4886, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5528, std. dev.: 0.0191) MultiSource/Applications/sgefa/sgefa: 12.84% (0.3746 => 0.4227, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 12.53% (3.4406 => 3.8716, std. dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 11.72% (0.1433 => 0.1601, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6258, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.64% (1.0063 => 1.0731, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (3.4876 => 3.7054, std. dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.8011, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.98% (4.2129 => 4.4647, std. dev.: 0.0444) SingleSource/Benchmarks/Misc/fp-convert: 4.76% (15.2242 => 15.9489, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8390, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.73% (0.7609 => 0.7893, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 3.34% (1.4184 => 1.4658, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 2.59% (5.1938 => 5.3283, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.23% (0.5876 => 0.6007, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.98% (2.6656 => 2.7183, std. dev.: 0.0122) MultiSource/Applications/siod/siod: 1.79% (3.5520 => 3.6156, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (4.6127 => 4.6814, std. dev.: 0.0228) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5312, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6652, std. dev.: 0.0599) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.11% (38.9255 => 39.3586, std. dev.: 0.1122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.27% (5.2665 => 4.0936, std. dev.: 0.0437) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.08% (1.1647 => 0.9891, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.85% (1.4034 => 1.2792, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.39% (3.2007 => 2.9322, std. dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3653, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.16% (1.4021 => 1.3017, std. dev.: 0.0320) MultiSource/Applications/SIBsim4/SIBsim4: -6.87% (3.4230 => 3.1878, std. dev.: 0.0318) SingleSource/Benchmarks/Misc/richards_benchmark: -6.14% (1.4441 => 1.3555, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.90% (0.4140 => 0.3937, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0440) MultiSource/Benchmarks/mafft/pairlocalalign: -3.20% (62.4126 => 60.4155, std. dev.: 0.4311) SingleSource/Benchmarks/Shootout-C++/methcall: -3.16% (9.2503 => 8.9581, std. dev.: 0.0340) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.09% (61.1734 => 59.2801, std. dev.: 0.6619) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.07% (1.1683 => 1.1324, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std. dev.: 0.0159) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.36% (2.8964 => 2.8281, std. dev.: 0.0196) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.24% (1.8739 => 1.8319, std. dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9824, std. dev.: 0.1465) MultiSource/Benchmarks/FreeBench/neural/neural: -1.82% (1.0926 => 1.0727, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -1.55% (3.8907 => 3.8304, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (9.3855 => 9.2406, std. dev.: 0.0457) SingleSource/Benchmarks/Misc/oourafft: -1.53% (3.8200 => 3.7616, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3077, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/ary3: -1.14% (1.7473 => 1.7274, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 18:46:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 20:46:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120911014614.E7A7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3648?compare_to=3640&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3648, Order: 163556, Start Time: 2012-09-10 23:03:40, End Time: 2012-09-11 01:47:28 To: 3640, Order: 163534, Start Time: 2012-09-10 19:49:11, End Time: 2012-09-10 22:32:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.26% (5.7805 => 5.8533, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 1.02% (24.2818 => 24.5298, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.21% (2.0726 => 2.1185, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.72% (0.3465 => 0.3975, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.62% (0.3460 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.59% (0.3488 => 0.3997, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.59% (0.3496 => 0.4006, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 14.50% (0.3469 => 0.3972, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 14.05% (0.3643 => 0.4155, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.97% (0.3650 => 0.4160, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3724 => 0.4236, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.1620 => 0.1760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.55% (0.5826 => 0.6324, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.5889 => 0.6388, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.17% (3.5627 => 3.8180, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7171 => 0.7683, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (1.6211 => 1.7342, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.73% (1.3152 => 1.4037, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.71% (0.5900 => 0.6296, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.65% (1.5932 => 1.6992, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.56% (0.4361 => 0.4647, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.23% (0.4994 => 0.5305, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (0.3930 => 0.4174, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 6.01% (4.2109 => 4.4641, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.98% (0.5000 => 0.5299, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 5.68% (1.0781 => 1.1393, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 5.62% (5.5417 => 5.8533, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (2.7292 => 2.8793, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2875 => 0.3026, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.19% (0.3004 => 0.3160, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.13% (2.1013 => 2.2090, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.12% (0.3792 => 0.3986, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.10% (0.3195 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (1.9694 => 2.0697, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (0.4658 => 0.4893, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.94% (0.9909 => 1.0399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.94% (0.2813 => 0.2952, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.93% (1.9966 => 2.0950, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.89% (0.2738 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2823 => 0.2961, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.76% (0.2750 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.73% (0.2792 => 0.2924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2729 => 0.2858, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (1.8794 => 1.9682, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 4.71% (0.2780 => 0.2911, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.71% (2.0673 => 2.1646, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.3903 => 0.4086, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.67% (0.2911 => 0.3047, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3258 => 0.3407, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.51% (0.3060 => 0.3198, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3267 => 0.3414, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.48% (0.3124 => 0.3264, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.43% (0.7875 => 0.8224, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.43% (0.3317 => 0.3464, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.43% (0.3477 => 0.3631, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.35% (0.4139 => 0.4319, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (2.1653 => 2.2593, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3362 => 0.3507, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.3348 => 0.3492, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.29% (0.3726 => 0.3886, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.29% (23.5202 => 24.5298, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3678 => 0.3835, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.24% (1.4269 => 1.4874, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (0.3625 => 0.3778, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.21% (4.6177 => 4.8119, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (4.4195 => 4.6047, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.3084 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.3282 => 0.3417, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.10% (0.4146 => 0.4316, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.98% (0.5546 => 0.5767, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.2969 => 0.3086, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.93% (0.6634 => 0.6895, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4251 => 0.4417, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.90% (0.3690 => 0.3834, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.89% (0.9697 => 1.0074, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.3845 => 0.3992, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.3981 => 0.4126, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.42% (0.3336 => 0.3450, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.33% (0.5012 => 0.5179, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.6435 => 0.6647, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.32% (2.0346 => 2.0819, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (0.4847 => 0.4952, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (0.5361 => 0.5464, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (0.7426 => 0.7552, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (11.6398 => 11.7576, std. dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6794, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8974, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6404, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1968, std. dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5039, std. dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.75% (2.0820 => 2.1185, std. dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2273, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4465, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2913, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5885, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.04% (25.4195 => 16.5133, std. dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7768, std. dev.: 0.0279) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.91% (0.6293 => 0.6173, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9576, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 19:18:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 21:18:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911021806.7372C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3649?compare_to=3645&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3649, Order: 163574, Start Time: 2012-09-11 00:59:53, End Time: 2012-09-11 02:19:20 To: 3645, Order: 163558, Start Time: 2012-09-10 23:12:08, End Time: 2012-09-11 00:31:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (712 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.67% (1.2091 => 1.2293, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.90% (10.3673 => 14.5041, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 25.71% (0.1622 => 0.2039, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.93% (0.3497 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3516 => 0.3968, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.68% (2.2022 => 2.4814, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.49% (7.0540 => 7.9347, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.08% (0.1432 => 0.1605, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std. dev.: 0.0095) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.31% (1.7609 => 1.9425, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.07% (0.3282 => 0.3547, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.49% (0.8172 => 0.8784, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.99% (0.3177 => 0.3399, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.6030 => 0.6451, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.60% (9.4845 => 10.1109, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 6.58% (0.2554 => 0.2722, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.46% (0.4615 => 0.4913, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2271 => 0.2416, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 6.37% (0.7326 => 0.7793, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.33% (0.4879 => 0.5188, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (8.1363 => 8.6451, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 6.22% (10.4361 => 11.0853, std. dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 6.16% (0.7433 => 0.7891, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 6.14% (0.7835 => 0.8316, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 6.08% (0.3109 => 0.3298, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.99% (0.7115 => 0.7541, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.96% (1.5415 => 1.6334, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.90% (0.5860 => 0.6206, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (4.2646 => 4.5156, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.75% (0.5569 => 0.5889, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.68% (3.3354 => 3.5247, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.3050 => 1.3786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.56% (0.6675 => 0.7046, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.56% (1.5603 => 1.6470, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (5.0018 => 5.2793, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.52% (4.9449 => 5.2180, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (0.3092 => 0.3256, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.29% (0.5105 => 0.5375, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.8067 => 0.8489, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std. dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 5.08% (5.7591 => 6.0515, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9765 => 1.0258, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.03% (0.3817 => 0.4009, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.93% (0.4299 => 0.4511, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.82% (0.3422 => 0.3587, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.82% (1.1642 => 1.2203, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.77% (0.4636 => 0.4857, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (1.1861 => 1.2426, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.4103 => 0.4297, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 4.54% (3.8723 => 4.0481, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 4.46% (0.6456 => 0.6744, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.46% (0.2603 => 0.2719, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.41% (1.0722 => 1.1195, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.39% (0.2891 => 0.3018, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.37% (0.2905 => 0.3032, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 4.37% (0.3387 => 0.3535, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (7.9617 => 8.3015, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 4.24% (0.4289 => 0.4471, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.24% (0.3865 => 0.4029, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.24% (0.2831 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.22% (0.3650 => 0.3804, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.3826 => 0.3987, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.18% (2.0273 => 2.1120, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.14% (0.6450 => 0.6717, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.05% (0.3283 => 0.3416, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.3098 => 0.3223, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 4.03% (21.9371 => 22.8211, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3232 => 0.3362, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.02% (2.0665 => 2.1495, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.97% (0.2871 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.97% (0.2872 => 0.2986, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.96% (0.3052 => 0.3173, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.95% (0.4203 => 0.4369, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2756 => 0.2864, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4620 => 0.4800, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.89% (2.2969 => 2.3862, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.4048 => 0.4205, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3603 => 0.3742, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3684 => 0.3826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.76% (0.8921 => 0.9256, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5981 => 0.6203, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.68% (0.2802 => 0.2905, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.62% (14.3668 => 14.8868, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (1.4186 => 1.4688, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.41% (1.5859 => 1.6399, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.96% (2.2024 => 2.2675, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.55% (1.1840 => 1.2142, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.2842 => 1.3161, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.8101 => 0.8248, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0031) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (3.1578 => 3.3922, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3615, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7513, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std. dev.: 0.0326) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.13% (5.2763 => 3.2117, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.85% (5.3855 => 3.8318, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.46% (5.3526 => 3.8292, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1242, std. dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.45% (2.9384 => 2.5725, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.69% (22.1758 => 19.8044, std. dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.63% (19.9488 => 18.2278, std. dev.: 0.0400) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.87% (0.3463 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.44% (1.8329 => 1.7148, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1517, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5042, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4268, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5543, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0020, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 19:58:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 21:58:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911025806.9F8BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3650?compare_to=3647&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3650, Order: 163584, Start Time: 2012-09-11 01:48:11, End Time: 2012-09-11 02:59:22 To: 3647, Order: 163571, Start Time: 2012-09-11 00:21:28, End Time: 2012-09-11 01:32:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (47 on baseline) Performance Improvements: 1 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.96% (0.1744 => 0.1848, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.12% (1.2200 => 1.2337, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (0.3326 => 0.3511, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.75% (43.3429 => 44.9664, std. dev.: 0.4138) SingleSource/Benchmarks/Misc/mandel-2: 2.46% (3.0308 => 3.1053, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -2.20% (2.4015 => 2.3486, std. dev.: 0.0172) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.20% (0.1414 => 0.1530, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.26% (0.6410 => 0.6811, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.39% (0.3582 => 0.3775, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 4.63% (1.1653 => 1.2193, std. dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: 4.21% (2.1763 => 2.2680, std. dev.: 0.0298) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3217 => 0.3349, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.37% (0.6173 => 0.6381, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.5150 => 1.5564, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.63% (1.2021 => 1.2337, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.59% (29.3170 => 29.7827, std. dev.: 0.1462) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.1827 => 1.2014, std. dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (8.2186 => 8.3472, std. dev.: 0.0281) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 14.79% (1.7426 => 2.0003, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.34% (4.0101 => 4.5850, std. dev.: 0.0087) SingleSource/Benchmarks/McGill/misr: 13.97% (0.4296 => 0.4896, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 12.66% (3.4406 => 3.8761, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 10.89% (0.1433 => 0.1589, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.98% (0.2694 => 0.2936, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 8.86% (7.0025 => 7.6232, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.44% (0.2857 => 0.3098, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 7.08% (1.0194 => 1.0916, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.02% (1.0063 => 1.0769, std. dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (0.3301 => 0.3511, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (3.4876 => 3.6974, std. dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8028, std. dev.: 0.0375) SingleSource/Benchmarks/Misc/fp-convert: 4.42% (15.2242 => 15.8966, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.92% (40.4792 => 42.0678, std. dev.: 0.5266) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 3.22% (1.4184 => 1.4641, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 3.13% (8.5113 => 8.7781, std. dev.: 0.0375) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.85% (2.6656 => 2.7415, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.84% (0.5876 => 0.6043, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 2.62% (5.1938 => 5.3299, std. dev.: 0.0214) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.20% (4.6127 => 4.7143, std. dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.4455 => 2.4874, std. dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 1.68% (6.9722 => 7.0896, std. dev.: 0.0419) MultiSource/Applications/siod/siod: 1.54% (3.5520 => 3.6067, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (2.4971 => 2.5350, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 1.36% (14.4877 => 14.6849, std. dev.: 0.0194) MultiSource/Benchmarks/Olden/bh/bh: 1.23% (2.5166 => 2.5476, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.21% (1.6110 => 1.6305, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.09% (0.7738 => 0.7576, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.24% (5.2665 => 4.0951, std. dev.: 0.0434) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.89% (1.1647 => 0.9913, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.45% (3.2007 => 2.9624, std. dev.: 0.0228) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3653, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/distray/distray: -6.68% (0.2664 => 0.2486, std. dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: -6.65% (3.4230 => 3.1953, std. dev.: 0.0236) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.25% (0.4140 => 0.3964, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.97% (2.4457 => 2.3486, std. dev.: 0.0172) MultiSource/Benchmarks/mafft/pairlocalalign: -3.42% (62.4126 => 60.2768, std. dev.: 0.5414) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9455, std. dev.: 0.0321) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.28% (3.7496 => 3.6268, std. dev.: 0.0249) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.02% (1.7361 => 1.6837, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1354, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2946, std. dev.: 0.0052) MultiSource/Applications/aha/aha: -2.51% (3.4286 => 3.3426, std. dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (92.7467 => 90.9782, std. dev.: 0.3242) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (9.3855 => 9.2418, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7648, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3171, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: -1.31% (6.7458 => 6.6573, std. dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/lists: -1.08% (16.5617 => 16.3833, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 20:06:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 22:06:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911030633.272852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3651?compare_to=3646&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3651, Order: 163584, Start Time: 2012-09-11 01:53:29, End Time: 2012-09-11 03:07:47 To: 3646, Order: 163566, Start Time: 2012-09-11 00:08:56, End Time: 2012-09-11 01:23:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.5503 => 56.6143, std. dev.: 0.0521) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.44% (2.0176 => 2.4098, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7061 => 0.7809, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.97% (0.7710 => 0.8479, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.75% (3.9660 => 4.3525, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 9.61% (0.3578 => 0.3922, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.60% (1.3693 => 1.5008, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.33% (0.3601 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3789 => 0.4139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3650 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.14% (0.3623 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.96% (0.4328 => 0.4716, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.85% (0.7038 => 0.7661, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.65% (0.9199 => 0.9995, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.59% (1.2193 => 1.3240, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.48% (0.6959 => 0.7549, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.41% (0.2781 => 0.3015, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.32% (1.4563 => 1.5774, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.09% (1.1364 => 1.2283, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.08% (0.3899 => 0.4214, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.05% (0.2782 => 0.3006, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.97% (0.2760 => 0.2980, std. dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 7.96% (13.8202 => 14.9198, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.85% (0.5577 => 0.6015, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.85% (0.2127 => 0.2294, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.76% (0.2937 => 0.3165, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.74% (0.3489 => 0.3759, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.72% (0.3485 => 0.3754, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.71% (0.2607 => 0.2808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.68% (0.3293 => 0.3546, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.57% (7.2180 => 7.7646, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3756 => 0.4040, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.55% (0.7506 => 0.8073, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.54% (1.9828 => 2.1324, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.54% (0.3580 => 0.3850, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.50% (0.2655 => 0.2854, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.48% (0.2726 => 0.2930, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6283 => 0.6753, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.42% (0.2761 => 0.2966, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.42% (0.2628 => 0.2823, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.42% (1.0313 => 1.1078, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.41% (0.2765 => 0.2970, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.34% (0.2914 => 0.3128, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.30% (0.3246 => 0.3483, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.25% (0.4016 => 0.4307, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3192 => 0.3423, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.21% (1.1061 => 1.1859, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3107 => 0.3331, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.21% (0.3149 => 0.3376, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std. dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.06% (0.2988 => 0.3199, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 7.01% (0.2925 => 0.3130, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5637 => 0.6031, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.95% (0.3868 => 0.4137, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.93% (3.8646 => 4.1325, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (3.6692 => 3.9225, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 6.88% (0.2995 => 0.3201, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 6.81% (0.8310 => 0.8876, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.81% (0.4390 => 0.4689, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3534 => 0.3773, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.51% (0.7460 => 0.7946, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.43% (3.1889 => 3.3938, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.42% (1.3245 => 1.4095, std. dev.: 0.0084) MultiSource/Applications/treecc/treecc: 6.36% (1.9270 => 2.0496, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 6.29% (2.1791 => 2.3162, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.29% (0.6744 => 0.7168, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 6.16% (0.2859 => 0.3035, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.07% (1.3819 => 1.4658, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.99% (1.3813 => 1.4640, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 5.95% (1.0594 => 1.1224, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4113 => 0.4356, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.89% (0.6576 => 0.6963, std. dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 5.86% (1.2749 => 1.3496, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.85% (4.4433 => 4.7032, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.81% (0.8698 => 0.9203, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.79% (4.3801 => 4.6335, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 5.74% (16.6129 => 17.5664, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.73% (0.3755 => 0.3970, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.67% (0.6135 => 0.6483, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.65% (0.2140 => 0.2261, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.64% (14.8535 => 15.6912, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.55% (13.2842 => 14.0220, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.49% (1.1333 => 1.1955, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.41% (8.4961 => 8.9560, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.17% (14.5298 => 15.2813, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.98% (0.8818 => 0.9257, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.2292 => 1.2900, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.90% (6.5754 => 6.8977, std. dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 4.89% (4.6629 => 4.8909, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.53% (3.2742 => 3.4225, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.20% (0.4805 => 0.5007, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.05% (0.6250 => 0.6503, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (1.5188 => 1.5787, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.92% (0.9108 => 0.9465, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1745, std. dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.74% (2.1007 => 2.1792, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 3.71% (3.7467 => 3.8857, std. dev.: 0.0126) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (6.2785 => 6.4832, std. dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 3.08% (33.2944 => 34.3210, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4671, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std. dev.: 0.0476) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4123, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0696, std. dev.: 0.0241) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.5184 => 0.5332, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5982, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5905, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.85% (22.5627 => 21.6946, std. dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2664, std. dev.: 0.0184) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3002, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9244, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6124, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.64% (4.5928 => 4.5175, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2439, std. dev.: 0.0108) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4322, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 21:05:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 23:05:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911040547.C45C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3652?compare_to=3649&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3652, Order: 163587, Start Time: 2012-09-11 02:47:37, End Time: 2012-09-11 04:07:01 To: 3649, Order: 163574, Start Time: 2012-09-11 00:59:53, End Time: 2012-09-11 02:19:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (133 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (2.4814 => 2.5126, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (11.0853 => 11.2165, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.09% (3.8292 => 3.8708, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (3.8318 => 3.8724, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.03% (55.1049 => 56.2210, std. dev.: 0.2438) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.84% (80.2450 => 78.7700, std. dev.: 0.3362) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.80% (10.3673 => 14.5971, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 26.39% (0.1622 => 0.2050, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.09% (2.2022 => 2.5126, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.47% (7.0540 => 8.0042, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 13.27% (0.3473 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.95% (0.3497 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3516 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.69% (0.3561 => 0.4013, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.43% (0.3694 => 0.4153, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.25% (1.1194 => 1.2565, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.10% (0.3927 => 0.4402, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.89% (0.3886 => 0.4348, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.26% (1.7609 => 1.9592, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 9.63% (0.3282 => 0.3598, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.6030 => 0.6507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5925 => 0.6389, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.48% (10.4361 => 11.2165, std. dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: 7.39% (9.4845 => 10.1853, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.8172 => 0.8739, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.70% (0.7326 => 0.7817, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.57% (8.1363 => 8.6710, std. dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3423 => 0.3643, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (4.2646 => 4.5359, std. dev.: 0.0106) MultiSource/Applications/minisat/minisat: 6.28% (0.7115 => 0.7562, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.23% (0.7433 => 0.7896, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.20% (0.6675 => 0.7089, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.14% (0.7835 => 0.8316, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5860 => 0.6218, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 6.10% (5.7591 => 6.1104, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.05% (1.5415 => 1.6347, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.03% (0.5105 => 0.5413, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.02% (5.0018 => 5.3031, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.02% (4.9449 => 5.2424, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.01% (3.3354 => 3.5359, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.99% (1.3050 => 1.3832, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5569 => 0.5899, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.44% (0.4299 => 0.4533, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.43% (0.8067 => 0.8505, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9765 => 1.0292, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.32% (1.5603 => 1.6433, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.1861 => 1.2476, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 5.07% (1.1642 => 1.2232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.98% (0.3817 => 0.4007, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2603 => 0.2731, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (7.9617 => 8.3477, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.80% (0.5020 => 0.5261, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.78% (1.0722 => 1.1235, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.76% (3.8723 => 4.0566, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.4064 => 0.4252, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.56% (0.6450 => 0.6744, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 4.44% (0.3422 => 0.3574, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.40% (0.6456 => 0.6740, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.38% (0.4636 => 0.4839, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.34% (2.0273 => 2.1153, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 4.29% (0.8921 => 0.9304, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.29% (21.9371 => 22.8775, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.27% (0.4103 => 0.4278, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.24% (0.4289 => 0.4471, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5981 => 0.6232, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.17% (0.3865 => 0.4026, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.03% (2.2969 => 2.3895, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (14.3668 => 14.9403, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.95% (0.4203 => 0.4369, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.86% (0.3650 => 0.3791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2831 => 0.2940, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4729, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3935 => 0.4084, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.74% (0.3052 => 0.3166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4620 => 0.4792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3603 => 0.3737, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5859 => 1.6444, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary3: 3.69% (0.3283 => 0.3404, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.66% (0.2756 => 0.2857, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3232 => 0.3349, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.61% (0.4048 => 0.4194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0665 => 2.1409, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.3098 => 0.3209, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.2024 => 2.2746, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.1840 => 1.2204, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2842 => 1.3131, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.8101 => 0.8283, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.18% (3.1578 => 3.3845, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3635, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2106, std. dev.: 0.0251) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.53% (5.2763 => 3.2436, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.10% (5.3855 => 3.8724, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.68% (5.3526 => 3.8708, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2222, std. dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.77% (2.9384 => 2.5926, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.54% (22.1758 => 19.8393, std. dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.60% (1.5373 => 1.3744, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2718, std. dev.: 0.1063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.87% (0.3463 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7152, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.17% (8.6802 => 8.4051, std. dev.: 0.0179) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5073, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9936, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.70% (1.2373 => 1.2039, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9865, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: -1.97% (4.6441 => 4.5528, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 21:25:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 23:25:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911042528.67F782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3653?compare_to=3650&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3653, Order: 163592, Start Time: 2012-09-11 03:15:44, End Time: 2012-09-11 04:26:45 To: 3650, Order: 163584, Start Time: 2012-09-11 01:48:11, End Time: 2012-09-11 02:59:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (50 on baseline) Performance Improvements: 3 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.4150 => 1.4317, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.17% (1.8767 => 1.8987, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 17.62% (3.0424 => 3.5784, std. dev.: 0.0917) MultiSource/Benchmarks/FreeBench/distray/distray: 6.07% (0.2486 => 0.2637, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 2.83% (2.3507 => 2.4172, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.16% (60.2870 => 60.9838, std. dev.: 0.2082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.39% (1.2337 => 1.2165, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.48% (2.0418 => 1.9912, std. dev.: 0.0191) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.55% (2.5984 => 2.5580, std. dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.07% (0.6410 => 0.6735, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3582 => 0.3738, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 3.97% (1.1653 => 1.2116, std. dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 3.93% (2.1763 => 2.2619, std. dev.: 0.0154) MultiSource/Applications/minisat/minisat: 3.76% (0.6173 => 0.6405, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 3.68% (1.0046 => 1.0416, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.5150 => 1.5620, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.27% (0.5937 => 0.6072, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (1.3935 => 1.4221, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.73% (0.7226 => 0.7351, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.65% (6.2546 => 6.3577, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.57% (1.1827 => 1.2013, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.55% (1.1672 => 1.1853, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.4113 => 1.4317, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (4.0318 => 4.0878, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (12.6413 => 12.7930, std. dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.08% (8.2559 => 8.3448, std. dev.: 0.0212) MultiSource/Applications/treecc/treecc: 1.01% (1.8798 => 1.8987, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.87% (1.6538 => 2.3297, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 21.96% (3.4629 => 4.2234, std. dev.: 0.0272) SingleSource/Benchmarks/Shootout/ary3: 15.16% (1.7426 => 2.0068, std. dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.72% (4.0101 => 4.5601, std. dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 12.23% (0.3746 => 0.4204, std. dev.: 0.0059) SingleSource/Benchmarks/McGill/misr: 11.59% (0.4296 => 0.4794, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 11.27% (3.2159 => 3.5784, std. dev.: 0.0917) SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1433 => 0.1583, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6206, std. dev.: 0.0333) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.84% (0.2857 => 0.3081, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.08% (1.0063 => 1.0775, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 6.29% (3.4876 => 3.7070, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (0.3301 => 0.3507, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7912, std. dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.55% (40.4792 => 42.7238, std. dev.: 0.3102) SingleSource/Benchmarks/Misc/fp-convert: 4.41% (15.2242 => 15.8960, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 3.07% (2.3453 => 2.4172, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 2.82% (8.5113 => 8.7516, std. dev.: 0.0463) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.28% (2.6656 => 2.7264, std. dev.: 0.0193) MultiSource/Benchmarks/BitBench/five11/five11: 2.03% (5.1938 => 5.2991, std. dev.: 0.0328) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.91% (4.6127 => 4.7008, std. dev.: 0.0187) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5321, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 1.37% (29.5232 => 29.9265, std. dev.: 0.0159) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6683, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 1.21% (2.5166 => 2.5470, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.40% (0.7738 => 0.7630, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.05% (5.2665 => 4.1050, std. dev.: 0.0589) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.18% (1.1647 => 0.9879, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std. dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.61% (1.4034 => 1.2825, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9383, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3658, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -6.89% (3.4230 => 3.1870, std. dev.: 0.0304) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.33% (2.4457 => 2.3154, std. dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0340) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.00% (45.4683 => 43.6496, std. dev.: 0.6011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.36% (1.7361 => 1.6777, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.35% (1.1683 => 1.1292, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6277, std. dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (9.2503 => 8.9585, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2850, std. dev.: 0.0112) MultiSource/Benchmarks/PAQ8p/paq8p: -2.62% (92.7467 => 90.3122, std. dev.: 0.6987) MultiSource/Applications/aha/aha: -2.52% (3.4286 => 3.3423, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: -2.16% (1.0926 => 1.0690, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -2.01% (62.4126 => 61.1607, std. dev.: 0.3823) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (9.3855 => 9.2140, std. dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.55% (2.5984 => 2.5580, std. dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3091, std. dev.: 0.0174) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 21:49:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 23:49:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911044911.C12522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3654?compare_to=3651&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3654, Order: 163593, Start Time: 2012-09-11 03:36:14, End Time: 2012-09-11 04:50:25 To: 3651, Order: 163584, Start Time: 2012-09-11 01:53:29, End Time: 2012-09-11 03:07:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.21% (80.5543 => 78.7739, std. dev.: 0.6569) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.76% (2.0176 => 2.3961, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.57% (0.5748 => 0.6413, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.23% (0.7061 => 0.7854, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.70% (0.7710 => 0.8458, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3578 => 0.3921, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.49% (3.9660 => 4.3424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.44% (0.3623 => 0.3965, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.42% (1.3693 => 1.4983, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3601 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3646 => 0.3989, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.38% (0.3914 => 0.4281, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3650 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.36% (0.3663 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.14% (0.3940 => 0.4300, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5265 => 0.5734, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 8.81% (0.7038 => 0.7658, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.54% (1.2193 => 1.3234, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.52% (0.6959 => 0.7552, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.49% (0.9199 => 0.9980, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.14% (1.4563 => 1.5749, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.06% (1.1364 => 1.2280, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.2721 => 0.2940, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 7.71% (13.8202 => 14.8853, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.67% (0.5577 => 0.6005, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.65% (0.3293 => 0.3545, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3756 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.58% (0.3485 => 0.3749, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.50% (0.6283 => 0.6754, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1589 => 0.1708, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.42% (0.4379 => 0.4704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.36% (7.2180 => 7.7491, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.34% (1.9828 => 2.1284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.28% (0.2761 => 0.2962, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 7.27% (0.7506 => 0.8052, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.23% (1.0313 => 1.1059, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.02% (0.3246 => 0.3474, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.95% (0.3192 => 0.3414, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3868 => 0.4134, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.86% (1.1061 => 1.1820, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.85% (0.5637 => 0.6023, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8310 => 0.8878, std. dev.: 0.0123) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 6.79% (3.8646 => 4.1270, std. dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.4390 => 0.4686, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.71% (3.6692 => 3.9155, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.34% (0.7460 => 0.7933, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 6.31% (3.1889 => 3.3902, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 6.31% (2.1791 => 2.3166, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: 6.27% (0.6744 => 0.7167, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.22% (1.3245 => 1.4069, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 6.11% (0.2945 => 0.3125, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.11% (1.9270 => 2.0447, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.83% (1.3813 => 1.4618, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1210, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.78% (1.3819 => 1.4618, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.76% (4.4433 => 4.6991, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 5.75% (1.2749 => 1.3482, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.3801 => 4.6305, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.71% (0.8698 => 0.9195, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.71% (0.4113 => 0.4348, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.68% (16.6129 => 17.5571, std. dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.56% (0.6135 => 0.6476, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.47% (14.8535 => 15.6657, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 5.46% (8.4961 => 8.9596, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (1.1333 => 1.1932, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (13.2842 => 13.9851, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.25% (0.6576 => 0.6921, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2698, std. dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.09% (0.8818 => 0.9267, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.05% (0.3131 => 0.3289, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2895, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 4.86% (4.6629 => 4.8895, std. dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (6.5754 => 6.8790, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.36% (3.2742 => 3.4170, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.27% (0.4805 => 0.5010, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5781, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6250 => 0.6493, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.87% (4.9865 => 5.1795, std. dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.75% (0.9108 => 0.9450, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.71% (3.7467 => 3.8857, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.62% (2.1007 => 2.1767, std. dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (6.2785 => 6.4713, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 3.03% (33.2944 => 34.3031, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4944, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0981, std. dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.76% (0.5184 => 0.5327, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.17% (3.1071 => 3.1433, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.15% (1.4298 => 1.4463, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.06% (0.4657 => 0.4002, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.7012, std. dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.33% (20.3410 => 18.2398, std. dev.: 0.0418) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.78% (1.3780 => 1.2984, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5108, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7058, std. dev.: 0.0105) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9224, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5825, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2426, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5198, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2392, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2262, std. dev.: 0.0314) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2610, std. dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4359, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 21:58:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Sep 2012 23:58:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120911045811.32D382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3655?compare_to=3648&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3655, Order: 163586, Start Time: 2012-09-11 02:15:40, End Time: 2012-09-11 04:59:26 To: 3648, Order: 163556, Start Time: 2012-09-10 23:03:40, End Time: 2012-09-11 01:47:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (125 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.20% (2.4824 => 2.5123, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.03% (125.5590 => 129.3595, std. dev.: 0.9861) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.17% (54.2239 => 54.8569, std. dev.: 0.1081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.51% (0.3446 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.44% (0.3469 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.41% (0.3442 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 14.34% (0.3460 => 0.3956, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.5889 => 0.6429, std. dev.: 0.0054) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5826 => 0.6357, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.68% (1.5932 => 1.7156, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7171 => 0.7721, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (1.6211 => 1.7376, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (3.5627 => 3.8117, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.65% (0.4994 => 0.5326, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.65% (1.3152 => 1.4026, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.58% (0.4361 => 0.4648, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.55% (0.5026 => 0.5355, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (0.3930 => 0.4186, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.2014 => 0.2143, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.14% (4.2109 => 4.4693, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.5000 => 0.5305, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.06% (0.3004 => 0.3186, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.5900 => 0.6253, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 5.93% (1.0781 => 1.1420, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.84% (0.2875 => 0.3043, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.83% (0.4029 => 0.4264, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3195 => 0.3381, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.67% (0.2714 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.67% (0.2750 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2823 => 0.2983, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2813 => 0.2972, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.64% (5.5417 => 5.8545, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2738 => 0.2890, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.2866 => 0.3025, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.3625 => 0.3826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.52% (0.2792 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.50% (0.2729 => 0.2879, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.46% (0.9909 => 1.0450, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3267 => 0.3445, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2803 => 0.2955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.40% (0.2780 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2911 => 0.3067, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3258 => 0.3432, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.2736 => 0.2882, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (2.0673 => 2.1771, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.30% (0.2811 => 0.2960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.30% (0.3096 => 0.3260, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3124 => 0.3289, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3348 => 0.3524, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3060 => 0.3219, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (0.3890 => 0.4091, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.11% (0.2566 => 0.2697, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (2.7292 => 2.8682, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 5.06% (0.3317 => 0.3485, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.00% (0.3477 => 0.3651, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (1.9694 => 2.0676, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 4.97% (0.3726 => 0.3911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.92% (0.4658 => 0.4887, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (1.9966 => 2.0936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.84% (0.3678 => 0.3856, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.81% (4.4195 => 4.6319, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.77% (2.1013 => 2.2016, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3690 => 0.3863, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.67% (0.6634 => 0.6944, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4146 => 0.4338, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.3084 => 0.3226, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (1.8794 => 1.9659, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.3903 => 0.4081, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 4.55% (1.4269 => 1.4918, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 4.54% (0.4251 => 0.4444, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (2.1653 => 2.2636, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 4.48% (23.5202 => 24.5734, std. dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 4.47% (4.6177 => 4.8240, std. dev.: 0.0067) MultiSource/Applications/hbd/hbd: 4.42% (0.9697 => 1.0126, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.4139 => 0.4322, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.41% (0.7875 => 0.8222, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.3981 => 0.4156, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.3845 => 0.4014, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.24% (0.2737 => 0.2853, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.13% (0.3271 => 0.3406, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.09% (0.5546 => 0.5773, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.08% (0.3336 => 0.3472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.98% (0.6435 => 0.6691, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.85% (0.5012 => 0.5205, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (0.2691 => 0.2791, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.2969 => 0.3076, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.14% (2.0346 => 2.0984, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 2.83% (0.4847 => 0.4984, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (0.5361 => 0.5504, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (0.7426 => 0.7616, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (0.5584 => 0.5700, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (11.6398 => 11.8497, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.55% (4.6926 => 4.7655, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: 1.45% (2.4764 => 2.5123, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6745, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std. dev.: 0.1335) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6447, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2033, std. dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std. dev.: 0.0271) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4415, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2812, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5875, std. dev.: 0.0258) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5305, std. dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8152, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9567, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8031, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7842, std. dev.: 0.0563) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6293 => 0.6164, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5806, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9562, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 22:51:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 00:51:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911055143.1644C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3656?compare_to=3653&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3656, Order: 163593, Start Time: 2012-09-11 04:42:25, End Time: 2012-09-11 05:53:00 To: 3653, Order: 163592, Start Time: 2012-09-11 03:15:44, End Time: 2012-09-11 04:26:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (51 on baseline) Performance Improvements: 4 (43 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (797 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.66% (8.6605 => 9.1504, std. dev.: 0.1576) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 14.78% (3.4104 => 3.9146, std. dev.: 0.1661) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.31% (0.7785 => 0.8821, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 6.85% (3.6308 => 3.8796, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.76% (1.7843 => 1.8514, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.81% (3.6277 => 3.6933, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: 1.49% (6.1910 => 6.2831, std. dev.: 0.0324) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.21% (42.7238 => 43.2387, std. dev.: 0.1602) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.86% (0.9041 => 0.8782, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.40% (0.5785 => 0.5646, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.40% (0.7351 => 0.7248, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.65% (1.6178 => 1.5911, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.48% (0.6410 => 0.6697, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3582 => 0.3729, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3.64% (1.1653 => 1.2077, std. dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: 3.63% (2.1763 => 2.2553, std. dev.: 0.0253) MultiSource/Applications/lemon/lemon: 3.40% (1.0046 => 1.0388, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: 3.19% (0.6173 => 0.6370, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.00% (1.1440 => 1.1669, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.7639 => 0.7785, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.78% (3.0225 => 3.0763, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.33% (1.1827 => 1.1984, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.29% (4.7455 => 4.8068, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.29% (13.3238 => 13.4951, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (12.6413 => 12.7909, std. dev.: 0.0453) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (8.2186 => 8.3120, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0149) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.80% (0.0766 => 0.0910, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.14% (0.0917 => 0.1065, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9997, std. dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.55% (4.0101 => 4.5536, std. dev.: 0.0109) SingleSource/Benchmarks/McGill/misr: 13.34% (0.4296 => 0.4869, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 12.76% (3.4406 => 3.8796, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.10% (0.2694 => 0.2966, std. dev.: 0.0066) SingleSource/Benchmarks/Stanford/Puzzle: 8.79% (0.1433 => 0.1559, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6053, std. dev.: 0.0192) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.12% (0.2857 => 0.3089, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.85% (0.3301 => 0.3527, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.82% (40.4792 => 43.2387, std. dev.: 0.1602) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8176, std. dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (3.4876 => 3.6931, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.16% (0.7609 => 0.8002, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8530, std. dev.: 0.0409) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.80% (0.8498 => 0.8821, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.52% (6.6312 => 6.8646, std. dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 2.98% (1.4184 => 1.4607, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/five11/five11: 2.81% (5.1938 => 5.3398, std. dev.: 0.0235) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.81% (2.6656 => 2.7405, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 2.47% (8.5113 => 8.7214, std. dev.: 0.0557) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.59% (4.6127 => 4.6860, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4455 => 2.4842, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.42% (29.5232 => 29.9436, std. dev.: 0.0085) MultiSource/Applications/siod/siod: 1.39% (3.5520 => 3.6013, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.36% (1.6110 => 1.6329, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6676, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 1.14% (2.5166 => 2.5452, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.77% (0.2080 => 0.1960, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.52% (0.4596 => 0.4434, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.74% (0.9029 => 0.8782, std. dev.: 0.0089) MultiSource/Applications/spiff/spiff: -1.86% (0.7738 => 0.7594, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.56% (5.2665 => 4.1308, std. dev.: 0.0717) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9896, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0428) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.87% (3.2007 => 2.9489, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.25% (3.6254 => 3.3627, std. dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: -6.99% (3.4230 => 3.1837, std. dev.: 0.0333) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3532, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4082, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.91% (2.4457 => 2.3501, std. dev.: 0.0274) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.60% (1.2959 => 1.2493, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.10% (1.7361 => 1.6822, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.09% (1.2722 => 1.2329, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.06% (45.4683 => 44.0754, std. dev.: 0.3816) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.02% (1.1683 => 1.1330, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -3.00% (9.2503 => 8.9724, std. dev.: 0.0149) MultiSource/Applications/aha/aha: -2.79% (3.4286 => 3.3328, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -2.79% (92.7467 => 90.1572, std. dev.: 0.4569) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2860, std. dev.: 0.0155) MultiSource/Benchmarks/mafft/pairlocalalign: -1.99% (62.4126 => 61.1733, std. dev.: 0.1236) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.96% (2.8964 => 2.8395, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.91% (0.6119 => 0.6002, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -1.90% (1.7330 => 1.7000, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2261, std. dev.: 0.0390) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.50% (3.7496 => 3.6933, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7656, std. dev.: 0.0079) MultiSource/Benchmarks/sim/sim: -1.40% (3.8907 => 3.8364, std. dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3094, std. dev.: 0.0354) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3569 => 2.3255, std. dev.: 0.0111) MultiSource/Benchmarks/llubenchmark/llu: -1.27% (2.0192 => 1.9936, std. dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6639, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.20% (1.8739 => 1.8514, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: -1.01% (2.8599 => 2.8309, std. dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 22:53:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 00:53:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911055320.705D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3657?compare_to=3652&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3657, Order: 163593, Start Time: 2012-09-11 04:35:13, End Time: 2012-09-11 05:54:35 To: 3652, Order: 163587, Start Time: 2012-09-11 02:47:37, End Time: 2012-09-11 04:07:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (139 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.03% (78.7700 => 80.3661, std. dev.: 0.2978) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (14.5971 => 14.3286, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.21% (56.2210 => 54.4182, std. dev.: 0.5132) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.21% (10.3673 => 14.3286, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.85% (2.2022 => 2.5071, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.53% (0.3473 => 0.3943, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.47% (7.0540 => 8.0045, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.32% (0.3543 => 0.4015, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.21% (0.3497 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.11% (0.3516 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3543 => 0.4006, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3561 => 0.4026, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3828 => 0.4302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3927 => 0.4410, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.13% (1.1194 => 1.2552, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.98% (1.7609 => 1.9543, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.3282 => 0.3585, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5925 => 0.6423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.78% (0.6030 => 0.6499, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.27% (10.4361 => 11.1946, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (9.4845 => 10.1708, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 7.17% (0.7326 => 0.7851, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.75% (0.8172 => 0.8724, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.56% (0.7115 => 0.7582, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.4615 => 0.4915, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (8.1363 => 8.6635, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3423 => 0.3644, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7433 => 0.7912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5860 => 0.6223, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.6675 => 0.7086, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.12% (5.0018 => 5.3079, std. dev.: 0.0130) MultiSource/Applications/d/make_dparser: 6.12% (3.3354 => 3.5395, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (4.2646 => 4.5255, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.12% (1.5415 => 1.6358, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 6.11% (5.7591 => 6.1107, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2107 => 0.2234, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.98% (4.9449 => 5.2408, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.3050 => 1.3830, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3121 => 0.3306, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.92% (0.7835 => 0.8299, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5569 => 0.5898, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.3092 => 0.3271, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2758 => 0.2914, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.48% (0.8067 => 0.8509, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9765 => 1.0287, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4299 => 0.4527, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.24% (0.3817 => 0.4017, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.14% (1.5603 => 1.6405, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.08% (1.1642 => 1.2233, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (1.1861 => 1.2459, std. dev.: 0.0147) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.90% (0.5020 => 0.5266, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.80% (1.0722 => 1.1237, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 4.76% (3.8723 => 4.0568, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4636 => 0.4849, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.57% (0.6450 => 0.6745, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (7.9617 => 8.3243, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6456 => 0.6745, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.48% (21.9371 => 22.9189, std. dev.: 0.0194) MultiSource/Applications/treecc/treecc: 4.44% (2.0273 => 2.1174, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 4.44% (0.3422 => 0.3574, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.4103 => 0.4280, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.20% (0.2905 => 0.3027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.19% (0.3865 => 0.4027, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.18% (2.2969 => 2.3929, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5981 => 0.6228, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.11% (0.8921 => 0.9288, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.4203 => 0.4374, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3650 => 0.3796, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3826 => 0.3979, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.99% (0.4289 => 0.4460, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (14.3668 => 14.9363, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/matrix: 3.91% (0.3098 => 0.3219, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.83% (0.3603 => 0.3741, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.80% (0.3162 => 0.3282, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.74% (0.2756 => 0.2859, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.73% (0.3136 => 0.3253, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2871 => 0.2978, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.4186 => 1.4712, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2872 => 0.2978, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (1.5859 => 1.6433, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0665 => 2.1406, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (2.2024 => 2.2788, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.3052 => 0.3157, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.1840 => 1.2218, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.27% (1.2842 => 1.3134, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.8101 => 0.8268, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.8922 => 3.9350, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3733, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7484, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2278, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7607, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.47% (5.2763 => 3.2463, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.32% (5.3855 => 3.8603, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.05% (5.3526 => 3.8512, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1682, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.86% (2.9384 => 2.5900, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.39% (22.1758 => 19.8720, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.83% (1.5373 => 1.3708, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (19.9488 => 18.2454, std. dev.: 0.0618) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.87% (0.3463 => 0.3225, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0019) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1498, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5078, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -2.88% (10.2830 => 9.9868, std. dev.: 0.0122) SingleSource/Benchmarks/McGill/chomp: -2.84% (1.2373 => 1.2021, std. dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.6802 => 8.4367, std. dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.97% (4.6441 => 4.5525, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0013, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.37% (6.2999 => 6.2136, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 10 23:31:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 01:31:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911063142.E2A0A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3658?compare_to=3654&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3658, Order: 163594, Start Time: 2012-09-11 05:18:35, End Time: 2012-09-11 06:32:57 To: 3654, Order: 163593, Start Time: 2012-09-11 03:36:14, End Time: 2012-09-11 04:50:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.51% (0.3968 => 0.4147, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (78.7739 => 80.5120, std. dev.: 0.4825) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.75% (2.0176 => 2.3960, std. dev.: 0.0167) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.68% (0.7061 => 0.7886, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.90% (0.7710 => 0.8473, std. dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.61% (0.3578 => 0.3922, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.48% (3.9660 => 4.3420, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3789 => 0.4146, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.41% (1.3693 => 1.4982, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 9.36% (0.3663 => 0.4006, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.36% (0.2596 => 0.2839, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3646 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3623 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3914 => 0.4274, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.88% (0.3940 => 0.4290, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5265 => 0.5731, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.75% (0.7038 => 0.7654, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.60% (0.9199 => 0.9990, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.49% (1.2193 => 1.3228, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.2721 => 0.2948, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.25% (0.6959 => 0.7533, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.17% (1.4563 => 1.5753, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.12% (1.1364 => 1.2287, std. dev.: 0.0077) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.73% (13.8202 => 14.8884, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hello: 7.71% (0.2607 => 0.2808, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.63% (0.3580 => 0.3853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.62% (0.2690 => 0.2895, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2127 => 0.2289, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.59% (0.6283 => 0.6760, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.3756 => 0.4039, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3293 => 0.3541, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1589 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.45% (0.3489 => 0.3749, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.42% (0.4379 => 0.4704, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (1.9828 => 2.1290, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.35% (0.4791 => 0.5143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (7.2180 => 7.7460, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.25% (0.7506 => 0.8050, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.18% (1.0313 => 1.1053, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 7.17% (0.3192 => 0.3421, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.99% (0.3246 => 0.3473, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.97% (0.2023 => 0.2164, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.94% (1.1061 => 1.1829, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3868 => 0.4136, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.87% (0.2925 => 0.3126, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5637 => 0.6024, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.75% (3.8646 => 4.1256, std. dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.4390 => 0.4686, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3220 => 0.3436, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.70% (0.8310 => 0.8867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.65% (3.6692 => 3.9132, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.51% (0.7460 => 0.7946, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.38% (0.6744 => 0.7174, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.34% (3.1889 => 3.3910, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 6.09% (2.1791 => 2.3119, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 6.09% (1.9270 => 2.0443, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 5.82% (1.0594 => 1.1211, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 5.80% (1.2749 => 1.3489, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.79% (1.3813 => 1.4613, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (1.3819 => 1.4619, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.76% (0.8698 => 0.9199, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.74% (0.4113 => 0.4349, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.70% (4.4433 => 4.6966, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.69% (4.3801 => 4.6294, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.59% (16.6129 => 17.5411, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.56% (0.6135 => 0.6476, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.40% (14.8535 => 15.6563, std. dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 5.35% (8.4961 => 8.9507, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (1.1333 => 1.1932, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (13.2842 => 13.9744, std. dev.: 0.0188) MultiSource/Applications/ClamAV/clamscan: 5.18% (14.5298 => 15.2820, std. dev.: 0.0121) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2504 => 0.2632, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.09% (0.6576 => 0.6911, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.09% (0.8818 => 0.9267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.89% (1.2292 => 1.2893, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 4.85% (4.6629 => 4.8892, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (6.5754 => 6.8817, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.38% (3.2742 => 3.4177, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.5188 => 1.5772, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1776, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.75% (0.9108 => 0.9450, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.61% (3.7467 => 3.8820, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.1007 => 2.1732, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 3.07% (33.2944 => 34.3169, std. dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (6.2785 => 6.4712, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4918, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0280) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7333, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5478, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.27% (1.9199 => 1.9826, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.93% (10.7476 => 11.0626, std. dev.: 0.0214) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (0.5184 => 0.5333, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5873, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.62% (3.7731 => 3.8342, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5847, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.17% (0.4657 => 0.3997, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.84% (22.5627 => 21.6965, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2541, std. dev.: 0.0439) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.04% (1.3780 => 1.2947, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.65% (1.7688 => 1.7042, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.33% (3.0263 => 2.9256, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5881, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5215, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2396, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2221, std. dev.: 0.0427) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.09% (6.6320 => 6.5600, std. dev.: 0.0140) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4326, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 00:18:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 02:18:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911071827.4AA9F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3659?compare_to=3656&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3659, Order: 163594, Start Time: 2012-09-11 06:08:35, End Time: 2012-09-11 07:19:44 To: 3656, Order: 163593, Start Time: 2012-09-11 04:42:25, End Time: 2012-09-11 05:53:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (46 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 887 (817 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 10.43% (3.0151 => 3.3296, std. dev.: 0.0511) SingleSource/Benchmarks/Shootout/heapsort: 7.76% (3.0651 => 3.3029, std. dev.: 0.0784) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.51% (4.1308 => 4.2343, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.97% (1.5911 => 1.6224, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.09% (1.1067 => 1.0946, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 4.28% (0.6173 => 0.6437, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.20% (0.6410 => 0.6679, std. dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 4.00% (1.1653 => 1.2119, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3582 => 0.3723, std. dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 3.63% (2.1763 => 2.2553, std. dev.: 0.0182) MultiSource/Applications/SPASS/SPASS: 2.05% (13.3238 => 13.5970, std. dev.: 0.0290) MultiSource/Applications/d/make_dparser: 1.97% (3.0225 => 3.0821, std. dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 1.81% (15.3105 => 15.5877, std. dev.: 0.0968) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (0.8569 => 0.8701, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.54% (2.0972 => 2.1295, std. dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 1.45% (29.3170 => 29.7409, std. dev.: 0.1287) MultiSource/Applications/treecc/treecc: 1.06% (1.8798 => 1.8997, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3397, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std. dev.: 0.0203) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0035, std. dev.: 0.0256) SingleSource/Benchmarks/McGill/misr: 13.31% (0.4296 => 0.4868, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.28% (4.0101 => 4.5426, std. dev.: 0.0176) MultiSource/Applications/sgefa/sgefa: 12.87% (0.3746 => 0.4228, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 12.78% (3.4406 => 3.8803, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.47% (0.2857 => 0.3156, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (3.0256 => 3.3296, std. dev.: 0.0511) SingleSource/Benchmarks/Shootout/lists: 8.94% (7.0025 => 7.6285, std. dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.77% (1.0063 => 1.0946, std. dev.: 0.0046) SingleSource/Benchmarks/Stanford/Puzzle: 7.75% (0.1433 => 0.1544, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.72% (0.2694 => 0.2902, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (3.4876 => 3.6985, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8114, std. dev.: 0.0424) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.29% (40.4792 => 42.6219, std. dev.: 0.3572) SingleSource/Benchmarks/Misc/fp-convert: 4.71% (15.2242 => 15.9418, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5375, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (6.6312 => 6.8749, std. dev.: 0.0198) MultiSource/Benchmarks/Olden/power/power: 3.30% (1.4184 => 1.4652, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.67% (0.5876 => 0.6033, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 2.56% (8.5113 => 8.7295, std. dev.: 0.0612) SingleSource/Benchmarks/Misc/whetstone: 2.40% (2.3453 => 2.4017, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.40% (2.6656 => 2.7297, std. dev.: 0.0205) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.16% (4.6127 => 4.7124, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.15% (29.5232 => 30.1591, std. dev.: 0.2138) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.5166 => 2.5597, std. dev.: 0.0073) MultiSource/Applications/siod/siod: 1.68% (3.5520 => 3.6115, std. dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5353, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (2.4455 => 2.4812, std. dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.6061 => 1.6224, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.60% (5.2665 => 4.2343, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.94% (1.1647 => 0.9907, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1617, std. dev.: 0.0581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9334, std. dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.22% (1.4034 => 1.2881, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.10% (3.6254 => 3.3680, std. dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: -6.73% (3.4230 => 3.1928, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4062, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7628, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.70% (1.7361 => 1.6718, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -3.03% (62.4126 => 60.5212, std. dev.: 0.4074) SingleSource/Benchmarks/Shootout-C++/methcall: -2.82% (9.2503 => 8.9894, std. dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6440, std. dev.: 0.0320) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2888, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.71% (2.8964 => 2.8180, std. dev.: 0.0297) MultiSource/Applications/aha/aha: -2.64% (3.4286 => 3.3381, std. dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -2.42% (92.7467 => 90.5045, std. dev.: 0.0812) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.68% (1.1683 => 1.1487, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.36% (9.3855 => 9.2583, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7683, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3287, std. dev.: 0.0458) MultiSource/Benchmarks/sim/sim: -1.19% (3.8907 => 3.8443, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 00:44:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 02:44:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911074412.581562A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3660?compare_to=3657&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3660, Order: 163594, Start Time: 2012-09-11 06:22:54, End Time: 2012-09-11 07:45:28 To: 3657, Order: 163593, Start Time: 2012-09-11 04:35:13, End Time: 2012-09-11 05:54:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (724 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.47% (10.3673 => 14.3558, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 26.82% (0.1622 => 0.2057, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.88% (2.2022 => 2.5079, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.57% (7.0540 => 8.0112, std. dev.: 0.0178) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3473 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.18% (0.3543 => 0.4010, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.14% (0.3516 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.13% (0.3497 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.01% (0.3543 => 0.4004, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3561 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.62% (0.3694 => 0.4160, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.14% (1.1194 => 1.2553, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.00% (1.7609 => 1.9546, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 8.44% (0.1695 => 0.1838, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.53% (10.4361 => 11.2216, std. dev.: 0.1912) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 7.16% (9.4845 => 10.1639, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.84% (0.8172 => 0.8731, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.5569 => 0.5948, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.60% (0.2758 => 0.2940, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (8.1363 => 8.6614, std. dev.: 0.0117) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 6.31% (0.3092 => 0.3287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.25% (1.5415 => 1.6378, std. dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.16% (4.2646 => 4.5275, std. dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 6.11% (5.7591 => 6.1112, std. dev.: 0.1068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.10% (0.6675 => 0.7082, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.07% (0.5105 => 0.5415, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.3050 => 1.3833, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.98% (4.9449 => 5.2406, std. dev.: 0.0281) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.92% (5.0018 => 5.2978, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4299 => 0.4548, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.8067 => 0.8508, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9765 => 1.0282, std. dev.: 0.0109) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.27% (0.3817 => 0.4018, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.14% (0.5020 => 0.5278, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.13% (1.1861 => 1.2469, std. dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 4.97% (3.8723 => 4.0646, std. dev.: 0.0281) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2603 => 0.2731, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.79% (0.6450 => 0.6759, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.4103 => 0.4296, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3422 => 0.3581, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (7.9617 => 8.3254, std. dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4636 => 0.4845, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.48% (0.4064 => 0.4246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6456 => 0.6745, std. dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2905 => 0.3026, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8921 => 0.9292, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.06% (0.3865 => 0.4022, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.05% (0.3826 => 0.3981, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.4203 => 0.4372, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3650 => 0.3796, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.98% (0.2891 => 0.3006, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4289 => 0.4459, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (14.3668 => 14.9353, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.91% (0.3098 => 0.3219, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.85% (0.4620 => 0.4798, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4730, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.83% (0.3162 => 0.3283, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 3.76% (0.2871 => 0.2979, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5859 => 1.6444, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.66% (0.2756 => 0.2857, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (0.3935 => 0.4077, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3283 => 0.3401, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0665 => 2.1406, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 3.58% (0.3684 => 0.3816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.1840 => 1.2236, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.2024 => 2.2750, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.8101 => 0.8293, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3861, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7599, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (4.2280 => 4.3674, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5798, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7617, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.45% (5.2763 => 3.2475, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.35% (5.3855 => 3.8588, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.02% (5.3526 => 3.8530, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1867, std. dev.: 0.0333) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.88% (2.9384 => 2.5892, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.38% (22.1758 => 19.8743, std. dev.: 0.4484) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.74% (1.5373 => 1.3722, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2839, std. dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7175, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.14% (1.6805 => 1.5773, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.3463 => 0.3252, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5006, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4152, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/salsa20: -2.84% (10.2830 => 9.9909, std. dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.82% (1.3677 => 1.3291, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -2.27% (1.2373 => 1.2092, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (8.1563 => 8.0228, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0126) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4230, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 01:13:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 03:13:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120911081322.87F242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3661?compare_to=3655&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3661, Order: 163594, Start Time: 2012-09-11 05:27:35, End Time: 2012-09-11 08:14:38 To: 3655, Order: 163586, Start Time: 2012-09-11 02:15:40, End Time: 2012-09-11 04:59:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (94 on baseline) Performance Improvements: 2 (12 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.80% (0.2089 => 0.2231, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.66% (2.0728 => 2.1279, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.85% (2.5123 => 2.4658, std. dev.: 0.0180) MultiSource/Applications/oggenc/oggenc: -1.28% (1.7156 => 1.6937, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3496 => 0.3971, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.5889 => 0.6396, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 8.58% (0.5826 => 0.6326, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.92% (0.7171 => 0.7667, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 6.31% (1.5932 => 1.6937, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 5.78% (4.2109 => 4.4541, std. dev.: 0.0091) SingleSource/Regression/C++/ofstream_ctor: 5.73% (0.3004 => 0.3176, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.63% (0.4029 => 0.4256, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.42% (1.0781 => 1.1365, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2875 => 0.3028, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.30% (0.2738 => 0.2883, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (0.3195 => 0.3359, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.05% (0.2911 => 0.3058, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.02% (0.2750 => 0.2888, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.00% (0.9909 => 1.0404, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.99% (5.5417 => 5.8183, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/fibo: 4.99% (0.2725 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.98% (0.2813 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2823 => 0.2963, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.95% (0.2729 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2792 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.87% (2.0673 => 2.1680, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.87% (0.3060 => 0.3209, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 4.85% (0.2803 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2780 => 0.2914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.79% (0.3362 => 0.3523, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3258 => 0.3411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.70% (0.2811 => 0.2943, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3625 => 0.3794, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.3348 => 0.3500, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.52% (0.3317 => 0.3467, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3690 => 0.3856, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.48% (0.3282 => 0.3429, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3124 => 0.3262, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.40% (2.1013 => 2.1937, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3726 => 0.3889, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3477 => 0.3629, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.36% (0.6634 => 0.6923, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 4.35% (23.5202 => 24.5439, std. dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.4146 => 0.4323, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.25% (0.3792 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3678 => 0.3834, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.3845 => 0.4008, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.05% (0.4251 => 0.4423, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.01% (0.7875 => 0.8191, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (2.1653 => 2.2517, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 3.97% (0.9697 => 1.0082, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.92% (4.6177 => 4.7988, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.84% (0.3981 => 0.4134, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.82% (0.5546 => 0.5758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.80% (0.2737 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.73% (0.3084 => 0.3199, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.69% (0.3336 => 0.3459, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.55% (0.5012 => 0.5190, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.42% (0.6435 => 0.6655, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.45% (2.0346 => 2.0844, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (0.4847 => 0.4965, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (0.5361 => 0.5478, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (0.7426 => 0.7572, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (11.6398 => 11.8005, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (4.6926 => 4.7488, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1652, std. dev.: 0.0934) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6362, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.20% (2.0820 => 2.1279, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2084, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5107, std. dev.: 0.0205) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std. dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4464, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std. dev.: 0.0357) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5578, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary2: -9.66% (0.2402 => 0.2170, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.56% (35.5013 => 32.8177, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std. dev.: 0.0225) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std. dev.: 0.0136) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7754, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.39% (17.2379 => 16.8265, std. dev.: 0.0814) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9680, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 01:17:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 03:17:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911081747.298AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3662?compare_to=3658&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3662, Order: 163596, Start Time: 2012-09-11 07:02:26, End Time: 2012-09-11 08:19:02 To: 3658, Order: 163594, Start Time: 2012-09-11 05:18:35, End Time: 2012-09-11 06:32:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (722 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (54.8507 => 56.4380, std. dev.: 0.1583) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.74% (2.0176 => 2.3957, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std. dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference: 11.34% (0.7061 => 0.7862, std. dev.: 0.0158) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.48% (0.7710 => 0.8518, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.79% (0.1072 => 0.1177, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 9.78% (0.3578 => 0.3928, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 9.65% (0.3646 => 0.3998, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/synchronized: 9.53% (0.3663 => 0.4012, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3789 => 0.4150, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3650 => 0.3997, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: 9.49% (0.3623 => 0.3967, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.47% (3.9660 => 4.3416, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 9.38% (0.3914 => 0.4281, std. dev.: 0.0079) MultiSource/Applications/hbd/hbd: 9.37% (1.3693 => 1.4976, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.28% (0.2596 => 0.2837, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 9.24% (0.4003 => 0.4373, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 9.21% (0.3940 => 0.4303, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.97% (0.7038 => 0.7669, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5265 => 0.5734, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.57% (1.2193 => 1.3238, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.47% (0.9199 => 0.9978, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.4563 => 1.5796, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.31% (0.6959 => 0.7537, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.26% (0.1865 => 0.2019, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.10% (1.1364 => 1.2285, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.5577 => 0.6013, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.80% (13.8202 => 14.8979, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.76% (0.2127 => 0.2292, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.62% (0.3293 => 0.3544, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.58% (0.7506 => 0.8075, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.58% (0.3485 => 0.3749, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.6283 => 0.6749, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (1.9828 => 2.1293, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.39% (7.2180 => 7.7512, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.31% (1.0313 => 1.1067, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.24% (0.4791 => 0.5138, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.2914 => 0.3123, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.97% (0.1435 => 0.1535, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.95% (0.3192 => 0.3414, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.92% (0.2023 => 0.2163, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 6.92% (1.1061 => 1.1826, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 6.90% (3.8646 => 4.1311, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3453 => 0.3689, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.82% (3.6692 => 3.9193, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.3220 => 0.3439, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 6.78% (0.2995 => 0.3198, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.77% (0.8310 => 0.8873, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0065) MultiSource/Applications/d/make_dparser: 6.64% (3.1889 => 3.4007, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.39% (1.3245 => 1.4091, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 6.36% (1.9270 => 2.0495, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 6.36% (2.1791 => 2.3176, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: 6.32% (0.6744 => 0.7170, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.29% (0.7460 => 0.7929, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (1.3819 => 1.4664, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.01% (1.3813 => 1.4643, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.2749 => 1.3511, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 5.96% (1.0594 => 1.1225, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.93% (0.6135 => 0.6499, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.3801 => 4.6305, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (4.4433 => 4.6961, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 5.66% (14.8535 => 15.6949, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.50% (16.6129 => 17.5267, std. dev.: 0.0159) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.48% (8.4961 => 8.9615, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.45% (0.8818 => 0.9299, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.38% (1.1333 => 1.1943, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.35% (13.2842 => 13.9953, std. dev.: 0.0160) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.32% (14.5298 => 15.3021, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.81% (0.6576 => 0.6892, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (6.5754 => 6.8858, std. dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 4.58% (4.6629 => 4.8764, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (3.2742 => 3.4187, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.20% (0.4805 => 0.5007, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1868, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.98% (1.5188 => 1.5793, std. dev.: 0.0060) MultiSource/Applications/lua/lua: 3.90% (3.7467 => 3.8930, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6250 => 0.6493, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.82% (0.9108 => 0.9456, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.59% (2.1007 => 2.1762, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.14% (6.2785 => 6.4759, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2497, std. dev.: 0.0271) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5206, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std. dev.: 0.0667) SingleSource/Benchmarks/Misc/fbench: 24.81% (1.8175 => 2.2684, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.87% (1.0895 => 1.3496, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4171, std. dev.: 0.0349) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.2093 => 0.2221, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 6.00% (1.2998 => 1.3778, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7339, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5456, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0767, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5920, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.16% (1.4298 => 1.4464, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6877, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.02% (0.4657 => 0.4004, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.91% (22.5627 => 21.6806, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.43% (20.3410 => 18.2195, std. dev.: 0.0445) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0342) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0230) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0152) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1507, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -3.42% (6.3560 => 6.1384, std. dev.: 0.0522) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9233, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.52% (4.5928 => 4.5232, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3305 => 7.2274, std. dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.29% (0.8342 => 0.8234, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2250, std. dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2634, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 01:44:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 03:44:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911084457.68EFF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3663?compare_to=3659&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3663, Order: 163598, Start Time: 2012-09-11 07:35:21, End Time: 2012-09-11 08:46:14 To: 3659, Order: 163594, Start Time: 2012-09-11 06:08:35, End Time: 2012-09-11 07:19:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (51 on baseline) Performance Improvements: 5 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.02% (0.4484 => 0.4709, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5571 => 0.5820, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.7133 => 0.7342, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5421 => 0.5543, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.69% (1.4150 => 1.4389, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.31% (1.1723 => 1.1877, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.57% (15.3990 => 17.0264, std. dev.: 0.2754) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (60.5212 => 61.3051, std. dev.: 0.0730) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.17% (15.5877 => 15.4056, std. dev.: 0.0318) MultiSource/Applications/SPASS/SPASS: -1.04% (13.5970 => 13.4560, std. dev.: 0.0337) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (1.1487 => 1.1337, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.21% (1.0946 => 1.0814, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.19% (30.1591 => 29.7994, std. dev.: 0.0998) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6410 => 0.6769, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3582 => 0.3738, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 3.55% (2.1763 => 2.2535, std. dev.: 0.0103) MultiSource/Applications/minisat/minisat: 3.43% (0.6173 => 0.6385, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.1653 => 1.2038, std. dev.: 0.0094) MultiSource/Applications/lemon/lemon: 3.06% (1.0046 => 1.0353, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.46% (0.4596 => 0.4709, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.38% (0.4248 => 0.4349, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.4113 => 1.4389, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.87% (1.1827 => 1.2048, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.76% (1.1672 => 1.1877, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.61% (0.7226 => 0.7342, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.58% (3.0225 => 3.0704, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.33% (4.0318 => 4.0854, std. dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (6.2546 => 6.3298, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.19% (8.2559 => 8.3539, std. dev.: 0.0214) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 45.63% (0.0263 => 0.0383, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0127) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.54% (0.0766 => 0.0908, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std. dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.89% (4.0101 => 4.5671, std. dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 12.66% (3.4406 => 3.8762, std. dev.: 0.0095) SingleSource/Benchmarks/McGill/misr: 12.06% (0.4296 => 0.4814, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.35% (7.0025 => 7.5870, std. dev.: 0.0476) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.19% (0.2857 => 0.3091, std. dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 8.16% (0.1433 => 0.1550, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 7.79% (1.0194 => 1.0988, std. dev.: 0.0294) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.55% (15.8312 => 17.0264, std. dev.: 0.2754) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.46% (1.0063 => 1.0814, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 6.29% (3.4876 => 3.7071, std. dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7942, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.24% (40.4792 => 42.6020, std. dev.: 0.2405) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.73% (0.7609 => 0.7969, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.12% (0.8498 => 0.8848, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.88% (4.2129 => 4.3764, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/fp-convert: 3.80% (15.2242 => 15.8024, std. dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 2.83% (8.5113 => 8.7522, std. dev.: 0.0338) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.79% (0.5587 => 0.5743, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.57% (4.6127 => 4.6852, std. dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (2.4971 => 2.5301, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6733, std. dev.: 0.0447) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.5166 => 2.5424, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.93% (0.7738 => 0.7589, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.35% (0.3497 => 0.2051, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.36% (5.2665 => 4.0887, std. dev.: 0.0881) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.05% (1.1647 => 0.9894, std. dev.: 0.0285) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1568, std. dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9407, std. dev.: 0.0421) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.03% (3.6254 => 3.3707, std. dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: -6.59% (3.4230 => 3.1973, std. dev.: 0.0434) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3515, std. dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0586) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.74% (0.4140 => 0.3985, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (9.2503 => 8.9377, std. dev.: 0.0122) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.23% (1.2722 => 1.2311, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.19% (1.7361 => 1.6808, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.96% (1.1683 => 1.1337, std. dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -2.76% (92.7467 => 90.1909, std. dev.: 0.4066) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std. dev.: 0.0133) MultiSource/Applications/aha/aha: -2.75% (3.4286 => 3.3343, std. dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.71% (3.7496 => 3.6478, std. dev.: 0.0336) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.04% (2.8964 => 2.8374, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.77% (62.4126 => 61.3051, std. dev.: 0.0730) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2271, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3062, std. dev.: 0.0145) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 02:32:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 04:32:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911093250.5570E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3664?compare_to=3660&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3664, Order: 163600, Start Time: 2012-09-11 08:14:01, End Time: 2012-09-11 09:34:06 To: 3660, Order: 163594, Start Time: 2012-09-11 06:22:54, End Time: 2012-09-11 07:45:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (137 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 945 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.85% (14.3558 => 15.1951, std. dev.: 0.1079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.69% (54.5157 => 55.9799, std. dev.: 0.2741) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (79.3088 => 80.4650, std. dev.: 0.3383) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (42.0793 => 42.5307, std. dev.: 0.1576) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.28% (1.3096 => 1.2929, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.57% (10.3673 => 15.1951, std. dev.: 0.1079) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.07% (2.2022 => 2.5120, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.92% (7.0540 => 8.0359, std. dev.: 0.0224) SingleSource/UnitTests/ObjC/trivial-interface: 13.76% (0.3473 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.53% (0.3497 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.41% (0.3543 => 0.4018, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.34% (0.3516 => 0.3985, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.25% (0.3561 => 0.4033, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.70% (0.3828 => 0.4314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.55% (0.3927 => 0.4420, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.35% (0.3886 => 0.4366, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2549, std. dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.42% (1.7609 => 1.9620, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 9.63% (0.3282 => 0.3598, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5925 => 0.6440, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 7.73% (0.1695 => 0.1826, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7326 => 0.7864, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 7.32% (9.4845 => 10.1785, std. dev.: 0.0169) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.20% (0.8172 => 0.8760, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.92% (0.3307 => 0.3536, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.4615 => 0.4932, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 6.82% (0.7835 => 0.8369, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 6.77% (10.4361 => 11.1426, std. dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.75% (8.1363 => 8.6852, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.5860 => 0.6252, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 6.63% (0.3423 => 0.3650, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 6.56% (0.7115 => 0.7582, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 6.55% (0.7433 => 0.7920, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (4.2646 => 4.5389, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.40% (1.5415 => 1.6401, std. dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.6675 => 0.7091, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.16% (0.5569 => 0.5912, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.11% (0.5105 => 0.5417, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (1.3050 => 1.3842, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.99% (3.3354 => 3.5353, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.99% (5.0018 => 5.3014, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.98% (4.9449 => 5.2406, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 5.94% (5.7591 => 6.1014, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.83% (0.8067 => 0.8537, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.9765 => 1.0308, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.53% (0.3817 => 0.4028, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.43% (0.4289 => 0.4522, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 5.42% (1.1642 => 1.2273, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.4103 => 0.4321, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.4064 => 0.4277, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.24% (1.5603 => 1.6420, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/lists: 5.23% (0.3422 => 0.3601, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.1861 => 1.2477, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.16% (0.5020 => 0.5279, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (7.9617 => 8.3544, std. dev.: 0.0147) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.89% (0.6456 => 0.6772, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 4.89% (3.8723 => 4.0617, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.88% (0.3650 => 0.3828, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2905 => 0.3044, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.78% (1.0722 => 1.1235, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.76% (0.3865 => 0.4049, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.74% (2.0273 => 2.1234, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.70% (0.2891 => 0.3027, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.3136 => 0.3281, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.62% (0.6450 => 0.6748, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4636 => 0.4846, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.4048 => 0.4231, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.52% (21.9371 => 22.9283, std. dev.: 0.0321) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.49% (0.2831 => 0.2958, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (2.0665 => 2.1590, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.47% (0.4203 => 0.4391, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.46% (0.3162 => 0.3303, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.42% (0.2871 => 0.2998, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.41% (0.3603 => 0.3762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.40% (0.3935 => 0.4108, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.37% (0.4620 => 0.4822, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8921 => 0.9310, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.35% (0.2872 => 0.2997, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.33% (0.3283 => 0.3425, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.32% (0.2756 => 0.2875, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5981 => 0.6239, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3232 => 0.3370, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 4.21% (0.2877 => 0.2998, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.19% (2.2969 => 2.3932, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wc: 4.16% (0.3052 => 0.3179, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2793 => 0.2909, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2802 => 0.2917, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.07% (14.3668 => 14.9510, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4761, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (1.5859 => 1.6459, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.2024 => 2.2779, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.1840 => 1.2215, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.01% (1.2842 => 1.3228, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.8101 => 0.8301, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.82% (1.1145 => 1.3688, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.43% (2.6778 => 2.9572, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3737, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7459, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2351, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7615, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2299, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.68% (5.3855 => 3.8948, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.39% (5.3526 => 3.8864, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1862, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.09% (2.9384 => 2.5831, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: -10.41% (22.1758 => 19.8681, std. dev.: 0.0442) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.63% (19.9488 => 18.2263, std. dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5770, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.14% (1.5835 => 1.5021, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4994, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4122, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9969, std. dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9902, std. dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5535, std. dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: -1.95% (1.2373 => 1.2132, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6783, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4228, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2322, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 03:01:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 05:01:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911100128.038A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3665?compare_to=3662&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3665, Order: 163601, Start Time: 2012-09-11 08:47:50, End Time: 2012-09-11 10:02:17 To: 3662, Order: 163596, Start Time: 2012-09-11 07:02:26, End Time: 2012-09-11 08:19:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.70% (6.1384 => 6.2430, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.57% (78.3465 => 79.5798, std. dev.: 0.4620) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.67% (2.0176 => 2.3942, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.43% (0.5818 => 0.6483, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.00% (0.7710 => 0.8481, std. dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.45% (1.3693 => 1.4987, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.36% (3.9660 => 4.3372, std. dev.: 0.0271) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.80% (0.7038 => 0.7657, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4328 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.50% (0.9199 => 0.9981, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.43% (1.2193 => 1.3221, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.22% (0.6959 => 0.7531, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.15% (1.4563 => 1.5750, std. dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.09% (0.2721 => 0.2941, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.08% (1.1364 => 1.2282, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.3899 => 0.4202, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3293 => 0.3547, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 7.68% (13.8202 => 14.8810, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2127 => 0.2290, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.65% (0.3580 => 0.3854, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.65% (0.3489 => 0.3756, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.64% (0.5577 => 0.6003, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.3756 => 0.4039, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.6283 => 0.6756, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (1.9828 => 2.1293, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (7.2180 => 7.7468, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.23% (0.7506 => 0.8049, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.19% (1.0313 => 1.1055, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.18% (0.3246 => 0.3479, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.12% (0.4791 => 0.5132, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.08% (0.3868 => 0.4142, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.05% (1.1061 => 1.1841, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 7.01% (0.2925 => 0.3130, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.97% (0.1865 => 0.1995, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4390 => 0.4696, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.87% (0.2243 => 0.2397, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.83% (0.3220 => 0.3440, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.81% (0.5637 => 0.6021, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.79% (3.8646 => 4.1270, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 6.78% (0.3453 => 0.3687, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.78% (3.6692 => 3.9178, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.66% (0.6744 => 0.7193, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.63% (0.8310 => 0.8861, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.58% (0.7460 => 0.7951, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 6.31% (3.1889 => 3.3901, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.24% (1.3245 => 1.4072, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.0594 => 1.1253, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 6.22% (2.1791 => 2.3146, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 6.10% (1.9270 => 2.0446, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.2945 => 0.3123, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.93% (0.6135 => 0.6499, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.84% (1.2749 => 1.3494, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.73% (1.3813 => 1.4605, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.73% (1.3819 => 1.4611, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.66% (4.4433 => 4.6948, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.8698 => 0.9189, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.64% (16.6129 => 17.5501, std. dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.61% (4.3801 => 4.6260, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.43% (8.4961 => 8.9576, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 5.40% (14.8535 => 15.6561, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (1.1333 => 1.1938, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (13.2842 => 13.9861, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.20% (14.5298 => 15.2855, std. dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.17% (0.8818 => 0.9274, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.79% (1.2292 => 1.2881, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 4.71% (4.6629 => 4.8823, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.68% (0.6576 => 0.6884, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (6.5754 => 6.8833, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.37% (3.2742 => 3.4173, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.18% (0.4805 => 0.5006, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1869, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (1.5188 => 1.5774, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6250 => 0.6488, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.78% (0.9108 => 0.9452, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.74% (3.7467 => 3.8869, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (2.1007 => 2.1735, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.14% (6.2785 => 6.4755, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 2.73% (33.2944 => 34.2019, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5080, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.72% (1.1560 => 1.2568, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7330, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5472, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.95% (10.7476 => 11.0647, std. dev.: 0.0748) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (0.5184 => 0.5333, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5943, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.75% (3.7731 => 3.8390, std. dev.: 0.0250) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1834, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5877, std. dev.: 0.0064) MultiSource/Applications/lemon/lemon: 1.03% (1.4298 => 1.4445, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.43% (0.4657 => 0.3985, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.98% (22.5627 => 21.6637, std. dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2750, std. dev.: 0.0131) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.26% (2.6470 => 2.5078, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.24% (1.3780 => 1.3196, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1513, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9216, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6075, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2430, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.5928 => 4.5215, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2393, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std. dev.: 0.0161) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.15% (6.6320 => 6.5559, std. dev.: 0.0155) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2615, std. dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4353, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 03:11:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 05:11:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911101136.563762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3666?compare_to=3663&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3666, Order: 163601, Start Time: 2012-09-11 09:01:36, End Time: 2012-09-11 10:12:53 To: 3663, Order: 163598, Start Time: 2012-09-11 07:35:21, End Time: 2012-09-11 08:46:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (64 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 885 (795 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.7706 => 0.7979, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 7.79% (3.1533 => 3.3990, std. dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.07% (20.8083 => 22.2793, std. dev.: 0.0818) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.83% (4.0887 => 4.2453, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.47% (2.6960 => 2.7625, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel-2: 2.10% (3.0575 => 3.1218, std. dev.: 0.0121) MultiSource/Applications/minisat/minisat: 1.85% (6.2014 => 6.3164, std. dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.82% (0.6410 => 0.6783, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.08% (0.3582 => 0.3764, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 4.33% (2.1763 => 2.2706, std. dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 3.64% (1.1653 => 1.2077, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.33% (0.7722 => 0.7979, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.5150 => 1.5580, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1672 => 1.1958, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.1827 => 1.2085, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.15% (1.3935 => 1.4235, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.4113 => 1.4412, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.99% (8.2559 => 8.4202, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.98% (1.2021 => 1.2259, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.71% (3.0225 => 3.0743, std. dev.: 0.0097) MultiSource/Applications/Burg/burg: 1.70% (1.1440 => 1.1635, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 1.63% (29.3170 => 29.7960, std. dev.: 0.1349) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.61% (6.2546 => 6.3555, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.4189 => 1.4416, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (8.2186 => 8.3472, std. dev.: 0.0201) MultiSource/Benchmarks/MallocBench/gs/gs: 1.40% (3.8796 => 3.9341, std. dev.: 0.0192) MultiSource/Applications/SPASS/SPASS: 1.39% (13.3238 => 13.5091, std. dev.: 0.0549) MultiSource/Applications/oggenc/oggenc: 1.35% (4.7455 => 4.8094, std. dev.: 0.0163) MultiSource/Applications/siod/siod: 1.13% (2.0972 => 2.1208, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.12% (1.8798 => 1.9009, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.91% (0.0263 => 0.0389, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 15.52% (1.7426 => 2.0130, std. dev.: 0.0740) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.36% (0.0766 => 0.0876, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.96% (0.0917 => 0.1045, std. dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5476, std. dev.: 0.0265) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.00% (15.8312 => 17.8894, std. dev.: 0.4211) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8793, std. dev.: 0.0105) SingleSource/Benchmarks/McGill/misr: 12.66% (0.4296 => 0.4840, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.65% (0.2694 => 0.2981, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6221, std. dev.: 0.0293) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.51% (0.2857 => 0.3100, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 7.40% (1.0194 => 1.0948, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 6.13% (3.4876 => 3.7015, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8167, std. dev.: 0.0889) SingleSource/Benchmarks/Shootout/heapsort: 5.69% (3.2159 => 3.3990, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.61% (4.2129 => 4.4492, std. dev.: 0.0848) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8377, std. dev.: 0.0603) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5386, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0191) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.64% (2.6656 => 2.7625, std. dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.39% (0.8498 => 0.8786, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 2.85% (1.4184 => 1.4588, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.84% (0.5876 => 0.6043, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 2.79% (0.6459 => 0.6639, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.76% (0.5587 => 0.5741, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.50% (3.5520 => 3.6052, std. dev.: 0.0109) MultiSource/Applications/minisat/minisat: 1.48% (6.2244 => 6.3164, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 1.45% (2.5166 => 2.5532, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4455 => 2.4802, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.40% (2.4013 => 2.4349, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.6127 => 4.6755, std. dev.: 0.0229) MultiSource/Applications/lua/lua: 1.30% (29.5232 => 29.9056, std. dev.: 0.1206) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6709, std. dev.: 0.0206) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.03% (4.0659 => 4.1076, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.39% (5.2665 => 4.2453, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.87% (1.1647 => 0.9915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.17% (1.4034 => 1.2888, std. dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.04% (3.2007 => 2.9435, std. dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3670, std. dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: -6.71% (3.4230 => 3.1932, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -6.02% (1.4441 => 1.3572, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4105, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.67% (3.9413 => 3.7573, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.23% (0.4564 => 0.4371, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.01% (0.4140 => 0.3974, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.2959 => 1.2494, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.40% (1.7361 => 1.6771, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.95% (1.1683 => 1.1338, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.92% (1.2722 => 1.2351, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6422, std. dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/methcall: -2.76% (9.2503 => 8.9947, std. dev.: 0.0031) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3352, std. dev.: 0.0344) SingleSource/Benchmarks/Misc/flops: -2.67% (9.5474 => 9.2929, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.20% (1.8739 => 1.8327, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -2.20% (62.4126 => 61.0416, std. dev.: 0.1147) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.12% (2.8964 => 2.8351, std. dev.: 0.0186) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.8025, std. dev.: 0.3349) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2333, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -1.45% (1.0926 => 1.0768, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3157, std. dev.: 0.0700) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.3569 => 2.3261, std. dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -1.23% (3.8907 => 3.8427, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 04:21:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 06:21:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911112115.1FB9C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3667?compare_to=3664&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3667, Order: 163601, Start Time: 2012-09-11 10:02:37, End Time: 2012-09-11 11:22:30 To: 3664, Order: 163600, Start Time: 2012-09-11 08:14:01, End Time: 2012-09-11 09:34:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (140 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.52% (1.2929 => 1.3125, std. dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.60% (10.3673 => 15.1982, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.09% (2.2022 => 2.5125, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.92% (7.0540 => 8.0358, std. dev.: 0.0135) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.69% (0.3543 => 0.4028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.69% (0.3543 => 0.4028, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 13.50% (0.3497 => 0.3969, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.28% (0.3561 => 0.4034, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 13.21% (0.3694 => 0.4182, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.40% (0.3886 => 0.4368, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.18% (1.1194 => 1.2557, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.44% (1.7609 => 1.9623, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 9.48% (0.3282 => 0.3593, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.01% (0.7326 => 0.7913, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.4879 => 0.5241, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2554 => 0.2742, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.34% (9.4845 => 10.1803, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.8172 => 0.8761, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.05% (0.3307 => 0.3540, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.00% (0.2700 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 6.80% (10.4361 => 11.1456, std. dev.: 0.0213) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (8.1363 => 8.6781, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (0.7433 => 0.7925, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 6.46% (0.7835 => 0.8341, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3423 => 0.3643, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 6.41% (0.7115 => 0.7571, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.41% (4.2646 => 4.5379, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.3092 => 0.3289, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5860 => 0.6230, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.6675 => 0.7091, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.23% (0.5105 => 0.5423, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.16% (0.5569 => 0.5912, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.16% (1.5415 => 1.6364, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.08% (3.3354 => 3.5381, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.03% (5.0018 => 5.3035, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.3050 => 1.3833, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.99% (4.9449 => 5.2411, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.93% (5.7591 => 6.1006, std. dev.: 0.0166) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.71% (0.3817 => 0.4035, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.8067 => 0.8527, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.9765 => 1.0308, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.51% (0.4299 => 0.4536, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 5.35% (1.5603 => 1.6437, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 5.27% (1.1642 => 1.2256, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3422 => 0.3602, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (1.1861 => 1.2474, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4636 => 0.4874, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.06% (0.5020 => 0.5274, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.4103 => 0.4308, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.97% (0.6456 => 0.6777, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.2905 => 0.3047, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (7.9617 => 8.3501, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.85% (3.8723 => 4.0600, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2891 => 0.3029, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.77% (0.3650 => 0.3824, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.6450 => 0.6757, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.76% (1.0722 => 1.1232, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.73% (0.3865 => 0.4048, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.68% (0.3826 => 0.4005, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.64% (2.0273 => 2.1214, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.64% (0.4289 => 0.4488, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.59% (0.2725 => 0.2850, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.56% (0.2871 => 0.3002, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.56% (0.2831 => 0.2960, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.55% (21.9371 => 22.9351, std. dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.3136 => 0.3278, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.4048 => 0.4231, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4203 => 0.4392, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0665 => 2.1587, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.43% (0.3162 => 0.3302, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.42% (0.2872 => 0.2999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3935 => 0.4109, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.42% (0.4620 => 0.4824, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.39% (0.2756 => 0.2877, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5981 => 0.6242, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.36% (0.3232 => 0.3373, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.3603 => 0.3760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3052 => 0.3184, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.32% (0.3684 => 0.3843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2877 => 0.3001, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.23% (0.3283 => 0.3422, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8921 => 0.9294, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/random: 4.18% (0.2802 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3379 => 0.3520, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2793 => 0.2909, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 4.08% (2.2969 => 2.3907, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (14.3668 => 14.9528, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (1.4186 => 1.4746, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.76% (1.5859 => 1.6456, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.2024 => 2.2767, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.1840 => 1.2216, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2842 => 1.3205, std. dev.: 0.0105) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.8101 => 0.8288, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.90% (1.1145 => 1.3697, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3850, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3737, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2266, std. dev.: 0.0363) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7613, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.73% (5.2763 => 3.2327, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.75% (5.3855 => 3.8908, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.45% (5.3526 => 3.8835, std. dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2315, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.29% (2.9384 => 2.5774, std. dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8906, std. dev.: 0.0245) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2983, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7174, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.13% (1.6805 => 1.5775, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0028) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1493, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4186, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/salsa20: -2.94% (10.2830 => 9.9809, std. dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.98% (4.6441 => 4.5520, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0084, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4227, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2259, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -1.12% (1.2373 => 1.2235, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8551, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 04:25:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 06:25:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120911112537.B27662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3668?compare_to=3661&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3668, Order: 163601, Start Time: 2012-09-11 08:43:08, End Time: 2012-09-11 11:26:54 To: 3661, Order: 163594, Start Time: 2012-09-11 05:27:35, End Time: 2012-09-11 08:14:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (779 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.45% (99.2316 => 118.5302, std. dev.: 0.0526) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3496 => 0.3991, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.03% (0.3442 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.03% (0.3465 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.02% (0.3488 => 0.3977, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.56% (0.3650 => 0.4145, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.42% (0.3643 => 0.4132, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.13% (0.3724 => 0.4213, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5826 => 0.6359, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.10% (0.5889 => 0.6425, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.39% (0.7171 => 0.7701, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (3.5627 => 3.7990, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (1.6211 => 1.7278, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.37% (1.3152 => 1.3990, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2875 => 0.3055, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.09% (1.5932 => 1.6903, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (0.5900 => 0.6257, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.03% (0.4361 => 0.4624, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.3004 => 0.3184, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.95% (0.2823 => 0.2991, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2729 => 0.2891, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.92% (0.2738 => 0.2900, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.91% (0.2792 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.91% (0.2725 => 0.2886, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2813 => 0.2979, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.89% (0.2750 => 0.2912, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2803 => 0.2967, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.79% (0.3195 => 0.3380, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (0.4994 => 0.5283, std. dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 5.76% (0.9909 => 1.0480, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.67% (2.0673 => 2.1846, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.3096 => 0.3271, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.2780 => 0.2937, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (0.3930 => 0.4151, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (0.5000 => 0.5280, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 5.59% (0.2811 => 0.2968, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.57% (0.3267 => 0.3449, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2911 => 0.3072, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.43% (0.3258 => 0.3435, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.42% (0.3060 => 0.3226, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.37% (4.2109 => 4.4372, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3477 => 0.3663, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.34% (0.3317 => 0.3494, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.29% (0.3362 => 0.3540, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3124 => 0.3287, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3726 => 0.3918, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.14% (0.3348 => 0.3520, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.12% (0.3282 => 0.3450, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.11% (0.3678 => 0.3866, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.08% (1.0781 => 1.1329, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.3625 => 0.3809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4146 => 0.4350, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.90% (0.9697 => 1.0172, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.78% (2.7292 => 2.8596, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3690 => 0.3866, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.66% (5.5417 => 5.7999, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.59% (0.3792 => 0.3966, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.3845 => 0.4020, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (1.9694 => 2.0576, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.47% (0.3981 => 0.4159, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (0.4658 => 0.4860, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.3903 => 0.4069, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.13% (1.8794 => 1.9570, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.96% (0.4139 => 0.4303, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 3.94% (1.4269 => 1.4831, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (2.1013 => 2.1831, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.5012 => 0.5206, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (4.4195 => 4.5877, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.3271 => 0.3394, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.72% (23.5202 => 24.3940, std. dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.6435 => 0.6672, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.58% (2.1653 => 2.2428, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 3.55% (0.5546 => 0.5743, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.3084 => 0.3193, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.53% (0.7875 => 0.8153, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.51% (4.6177 => 4.7797, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.50% (0.2969 => 0.3073, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.41% (0.6634 => 0.6860, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: 3.18% (0.3336 => 0.3442, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.77% (2.0346 => 2.0707, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (0.7426 => 0.7539, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 4.83% (15.4430 => 16.1892, std. dev.: 0.0485) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6375, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.1999, std. dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5080, std. dev.: 0.0246) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.62% (41.7953 => 42.4732, std. dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5885, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5595, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ary2: -10.20% (0.2402 => 0.2157, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7891, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7571, std. dev.: 0.0779) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9744, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5025, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 04:50:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 06:50:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911115036.6F7812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3669?compare_to=3665&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3669, Order: 163605, Start Time: 2012-09-11 10:37:34, End Time: 2012-09-11 11:51:52 To: 3665, Order: 163601, Start Time: 2012-09-11 08:47:50, End Time: 2012-09-11 10:02:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.24% (1.3196 => 1.2901, std. dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.65% (2.0176 => 2.3938, std. dev.: 0.0213) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 11.31% (0.5748 => 0.6398, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.45% (0.7710 => 0.8516, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.51% (3.9660 => 4.3433, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 9.50% (1.3693 => 1.4994, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3623 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.19% (0.3601 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3663 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.13% (0.3789 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5265 => 0.5738, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.4003 => 0.4359, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 8.75% (0.7038 => 0.7654, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3242, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.51% (0.9199 => 0.9982, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.29% (0.6959 => 0.7536, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.4563 => 1.5759, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.12% (1.1364 => 1.2287, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.5577 => 0.6013, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2127 => 0.2293, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.77% (0.3489 => 0.3760, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.70% (0.4379 => 0.4716, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.67% (0.3756 => 0.4044, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.65% (13.8202 => 14.8768, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.62% (0.3293 => 0.3544, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2607 => 0.2804, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3485 => 0.3748, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.50% (7.2180 => 7.7593, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 7.45% (0.7506 => 0.8065, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3022 => 0.3247, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.29% (1.9828 => 2.1273, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.25% (0.4016 => 0.4307, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.19% (1.0313 => 1.1055, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.15% (0.5637 => 0.6040, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.10% (1.1061 => 1.1846, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.10% (0.4791 => 0.5131, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.02% (0.1865 => 0.1996, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3192 => 0.3415, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.97% (0.2023 => 0.2164, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.88% (0.2995 => 0.3201, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.81% (0.3453 => 0.3688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.81% (3.6692 => 3.9189, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 6.80% (3.8646 => 4.1274, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4390 => 0.4688, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.71% (0.8310 => 0.8868, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.71% (0.3534 => 0.3771, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.2140 => 0.2278, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.43% (0.7460 => 0.7940, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.31% (3.1889 => 3.3902, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.23% (1.3245 => 1.4070, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.16% (1.9270 => 2.0457, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 6.11% (2.1791 => 2.3122, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (1.2749 => 1.3501, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4113 => 0.4354, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.81% (1.3813 => 1.4616, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.81% (1.3819 => 1.4622, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.77% (4.4433 => 4.6995, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 5.76% (1.0594 => 1.1204, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.3801 => 4.6322, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.66% (0.6135 => 0.6482, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.2859 => 0.3019, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 5.48% (16.6129 => 17.5239, std. dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 5.46% (14.8535 => 15.6649, std. dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: 5.36% (8.4961 => 8.9512, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.33% (1.1333 => 1.1937, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (13.2842 => 13.9888, std. dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 5.22% (14.5298 => 15.2884, std. dev.: 0.0117) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.14% (0.8818 => 0.9271, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.11% (0.6576 => 0.6912, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.78% (1.2292 => 1.2880, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.67% (6.5754 => 6.8827, std. dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 4.62% (4.6629 => 4.8785, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.38% (3.2742 => 3.4175, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.95% (4.9865 => 5.1834, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.91% (1.5188 => 1.5782, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.6250 => 0.6486, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.74% (3.7467 => 3.8869, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.68% (0.9108 => 0.9443, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.51% (2.1007 => 2.1745, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.24% (6.2785 => 6.4817, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 3.14% (33.2944 => 34.3384, std. dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 1.49% (16.2614 => 16.5031, std. dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2734, std. dev.: 0.0449) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4125, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7339, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.12% (10.7476 => 11.0830, std. dev.: 0.0271) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.5184 => 0.5328, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6008, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.32% (0.4657 => 0.3990, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.97% (22.5627 => 21.6669, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2839, std. dev.: 0.0182) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.38% (1.3780 => 1.2901, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5110, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1504, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7057, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9237, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2429, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9933, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5223, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2174, std. dev.: 0.0394) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2438, std. dev.: 0.0207) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4315, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 05:14:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 07:14:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911121435.60C7E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3670?compare_to=3666&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3670, Order: 163609, Start Time: 2012-09-11 11:04:57, End Time: 2012-09-11 12:15:52 To: 3666, Order: 163601, Start Time: 2012-09-11 09:01:36, End Time: 2012-09-11 10:12:53 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (51 on baseline) Performance Improvements: 1 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 2.05% (0.7599 => 0.7755, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.24% (0.9465 => 0.9582, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 1.09% (1.1635 => 1.1762, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 5.67% (0.2486 => 0.2627, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.77% (0.7640 => 0.7928, std. dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.08% (41.5322 => 42.8121, std. dev.: 0.4479) MultiSource/Applications/SPASS/SPASS: 2.96% (8.4505 => 8.7003, std. dev.: 0.0744) SingleSource/Benchmarks/Misc/whetstone: 2.20% (2.3467 => 2.3983, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.83% (1.8327 => 1.8662, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -11.05% (3.3990 => 3.0233, std. dev.: 0.1199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.12% (0.1414 => 0.1543, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.91% (0.6410 => 0.6789, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.05% (0.3582 => 0.3763, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 4.20% (0.6173 => 0.6432, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 3.95% (0.3217 => 0.3344, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.87% (1.1653 => 1.2104, std. dev.: 0.0094) MultiSource/Applications/lemon/lemon: 3.64% (1.0046 => 1.0412, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.57% (0.2886 => 0.2989, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.5150 => 1.5676, std. dev.: 0.0120) MultiSource/Applications/Burg/burg: 2.81% (1.1440 => 1.1762, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.38% (1.4113 => 1.4449, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1672 => 1.1932, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.02% (0.7226 => 0.7372, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.7639 => 0.7778, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.67% (0.9425 => 0.9582, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 1.61% (3.5980 => 3.6560, std. dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.50% (1.0689 => 1.0849, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.36% (14.6079 => 14.8061, std. dev.: 0.0518) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.18% (1.6538 => 2.3349, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.06% (0.0766 => 0.0889, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std. dev.: 0.0375) SingleSource/Benchmarks/McGill/misr: 13.52% (0.4296 => 0.4877, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.43% (4.0101 => 4.5486, std. dev.: 0.0192) MultiSource/Applications/sgefa/sgefa: 13.05% (0.3746 => 0.4235, std. dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 12.49% (0.1433 => 0.1612, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.11% (1.0063 => 1.0980, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6043, std. dev.: 0.0375) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.39% (0.2694 => 0.2920, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (0.3301 => 0.3536, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 6.95% (1.0194 => 1.0902, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (3.4876 => 3.6995, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.91% (27.1724 => 28.7772, std. dev.: 0.1365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.76% (40.4792 => 42.8121, std. dev.: 0.4479) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.19% (0.7609 => 0.7928, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 4.01% (15.2242 => 15.8343, std. dev.: 0.0531) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.91% (0.3508 => 0.3610, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 2.82% (8.5113 => 8.7512, std. dev.: 0.0398) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.67% (0.5587 => 0.5736, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.45% (2.6656 => 2.7310, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/whetstone: 2.26% (2.3453 => 2.3983, std. dev.: 0.0104) MultiSource/Applications/siod/siod: 2.08% (3.5520 => 3.6258, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/five11/five11: 1.98% (5.1938 => 5.2966, std. dev.: 0.0169) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6675, std. dev.: 0.0553) MultiSource/Benchmarks/Olden/bh/bh: 1.11% (2.5166 => 2.5445, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.52% (0.3497 => 0.2080, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.17% (5.2665 => 4.0990, std. dev.: 0.2487) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.88% (1.1647 => 0.9914, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1570, std. dev.: 0.0744) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.93% (3.2007 => 2.9150, std. dev.: 0.0589) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3665, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -6.75% (3.4230 => 3.1918, std. dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.63% (1.4021 => 1.3091, std. dev.: 0.0346) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3526, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4094, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.38% (0.4564 => 0.4364, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.75% (1.7361 => 1.6710, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -3.55% (9.2503 => 8.9219, std. dev.: 0.0518) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std. dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.10% (61.1734 => 59.2779, std. dev.: 0.4746) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.10% (3.7496 => 3.6335, std. dev.: 0.0170) MultiSource/Applications/aha/aha: -2.76% (3.4286 => 3.3338, std. dev.: 0.0192) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.46% (0.4140 => 0.4038, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -2.13% (62.4126 => 61.0847, std. dev.: 0.2868) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9878, std. dev.: 0.6150) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (9.3855 => 9.2214, std. dev.: 0.0208) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3063, std. dev.: 0.0567) MultiSource/Benchmarks/sim/sim: -1.15% (3.8907 => 3.8461, std. dev.: 0.0152) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 06:10:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 08:10:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911131001.5633E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3671?compare_to=3667&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3671, Order: 163609, Start Time: 2012-09-11 11:51:18, End Time: 2012-09-11 13:11:16 To: 3667, Order: 163601, Start Time: 2012-09-11 10:02:37, End Time: 2012-09-11 11:22:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (140 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.6944 => 56.6282, std. dev.: 0.0899) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.50% (10.3673 => 15.1879, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.06% (2.2022 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.88% (7.0540 => 8.0328, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/trivial-interface: 13.73% (0.3473 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.43% (0.3543 => 0.4019, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3497 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.37% (0.3516 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.28% (0.3561 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3543 => 0.4013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3828 => 0.4309, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.14% (1.1194 => 1.2553, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.41% (1.7609 => 1.9619, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 9.48% (0.3282 => 0.3593, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.36% (9.4845 => 10.1829, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 7.33% (0.7326 => 0.7863, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.8172 => 0.8750, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.99% (0.3307 => 0.3538, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.90% (10.4361 => 11.1558, std. dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7433 => 0.7923, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (8.1363 => 8.6714, std. dev.: 0.0127) MultiSource/Benchmarks/McCat/18-imp/imp: 6.57% (0.3423 => 0.3648, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 6.50% (0.3109 => 0.3311, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.42% (0.7835 => 0.8338, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.37% (0.5105 => 0.5430, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.36% (1.5415 => 1.6395, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.34% (0.1940 => 0.2063, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.28% (0.5860 => 0.6228, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.27% (4.2646 => 4.5322, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.19% (0.6675 => 0.7088, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.02% (5.0018 => 5.3031, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.02% (1.3050 => 1.3836, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 5.98% (3.3354 => 3.5349, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.9449 => 5.2400, std. dev.: 0.0163) MultiSource/Applications/oggenc/oggenc: 5.96% (5.7591 => 6.1025, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.8067 => 0.8532, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.66% (0.3092 => 0.3267, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.64% (0.9765 => 1.0316, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.60% (0.5020 => 0.5301, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4299 => 0.4537, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.50% (0.3817 => 0.4027, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (0.4064 => 0.4280, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4636 => 0.4880, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (1.1861 => 1.2480, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 5.20% (0.3422 => 0.3600, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.20% (1.5603 => 1.6414, std. dev.: 0.0084) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2241, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.6456 => 0.6783, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2603 => 0.2731, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (7.9617 => 8.3507, std. dev.: 0.0128) MultiSource/Applications/lua/lua: 4.88% (3.8723 => 4.0612, std. dev.: 0.0124) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2905 => 0.3044, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.78% (1.0722 => 1.1234, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.78% (0.6450 => 0.6758, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.77% (0.3650 => 0.3824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.73% (0.3865 => 0.4048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2891 => 0.3026, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.64% (0.4289 => 0.4488, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.63% (0.3826 => 0.4003, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.62% (0.4203 => 0.4397, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.60% (2.0273 => 2.1206, std. dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 4.59% (21.9371 => 22.9444, std. dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/strcat: 4.56% (0.2831 => 0.2960, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.46% (0.3162 => 0.3303, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.44% (2.0665 => 2.1582, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.3136 => 0.3275, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3098 => 0.3235, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.4048 => 0.4227, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3684 => 0.3846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.3603 => 0.3760, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2756 => 0.2876, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3935 => 0.4105, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.31% (0.4620 => 0.4819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2871 => 0.2994, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.25% (0.2872 => 0.2994, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2877 => 0.2999, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3232 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.5981 => 0.6233, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.3052 => 0.3180, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8921 => 0.9291, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.4186 => 1.4770, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (14.3668 => 14.9541, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2793 => 0.2907, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 4.07% (2.2969 => 2.3904, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2802 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.91% (0.3379 => 0.3511, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.70% (1.5859 => 1.6446, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.2024 => 2.2794, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.22% (1.1840 => 1.2221, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.2842 => 1.3208, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.8101 => 0.8304, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.94% (1.1145 => 1.3702, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3823, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.68% (0.4162 => 0.4315, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (4.2280 => 4.3830, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7560, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2386, std. dev.: 0.0363) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5763, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7614, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.82% (5.2763 => 3.2278, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.75% (5.3855 => 3.8908, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8885, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2161, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.21% (2.9384 => 2.5795, std. dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -10.33% (22.1758 => 19.8861, std. dev.: 0.0384) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2675, std. dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (1.8329 => 1.7155, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1499, std. dev.: 0.0108) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5012, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4227, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9815, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -2.22% (1.2373 => 1.2098, std. dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: -1.94% (4.6441 => 4.5542, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0195, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.21% (6.2999 => 6.2237, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 06:33:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 08:33:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911133324.904082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3672?compare_to=3669&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3672, Order: 163609, Start Time: 2012-09-11 12:20:08, End Time: 2012-09-11 13:34:40 To: 3669, Order: 163605, Start Time: 2012-09-11 10:37:34, End Time: 2012-09-11 11:51:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5613 => 56.4562, std. dev.: 0.1364) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.60% (2.0176 => 2.3929, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 11.27% (0.7061 => 0.7857, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.65% (0.7710 => 0.8531, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.61% (0.1072 => 0.1175, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.46% (3.9660 => 4.3411, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 9.36% (1.3693 => 1.4975, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5265 => 0.5731, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 8.80% (0.3623 => 0.3942, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.71% (0.4328 => 0.4705, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.55% (0.3940 => 0.4277, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.53% (0.9199 => 0.9984, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.49% (1.2193 => 1.3228, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.29% (1.4563 => 1.5770, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.26% (0.6959 => 0.7534, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.06% (1.1364 => 1.2280, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 7.98% (0.4062 => 0.4386, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.84% (0.3022 => 0.3259, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3293 => 0.3549, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.75% (13.8202 => 14.8908, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.71% (0.3489 => 0.3758, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.66% (0.5577 => 0.6004, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.65% (0.2655 => 0.2858, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 7.58% (0.2690 => 0.2894, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3756 => 0.4040, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.6283 => 0.6758, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2726 => 0.2931, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.49% (1.9828 => 2.1314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.49% (0.2937 => 0.3157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.45% (0.4390 => 0.4717, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.38% (7.2180 => 7.7504, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.34% (0.2696 => 0.2894, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.26% (1.0313 => 1.1062, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.23% (0.7506 => 0.8049, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 7.14% (0.3192 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 6.97% (0.2925 => 0.3129, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.95% (0.3868 => 0.4137, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.89% (3.8646 => 4.1310, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 6.87% (0.2243 => 0.2397, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.86% (1.1061 => 1.1820, std. dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.83% (0.3220 => 0.3440, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.69% (3.6692 => 3.9146, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3534 => 0.3770, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.68% (0.2995 => 0.3195, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 6.67% (0.8310 => 0.8864, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.49% (0.7460 => 0.7944, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.38% (3.1889 => 3.3924, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.32% (0.6744 => 0.7170, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4076, std. dev.: 0.0125) MultiSource/Applications/treecc/treecc: 6.23% (1.9270 => 2.0470, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.20% (2.1791 => 2.3142, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 6.15% (0.2945 => 0.3126, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (1.3819 => 1.4649, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.87% (1.2749 => 1.3497, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1210, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.78% (1.3813 => 1.4612, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.77% (4.4433 => 4.6995, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.74% (0.8698 => 0.9197, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.66% (4.3801 => 4.6278, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6135 => 0.6481, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 5.62% (0.4113 => 0.4344, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.55% (16.6129 => 17.5354, std. dev.: 0.0208) MultiSource/Benchmarks/mafft/pairlocalalign: 5.41% (8.4961 => 8.9558, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 5.38% (14.8535 => 15.6527, std. dev.: 0.0145) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (13.2842 => 13.9858, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.25% (1.1333 => 1.1928, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 5.21% (0.3131 => 0.3294, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.18% (14.5298 => 15.2819, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.16% (0.8818 => 0.9273, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.16% (0.6576 => 0.6915, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2292 => 1.2877, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.68% (4.6629 => 4.8812, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (6.5754 => 6.8813, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4805 => 0.5016, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (3.2742 => 3.4178, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1872, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.87% (1.5188 => 1.5776, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.6250 => 0.6491, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.80% (0.9108 => 0.9454, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.73% (3.7467 => 3.8865, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.58% (2.1007 => 2.1759, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (6.2785 => 6.4807, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 2.67% (33.2944 => 34.1844, std. dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: 1.46% (16.2614 => 16.4996, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0507) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7337, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0879, std. dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5910, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6873, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.04% (7.9275 => 8.0096, std. dev.: 0.0085) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std. dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.47% (0.4657 => 0.3983, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.91% (22.5627 => 21.6813, std. dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2537, std. dev.: 0.0221) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.24% (1.3780 => 1.2920, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.76% (0.4867 => 0.4684, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -3.69% (3.2729 => 3.1522, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9243, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5900, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2430, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.61% (4.5928 => 4.5187, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std. dev.: 0.0197) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2267, std. dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2604, std. dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 06:41:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 08:41:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911134116.EA0012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3673?compare_to=3670&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3673, Order: 163612, Start Time: 2012-09-11 12:31:47, End Time: 2012-09-11 13:42:34 To: 3670, Order: 163609, Start Time: 2012-09-11 11:04:57, End Time: 2012-09-11 12:15:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (49 on baseline) Performance Improvements: 5 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.70% (1.3091 => 1.3837, std. dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/sieve: 5.29% (3.6774 => 3.8719, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.14% (2.2862 => 2.3580, std. dev.: 0.0128) MultiSource/Applications/minisat/minisat: 1.08% (6.2619 => 6.3295, std. dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.15% (0.1436 => 0.1319, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -2.86% (0.7755 => 0.7533, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.23% (1.2833 => 1.2547, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.88% (1.0980 => 1.0774, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.75% (4.5497 => 4.4701, std. dev.: 0.0176) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6410 => 0.6797, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.11% (0.3582 => 0.3765, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3217 => 0.3346, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 3.92% (2.1763 => 2.2617, std. dev.: 0.0197) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.5150 => 1.5645, std. dev.: 0.0176) MultiSource/Applications/minisat/minisat: 3.21% (0.6173 => 0.6371, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.88% (1.3935 => 1.4197, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.82% (0.5937 => 0.6045, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (12.6413 => 12.8654, std. dev.: 0.0456) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.62% (1.2021 => 1.2216, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.7639 => 0.7762, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.50% (29.3170 => 29.7572, std. dev.: 0.0639) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.33% (1.1827 => 1.1984, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.96% (1.6538 => 2.3312, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.45% (0.0766 => 0.0869, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.11% (4.0101 => 4.5358, std. dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/sieve: 12.54% (3.4406 => 3.8719, std. dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 11.88% (0.3746 => 0.4191, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.32% (0.2694 => 0.2972, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6097, std. dev.: 0.0127) SingleSource/Benchmarks/Stanford/Puzzle: 8.51% (0.1433 => 0.1555, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.39% (0.2857 => 0.3068, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 7.15% (1.0194 => 1.0923, std. dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.07% (1.0063 => 1.0774, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.08% (27.1724 => 28.8239, std. dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (3.4876 => 3.6915, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.55% (4.2129 => 4.4467, std. dev.: 0.0435) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.77% (40.4792 => 42.4085, std. dev.: 0.6196) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5423, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 3.74% (15.2242 => 15.7934, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8712, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.41% (8.5113 => 8.7161, std. dev.: 0.0537) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.35% (4.6127 => 4.7213, std. dev.: 0.0269) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.27% (2.6656 => 2.7262, std. dev.: 0.0126) MultiSource/Benchmarks/BitBench/five11/five11: 2.05% (5.1938 => 5.3004, std. dev.: 0.0260) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.4455 => 2.4871, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.69% (6.2244 => 6.3295, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/bh/bh: 1.44% (2.5166 => 2.5528, std. dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5314, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.35% (29.5232 => 29.9210, std. dev.: 0.1402) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6694, std. dev.: 0.0275) MultiSource/Benchmarks/Bullet/bullet: 1.13% (6.9722 => 7.0510, std. dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.53% (1.2742 => 1.2547, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.09% (5.2665 => 4.1030, std. dev.: 0.1544) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9896, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1572, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.02% (3.2007 => 2.9441, std. dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.20% (3.6254 => 3.3643, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1853, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -6.56% (1.4441 => 1.3493, std. dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0585) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.72% (45.4683 => 43.7764, std. dev.: 0.3785) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.59% (2.4457 => 2.3580, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (9.2503 => 8.9296, std. dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.24% (3.7496 => 3.6282, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.17% (1.7361 => 1.6811, std. dev.: 0.0077) MultiSource/Applications/aha/aha: -2.85% (3.4286 => 3.3309, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.73% (1.1683 => 1.1364, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2868, std. dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: -2.42% (92.7467 => 90.5058, std. dev.: 0.2306) MultiSource/Benchmarks/mafft/pairlocalalign: -1.92% (62.4126 => 61.2123, std. dev.: 0.1575) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2478, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7658, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3080, std. dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1116 => 1.1002, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 07:37:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 09:37:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120911143704.335642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3674?compare_to=3668&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3674, Order: 163609, Start Time: 2012-09-11 11:55:03, End Time: 2012-09-11 14:38:19 To: 3668, Order: 163601, Start Time: 2012-09-11 08:43:08, End Time: 2012-09-11 11:26:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (119 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.23% (117.0160 => 125.4733, std. dev.: 2.5513) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.74% (0.6098 => 0.6204, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.50% (9.7647 => 9.9115, std. dev.: 0.0501) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.42% (54.0900 => 54.8602, std. dev.: 0.0272) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.06% (0.3442 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.02% (0.3488 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.96% (0.3460 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.95% (0.3469 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.45% (0.3643 => 0.4133, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.40% (0.3650 => 0.4139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.24% (0.3724 => 0.4217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5826 => 0.6353, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5889 => 0.6420, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7171 => 0.7697, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (3.5627 => 3.7998, std. dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (1.6211 => 1.7278, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 6.32% (0.3004 => 0.3194, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2875 => 0.3054, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (0.4361 => 0.4629, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 6.12% (1.5932 => 1.6907, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.11% (1.3152 => 1.3956, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2813 => 0.2984, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.05% (0.2792 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2750 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.95% (0.2823 => 0.2991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2729 => 0.2891, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (0.5026 => 0.5322, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3195 => 0.3383, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2738 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2803 => 0.2966, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.79% (0.9909 => 1.0483, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2780 => 0.2941, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (0.4994 => 0.5281, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.73% (0.2811 => 0.2972, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.5900 => 0.6237, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.67% (0.2911 => 0.3076, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.3267 => 0.3452, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (2.0673 => 2.1843, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.66% (0.4029 => 0.4257, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.3096 => 0.3270, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.59% (0.3258 => 0.3440, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (0.3930 => 0.4149, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.40% (0.3317 => 0.3496, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3060 => 0.3225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.38% (0.3124 => 0.3292, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3477 => 0.3663, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.35% (4.2109 => 4.4361, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (0.5000 => 0.5267, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3362 => 0.3539, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.20% (0.3348 => 0.3522, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3726 => 0.3919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.15% (0.3282 => 0.3451, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3678 => 0.3867, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.2866 => 0.3013, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.10% (1.0781 => 1.1331, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.3625 => 0.3809, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (2.7292 => 2.8645, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 4.85% (0.9697 => 1.0167, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3690 => 0.3866, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.68% (0.4146 => 0.4340, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.63% (0.4251 => 0.4448, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.61% (0.3792 => 0.3967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.3981 => 0.4162, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.49% (1.9694 => 2.0579, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 4.46% (5.5417 => 5.7890, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.3845 => 0.4015, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (0.4658 => 0.4862, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.37% (0.3890 => 0.4060, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (1.9966 => 2.0830, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.3903 => 0.4065, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.08% (1.8794 => 1.9561, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (2.1013 => 2.1817, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.5012 => 0.5203, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.80% (0.2737 => 0.2841, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (2.1653 => 2.2464, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (4.4195 => 4.5846, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.71% (1.4269 => 1.4799, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.70% (0.3271 => 0.3392, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.69% (23.5202 => 24.3875, std. dev.: 0.0164) MultiSource/Applications/siod/siod: 3.59% (0.6634 => 0.6872, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.6435 => 0.6665, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.3084 => 0.3194, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.51% (4.6177 => 4.7799, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.42% (0.7875 => 0.8144, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.41% (0.5546 => 0.5735, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.76% (2.0346 => 2.0704, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (0.7426 => 0.7539, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6695, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8909, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1635, std. dev.: 0.0409) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6377, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std. dev.: 0.0108) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std. dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2286, std. dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4344, std. dev.: 0.0214) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5161, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5844, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4605, std. dev.: 0.0473) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5525, std. dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7877, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8023, std. dev.: 0.0118) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7500, std. dev.: 0.0607) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9629, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 07:57:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 09:57:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911145758.55A532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3675?compare_to=3671&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3675, Order: 163616, Start Time: 2012-09-11 13:39:42, End Time: 2012-09-11 14:59:13 To: 3671, Order: 163609, Start Time: 2012-09-11 11:51:18, End Time: 2012-09-11 13:11:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (140 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.18% (27.5940 => 29.5753, std. dev.: 0.0888) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.83% (56.6282 => 54.4589, std. dev.: 0.7481) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.56% (10.3673 => 15.1948, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 26.14% (0.1622 => 0.2046, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.13% (2.2022 => 2.5134, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.92% (7.0540 => 8.0359, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 13.50% (0.3497 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.35% (0.3543 => 0.4016, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.91% (0.3694 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.72% (0.3828 => 0.4315, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.48% (0.3886 => 0.4371, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.39% (1.7609 => 1.9615, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 9.45% (0.3282 => 0.3592, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 7.30% (9.4845 => 10.1769, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.26% (0.4879 => 0.5233, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.8172 => 0.8764, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.97% (0.2554 => 0.2732, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.89% (0.3307 => 0.3535, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 6.77% (10.4361 => 11.1423, std. dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7433 => 0.7924, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.59% (8.1363 => 8.6723, std. dev.: 0.0095) MultiSource/Applications/spiff/spiff: 6.47% (0.7835 => 0.8342, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.39% (0.5105 => 0.5431, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.38% (0.7115 => 0.7569, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (4.2646 => 4.5337, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30% (0.5860 => 0.6229, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.5569 => 0.5919, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.07% (1.5415 => 1.6350, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.07% (3.3354 => 3.5377, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.01% (1.3050 => 1.3834, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.99% (5.0018 => 5.3016, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 5.96% (5.7591 => 6.1023, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.94% (4.9449 => 5.2385, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.8067 => 0.8527, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.63% (0.3817 => 0.4032, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.47% (0.9765 => 1.0299, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.3422 => 0.3607, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.28% (1.5603 => 1.6427, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.4064 => 0.4278, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.26% (1.1642 => 1.2254, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.10% (1.1861 => 1.2466, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.4103 => 0.4308, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.97% (0.6456 => 0.6777, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.96% (0.5020 => 0.5269, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.95% (7.9617 => 8.3560, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.88% (0.2725 => 0.2858, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.3650 => 0.3826, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.81% (3.8723 => 4.0584, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 4.80% (0.4289 => 0.4495, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.72% (0.2905 => 0.3042, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.71% (0.6450 => 0.6754, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.70% (1.0722 => 1.1226, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2891 => 0.3026, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3865 => 0.4045, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.64% (0.4048 => 0.4236, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.63% (0.2831 => 0.2962, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.60% (2.0273 => 2.1205, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.57% (0.3826 => 0.4001, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.57% (0.4203 => 0.4395, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4636 => 0.4847, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (2.0665 => 2.1602, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.53% (21.9371 => 22.9300, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.49% (0.3232 => 0.3377, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.46% (0.3162 => 0.3303, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.46% (0.2872 => 0.3000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.42% (0.3684 => 0.3847, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.40% (0.3935 => 0.4108, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.39% (0.2871 => 0.2997, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.37% (0.4620 => 0.4822, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3052 => 0.3185, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.30% (0.3603 => 0.3758, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.5981 => 0.6233, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 4.21% (0.2877 => 0.2998, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.19% (2.2969 => 2.3932, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2793 => 0.2910, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.11% (0.8921 => 0.9288, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2802 => 0.2917, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4761, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (14.3668 => 14.9443, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3379 => 0.3510, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.73% (1.5859 => 1.6450, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.40% (2.2024 => 2.2773, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.1840 => 1.2217, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2842 => 1.3205, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4144, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3860, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.32% (4.2280 => 4.3682, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7494, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2346, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5750, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7607, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2308, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.76% (5.3855 => 3.8907, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.43% (5.3526 => 3.8844, std. dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2104, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.23% (2.9384 => 2.5791, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8753, std. dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2630, std. dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1497, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5089, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9818, std. dev.: 0.0266) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4298, std. dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.68% (1.2373 => 1.2042, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9874, std. dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5534, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.82% (2.5528 => 2.5063, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8556, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0554 => 1.0446, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 08:08:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 10:08:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911150805.A70132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3676?compare_to=3673&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3676, Order: 163616, Start Time: 2012-09-11 13:58:27, End Time: 2012-09-11 15:09:22 To: 3673, Order: 163612, Start Time: 2012-09-11 12:31:47, End Time: 2012-09-11 13:42:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (52 on baseline) Performance Improvements: 1 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.2547 => 1.2753, std. dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.13% (1.0371 => 1.0488, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2009 => 1.2141, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.39% (15.7717 => 16.9380, std. dev.: 0.1037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.29% (21.6641 => 22.3777, std. dev.: 0.0542) SingleSource/Benchmarks/Misc/mandel-2: 2.56% (3.0367 => 3.1144, std. dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.54% (3.6282 => 3.6839, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.69% (2.4840 => 2.3426, std. dev.: 0.0352) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.98% (0.6410 => 0.6793, std. dev.: 0.0063) MultiSource/Applications/lemon/lemon: 4.40% (1.0046 => 1.0488, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 4.19% (1.1653 => 1.2141, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 4.01% (2.1763 => 2.2636, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: 3.32% (0.6173 => 0.6378, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.5309 => 0.5448, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.7639 => 0.7773, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.1827 => 1.2030, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.62% (3.0225 => 3.0716, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.26% (13.3238 => 13.4920, std. dev.: 0.0097) MultiSource/Applications/hbd/hbd: 1.22% (1.3268 => 1.3430, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.0689 => 1.0812, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.4408 => 1.4554, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.6079 => 14.7558, std. dev.: 0.0351) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2299, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/ary3: 14.99% (1.7426 => 2.0039, std. dev.: 0.0232) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.97% (4.0101 => 4.5704, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 12.83% (3.4406 => 3.8822, std. dev.: 0.0069) SingleSource/Benchmarks/McGill/misr: 12.78% (0.4296 => 0.4845, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 8.72% (7.0025 => 7.6130, std. dev.: 0.0253) SingleSource/Benchmarks/Stanford/Puzzle: 8.58% (0.1433 => 0.1556, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.31% (1.0063 => 1.0899, std. dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: 7.74% (1.0194 => 1.0983, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.28% (0.2857 => 0.3065, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.99% (15.8312 => 16.9380, std. dev.: 0.1037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.35% (40.4792 => 43.0503, std. dev.: 0.2624) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.13% (27.1724 => 28.8390, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (0.3301 => 0.3501, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 5.93% (3.4876 => 3.6943, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/dt: 4.51% (0.9851 => 1.0295, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.28% (15.2242 => 15.8765, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (4.2129 => 4.3716, std. dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.76% (3.4080 => 3.5362, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.73% (2.6656 => 2.7650, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (6.6312 => 6.8759, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.25% (0.3508 => 0.3622, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 3.18% (8.5113 => 8.7819, std. dev.: 0.0833) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.86% (0.5876 => 0.6044, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.6127 => 4.7118, std. dev.: 0.0250) MultiSource/Benchmarks/BitBench/five11/five11: 2.05% (5.1938 => 5.3002, std. dev.: 0.0268) MultiSource/Benchmarks/Bullet/bullet: 1.94% (6.9722 => 7.1073, std. dev.: 0.0511) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5329, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6709, std. dev.: 0.0275) MultiSource/Applications/lua/lua: 1.12% (29.5232 => 29.8542, std. dev.: 0.1139) MultiSource/Benchmarks/Olden/bh/bh: 1.10% (2.5166 => 2.5444, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.93% (0.7738 => 0.7589, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.75% (0.3497 => 0.2072, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.16% (5.2665 => 4.0992, std. dev.: 0.0579) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9917, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.71% (3.2007 => 2.9539, std. dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.11% (3.6254 => 3.3677, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: -6.89% (3.4230 => 3.1872, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3559, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7960, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.05% (0.4140 => 0.3931, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7625, std. dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.90% (2.4457 => 2.3504, std. dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (9.2503 => 8.9387, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.27% (1.7361 => 1.6794, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.21% (1.2722 => 1.2314, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.77% (1.1683 => 1.1359, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2855, std. dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (92.7467 => 90.3251, std. dev.: 0.2415) MultiSource/Applications/aha/aha: -2.54% (3.4286 => 3.3415, std. dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: -2.26% (62.4126 => 61.0013, std. dev.: 0.2442) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.75% (3.7496 => 3.6839, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0766, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -1.46% (3.8200 => 3.7642, std. dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3174, std. dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.33% (9.3855 => 9.2606, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (7.6833 => 7.5997, std. dev.: 0.0245) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 08:15:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 10:15:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911151559.5ED3D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3677?compare_to=3672&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3677, Order: 163616, Start Time: 2012-09-11 14:02:54, End Time: 2012-09-11 15:17:15 To: 3672, Order: 163609, Start Time: 2012-09-11 12:20:08, End Time: 2012-09-11 13:34:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.72% (2.0176 => 2.3952, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.20% (0.7061 => 0.7852, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.70% (0.7710 => 0.8458, std. dev.: 0.0034) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.39% (3.9660 => 4.3386, std. dev.: 0.0117) MultiSource/Applications/hbd/hbd: 9.36% (1.3693 => 1.4975, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.97% (0.7038 => 0.7669, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5265 => 0.5731, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.84% (0.3914 => 0.4260, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.76% (0.4328 => 0.4707, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.54% (0.9199 => 0.9985, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.51% (1.2193 => 1.3231, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.6959 => 0.7543, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.23% (0.2721 => 0.2945, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.15% (1.4563 => 1.5750, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.08% (1.1364 => 1.2282, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.76% (0.5577 => 0.6010, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.76% (13.8202 => 14.8924, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.75% (0.3899 => 0.4201, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.74% (0.3293 => 0.3548, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.68% (0.3489 => 0.3757, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3756 => 0.4041, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2127 => 0.2288, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2607 => 0.2804, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.6283 => 0.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.42% (7.2180 => 7.7539, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.38% (0.7506 => 0.8060, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.38% (0.4379 => 0.4702, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.32% (1.9828 => 2.1279, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.22% (1.0313 => 1.1058, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.16% (0.4791 => 0.5134, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.12% (0.4016 => 0.4302, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.02% (0.1865 => 0.1996, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.97% (0.2925 => 0.3129, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.5637 => 0.6029, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.4390 => 0.4694, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.79% (1.1061 => 1.1812, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.76% (0.8310 => 0.8872, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.74% (3.8646 => 4.1251, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.72% (3.6692 => 3.9157, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.68% (0.2995 => 0.3195, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.39% (3.1889 => 3.3926, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.38% (0.7460 => 0.7936, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 6.33% (2.1791 => 2.3171, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 6.27% (0.6744 => 0.7167, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.20% (1.3245 => 1.4066, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.20% (1.9270 => 2.0464, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.15% (0.2945 => 0.3126, std. dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (1.2749 => 1.3501, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.82% (1.3819 => 1.4623, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.76% (1.0594 => 1.1204, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 5.74% (0.2859 => 0.3023, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.73% (1.3813 => 1.4605, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.73% (4.4433 => 4.6980, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.3801 => 4.6311, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.8698 => 0.9193, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.66% (0.4113 => 0.4346, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.56% (0.6135 => 0.6476, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.54% (16.6129 => 17.5331, std. dev.: 0.0215) MultiSource/Applications/JM/lencod/lencod: 5.46% (14.8535 => 15.6645, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.41% (8.4961 => 8.9559, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1333 => 1.1939, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.32% (13.2842 => 13.9906, std. dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: 5.17% (14.5298 => 15.2816, std. dev.: 0.0126) MultiSource/Benchmarks/sim/sim: 5.14% (0.3131 => 0.3292, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.14% (0.8818 => 0.9271, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3245 => 0.3407, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2292 => 1.2890, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.81% (0.6576 => 0.6892, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 4.75% (4.6629 => 4.8844, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (6.5754 => 6.8868, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (3.2742 => 3.4187, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4805 => 0.5004, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1867, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5781, std. dev.: 0.0073) MultiSource/Applications/lua/lua: 3.81% (3.7467 => 3.8894, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.75% (0.9108 => 0.9450, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.1007 => 2.1750, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (6.2785 => 6.4806, std. dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 2.74% (33.2944 => 34.2051, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5145, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 25.25% (1.8175 => 2.2764, std. dev.: 0.0432) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7326, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0931, std. dev.: 0.0486) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (0.5184 => 0.5335, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6092, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.14% (1.4298 => 1.4461, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5863, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.43% (0.4657 => 0.3985, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.87% (22.5627 => 21.6901, std. dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2685, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1515, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9259, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5941, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.5928 => 4.5212, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2382, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.14% (4.4810 => 4.4297, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2366, std. dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 09:46:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 11:46:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911164624.EA9522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3678?compare_to=3675&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3678, Order: 163620, Start Time: 2012-09-11 15:27:42, End Time: 2012-09-11 16:47:40 To: 3675, Order: 163616, Start Time: 2012-09-11 13:39:42, End Time: 2012-09-11 14:59:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (142 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (0.8764 => 0.8911, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.96% (78.2848 => 79.8182, std. dev.: 0.4965) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.78% (1.3139 => 1.2905, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fbench: -1.09% (2.3172 => 2.2919, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.36% (10.3673 => 15.1738, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.07% (2.2022 => 2.5120, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.98% (7.0540 => 8.0402, std. dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: 13.79% (0.3473 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.50% (0.3497 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.38% (0.3543 => 0.4017, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.35% (0.3543 => 0.4016, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.31% (0.3561 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3694 => 0.4179, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 12.70% (0.3828 => 0.4314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.51% (0.3886 => 0.4372, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.50% (0.3927 => 0.4418, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.15% (1.1194 => 1.2554, std. dev.: 0.0161) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.39% (1.7609 => 1.9614, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 9.48% (0.3282 => 0.3593, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.04% (0.8172 => 0.8911, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7326 => 0.7916, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.45% (9.4845 => 10.1912, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.4879 => 0.5238, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.11% (0.3307 => 0.3542, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.89% (0.2700 => 0.2886, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.84% (10.4361 => 11.1503, std. dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: 6.81% (0.2554 => 0.2728, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.79% (0.5860 => 0.6258, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.65% (8.1363 => 8.6776, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.60% (0.2107 => 0.2246, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 6.54% (0.3423 => 0.3647, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.48% (0.7115 => 0.7576, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5105 => 0.5435, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.43% (0.7433 => 0.7911, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.40% (0.6675 => 0.7102, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (4.2646 => 4.5368, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.29% (1.5415 => 1.6385, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.15% (5.0018 => 5.3093, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 6.14% (0.7835 => 0.8316, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.11% (4.9449 => 5.2469, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5387, std. dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 6.03% (5.7591 => 6.1061, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.8067 => 0.8553, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5569 => 0.5904, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.97% (1.3050 => 1.3829, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.53% (0.3817 => 0.4028, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4299 => 0.4532, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (0.9765 => 1.0293, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.35% (0.4636 => 0.4884, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (1.1861 => 1.2483, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 5.23% (0.3422 => 0.3601, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.4064 => 0.4276, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.18% (1.5603 => 1.6411, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 5.17% (1.1642 => 1.2244, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 5.11% (0.6456 => 0.6786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.4103 => 0.4312, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 5.08% (3.8723 => 4.0689, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.02% (0.5020 => 0.5272, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3650 => 0.3832, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.84% (7.9617 => 8.3468, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.81% (0.3162 => 0.3314, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.79% (0.3865 => 0.4050, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.74% (1.0722 => 1.1230, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.72% (0.2905 => 0.3042, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.71% (0.4289 => 0.4491, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2891 => 0.3026, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4203 => 0.4399, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.62% (0.6450 => 0.6748, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 4.59% (0.2725 => 0.2850, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.56% (2.0273 => 2.1198, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 4.55% (0.4620 => 0.4830, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.52% (0.3826 => 0.3999, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.51% (21.9371 => 22.9266, std. dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.4048 => 0.4230, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.49% (0.2831 => 0.2958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.48% (0.3684 => 0.3849, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.47% (2.0665 => 2.1588, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3935 => 0.4110, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.3136 => 0.3275, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3098 => 0.3235, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.39% (0.2871 => 0.2997, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.39% (0.3283 => 0.3427, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.39% (0.3603 => 0.3761, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.32% (0.2756 => 0.2875, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.32% (0.2872 => 0.2996, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.30% (0.5981 => 0.6238, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3232 => 0.3370, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8921 => 0.9297, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.3052 => 0.3180, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3920, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 4.14% (0.2877 => 0.2996, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.12% (0.2793 => 0.2908, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (14.3668 => 14.9534, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2802 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (1.4186 => 1.4762, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.5859 => 1.6454, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.2024 => 2.2779, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.1840 => 1.2223, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.82% (1.2842 => 1.3204, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.8101 => 0.8291, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.04% (17.1811 => 17.3606, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0022) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (4.2280 => 4.3641, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2141, std. dev.: 0.0126) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5785, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6818, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1306, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2294, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.75% (5.3855 => 3.8910, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.38% (5.3526 => 3.8868, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2025, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.08% (2.9384 => 2.5834, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -10.26% (22.1758 => 19.9010, std. dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3020, std. dev.: 0.0595) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std. dev.: 0.0015) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5060, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4143, std. dev.: 0.0107) SingleSource/Benchmarks/McGill/chomp: -3.00% (1.2373 => 1.2002, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0088, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9987, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5144, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5778, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 10:01:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 12:01:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911170145.267C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3679?compare_to=3677&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3679, Order: 163620, Start Time: 2012-09-11 15:45:29, End Time: 2012-09-11 16:59:49 To: 3677, Order: 163616, Start Time: 2012-09-11 14:02:54, End Time: 2012-09-11 15:17:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 3 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.5212 => 4.5673, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.04% (0.5335 => 0.5226, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -2.00% (26.4281 => 25.9004, std. dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.67% (4.1259 => 4.0569, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.70% (2.0176 => 2.3949, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.20% (0.7061 => 0.7852, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.88% (0.7710 => 0.8472, std. dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.79% (0.1072 => 0.1177, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.47% (3.9660 => 4.3416, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 9.34% (1.3693 => 1.4972, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.02% (0.7038 => 0.7673, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 8.97% (0.3601 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5265 => 0.5731, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.80% (0.4328 => 0.4709, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.61% (0.6959 => 0.7558, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.44% (1.2193 => 1.3222, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.33% (1.4563 => 1.5776, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.23% (0.2721 => 0.2945, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.12% (1.1364 => 1.2287, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5577 => 0.6016, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.3899 => 0.4205, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.76% (0.2127 => 0.2292, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.74% (0.7506 => 0.8087, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.74% (0.6283 => 0.6769, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.71% (0.3489 => 0.3758, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.71% (13.8202 => 14.8852, std. dev.: 0.0114) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3756 => 0.4040, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.50% (0.2655 => 0.2854, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (7.2180 => 7.7548, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.43% (0.3580 => 0.3846, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.36% (1.9828 => 2.1287, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.25% (1.0313 => 1.1061, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.24% (0.2761 => 0.2961, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.22% (0.4016 => 0.4306, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.18% (0.3246 => 0.3479, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.08% (0.4791 => 0.5130, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.04% (1.1061 => 1.1840, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.97% (0.1865 => 0.1995, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 6.87% (0.2243 => 0.2397, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 6.84% (3.8646 => 4.1289, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4390 => 0.4688, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 6.77% (0.8310 => 0.8873, std. dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.76% (3.6692 => 3.9172, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3453 => 0.3684, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.52% (0.1657 => 0.1765, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.43% (3.1889 => 3.3940, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.39% (0.7460 => 0.7937, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.39% (2.1791 => 2.3183, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 6.36% (1.9270 => 2.0496, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.34% (1.3245 => 1.4085, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: 6.27% (0.6744 => 0.7167, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6135 => 0.6507, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.2945 => 0.3123, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.94% (1.2749 => 1.3506, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.91% (1.3819 => 1.4636, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 5.90% (1.0594 => 1.1219, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.80% (1.3813 => 1.4614, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 5.79% (16.6129 => 17.5755, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4113 => 0.4351, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.3801 => 4.6312, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (4.4433 => 4.6963, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.67% (0.3755 => 0.3968, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.39% (14.8535 => 15.6534, std. dev.: 0.0159) MultiSource/Benchmarks/mafft/pairlocalalign: 5.38% (8.4961 => 8.9534, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9984, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.33% (1.1333 => 1.1937, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 5.31% (14.5298 => 15.3014, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std. dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 5.14% (0.3131 => 0.3292, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.11% (0.8818 => 0.9269, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2292 => 1.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.75% (4.6629 => 4.8843, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.71% (0.6576 => 0.6886, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (6.5754 => 6.8829, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (3.2742 => 3.4179, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.27% (4.9865 => 5.1996, std. dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6250 => 0.6502, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8905, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.82% (1.5188 => 1.5768, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.77% (0.9108 => 0.9451, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1007 => 2.1742, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (6.2785 => 6.4775, std. dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 2.76% (33.2944 => 34.2134, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 1.75% (16.2614 => 16.5467, std. dev.: 0.0297) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.57% (1.9144 => 2.0019, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5480, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.96% (10.7476 => 11.0662, std. dev.: 0.0273) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6015, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1833, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6000, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6872, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.86% (22.5627 => 21.6913, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2566, std. dev.: 0.0163) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3060, std. dev.: 0.0100) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9234, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9180, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5793, std. dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.32% (26.5159 => 25.9004, std. dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2422, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.1080 => 4.0569, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2295, std. dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2520, std. dev.: 0.0204) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2607, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 11:23:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 13:23:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911182331.535712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3680?compare_to=3676&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3680, Order: 163630, Start Time: 2012-09-11 17:07:47, End Time: 2012-09-11 18:20:27 To: 3676, Order: 163616, Start Time: 2012-09-11 13:58:27, End Time: 2012-09-11 15:09:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (44 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 888 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.35% (0.6994 => 0.7228, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.91% (2.8310 => 2.9134, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -2.68% (0.5448 => 0.5302, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: -1.12% (1.0934 => 1.0812, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.34% (0.6410 => 0.6752, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.49% (0.3582 => 0.3743, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.66% (1.1653 => 1.2080, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: 3.14% (0.6173 => 0.6367, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.5150 => 1.5597, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (12.6413 => 12.8643, std. dev.: 0.0229) MultiSource/Applications/d/make_dparser: 1.74% (3.0225 => 3.0751, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.7639 => 0.7742, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.22% (1.1440 => 1.1579, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.15% (13.3238 => 13.4775, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.32% (1.6538 => 2.3371, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std. dev.: 0.0245) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.30% (4.0101 => 4.5433, std. dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/sieve: 12.84% (3.4406 => 3.8823, std. dev.: 0.0126) SingleSource/Benchmarks/McGill/misr: 12.76% (0.4296 => 0.4844, std. dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.24% (0.2694 => 0.2970, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.22% (1.0063 => 1.0991, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6278, std. dev.: 0.0486) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.98% (0.2857 => 0.3085, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.76% (0.3301 => 0.3557, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 6.95% (1.0194 => 1.0902, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 6.27% (3.4876 => 3.7063, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.24% (27.1724 => 28.8678, std. dev.: 0.0244) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.21% (0.7609 => 0.7929, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8326, std. dev.: 0.0544) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 3.34% (8.5113 => 8.7957, std. dev.: 0.0202) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.05% (0.5876 => 0.6055, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.71% (6.9722 => 7.1613, std. dev.: 0.0246) MultiSource/Benchmarks/BitBench/five11/five11: 2.53% (5.1938 => 5.3252, std. dev.: 0.0254) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (2.4971 => 2.5344, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 1.40% (29.5232 => 29.9358, std. dev.: 0.0668) MultiSource/Applications/siod/siod: 1.32% (3.5520 => 3.5988, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.29% (4.0659 => 4.1183, std. dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6643, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 1.14% (2.5166 => 2.5454, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.41% (0.7738 => 0.7474, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.72% (0.3497 => 0.2073, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.08% (5.2665 => 4.1037, std. dev.: 0.1027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.01% (1.1647 => 0.9899, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: -13.20% (0.1114 => 0.0967, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std. dev.: 0.0306) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9446, std. dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.19% (3.6254 => 3.3649, std. dev.: 0.0182) MultiSource/Applications/SIBsim4/SIBsim4: -6.74% (3.4230 => 3.1923, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: -4.71% (4.6355 => 4.4171, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7628, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: -4.43% (0.2664 => 0.2546, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.65% (0.4140 => 0.3989, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -3.46% (62.4126 => 60.2544, std. dev.: 0.4459) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (9.2503 => 8.9373, std. dev.: 0.0401) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.33% (2.4457 => 2.3642, std. dev.: 0.0219) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.07% (1.2722 => 1.2332, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.85% (1.7361 => 1.6866, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.79% (1.1683 => 1.1357, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2864, std. dev.: 0.0095) MultiSource/Applications/aha/aha: -2.60% (3.4286 => 3.3396, std. dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: -2.47% (92.7467 => 90.4579, std. dev.: 0.5191) MultiSource/Benchmarks/FreeBench/neural/neural: -2.04% (1.0926 => 1.0703, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.03% (3.7496 => 3.6736, std. dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.71% (1.0686 => 1.0503, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -1.58% (3.8907 => 3.8294, std. dev.: 0.0183) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.3569 => 2.3206, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (9.3855 => 9.2412, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std. dev.: 0.0191) MultiSource/Benchmarks/Olden/tsp/tsp: -1.33% (1.7330 => 1.7099, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 11:34:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 13:34:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120911183428.E7F8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3681?compare_to=3678&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3681, Order: 163630, Start Time: 2012-09-11 17:16:02, End Time: 2012-09-11 18:35:45 To: 3678, Order: 163620, Start Time: 2012-09-11 15:27:42, End Time: 2012-09-11 16:47:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.99% (54.9186 => 56.5591, std. dev.: 0.0793) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.29% (0.4348 => 0.4031, std. dev.: 0.0119) MultiSource/Benchmarks/PAQ8p/paq8p: -2.38% (15.1738 => 14.8132, std. dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.88% (10.3673 => 14.8132, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 25.34% (0.1622 => 0.2033, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.89% (7.0540 => 8.0341, std. dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.82% (2.2022 => 2.5065, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3473 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.73% (0.3497 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.71% (0.3516 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3543 => 0.3993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3543 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.50% (0.1432 => 0.1611, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.45% (0.3694 => 0.4154, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.99% (0.3828 => 0.4287, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.03% (1.7609 => 1.9551, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1584 => 0.1723, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 8.78% (0.3282 => 0.3570, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5925 => 0.6389, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.6030 => 0.6480, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.3177 => 0.3413, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.35% (0.8172 => 0.8773, std. dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.19% (0.4879 => 0.5230, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.00% (9.4845 => 10.1487, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 6.81% (10.4361 => 11.1466, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.74% (0.7326 => 0.7820, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.42% (8.1363 => 8.6583, std. dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (0.7433 => 0.7909, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3423 => 0.3635, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (4.2646 => 4.5255, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.02% (0.6675 => 0.7077, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.02% (3.3354 => 3.5361, std. dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5860 => 0.6212, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.95% (5.0018 => 5.2996, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.95% (4.9449 => 5.2391, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5569 => 0.5899, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.8067 => 0.8545, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.92% (0.7835 => 0.8299, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.88% (0.5105 => 0.5405, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 5.86% (5.7591 => 6.0967, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (1.3050 => 1.3814, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.85% (1.5415 => 1.6317, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.2758 => 0.2915, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.3092 => 0.3262, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.23% (1.5603 => 1.6419, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9765 => 1.0272, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2234, std. dev.: 0.0081) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.95% (1.1861 => 1.2448, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.90% (0.3817 => 0.4004, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.78% (3.8723 => 4.0575, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.75% (0.4636 => 0.4856, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (7.9617 => 8.3375, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.67% (1.0722 => 1.1223, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.66% (0.6456 => 0.6757, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3422 => 0.3581, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.4103 => 0.4285, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 4.40% (21.9371 => 22.9030, std. dev.: 0.0230) MultiSource/Applications/treecc/treecc: 4.30% (2.0273 => 2.1145, std. dev.: 0.0177) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.28% (0.6450 => 0.6726, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.22% (0.3650 => 0.3804, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.2905 => 0.3023, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.05% (0.3826 => 0.3981, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.05% (0.5981 => 0.6223, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.01% (0.3865 => 0.4020, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.4289 => 0.4461, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.01% (2.2969 => 2.3890, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.97% (0.4203 => 0.4370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.95% (0.4048 => 0.4208, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (14.3668 => 14.9307, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4620 => 0.4800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2831 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3232 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4730, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.3098 => 0.3214, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (2.0665 => 2.1430, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.70% (0.3162 => 0.3279, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.69% (0.3684 => 0.3820, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2871 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.59% (0.2872 => 0.2975, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.54% (1.5859 => 1.6420, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.2024 => 2.2739, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.1840 => 1.2171, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 2.39% (1.2842 => 1.3149, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.8101 => 0.8273, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4138, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3616, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2202, std. dev.: 0.0187) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7612, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.91% (5.2763 => 3.2232, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.95% (5.3855 => 3.8804, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.64% (5.3526 => 3.8729, std. dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1506, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.13% (2.9384 => 2.5820, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.46% (22.1758 => 19.8554, std. dev.: 0.0289) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2745, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0015) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5078, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4161, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0031, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5534, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0135, std. dev.: 0.0108) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2249, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 11:44:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 13:44:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911184430.1C7102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3682?compare_to=3679&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3682, Order: 163630, Start Time: 2012-09-11 17:31:20, End Time: 2012-09-11 18:45:45 To: 3679, Order: 163620, Start Time: 2012-09-11 15:45:29, End Time: 2012-09-11 16:59:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (169 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 964 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.31% (25.9004 => 26.4996, std. dev.: 0.0156) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5226 => 0.5339, std. dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 2.03% (0.5330 => 0.5438, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.78% (79.0671 => 80.4768, std. dev.: 0.3895) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.71% (4.0569 => 4.1264, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.01% (4.5673 => 4.5213, std. dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.79% (2.0176 => 2.4169, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.15% (0.7061 => 0.7848, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.12% (0.5818 => 0.6465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.44% (1.3693 => 1.5123, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.99% (0.7710 => 0.8480, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.86% (3.9660 => 4.3569, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.42% (0.1072 => 0.1173, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.41% (0.7038 => 0.7700, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 9.24% (0.4328 => 0.4728, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.23% (0.4062 => 0.4437, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.09% (0.2782 => 0.3035, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.97% (0.3601 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2781 => 0.3030, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.84% (1.2193 => 1.3271, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.65% (0.9199 => 0.9995, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.59% (0.6959 => 0.7557, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.52% (0.3899 => 0.4231, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.47% (0.3022 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.45% (1.4563 => 1.5794, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 8.44% (0.3293 => 0.3571, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.44% (1.1364 => 1.2323, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.44% (0.2655 => 0.2879, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 8.37% (0.2761 => 0.2992, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.2721 => 0.2948, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.32% (0.2607 => 0.2824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.30% (0.2628 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.29% (0.2966 => 0.3212, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.25% (0.2726 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.25% (0.2690 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.2937 => 0.3179, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.24% (0.3485 => 0.3772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.23% (0.3489 => 0.3776, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.21% (1.9828 => 2.1456, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 8.18% (0.3107 => 0.3361, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.16% (0.6283 => 0.6796, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2760 => 0.2985, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.15% (0.3756 => 0.4062, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.10% (0.3580 => 0.3870, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9387, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.07% (0.3149 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.01% (0.2696 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.98% (0.5577 => 0.6022, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.87% (0.4016 => 0.4332, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.82% (0.3453 => 0.3723, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2127 => 0.2293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.78% (0.3534 => 0.3809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.73% (0.2988 => 0.3219, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.72% (0.4379 => 0.4717, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.71% (0.3192 => 0.3438, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.66% (0.4791 => 0.5158, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.59% (7.2180 => 7.7658, std. dev.: 0.0108) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.47% (0.3868 => 0.4157, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.43% (0.7506 => 0.8064, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.33% (0.2945 => 0.3161, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.24% (0.4390 => 0.4708, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 7.23% (0.8310 => 0.8911, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 7.22% (1.1061 => 1.1860, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.09% (3.6692 => 3.9295, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (3.8646 => 4.1380, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5637 => 0.6035, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 6.83% (0.3220 => 0.3440, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.55% (0.6744 => 0.7186, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 6.50% (3.1889 => 3.3963, std. dev.: 0.0107) MultiSource/Applications/siod/siod: 6.47% (2.1791 => 2.3200, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (0.7460 => 0.7942, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 6.45% (1.9270 => 2.0513, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (1.3819 => 1.4708, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.35% (1.3245 => 1.4086, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.35% (0.8698 => 0.9250, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3755 => 0.3992, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.27% (1.3813 => 1.4679, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 6.21% (1.2749 => 1.3541, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 6.18% (1.0594 => 1.1249, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.6135 => 0.6512, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.01% (0.4113 => 0.4360, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.3801 => 4.6415, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 5.95% (14.8535 => 15.7377, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.94% (4.4433 => 4.7073, std. dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 5.85% (16.6129 => 17.5850, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.2140 => 0.2262, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (8.4961 => 8.9796, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.60% (0.8818 => 0.9312, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.52% (1.2292 => 1.2971, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.2842 => 14.0176, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.50% (1.1333 => 1.1956, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.46% (14.5298 => 15.3227, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.45% (0.3245 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.6576 => 0.6905, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9027, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 4.85% (4.6629 => 4.8892, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.72% (3.2742 => 3.4288, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.60% (0.4805 => 0.5026, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6250 => 0.6530, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.39% (4.9865 => 5.2054, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.12% (0.9108 => 0.9483, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.08% (1.5188 => 1.5808, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.92% (3.7467 => 3.8937, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.73% (2.1007 => 2.1791, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (6.2785 => 6.4974, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 3.00% (33.2944 => 34.2935, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5215, std. dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4166, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.11% (1.2998 => 1.3792, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7343, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5451, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0746, std. dev.: 0.0339) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.99% (0.5184 => 0.5339, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5944, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5159, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5946, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0081) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7476, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2819, std. dev.: 0.0291) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.53% (1.3780 => 1.3018, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9245, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5890, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2498, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.5928 => 4.5213, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std. dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4356, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2417, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 12:50:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 14:50:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911195023.E58AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3683?compare_to=3680&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3683, Order: 163635, Start Time: 2012-09-11 18:40:28, End Time: 2012-09-11 19:51:40 To: 3680, Order: 163630, Start Time: 2012-09-11 17:07:47, End Time: 2012-09-11 18:20:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (48 on baseline) Performance Improvements: 2 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (812 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.2934 => 0.3043, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.94% (0.5620 => 0.5729, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.8842 => 0.9013, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.2564 => 1.2797, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (1.3890 => 1.4136, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.44% (0.7228 => 0.7332, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.61% (20.1928 => 21.5277, std. dev.: 0.3968) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.48% (3.0712 => 3.2394, std. dev.: 0.0363) SingleSource/Benchmarks/Shootout/heapsort: 4.87% (3.1984 => 3.3541, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/mandel-2: 3.35% (3.0331 => 3.1347, std. dev.: 0.0209) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.92% (4.1037 => 4.1824, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.79% (1.3659 => 1.3904, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.27% (1.6096 => 1.6300, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.28% (2.9134 => 2.8469, std. dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.20% (3.6736 => 3.6296, std. dev.: 0.0168) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.98% (0.6410 => 0.6729, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.24% (0.3582 => 0.3734, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 3.63% (2.1763 => 2.2553, std. dev.: 0.0202) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.5150 => 1.5684, std. dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 2.94% (1.1653 => 1.1996, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.72% (0.6173 => 0.6341, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.83% (1.1827 => 1.2043, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.67% (1.4113 => 1.4349, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.47% (0.7226 => 0.7332, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.44% (1.3935 => 1.4136, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (1.2021 => 1.2177, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.23% (2.0972 => 2.1229, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9990, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.64% (4.0101 => 4.5570, std. dev.: 0.1171) SingleSource/Benchmarks/McGill/misr: 12.76% (0.4296 => 0.4844, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 12.69% (3.4406 => 3.8771, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 10.76% (0.3746 => 0.4149, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.28% (0.1433 => 0.1566, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6105, std. dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.96% (1.0063 => 1.0864, std. dev.: 0.0163) SingleSource/Benchmarks/McGill/chomp: 7.77% (1.0194 => 1.0986, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.63% (0.2857 => 0.3075, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (3.0256 => 3.2394, std. dev.: 0.0363) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (0.3301 => 0.3522, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.11% (3.4876 => 3.7006, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8167, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.57% (40.4792 => 42.7346, std. dev.: 0.6124) SingleSource/Benchmarks/Misc/fp-convert: 4.31% (15.2242 => 15.8810, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout/heapsort: 4.30% (3.2159 => 3.3541, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 3.49% (8.5113 => 8.8080, std. dev.: 0.0491) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 2.37% (5.1938 => 5.3170, std. dev.: 0.0461) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.13% (2.6656 => 2.7224, std. dev.: 0.0116) MultiSource/Applications/siod/siod: 1.63% (3.5520 => 3.6098, std. dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (2.4042 => 2.4405, std. dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 1.50% (14.4877 => 14.7055, std. dev.: 0.0268) MultiSource/Applications/lua/lua: 1.43% (29.5232 => 29.9462, std. dev.: 0.1505) MultiSource/Benchmarks/Olden/bh/bh: 1.43% (2.5166 => 2.5525, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5303, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.18% (1.6110 => 1.6300, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.58% (5.2665 => 4.1824, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.02% (1.1647 => 0.9898, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.19% (3.2007 => 2.9385, std. dev.: 0.0679) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3640, std. dev.: 0.0215) MultiSource/Applications/SIBsim4/SIBsim4: -6.74% (3.4230 => 3.1923, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3509, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.98% (0.4140 => 0.3934, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4090, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (3.9413 => 3.7616, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -3.80% (9.2503 => 8.8987, std. dev.: 0.0434) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.32% (1.7361 => 1.6784, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.24% (1.2722 => 1.2310, std. dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.20% (3.7496 => 3.6296, std. dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.10% (2.4457 => 2.3698, std. dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.77% (61.1734 => 59.4799, std. dev.: 0.2668) MultiSource/Applications/aha/aha: -2.73% (3.4286 => 3.3351, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2917, std. dev.: 0.0213) MultiSource/Benchmarks/mafft/pairlocalalign: -2.59% (62.4126 => 60.7969, std. dev.: 0.2322) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6912, std. dev.: 0.1513) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2288, std. dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.51% (1.8739 => 1.8456, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7671, std. dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3172, std. dev.: 0.0299) MultiSource/Benchmarks/sim/sim: -1.27% (3.8907 => 3.8411, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 13:27:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 15:27:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911202713.325782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3684?compare_to=3682&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3684, Order: 163643, Start Time: 2012-09-11 19:14:04, End Time: 2012-09-11 20:28:29 To: 3682, Order: 163630, Start Time: 2012-09-11 17:31:20, End Time: 2012-09-11 18:45:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.4518 => 56.3762, std. dev.: 0.0938) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.04% (2.0176 => 2.4018, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.52% (0.7710 => 0.8521, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 10.21% (0.7061 => 0.7782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.16% (0.5818 => 0.6409, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.90% (0.5748 => 0.6317, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.84% (1.3693 => 1.5041, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.82% (3.9660 => 4.3553, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.15% (0.5265 => 0.5747, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.14% (0.7038 => 0.7681, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.99% (0.4003 => 0.4363, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.95% (0.9199 => 1.0022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.94% (0.4328 => 0.4715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.85% (1.2193 => 1.3272, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.78% (0.6959 => 0.7570, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.73% (0.3940 => 0.4284, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.55% (1.4563 => 1.5808, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.46% (1.1364 => 1.2325, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.2721 => 0.2948, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.25% (0.5577 => 0.6037, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.18% (13.8202 => 14.9503, std. dev.: 0.0123) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.95% (0.2995 => 0.3233, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.88% (0.4379 => 0.4724, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.83% (0.2655 => 0.2863, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.83% (0.7506 => 0.8094, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.75% (0.2607 => 0.2809, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.74% (0.3489 => 0.3759, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.73% (0.2690 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.72% (0.3107 => 0.3347, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.4791 => 0.5161, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3293 => 0.3547, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.3756 => 0.4045, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2726 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.65% (0.2628 => 0.2829, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.60% (7.2180 => 7.7667, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 7.59% (0.2937 => 0.3160, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.58% (0.3246 => 0.3492, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2760 => 0.2968, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 7.53% (0.2761 => 0.2969, std. dev.: 0.0041) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.49% (1.1061 => 1.1890, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3149 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.49% (1.9828 => 2.1313, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.42% (0.2696 => 0.2896, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.24% (3.8646 => 4.1444, std. dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.20% (0.5637 => 0.6043, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.20% (0.4016 => 0.4305, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2988 => 0.3202, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.14% (0.3868 => 0.4144, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3192 => 0.3418, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.07% (0.3534 => 0.3784, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.05% (3.6692 => 3.9278, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.87% (0.8310 => 0.8881, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.81% (0.4390 => 0.4689, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.7460 => 0.7963, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.66% (1.3245 => 1.4127, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.65% (2.1791 => 2.3240, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 6.52% (1.9270 => 2.0526, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.50% (0.1569 => 0.1671, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.50% (3.1889 => 3.3962, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.49% (0.6744 => 0.7182, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.15% (1.0594 => 1.1246, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.10% (0.4113 => 0.4364, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.10% (4.4433 => 4.7143, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (1.3813 => 1.4655, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3525, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6135 => 0.6507, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.06% (0.8698 => 0.9225, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.00% (1.3819 => 1.4648, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.00% (4.3801 => 4.6428, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.99% (0.3755 => 0.3980, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.93% (16.6129 => 17.5981, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (0.2859 => 0.3028, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.74% (14.8535 => 15.7059, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (8.4961 => 8.9797, std. dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.1333 => 1.1973, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (13.2842 => 14.0050, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.36% (0.8818 => 0.9291, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.29% (14.5298 => 15.2982, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9027, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 4.95% (4.6629 => 4.8939, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.2292 => 1.2894, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.68% (3.2742 => 3.4275, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.62% (0.6576 => 0.6880, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.45% (4.9865 => 5.2083, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6250 => 0.6522, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.26% (1.5188 => 1.5835, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (0.9108 => 0.9481, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.05% (2.1007 => 2.1857, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.01% (3.7467 => 3.8968, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (6.2785 => 6.4916, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.19% (33.2944 => 34.3561, std. dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4886, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std. dev.: 0.0515) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7324, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5477, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.15% (10.7476 => 11.0864, std. dev.: 0.0404) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.5184 => 0.5332, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.5999, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.44% (2.0200 => 2.0491, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6867, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5863, std. dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.43% (0.4657 => 0.3985, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.72% (22.5627 => 21.7231, std. dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2518, std. dev.: 0.0360) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std. dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2729 => 3.1514, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9239, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5888, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9933, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5199, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std. dev.: 0.0154) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2236, std. dev.: 0.0114) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4356, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2633, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5656, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 14:05:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 16:05:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120911210540.059952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3685?compare_to=3674&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3685, Order: 163635, Start Time: 2012-09-11 18:23:08, End Time: 2012-09-11 21:06:56 To: 3674, Order: 163609, Start Time: 2012-09-11 11:55:03, End Time: 2012-09-11 14:38:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (125 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.80% (0.3933 => 0.4161, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.61% (109.0935 => 118.4827, std. dev.: 0.0489) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 14.36% (0.3496 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.36% (0.3469 => 0.3967, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 14.34% (0.3465 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.32% (0.3442 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.75% (0.3650 => 0.4152, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5826 => 0.6347, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.5889 => 0.6402, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.29% (0.7171 => 0.7694, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.17% (3.5627 => 3.8182, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (1.6211 => 1.7364, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.97% (1.3152 => 1.4069, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.76% (1.5932 => 1.7009, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.69% (0.5026 => 0.5362, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 6.63% (0.4029 => 0.4296, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.63% (0.4361 => 0.4650, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.55% (0.2014 => 0.2146, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.35% (0.4994 => 0.5311, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.34% (0.5900 => 0.6274, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.18% (0.3930 => 0.4173, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (0.5000 => 0.5306, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 6.04% (4.2109 => 4.4653, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.70% (1.0781 => 1.1395, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.2736 => 0.2891, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.58% (2.7292 => 2.8816, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.2866 => 0.3025, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.3004 => 0.3165, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (1.9694 => 2.0717, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 5.18% (5.5417 => 5.8288, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.15% (0.2875 => 0.3023, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (1.9966 => 2.0991, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.11% (0.9909 => 1.0415, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.07% (0.3195 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.06% (0.3890 => 0.4087, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (0.4658 => 0.4892, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.91% (0.2813 => 0.2951, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.89% (0.3903 => 0.4094, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.85% (1.8794 => 1.9705, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2823 => 0.2959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.80% (0.2792 => 0.2926, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.80% (2.0673 => 2.1665, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2729 => 0.2858, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.71% (0.2780 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2803 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.68% (2.1013 => 2.1996, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.61% (0.3362 => 0.3517, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.60% (0.2911 => 0.3045, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.54% (0.3060 => 0.3199, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 4.51% (0.3348 => 0.3499, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 4.48% (0.3258 => 0.3404, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.48% (2.1653 => 2.2623, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3625 => 0.3787, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.47% (0.3267 => 0.3413, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (4.4195 => 4.6150, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 4.42% (23.5202 => 24.5602, std. dev.: 0.0127) MultiSource/Applications/lua/lua: 4.40% (1.4269 => 1.4897, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.4139 => 0.4320, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.35% (4.6177 => 4.8188, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sieve: 4.35% (0.3726 => 0.3888, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.34% (0.3477 => 0.3628, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.34% (0.3317 => 0.3461, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3282 => 0.3424, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.30% (0.3678 => 0.3836, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.25% (0.6634 => 0.6916, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.3271 => 0.3409, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.20% (0.7875 => 0.8206, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.14% (0.2969 => 0.3092, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3690 => 0.3839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.00% (0.4146 => 0.4312, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.00% (0.9697 => 1.0085, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4251 => 0.4421, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.86% (0.3084 => 0.3203, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.3845 => 0.3990, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.2737 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.72% (0.3981 => 0.4129, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.56% (0.6435 => 0.6664, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.5012 => 0.5186, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.63% (2.0346 => 2.0881, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (0.5361 => 0.5491, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.42% (0.7426 => 0.7606, std. dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 2.39% (0.4847 => 0.4963, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.51% (11.6398 => 11.8152, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (4.6926 => 4.7468, std. dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6658, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 4.07% (14.0481 => 14.6200, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std. dev.: 0.0093) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std. dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2274, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4348, std. dev.: 0.0309) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5926, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4378, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5681, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -8.83% (0.2402 => 0.2190, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7884, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7972, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0060) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.44% (17.2379 => 16.8172, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9585, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 14:16:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 16:16:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911211647.979FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3686?compare_to=3683&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3686, Order: 163646, Start Time: 2012-09-11 20:07:09, End Time: 2012-09-11 21:18:04 To: 3683, Order: 163635, Start Time: 2012-09-11 18:40:28, End Time: 2012-09-11 19:51:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (54 on baseline) Performance Improvements: 0 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.25% (0.2822 => 0.2942, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8298 => 0.8495, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.0703 => 1.0866, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (4.3106 => 4.3580, std. dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 3.45% (21.5277 => 22.2712, std. dev.: 0.2793) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.87% (0.3934 => 0.4047, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.12% (2.3698 => 2.4201, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 1.40% (2.3489 => 2.3817, std. dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.42% (0.1414 => 0.1533, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.63% (0.6410 => 0.6771, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.94% (0.3582 => 0.3759, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 3.97% (0.6173 => 0.6418, std. dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 3.69% (1.1653 => 1.2083, std. dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: 3.52% (2.1763 => 2.2529, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.25% (0.4248 => 0.4386, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.5150 => 1.5617, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.74% (0.3901 => 0.4008, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.5309 => 0.5446, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (1.3935 => 1.4231, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.7639 => 0.7791, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.77% (29.3170 => 29.8359, std. dev.: 0.1141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.70% (1.1827 => 1.2028, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.67% (1.4113 => 1.4348, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (6.2546 => 6.3562, std. dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.60% (4.0318 => 4.0962, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (12.6413 => 12.8396, std. dev.: 0.0549) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (4.2616 => 4.3140, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (8.2559 => 8.3568, std. dev.: 0.0122) MultiSource/Applications/lua/lua: 1.01% (3.5980 => 3.6344, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.83% (0.0263 => 0.0373, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.90% (0.0917 => 0.1072, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 15.00% (1.7426 => 2.0040, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.68% (4.0101 => 4.5585, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.45% (0.0766 => 0.0869, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 12.84% (0.3746 => 0.4227, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8789, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: 11.03% (0.4296 => 0.4770, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 9.07% (7.0025 => 7.6377, std. dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.81% (1.0063 => 1.0849, std. dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.63% (0.2857 => 0.3075, std. dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 7.61% (0.1433 => 0.1542, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8074, std. dev.: 0.0993) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (3.4876 => 3.6951, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 5.19% (21.1721 => 22.2712, std. dev.: 0.2793) SingleSource/Benchmarks/Misc/fp-convert: 4.59% (15.2242 => 15.9229, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (40.4792 => 41.9680, std. dev.: 0.4586) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.83% (2.6656 => 2.7411, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.72% (0.5587 => 0.5739, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 2.24% (5.1938 => 5.3103, std. dev.: 0.0350) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4455 => 2.4847, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.55% (2.3453 => 2.3817, std. dev.: 0.0112) MultiSource/Applications/siod/siod: 1.48% (3.5520 => 3.6044, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5309, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6705, std. dev.: 0.0270) MultiSource/Benchmarks/Olden/bh/bh: 1.09% (2.5166 => 2.5440, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.49% (0.3497 => 0.2046, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.33% (5.2665 => 4.0907, std. dev.: 0.0686) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.81% (1.1647 => 0.9922, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1569, std. dev.: 0.1162) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9396, std. dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3658, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -6.30% (1.4441 => 1.3531, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.4230 => 3.2258, std. dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4094, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.60% (61.1734 => 58.9715, std. dev.: 0.5865) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.46% (1.7361 => 1.6761, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.34% (1.2722 => 1.2297, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/methcall: -3.14% (9.2503 => 8.9595, std. dev.: 0.0565) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.10% (3.7496 => 3.6332, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.05% (1.1683 => 1.1327, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.04% (1.8739 => 1.8170, std. dev.: 0.0213) MultiSource/Applications/aha/aha: -2.76% (3.4286 => 3.3339, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std. dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: -2.70% (92.7467 => 90.2428, std. dev.: 0.3898) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.51% (2.8964 => 2.8238, std. dev.: 0.0200) MultiSource/Benchmarks/Olden/tsp/tsp: -1.88% (1.7330 => 1.7004, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (62.4126 => 61.2724, std. dev.: 0.1862) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2246, std. dev.: 0.0237) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.61% (3.8907 => 3.8279, std. dev.: 0.0111) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.3569 => 2.3225, std. dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3064, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/lists: -1.14% (16.5617 => 16.3737, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (1.7473 => 1.7278, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.06% (1.1116 => 1.0998, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 15:10:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 17:10:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911221004.184B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3687?compare_to=3684&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3687, Order: 163646, Start Time: 2012-09-11 20:56:48, End Time: 2012-09-11 22:11:20 To: 3684, Order: 163643, Start Time: 2012-09-11 19:14:04, End Time: 2012-09-11 20:28:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.54% (2.0176 => 2.4119, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.63% (0.1072 => 0.1186, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.41% (0.7061 => 0.7796, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.31% (0.5818 => 0.6418, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.16% (0.5748 => 0.6332, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.04% (0.7710 => 0.8484, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 9.95% (0.3578 => 0.3934, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.87% (3.9660 => 4.3573, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3623 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.75% (0.3663 => 0.4020, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: 9.74% (0.3789 => 0.4158, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3646 => 0.4001, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3601 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.62% (0.3650 => 0.4001, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.53% (0.3914 => 0.4287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.48% (0.2596 => 0.2842, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.4003 => 0.4382, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.41% (1.3693 => 1.4981, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 9.29% (0.3940 => 0.4306, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.5265 => 0.5749, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.08% (0.7038 => 0.7677, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.90% (1.2193 => 1.3278, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.81% (0.9199 => 1.0009, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.76% (1.1364 => 1.2360, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.67% (0.6959 => 0.7562, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.56% (1.4563 => 1.5809, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.12% (0.5577 => 0.6030, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.00% (13.8202 => 14.9255, std. dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.91% (0.4791 => 0.5170, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.65% (0.2914 => 0.3137, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.65% (0.4379 => 0.4714, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.61% (0.7506 => 0.8077, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.52% (1.0313 => 1.1089, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (7.2180 => 7.7607, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3756 => 0.4036, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.44% (0.3293 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.38% (1.1061 => 1.1877, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (1.9828 => 2.1270, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.20% (0.5637 => 0.6043, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.08% (0.3107 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.04% (3.8646 => 4.1367, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (3.6692 => 3.9246, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 6.88% (0.8310 => 0.8882, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4390 => 0.4691, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3453 => 0.3685, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 6.57% (2.1791 => 2.3222, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.3868 => 0.4122, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.54% (3.1889 => 3.3976, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.50% (1.3245 => 1.4106, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 6.41% (1.9270 => 2.0506, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.41% (0.6744 => 0.7176, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (1.3813 => 1.4670, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.19% (1.3819 => 1.4674, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.11% (1.0594 => 1.1241, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.07% (4.4433 => 4.7130, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.04% (0.8698 => 0.9223, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (1.2749 => 1.3517, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 6.01% (0.4113 => 0.4360, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.6135 => 0.6503, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.98% (4.3801 => 4.6419, std. dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 5.93% (16.6129 => 17.5983, std. dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: 5.86% (14.8535 => 15.7239, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9783, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1974, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (13.2842 => 14.0247, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.44% (0.8818 => 0.9298, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.38% (14.5298 => 15.3122, std. dev.: 0.0156) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.3245 => 0.3411, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.05% (6.5754 => 6.9077, std. dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 4.75% (1.2292 => 1.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.4805 => 0.5031, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 4.70% (4.6629 => 4.8820, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.65% (3.2742 => 3.4264, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.61% (0.6576 => 0.6879, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (4.9865 => 5.2097, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (1.5188 => 1.5816, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.06% (0.9108 => 0.9478, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 4.00% (3.7467 => 3.8966, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6250 => 0.6498, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.87% (2.1007 => 2.1819, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.45% (6.2785 => 6.4948, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.26% (33.2944 => 34.3801, std. dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5205, std. dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5480, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.15% (10.7476 => 11.0862, std. dev.: 0.0372) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (0.5184 => 0.5329, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6059, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5998, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5715, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6852, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.02% (7.9275 => 8.0086, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.91% (0.4657 => 0.4009, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.59% (22.5627 => 21.7525, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2823, std. dev.: 0.0217) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.36% (1.3780 => 1.2904, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1511, std. dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9225, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5818, std. dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2443, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5222, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2246, std. dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2322, std. dev.: 0.0379) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2625, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 15:44:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 17:44:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120911224430.CFD642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3688?compare_to=3686&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3688, Order: 163648, Start Time: 2012-09-11 21:33:59, End Time: 2012-09-11 22:45:46 To: 3686, Order: 163646, Start Time: 2012-09-11 20:07:09, End Time: 2012-09-11 21:18:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (46 on baseline) Performance Improvements: 8 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 874 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.00% (1.3678 => 1.4362, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.07% (0.3367 => 0.3504, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.61% (2.4933 => 2.5832, std. dev.: 0.0184) SingleSource/Benchmarks/McGill/misr: 2.31% (0.4770 => 0.4880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.59% (1.8170 => 1.8458, std. dev.: 0.0079) MultiSource/Benchmarks/llubenchmark/llu: 1.35% (1.9968 => 2.0238, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.35% (4.6687 => 4.7318, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: 1.20% (1.7004 => 1.7208, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.09% (2.5511 => 2.5788, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.03% (5.8543 => 5.9148, std. dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.81% (0.5821 => 0.5541, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.68% (0.9015 => 0.8773, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.27% (0.6025 => 0.5888, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.28% (8.3568 => 8.2496, std. dev.: 0.0404) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.10% (4.3140 => 4.2667, std. dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: -1.04% (3.8975 => 3.8570, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -6.44% (1.1694 => 1.0941, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.89% (2.4201 => 2.3744, std. dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.63% (0.6410 => 0.6771, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.72% (0.3582 => 0.3751, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.13% (0.6173 => 0.6428, std. dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.71% (1.1653 => 1.2085, std. dev.: 0.0109) MultiSource/Applications/lemon/lemon: 3.68% (1.0046 => 1.0416, std. dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: 3.56% (2.1763 => 2.2538, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6069 => 0.6219, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.99% (3.0225 => 3.0827, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.7639 => 0.7774, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (12.6413 => 12.8309, std. dev.: 0.0577) MultiSource/Benchmarks/Bullet/bullet: 1.42% (29.3170 => 29.7339, std. dev.: 0.1571) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.20% (2.0317 => 2.0561, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: 14.79% (1.7426 => 2.0003, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.50% (0.0917 => 0.1050, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.46% (4.0101 => 4.5900, std. dev.: 0.0853) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.71% (0.0766 => 0.0871, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (3.4406 => 3.8801, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6182, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.19% (0.2857 => 0.3091, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 7.33% (1.0194 => 1.0941, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3301 => 0.3504, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 6.04% (3.4876 => 3.6982, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8074, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/fp-convert: 4.27% (15.2242 => 15.8739, std. dev.: 0.0495) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 3.16% (1.4184 => 1.4632, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.08% (0.5876 => 0.6057, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5113 => 8.7605, std. dev.: 0.0442) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.76% (2.6656 => 2.7391, std. dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.58% (4.6127 => 4.7318, std. dev.: 0.0089) MultiSource/Benchmarks/BitBench/five11/five11: 2.55% (5.1938 => 5.3265, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.43% (1.4021 => 1.4362, std. dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.24% (0.5587 => 0.5712, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (2.4455 => 2.4824, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9152 => 2.9590, std. dev.: 0.0125) MultiSource/Applications/siod/siod: 1.49% (3.5520 => 3.6050, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5308, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.31% (14.4877 => 14.6769, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 1.28% (2.5166 => 2.5487, std. dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.47% (0.5740 => 0.5541, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.84% (0.9029 => 0.8773, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: -1.84% (0.7738 => 0.7596, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.15% (5.2665 => 4.1001, std. dev.: 0.0887) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.51% (1.1647 => 0.9841, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.65% (1.4034 => 1.2820, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.19% (3.2007 => 2.9386, std. dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.04% (3.6254 => 3.3700, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -6.57% (3.4230 => 3.1981, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/richards_benchmark: -6.48% (1.4441 => 1.3505, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4103, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.13% (0.4140 => 0.3969, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.16% (1.7361 => 1.6812, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.02% (9.2503 => 8.9708, std. dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.92% (2.4457 => 2.3744, std. dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6424, std. dev.: 0.0389) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1354, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -2.80% (62.4126 => 60.6620, std. dev.: 0.3472) MultiSource/Applications/aha/aha: -2.67% (3.4286 => 3.3372, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -2.63% (9.5474 => 9.2960, std. dev.: 0.0096) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.52% (1.2722 => 1.2401, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.37% (2.8964 => 2.8279, std. dev.: 0.0144) MultiSource/Benchmarks/PAQ8p/paq8p: -2.33% (92.7467 => 90.5869, std. dev.: 0.2063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (9.3855 => 9.2178, std. dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.50% (1.8739 => 1.8458, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (25.6658 => 25.3267, std. dev.: 0.0251) MultiSource/Benchmarks/sim/sim: -1.31% (3.8907 => 3.8398, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/oourafft: -1.30% (3.8200 => 3.7704, std. dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: -1.26% (6.7458 => 6.6606, std. dev.: 0.0194) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 16:53:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 18:53:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120911235303.87AD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3689?compare_to=3687&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3689, Order: 163650, Start Time: 2012-09-11 22:39:38, End Time: 2012-09-11 23:54:18 To: 3687, Order: 163646, Start Time: 2012-09-11 20:56:48, End Time: 2012-09-11 22:11:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.24% (78.9309 => 80.7011, std. dev.: 0.3813) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.49% (2.0176 => 2.4108, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.81% (0.7061 => 0.7824, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.73% (0.5748 => 0.6365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.71% (0.5818 => 0.6441, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.14% (0.7710 => 0.8492, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.87% (3.9660 => 4.3576, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 9.81% (0.3578 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3646 => 0.3999, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3789 => 0.4153, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.53% (0.3663 => 0.4012, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.38% (0.3623 => 0.3963, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.38% (1.3693 => 1.4978, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3914 => 0.4280, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.4003 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.10% (0.5265 => 0.5744, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.86% (1.2193 => 1.3273, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.84% (0.7038 => 0.7660, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.69% (0.9199 => 0.9998, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.62% (1.4563 => 1.5819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.47% (1.1364 => 1.2327, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.32% (0.6959 => 0.7538, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 8.32% (0.4328 => 0.4688, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.95% (0.2127 => 0.2296, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.77% (13.8202 => 14.8938, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.70% (0.6283 => 0.6767, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4379 => 0.4715, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (7.2180 => 7.7627, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 7.46% (1.0313 => 1.1082, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.43% (0.7506 => 0.8064, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.4791 => 0.5145, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.34% (0.2914 => 0.3128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4390 => 0.4711, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.3489 => 0.3744, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.29% (0.3756 => 0.4030, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (1.9828 => 2.1251, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.17% (0.5637 => 0.6041, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1848, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4016 => 0.4300, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3192 => 0.3417, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.02% (0.1865 => 0.1996, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (3.8646 => 4.1316, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (3.6692 => 3.9225, std. dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.89% (0.3220 => 0.3442, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.87% (0.2023 => 0.2162, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 6.86% (0.8310 => 0.8880, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.53% (0.7460 => 0.7947, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.50% (3.1889 => 3.3962, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.47% (1.3245 => 1.4102, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.36% (0.6744 => 0.7173, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 6.31% (1.9270 => 2.0485, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 6.30% (2.1791 => 2.3164, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.23% (1.3813 => 1.4673, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (1.3819 => 1.4673, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.11% (4.3801 => 4.6477, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 6.04% (1.0594 => 1.1234, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.98% (4.4433 => 4.7092, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.89% (1.2749 => 1.3500, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.86% (14.8535 => 15.7236, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4113 => 0.4353, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.82% (0.6135 => 0.6492, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.2140 => 0.2262, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.8698 => 0.9193, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.62% (8.4961 => 8.9732, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.60% (16.6129 => 17.5426, std. dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.51% (1.1333 => 1.1957, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.48% (13.2842 => 14.0122, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 5.46% (14.5298 => 15.3230, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.25% (0.8818 => 0.9281, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9029, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.68% (3.2742 => 3.4275, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.66% (1.2292 => 1.2865, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 4.51% (4.6629 => 4.8731, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.32% (0.6576 => 0.6860, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.07% (4.9865 => 5.1896, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.07% (1.5188 => 1.5806, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.89% (0.9108 => 0.9462, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.82% (3.7467 => 3.8898, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.6250 => 0.6484, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.72% (2.1007 => 2.1789, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.34% (6.2785 => 6.4882, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.10% (33.2944 => 34.3270, std. dev.: 0.0196) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5219, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5191, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0461) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7338, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1220, std. dev.: 0.0361) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6065, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0067) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5948, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.09% (0.4657 => 0.4001, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7092, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2601, std. dev.: 0.0150) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.34% (1.3780 => 1.3044, std. dev.: 0.0114) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.48% (3.0263 => 2.9210, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6040, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2331, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5205, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0163) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2392, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2372, std. dev.: 0.0185) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 17:09:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 19:09:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912000903.63C792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3690?compare_to=3681&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3690, Order: 163650, Start Time: 2012-09-11 22:50:15, End Time: 2012-09-12 00:10:20 To: 3681, Order: 163630, Start Time: 2012-09-11 17:16:02, End Time: 2012-09-11 18:35:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (140 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.07% (11.1466 => 11.2658, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (79.3001 => 81.0107, std. dev.: 0.0872) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.48% (10.3673 => 14.6674, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/richards_benchmark: 25.96% (0.1622 => 0.2043, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.34% (2.2022 => 2.5181, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.05% (0.3473 => 0.3961, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.04% (7.0540 => 8.0444, std. dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3497 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.83% (0.3543 => 0.4033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 13.71% (0.3516 => 0.3998, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.59% (0.3561 => 0.4045, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/for-in: 13.21% (0.3694 => 0.4182, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0834 => 0.0944, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3828 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.89% (0.3927 => 0.4433, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.14% (1.1194 => 1.2553, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.06% (1.7609 => 1.9557, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 9.81% (0.3282 => 0.3604, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.03% (0.3177 => 0.3432, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.95% (10.4361 => 11.2658, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.87% (0.8172 => 0.8815, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.40% (0.4879 => 0.5240, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.36% (9.4845 => 10.1823, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.26% (0.2107 => 0.2260, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.02% (0.3307 => 0.3539, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 6.81% (0.2554 => 0.2728, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.74% (0.5860 => 0.6255, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5569 => 0.5942, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 6.69% (0.7326 => 0.7816, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.66% (0.7835 => 0.8357, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (8.1363 => 8.6769, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (4.2646 => 4.5468, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.52% (1.5415 => 1.6420, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 6.50% (0.3109 => 0.3311, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3423 => 0.3643, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.34% (4.9449 => 5.2583, std. dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7433 => 0.7904, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.31% (0.5105 => 0.5427, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.6675 => 0.7091, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.23% (5.0018 => 5.3134, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5388, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (1.3050 => 1.3839, std. dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 5.95% (5.7591 => 6.1017, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.82% (0.3817 => 0.4039, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.77% (0.4299 => 0.4547, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.8067 => 0.8529, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 5.70% (1.5603 => 1.6493, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.57% (0.9765 => 1.0309, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.42% (1.1642 => 1.2273, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1861 => 1.2481, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.06% (0.3441 => 0.3615, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (0.4064 => 0.4269, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 5.04% (3.8723 => 4.0676, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 4.97% (0.3422 => 0.3592, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.96% (0.6456 => 0.6776, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2603 => 0.2731, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (7.9617 => 8.3506, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4636 => 0.4862, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.80% (0.5020 => 0.5261, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 4.77% (1.0722 => 1.1233, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2891 => 0.3025, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.60% (21.9371 => 22.9467, std. dev.: 0.0205) MultiSource/Applications/treecc/treecc: 4.60% (2.0273 => 2.1205, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.59% (0.4203 => 0.4396, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.59% (0.6450 => 0.6746, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3865 => 0.4039, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.48% (0.2905 => 0.3035, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.46% (0.3136 => 0.3276, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3650 => 0.3811, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.36% (2.0665 => 2.1566, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.4289 => 0.4476, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5981 => 0.6239, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.27% (0.3935 => 0.4103, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3826 => 0.3988, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.20% (0.2831 => 0.2950, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8921 => 0.9295, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3603 => 0.3753, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.16% (0.4620 => 0.4812, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.15% (0.4048 => 0.4216, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3684 => 0.3836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.11% (0.3283 => 0.3418, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.11% (0.3162 => 0.3292, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.11% (0.2872 => 0.2990, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.08% (2.2969 => 2.3905, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 4.06% (0.3052 => 0.3176, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4761, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (14.3668 => 14.9451, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3232 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.96% (0.2877 => 0.2991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.83% (0.2793 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2802 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3379 => 0.3503, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5859 => 1.6432, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.2024 => 2.2760, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.1840 => 1.2213, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.77% (1.2842 => 1.3198, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.8101 => 0.8309, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.09% (1.1145 => 1.3718, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (4.2280 => 4.3641, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2334, std. dev.: 0.0274) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7617, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.70% (5.2763 => 3.2344, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.82% (5.3855 => 3.8870, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8888, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1811, std. dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.61% (2.9384 => 2.5973, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -10.39% (22.1758 => 19.8711, std. dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2590, std. dev.: 0.1223) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.14% (1.6805 => 1.5773, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1498, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5108, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4196, std. dev.: 0.0146) SingleSource/Benchmarks/McGill/chomp: -2.89% (1.2373 => 1.2016, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0096, std. dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.09% (8.1563 => 7.9856, std. dev.: 0.0152) MultiSource/Applications/sqlite3/sqlite3: -1.90% (4.6441 => 4.5560, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6781, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4231, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.35% (6.2999 => 6.2150, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 17:16:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 19:16:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912001642.B2DC62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3691?compare_to=3688&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3691, Order: 163653, Start Time: 2012-09-11 23:06:05, End Time: 2012-09-12 00:18:00 To: 3688, Order: 163648, Start Time: 2012-09-11 21:33:59, End Time: 2012-09-11 22:45:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (44 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (819 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.55% (0.4304 => 0.4543, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (12.8309 => 13.0210, std. dev.: 0.0295) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 2.24% (2.3744 => 2.4276, std. dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.67% (42.8794 => 43.5974, std. dev.: 0.1984) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.66% (59.9029 => 60.8985, std. dev.: 0.3646) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.04% (1.4362 => 1.3351, std. dev.: 0.0333) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.24% (0.6410 => 0.6746, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.39% (1.4408 => 1.5040, std. dev.: 0.0199) MultiSource/Applications/lemon/lemon: 4.35% (1.0046 => 1.0483, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (3.0758 => 3.1968, std. dev.: 0.0419) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3582 => 0.3719, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 3.52% (0.6173 => 0.6390, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (12.6413 => 13.0210, std. dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.7639 => 0.7861, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.4113 => 1.4373, std. dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 1.47% (29.3170 => 29.7467, std. dev.: 0.1197) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (8.2186 => 8.3141, std. dev.: 0.0209) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std. dev.: 0.0271) SingleSource/Benchmarks/McGill/misr: 14.04% (0.4296 => 0.4899, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5565, std. dev.: 0.0157) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std. dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 13.05% (0.1433 => 0.1620, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.25% (1.0063 => 1.0994, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6220, std. dev.: 0.0237) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.91% (0.2857 => 0.3083, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.70% (40.4792 => 43.5974, std. dev.: 0.1984) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.63% (0.3301 => 0.3553, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 7.49% (1.0194 => 1.0958, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8122, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (3.4876 => 3.6974, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8581, std. dev.: 0.0530) SingleSource/Benchmarks/Misc/ReedSolomon: 3.89% (8.5113 => 8.8427, std. dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (4.2129 => 4.3694, std. dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.71% (6.6312 => 6.8774, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.68% (2.6656 => 2.7636, std. dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 3.45% (21.1721 => 21.9033, std. dev.: 0.1683) MultiSource/Benchmarks/Olden/power/power: 3.36% (1.4184 => 1.4660, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.37% (0.5876 => 0.6015, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2995, std. dev.: 0.0392) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.00% (4.6127 => 4.7050, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4455 => 2.4807, std. dev.: 0.0077) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.40% (4.0659 => 4.1229, std. dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6705, std. dev.: 0.0410) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.21% (5.2665 => 4.0968, std. dev.: 0.1312) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9897, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9362, std. dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3671, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: -6.92% (3.4230 => 3.1862, std. dev.: 0.0314) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3522, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4100, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (3.9413 => 3.7643, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (9.2503 => 8.9177, std. dev.: 0.0472) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.32% (1.2722 => 1.2299, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.92% (1.7361 => 1.6854, std. dev.: 0.0172) MultiSource/Applications/aha/aha: -2.86% (3.4286 => 3.3306, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: -2.37% (62.4126 => 60.9309, std. dev.: 0.2422) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.09% (3.7496 => 3.6712, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.83% (2.8964 => 2.8434, std. dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2479, std. dev.: 0.0437) MultiSource/Benchmarks/sim/sim: -1.38% (3.8907 => 3.8370, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7689, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3286, std. dev.: 0.1239) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.17% (1.8739 => 1.8519, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 17:17:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 19:17:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912001747.2A9272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3692?compare_to=3685&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3692, Order: 163648, Start Time: 2012-09-11 21:35:06, End Time: 2012-09-12 00:19:02 To: 3685, Order: 163635, Start Time: 2012-09-11 18:23:08, End Time: 2012-09-11 21:06:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.36% (54.1807 => 54.9180, std. dev.: 0.0206) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.13% (0.3496 => 0.3990, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.59% (0.3650 => 0.4146, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5826 => 0.6332, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5889 => 0.6389, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.03% (0.1619 => 0.1749, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.48% (0.5026 => 0.5402, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.97% (0.7171 => 0.7671, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (1.6211 => 1.7335, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (3.5627 => 3.8084, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.67% (0.4994 => 0.5327, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.63% (0.4361 => 0.4650, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.44% (0.5900 => 0.6280, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.38% (1.3152 => 1.3991, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (0.3930 => 0.4178, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.20% (1.5932 => 1.6919, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2875 => 0.3046, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.88% (4.2109 => 4.4584, std. dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.3004 => 0.3179, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (0.5000 => 0.5288, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.76% (0.3195 => 0.3379, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 5.76% (0.4029 => 0.4261, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.67% (0.9909 => 1.0471, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2738 => 0.2893, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.57% (0.2729 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.56% (0.3362 => 0.3549, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.2823 => 0.2980, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.53% (1.0781 => 1.1377, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.52% (0.3060 => 0.3229, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.2736 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.2780 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.49% (0.2750 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.48% (0.2792 => 0.2945, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2813 => 0.2967, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2911 => 0.3070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.44% (0.2811 => 0.2964, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 5.39% (0.3096 => 0.3263, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2803 => 0.2954, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.37% (2.0673 => 2.1783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3258 => 0.3429, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 5.20% (0.3267 => 0.3437, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.3625 => 0.3813, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.19% (0.3317 => 0.3489, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.15% (0.3124 => 0.3285, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.13% (2.7292 => 2.8691, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 5.11% (0.3678 => 0.3866, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.11% (0.2566 => 0.2697, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (0.3890 => 0.4088, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.06% (0.3282 => 0.3448, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.05% (0.3348 => 0.3517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.04% (1.9694 => 2.0686, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8203, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3726 => 0.3913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (0.4658 => 0.4888, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.92% (1.9966 => 2.0949, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3477 => 0.3648, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.89% (0.9697 => 1.0171, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.82% (0.4146 => 0.4346, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.75% (23.5202 => 24.6379, std. dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: 4.69% (2.1013 => 2.1998, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3690 => 0.3862, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (1.8794 => 1.9666, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.61% (0.3903 => 0.4083, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.59% (0.4251 => 0.4446, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (4.4195 => 4.6202, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 4.39% (0.6634 => 0.6925, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 4.35% (1.4269 => 1.4889, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.32% (0.3845 => 0.4011, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.27% (0.3981 => 0.4151, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.22% (4.6177 => 4.8124, std. dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: 4.17% (2.1653 => 2.2556, std. dev.: 0.0070) MultiSource/Applications/treecc/treecc: 4.14% (0.7875 => 0.8201, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 4.09% (0.5546 => 0.5773, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.5012 => 0.5211, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.4139 => 0.4302, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.92% (0.6435 => 0.6687, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.2737 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.80% (2.0346 => 2.0915, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 2.70% (0.4847 => 0.4978, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (0.5361 => 0.5493, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (0.7426 => 0.7584, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (0.5584 => 0.5688, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.62% (11.6398 => 11.8281, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.6926 => 4.7561, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6827, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.13% (1.8057 => 1.8983, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std. dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5045, std. dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4500, std. dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.47% (2.0820 => 2.1127, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2817, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5923, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5598, std. dev.: 0.0165) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7904, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: -5.87% (0.2402 => 0.2261, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8028, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0047) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7763, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8023, std. dev.: 0.0553) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5696, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9614, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 18:36:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 20:36:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912013623.61DFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3693?compare_to=3689&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3693, Order: 163665, Start Time: 2012-09-12 00:23:15, End Time: 2012-09-12 01:37:38 To: 3689, Order: 163650, Start Time: 2012-09-11 22:39:38, End Time: 2012-09-11 23:54:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.44% (55.0577 => 56.3990, std. dev.: 0.0655) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.28% (2.0176 => 2.4066, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.12% (0.7061 => 0.7846, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 11.02% (0.5818 => 0.6459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.94% (0.5748 => 0.6377, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.33% (0.3601 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3623 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.32% (0.3663 => 0.4041, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3789 => 0.4179, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.29% (0.3646 => 0.4021, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3650 => 0.4023, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.12% (0.7710 => 0.8490, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.07% (0.3914 => 0.4308, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.89% (0.4003 => 0.4399, std. dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.85% (0.3940 => 0.4328, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.72% (3.9660 => 4.3513, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.19% (1.3693 => 1.4951, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.12% (0.5265 => 0.5745, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.90% (1.2193 => 1.3278, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 8.77% (0.7038 => 0.7655, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.76% (0.9199 => 1.0005, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.74% (0.6959 => 0.7567, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.68% (1.4563 => 1.5827, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.54% (0.4062 => 0.4409, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.38% (1.1364 => 1.2316, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 8.13% (13.8202 => 14.9440, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.05% (0.5577 => 0.6026, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.01% (0.6283 => 0.6786, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.95% (0.2127 => 0.2296, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.76% (0.4791 => 0.5163, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.63% (0.4379 => 0.4713, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.62% (0.7506 => 0.8078, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3756 => 0.4040, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (7.2180 => 7.7628, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.54% (0.4390 => 0.4721, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.48% (0.2914 => 0.3132, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.47% (0.3293 => 0.3539, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.43% (1.0313 => 1.1079, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.35% (0.2925 => 0.3140, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (1.9828 => 2.1272, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.22% (0.5637 => 0.6044, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 7.22% (0.2937 => 0.3149, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (3.6692 => 3.9316, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.11% (1.1061 => 1.1847, std. dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.08% (0.3868 => 0.4142, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.08% (0.2995 => 0.3207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2023 => 0.2165, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.99% (3.8646 => 4.1347, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 6.99% (0.3220 => 0.3445, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3192 => 0.3415, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.86% (0.8310 => 0.8880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3453 => 0.3689, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3971, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.42% (1.3245 => 1.4095, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.38% (1.9270 => 2.0500, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 6.26% (2.1791 => 2.3156, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.24% (0.6744 => 0.7165, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (1.3819 => 1.4664, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.10% (0.4113 => 0.4364, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.08% (1.3813 => 1.4653, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.07% (1.0594 => 1.1237, std. dev.: 0.0126) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.02% (4.4433 => 4.7107, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.6135 => 0.6503, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.98% (4.3801 => 4.6420, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.2859 => 0.3029, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (1.2749 => 1.3501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (0.8698 => 0.9211, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.80% (14.8535 => 15.7156, std. dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (8.4961 => 8.9887, std. dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 5.63% (16.6129 => 17.5489, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.53% (0.8818 => 0.9306, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (1.1333 => 1.1959, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.49% (13.2842 => 14.0129, std. dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.29% (14.5298 => 15.2988, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.07% (4.6629 => 4.8992, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (6.5754 => 6.9060, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.99% (0.6576 => 0.6904, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.47% (3.2742 => 3.4207, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6250 => 0.6506, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.02% (1.5188 => 1.5798, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1866, std. dev.: 0.0084) MultiSource/Applications/lua/lua: 3.85% (3.7467 => 3.8908, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (6.2785 => 6.5151, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.66% (2.1007 => 2.1776, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.25% (0.3511 => 0.3625, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.13% (33.2944 => 34.3364, std. dev.: 0.0202) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4951, std. dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.55% (1.8175 => 2.2637, std. dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5462, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0751, std. dev.: 0.0644) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.5184 => 0.5330, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5962, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5944, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.38% (0.4657 => 0.4034, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (22.5627 => 21.7034, std. dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.34% (20.3410 => 18.2385, std. dev.: 0.0266) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.13% (1.3780 => 1.2935, std. dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9228, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5781, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2446, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.5928 => 4.5197, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2404, std. dev.: 0.0239) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.5254 => 2.4967, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 18:43:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 20:43:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912014304.7AB2D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3694?compare_to=3691&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3694, Order: 163666, Start Time: 2012-09-12 00:33:44, End Time: 2012-09-12 01:44:22 To: 3691, Order: 163653, Start Time: 2012-09-11 23:06:05, End Time: 2012-09-12 00:18:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (52 on baseline) Performance Improvements: 3 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 876 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.48% (0.1019 => 0.1136, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 8.03% (0.1432 => 0.1547, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2950 => 0.3097, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.72% (0.2372 => 0.2484, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.25% (0.2750 => 0.2867, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.59% (0.4543 => 0.4706, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.53% (0.5465 => 0.5603, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.2379 => 4.3065, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.57% (8.3118 => 8.4421, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.4241 => 1.4408, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 7.84% (3.5975 => 3.8794, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.61% (4.3694 => 4.5708, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.06% (1.4336 => 1.4488, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.56% (2.0900 => 2.0364, std. dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -3.67% (2.4276 => 2.3384, std. dev.: 0.0207) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.99% (1.6854 => 1.6518, std. dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6410 => 0.6835, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.47% (0.3582 => 0.3778, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 4.46% (2.1763 => 2.2733, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: 3.69% (0.6173 => 0.6401, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3.66% (1.1653 => 1.2080, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.5150 => 1.5684, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.1827 => 1.2114, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.39% (0.4596 => 0.4706, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (8.2559 => 8.4421, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.93% (0.5636 => 0.5745, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.7639 => 0.7784, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.0318 => 4.1077, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (12.6413 => 12.8611, std. dev.: 0.0843) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.4189 => 1.4408, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (8.2186 => 8.3371, std. dev.: 0.0212) MultiSource/Benchmarks/Bullet/bullet: 1.35% (29.3170 => 29.7138, std. dev.: 0.0210) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.08% (1.2021 => 1.2151, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 1.06% (15.3105 => 15.4735, std. dev.: 0.0482) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0198) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5476, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (3.4406 => 3.8794, std. dev.: 0.0203) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.73% (7.0025 => 7.6139, std. dev.: 0.0595) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.50% (4.2129 => 4.5708, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.60% (0.2857 => 0.3074, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 7.36% (1.0194 => 1.0944, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.31% (1.0063 => 1.0698, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (3.4876 => 3.7052, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8075, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (0.3301 => 0.3463, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8520, std. dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.69% (0.8498 => 0.8812, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std. dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.84% (2.6656 => 2.7412, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: 2.73% (8.5113 => 8.7440, std. dev.: 0.0454) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 2.00% (5.1938 => 5.2975, std. dev.: 0.0320) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.61% (4.6127 => 4.6871, std. dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4835, std. dev.: 0.0096) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.55% (4.0659 => 4.1290, std. dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.39% (29.5232 => 29.9327, std. dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6692, std. dev.: 0.0361) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.14% (1.4324 => 1.4488, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0780, std. dev.: 0.1145) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9897, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std. dev.: 0.0220) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.64% (1.4034 => 1.2822, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9389, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3664, std. dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: -6.87% (3.4230 => 3.1880, std. dev.: 0.0656) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3515, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7959, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0285) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.86% (1.7361 => 1.6518, std. dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/distray/distray: -4.43% (0.2664 => 0.2546, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.39% (2.4457 => 2.3384, std. dev.: 0.0207) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.04% (1.2959 => 1.2436, std. dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.57% (3.7496 => 3.6158, std. dev.: 0.0505) SingleSource/Benchmarks/Shootout-C++/methcall: -3.54% (9.2503 => 8.9230, std. dev.: 0.0290) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.38% (1.2722 => 1.2292, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.91% (1.1683 => 1.1343, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std. dev.: 0.0208) MultiSource/Applications/aha/aha: -2.70% (3.4286 => 3.3361, std. dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -2.66% (92.7467 => 90.2816, std. dev.: 0.2173) MultiSource/Benchmarks/Olden/tsp/tsp: -1.88% (1.7330 => 1.7004, std. dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (62.4126 => 61.2422, std. dev.: 0.1899) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2353, std. dev.: 0.0453) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.55% (3.8907 => 3.8303, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: -1.43% (6.7458 => 6.6495, std. dev.: 0.0242) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3112, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7700, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.15% (1.1116 => 1.0988, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 18:57:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 20:57:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912015700.0E8ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3695?compare_to=3690&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3695, Order: 163666, Start Time: 2012-09-12 00:38:38, End Time: 2012-09-12 01:58:16 To: 3690, Order: 163650, Start Time: 2012-09-11 22:50:15, End Time: 2012-09-12 00:10:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (721 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.42% (14.6674 => 15.0227, std. dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.90% (10.3673 => 15.0227, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: 25.96% (0.1622 => 0.2043, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.27% (2.2022 => 2.5165, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.93% (7.0540 => 8.0364, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3473 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3516 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3543 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.69% (0.3561 => 0.4013, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.40% (0.3694 => 0.4152, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.29% (0.1432 => 0.1608, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.39% (1.7609 => 1.9439, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.02% (0.3282 => 0.3578, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.03% (10.4361 => 11.2743, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.71% (0.8172 => 0.8802, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.38% (0.1625 => 0.1745, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.6030 => 0.6464, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.05% (0.4879 => 0.5223, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.94% (9.4845 => 10.1429, std. dev.: 0.0165) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (8.1363 => 8.6595, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 6.42% (0.7835 => 0.8338, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.34% (0.7115 => 0.7566, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7433 => 0.7902, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3423 => 0.3638, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.27% (4.2646 => 4.5320, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 6.18% (0.7326 => 0.7779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2758 => 0.2928, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.5860 => 0.6220, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.05% (0.5105 => 0.5414, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.02% (1.5415 => 1.6343, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.3092 => 0.3277, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 5.96% (5.7591 => 6.1026, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.95% (0.6675 => 0.7072, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.94% (5.0018 => 5.2987, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5569 => 0.5899, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.92% (4.9449 => 5.2375, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.8067 => 0.8544, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (1.3050 => 1.3814, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 5.85% (3.3354 => 3.5306, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9765 => 1.0291, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 5.35% (0.3180 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.10% (1.1861 => 1.2466, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.08% (0.3817 => 0.4011, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.05% (1.1642 => 1.2230, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 4.91% (1.5603 => 1.6369, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 4.88% (3.8723 => 4.0611, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5020 => 0.5259, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.64% (1.0722 => 1.1220, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (7.9617 => 8.3239, std. dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6450 => 0.6738, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.37% (2.0273 => 2.1159, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4636 => 0.4836, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.30% (21.9371 => 22.8803, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.24% (0.4103 => 0.4277, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6456 => 0.6727, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3422 => 0.3565, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5981 => 0.6228, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.00% (2.2969 => 2.3888, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.79% (1.4186 => 1.4724, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3650 => 0.3787, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (14.3668 => 14.9009, std. dev.: 0.0155) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.4203 => 0.4353, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.53% (0.3684 => 0.3814, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (2.0665 => 2.1384, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.44% (0.4620 => 0.4779, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3603 => 0.3726, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (1.5859 => 1.6396, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.23% (0.3283 => 0.3389, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.20% (2.2024 => 2.2729, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.1840 => 1.2180, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.8101 => 0.8277, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.42% (2.6778 => 2.9569, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (4.2280 => 4.3627, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2172, std. dev.: 0.0151) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7611, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.92% (5.2763 => 3.2226, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.17% (5.3855 => 3.8682, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.75% (5.3526 => 3.8673, std. dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1688, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.91% (2.9384 => 2.5883, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.69% (22.1758 => 19.8057, std. dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2676, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.15% (1.6805 => 1.5771, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1497, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5063, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4285, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9849, std. dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.05% (1.2373 => 1.2119, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5534, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.87% (2.5528 => 2.5050, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0055, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 20:09:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 22:09:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912030927.29F9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3696?compare_to=3694&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3696, Order: 163674, Start Time: 2012-09-12 02:00:07, End Time: 2012-09-12 03:10:43 To: 3694, Order: 163666, Start Time: 2012-09-12 00:33:44, End Time: 2012-09-12 01:44:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (51 on baseline) Performance Improvements: 10 (37 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 872 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.87% (8.6769 => 9.2734, std. dev.: 0.1182) MultiSource/Applications/hbd/hbd: 1.00% (1.3167 => 1.3299, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.44% (1.2936 => 1.3769, std. dev.: 0.0310) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.01% (1.7740 => 1.8452, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.54% (0.7754 => 0.7951, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (4.4809 => 4.5797, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.89% (1.6518 => 1.6830, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.47% (2.8239 => 2.8654, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.47% (3.6158 => 3.6689, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: 1.26% (8.7440 => 8.8546, std. dev.: 0.0235) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.49% (0.3097 => 0.2989, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.10% (0.6101 => 0.5973, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.89% (8.4421 => 8.2826, std. dev.: 0.0394) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (1.4408 => 1.4144, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.61% (0.6835 => 0.6725, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.55% (1.2114 => 1.1926, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.47% (4.3065 => 4.2430, std. dev.: 0.0177) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.44% (4.3620 => 4.2994, std. dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.19% (4.1077 => 4.0588, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.88% (61.0641 => 59.3044, std. dev.: 0.2493) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.91% (0.6410 => 0.6725, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.19% (0.3582 => 0.3732, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.86% (1.0046 => 1.0434, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 3.48% (2.1763 => 2.2520, std. dev.: 0.0114) MultiSource/Applications/minisat/minisat: 2.92% (0.6173 => 0.6353, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5150 => 1.5539, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.7639 => 0.7793, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.5309 => 0.5410, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.84% (3.0225 => 3.0782, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 1.71% (2.0972 => 2.1331, std. dev.: 0.0139) MultiSource/Applications/Burg/burg: 1.26% (1.1440 => 1.1584, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 1.24% (13.3238 => 13.4896, std. dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (1.3935 => 1.4098, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.06% (8.2186 => 8.3061, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.50% (1.6538 => 2.3401, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.72% (0.0766 => 0.0940, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.33% (3.4629 => 4.2362, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0285) SingleSource/Benchmarks/McGill/misr: 13.83% (0.4296 => 0.4890, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.75% (4.0101 => 4.5615, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 12.80% (3.4406 => 3.8810, std. dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 11.93% (0.1433 => 0.1604, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.92% (7.0025 => 7.6270, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.77% (0.2857 => 0.3079, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.03% (1.0063 => 1.0770, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 6.06% (3.4876 => 3.6988, std. dev.: 0.0357) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7917, std. dev.: 0.0373) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.49% (0.7609 => 0.7951, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 4.03% (8.5113 => 8.8546, std. dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.82% (0.8498 => 0.8823, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: 3.74% (15.2242 => 15.7937, std. dev.: 0.0766) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: 3.28% (1.4184 => 1.4649, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.96% (2.6656 => 2.7444, std. dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/five11/five11: 2.61% (5.1938 => 5.3295, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/bisort/bisort: 2.14% (0.6459 => 0.6597, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.67% (4.6127 => 4.6899, std. dev.: 0.0148) MultiSource/Applications/siod/siod: 1.67% (3.5520 => 3.6113, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (4.5056 => 4.5797, std. dev.: 0.0232) MultiSource/Applications/lua/lua: 1.55% (29.5232 => 29.9817, std. dev.: 0.1372) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4455 => 2.4815, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.45% (4.0659 => 4.1247, std. dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 1.37% (14.4877 => 14.6862, std. dev.: 0.0436) MultiSource/Benchmarks/Olden/bh/bh: 1.33% (2.5166 => 2.5500, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout/hash: 1.15% (4.3016 => 4.3512, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.50% (0.7738 => 0.7622, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.68% (5.2665 => 4.1247, std. dev.: 0.0782) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.91% (1.1647 => 0.9911, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1637, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.97% (3.2007 => 2.9456, std. dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3674, std. dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: -6.70% (3.4230 => 3.1937, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3507, std. dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/fibo: -4.99% (4.6355 => 4.4044, std. dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7627, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.43% (2.4457 => 2.3374, std. dev.: 0.0327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.21% (0.4564 => 0.4372, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (9.2503 => 8.9364, std. dev.: 0.0177) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -3.19% (62.4126 => 60.4226, std. dev.: 0.4666) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.06% (1.7361 => 1.6830, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.06% (61.1734 => 59.3044, std. dev.: 0.2493) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.87% (1.2959 => 1.2587, std. dev.: 0.0132) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3352, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.68% (1.1683 => 1.1370, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -2.46% (9.5474 => 9.3127, std. dev.: 0.0308) MultiSource/Applications/SPASS/SPASS: -2.44% (8.5323 => 8.3242, std. dev.: 0.0701) MultiSource/Benchmarks/PAQ8p/paq8p: -2.39% (92.7467 => 90.5308, std. dev.: 0.3950) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.15% (3.7496 => 3.6689, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2268, std. dev.: 0.0196) MultiSource/Benchmarks/Olden/tsp/tsp: -1.67% (1.7330 => 1.7041, std. dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.53% (1.8739 => 1.8452, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7657, std. dev.: 0.0148) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0926 => 1.0772, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3155, std. dev.: 0.0100) MultiSource/Benchmarks/sim/sim: -1.30% (3.8907 => 3.8402, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/lists: -1.07% (16.5617 => 16.3839, std. dev.: 0.0489) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.07% (2.8964 => 2.8654, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 20:19:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 22:19:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912031905.459652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3697?compare_to=3693&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3697, Order: 163674, Start Time: 2012-09-12 02:05:59, End Time: 2012-09-12 03:20:21 To: 3693, Order: 163665, Start Time: 2012-09-12 00:23:15, End Time: 2012-09-12 01:37:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.45% (0.6904 => 0.7004, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.89% (2.2637 => 2.3743, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.06% (2.0176 => 2.4223, std. dev.: 0.0150) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.19% (0.5818 => 0.6469, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.01% (0.5748 => 0.6381, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.73% (0.3578 => 0.3962, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.71% (0.7710 => 0.8536, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.65% (0.7061 => 0.7813, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.45% (0.3646 => 0.4027, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3650 => 0.4030, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.40% (0.3663 => 0.4044, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3623 => 0.3999, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.35% (0.3789 => 0.4181, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.25% (0.3914 => 0.4315, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.22% (3.9660 => 4.3712, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 10.14% (0.4003 => 0.4409, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/property: 10.05% (0.3940 => 0.4336, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.55% (0.5265 => 0.5768, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.55% (1.3693 => 1.5000, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.22% (0.9199 => 1.0047, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.15% (0.6959 => 0.7596, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.09% (1.2193 => 1.3301, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.2721 => 0.2967, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.98% (0.7038 => 0.7670, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.91% (1.4563 => 1.5860, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.59% (1.1364 => 1.2340, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.46% (0.2127 => 0.2307, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.43% (13.8202 => 14.9854, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.18% (0.5577 => 0.6033, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 8.13% (0.7506 => 0.8116, std. dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.08% (0.3899 => 0.4214, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (7.2180 => 7.7982, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.95% (0.4379 => 0.4727, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 7.82% (1.1061 => 1.1926, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.75% (0.3485 => 0.3755, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 7.69% (0.2925 => 0.3150, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.67% (0.2243 => 0.2415, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.65% (0.3580 => 0.3854, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.64% (1.0313 => 1.1101, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.57% (0.5637 => 0.6064, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.4791 => 0.5153, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.3756 => 0.4039, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.46% (1.9828 => 2.1308, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (0.1657 => 0.1780, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.37% (3.6692 => 3.9396, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 7.36% (0.3220 => 0.3457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.4390 => 0.4712, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.22% (3.8646 => 4.1437, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.11% (0.8310 => 0.8901, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.94% (0.7460 => 0.7978, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3868 => 0.4134, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.80% (1.3245 => 1.4145, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.74% (0.3192 => 0.3407, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.72% (1.9270 => 2.0565, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 6.72% (2.1791 => 2.3255, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 6.71% (0.3534 => 0.3771, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.65% (3.1889 => 3.4011, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.51% (0.6576 => 0.7004, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.39% (1.3819 => 1.4702, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.38% (0.6744 => 0.7174, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.30% (1.3813 => 1.4683, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.2140 => 0.2274, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 6.23% (0.2859 => 0.3037, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.0594 => 1.1253, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.16% (4.4433 => 4.7172, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6135 => 0.6511, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 6.13% (0.4113 => 0.4365, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.10% (4.3801 => 4.6475, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.93% (14.8535 => 15.7337, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (8.4961 => 8.9984, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.90% (1.1333 => 1.2002, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (0.8698 => 0.9211, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (1.2749 => 1.3499, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.79% (16.6129 => 17.5741, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (13.2842 => 14.0498, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.63% (0.2504 => 0.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.59% (0.3131 => 0.3306, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.56% (14.5298 => 15.3381, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.43% (0.2321 => 0.2447, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.40% (0.8818 => 0.9294, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (6.5754 => 6.9285, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.3245 => 0.3418, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.83% (1.2292 => 1.2886, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.82% (4.6629 => 4.8875, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.73% (3.2742 => 3.4291, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4805 => 0.5021, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.23% (4.9865 => 5.1973, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 4.22% (3.7467 => 3.9047, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.19% (1.5188 => 1.5825, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.00% (0.9108 => 0.9472, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6250 => 0.6498, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.93% (2.1007 => 2.1833, std. dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2785 => 6.5108, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.13% (0.3511 => 0.3621, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.96% (33.2944 => 34.2796, std. dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5007, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 30.64% (1.8175 => 2.3743, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5192, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.72% (1.1560 => 1.2568, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4134, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.97% (1.2998 => 1.3774, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5487, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0738, std. dev.: 0.0550) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (0.5184 => 0.5331, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6088, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5920, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.31% (0.4657 => 0.4037, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7480, std. dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2834, std. dev.: 0.0399) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.91% (1.3780 => 1.2965, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9221, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2470, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.60% (4.5928 => 4.5195, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2250, std. dev.: 0.0287) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8711, std. dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2441, std. dev.: 0.0186) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4339, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.03% (1.0310 => 1.0204, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2621, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 20:29:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Sep 2012 22:29:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912032940.2F12C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3698?compare_to=3692&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3698, Order: 163666, Start Time: 2012-09-12 00:47:10, End Time: 2012-09-12 03:30:57 To: 3692, Order: 163648, Start Time: 2012-09-11 21:35:06, End Time: 2012-09-12 00:19:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 3 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (779 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.21% (1.0171 => 1.0048, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -1.10% (1.0471 => 1.0356, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (11.8281 => 11.7051, std. dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.79% (0.3442 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.75% (0.3465 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.65% (0.3496 => 0.4008, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.14% (0.3650 => 0.4166, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.99% (0.3724 => 0.4245, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.65% (0.5826 => 0.6330, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5889 => 0.6389, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.1620 => 0.1751, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.24% (0.5026 => 0.5390, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.79% (0.7171 => 0.7658, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.75% (3.5627 => 3.8032, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 6.73% (1.5932 => 1.7005, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.69% (0.4994 => 0.5328, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (1.6211 => 1.7294, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (0.4361 => 0.4634, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.23% (1.3152 => 1.3972, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.5900 => 0.6259, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.06% (0.4029 => 0.4273, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.98% (0.5000 => 0.5299, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.85% (0.3930 => 0.4160, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.62% (4.2109 => 4.4475, std. dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (2.7292 => 2.8818, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.26% (0.2566 => 0.2701, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.19% (1.0781 => 1.1341, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.12% (0.2736 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.11% (0.2738 => 0.2878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.02% (0.2866 => 0.3010, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.93% (1.9694 => 2.0664, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2875 => 0.3012, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.75% (1.9966 => 2.0914, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.68% (2.1013 => 2.1996, std. dev.: 0.0063) SingleSource/Regression/C++/ofstream_ctor: 4.66% (0.3004 => 0.3144, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2714 => 0.2837, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.52% (5.5417 => 5.7920, std. dev.: 0.0116) MultiSource/Applications/hexxagon/hexxagon: 4.51% (0.9909 => 1.0356, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (2.0673 => 2.1599, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (0.4658 => 0.4864, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.40% (0.2729 => 0.2849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.36% (0.2750 => 0.2870, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.3903 => 0.4072, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.32% (0.2823 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2780 => 0.2900, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.30% (0.2813 => 0.2934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.29% (0.2911 => 0.3036, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.25% (0.3625 => 0.3779, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.25% (0.4146 => 0.4322, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (1.8794 => 1.9583, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3267 => 0.3402, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (4.4195 => 4.6018, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3362 => 0.3498, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (2.1653 => 2.2521, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.97% (4.6177 => 4.8009, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3317 => 0.3448, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.91% (0.3477 => 0.3613, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.86% (0.3678 => 0.3820, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.85% (0.3348 => 0.3477, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.85% (23.5202 => 24.4249, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 3.80% (1.4269 => 1.4811, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.77% (0.7875 => 0.8172, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.62% (0.9697 => 1.0048, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 3.60% (0.4251 => 0.4404, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3690 => 0.3820, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.48% (0.5546 => 0.5739, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 3.45% (0.6634 => 0.6863, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.3845 => 0.3965, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.95% (0.5012 => 0.5160, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.6435 => 0.6606, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.03% (2.0346 => 2.0759, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std. dev.: 0.1463) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1891, std. dev.: 0.0101) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5017, std. dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4488, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2822, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std. dev.: 0.0237) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4711, std. dev.: 0.0526) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5857, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: -9.99% (0.2402 => 0.2162, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9737, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8044, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7883, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std. dev.: 0.0048) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -1.90% (17.2379 => 16.9107, std. dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5765, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9649, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: -1.40% (5.5810 => 5.5030, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 23:30:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 01:30:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912063049.492212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3699?compare_to=3696&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3699, Order: 163678, Start Time: 2012-09-12 05:21:17, End Time: 2012-09-12 06:32:07 To: 3696, Order: 163674, Start Time: 2012-09-12 02:00:07, End Time: 2012-09-12 03:10:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (52 on baseline) Performance Improvements: 1 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.15% (0.9377 => 0.9485, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.06% (1.5539 => 1.5703, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.85% (3.0862 => 3.3903, std. dev.: 0.0613) SingleSource/Benchmarks/Shootout/heapsort: 7.24% (3.0805 => 3.3035, std. dev.: 0.0393) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.18% (3.0298 => 3.2473, std. dev.: 0.0570) MultiSource/Benchmarks/Olden/bisort/bisort: 2.14% (0.6597 => 0.6738, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.13% (2.4182 => 2.4696, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.49% (4.3526 => 4.4176, std. dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/ary3: 1.31% (1.7427 => 1.7655, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -14.81% (23.5931 => 20.0987, std. dev.: 1.1737) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.08% (0.6410 => 0.6800, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.49% (0.3582 => 0.3743, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 4.30% (2.1763 => 2.2698, std. dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (1.1653 => 1.2107, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 3.85% (1.0046 => 1.0433, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.65% (1.5150 => 1.5703, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.13% (0.7639 => 0.7878, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: 2.96% (0.6173 => 0.6356, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.5309 => 0.5427, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.94% (3.0225 => 3.0810, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (12.6413 => 12.8798, std. dev.: 0.0562) MultiSource/Applications/siod/siod: 1.68% (2.0972 => 2.1325, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (8.2186 => 8.3473, std. dev.: 0.0462) MultiSource/Applications/SPASS/SPASS: 1.44% (13.3238 => 13.5156, std. dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.34% (1.2021 => 1.2182, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (4.0318 => 4.0780, std. dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 1.07% (4.7455 => 4.7965, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3394, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.39% (3.4629 => 4.2383, std. dev.: 0.0230) SingleSource/Benchmarks/McGill/misr: 13.43% (0.4296 => 0.4873, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.41% (4.0101 => 4.5477, std. dev.: 0.0172) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 12.84% (3.4406 => 3.8823, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.10% (0.2694 => 0.2966, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 9.19% (7.0025 => 7.6461, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 8.20% (1.0194 => 1.1030, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.33% (3.0256 => 3.2473, std. dev.: 0.0570) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (3.4876 => 3.7051, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3301 => 0.3505, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (27.1724 => 28.8438, std. dev.: 0.0633) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.63% (1.0063 => 1.0630, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.86% (4.2129 => 4.4176, std. dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.77% (40.4792 => 42.4100, std. dev.: 0.6127) SingleSource/Benchmarks/Misc/dt: 4.48% (0.9851 => 1.0292, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 4.32% (0.6459 => 0.6738, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8562, std. dev.: 0.0391) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5383, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0199) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.05% (0.5876 => 0.6055, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5113 => 8.7629, std. dev.: 0.0378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.81% (0.5587 => 0.5744, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.72% (2.4042 => 2.4696, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 2.70% (5.1938 => 5.3342, std. dev.: 0.0259) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.28% (2.6656 => 2.7263, std. dev.: 0.0153) MultiSource/Benchmarks/Olden/bh/bh: 1.45% (2.5166 => 2.5531, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4455 => 2.4805, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 1.42% (3.5520 => 3.6023, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6728, std. dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/ary3: 1.04% (1.7473 => 1.7655, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.81% (0.3497 => 0.2070, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.04% (5.2665 => 4.1582, std. dev.: 0.0679) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.95% (1.1647 => 0.9906, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1640, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.14% (3.2007 => 2.9403, std. dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3742, std. dev.: 0.0349) MultiSource/Applications/SIBsim4/SIBsim4: -6.84% (3.4230 => 3.1890, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.89% (3.6023 => 3.3903, std. dev.: 0.0613) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4105, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9422, std. dev.: 0.0429) MultiSource/Benchmarks/mafft/pairlocalalign: -3.24% (62.4126 => 60.3908, std. dev.: 0.3211) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std. dev.: 0.0148) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3365, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.66% (2.4457 => 2.3806, std. dev.: 0.0235) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1381, std. dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.52% (45.4683 => 44.3240, std. dev.: 0.2344) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (92.7467 => 90.4262, std. dev.: 0.4255) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.89% (3.7496 => 3.6788, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2284, std. dev.: 0.0158) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.57% (1.0686 => 1.0518, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3344, std. dev.: 0.0349) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6644, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/oourafft: -1.11% (3.8200 => 3.7776, std. dev.: 0.0076) MultiSource/Benchmarks/sim/sim: -1.08% (3.8907 => 3.8485, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: -1.02% (1.7330 => 1.7153, std. dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 23:41:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 01:41:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912064139.346DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3700?compare_to=3698&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3700, Order: 163674, Start Time: 2012-09-12 03:59:12, End Time: 2012-09-12 06:42:56 To: 3698, Order: 163666, Start Time: 2012-09-12 00:47:10, End Time: 2012-09-12 03:30:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (124 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.12% (5.7920 => 5.8566, std. dev.: 0.0068) MultiSource/Applications/lua/lua: 1.04% (1.4811 => 1.4965, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.13% (2.0403 => 2.1042, std. dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 15.01% (0.3465 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.94% (0.3446 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.90% (0.3442 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 14.82% (0.3496 => 0.4014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.80% (0.3460 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.22% (0.3643 => 0.4161, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.91% (0.3724 => 0.4242, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.51% (0.5826 => 0.6380, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.39% (0.5889 => 0.6442, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.1620 => 0.1758, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.71% (1.5932 => 1.7160, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (3.5627 => 3.8359, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7171 => 0.7716, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.51% (1.6211 => 1.7429, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.45% (0.4361 => 0.4686, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.00% (1.3152 => 1.4073, std. dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (0.4994 => 0.5332, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.46% (0.3930 => 0.4184, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.36% (1.0781 => 1.1467, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 6.30% (4.2109 => 4.4762, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (0.5000 => 0.5312, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.24% (0.5900 => 0.6268, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.16% (0.4029 => 0.4277, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.3004 => 0.3182, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.83% (0.2866 => 0.3033, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (2.7292 => 2.8862, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 5.68% (5.5417 => 5.8566, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.2736 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2875 => 0.3032, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3195 => 0.3369, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.44% (0.2792 => 0.2944, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.43% (0.3792 => 0.3998, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.28% (0.2729 => 0.2873, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.20% (0.2714 => 0.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.19% (0.2813 => 0.2959, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.14% (0.3890 => 0.4090, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.08% (2.1013 => 2.2081, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 5.05% (0.2750 => 0.2889, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.05% (0.9909 => 1.0409, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (0.4658 => 0.4893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2738 => 0.2876, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.03% (0.2566 => 0.2695, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.00% (1.9694 => 2.0678, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (0.3625 => 0.3806, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 4.96% (0.2803 => 0.2942, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.94% (2.0673 => 2.1694, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.93% (0.2780 => 0.2917, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 4.88% (1.4269 => 1.4965, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (1.9966 => 2.0938, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2911 => 0.3052, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (0.3903 => 0.4092, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3678 => 0.3855, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.79% (0.2691 => 0.2820, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3317 => 0.3476, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3060 => 0.3206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.3362 => 0.3521, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3258 => 0.3412, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (1.8794 => 1.9680, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.71% (0.3124 => 0.3271, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.63% (0.3348 => 0.3503, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.63% (4.6177 => 4.8313, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (2.1653 => 2.2644, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists1: 4.57% (0.3477 => 0.3636, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.56% (0.3726 => 0.3896, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.54% (0.6634 => 0.6935, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 4.47% (23.5202 => 24.5704, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (4.4195 => 4.6163, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.40% (0.3271 => 0.3415, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.4139 => 0.4320, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.36% (0.5546 => 0.5788, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.28% (0.3690 => 0.3848, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.18% (0.7875 => 0.8204, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.17% (0.3981 => 0.4147, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.16% (0.4251 => 0.4428, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.2969 => 0.3090, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.05% (0.4146 => 0.4314, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.96% (0.3084 => 0.3206, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.87% (0.9697 => 1.0072, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.3845 => 0.3991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.5012 => 0.5198, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.51% (0.3336 => 0.3453, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.6435 => 0.6653, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.70% (2.0346 => 2.0896, std. dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: 2.54% (0.4847 => 0.4970, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (0.5361 => 0.5478, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (0.7426 => 0.7573, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.34% (11.6398 => 11.7958, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (4.6926 => 4.7452, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6738, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std. dev.: 0.1367) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6459, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2013, std. dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5044, std. dev.: 0.0273) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std. dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4483, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5783, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4455, std. dev.: 0.0325) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5657, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7990, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8027, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0028) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.42% (17.2379 => 16.8202, std. dev.: 0.0291) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9645, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 23:46:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 01:46:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912064627.E57992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3701?compare_to=3697&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3701, Order: 163678, Start Time: 2012-09-12 05:33:31, End Time: 2012-09-12 06:47:44 To: 3697, Order: 163674, Start Time: 2012-09-12 02:05:59, End Time: 2012-09-12 03:20:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.4968 => 56.2361, std. dev.: 0.2272) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.12% (1.4850 => 1.5017, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.76% (80.5546 => 79.1353, std. dev.: 0.4890) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.43% (2.0176 => 2.4096, std. dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.82% (0.3578 => 0.3965, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3646 => 0.4031, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.51% (0.7710 => 0.8520, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3663 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.43% (0.3623 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3789 => 0.4183, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.38% (0.3650 => 0.4029, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3914 => 0.4318, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.13% (0.7061 => 0.7776, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 10.08% (0.3940 => 0.4337, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.02% (0.4003 => 0.4404, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.00% (3.9660 => 4.3625, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std. dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.79% (0.1072 => 0.1177, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.36% (1.3693 => 1.4974, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 9.05% (0.7038 => 0.7675, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.91% (1.2193 => 1.3280, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.88% (0.9199 => 1.0016, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.75% (0.6959 => 0.7568, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.50% (1.4563 => 1.5801, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.35% (1.1364 => 1.2313, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 8.18% (13.8202 => 14.9506, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.87% (7.2180 => 7.7864, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.86% (0.4379 => 0.4723, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.3899 => 0.4205, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.71% (0.4062 => 0.4375, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std. dev.: 0.0041) MultiSource/Applications/lemon/lemon: 7.40% (1.0313 => 1.1076, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.39% (0.3489 => 0.3747, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.4791 => 0.5145, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.38% (0.3293 => 0.3536, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.37% (0.3756 => 0.4033, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.36% (1.9828 => 2.1287, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.34% (0.5637 => 0.6051, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.27% (1.1061 => 1.1865, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.3220 => 0.3454, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.18% (3.6692 => 3.9328, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1392, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.97% (0.4016 => 0.4296, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.96% (0.7460 => 0.7979, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8310 => 0.8874, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.75% (0.3868 => 0.4129, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.64% (0.3192 => 0.3404, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.53% (1.9270 => 2.0529, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.53% (1.3245 => 1.4110, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.48% (3.1889 => 3.3954, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 6.43% (2.1791 => 2.3192, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 6.37% (0.4113 => 0.4375, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.23% (1.3813 => 1.4673, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (1.3819 => 1.4679, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 6.21% (0.6744 => 0.7163, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.01% (4.4433 => 4.7102, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.97% (1.0594 => 1.1226, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.96% (4.3801 => 4.6412, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.2945 => 0.3120, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.85% (0.6135 => 0.6494, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 5.80% (1.2749 => 1.3488, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.73% (0.8698 => 0.9196, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 5.69% (14.8535 => 15.6980, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.63% (1.1333 => 1.1971, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.61% (16.6129 => 17.5456, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 5.59% (8.4961 => 8.9713, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.42% (0.8818 => 0.9296, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.41% (13.2842 => 14.0024, std. dev.: 0.0153) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.34% (14.5298 => 15.3052, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.3245 => 0.3411, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9030, std. dev.: 0.0231) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8884, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 4.69% (1.2292 => 1.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (3.2742 => 3.4185, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6250 => 0.6495, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.91% (4.9865 => 5.1815, std. dev.: 0.0135) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8905, std. dev.: 0.0185) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.83% (0.9108 => 0.9457, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.82% (1.5188 => 1.5768, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (6.2785 => 6.5003, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (2.1007 => 2.1736, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 2.62% (33.2944 => 34.1660, std. dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.29% (16.2614 => 16.4709, std. dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.37% (5.7573 => 7.5058, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/fbench: 25.34% (1.8175 => 2.2781, std. dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.70% (3.1736 => 3.4180, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3793, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7337, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0744, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.99% (0.5184 => 0.5339, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6012, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0071) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1835, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5976, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.16% (0.4657 => 0.4044, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.87% (22.5627 => 21.6898, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.30% (20.3410 => 18.2451, std. dev.: 0.0326) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0089) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1508, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9257, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2405, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5220, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2445, std. dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4327, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 11 23:52:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 01:52:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912065217.184A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3702?compare_to=3695&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3702, Order: 163678, Start Time: 2012-09-12 05:33:51, End Time: 2012-09-12 06:53:33 To: 3695, Order: 163666, Start Time: 2012-09-12 00:38:38, End Time: 2012-09-12 01:58:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (134 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.34% (0.7779 => 0.7883, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.91% (10.3673 => 15.1273, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: 25.71% (0.1622 => 0.2039, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.20% (0.3473 => 0.3966, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.06% (2.2022 => 2.5118, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3497 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.86% (0.3543 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.83% (0.3543 => 0.4033, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3516 => 0.4002, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 13.79% (0.3561 => 0.4052, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.35% (0.3694 => 0.4187, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.31% (7.0540 => 7.9929, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3828 => 0.4327, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3927 => 0.4432, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.76% (0.3886 => 0.4382, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.05% (1.7609 => 1.9379, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.8172 => 0.8895, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7326 => 0.7883, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.37% (0.4615 => 0.4955, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.09% (10.4361 => 11.1765, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.93% (9.4845 => 10.1421, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (8.1363 => 8.6830, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.64% (0.7835 => 0.8355, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (4.2646 => 4.5354, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3423 => 0.3638, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5860 => 0.6218, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.10% (0.7115 => 0.7549, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.08% (1.5415 => 1.6353, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.08% (0.7433 => 0.7885, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.95% (0.3817 => 0.4044, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.90% (0.8067 => 0.8543, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5569 => 0.5896, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.87% (4.9449 => 5.2351, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.86% (5.0018 => 5.2947, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.83% (5.7591 => 6.0948, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.3050 => 1.3801, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.75% (0.6675 => 0.7059, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.73% (3.3354 => 3.5264, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.70% (0.5105 => 0.5396, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (0.9765 => 1.0281, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 5.28% (0.3180 => 0.3348, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2242, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1861 => 1.2454, std. dev.: 0.0092) MultiSource/Benchmarks/sim/sim: 4.87% (0.3387 => 0.3552, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.77% (1.5603 => 1.6347, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 4.72% (21.9371 => 22.9720, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.65% (3.8723 => 4.0522, std. dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (7.9617 => 8.3287, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.40% (0.6450 => 0.6734, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.5020 => 0.5241, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 4.38% (1.0722 => 1.1192, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 4.37% (2.0273 => 2.1159, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.30% (0.5981 => 0.6238, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.4064 => 0.4235, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6456 => 0.6723, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2905 => 0.3024, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (1.4186 => 1.4752, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.89% (0.3650 => 0.3792, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.88% (2.2969 => 2.3860, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 3.88% (0.8921 => 0.9267, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (14.3668 => 14.9146, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3865 => 0.4010, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.66% (0.3826 => 0.3966, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2871 => 0.2974, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.3136 => 0.3248, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0665 => 2.1401, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.4048 => 0.4191, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.50% (0.3603 => 0.3729, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3684 => 0.3810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.37% (0.3052 => 0.3155, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.31% (1.5859 => 1.6384, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: 3.29% (0.3283 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.2024 => 2.2652, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2177, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.8101 => 0.8290, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.2842 => 1.3113, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.53% (4.2280 => 4.3774, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7484, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2299, std. dev.: 0.0164) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5777, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7606, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.83% (5.2763 => 3.2277, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.25% (5.3855 => 3.8641, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.87% (5.3526 => 3.8610, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1255, std. dev.: 0.0238) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.79% (2.9384 => 2.5920, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -10.66% (22.1758 => 19.8111, std. dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.58% (1.6925 => 1.4119, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: -10.54% (1.5373 => 1.3753, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2846, std. dev.: 0.1076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7172, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5024, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.05% (3.2827 => 3.1496, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5045, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4150, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -2.88% (10.2830 => 9.9864, std. dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.94% (4.6441 => 4.5542, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0190, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2331, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 00:58:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 02:58:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912075828.EEA4B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3703?compare_to=3699&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3703, Order: 163683, Start Time: 2012-09-12 06:48:17, End Time: 2012-09-12 07:59:47 To: 3699, Order: 163678, Start Time: 2012-09-12 05:21:17, End Time: 2012-09-12 06:32:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (45 on baseline) Performance Improvements: 3 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (810 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.34% (8.9378 => 9.5046, std. dev.: 0.1438) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.55% (0.7131 => 0.7313, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7692 => 0.7847, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (12.8798 => 13.0981, std. dev.: 0.0083) MultiSource/Applications/Burg/burg: 1.60% (1.1510 => 1.1694, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.23% (0.7567 => 0.7963, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.38% (21.7845 => 22.3025, std. dev.: 0.1080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.23% (1.6555 => 1.6759, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.76% (0.6738 => 0.6552, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: -1.83% (1.7655 => 1.7332, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.29% (2.3266 => 2.2965, std. dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.19% (0.6410 => 0.6807, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: 5.63% (8.9977 => 9.5046, std. dev.: 0.1438) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3582 => 0.3723, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (12.6413 => 13.0981, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.5150 => 1.5659, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 3.22% (1.0046 => 1.0369, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 2.22% (1.1440 => 1.1694, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.82% (0.5937 => 0.6045, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 1.20% (0.8405 => 0.8506, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (6.2546 => 6.3286, std. dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std. dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (4.0101 => 4.5521, std. dev.: 0.0127) SingleSource/Benchmarks/McGill/misr: 13.48% (0.4296 => 0.4875, std. dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.65% (0.3746 => 0.4145, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.20% (1.0063 => 1.0989, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout/lists: 8.86% (7.0025 => 7.6226, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: 8.01% (3.4406 => 3.7162, std. dev.: 0.0776) SingleSource/Benchmarks/McGill/chomp: 7.98% (1.0194 => 1.1007, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.77% (0.2857 => 0.3079, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (3.4876 => 3.7027, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7987, std. dev.: 0.0472) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.65% (0.7609 => 0.7963, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.42% (4.2129 => 4.3989, std. dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.37% (40.4792 => 42.2484, std. dev.: 0.3880) SingleSource/Benchmarks/Misc/fp-convert: 4.34% (15.2242 => 15.8855, std. dev.: 0.0270) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.88% (0.8498 => 0.8828, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/ReedSolomon: 3.75% (8.5113 => 8.8306, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 3.20% (5.1938 => 5.3600, std. dev.: 0.0413) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.00% (2.6656 => 2.7457, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 1.78% (3.5520 => 3.6152, std. dev.: 0.0202) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (2.4455 => 2.4867, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 1.53% (29.5232 => 29.9755, std. dev.: 0.0648) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5352, std. dev.: 0.0116) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6693, std. dev.: 0.0592) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.5166 => 2.5451, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.01% (4.0659 => 4.1068, std. dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.28% (5.2665 => 4.0929, std. dev.: 0.0792) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.45% (1.1647 => 0.9964, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9437, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3733, std. dev.: 0.0305) MultiSource/Benchmarks/FreeBench/distray/distray: -6.72% (0.2664 => 0.2485, std. dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: -6.60% (3.4230 => 3.1970, std. dev.: 0.0292) SingleSource/Benchmarks/Misc/richards_benchmark: -6.54% (1.4441 => 1.3496, std. dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.18% (1.4021 => 1.3295, std. dev.: 0.0131) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.05% (0.4140 => 0.3931, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4061, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.55% (3.9413 => 3.7619, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -4.31% (1.8739 => 1.7932, std. dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.25% (0.4564 => 0.4370, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.66% (1.2959 => 1.2485, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.47% (1.7361 => 1.6759, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.40% (3.7496 => 3.6222, std. dev.: 0.0409) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.22% (1.2722 => 1.2312, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/methcall: -2.96% (9.2503 => 8.9768, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1353, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -2.73% (62.4126 => 60.7097, std. dev.: 0.2893) MultiSource/Applications/aha/aha: -2.68% (3.4286 => 3.3367, std. dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.61% (2.3580 => 2.2965, std. dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: -2.47% (92.7467 => 90.4547, std. dev.: 0.3928) MultiSource/Benchmarks/Olden/tsp/tsp: -1.93% (1.7330 => 1.6995, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2337, std. dev.: 0.0488) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -1.41% (3.8907 => 3.8359, std. dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3185, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.31% (16.5617 => 16.3443, std. dev.: 0.0475) MultiSource/Applications/JM/lencod/lencod: -1.14% (6.7458 => 6.6692, std. dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 01:33:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 03:33:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912083347.011072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3704?compare_to=3701&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3704, Order: 163683, Start Time: 2012-09-12 07:20:15, End Time: 2012-09-12 08:35:02 To: 3701, Order: 163678, Start Time: 2012-09-12 05:33:31, End Time: 2012-09-12 06:47:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.05% (1.2315 => 1.2186, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (2.0176 => 2.4141, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.50% (0.5818 => 0.6487, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/trivial-interface: 10.84% (0.3578 => 0.3966, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.45% (0.3646 => 0.4027, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3601 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.43% (0.3663 => 0.4045, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.43% (0.7710 => 0.8514, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3650 => 0.4028, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.24% (0.3789 => 0.4177, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3914 => 0.4313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.17% (0.7061 => 0.7779, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 10.09% (0.4003 => 0.4407, std. dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.02% (3.9660 => 4.3635, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/property: 10.00% (0.3940 => 0.4334, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.60% (1.3693 => 1.5007, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.33% (0.5265 => 0.5756, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7038 => 0.7683, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.94% (1.2193 => 1.3283, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.92% (0.9199 => 1.0020, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.67% (1.4563 => 1.5826, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.45% (1.1364 => 1.2324, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 8.43% (13.8202 => 14.9847, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.14% (0.5577 => 0.6031, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.92% (7.2180 => 7.7896, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.90% (0.4379 => 0.4725, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.6283 => 0.6774, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.78% (0.7506 => 0.8090, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.4791 => 0.5159, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 7.62% (1.0313 => 1.1099, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3756 => 0.4036, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.41% (1.1061 => 1.1881, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.40% (0.5637 => 0.6054, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.33% (3.6692 => 3.9380, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.29% (0.3293 => 0.3533, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.26% (1.9828 => 2.1267, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3580 => 0.3838, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.17% (0.3220 => 0.3451, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.17% (0.4016 => 0.4304, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 7.10% (3.8646 => 4.1388, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2761 => 0.2956, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.99% (0.8310 => 0.8891, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4390 => 0.4687, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.7460 => 0.7963, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.57% (1.9270 => 2.0537, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.57% (1.3245 => 1.4115, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 6.53% (2.1791 => 2.3215, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3971, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.48% (0.6576 => 0.7002, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.33% (1.3813 => 1.4688, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.33% (1.3819 => 1.4694, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 6.32% (0.4113 => 0.4373, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.21% (4.4433 => 4.7194, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 6.09% (1.0594 => 1.1239, std. dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: 6.07% (1.2749 => 1.3523, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.07% (4.3801 => 4.6459, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.2859 => 0.3032, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.94% (14.8535 => 15.7353, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.92% (0.8698 => 0.9213, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 5.87% (8.4961 => 8.9947, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.6135 => 0.6493, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.82% (16.6129 => 17.5795, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.65% (0.8818 => 0.9316, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (13.2842 => 14.0326, std. dev.: 0.0258) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.63% (1.1333 => 1.1971, std. dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 5.43% (0.3131 => 0.3301, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.39% (14.5298 => 15.3123, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.25% (6.5754 => 6.9206, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.77% (1.2292 => 1.2878, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 4.64% (4.6629 => 4.8792, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.61% (3.2742 => 3.4251, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.30% (4.9865 => 5.2010, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.18% (0.9108 => 0.9489, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.06% (1.5188 => 1.5805, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 4.03% (3.7467 => 3.8976, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.78% (2.1007 => 2.1801, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5064, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.17% (33.2944 => 34.3499, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.13% (0.3511 => 0.3621, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5332, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7332, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5468, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.97% (10.7476 => 11.0667, std. dev.: 0.0089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.5184 => 0.5332, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5957, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std. dev.: 0.0067) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.01% (7.9275 => 8.0073, std. dev.: 0.0214) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.36% (0.4657 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.53% (22.5627 => 21.7667, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2730, std. dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1512, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9208, std. dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5896, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5205, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2312, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2144, std. dev.: 0.0425) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.11% (6.6320 => 6.5586, std. dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 01:44:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 03:44:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912084457.94FC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3705?compare_to=3702&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3705, Order: 163683, Start Time: 2012-09-12 07:25:51, End Time: 2012-09-12 08:46:13 To: 3702, Order: 163678, Start Time: 2012-09-12 05:33:51, End Time: 2012-09-12 06:53:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (134 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (15.1273 => 15.2869, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.15% (3.7798 => 3.8611, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-6: 1.03% (1.4119 => 1.4264, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.45% (10.3673 => 15.2869, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 26.14% (0.1622 => 0.2046, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.24% (2.2022 => 2.5158, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.94% (7.0540 => 8.0375, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.83% (0.3543 => 0.4033, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.81% (0.3497 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.57% (0.3516 => 0.3993, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.49% (0.3543 => 0.4021, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 13.48% (0.3561 => 0.4041, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3828 => 0.4324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.71% (0.3927 => 0.4426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.98% (1.7609 => 1.9542, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/oourafft: 9.35% (0.3282 => 0.3589, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.31% (0.3177 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.81% (0.2700 => 0.2911, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.71% (0.4879 => 0.5255, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5925 => 0.6372, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 7.36% (0.6030 => 0.6474, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.33% (0.3180 => 0.3413, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.8172 => 0.8770, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/em3d/em3d: 7.32% (0.1695 => 0.1819, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 7.19% (0.3423 => 0.3669, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 7.13% (10.4361 => 11.1801, std. dev.: 0.0261) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 7.09% (9.4845 => 10.1574, std. dev.: 0.0227) MultiSource/Applications/spiff/spiff: 6.83% (0.7835 => 0.8370, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.76% (8.1363 => 8.6862, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.5860 => 0.6256, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.62% (1.5415 => 1.6436, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.45% (0.2107 => 0.2243, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.42% (4.2646 => 4.5384, std. dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 6.34% (0.3092 => 0.3288, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 6.33% (0.7326 => 0.7790, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7433 => 0.7902, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: 6.20% (0.7115 => 0.7556, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 6.18% (0.3109 => 0.3301, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.11% (0.5569 => 0.5909, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.06% (1.3050 => 1.3841, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (5.0018 => 5.3046, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 5.96% (3.3354 => 3.5342, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.6675 => 0.7069, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.87% (0.2758 => 0.2920, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.87% (4.9449 => 5.2352, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.8067 => 0.8539, std. dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 5.78% (5.7591 => 6.0920, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.74% (0.3817 => 0.4036, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.5105 => 0.5394, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (1.1861 => 1.2527, std. dev.: 0.0179) MultiSource/Benchmarks/McCat/05-eks/eks: 5.44% (0.4299 => 0.4533, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.40% (1.1642 => 1.2271, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9765 => 1.0288, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std. dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4636 => 0.4862, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.82% (1.5603 => 1.6355, std. dev.: 0.0096) MultiSource/Applications/lua/lua: 4.81% (3.8723 => 4.0585, std. dev.: 0.0224) MultiSource/Applications/treecc/treecc: 4.77% (2.0273 => 2.1241, std. dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (7.9617 => 8.3385, std. dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.72% (1.0722 => 1.1228, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3422 => 0.3581, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.62% (21.9371 => 22.9511, std. dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/hash: 4.55% (0.4289 => 0.4484, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.44% (0.5020 => 0.5243, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6456 => 0.6736, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.4103 => 0.4280, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8921 => 0.9291, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.4186 => 1.4773, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3826 => 0.3979, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.97% (14.3668 => 14.9366, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.2905 => 0.3017, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.84% (2.2969 => 2.3852, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.74% (0.4620 => 0.4793, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.69% (0.4203 => 0.4358, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.3684 => 0.3818, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0665 => 2.1414, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.61% (0.4048 => 0.4194, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 3.60% (0.3052 => 0.3162, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.58% (0.2793 => 0.2893, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.55% (0.3603 => 0.3731, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3935 => 0.4074, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.49% (1.5859 => 1.6413, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.42% (0.3162 => 0.3270, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.37% (0.3379 => 0.3493, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.18% (2.2024 => 2.2724, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1840 => 1.2200, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 2.37% (1.2842 => 1.3146, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.98% (1.1145 => 1.3706, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3826, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.63% (4.2280 => 4.3815, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7479, std. dev.: 0.0074) MultiSource/Benchmarks/llubenchmark/llu: 2.20% (3.7781 => 3.8611, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2229, std. dev.: 0.0146) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5745, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7610, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -79.84% (0.8651 => 0.1744, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.69% (5.2763 => 3.2348, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.84% (5.3855 => 3.8861, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.41% (5.3526 => 3.8855, std. dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2607, std. dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.00% (2.9384 => 2.5858, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8604, std. dev.: 0.0328) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2682, std. dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5766, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5716, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1495, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4105, std. dev.: 0.0238) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5063, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -2.89% (1.2373 => 1.2016, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0058, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9890, std. dev.: 0.0227) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5544, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2257, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8555, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 02:25:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 04:25:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912092504.2EBE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3706?compare_to=3703&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3706, Order: 163685, Start Time: 2012-09-12 08:15:29, End Time: 2012-09-12 09:26:21 To: 3703, Order: 163683, Start Time: 2012-09-12 06:48:17, End Time: 2012-09-12 07:59:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (56 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.03% (0.4445 => 0.4624, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.2987 => 0.3093, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.93% (1.4034 => 1.4305, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 30.04% (3.1342 => 4.0757, std. dev.: 0.1290) MultiSource/Benchmarks/FreeBench/distray/distray: 5.51% (0.2485 => 0.2622, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (3.7162 => 3.8783, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.88% (1.3295 => 1.3678, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.53% (1.7932 => 1.8385, std. dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.74% (2.3437 => 2.3844, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/whetstone: 1.45% (2.3667 => 2.4009, std. dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.09% (9.5046 => 8.9262, std. dev.: 0.2107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.86% (13.0981 => 12.8543, std. dev.: 0.0538) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.56% (0.1414 => 0.1535, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.18% (0.6410 => 0.6806, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.69% (0.3582 => 0.3750, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (1.1653 => 1.2138, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 3.89% (0.6173 => 0.6413, std. dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 3.76% (2.1763 => 2.2581, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3217 => 0.3332, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 3.39% (1.0046 => 1.0387, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.5150 => 1.5659, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 2.65% (1.1440 => 1.1743, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.7639 => 0.7809, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 2.07% (3.0225 => 3.0852, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 1.98% (4.7455 => 4.8393, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (1.3935 => 1.4196, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.68% (12.6413 => 12.8543, std. dev.: 0.0538) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.1827 => 1.2026, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.65% (0.6069 => 0.6169, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.55% (1.2021 => 1.2207, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.4113 => 1.4305, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 1.36% (0.8405 => 0.8519, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.28% (13.3238 => 13.4949, std. dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (1.4408 => 1.4556, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.39% (0.0263 => 0.0385, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/pi: 41.15% (1.6538 => 2.3344, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2271, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.01% (0.0766 => 0.0881, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 14.65% (1.7426 => 1.9979, std. dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5567, std. dev.: 0.0629) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: 13.31% (0.4296 => 0.4868, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.14% (3.6023 => 4.0757, std. dev.: 0.1290) MultiSource/Applications/sgefa/sgefa: 12.79% (0.3746 => 0.4225, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sieve: 12.72% (3.4406 => 3.8783, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6029, std. dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.16% (1.0063 => 1.0884, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.18% (0.2857 => 0.3062, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (3.4876 => 3.7054, std. dev.: 0.0115) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8037, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.18% (0.7609 => 0.8003, std. dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.33% (40.4792 => 42.2336, std. dev.: 0.2810) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 4.01% (15.2242 => 15.8352, std. dev.: 0.0468) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 3.82% (8.5113 => 8.8364, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.25% (0.3508 => 0.3622, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 2.37% (2.3453 => 2.4009, std. dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.34% (0.5587 => 0.5718, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.19% (2.6656 => 2.7240, std. dev.: 0.0103) MultiSource/Benchmarks/BitBench/five11/five11: 1.98% (5.1938 => 5.2964, std. dev.: 0.0257) MultiSource/Applications/siod/siod: 1.48% (3.5520 => 3.6044, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4455 => 2.4781, std. dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6672, std. dev.: 0.0086) MultiSource/Applications/lua/lua: 1.05% (29.5232 => 29.8346, std. dev.: 0.1093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.63% (0.3497 => 0.2111, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0776, std. dev.: 0.1147) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.94% (1.1647 => 0.9907, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std. dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9389, std. dev.: 0.0263) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3638, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -6.73% (1.4441 => 1.3469, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -6.64% (3.4230 => 3.1957, std. dev.: 0.0671) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -5.65% (3.2159 => 3.0343, std. dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4053, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7623, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.66% (1.7361 => 1.6726, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (9.2503 => 8.9384, std. dev.: 0.0411) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.13% (3.7496 => 3.6323, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2858, std. dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -2.73% (92.7467 => 90.2117, std. dev.: 0.3741) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3362, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.57% (1.2722 => 1.2395, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.57% (1.1683 => 1.1383, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.51% (2.4457 => 2.3844, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.45% (1.4021 => 1.3678, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: -2.29% (62.4126 => 60.9808, std. dev.: 0.1465) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.21% (1.0686 => 1.0450, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.87% (2.8964 => 2.8423, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2227, std. dev.: 0.0118) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.42% (61.1734 => 60.3021, std. dev.: 0.2149) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7657, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3061, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.3569 => 2.3240, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1116 => 1.1002, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 03:00:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 05:00:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912100059.986CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3707?compare_to=3700&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3707, Order: 163683, Start Time: 2012-09-12 07:17:11, End Time: 2012-09-12 10:01:07 To: 3700, Order: 163674, Start Time: 2012-09-12 03:59:12, End Time: 2012-09-12 06:42:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.34% (1.7160 => 1.6930, std. dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 14.73% (0.3442 => 0.3949, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.65% (0.3446 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.63% (0.3465 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.38% (0.3469 => 0.3968, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.89% (0.3650 => 0.4157, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.89% (0.3643 => 0.4149, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5826 => 0.6332, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1620 => 0.1757, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5889 => 0.6386, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (3.5627 => 3.8236, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.30% (1.6211 => 1.7394, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7171 => 0.7668, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.2014 => 0.2152, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.65% (1.3152 => 1.4026, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.60% (0.4361 => 0.4649, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.26% (1.5932 => 1.6930, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.5900 => 0.6266, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.18% (0.3930 => 0.4173, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.17% (0.4994 => 0.5302, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (0.5000 => 0.5301, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 5.81% (4.2109 => 4.4555, std. dev.: 0.0114) MultiSource/Applications/d/make_dparser: 5.61% (1.0781 => 1.1386, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2875 => 0.3033, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.48% (5.5417 => 5.8456, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8784, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2738 => 0.2887, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.38% (0.2566 => 0.2704, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 5.26% (0.3004 => 0.3162, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.2866 => 0.3016, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.10% (0.3195 => 0.3358, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.10% (0.2803 => 0.2946, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2725 => 0.2864, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.09% (0.2729 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.04% (0.3792 => 0.3983, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2823 => 0.2965, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.02% (2.1013 => 2.2067, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.01% (0.2792 => 0.2932, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (0.3890 => 0.4085, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.3096 => 0.3250, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.96% (0.2780 => 0.2918, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.91% (0.2750 => 0.2885, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.88% (0.9909 => 1.0393, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.87% (0.2811 => 0.2948, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (2.0673 => 2.1675, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.3903 => 0.4091, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.79% (1.9694 => 2.0637, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (0.4658 => 0.4880, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.3348 => 0.3506, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.71% (0.2911 => 0.3048, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3060 => 0.3203, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (1.8794 => 1.9672, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.66% (1.9966 => 2.0896, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3317 => 0.3471, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3124 => 0.3269, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3258 => 0.3408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.60% (0.3477 => 0.3637, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.59% (0.3267 => 0.3417, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3625 => 0.3788, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3726 => 0.3892, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3690 => 0.3853, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (2.1653 => 2.2589, std. dev.: 0.0139) MultiSource/Applications/lua/lua: 4.31% (1.4269 => 1.4884, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 4.28% (4.6177 => 4.8154, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (4.4195 => 4.6079, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3282 => 0.3421, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.21% (0.6634 => 0.6913, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.16% (0.3271 => 0.3407, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.15% (0.7875 => 0.8202, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4251 => 0.4425, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4146 => 0.4315, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.02% (0.5546 => 0.5769, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.96% (0.3336 => 0.3468, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 3.89% (0.9697 => 1.0074, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.2737 => 0.2843, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.87% (0.3981 => 0.4135, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.77% (0.2969 => 0.3081, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.3845 => 0.3986, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 3.66% (23.5202 => 24.3815, std. dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.6435 => 0.6659, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.45% (0.5012 => 0.5185, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.68% (2.0346 => 2.0891, std. dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 2.41% (0.4847 => 0.4964, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (0.5361 => 0.5480, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (0.7426 => 0.7577, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.35% (11.6398 => 11.7964, std. dev.: 0.0129) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.6926 => 4.7456, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6635, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1661, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6504, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1986, std. dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5020, std. dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2249, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4400, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5900, std. dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5892, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8066, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7953, std. dev.: 0.0030) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.41% (17.2379 => 16.8231, std. dev.: 0.0455) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.19% (0.6293 => 0.6155, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9566, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 03:16:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 05:16:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912101626.D30352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3708?compare_to=3704&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3708, Order: 163687, Start Time: 2012-09-12 09:03:29, End Time: 2012-09-12 10:17:42 To: 3704, Order: 163683, Start Time: 2012-09-12 07:20:15, End Time: 2012-09-12 08:35:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.40% (3.7798 => 3.8329, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5205 => 4.5686, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -2.00% (26.4746 => 25.9445, std. dev.: 0.0327) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (4.1261 => 4.0597, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.29% (2.0176 => 2.4068, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 11.33% (0.5818 => 0.6477, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.40% (0.3578 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.21% (0.3663 => 0.4037, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (0.7710 => 0.8497, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 10.20% (0.7061 => 0.7781, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 10.18% (0.3646 => 0.4017, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3601 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.11% (0.3650 => 0.4019, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.11% (0.3789 => 0.4172, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3623 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.91% (0.3914 => 0.4302, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.89% (3.9660 => 4.3582, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/property: 9.80% (0.3940 => 0.4326, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.77% (0.4003 => 0.4394, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.54% (1.3693 => 1.4999, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.36% (0.2596 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.10% (0.5265 => 0.5744, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.7038 => 0.7663, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.86% (1.2193 => 1.3273, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.75% (0.9199 => 1.0004, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.6959 => 0.7564, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.65% (1.4563 => 1.5822, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.44% (1.1364 => 1.2323, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9379, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.94% (0.5577 => 0.6020, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 7.93% (0.4062 => 0.4384, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.6283 => 0.6772, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.76% (0.2782 => 0.2998, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (7.2180 => 7.7771, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4379 => 0.4718, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.58% (0.7506 => 0.8075, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3489 => 0.3750, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.38% (1.0313 => 1.1074, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.33% (0.5637 => 0.6050, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.32% (0.3756 => 0.4031, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.31% (0.2995 => 0.3214, std. dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.30% (0.3246 => 0.3483, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.23% (3.6692 => 3.9345, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3293 => 0.3531, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.22% (0.4791 => 0.5137, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.21% (1.9828 => 2.1258, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.16% (1.1061 => 1.1853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4016 => 0.4300, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 6.97% (0.8310 => 0.8889, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.90% (3.8646 => 4.1314, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.81% (0.3453 => 0.3688, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.65% (0.7460 => 0.7956, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 6.54% (3.1889 => 3.3974, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4390 => 0.4676, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.47% (1.3245 => 1.4102, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.43% (0.6576 => 0.6999, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.40% (1.3819 => 1.4704, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.35% (0.6744 => 0.7172, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.31% (1.9270 => 2.0486, std. dev.: 0.0071) MultiSource/Applications/siod/siod: 6.31% (2.1791 => 2.3166, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4113 => 0.4372, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (1.3813 => 1.4680, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 6.19% (1.0594 => 1.1250, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6135 => 0.6507, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.04% (4.4433 => 4.7116, std. dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.2749 => 1.3512, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.3801 => 4.6416, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.82% (16.6129 => 17.5803, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.79% (14.8535 => 15.7137, std. dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.72% (1.1333 => 1.1981, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.71% (0.8698 => 0.9195, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (8.4961 => 8.9795, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0082, std. dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.44% (0.8818 => 0.9298, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.37% (14.5298 => 15.3097, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (6.5754 => 6.9102, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.71% (1.2292 => 1.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.44% (3.2742 => 3.4197, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 4.29% (4.6629 => 4.8630, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.9108 => 0.9491, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.02% (0.6250 => 0.6501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1863, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.88% (1.5188 => 1.5777, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.83% (3.7467 => 3.8902, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.1007 => 2.1751, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (6.2785 => 6.4947, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.02% (0.3511 => 0.3617, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.65% (33.2944 => 34.1754, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5393, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0468) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4133, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5484, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0988, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5956, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.58% (3.7731 => 3.8329, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5927, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.55% (0.4657 => 0.4026, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.72% (0.2670 => 0.2544, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.85% (22.5627 => 21.6930, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2833, std. dev.: 0.0174) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.90% (1.3780 => 1.2967, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0005) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1509, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9221, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5766, std. dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.15% (26.5159 => 25.9445, std. dev.: 0.0327) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2480, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0597, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.14% (7.3305 => 7.2471, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std. dev.: 0.0127) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4320, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 03:33:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 05:33:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912103316.55CEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3709?compare_to=3705&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3709, Order: 163687, Start Time: 2012-09-12 09:14:45, End Time: 2012-09-12 10:34:32 To: 3705, Order: 163683, Start Time: 2012-09-12 07:25:51, End Time: 2012-09-12 08:46:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (133 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (54.8691 => 56.4163, std. dev.: 0.1252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.44% (78.8701 => 80.0049, std. dev.: 0.2987) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.36% (15.2869 => 15.0785, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.44% (10.3673 => 15.0785, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/richards_benchmark: 25.28% (0.1622 => 0.2032, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.57% (0.3473 => 0.3979, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 14.33% (0.3516 => 0.4020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.18% (0.3497 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3561 => 0.4066, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.17% (0.3543 => 0.4045, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3543 => 0.4042, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.81% (0.3694 => 0.4204, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.38% (2.2022 => 2.4969, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.35% (0.3828 => 0.4339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.19% (0.3927 => 0.4445, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.10% (7.0540 => 7.9778, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 12.97% (0.3886 => 0.4390, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.43% (0.1432 => 0.1610, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.50% (1.1194 => 1.2481, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.07% (1.7609 => 1.9382, std. dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.6030 => 0.6522, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.46% (10.4361 => 11.2151, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.45% (0.8172 => 0.8781, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7326 => 0.7841, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.01% (0.4879 => 0.5221, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.81% (9.4845 => 10.1300, std. dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (8.1363 => 8.6718, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.54% (0.4615 => 0.4917, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3423 => 0.3645, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.37% (0.7835 => 0.8334, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.28% (4.2646 => 4.5324, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.24% (0.3817 => 0.4055, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.16% (0.5860 => 0.6221, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 6.08% (0.3109 => 0.3298, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 5.97% (0.7115 => 0.7540, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 5.92% (0.7433 => 0.7873, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.90% (1.5415 => 1.6325, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.90% (1.3050 => 1.3820, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.89% (0.5569 => 0.5897, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.89% (0.6675 => 0.7068, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3121 => 0.3303, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.76% (5.0018 => 5.2898, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.9449 => 5.2276, std. dev.: 0.0135) MultiSource/Applications/d/make_dparser: 5.64% (3.3354 => 3.5235, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.8067 => 0.8512, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.3092 => 0.3262, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.47% (0.5105 => 0.5384, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 5.41% (5.7591 => 6.0704, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 5.28% (0.3180 => 0.3348, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.26% (0.4299 => 0.4525, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9765 => 1.0270, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2234, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.06% (0.5020 => 0.5274, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.98% (1.1861 => 1.2452, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 4.97% (21.9371 => 23.0281, std. dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.97% (0.3441 => 0.3612, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 4.77% (1.5603 => 1.6348, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 4.65% (3.8723 => 4.0525, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3422 => 0.3580, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.58% (0.3387 => 0.3542, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4636 => 0.4845, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.38% (7.9617 => 8.3108, std. dev.: 0.0116) MultiSource/Applications/lemon/lemon: 4.36% (1.0722 => 1.1190, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.36% (0.6450 => 0.6731, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.24% (2.0273 => 2.1133, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.24% (0.4103 => 0.4277, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.22% (0.2891 => 0.3013, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.3650 => 0.3803, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.16% (0.5981 => 0.6230, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.14% (0.3865 => 0.4025, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.2905 => 0.3023, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.99% (2.2969 => 2.3885, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4289 => 0.4459, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3826 => 0.3973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4203 => 0.4361, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.74% (0.2756 => 0.2859, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2871 => 0.2978, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.71% (2.0665 => 2.1432, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2872 => 0.2978, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.68% (0.8921 => 0.9249, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (14.3668 => 14.8934, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3232 => 0.3349, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.4186 => 1.4693, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/wc: 3.51% (0.3052 => 0.3159, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6385, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3379 => 0.3489, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.2024 => 2.2678, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.1840 => 1.2171, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 2.24% (1.2842 => 1.3130, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (0.8101 => 0.8269, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3842, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (4.2280 => 4.3533, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7891, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2297, std. dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.03% (5.2763 => 3.2172, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.50% (5.3855 => 3.8504, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.10% (5.3526 => 3.8484, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1182, std. dev.: 0.0389) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.35% (2.9384 => 2.5755, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8157, std. dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2814, std. dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.87% (0.3463 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7152, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5769, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1511, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5042, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4175, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9975, std. dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.47% (1.2373 => 1.2068, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0082, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5793, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0134) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 03:52:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 05:52:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912105201.09D542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3710?compare_to=3706&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3710, Order: 163689, Start Time: 2012-09-12 09:41:54, End Time: 2012-09-12 10:53:19 To: 3706, Order: 163685, Start Time: 2012-09-12 08:15:29, End Time: 2012-09-12 09:26:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (51 on baseline) Performance Improvements: 5 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.94% (0.5886 => 0.6000, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8575 => 3.9304, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.54% (4.2281 => 4.2933, std. dev.: 0.0165) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.2581 => 2.2810, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.38% (16.0937 => 17.7647, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/mandel-2: 2.65% (3.0451 => 3.1259, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.62% (1.7394 => 1.7849, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (2.5449 => 2.6041, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.47% (3.6323 => 3.6857, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.22% (1.8385 => 1.8610, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.22% (0.7877 => 0.7702, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -17.29% (4.0757 => 3.3712, std. dev.: 0.1152) SingleSource/Benchmarks/Shootout-C++/hash2: -5.04% (3.7054 => 3.5186, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: -2.05% (2.4009 => 2.3517, std. dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.47% (1.4443 => 1.4231, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.43% (0.6410 => 0.6758, std. dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 4.81% (2.1763 => 2.2810, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.55% (0.3582 => 0.3745, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 4.00% (1.0046 => 1.0448, std. dev.: 0.0101) MultiSource/Applications/minisat/minisat: 3.55% (0.6173 => 0.6392, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (1.5150 => 1.5635, std. dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: 3.06% (1.1653 => 1.2010, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (1.3935 => 1.4245, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (12.6413 => 12.8718, std. dev.: 0.0242) MultiSource/Applications/d/make_dparser: 1.80% (3.0225 => 3.0769, std. dev.: 0.0126) MultiSource/Applications/siod/siod: 1.76% (2.0972 => 2.1342, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.70% (1.1827 => 1.2028, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6069 => 0.6172, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.52% (29.3170 => 29.7639, std. dev.: 0.1416) MultiSource/Benchmarks/MallocBench/gs/gs: 1.31% (3.8796 => 3.9304, std. dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 1.25% (13.3238 => 13.4900, std. dev.: 0.0620) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 52.09% (0.0263 => 0.0400, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0107) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.06% (0.0766 => 0.0935, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.95% (1.7426 => 2.0032, std. dev.: 0.0283) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.69% (4.0101 => 4.5592, std. dev.: 0.0170) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.20% (0.0917 => 0.1038, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.21% (15.8312 => 17.7647, std. dev.: 0.0421) SingleSource/Benchmarks/McGill/misr: 10.99% (0.4296 => 0.4768, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 9.50% (3.4406 => 3.7673, std. dev.: 0.0603) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.42% (0.2857 => 0.3126, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6168, std. dev.: 0.0381) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.74% (1.0063 => 1.0943, std. dev.: 0.0211) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.69% (0.2694 => 0.2928, std. dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: 7.23% (1.0194 => 1.0931, std. dev.: 0.0136) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7999, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 3.87% (15.2242 => 15.8128, std. dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.85% (40.4792 => 42.0374, std. dev.: 0.5363) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/ReedSolomon: 3.53% (8.5113 => 8.8116, std. dev.: 0.0304) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.01% (0.5876 => 0.6053, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3508 => 0.3612, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.58% (0.5587 => 0.5731, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (1.7473 => 1.7849, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.6127 => 4.6990, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4455 => 2.4842, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.55% (3.5520 => 3.6071, std. dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5316, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 1.31% (2.5166 => 2.5495, std. dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6699, std. dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.75% (0.2080 => 0.1898, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.38% (0.3497 => 0.2085, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.19% (5.2665 => 4.1504, std. dev.: 0.0872) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.05% (1.1647 => 0.9894, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.76% (3.2007 => 2.9524, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.08% (3.6254 => 3.3687, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -6.76% (3.4230 => 3.1917, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/richards_benchmark: -6.14% (1.4441 => 1.3555, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4060, std. dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7624, std. dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.18% (0.4140 => 0.3967, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -3.61% (9.2503 => 8.9160, std. dev.: 0.0299) MultiSource/Benchmarks/mafft/pairlocalalign: -3.46% (62.4126 => 60.2508, std. dev.: 0.4825) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.32% (1.7361 => 1.6784, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.04% (1.1683 => 1.1328, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.89% (2.4457 => 2.3749, std. dev.: 0.0145) MultiSource/Applications/aha/aha: -2.82% (3.4286 => 3.3320, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -2.64% (9.5474 => 9.2957, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.42% (1.2722 => 1.2414, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.22% (0.6119 => 0.5983, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -1.96% (92.7467 => 90.9260, std. dev.: 0.0791) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.70% (3.7496 => 3.6857, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.62% (2.8964 => 2.8496, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2425, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7659, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: -1.37% (1.7330 => 1.7093, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3299, std. dev.: 0.0401) MultiSource/Benchmarks/sim/sim: -1.07% (3.8907 => 3.8489, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -1.05% (6.7458 => 6.6750, std. dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 04:59:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 06:59:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912115908.718452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3711?compare_to=3708&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3711, Order: 163694, Start Time: 2012-09-12 10:46:05, End Time: 2012-09-12 12:00:24 To: 3708, Order: 163687, Start Time: 2012-09-12 09:03:29, End Time: 2012-09-12 10:17:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.74% (77.2944 => 80.1867, std. dev.: 0.2298) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.91% (54.7145 => 55.7595, std. dev.: 0.3598) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.42% (2.0176 => 2.4094, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 12.55% (0.5818 => 0.6548, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.37% (0.5748 => 0.6459, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3578 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.95% (0.3650 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.94% (0.3601 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3646 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3663 => 0.4095, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.79% (0.3623 => 0.4050, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3789 => 0.4231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3914 => 0.4366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.4003 => 0.4459, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.32% (0.3940 => 0.4386, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.23% (0.7061 => 0.7854, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.77% (0.7710 => 0.8540, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.14% (3.9660 => 4.3682, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.78% (0.2596 => 0.2850, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.65% (1.3693 => 1.5015, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.29% (0.5265 => 0.5754, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.20% (0.4328 => 0.4726, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.96% (1.2193 => 1.3286, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.94% (0.9199 => 1.0021, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.92% (0.7038 => 0.7666, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.87% (0.6959 => 0.7576, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.71% (1.4563 => 1.5831, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.70% (0.2781 => 0.3023, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.49% (1.1364 => 1.2329, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2782 => 0.3017, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2127 => 0.2306, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.37% (0.4062 => 0.4402, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.25% (13.8202 => 14.9610, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.23% (0.3899 => 0.4220, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.18% (0.4379 => 0.4737, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.14% (0.5577 => 0.6031, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 8.08% (0.3293 => 0.3559, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2628 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3485 => 0.3766, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.06% (1.9828 => 2.1426, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.04% (0.3022 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6283 => 0.6788, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.03% (0.3489 => 0.3769, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.02% (7.2180 => 7.7970, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.2914 => 0.3147, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.99% (0.7506 => 0.8106, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.98% (0.2607 => 0.2815, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.92% (0.2966 => 0.3201, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.88% (0.3580 => 0.3862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2760 => 0.2977, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.85% (0.3756 => 0.4051, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.83% (0.2937 => 0.3167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2726 => 0.2939, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.81% (1.1061 => 1.1925, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.79% (0.3107 => 0.3349, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.78% (0.2765 => 0.2980, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.72% (0.4390 => 0.4729, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2761 => 0.2973, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.55% (1.0313 => 1.1092, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.54% (0.4016 => 0.4319, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.53% (0.2988 => 0.3213, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3246 => 0.3490, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3149 => 0.3385, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (0.1657 => 0.1780, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.42% (0.5637 => 0.6055, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.3868 => 0.4150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.27% (0.3453 => 0.3704, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.27% (3.6692 => 3.9359, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: 7.27% (0.3192 => 0.3424, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3534 => 0.3788, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.18% (3.8646 => 4.1421, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 7.14% (0.3220 => 0.3450, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 6.90% (0.8310 => 0.8883, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.85% (0.7460 => 0.7971, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.67% (1.3245 => 1.4129, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.65% (0.6576 => 0.7013, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.63% (3.1889 => 3.4003, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 6.56% (1.9270 => 2.0534, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.54% (0.6744 => 0.7185, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.52% (0.4113 => 0.4381, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 6.49% (2.1791 => 2.3205, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.24% (4.4433 => 4.7205, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 6.23% (0.2859 => 0.3037, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.23% (4.3801 => 4.6528, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.18% (0.6135 => 0.6514, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.16% (1.0594 => 1.1247, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.15% (0.3755 => 0.3986, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.14% (16.6129 => 17.6326, std. dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.8698 => 0.9230, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.08% (1.3819 => 1.4659, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.05% (1.3813 => 1.4649, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (1.2749 => 1.3517, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.84% (8.4961 => 8.9919, std. dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 5.75% (14.8535 => 15.7080, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.73% (1.1333 => 1.1982, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.61% (0.3245 => 0.3427, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.47% (14.5298 => 15.3244, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0084, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.35% (0.8818 => 0.9290, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.16% (1.2292 => 1.2926, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (6.5754 => 6.9134, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 4.89% (4.6629 => 4.8910, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.4805 => 0.5031, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.52% (3.2742 => 3.4222, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6250 => 0.6521, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.30% (4.9865 => 5.2007, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.19% (0.9108 => 0.9490, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5188 => 1.5822, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 4.08% (3.7467 => 3.8994, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (6.2785 => 6.5239, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.79% (2.1007 => 2.1803, std. dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 3.43% (33.2944 => 34.4372, std. dev.: 0.0193) MultiSource/Applications/sqlite3/sqlite3: 1.57% (16.2614 => 16.5165, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5108, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4133, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0760, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6867, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5919, std. dev.: 0.0043) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.22% (0.4657 => 0.4088, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.71% (22.5627 => 21.7248, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.36% (20.3410 => 18.2343, std. dev.: 0.0284) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std. dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9238, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5861, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9092, std. dev.: 0.0131) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2431, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2170, std. dev.: 0.0320) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0606, std. dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4358, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 05:21:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 07:21:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912122140.D02D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3712?compare_to=3709&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3712, Order: 163695, Start Time: 2012-09-12 11:03:01, End Time: 2012-09-12 12:22:57 To: 3709, Order: 163687, Start Time: 2012-09-12 09:14:45, End Time: 2012-09-12 10:34:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (136 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (713 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.68% (15.0785 => 14.6740, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.54% (10.3673 => 14.6740, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.45% (0.3473 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.15% (0.3497 => 0.3992, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.99% (0.3516 => 0.4008, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.97% (0.3543 => 0.4038, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.93% (0.3561 => 0.4057, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.89% (2.2022 => 2.5081, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.86% (0.3543 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.51% (0.3694 => 0.4193, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 13.24% (0.3828 => 0.4335, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.23% (7.0540 => 7.9870, std. dev.: 0.0100) SingleSource/UnitTests/ObjC/parameter-passing: 13.17% (0.3927 => 0.4444, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 13.02% (0.3886 => 0.4392, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.97% (1.1194 => 1.2534, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (1.7609 => 1.9545, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 8.62% (0.3282 => 0.3565, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.6030 => 0.6513, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.56% (0.8172 => 0.8790, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.4615 => 0.4961, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.14% (10.4361 => 11.1816, std. dev.: 0.0134) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7326 => 0.7834, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 6.92% (9.4845 => 10.1413, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.65% (0.3307 => 0.3527, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (8.1363 => 8.6718, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.37% (0.5860 => 0.6233, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.25% (0.3423 => 0.3637, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (4.2646 => 4.5304, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 6.23% (0.7433 => 0.7896, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 6.20% (0.7835 => 0.8321, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.16% (0.3817 => 0.4052, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.14% (0.7115 => 0.7552, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5569 => 0.5902, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.95% (0.6675 => 0.7072, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.3050 => 1.3818, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.5415 => 1.6316, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.8067 => 0.8533, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 5.77% (3.3354 => 3.5278, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.9449 => 5.2297, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (5.0018 => 5.2893, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.3092 => 0.3264, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9765 => 1.0292, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.37% (5.7591 => 6.0684, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.24% (1.1642 => 1.2252, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1861 => 1.2456, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.94% (0.3441 => 0.3611, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.90% (1.5603 => 1.6368, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 4.86% (3.8723 => 4.0605, std. dev.: 0.0150) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.4064 => 0.4256, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (7.9617 => 8.3317, std. dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 4.64% (0.3387 => 0.3544, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.62% (0.5020 => 0.5252, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.56% (0.4103 => 0.4290, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.53% (0.3422 => 0.3577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.49% (0.6456 => 0.6746, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.44% (21.9371 => 22.9109, std. dev.: 0.0344) MultiSource/Applications/treecc/treecc: 4.40% (2.0273 => 2.1165, std. dev.: 0.0123) MultiSource/Applications/lemon/lemon: 4.39% (1.0722 => 1.1193, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.36% (0.4636 => 0.4838, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 4.29% (2.2969 => 2.3954, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5981 => 0.6228, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.03% (0.3650 => 0.3797, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.96% (2.0665 => 2.1484, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.92% (0.3826 => 0.3976, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8921 => 0.9264, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4620 => 0.4796, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.80% (0.3162 => 0.3282, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.3098 => 0.3214, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.4186 => 1.4716, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (14.3668 => 14.8982, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.69% (0.3603 => 0.3736, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.62% (0.2871 => 0.2975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.59% (0.2872 => 0.2975, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3684 => 0.3811, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.3052 => 0.3157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.34% (1.5859 => 1.6388, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (2.2024 => 2.2688, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.1840 => 1.2165, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.28% (1.2842 => 1.3135, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.8101 => 0.8282, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3842, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7455, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (4.2280 => 4.3508, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7894, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2283, std. dev.: 0.0246) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.01% (26.0924 => 26.3562, std. dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.70% (5.2763 => 3.2342, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.21% (5.3855 => 3.8661, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.82% (5.3526 => 3.8633, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1987, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.04% (2.9384 => 2.5847, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8295, std. dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2866, std. dev.: 0.1007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.40% (1.8329 => 1.7156, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.13% (1.6805 => 1.5775, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1511, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4994, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: -3.09% (1.2373 => 1.1991, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4124, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9860, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.80% (1.3677 => 1.3294, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0027, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5783, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 06:13:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 08:13:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912131316.330AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3713?compare_to=3707&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3713, Order: 163691, Start Time: 2012-09-12 10:30:49, End Time: 2012-09-12 13:14:32 To: 3707, Order: 163683, Start Time: 2012-09-12 07:17:11, End Time: 2012-09-12 10:01:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (124 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.46% (1.6930 => 1.7177, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.25% (24.3815 => 24.6871, std. dev.: 0.0236) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.60% (0.3465 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.59% (0.3488 => 0.3997, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 14.54% (0.3446 => 0.3947, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.45% (0.3496 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.38% (0.3469 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.95% (0.3650 => 0.4159, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.92% (0.3643 => 0.4150, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.67% (0.3724 => 0.4233, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5826 => 0.6356, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5889 => 0.6407, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1620 => 0.1753, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.81% (1.5932 => 1.7177, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.28% (3.5627 => 3.8220, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.27% (1.6211 => 1.7390, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.24% (0.7171 => 0.7690, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.75% (0.4994 => 0.5331, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.69% (1.3152 => 1.4032, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.60% (0.5000 => 0.5330, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.58% (0.4361 => 0.4648, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.44% (0.3930 => 0.4183, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.3004 => 0.3189, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2875 => 0.3051, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.07% (4.2109 => 4.4664, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 6.03% (0.4029 => 0.4272, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.92% (1.0781 => 1.1419, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2823 => 0.2987, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.81% (0.2738 => 0.2897, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.79% (0.2813 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2729 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.76% (0.3195 => 0.3379, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.69% (0.2792 => 0.2951, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.67% (0.2750 => 0.2906, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (0.5026 => 0.5311, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 5.66% (0.9909 => 1.0470, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.2780 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2803 => 0.2961, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.55% (0.2811 => 0.2967, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.54% (2.0673 => 2.1819, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.53% (5.5417 => 5.8479, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2911 => 0.3071, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.44% (0.3124 => 0.3294, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.43% (2.7292 => 2.8775, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 5.43% (0.3258 => 0.3435, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: 5.43% (0.3096 => 0.3264, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.41% (0.2736 => 0.2884, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.39% (0.3267 => 0.3443, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3060 => 0.3221, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3477 => 0.3657, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3362 => 0.3536, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.17% (0.3348 => 0.3521, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3678 => 0.3867, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.13% (0.3625 => 0.3811, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.12% (0.3792 => 0.3986, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.11% (0.2566 => 0.2697, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.00% (0.4658 => 0.4891, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 5.00% (2.1013 => 2.2063, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.99% (0.3726 => 0.3912, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (0.3890 => 0.4084, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.97% (0.3282 => 0.3445, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.96% (23.5202 => 24.6871, std. dev.: 0.0236) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.82% (1.9694 => 2.0643, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.82% (1.9966 => 2.0928, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 4.80% (0.4146 => 0.4345, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3690 => 0.3865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.73% (0.4251 => 0.4452, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (1.8794 => 1.9670, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.64% (0.3903 => 0.4084, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.56% (2.1653 => 2.2641, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 4.52% (1.4269 => 1.4914, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.4139 => 0.4324, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.45% (0.3981 => 0.4158, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.3845 => 0.4013, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.36% (0.5546 => 0.5788, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.32% (4.6177 => 4.8172, std. dev.: 0.0103) MultiSource/Applications/hbd/hbd: 4.30% (0.9697 => 1.0114, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.28% (4.4195 => 4.6087, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.24% (0.2737 => 0.2853, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.24% (0.6634 => 0.6915, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.15% (0.3084 => 0.3212, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 4.11% (0.3336 => 0.3473, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.09% (0.7875 => 0.8197, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.99% (0.5012 => 0.5212, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.2969 => 0.3084, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.85% (0.6435 => 0.6683, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (0.2691 => 0.2793, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.90% (2.0346 => 2.0936, std. dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (0.4847 => 0.4967, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (0.5361 => 0.5486, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (0.7426 => 0.7591, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (11.6398 => 11.8259, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.45% (4.6926 => 4.7606, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6569, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std. dev.: 0.0789) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6422, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std. dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5067, std. dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4404, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2915, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5810, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4466, std. dev.: 0.0325) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5688, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7867, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8051, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -3.24% (17.2379 => 16.6792, std. dev.: 0.1088) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5697, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9693, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 06:42:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 08:42:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912134208.8EA112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3714?compare_to=3711&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3714, Order: 163703, Start Time: 2012-09-12 12:28:43, End Time: 2012-09-12 13:43:25 To: 3711, Order: 163694, Start Time: 2012-09-12 10:46:05, End Time: 2012-09-12 12:00:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.15% (55.7595 => 56.4029, std. dev.: 0.1337) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.71% (2.0176 => 2.4152, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.20% (0.5748 => 0.6449, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.19% (0.5818 => 0.6527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.91% (0.3578 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.90% (0.7061 => 0.7901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3663 => 0.4093, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.73% (0.3623 => 0.4048, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.69% (0.3601 => 0.4022, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3646 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3650 => 0.4071, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3789 => 0.4225, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3914 => 0.4358, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.14% (0.3940 => 0.4379, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 11.12% (0.4003 => 0.4448, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.80% (0.7710 => 0.8543, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.99% (3.9660 => 4.3624, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.55% (1.3693 => 1.5000, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.36% (0.5265 => 0.5758, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.97% (0.2721 => 0.2965, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 8.92% (0.7038 => 0.7666, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.92% (0.4328 => 0.4714, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9199 => 1.0019, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.2193 => 1.3274, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.6959 => 0.7564, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.68% (1.4563 => 1.5827, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 8.56% (0.2781 => 0.3019, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.52% (0.2782 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.36% (1.1364 => 1.2314, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.21% (0.3022 => 0.3270, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9347, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hello: 8.06% (0.2607 => 0.2817, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.01% (0.3756 => 0.4057, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2690 => 0.2904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.94% (7.2180 => 7.7908, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.92% (0.4379 => 0.4726, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.89% (0.3485 => 0.3760, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.88% (0.3489 => 0.3764, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.86% (0.2761 => 0.2978, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.83% (0.7506 => 0.8094, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.82% (0.2966 => 0.3198, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 7.78% (0.2726 => 0.2938, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.77% (1.9828 => 2.1369, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.74% (0.3580 => 0.3857, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.63% (0.4390 => 0.4725, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2765 => 0.2974, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.50% (0.4016 => 0.4317, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.42% (0.3246 => 0.3487, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (0.1657 => 0.1780, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.38% (0.5637 => 0.6053, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.33% (1.0313 => 1.1069, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.2988 => 0.3207, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.27% (1.1061 => 1.1865, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.20% (3.6692 => 3.9335, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3534 => 0.3788, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.16% (0.3868 => 0.4145, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.01% (0.2995 => 0.3205, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.00% (3.8646 => 4.1350, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/18-imp/imp: 6.96% (0.3220 => 0.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 6.92% (0.8310 => 0.8885, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.86% (0.7460 => 0.7972, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.69% (0.2945 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.55% (0.6576 => 0.7007, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.3245 => 1.4111, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 6.50% (1.9270 => 2.0522, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.49% (3.1889 => 3.3959, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4113 => 0.4374, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 6.23% (2.1791 => 2.3148, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.22% (4.3801 => 4.6525, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.17% (4.4433 => 4.7176, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.13% (0.3755 => 0.3985, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 6.12% (0.2859 => 0.3034, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.07% (1.3813 => 1.4652, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.04% (16.6129 => 17.6168, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.04% (1.3819 => 1.4653, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 6.00% (1.0594 => 1.1230, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.90% (0.6135 => 0.6497, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.85% (14.8535 => 15.7223, std. dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.84% (0.8698 => 0.9206, std. dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (1.2749 => 1.3483, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 5.59% (8.4961 => 8.9707, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (1.1333 => 1.1962, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.55% (0.3245 => 0.3425, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (13.2842 => 14.0111, std. dev.: 0.0202) MultiSource/Applications/ClamAV/clamscan: 5.38% (14.5298 => 15.3115, std. dev.: 0.0168) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.33% (0.8818 => 0.9288, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.24% (0.3131 => 0.3295, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.07% (6.5754 => 6.9090, std. dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.2292 => 1.2904, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.60% (0.4805 => 0.5026, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.50% (4.6629 => 4.8725, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.47% (3.2742 => 3.4205, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.6250 => 0.6513, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.11% (4.9865 => 5.1914, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.08% (0.9108 => 0.9480, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.89% (3.7467 => 3.8926, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5188 => 1.5749, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.2785 => 6.5082, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.1007 => 2.1690, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.11% (33.2944 => 34.3295, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.02% (0.3511 => 0.3617, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5118, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4168, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.14% (10.7476 => 11.0847, std. dev.: 0.0497) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6003, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std. dev.: 0.0067) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5962, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.35% (0.4657 => 0.4082, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.7000, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2953, std. dev.: 0.0195) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.08% (1.3780 => 1.2942, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5092, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std. dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9259, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5873, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8979, std. dev.: 0.0439) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2424, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2410, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.14% (4.1080 => 4.0613, std. dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4326, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2595, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 06:50:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 08:50:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912135020.55D4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3715?compare_to=3710&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3715, Order: 163703, Start Time: 2012-09-12 12:41:17, End Time: 2012-09-12 13:51:38 To: 3710, Order: 163689, Start Time: 2012-09-12 09:41:54, End Time: 2012-09-12 10:53:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (49 on baseline) Performance Improvements: 4 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 875 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.24% (0.0667 => 0.0802, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.01% (0.7428 => 0.7949, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.48% (0.1898 => 0.2021, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3191 => 0.3319, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.92% (0.5618 => 0.5782, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 2.91% (0.4126 => 0.4246, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.8825 => 0.9047, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7702 => 0.7808, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (0.3282 => 0.3482, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (1.3264 => 1.3939, std. dev.: 0.0221) MultiSource/Benchmarks/mafft/pairlocalalign: 1.97% (60.2508 => 61.4368, std. dev.: 0.1037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.37% (1.4231 => 1.4426, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 1.20% (8.3831 => 8.4833, std. dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.43% (1.4245 => 1.4042, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -4.72% (3.2340 => 3.0812, std. dev.: 0.0299) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.10% (17.7647 => 17.0366, std. dev.: 0.2691) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.02% (3.6857 => 3.6480, std. dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.6410 => 0.6748, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3582 => 0.3738, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 3.75% (1.0046 => 1.0423, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.63% (0.6173 => 0.6397, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3.51% (1.1653 => 1.2062, std. dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 3.50% (2.1763 => 2.2525, std. dev.: 0.0123) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3217 => 0.3319, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.94% (0.7722 => 0.7949, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.5150 => 1.5457, std. dev.: 0.0092) MultiSource/Applications/Burg/burg: 1.89% (1.1440 => 1.1656, std. dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 1.68% (29.3170 => 29.8101, std. dev.: 0.0605) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.51% (1.1827 => 1.2005, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.46% (13.3238 => 13.5180, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (12.6413 => 12.8183, std. dev.: 0.0342) MultiSource/Applications/kimwitu++/kc: 1.36% (15.3105 => 15.5194, std. dev.: 0.0343) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.6079 => 14.7570, std. dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.48% (1.6538 => 2.3398, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.0766 => 0.0903, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9990, std. dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.82% (4.0101 => 4.5644, std. dev.: 0.0072) SingleSource/Benchmarks/McGill/misr: 12.64% (0.4296 => 0.4839, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 12.28% (0.3746 => 0.4206, std. dev.: 0.0103) SingleSource/Benchmarks/Stanford/Puzzle: 12.07% (0.1433 => 0.1606, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (3.4406 => 3.7936, std. dev.: 0.0402) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.6001, std. dev.: 0.0861) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.53% (1.0063 => 1.0921, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.61% (15.8312 => 17.0366, std. dev.: 0.2691) SingleSource/Benchmarks/McGill/chomp: 6.93% (1.0194 => 1.0900, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7926, std. dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.48% (0.3301 => 0.3482, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.21% (4.2129 => 4.4322, std. dev.: 0.0443) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8766, std. dev.: 0.0507) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: 3.85% (0.9851 => 1.0230, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8715, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 2.92% (1.4184 => 1.4598, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.60% (0.8498 => 0.8719, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/ReedSolomon: 2.49% (8.5113 => 8.7233, std. dev.: 0.0531) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.40% (0.5876 => 0.6017, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/five11/five11: 1.96% (5.1938 => 5.2956, std. dev.: 0.0206) MultiSource/Applications/siod/siod: 1.94% (3.5520 => 3.6209, std. dev.: 0.0099) MultiSource/Applications/lua/lua: 1.91% (29.5232 => 30.0859, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6646, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: 1.18% (2.4013 => 2.4297, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 1.14% (2.5166 => 2.5452, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.06% (0.3497 => 0.2061, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.21% (5.2665 => 4.1496, std. dev.: 0.0754) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.07% (1.1647 => 0.9892, std. dev.: 0.0295) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1571, std. dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2856, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.73% (3.2007 => 2.9534, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3665, std. dev.: 0.0156) MultiSource/Applications/SIBsim4/SIBsim4: -6.76% (3.4230 => 3.1917, std. dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -5.69% (1.4441 => 1.3619, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4074, std. dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.9413 => 3.7625, std. dev.: 0.0593) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.74% (0.4140 => 0.3985, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -3.52% (9.2503 => 8.9247, std. dev.: 0.0433) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.29% (1.7361 => 1.6789, std. dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std. dev.: 0.0062) MultiSource/Applications/aha/aha: -2.80% (3.4286 => 3.3327, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1360, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std. dev.: 0.0239) MultiSource/Benchmarks/PAQ8p/paq8p: -2.71% (92.7467 => 90.2317, std. dev.: 0.2159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.71% (3.7496 => 3.6480, std. dev.: 0.0122) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.14% (2.8964 => 2.8343, std. dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.71% (61.1734 => 60.1283, std. dev.: 0.3987) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2275, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.56% (62.4126 => 61.4368, std. dev.: 0.1037) MultiSource/Applications/JM/lencod/lencod: -1.43% (6.7458 => 6.6492, std. dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3122, std. dev.: 0.0438) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.36% (1.8739 => 1.8485, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 07:10:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 09:10:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912141005.7D4E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3716?compare_to=3712&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3716, Order: 163703, Start Time: 2012-09-12 12:51:29, End Time: 2012-09-12 14:11:21 To: 3712, Order: 163695, Start Time: 2012-09-12 11:03:01, End Time: 2012-09-12 12:22:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (142 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.09% (3.8128 => 3.8545, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.09% (1.3357 => 1.3212, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.70% (10.3673 => 14.6905, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 26.08% (0.1622 => 0.2045, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.23% (0.3543 => 0.4047, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.05% (0.3473 => 0.3961, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.92% (2.2022 => 2.5087, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.90% (7.0540 => 8.0346, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3497 => 0.3979, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.71% (0.3516 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.66% (0.3543 => 0.4027, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.62% (0.3561 => 0.4046, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.32% (0.3694 => 0.4186, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3828 => 0.4325, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3927 => 0.4430, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.66% (0.3886 => 0.4378, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.45% (0.1566 => 0.1761, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.94% (1.1194 => 1.2531, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.17% (1.7609 => 1.9576, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.6030 => 0.6500, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.56% (0.4879 => 0.5248, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.44% (0.8172 => 0.8780, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (9.4845 => 10.1715, std. dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: 7.15% (10.4361 => 11.1820, std. dev.: 0.0310) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (8.1363 => 8.6981, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.86% (0.3307 => 0.3534, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.83% (0.4615 => 0.4930, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.73% (0.7326 => 0.7819, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7433 => 0.7927, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 6.63% (0.3423 => 0.3650, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.62% (0.7835 => 0.8354, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (4.2646 => 4.5452, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.48% (0.7115 => 0.7576, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.5860 => 0.6237, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.38% (0.6675 => 0.7101, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.22% (1.5415 => 1.6374, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.20% (0.5569 => 0.5914, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (1.3050 => 1.3852, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 6.12% (3.3354 => 3.5394, std. dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.08% (4.9449 => 5.2454, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (5.0018 => 5.3044, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.01% (0.5105 => 0.5412, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 6.01% (5.7591 => 6.1054, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.84% (0.3817 => 0.4040, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.84% (0.8067 => 0.8538, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 5.66% (0.3180 => 0.3360, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.63% (0.9765 => 1.0315, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 5.53% (1.1642 => 1.2286, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1861 => 1.2495, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.29% (0.3441 => 0.3623, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 5.27% (1.5603 => 1.6426, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.05% (0.3387 => 0.3558, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 5.05% (3.8723 => 4.0677, std. dev.: 0.0114) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1249, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4636 => 0.4861, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.82% (0.3422 => 0.3587, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.82% (0.6456 => 0.6767, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.78% (0.6450 => 0.6758, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.77% (7.9617 => 8.3412, std. dev.: 0.0107) MultiSource/Applications/treecc/treecc: 4.71% (2.0273 => 2.1227, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.4103 => 0.4296, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.52% (2.2969 => 2.4008, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.52% (0.3650 => 0.3815, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.42% (21.9371 => 22.9063, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.40% (0.3865 => 0.4035, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5981 => 0.6243, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4289 => 0.4474, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4203 => 0.4384, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.30% (0.8921 => 0.9305, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.25% (0.2891 => 0.3014, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.24% (0.3136 => 0.3269, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.3826 => 0.3987, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.13% (2.0665 => 2.1519, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.2905 => 0.3025, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.3098 => 0.3225, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4760, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (14.3668 => 14.9476, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.4048 => 0.4209, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.97% (0.2871 => 0.2985, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.96% (0.2877 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (1.5859 => 1.6484, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3603 => 0.3743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3232 => 0.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.85% (0.2756 => 0.2862, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3684 => 0.3825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3283 => 0.3407, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.62% (2.2024 => 2.2822, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2802 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.52% (0.3379 => 0.3498, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.1840 => 1.2204, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.50% (1.2842 => 1.3163, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.8101 => 0.8289, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.82% (1.1145 => 1.3688, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3826, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3545, std. dev.: 0.0080) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7781 => 3.8545, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7899, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.72% (5.2763 => 3.2331, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.04% (5.3855 => 3.8755, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.70% (5.3526 => 3.8701, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0864, std. dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.08% (2.9384 => 2.5834, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.41% (22.1758 => 19.8666, std. dev.: 0.0377) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3126, std. dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5024, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0014) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1506, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5032, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -2.93% (10.2830 => 9.9816, std. dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.6802 => 8.4409, std. dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9900, std. dev.: 0.0243) SingleSource/Benchmarks/McGill/chomp: -1.83% (1.2373 => 1.2147, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std. dev.: 0.0173) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 08:25:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 10:25:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912152529.6FC7A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3717?compare_to=3715&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3717, Order: 163705, Start Time: 2012-09-12 14:14:53, End Time: 2012-09-12 15:26:47 To: 3715, Order: 163703, Start Time: 2012-09-12 12:41:17, End Time: 2012-09-12 13:51:38 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (46 on baseline) Performance Improvements: 2 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 8.78% (3.0812 => 3.3517, std. dev.: 0.0675) SingleSource/Benchmarks/Shootout/heapsort: 8.14% (3.0489 => 3.2972, std. dev.: 0.0873) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.60% (21.9937 => 22.5646, std. dev.: 0.0372) SingleSource/Benchmarks/Shootout-C++/sieve: 2.21% (3.7936 => 3.8774, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 1.65% (8.7233 => 8.8670, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (3.1917 => 3.2442, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.55% (42.0769 => 42.7307, std. dev.: 0.0642) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.6543 => 4.7176, std. dev.: 0.0075) MultiSource/Benchmarks/llubenchmark/llu: 1.24% (1.9983 => 2.0231, std. dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 1.11% (6.6492 => 6.7232, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.94% (0.2021 => 0.1901, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.92% (17.0366 => 15.1765, std. dev.: 0.6787) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.87% (1.1653 => 1.2221, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.56% (0.6410 => 0.6702, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 3.77% (0.6173 => 0.6406, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 3.17% (2.1763 => 2.2453, std. dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.85% (0.3901 => 0.4012, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (1.5150 => 1.5567, std. dev.: 0.0123) MultiSource/Applications/d/make_dparser: 2.73% (3.0225 => 3.1050, std. dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 2.42% (29.3170 => 30.0268, std. dev.: 0.0500) MultiSource/Applications/siod/siod: 2.28% (2.0972 => 2.1450, std. dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 1.93% (13.3238 => 13.5810, std. dev.: 0.0684) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.55% (1.1827 => 1.2010, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2546 => 6.3385, std. dev.: 0.0231) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.28% (4.2616 => 4.3163, std. dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.97% (0.0263 => 0.0376, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.26% (3.4629 => 4.2339, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: 17.70% (1.7426 => 2.0510, std. dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.55% (4.0101 => 4.5935, std. dev.: 0.1467) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 13.38% (0.4296 => 0.4871, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 12.70% (3.4406 => 3.8774, std. dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 12.65% (0.3746 => 0.4220, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.78% (3.0256 => 3.3517, std. dev.: 0.0675) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.32% (0.2694 => 0.2945, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 9.21% (7.0025 => 7.6472, std. dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.39% (1.0063 => 1.0807, std. dev.: 0.0230) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.21% (0.2857 => 0.3063, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 6.71% (1.0194 => 1.0878, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (27.1724 => 28.8365, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.56% (40.4792 => 42.7307, std. dev.: 0.0642) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.65% (0.7609 => 0.7963, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/ReedSolomon: 4.18% (8.5113 => 8.8670, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.88% (15.2242 => 15.8146, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8733, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.00% (0.5876 => 0.6052, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.27% (4.6127 => 4.7176, std. dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: 1.89% (2.4971 => 2.5443, std. dev.: 0.0148) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (2.4455 => 2.4882, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6713, std. dev.: 0.0479) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.01% (22.3381 => 22.5646, std. dev.: 0.0372) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.61% (0.2080 => 0.1901, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.95% (5.2665 => 4.1634, std. dev.: 0.0436) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.00% (1.1647 => 0.9900, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -12.38% (3.6023 => 3.1564, std. dev.: 0.1487) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1640, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3668, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.78% (3.2007 => 2.9836, std. dev.: 0.0227) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.22% (3.4230 => 3.2442, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std. dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (3.9413 => 3.7626, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.10% (2.4457 => 2.3454, std. dev.: 0.0174) MultiSource/Benchmarks/FreeBench/distray/distray: -3.79% (0.2664 => 0.2563, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.56% (3.7496 => 3.6162, std. dev.: 0.0437) MultiSource/Benchmarks/mafft/pairlocalalign: -3.00% (62.4126 => 60.5425, std. dev.: 0.3571) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -2.60% (9.2503 => 9.0095, std. dev.: 0.0104) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.55% (1.2722 => 1.2398, std. dev.: 0.0069) MultiSource/Applications/aha/aha: -2.47% (3.4286 => 3.3440, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.45% (1.1683 => 1.1397, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -2.13% (92.7467 => 90.7729, std. dev.: 0.1657) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.00% (2.8964 => 2.8386, std. dev.: 0.0223) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2321, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -1.50% (1.0926 => 1.0762, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7668, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3344, std. dev.: 0.0930) MultiSource/Benchmarks/sim/sim: -1.27% (3.8907 => 3.8413, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 08:40:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 10:40:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912154038.10E2A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3718?compare_to=3714&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3718, Order: 163705, Start Time: 2012-09-12 14:27:41, End Time: 2012-09-12 15:41:54 To: 3714, Order: 163703, Start Time: 2012-09-12 12:28:43, End Time: 2012-09-12 13:43:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.31% (80.7595 => 79.7047, std. dev.: 0.2802) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.35% (2.0176 => 2.4081, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.21% (0.5818 => 0.6470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.20% (0.5748 => 0.6392, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.93% (0.3578 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.71% (0.7061 => 0.7817, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3601 => 0.3986, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3646 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.66% (0.3650 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.62% (0.3663 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.57% (0.3623 => 0.4006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3789 => 0.4189, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.34% (0.7710 => 0.8507, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3914 => 0.4318, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.4003 => 0.4413, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.18% (0.3940 => 0.4341, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.76% (3.9660 => 4.3529, std. dev.: 0.0082) MultiSource/Applications/hbd/hbd: 9.67% (1.3693 => 1.5017, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.04% (0.5265 => 0.5741, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 8.85% (0.4328 => 0.4711, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.69% (1.2193 => 1.3253, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.64% (0.7038 => 0.7646, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.60% (0.9199 => 0.9990, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.54% (0.6959 => 0.7553, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.45% (1.4563 => 1.5793, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 8.34% (0.2781 => 0.3013, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2782 => 0.3014, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.2721 => 0.2947, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.05% (1.1364 => 1.2279, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.99% (0.2127 => 0.2297, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.91% (0.2655 => 0.2865, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.90% (0.2607 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (0.2628 => 0.2835, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5577 => 0.6016, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2761 => 0.2976, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.78% (13.8202 => 14.8949, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 7.75% (0.7506 => 0.8088, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2726 => 0.2937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.69% (1.9828 => 2.1353, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.68% (0.3489 => 0.3757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6283 => 0.6765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.67% (0.3756 => 0.4044, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (7.2180 => 7.7705, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 7.65% (0.3293 => 0.3545, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.2966 => 0.3192, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2765 => 0.2973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.48% (0.2914 => 0.3132, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.47% (0.4390 => 0.4718, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.46% (0.2696 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3107 => 0.3338, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.30% (0.1589 => 0.1705, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4016 => 0.4309, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.20% (0.5637 => 0.6043, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 7.14% (1.0313 => 1.1049, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3192 => 0.3418, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.07% (0.3534 => 0.3784, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 7.06% (0.3868 => 0.4141, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.99% (0.4791 => 0.5126, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.92% (0.2023 => 0.2163, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.91% (3.6692 => 3.9228, std. dev.: 0.0081) MultiSource/Applications/Burg/burg: 6.89% (1.1061 => 1.1823, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 6.86% (0.3220 => 0.3441, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.73% (3.8646 => 4.1246, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.71% (0.2995 => 0.3196, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.66% (0.6576 => 0.7014, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 6.62% (0.8310 => 0.8860, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.57% (0.7460 => 0.7950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.52% (0.2945 => 0.3137, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 6.41% (1.9270 => 2.0506, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 6.23% (3.1889 => 3.3876, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 6.19% (2.1791 => 2.3140, std. dev.: 0.0152) MultiSource/Applications/minisat/minisat: 6.12% (0.6744 => 0.7157, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.09% (1.3819 => 1.4661, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.3813 => 1.4636, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.92% (4.3801 => 4.6395, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4113 => 0.4356, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1210, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.81% (0.3755 => 0.3973, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (4.4433 => 4.6987, std. dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 5.73% (16.6129 => 17.5648, std. dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.8698 => 0.9193, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.66% (0.6135 => 0.6482, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.54% (1.2749 => 1.3455, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.48% (14.8535 => 15.6678, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 5.40% (8.4961 => 8.9553, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (1.1333 => 1.1927, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (13.2842 => 13.9784, std. dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 5.13% (14.5298 => 15.2757, std. dev.: 0.0187) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2504 => 0.2632, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.99% (0.8818 => 0.9258, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2895, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (6.5754 => 6.8884, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.21% (3.2742 => 3.4119, std. dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 4.18% (4.6629 => 4.8580, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 4.11% (0.6250 => 0.6507, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1771, std. dev.: 0.0209) MultiSource/Applications/lua/lua: 3.61% (3.7467 => 3.8821, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.60% (0.9108 => 0.9436, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.54% (1.5188 => 1.5726, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (6.2785 => 6.4904, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.14% (33.2944 => 34.3414, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.07% (2.1007 => 2.1652, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4610, std. dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2661, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1197, std. dev.: 0.0531) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5953, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5962, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.16% (0.4657 => 0.4044, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.11% (22.5627 => 21.6349, std. dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2556, std. dev.: 0.0202) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9248, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6000, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -2.22% (26.5159 => 25.9266, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2365, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2195, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0605, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2595, std. dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4349, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 08:58:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 10:58:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912155822.E150E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3719?compare_to=3716&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3719, Order: 163705, Start Time: 2012-09-12 14:39:58, End Time: 2012-09-12 15:59:39 To: 3716, Order: 163703, Start Time: 2012-09-12 12:51:29, End Time: 2012-09-12 14:11:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (139 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.03% (3.8545 => 3.7762, std. dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.80% (10.3673 => 14.7006, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 26.02% (0.1622 => 0.2044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.37% (0.3473 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.04% (0.3497 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.03% (0.3543 => 0.4040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3543 => 0.4039, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.99% (0.3516 => 0.4008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.87% (0.3561 => 0.4055, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.78% (2.2022 => 2.5057, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.64% (7.0540 => 8.0161, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/for-in: 13.51% (0.3694 => 0.4193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.06% (0.3927 => 0.4440, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 12.84% (0.3886 => 0.4385, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.15% (1.1194 => 1.2554, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.73% (1.7609 => 1.9499, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.59% (0.3282 => 0.3564, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (9.4845 => 10.1714, std. dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 7.12% (10.4361 => 11.1791, std. dev.: 0.0093) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.10% (0.8172 => 0.8752, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.99% (0.3307 => 0.3538, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.4879 => 0.5218, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.88% (0.7326 => 0.7830, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7433 => 0.7935, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.74% (8.1363 => 8.6850, std. dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.72% (0.3423 => 0.3653, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.50% (0.5860 => 0.6241, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.47% (0.7115 => 0.7575, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 6.34% (0.7835 => 0.8332, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (4.2646 => 4.5351, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.6675 => 0.7096, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (1.5415 => 1.6369, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (1.3050 => 1.3852, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.13% (0.5105 => 0.5418, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.12% (3.3354 => 3.5396, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.10% (0.3817 => 0.4050, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.05% (0.5569 => 0.5906, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (5.0018 => 5.3043, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.03% (4.9449 => 5.2430, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 5.97% (0.3180 => 0.3370, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.92% (5.7591 => 6.0999, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.74% (0.8067 => 0.8530, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.59% (0.9765 => 1.0311, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 5.56% (1.5603 => 1.6470, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4299 => 0.4529, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.33% (1.1642 => 1.2263, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3441 => 0.3624, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1861 => 1.2481, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 5.11% (3.8723 => 4.0702, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.09% (0.4636 => 0.4872, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.02% (0.6456 => 0.6780, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.00% (0.3422 => 0.3593, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.4103 => 0.4305, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.5020 => 0.5267, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.4064 => 0.4263, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.89% (1.0722 => 1.1246, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.76% (0.3865 => 0.4049, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (7.9617 => 8.3351, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.68% (0.6450 => 0.6752, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.66% (0.3650 => 0.3820, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.62% (2.0273 => 2.1209, std. dev.: 0.0133) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.50% (0.4289 => 0.4482, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.40% (0.2725 => 0.2845, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.40% (2.2969 => 2.3979, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9371 => 22.8891, std. dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.34% (0.3826 => 0.3992, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.34% (0.3136 => 0.3272, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4203 => 0.4385, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.33% (0.3098 => 0.3232, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3162 => 0.3298, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.30% (0.5981 => 0.6238, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3684 => 0.3842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2871 => 0.2994, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.28% (2.0665 => 2.1549, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.2831 => 0.2952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.24% (0.4620 => 0.4816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.23% (0.8921 => 0.9298, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 4.20% (0.4048 => 0.4218, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.18% (0.2872 => 0.2992, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.16% (0.3052 => 0.3179, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3232 => 0.3366, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (14.3668 => 14.9590, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.07% (0.2877 => 0.2994, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.05% (0.3283 => 0.3416, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4760, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5859 => 1.6467, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.83% (0.2793 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.58% (2.2024 => 2.2812, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1840 => 1.2199, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.71% (1.2842 => 1.3190, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.8101 => 0.8297, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3804, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7498, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (4.2280 => 4.3539, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2238, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6816, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.60% (5.2763 => 3.2397, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.26% (5.3855 => 3.8637, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.85% (5.3526 => 3.8617, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1703, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.96% (2.9384 => 2.5871, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8599, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2534, std. dev.: 0.0793) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5024, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4319, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0041, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.33% (1.2373 => 1.2085, std. dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0017, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5089, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5785, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2280, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 09:25:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 11:25:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912162509.D48252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3720?compare_to=3713&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3720, Order: 163703, Start Time: 2012-09-12 13:42:55, End Time: 2012-09-12 16:26:26 To: 3713, Order: 163691, Start Time: 2012-09-12 10:30:49, End Time: 2012-09-12 13:14:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (126 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (767 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2142 => 0.2264, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.82% (2.0421 => 2.1201, std. dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.45% (54.0658 => 54.8521, std. dev.: 0.1026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.06% (0.3446 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.99% (0.3442 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.89% (0.3465 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3496 => 0.4011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.27% (0.3650 => 0.4171, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.25% (0.3643 => 0.4162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5826 => 0.6369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.05% (0.5889 => 0.6422, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.88% (1.6211 => 1.7489, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 7.43% (0.7171 => 0.7704, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (3.5627 => 3.8265, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 7.36% (1.5932 => 1.7105, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (1.3152 => 1.4068, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (0.4361 => 0.4658, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.57% (0.4994 => 0.5322, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (0.3930 => 0.4178, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (0.5000 => 0.5310, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2738 => 0.2907, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.5900 => 0.6258, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.03% (4.2109 => 4.4650, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (0.5026 => 0.5329, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.89% (0.3004 => 0.3181, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2875 => 0.3042, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.81% (1.0781 => 1.1407, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3195 => 0.3374, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.2823 => 0.2980, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.54% (2.7292 => 2.8805, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.51% (0.3792 => 0.4001, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2813 => 0.2968, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.45% (0.9909 => 1.0449, std. dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 5.44% (5.5417 => 5.8430, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2729 => 0.2877, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.41% (0.2792 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.40% (0.2780 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.38% (0.2750 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (2.0673 => 2.1779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.34% (0.2811 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2803 => 0.2952, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.26% (0.3096 => 0.3259, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.22% (0.2911 => 0.3063, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.20% (0.3267 => 0.3437, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.17% (0.2068 => 0.2175, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.16% (0.3258 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.14% (0.2566 => 0.2698, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.14% (0.3890 => 0.4090, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (2.1013 => 2.2087, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (0.3625 => 0.3810, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3060 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (1.9694 => 2.0695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (0.4658 => 0.4892, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (1.9966 => 2.0966, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: 5.00% (0.3317 => 0.3483, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3362 => 0.3530, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.99% (0.3124 => 0.3280, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3477 => 0.3649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.3348 => 0.3513, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3678 => 0.3858, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.83% (0.3726 => 0.3906, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.3903 => 0.4091, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.75% (1.8794 => 1.9686, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 4.68% (23.5202 => 24.6207, std. dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 4.63% (4.6177 => 4.8313, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.61% (2.1653 => 2.2651, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.4146 => 0.4336, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3690 => 0.3856, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.4139 => 0.4323, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.42% (1.4269 => 1.4900, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (4.4195 => 4.6143, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.3845 => 0.4013, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.35% (0.3084 => 0.3218, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.32% (0.9697 => 1.0116, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.31% (0.2737 => 0.2855, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.27% (0.3981 => 0.4151, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.24% (0.6634 => 0.6915, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 4.22% (0.7875 => 0.8207, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.05% (0.5012 => 0.5215, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.02% (0.3336 => 0.3470, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.84% (0.6435 => 0.6682, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.2969 => 0.3080, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.01% (2.0346 => 2.0959, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (0.4847 => 0.4990, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (0.5361 => 0.5489, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.17% (0.7426 => 0.7587, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.83% (11.6398 => 11.8524, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.52% (4.6926 => 4.7641, std. dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: 1.07% (2.4764 => 2.5029, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8980, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std. dev.: 0.0463) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6315, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1932, std. dev.: 0.0093) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5014, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.83% (2.0820 => 2.1201, std. dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4518, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2834, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5888, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4381, std. dev.: 0.0734) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5645, std. dev.: 0.0186) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7889, std. dev.: 0.0171) MultiSource/Benchmarks/Olden/tsp/tsp: -6.92% (2.1113 => 1.9651, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8059, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0066) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.94% (17.2379 => 16.7312, std. dev.: 0.0768) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9671, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 09:52:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 11:52:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912165222.B8A422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3721?compare_to=3717&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3721, Order: 163714, Start Time: 2012-09-12 15:42:45, End Time: 2012-09-12 16:53:41 To: 3717, Order: 163705, Start Time: 2012-09-12 14:14:53, End Time: 2012-09-12 15:26:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (39 on baseline) Performance Improvements: 17 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 870 (818 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.68% (0.1901 => 0.2028, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 4.44% (0.4008 => 0.4186, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (1.4004 => 1.4279, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.77% (3.6162 => 3.6802, std. dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1020 => 1.1172, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.45% (4.8410 => 4.7708, std. dev.: 0.0162) MultiSource/Applications/SIBsim4/SIBsim4: -1.31% (1.2221 => 1.2061, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -1.22% (6.5799 => 6.4993, std. dev.: 0.0234) MultiSource/Applications/siod/siod: -1.08% (2.1450 => 2.1219, std. dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: -1.05% (14.8750 => 14.7191, std. dev.: 0.0547) MultiSource/Applications/d/make_dparser: -1.02% (3.1050 => 3.0732, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/misr: -14.21% (0.4871 => 0.4179, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.61% (60.5425 => 56.5410, std. dev.: 0.1874) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.9900 => 0.9379, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: -2.76% (8.6045 => 8.3672, std. dev.: 0.0620) MultiSource/Applications/lua/lua: -2.75% (30.0556 => 29.2305, std. dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.24% (2.3454 => 2.2929, std. dev.: 0.0157) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.0377 => 6.9150, std. dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: -1.66% (2.0231 => 1.9895, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (8.8670 => 8.7239, std. dev.: 0.0290) SingleSource/Benchmarks/Misc/ffbench: -1.22% (1.3748 => 1.3580, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -1.17% (6.7232 => 6.6443, std. dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.96% (0.6410 => 0.6728, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3582 => 0.3720, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: 3.53% (0.6173 => 0.6391, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.50% (1.1653 => 1.2061, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 3.18% (1.0046 => 1.0365, std. dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: 3.06% (2.1763 => 2.2430, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.75% (0.4248 => 0.4365, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5150 => 1.5551, std. dev.: 0.0085) MultiSource/Applications/d/make_dparser: 1.68% (3.0225 => 3.0732, std. dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 1.19% (13.3238 => 13.4818, std. dev.: 0.0418) MultiSource/Applications/siod/siod: 1.18% (2.0972 => 2.1219, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0166) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.0766 => 0.0903, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0497) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.49% (4.0101 => 4.5510, std. dev.: 0.0165) MultiSource/Applications/sgefa/sgefa: 13.05% (0.3746 => 0.4235, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8790, std. dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 11.72% (0.1433 => 0.1601, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.74% (7.0025 => 7.6145, std. dev.: 0.0547) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.88% (1.0063 => 1.0856, std. dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 6.99% (1.0194 => 1.0907, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.62% (0.2857 => 0.3046, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8097, std. dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.81% (40.4792 => 42.8318, std. dev.: 0.3162) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (0.3301 => 0.3475, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: 4.27% (0.9851 => 1.0272, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8125, std. dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.67% (3.4080 => 3.5332, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.02% (0.3508 => 0.3614, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.57% (0.5876 => 0.6027, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7239, std. dev.: 0.0290) MultiSource/Benchmarks/BitBench/five11/five11: 2.05% (5.1938 => 5.3003, std. dev.: 0.0376) MultiSource/Applications/siod/siod: 1.53% (3.5520 => 3.6063, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (2.4455 => 2.4794, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6737, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.99% (5.2665 => 4.1613, std. dev.: 0.0962) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.47% (1.1647 => 0.9379, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1576, std. dev.: 0.0164) MultiSource/Benchmarks/mafft/pairlocalalign: -9.41% (62.4126 => 56.5410, std. dev.: 0.1874) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.80% (3.2007 => 2.9511, std. dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3654, std. dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: -6.99% (3.4230 => 3.1836, std. dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.25% (2.4457 => 2.2929, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/richards_benchmark: -6.24% (1.4441 => 1.3540, std. dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.39% (0.4140 => 0.3917, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std. dev.: 0.0381) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.38% (0.4564 => 0.4364, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.34% (3.9413 => 3.7702, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.18% (45.4683 => 43.5682, std. dev.: 0.5830) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.16% (1.7361 => 1.6638, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/ffbench: -3.80% (1.4117 => 1.3580, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.51% (1.1683 => 1.1273, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -3.24% (9.2503 => 8.9505, std. dev.: 0.0615) MultiSource/Benchmarks/PAQ8p/paq8p: -2.85% (92.7467 => 90.1044, std. dev.: 0.2418) SingleSource/Benchmarks/McGill/misr: -2.72% (0.4296 => 0.4179, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2880, std. dev.: 0.0094) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.68% (1.2722 => 1.2381, std. dev.: 0.0090) MultiSource/Applications/aha/aha: -2.62% (3.4286 => 3.3388, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/neural/neural: -1.98% (1.0926 => 1.0710, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: -1.93% (8.5323 => 8.3672, std. dev.: 0.0620) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.85% (3.7496 => 3.6802, std. dev.: 0.0214) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (9.3855 => 9.2173, std. dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: -1.50% (6.7458 => 6.6443, std. dev.: 0.0106) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8322, std. dev.: 0.0169) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3084, std. dev.: 0.0643) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 10:23:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 12:23:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912172334.1982F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3722?compare_to=3718&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3722, Order: 163715, Start Time: 2012-09-12 16:10:02, End Time: 2012-09-12 17:24:49 To: 3718, Order: 163705, Start Time: 2012-09-12 14:27:41, End Time: 2012-09-12 15:41:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (54.8066 => 56.3542, std. dev.: 0.1173) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.10% (2.0176 => 2.4029, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.71% (0.5818 => 0.6499, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.55% (0.5748 => 0.6412, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3578 => 0.3983, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.05% (0.7061 => 0.7841, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.97% (0.3663 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.97% (0.3601 => 0.3996, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.96% (0.3650 => 0.4050, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.94% (0.3646 => 0.4045, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.93% (0.3623 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.86% (0.3914 => 0.4339, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.85% (0.3789 => 0.4200, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.76% (0.3940 => 0.4364, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.4003 => 0.4432, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.51% (0.7710 => 0.8520, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.97% (3.9660 => 4.3615, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.69% (1.3693 => 1.5020, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.67% (0.2596 => 0.2847, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.43% (0.7038 => 0.7702, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/hash2: 9.38% (0.4328 => 0.4734, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.34% (0.5265 => 0.5757, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2781 => 0.3030, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.95% (0.6959 => 0.7582, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.91% (1.2193 => 1.3279, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.88% (0.9199 => 1.0016, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.72% (0.3899 => 0.4239, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.64% (1.4563 => 1.5821, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.63% (0.2782 => 0.3022, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.54% (0.4062 => 0.4409, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.34% (0.3022 => 0.3274, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.30% (1.1364 => 1.2307, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.2966 => 0.3211, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 8.25% (13.8202 => 14.9608, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.24% (0.6283 => 0.6801, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.23% (0.5577 => 0.6036, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.20% (0.3489 => 0.3775, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.17% (0.3756 => 0.4063, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.13% (0.3580 => 0.3871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2690 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.10% (0.2655 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.2607 => 0.2818, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.09% (0.3485 => 0.3767, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.08% (0.3293 => 0.3559, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.07% (0.2726 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2628 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.04% (0.2760 => 0.2982, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.04% (0.2937 => 0.3173, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.03% (1.9828 => 2.1420, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 8.00% (0.2761 => 0.2982, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.93% (0.7506 => 0.8101, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.88% (0.4379 => 0.4724, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.87% (0.4016 => 0.4332, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.85% (7.2180 => 7.7848, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.73% (0.2925 => 0.3151, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.72% (0.3107 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.72% (0.3149 => 0.3392, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.68% (0.2696 => 0.2903, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.62% (0.4791 => 0.5156, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 7.59% (1.0313 => 1.1096, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 7.57% (0.3868 => 0.4161, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.50% (0.2988 => 0.3212, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3192 => 0.3431, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3453 => 0.3710, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.34% (1.1061 => 1.1873, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 7.32% (3.8646 => 4.1473, std. dev.: 0.0064) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.24% (0.3534 => 0.3790, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.15% (0.4390 => 0.4704, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 7.14% (0.3220 => 0.3450, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.04% (3.6692 => 3.9274, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 7.00% (0.8310 => 0.8892, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.87% (0.2140 => 0.2287, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 6.81% (2.1791 => 2.3274, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.76% (0.2945 => 0.3144, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.65% (1.9270 => 2.0552, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.59% (1.3245 => 1.4118, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.52% (3.1889 => 3.3967, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: 6.51% (0.6744 => 0.7183, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.46% (16.6129 => 17.6864, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.43% (0.6576 => 0.6999, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.30% (0.8698 => 0.9246, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.22% (4.4433 => 4.7195, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.21% (0.3755 => 0.3988, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.18% (4.3801 => 4.6508, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4658, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.6135 => 0.6506, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 6.02% (1.0594 => 1.1232, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.95% (1.3819 => 1.4641, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (1.2749 => 1.3490, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.3245 => 0.3430, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.67% (14.8535 => 15.6953, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1333 => 1.1975, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.62% (13.2842 => 14.0311, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 5.61% (8.4961 => 8.9725, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2321 => 0.2451, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.32% (14.5298 => 15.3022, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2292 => 1.2943, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.16% (0.8818 => 0.9273, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (6.5754 => 6.9039, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 4.69% (0.6250 => 0.6543, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.4805 => 0.5025, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.55% (3.2742 => 3.4232, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.47% (4.9865 => 5.2096, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 4.42% (4.6629 => 4.8691, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.15% (0.9108 => 0.9486, std. dev.: 0.0130) MultiSource/Applications/lua/lua: 4.10% (3.7467 => 3.9003, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.06% (1.5188 => 1.5804, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (2.1007 => 2.1797, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.64% (6.2785 => 6.5073, std. dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: 3.39% (33.2944 => 34.4232, std. dev.: 0.0164) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4946, std. dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 26.35% (1.8175 => 2.2964, std. dev.: 0.0327) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0942, std. dev.: 0.0441) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6039, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.21% (7.9275 => 8.0237, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5896, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.86% (0.4657 => 0.4058, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.50% (22.5627 => 21.7731, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2759, std. dev.: 0.0111) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3049, std. dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5099, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.61% (1.7688 => 1.7050, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9220, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8968, std. dev.: 0.0573) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2393, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0588, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2514, std. dev.: 0.0196) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2604, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2417, std. dev.: 0.0118) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4359, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 11:19:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 13:19:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912181958.0DD242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3723?compare_to=3721&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3723, Order: 163715, Start Time: 2012-09-12 17:09:13, End Time: 2012-09-12 18:21:16 To: 3721, Order: 163714, Start Time: 2012-09-12 15:42:45, End Time: 2012-09-12 16:53:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 9 (10 on baseline) Performance Regressions: 20 (50 on baseline) Performance Improvements: 4 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 868 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.73% (0.0750 => 0.0898, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 5.77% (0.5405 => 0.5717, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.89% (0.4360 => 0.4573, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.2553 => 0.2662, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.6912 => 0.7195, std. dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 2.69% (15.4280 => 15.8437, std. dev.: 0.1138) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1610 => 1.1861, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.66% (29.5744 => 30.0650, std. dev.: 0.1517) MultiSource/Applications/d/make_dparser: 1.45% (3.0732 => 3.1177, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.39% (1.3983 => 1.4178, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.0716 => 1.0851, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 14.77% (3.0397 => 3.4888, std. dev.: 0.1510) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (2.3930 => 2.6063, std. dev.: 0.0489) SingleSource/Benchmarks/Misc/mandel-2: 2.75% (3.0417 => 3.1252, std. dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/hash: 1.95% (0.6366 => 0.6490, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.73% (6.9150 => 7.0344, std. dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.55% (3.7702 => 3.8287, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.39% (4.6611 => 4.7260, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/ReedSolomon: 1.34% (8.7239 => 8.8411, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.22% (1.1273 => 1.1411, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -18.91% (1.7369 => 1.4084, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/sieve: -11.06% (3.8790 => 3.4498, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: -2.87% (3.5205 => 3.4196, std. dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: -2.42% (7.6354 => 7.4509, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.54% (0.0745 => 0.0898, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.69% (0.5309 => 0.5717, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 5.37% (2.1763 => 2.2932, std. dev.: 0.0204) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.6410 => 0.6743, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.31% (0.2552 => 0.2662, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 4.31% (1.1653 => 1.2155, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.6915 => 0.7195, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.02% (0.3582 => 0.3726, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.87% (0.6173 => 0.6412, std. dev.: 0.0067) MultiSource/Applications/lemon/lemon: 3.79% (1.0046 => 1.0427, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 3.48% (15.3105 => 15.8437, std. dev.: 0.1138) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3217 => 0.3319, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 3.15% (3.0225 => 3.1177, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.75% (2.0972 => 2.1549, std. dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 2.55% (29.3170 => 30.0650, std. dev.: 0.1517) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5150 => 1.5505, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.7639 => 0.7809, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.0689 => 1.0851, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 1.40% (13.3238 => 13.5105, std. dev.: 0.0604) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.15% (12.6413 => 12.7871, std. dev.: 0.0361) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.56% (1.6538 => 2.3411, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2291, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.31% (3.0256 => 3.4888, std. dev.: 0.1510) SingleSource/Benchmarks/Shootout/ary3: 14.79% (1.7426 => 2.0004, std. dev.: 0.0407) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3746 => 0.4277, std. dev.: 0.0077) SingleSource/Benchmarks/Stanford/Puzzle: 14.10% (0.1433 => 0.1635, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.30% (4.0101 => 4.5436, std. dev.: 0.0629) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.67% (0.0917 => 0.1024, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6151, std. dev.: 0.0205) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.31% (0.2694 => 0.2918, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.70% (0.2857 => 0.3077, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8166, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/fp-convert: 4.23% (15.2242 => 15.8687, std. dev.: 0.0596) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 3.87% (8.5113 => 8.8411, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.6308 => 0.6490, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.46% (4.6127 => 4.7260, std. dev.: 0.0169) MultiSource/Benchmarks/BitBench/five11/five11: 2.39% (5.1938 => 5.3178, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.33% (2.6656 => 2.7278, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 2.10% (3.5520 => 3.6267, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.84% (14.4877 => 14.7545, std. dev.: 0.0244) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4455 => 2.4846, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5328, std. dev.: 0.0115) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.25% (4.0659 => 4.1169, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.5166 => 2.5451, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.40% (5.2665 => 4.0867, std. dev.: 0.0594) SingleSource/Benchmarks/Shootout-C++/ary3: -19.40% (1.7473 => 1.4084, std. dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.40% (1.1647 => 0.9388, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5449, std. dev.: 0.1052) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.16% (3.2007 => 2.9716, std. dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.99% (3.6254 => 3.3720, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: -6.62% (1.4117 => 1.3182, std. dev.: 0.0327) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.59% (2.4457 => 2.2845, std. dev.: 0.0265) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: -6.36% (3.4230 => 3.2054, std. dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: -5.14% (4.6355 => 4.3971, std. dev.: 0.0421) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.10% (0.4140 => 0.3929, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: -4.47% (0.4296 => 0.4104, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.50% (1.7361 => 1.6754, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.21% (1.2722 => 1.2314, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -3.19% (9.2503 => 8.9551, std. dev.: 0.0405) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (7.6833 => 7.4509, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2893, std. dev.: 0.0220) MultiSource/Applications/aha/aha: -2.65% (3.4286 => 3.3376, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.59% (2.8964 => 2.8214, std. dev.: 0.0255) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.35% (1.2959 => 1.2654, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.33% (1.1683 => 1.1411, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.18% (3.7496 => 3.6679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std. dev.: 0.0112) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9827, std. dev.: 0.3583) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.72% (1.0686 => 1.0502, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -1.66% (3.8907 => 3.8260, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (9.3855 => 9.2406, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.3569 => 2.3227, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std. dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std. dev.: 0.0895) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.36% (1.8739 => 1.8484, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6644, std. dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 12:37:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 14:37:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912193709.E95A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3724?compare_to=3720&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3724, Order: 163715, Start Time: 2012-09-12 16:54:46, End Time: 2012-09-12 19:38:27 To: 3720, Order: 163703, Start Time: 2012-09-12 13:42:55, End Time: 2012-09-12 16:26:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 14.54% (0.3460 => 0.3963, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.46% (0.3465 => 0.3966, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.45% (0.3488 => 0.3992, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 14.44% (0.3469 => 0.3970, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.41% (0.3442 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.86% (0.3650 => 0.4156, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.83% (0.3643 => 0.4147, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5826 => 0.6322, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.34% (0.5889 => 0.6380, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.03% (0.1619 => 0.1749, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (3.5627 => 3.8223, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.15% (1.6211 => 1.7370, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.80% (0.5026 => 0.5368, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.74% (0.7171 => 0.7654, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 6.56% (1.5932 => 1.6977, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.53% (1.3152 => 1.4011, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.47% (0.4361 => 0.4643, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (0.4994 => 0.5295, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2813 => 0.2982, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.3004 => 0.3184, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.5900 => 0.6253, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.92% (0.2823 => 0.2990, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.85% (4.2109 => 4.4572, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.84% (0.2875 => 0.3043, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.82% (0.5000 => 0.5291, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2738 => 0.2896, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.66% (0.4029 => 0.4257, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.62% (0.2792 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.58% (1.0781 => 1.1383, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.49% (0.2803 => 0.2957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.2780 => 0.2932, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2714 => 0.2862, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.44% (0.9909 => 1.0448, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (2.0673 => 2.1793, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.39% (0.2729 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.38% (0.2750 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.2866 => 0.3020, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.37% (0.2811 => 0.2962, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.29% (2.7292 => 2.8737, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3060 => 0.3221, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 5.20% (0.3096 => 0.3257, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2911 => 0.3060, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.09% (0.3317 => 0.3486, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.02% (5.5417 => 5.8198, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.01% (0.3792 => 0.3982, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3267 => 0.3430, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.95% (1.9694 => 2.0669, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 4.94% (0.3258 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3477 => 0.3648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.90% (0.3348 => 0.3512, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.90% (0.3124 => 0.3277, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.88% (0.3362 => 0.3526, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.80% (0.3726 => 0.3905, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (0.4658 => 0.4881, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3678 => 0.3852, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.3625 => 0.3796, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.68% (2.1013 => 2.1996, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.3903 => 0.4085, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.66% (0.3282 => 0.3435, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.66% (0.9697 => 1.0149, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.64% (1.9966 => 2.0893, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (1.8794 => 1.9651, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.50% (23.5202 => 24.5789, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash2: 4.47% (0.4251 => 0.4441, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.4139 => 0.4322, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (4.4195 => 4.6142, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3690 => 0.3852, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.3845 => 0.4013, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.32% (0.3981 => 0.4153, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.27% (4.6177 => 4.8149, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.24% (2.1653 => 2.2572, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.15% (0.5546 => 0.5776, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.2969 => 0.3091, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.06% (0.7875 => 0.8195, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 4.02% (1.4269 => 1.4842, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.3271 => 0.3398, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 3.87% (0.6634 => 0.6891, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.80% (0.2737 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.70% (0.3084 => 0.3198, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.5012 => 0.5195, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.56% (0.6435 => 0.6664, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.68% (2.0346 => 2.0892, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (0.4847 => 0.4967, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (0.7426 => 0.7541, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (11.6398 => 11.7653, std. dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (4.6926 => 4.7413, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.68% (0.2122 => 0.2285, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6658, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std. dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6432, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2064, std. dev.: 0.0064) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5024, std. dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std. dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4359, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5933, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5778, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -9.49% (0.2402 => 0.2174, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7859, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8023, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0062) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.41% (17.2379 => 16.8227, std. dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9735, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 12:46:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 14:46:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912194659.C7B812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3725?compare_to=3723&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3725, Order: 163726, Start Time: 2012-09-12 18:36:56, End Time: 2012-09-12 19:48:18 To: 3723, Order: 163715, Start Time: 2012-09-12 17:09:13, End Time: 2012-09-12 18:21:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (64 on baseline) Performance Improvements: 3 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 889 (787 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.90% (0.5589 => 0.5695, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (6.4978 => 6.5941, std. dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (1.3984 => 1.4140, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 11.96% (3.0121 => 3.3724, std. dev.: 0.1230) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.66% (0.7733 => 0.8016, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (0.3362 => 0.3477, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.94% (2.3535 => 2.3991, std. dev.: 0.0110) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (2.0008 => 2.0319, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/hash: 1.32% (4.3108 => 4.3678, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: -4.23% (0.2600 => 0.2490, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: -1.55% (8.5200 => 8.3878, std. dev.: 0.0376) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.36% (43.3031 => 42.7158, std. dev.: 0.2065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.84% (0.0745 => 0.0863, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.46% (0.5309 => 0.5652, std. dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 6.18% (2.1763 => 2.3107, std. dev.: 0.0214) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.05% (0.6410 => 0.6798, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.2552 => 0.2699, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 5.39% (1.1653 => 1.2281, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.83% (0.3582 => 0.3755, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 4.43% (1.0046 => 1.0491, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 4.31% (0.6915 => 0.7213, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 4.19% (15.3105 => 15.9525, std. dev.: 0.0937) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.3901 => 0.4063, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.79% (0.3062 => 0.3178, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3217 => 0.3329, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 3.42% (0.6173 => 0.6384, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.3847 => 0.3976, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.12% (1.3268 => 1.3682, std. dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 2.48% (29.3170 => 30.0450, std. dev.: 0.0662) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (0.6069 => 0.6203, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.02% (13.3238 => 13.5923, std. dev.: 0.0897) MultiSource/Benchmarks/Prolangs-C/football/football: 1.59% (0.8405 => 0.8539, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.59% (6.4908 => 6.5941, std. dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.47% (1.3935 => 1.4140, std. dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 1.38% (14.6079 => 14.8100, std. dev.: 0.0767) MultiSource/Applications/oggenc/oggenc: 1.29% (4.7455 => 4.8069, std. dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.06% (4.2616 => 4.3066, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3397, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 22.17% (3.4629 => 4.2305, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout/ary3: 15.47% (1.7426 => 2.0122, std. dev.: 0.0354) MultiSource/Benchmarks/nbench/nbench: 14.53% (21.1721 => 24.2479, std. dev.: 1.0083) MultiSource/Applications/sgefa/sgefa: 14.50% (0.3746 => 0.4289, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.18% (0.0917 => 0.1047, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.25% (4.0101 => 4.5415, std. dev.: 0.0776) SingleSource/Benchmarks/Stanford/Puzzle: 12.98% (0.1433 => 0.1619, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 8.95% (7.0025 => 7.6292, std. dev.: 0.0232) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.19% (0.2857 => 0.3091, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 8.10% (1.0194 => 1.1020, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.93% (1.0063 => 1.0760, std. dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8118, std. dev.: 0.1757) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.53% (40.4792 => 42.7158, std. dev.: 0.2065) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.35% (0.7609 => 0.8016, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (0.3301 => 0.3477, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8525, std. dev.: 0.0414) SingleSource/Benchmarks/Misc/dt: 3.91% (0.9851 => 1.0236, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.62% (3.4080 => 3.5314, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.47% (0.5587 => 0.5781, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 3.28% (1.4184 => 1.4649, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.85% (0.3508 => 0.3608, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.77% (2.6656 => 2.7394, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.72% (0.5876 => 0.6036, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 2.56% (8.5113 => 8.7291, std. dev.: 0.0545) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.45% (4.6127 => 4.7255, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/whetstone: 2.29% (2.3453 => 2.3991, std. dev.: 0.0110) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2999, std. dev.: 0.0234) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.5166 => 2.5590, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.67% (2.4971 => 2.5389, std. dev.: 0.0133) MultiSource/Applications/siod/siod: 1.65% (3.5520 => 3.6107, std. dev.: 0.0219) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4845, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.59% (14.4877 => 14.7176, std. dev.: 0.0412) SingleSource/Benchmarks/Shootout/hash: 1.54% (4.3016 => 4.3678, std. dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.43% (22.3381 => 22.6571, std. dev.: 0.0994) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.32% (2.9152 => 2.9537, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.68% (0.7738 => 0.7531, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.32% (0.9029 => 0.8910, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.44% (0.3497 => 0.2048, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.38% (1.1647 => 0.9390, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary3: -18.94% (1.7473 => 1.4164, std. dev.: 0.0431) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.45% (5.2665 => 4.2946, std. dev.: 0.0817) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5255, std. dev.: 0.0496) SingleSource/Benchmarks/BenchmarkGame/recursive: -9.01% (2.4457 => 2.2254, std. dev.: 0.0326) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.28% (3.2007 => 2.9357, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.07% (3.6254 => 3.3691, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/distray/distray: -6.53% (0.2664 => 0.2490, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -6.02% (3.4230 => 3.2168, std. dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -5.89% (1.4441 => 1.3591, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: -4.72% (1.4117 => 1.3450, std. dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/fibo: -4.57% (4.6355 => 4.4236, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.41% (0.4140 => 0.3999, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9454, std. dev.: 0.0315) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.13% (1.7361 => 1.6817, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -3.06% (7.6833 => 7.4483, std. dev.: 0.0285) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.03% (1.2722 => 1.2337, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.79% (1.1683 => 1.1357, std. dev.: 0.0061) MultiSource/Applications/aha/aha: -2.71% (3.4286 => 3.3357, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2920, std. dev.: 0.0086) SingleSource/Benchmarks/McGill/misr: -2.61% (0.4296 => 0.4184, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.92% (92.7467 => 90.9666, std. dev.: 0.6501) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4229, std. dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: -1.69% (8.5323 => 8.3878, std. dev.: 0.0376) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2331, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.62% (2.8964 => 2.8494, std. dev.: 0.0075) MultiSource/Benchmarks/sim/sim: -1.62% (3.8907 => 3.8276, std. dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3197, std. dev.: 0.0373) SingleSource/Benchmarks/Misc/oourafft: -1.26% (3.8200 => 3.7718, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 13:53:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 15:53:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912205340.1EA4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3726?compare_to=3722&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3726, Order: 163734, Start Time: 2012-09-12 19:40:24, End Time: 2012-09-12 20:54:57 To: 3722, Order: 163715, Start Time: 2012-09-12 16:10:02, End Time: 2012-09-12 17:24:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.22% (2.0176 => 2.4255, std. dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.10% (0.1410 => 0.1637, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.91% (0.5818 => 0.6511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.73% (0.5748 => 0.6422, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.39% (0.1413 => 0.1574, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3578 => 0.3982, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.19% (0.3601 => 0.4004, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3650 => 0.4056, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.11% (0.3646 => 0.4051, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.08% (0.7710 => 0.8564, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3623 => 0.4023, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3663 => 0.4064, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.91% (0.3914 => 0.4341, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.90% (0.3789 => 0.4202, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.4003 => 0.4434, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.58% (0.3940 => 0.4357, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.50% (3.9660 => 4.3826, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.05% (1.3693 => 1.5069, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.84% (0.5265 => 0.5783, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 9.65% (0.7038 => 0.7717, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.40% (1.2193 => 1.3339, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.38% (0.6959 => 0.7612, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.35% (0.9199 => 1.0059, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.19% (0.2721 => 0.2971, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.19% (1.4563 => 1.5901, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 9.15% (0.4328 => 0.4724, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.91% (1.1364 => 1.2377, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 8.83% (13.8202 => 15.0403, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.50% (0.5577 => 0.6051, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.49% (0.3899 => 0.4230, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.44% (7.2180 => 7.8274, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 8.34% (0.7506 => 0.8132, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 8.32% (0.4062 => 0.4400, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.29% (0.4379 => 0.4742, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.28% (0.6283 => 0.6803, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 8.22% (1.0313 => 1.1161, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.20% (0.2914 => 0.3153, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2782 => 0.3009, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.11% (0.3022 => 0.3267, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.07% (0.2925 => 0.3161, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 7.94% (0.2243 => 0.2421, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.90% (0.3293 => 0.3553, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.85% (0.3580 => 0.3861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3485 => 0.3758, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.83% (0.3756 => 0.4050, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.83% (0.2607 => 0.2811, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.82% (1.1061 => 1.1926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2655 => 0.2862, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.80% (0.3489 => 0.3761, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.79% (0.4791 => 0.5164, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.77% (0.4390 => 0.4731, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.72% (0.2628 => 0.2831, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 7.70% (3.8646 => 4.1620, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2726 => 0.2935, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.66% (3.6692 => 3.9503, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 7.66% (0.2937 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.64% (1.9828 => 2.1342, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.63% (0.2765 => 0.2976, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.63% (0.5637 => 0.6067, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.2966 => 0.3192, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.61% (0.3220 => 0.3465, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.57% (0.2761 => 0.2970, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.50% (0.4016 => 0.4317, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.44% (0.8310 => 0.8928, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.42% (0.2696 => 0.2896, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.3107 => 0.3337, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3149 => 0.3380, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.2988 => 0.3205, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.24% (0.7460 => 0.8000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.3868 => 0.4147, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.19% (1.9270 => 2.0655, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: 7.18% (0.6744 => 0.7228, std. dev.: 0.0134) MultiSource/Applications/d/make_dparser: 7.17% (3.1889 => 3.4176, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 7.15% (2.1791 => 2.3350, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4190, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3192 => 0.3418, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.98% (0.3453 => 0.3694, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3534 => 0.3780, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.71% (1.0594 => 1.1305, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.70% (1.3813 => 1.4739, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.69% (0.4113 => 0.4388, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.67% (1.3819 => 1.4741, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 6.65% (0.2859 => 0.3049, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.64% (4.3801 => 4.6711, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.61% (4.4433 => 4.7369, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.59% (0.6135 => 0.6539, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.54% (16.6129 => 17.7000, std. dev.: 0.0184) MultiSource/Applications/SIBsim4/SIBsim4: 6.51% (1.2749 => 1.3579, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.50% (0.2140 => 0.2279, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 6.41% (14.8535 => 15.8050, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.35% (0.8698 => 0.9250, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.32% (8.4961 => 9.0327, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (1.1333 => 1.2039, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3755 => 0.3984, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.10% (13.2842 => 14.0941, std. dev.: 0.0220) MultiSource/Applications/ClamAV/clamscan: 6.00% (14.5298 => 15.4017, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 5.97% (0.3131 => 0.3318, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2504 => 0.2653, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.94% (0.8818 => 0.9342, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.66% (6.5754 => 6.9475, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.63% (0.6576 => 0.6946, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1819 => 0.1920, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 5.42% (4.6629 => 4.9154, std. dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 5.15% (1.2292 => 1.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.06% (3.2742 => 3.4399, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.93% (0.4805 => 0.5042, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.84% (4.9865 => 5.2280, std. dev.: 0.0266) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.74% (0.9108 => 0.9540, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 4.63% (3.7467 => 3.9201, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (1.5188 => 1.5867, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.45% (0.6250 => 0.6528, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (6.2785 => 6.5428, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (2.1007 => 2.1873, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 3.61% (33.2944 => 34.4970, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.11% (16.2614 => 16.6043, std. dev.: 0.0235) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2522, std. dev.: 0.0343) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6969, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5461, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0718, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6005, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5160, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5889, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.88% (0.4657 => 0.4057, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.27% (22.5627 => 21.8260, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2705, std. dev.: 0.0131) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.54% (1.3780 => 1.3017, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -3.34% (3.0263 => 2.9252, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5896, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -2.32% (26.5159 => 25.9000, std. dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2388, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0624, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2540, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 14:14:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 16:14:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912211404.0D6B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3727?compare_to=3725&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3727, Order: 163734, Start Time: 2012-09-12 20:04:23, End Time: 2012-09-12 21:15:23 To: 3725, Order: 163726, Start Time: 2012-09-12 18:36:56, End Time: 2012-09-12 19:48:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (50 on baseline) Performance Improvements: 4 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (1.3641 => 1.4087, std. dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: 3.08% (8.3878 => 8.6461, std. dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.23% (1.0760 => 1.1000, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.69% (1.2715 => 1.2930, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.04% (0.6011 => 0.5828, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: -1.17% (1.3682 => 1.3522, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.04% (1.4290 => 1.4141, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -4.11% (24.2479 => 23.2520, std. dev.: 0.2219) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 6.74% (2.1763 => 2.3229, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.32% (0.6410 => 0.6815, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.5309 => 0.5629, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.2552 => 0.2677, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 3.95% (0.6173 => 0.6417, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 3.64% (0.6915 => 0.7167, std. dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.1653 => 1.2069, std. dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 2.80% (29.3170 => 30.1387, std. dev.: 0.1867) MultiSource/Applications/d/make_dparser: 2.78% (3.0225 => 3.1066, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5150 => 1.5504, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.7639 => 0.7812, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 1.91% (1.3268 => 1.3522, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.19% (1.1672 => 1.1811, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.27% (0.0766 => 0.0883, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9990, std. dev.: 0.0277) MultiSource/Applications/sgefa/sgefa: 14.10% (0.3746 => 0.4274, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.13% (4.0101 => 4.5367, std. dev.: 0.0256) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std. dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 11.58% (0.1433 => 0.1599, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 9.82% (21.1721 => 23.2520, std. dev.: 0.2219) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.31% (1.0063 => 1.1000, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.91% (0.2694 => 0.2934, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.66% (7.0025 => 7.6088, std. dev.: 0.0312) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.27% (0.3301 => 0.3574, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.53% (0.2857 => 0.3072, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 6.97% (1.0194 => 1.0905, std. dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.49% (40.4792 => 43.1054, std. dev.: 0.2337) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (27.1724 => 28.8260, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.31% (0.8498 => 0.8949, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 4.47% (0.6308 => 0.6590, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8435, std. dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5377, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.57% (0.5876 => 0.6027, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7242, std. dev.: 0.0390) MultiSource/Benchmarks/BitBench/five11/five11: 2.17% (5.1938 => 5.3064, std. dev.: 0.0401) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.6127 => 4.7092, std. dev.: 0.0151) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7227, std. dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.60% (1.2726 => 1.2930, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 1.54% (3.5520 => 3.6068, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: 1.44% (2.5166 => 2.5529, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5311, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.33% (8.5323 => 8.6461, std. dev.: 0.0286) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -4.14% (0.7738 => 0.7418, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.66% (0.3497 => 0.2075, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.70% (5.2665 => 4.0708, std. dev.: 0.2592) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.30% (1.1647 => 0.9399, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std. dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5319, std. dev.: 0.0883) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.44% (2.4457 => 2.2392, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.89% (3.2007 => 2.9483, std. dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3657, std. dev.: 0.0083) MultiSource/Applications/SIBsim4/SIBsim4: -6.57% (3.4230 => 3.1980, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3513, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -5.17% (1.7361 => 1.6463, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.35% (0.4140 => 0.3960, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: -4.33% (1.4117 => 1.3506, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (9.2503 => 8.9105, std. dev.: 0.0529) SingleSource/Benchmarks/McGill/misr: -3.65% (0.4296 => 0.4139, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.44% (1.2722 => 1.2284, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.04% (1.1683 => 1.1328, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.90% (3.7496 => 3.6407, std. dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: -2.88% (7.6833 => 7.4623, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std. dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.56% (45.4683 => 44.3042, std. dev.: 0.3941) MultiSource/Applications/aha/aha: -2.50% (3.4286 => 3.3428, std. dev.: 0.0144) MultiSource/Benchmarks/sim/sim: -1.90% (3.8907 => 3.8168, std. dev.: 0.0244) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (9.3855 => 9.2100, std. dev.: 0.0279) MultiSource/Benchmarks/PAQ8p/paq8p: -1.85% (92.7467 => 91.0277, std. dev.: 0.3021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.49% (1.8739 => 1.8459, std. dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: -1.41% (6.7458 => 6.6505, std. dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std. dev.: 0.0210) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 14:32:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 16:32:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912213237.3117C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3728?compare_to=3719&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3728, Order: 163734, Start Time: 2012-09-12 20:14:17, End Time: 2012-09-12 21:33:54 To: 3719, Order: 163705, Start Time: 2012-09-12 14:39:58, End Time: 2012-09-12 15:59:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.14% (1.2872 => 1.3148, std. dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.03% (10.3673 => 14.6208, std. dev.: 0.0647) SingleSource/Benchmarks/Misc/richards_benchmark: 27.00% (0.1622 => 0.2060, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.23% (0.3473 => 0.4002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.87% (0.3497 => 0.4017, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3543 => 0.4067, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-4: 14.76% (0.3543 => 0.4066, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.62% (0.3516 => 0.4030, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.52% (0.3561 => 0.4078, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 14.10% (0.3694 => 0.4215, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.87% (0.3828 => 0.4359, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.83% (0.3927 => 0.4470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.61% (0.3886 => 0.4415, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.36% (2.2022 => 2.4964, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.12% (7.0540 => 7.9796, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 12.29% (0.1432 => 0.1608, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2549, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.51% (1.7609 => 1.9460, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5925 => 0.6442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.44% (0.3282 => 0.3559, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.26% (0.1440 => 0.1559, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7326 => 0.7865, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.8172 => 0.8772, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.04% (0.4615 => 0.4940, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.96% (9.4845 => 10.1444, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.85% (0.2554 => 0.2729, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7433 => 0.7939, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.77% (0.3307 => 0.3531, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.73% (0.3817 => 0.4074, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.71% (8.1363 => 8.6822, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.68% (0.7835 => 0.8358, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.2700 => 0.2880, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.66% (0.3423 => 0.3651, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.66% (0.5860 => 0.6250, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.55% (0.2107 => 0.2245, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 6.50% (0.3092 => 0.3293, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (4.2646 => 4.5353, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.29% (1.5415 => 1.6385, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5569 => 0.5918, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 6.25% (10.4361 => 11.0882, std. dev.: 0.0110) MultiSource/Applications/d/make_dparser: 6.22% (3.3354 => 3.5427, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.13% (0.2758 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.10% (0.8067 => 0.8559, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.10% (0.6675 => 0.7082, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.08% (0.3109 => 0.3298, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.03% (1.3050 => 1.3837, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.90% (5.0018 => 5.2968, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.9449 => 5.2356, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 5.81% (5.7591 => 6.0937, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 5.77% (0.4299 => 0.4547, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 5.75% (0.3180 => 0.3363, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.5105 => 0.5395, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.60% (0.9765 => 1.0312, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 5.49% (1.1642 => 1.2281, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.25% (1.1861 => 1.2484, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 5.21% (1.5603 => 1.6416, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 5.04% (3.8723 => 4.0674, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.02% (0.5020 => 0.5272, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.73% (1.0722 => 1.1229, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.68% (2.0273 => 2.1221, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.64% (0.4636 => 0.4851, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (7.9617 => 8.3306, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.63% (0.6456 => 0.6755, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.61% (0.3387 => 0.3543, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.60% (0.6450 => 0.6747, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.4064 => 0.4249, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5981 => 0.6247, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.44% (2.2969 => 2.3989, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.40% (0.3865 => 0.4035, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.34% (0.2905 => 0.3031, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.25% (0.2891 => 0.3014, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3826 => 0.3988, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 4.20% (21.9371 => 22.8576, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.3650 => 0.3803, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8921 => 0.9290, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.3136 => 0.3265, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.10% (0.4289 => 0.4465, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.09% (0.4203 => 0.4375, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4620 => 0.4808, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.4186 => 1.4754, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.96% (0.2756 => 0.2865, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.94% (0.3684 => 0.3829, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (2.0665 => 2.1474, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.91% (0.3098 => 0.3219, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.4048 => 0.4205, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.83% (0.3603 => 0.3741, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (0.3935 => 0.4085, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3283 => 0.3407, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (14.3668 => 14.9073, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3232 => 0.3353, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (1.5859 => 1.6430, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 3.40% (0.3379 => 0.3494, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.2024 => 2.2767, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1840 => 1.2199, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3170, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.8101 => 0.8295, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3823, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3616, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7449, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2431, std. dev.: 0.0276) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7894, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.89% (5.2763 => 3.2246, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.33% (5.3855 => 3.8599, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.97% (5.3526 => 3.8557, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2394, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.73% (2.9384 => 2.5936, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -10.29% (22.1758 => 19.8929, std. dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2751, std. dev.: 0.0478) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.40% (1.8329 => 1.7156, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5769, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5103, std. dev.: 0.0046) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1515, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4980, std. dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4180, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9827, std. dev.: 0.0146) SingleSource/Benchmarks/McGill/chomp: -2.72% (1.2373 => 1.2036, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0039, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5797, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2352, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 15:37:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 17:37:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120912223720.042992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3729?compare_to=3726&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3729, Order: 163739, Start Time: 2012-09-12 21:24:02, End Time: 2012-09-12 22:38:35 To: 3726, Order: 163734, Start Time: 2012-09-12 19:40:24, End Time: 2012-09-12 20:54:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (2.0176 => 2.4141, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.05% (0.5748 => 0.6383, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.04% (0.3578 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.86% (0.7061 => 0.7828, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3646 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3601 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.71% (0.3650 => 0.4041, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.65% (0.3623 => 0.4009, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.62% (0.3663 => 0.4052, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.56% (0.7710 => 0.8524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3789 => 0.4189, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3914 => 0.4326, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 10.37% (0.4003 => 0.4418, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.25% (0.3940 => 0.4344, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.18% (3.9660 => 4.3698, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.82% (0.1588 => 0.1744, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.74% (1.3693 => 1.5027, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.71% (0.2596 => 0.2848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.52% (0.4328 => 0.4740, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.25% (0.5265 => 0.5752, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.19% (0.7038 => 0.7685, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.16% (1.2193 => 1.3310, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.00% (0.9199 => 1.0027, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.89% (1.4563 => 1.5858, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.88% (0.6959 => 0.7577, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2781 => 0.3024, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.65% (1.1364 => 1.2347, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 8.49% (0.4062 => 0.4407, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 8.37% (13.8202 => 14.9776, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.30% (0.2782 => 0.3013, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.28% (0.3899 => 0.4222, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.28% (0.5577 => 0.6039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.22% (0.2690 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.18% (0.1589 => 0.1719, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.18% (0.6283 => 0.6797, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.17% (0.3022 => 0.3269, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3489 => 0.3770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.05% (0.3293 => 0.3558, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.98% (0.3485 => 0.3763, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.96% (0.3756 => 0.4055, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.95% (1.9828 => 2.1404, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 7.94% (0.2607 => 0.2814, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.93% (0.2760 => 0.2979, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.92% (0.4379 => 0.4726, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.91% (0.2628 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.91% (7.2180 => 7.7888, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.90% (0.4390 => 0.4737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.90% (0.2761 => 0.2979, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2726 => 0.2941, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.85% (0.3580 => 0.3861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.83% (0.2937 => 0.3167, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.81% (0.2765 => 0.2981, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.79% (0.2966 => 0.3197, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.78% (1.0313 => 1.1115, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.72% (0.3149 => 0.3392, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.69% (0.3107 => 0.3346, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.60% (0.2696 => 0.2901, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.58% (0.3246 => 0.3492, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.58% (0.4791 => 0.5154, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.56% (0.2988 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.52% (0.4016 => 0.4318, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.52% (0.3192 => 0.3432, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.48% (0.3220 => 0.3461, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3453 => 0.3708, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.35% (3.6692 => 3.9390, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.3868 => 0.4152, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.29% (1.1061 => 1.1867, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 7.27% (0.3534 => 0.3791, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.21% (0.2995 => 0.3211, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8310 => 0.8903, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1395, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.10% (0.2140 => 0.2292, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.83% (3.1889 => 3.4066, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.75% (0.6744 => 0.7199, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.69% (1.9270 => 2.0560, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.69% (1.3245 => 1.4131, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.66% (0.2945 => 0.3141, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 6.56% (2.1791 => 2.3220, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.54% (1.3813 => 1.4717, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.48% (1.0594 => 1.1281, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4113 => 0.4378, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (1.3819 => 1.4707, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (4.3801 => 4.6552, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.27% (0.8698 => 0.9243, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.26% (0.6135 => 0.6519, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.23% (4.4433 => 4.7202, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 6.12% (0.2859 => 0.3034, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3526, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.05% (14.8535 => 15.7514, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 6.03% (16.6129 => 17.6145, std. dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.02% (0.3755 => 0.3981, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (8.4961 => 9.0047, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.79% (1.1333 => 1.1989, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.76% (0.6576 => 0.6955, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.70% (14.5298 => 15.3573, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (13.2842 => 14.0364, std. dev.: 0.0079) MultiSource/Benchmarks/sim/sim: 5.65% (0.3131 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.59% (0.2504 => 0.2644, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.53% (0.8818 => 0.9306, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.39% (0.3245 => 0.3420, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.26% (1.2292 => 1.2939, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.26% (6.5754 => 6.9215, std. dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 5.03% (4.6629 => 4.8973, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.77% (3.2742 => 3.4303, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.4805 => 0.5023, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6250 => 0.6530, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.35% (0.9108 => 0.9504, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.29% (1.5188 => 1.5839, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.24% (4.9865 => 5.1981, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 4.10% (3.7467 => 3.9004, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (2.1007 => 2.1816, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.85% (6.2785 => 6.5200, std. dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 3.11% (33.2944 => 34.3286, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.05% (0.3511 => 0.3618, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.85% (16.2614 => 16.5623, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0455) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4123, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.79% (12.0921 => 12.5505, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1067, std. dev.: 0.0556) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6012, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5947, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6851, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.01% (7.9275 => 8.0073, std. dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.14% (0.4657 => 0.4045, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.56% (22.5627 => 21.7601, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2792, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.69% (1.3780 => 1.2996, std. dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std. dev.: 0.0010) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9233, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.8259 => 8.5613, std. dev.: 0.0187) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8966, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (4.1080 => 4.0614, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.11% (7.3305 => 7.2492, std. dev.: 0.0202) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2325, std. dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 15:40:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 17:40:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120912224038.7AE7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3730?compare_to=3727&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3730, Order: 163739, Start Time: 2012-09-12 21:31:01, End Time: 2012-09-12 22:41:57 To: 3727, Order: 163734, Start Time: 2012-09-12 20:04:23, End Time: 2012-09-12 21:15:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (49 on baseline) Performance Improvements: 4 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 2.82% (0.7418 => 0.7627, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 4.00% (4.3239 => 4.4967, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 3.01% (1.6094 => 1.6579, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.11% (1.6463 => 1.6811, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.73% (1.3506 => 1.3740, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 1.50% (8.7242 => 8.8548, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.10% (1.2284 => 1.2419, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.40% (8.9313 => 8.3593, std. dev.: 0.1777) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.32% (1.4678 => 1.4484, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -4.27% (8.6461 => 8.2766, std. dev.: 0.0424) SingleSource/Benchmarks/Shootout-C++/hash: -1.55% (0.6590 => 0.6488, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.10% (0.5309 => 0.5633, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 5.62% (2.1763 => 2.2986, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.6410 => 0.6749, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.2552 => 0.2661, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.22% (1.1653 => 1.2145, std. dev.: 0.0115) MultiSource/Applications/lemon/lemon: 4.14% (1.0046 => 1.0462, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.77% (0.3582 => 0.3717, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 3.66% (15.3105 => 15.8707, std. dev.: 0.0567) MultiSource/Benchmarks/Bullet/bullet: 2.67% (29.3170 => 30.0998, std. dev.: 0.2194) MultiSource/Applications/d/make_dparser: 2.49% (3.0225 => 3.0977, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.5150 => 1.5474, std. dev.: 0.0115) MultiSource/Applications/siod/siod: 1.71% (2.0972 => 2.1330, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 1.70% (1.1440 => 1.1634, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.1827 => 1.1994, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.01% (0.0263 => 0.0384, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.27% (0.0766 => 0.0883, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9981, std. dev.: 0.0262) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3746 => 0.4281, std. dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.67% (4.0101 => 4.5583, std. dev.: 0.0283) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.98% (0.2694 => 0.2936, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6029, std. dev.: 0.0118) SingleSource/Benchmarks/McGill/chomp: 7.56% (1.0194 => 1.0965, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (0.3301 => 0.3531, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (4.2129 => 4.4967, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.55% (0.2857 => 0.3044, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8074, std. dev.: 0.0417) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.42% (40.4792 => 42.6739, std. dev.: 0.2148) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8767, std. dev.: 0.0524) SingleSource/Benchmarks/Misc/dt: 4.26% (0.9851 => 1.0271, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 4.04% (8.5113 => 8.8548, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0173) MultiSource/Benchmarks/Olden/power/power: 3.32% (1.4184 => 1.4655, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.91% (1.6110 => 1.6579, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.6308 => 0.6488, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.35% (0.5876 => 0.6014, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.6459 => 0.6599, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.11% (2.6656 => 2.7219, std. dev.: 0.0213) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.90% (4.6127 => 4.7005, std. dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 1.66% (14.4877 => 14.7277, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4855, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.43% (3.5520 => 3.6027, std. dev.: 0.0158) MultiSource/Applications/spiff/spiff: 1.14% (2.8599 => 2.8926, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 1.07% (2.4971 => 2.5237, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -7.10% (8.9977 => 8.3593, std. dev.: 0.1777) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.43% (5.2665 => 4.0853, std. dev.: 0.1104) SingleSource/Benchmarks/Shootout-C++/ary3: -20.41% (1.7473 => 1.3906, std. dev.: 0.0606) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.48% (1.1647 => 0.9378, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: -9.52% (0.1114 => 0.1008, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.27% (62.4126 => 56.6269, std. dev.: 0.1508) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9453, std. dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.72% (2.4457 => 2.2569, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.03% (3.6254 => 3.3704, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1855, std. dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: -5.89% (1.4441 => 1.3590, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.07% (0.4140 => 0.3930, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4096, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -3.91% (9.2503 => 8.8887, std. dev.: 0.0541) MultiSource/Applications/lambda-0_1_3/lambda: -3.17% (7.6833 => 7.4398, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.17% (1.7361 => 1.6811, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -3.00% (8.5323 => 8.2766, std. dev.: 0.0424) SingleSource/Benchmarks/McGill/misr: -2.98% (0.4296 => 0.4168, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std. dev.: 0.0216) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0184) MultiSource/Applications/aha/aha: -2.70% (3.4286 => 3.3359, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: -2.67% (1.4117 => 1.3740, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.53% (1.1683 => 1.1388, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.38% (1.2722 => 1.2419, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.15% (3.7496 => 3.6690, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.91% (0.6119 => 0.6002, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std. dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (92.7467 => 91.0774, std. dev.: 0.3001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2231, std. dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.8964 => 2.8493, std. dev.: 0.0173) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -1.50% (3.8907 => 3.8322, std. dev.: 0.0160) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.3569 => 2.3222, std. dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3177, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 15:49:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 17:49:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120912224904.EA2BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3731?compare_to=3724&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3731, Order: 163734, Start Time: 2012-09-12 20:06:47, End Time: 2012-09-12 22:50:22 To: 3724, Order: 163715, Start Time: 2012-09-12 16:54:46, End Time: 2012-09-12 19:38:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.08% (2.4611 => 2.4877, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.01% (1.0149 => 1.0047, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.01% (2.0946 => 2.0734, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.92% (0.3446 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.89% (0.3465 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.86% (0.3460 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.82% (0.3496 => 0.4014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3488 => 0.4004, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.79% (0.3469 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.79% (0.3442 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.22% (0.3650 => 0.4169, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.22% (0.3643 => 0.4161, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.86% (0.3724 => 0.4240, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.65% (0.5826 => 0.6330, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.5889 => 0.6392, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1620 => 0.1753, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.00% (1.5932 => 1.7047, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.97% (3.5627 => 3.8110, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (1.6211 => 1.7331, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.81% (0.7171 => 0.7659, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.65% (0.4994 => 0.5326, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.52% (1.3152 => 1.4010, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (0.4361 => 0.4632, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.86% (0.5000 => 0.5293, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.80% (0.3930 => 0.4158, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2738 => 0.2893, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.63% (4.2109 => 4.4479, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2813 => 0.2965, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (0.5026 => 0.5297, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.39% (1.0781 => 1.1362, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.38% (0.2823 => 0.2975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.29% (0.2875 => 0.3027, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.3004 => 0.3161, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (2.7292 => 2.8715, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2725 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.01% (0.3195 => 0.3355, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.95% (0.2729 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.86% (0.2780 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.85% (0.2803 => 0.2939, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2911 => 0.3052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.80% (0.2811 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.80% (0.2750 => 0.2882, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.79% (0.9909 => 1.0384, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (2.0673 => 2.1660, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.72% (0.3096 => 0.3242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3060 => 0.3204, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.68% (5.5417 => 5.8009, std. dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3625 => 0.3794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.3317 => 0.3469, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (0.3890 => 0.4068, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.57% (1.9694 => 2.0595, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.51% (0.3903 => 0.4079, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (0.4658 => 0.4868, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3362 => 0.3512, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.45% (0.3348 => 0.3497, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.45% (0.3124 => 0.3263, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.44% (0.3267 => 0.3412, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.44% (1.9966 => 2.0852, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.43% (2.1013 => 2.1943, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.42% (0.3258 => 0.3402, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.35% (0.3726 => 0.3888, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3678 => 0.3833, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.4139 => 0.4313, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.20% (0.3477 => 0.3623, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.13% (1.8794 => 1.9570, std. dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 4.04% (2.1653 => 2.2527, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 3.99% (23.5202 => 24.4587, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3690 => 0.3835, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.92% (4.6177 => 4.7986, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 3.90% (1.4269 => 1.4825, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (4.4195 => 4.5903, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4251 => 0.4413, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.3271 => 0.3395, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.79% (0.4146 => 0.4303, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.64% (0.5546 => 0.5748, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.3845 => 0.3985, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.62% (0.7875 => 0.8160, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.61% (0.9697 => 1.0047, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.60% (0.6634 => 0.6873, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.3981 => 0.4123, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.3084 => 0.3186, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.15% (0.5012 => 0.5170, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.6435 => 0.6636, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.06% (0.3336 => 0.3438, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.97% (2.0346 => 2.0746, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6722, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 5.03% (15.4430 => 16.2203, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6395, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1976, std. dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5026, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4588, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.27% (7.1849 => 7.2765, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5968, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5591, std. dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8023, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7948, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -3.11% (17.2379 => 16.7010, std. dev.: 0.0553) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0033) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9638, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 16:20:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 18:20:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120912232038.BFEE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3732?compare_to=3728&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3732, Order: 163741, Start Time: 2012-09-12 22:02:15, End Time: 2012-09-12 23:21:54 To: 3728, Order: 163734, Start Time: 2012-09-12 20:14:17, End Time: 2012-09-12 21:33:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (137 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.21% (11.0882 => 11.2229, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.7831 => 56.5143, std. dev.: 0.1474) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.66% (10.3673 => 14.6866, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 27.25% (0.1622 => 0.2064, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.14% (0.3473 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.96% (0.3516 => 0.4007, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3497 => 0.3982, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.78% (7.0540 => 8.0262, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.77% (0.3543 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.75% (2.2022 => 2.5051, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.70% (0.3561 => 0.4049, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-4: 13.69% (0.3543 => 0.4028, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.32% (0.3694 => 0.4186, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 12.91% (0.3927 => 0.4434, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.84% (0.3886 => 0.4385, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.22% (1.1194 => 1.2562, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.01% (1.7609 => 1.9548, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 8.40% (0.1440 => 0.1561, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.21% (0.6030 => 0.6525, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.99% (0.8172 => 0.8825, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.4879 => 0.5259, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.54% (10.4361 => 11.2229, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (0.4615 => 0.4958, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.23% (0.1438 => 0.1542, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.09% (9.4845 => 10.1572, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.98% (0.8067 => 0.8630, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3121 => 0.3337, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.79% (0.5860 => 0.6258, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.78% (8.1363 => 8.6878, std. dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7433 => 0.7933, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 6.62% (0.7835 => 0.8354, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 6.60% (0.3423 => 0.3649, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.55% (0.7115 => 0.7581, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (4.2646 => 4.5433, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.32% (3.3354 => 3.5463, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.29% (1.5415 => 1.6384, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.25% (1.3050 => 1.3865, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.21% (4.9449 => 5.2519, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.5569 => 0.5911, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.13% (0.6675 => 0.7084, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.09% (5.0018 => 5.3064, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.3092 => 0.3277, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 5.98% (5.7591 => 6.1035, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.92% (0.3817 => 0.4043, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.82% (0.5105 => 0.5402, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.82% (0.3180 => 0.3365, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.65% (0.9765 => 1.0317, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.43% (1.1642 => 1.2274, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.27% (1.5603 => 1.6426, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.26% (1.1861 => 1.2485, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 5.15% (3.8723 => 4.0718, std. dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (7.9617 => 8.3602, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.00% (0.5020 => 0.5271, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std. dev.: 0.0038) MultiSource/Applications/lemon/lemon: 4.86% (1.0722 => 1.1243, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1237, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.4103 => 0.4297, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.57% (0.6450 => 0.6745, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 4.53% (2.2969 => 2.4010, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.41% (0.3422 => 0.3573, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.40% (0.6456 => 0.6740, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.35% (0.5981 => 0.6241, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.4064 => 0.4239, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8921 => 0.9299, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9371 => 22.8521, std. dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (1.4186 => 1.4776, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.04% (0.4203 => 0.4373, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3865 => 0.4021, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (14.3668 => 14.9438, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3650 => 0.3796, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 3.99% (0.4289 => 0.4460, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.92% (0.3826 => 0.3976, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.82% (1.5859 => 1.6465, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sieve: 3.80% (0.3603 => 0.3740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2872 => 0.2981, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.66% (0.4620 => 0.4789, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.3098 => 0.3211, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.64% (2.0665 => 2.1418, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 3.64% (0.2831 => 0.2934, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (0.2877 => 0.2981, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.55% (0.2871 => 0.2973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.2024 => 2.2784, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1840 => 1.2197, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.62% (0.8101 => 0.8313, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3166, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.06% (17.1811 => 17.3625, std. dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.89% (1.1145 => 1.3696, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3525, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7457, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.27% (11.6436 => 11.7918, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2319, std. dev.: 0.0317) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5747, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2352, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.97% (5.3855 => 3.8790, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.59% (5.3526 => 3.8759, std. dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1881, std. dev.: 0.0238) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.10% (2.9384 => 2.5828, std. dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9211, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2734, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.46% (1.8329 => 1.7145, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.12% (1.6805 => 1.5776, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.09% (1.5835 => 1.5029, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4110, std. dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5116, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -3.00% (1.2373 => 1.2002, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/salsa20: -2.80% (10.2830 => 9.9954, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (8.1563 => 8.0284, std. dev.: 0.0157) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.36% (4.6441 => 4.5810, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 17:08:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 19:08:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913000800.4434B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3733?compare_to=3730&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3733, Order: 163746, Start Time: 2012-09-12 22:58:04, End Time: 2012-09-13 00:09:19 To: 3730, Order: 163739, Start Time: 2012-09-12 21:31:01, End Time: 2012-09-12 22:41:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (53 on baseline) Performance Improvements: 2 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.63% (0.7513 => 0.7861, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.00% (0.3075 => 0.3198, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.65% (0.2823 => 0.2926, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.08% (0.7764 => 0.8003, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8635 => 3.9411, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.2593 => 1.2835, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.73% (1.4052 => 1.4295, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.42% (0.8953 => 0.9080, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.85% (21.7760 => 22.6145, std. dev.: 0.2741) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.37% (0.3531 => 0.3412, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: -2.42% (4.4967 => 4.3877, std. dev.: 0.0373) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.48% (0.0745 => 0.0905, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.74% (0.5309 => 0.5667, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.2552 => 0.2713, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.54% (0.6410 => 0.6765, std. dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 5.20% (2.1763 => 2.2895, std. dev.: 0.0380) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.77% (0.3582 => 0.3753, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 4.39% (0.6173 => 0.6444, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 4.03% (0.6915 => 0.7194, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.64% (0.7722 => 0.8003, std. dev.: 0.0068) MultiSource/Applications/lemon/lemon: 3.59% (1.0046 => 1.0407, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3217 => 0.3328, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 3.06% (1.1653 => 1.2010, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 3.06% (29.3170 => 30.2130, std. dev.: 0.1920) MultiSource/Applications/d/make_dparser: 2.69% (3.0225 => 3.1037, std. dev.: 0.0176) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5150 => 1.5555, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.66% (2.0972 => 2.1530, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.63% (1.1440 => 1.1741, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.39% (0.5937 => 0.6079, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1672 => 1.1934, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (1.3935 => 1.4228, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.62% (4.2616 => 4.3307, std. dev.: 0.0202) MultiSource/Applications/SPASS/SPASS: 1.61% (13.3238 => 13.5377, std. dev.: 0.0760) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8796 => 3.9411, std. dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.58% (6.2546 => 6.3532, std. dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2294, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 14.91% (1.7426 => 2.0024, std. dev.: 0.0269) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3746 => 0.4281, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.09% (4.0101 => 4.5750, std. dev.: 0.0373) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 9.11% (7.0025 => 7.6401, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.44% (1.0063 => 1.0912, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.32% (0.2857 => 0.3066, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 6.90% (1.0194 => 1.0897, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.95% (27.1724 => 28.7899, std. dev.: 0.0695) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 4.34% (15.2242 => 15.8852, std. dev.: 0.0445) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.15% (4.2129 => 4.3877, std. dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (6.6312 => 6.8637, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (0.3301 => 0.3412, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 3.22% (1.4184 => 1.4641, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.87% (4.6127 => 4.7449, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.6308 => 0.6488, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 2.80% (8.5113 => 8.7492, std. dev.: 0.0656) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.21% (2.6656 => 2.7245, std. dev.: 0.0193) MultiSource/Benchmarks/BitBench/five11/five11: 1.93% (5.1938 => 5.2938, std. dev.: 0.0290) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.82% (1.2726 => 1.2958, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.77% (3.5520 => 3.6147, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.71% (14.4877 => 14.7359, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5325, std. dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.57% (5.2665 => 4.1832, std. dev.: 0.0764) SingleSource/Benchmarks/Shootout-C++/ary3: -20.47% (1.7473 => 1.3896, std. dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.23% (1.1647 => 0.9407, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/sieve: -12.14% (8.1594 => 7.1692, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5432, std. dev.: 0.1851) SingleSource/Benchmarks/BenchmarkGame/recursive: -9.07% (2.4457 => 2.2238, std. dev.: 0.0394) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3653, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.84% (3.2007 => 2.9819, std. dev.: 0.0223) MultiSource/Applications/SIBsim4/SIBsim4: -6.80% (3.4230 => 3.1903, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -6.37% (1.4441 => 1.3521, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4066, std. dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.30% (1.7361 => 1.6614, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/ffbench: -3.62% (1.4117 => 1.3606, std. dev.: 0.0087) SingleSource/Benchmarks/McGill/misr: -3.38% (0.4296 => 0.4151, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.34% (1.2722 => 1.2297, std. dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: -3.33% (7.6833 => 7.4278, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.17% (1.1683 => 1.1313, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -3.00% (9.2503 => 8.9726, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.96% (3.9413 => 3.8248, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.90% (0.4140 => 0.4020, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2882, std. dev.: 0.0141) MultiSource/Applications/aha/aha: -2.71% (3.4286 => 3.3358, std. dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.48% (45.4683 => 44.3387, std. dev.: 0.3522) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.15% (3.7496 => 3.6690, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4194, std. dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: -1.78% (1.0926 => 1.0731, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2291, std. dev.: 0.0273) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.65% (2.8964 => 2.8485, std. dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -1.59% (3.8907 => 3.8290, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.31% (1.8739 => 1.8494, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.3569 => 2.3262, std. dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3328, std. dev.: 0.0234) MultiSource/Applications/JM/lencod/lencod: -1.28% (6.7458 => 6.6597, std. dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 17:19:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 19:19:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913001952.B2B2F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3734?compare_to=3729&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3734, Order: 163746, Start Time: 2012-09-12 23:06:49, End Time: 2012-09-13 00:21:10 To: 3729, Order: 163739, Start Time: 2012-09-12 21:24:02, End Time: 2012-09-12 22:38:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.52% (55.7523 => 56.5987, std. dev.: 0.0797) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.60% (2.0176 => 2.4130, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 12.56% (0.5818 => 0.6549, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.44% (0.5748 => 0.6463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.90% (0.7061 => 0.7901, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.18% (0.3578 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3646 => 0.4044, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 10.90% (0.3789 => 0.4202, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.86% (0.3601 => 0.3992, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.82% (0.3650 => 0.4045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.79% (0.3623 => 0.4014, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3663 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3914 => 0.4328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.4003 => 0.4424, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.7710 => 0.8512, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.38% (0.3940 => 0.4349, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.16% (3.9660 => 4.3689, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.82% (1.3693 => 1.5037, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.46% (0.5265 => 0.5763, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.43% (0.4328 => 0.4736, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.31% (0.7038 => 0.7693, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.11% (0.9199 => 1.0037, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.09% (1.2193 => 1.3301, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 9.06% (0.2781 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.83% (1.4563 => 1.5849, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.82% (0.6959 => 0.7573, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.73% (0.2782 => 0.3025, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.64% (0.4062 => 0.4413, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.62% (1.1364 => 1.2344, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.54% (0.3899 => 0.4232, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 8.48% (0.2607 => 0.2828, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3022 => 0.3277, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.43% (13.8202 => 14.9846, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2127 => 0.2306, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.33% (0.2690 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.29% (0.2655 => 0.2875, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.25% (0.3489 => 0.3777, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.23% (0.5577 => 0.6036, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.21% (0.2937 => 0.3178, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2628 => 0.2843, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.16% (0.6283 => 0.6796, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (0.3485 => 0.3769, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (7.2180 => 7.8056, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.13% (1.9828 => 2.1441, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2760 => 0.2984, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.11% (0.3293 => 0.3560, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.09% (0.3756 => 0.4060, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.08% (0.4379 => 0.4733, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.07% (0.3580 => 0.3869, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 8.07% (0.2726 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.04% (0.2761 => 0.2983, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.03% (0.2765 => 0.2987, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.02% (0.2966 => 0.3204, std. dev.: 0.0085) MultiSource/Applications/spiff/spiff: 8.02% (0.7506 => 0.8108, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.90% (0.2696 => 0.2909, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.87% (0.1435 => 0.1548, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.85% (0.3107 => 0.3351, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.75% (0.3149 => 0.3393, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.74% (0.4016 => 0.4327, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.74% (1.0313 => 1.1111, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1865 => 0.2009, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 7.71% (0.3192 => 0.3438, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.4791 => 0.5159, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.62% (0.2925 => 0.3148, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.58% (0.2243 => 0.2413, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.56% (0.2988 => 0.3214, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.50% (0.3868 => 0.4158, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.49% (3.6692 => 3.9441, std. dev.: 0.0108) MultiSource/Applications/Burg/burg: 7.48% (1.1061 => 1.1888, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.47% (0.4390 => 0.4718, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.41% (0.2023 => 0.2173, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 7.39% (3.8646 => 4.1502, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 7.36% (0.3220 => 0.3457, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.36% (0.3453 => 0.3707, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.30% (0.3534 => 0.3792, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.20% (0.5637 => 0.6043, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.09% (0.8310 => 0.8899, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.90% (3.1889 => 3.4090, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.86% (0.2945 => 0.3147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.86% (1.3245 => 1.4153, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.82% (0.6744 => 0.7204, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.73% (1.9270 => 2.0567, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 6.69% (2.1791 => 2.3248, std. dev.: 0.0147) MultiSource/Benchmarks/McCat/05-eks/eks: 6.59% (0.4113 => 0.4384, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.53% (1.3819 => 1.4721, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.48% (1.0594 => 1.1280, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.45% (1.3813 => 1.4704, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.43% (16.6129 => 17.6815, std. dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.41% (4.3801 => 4.6610, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.39% (0.3755 => 0.3995, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.38% (4.4433 => 4.7268, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.37% (0.6135 => 0.6526, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.31% (0.8698 => 0.9247, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (1.2749 => 1.3549, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.08% (14.8535 => 15.7563, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.07% (0.6576 => 0.6975, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.06% (8.4961 => 9.0113, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.92% (1.1333 => 1.2004, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.75% (0.3131 => 0.3311, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (13.2842 => 14.0470, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.73% (0.3245 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.70% (0.8818 => 0.9321, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.70% (14.5298 => 15.3583, std. dev.: 0.0163) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.52% (1.2292 => 1.2970, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.43% (6.5754 => 6.9323, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 5.10% (4.6629 => 4.9007, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.76% (3.2742 => 3.4302, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.4805 => 0.5032, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 4.69% (0.6250 => 0.6543, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.54% (4.9865 => 5.2131, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.42% (0.9108 => 0.9511, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.29% (1.5188 => 1.5839, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 4.19% (3.7467 => 3.9036, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (6.2785 => 6.5371, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.90% (2.1007 => 2.1827, std. dev.: 0.0194) MultiSource/Benchmarks/Bullet/bullet: 3.38% (33.2944 => 34.4204, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.82% (16.2614 => 16.5575, std. dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4171, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0006, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5460, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0778, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6022, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.19% (7.9275 => 8.0216, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5853, std. dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.01% (0.4657 => 0.4051, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.52% (22.5627 => 21.7686, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2771, std. dev.: 0.0260) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.73% (1.3780 => 1.2990, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5112, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1504, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9244, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5836, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -2.26% (26.5159 => 25.9164, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2414, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2423, std. dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0598, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2341, std. dev.: 0.0349) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 18:08:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 20:08:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913010838.55CF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3735?compare_to=3732&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3735, Order: 163752, Start Time: 2012-09-12 23:50:18, End Time: 2012-09-13 01:09:54 To: 3732, Order: 163741, Start Time: 2012-09-12 22:02:15, End Time: 2012-09-12 23:21:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (142 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (14.6866 => 14.8901, std. dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.03% (11.2229 => 11.1077, std. dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.63% (10.3673 => 14.8901, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 15.66% (0.3473 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.44% (0.3516 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.41% (0.3497 => 0.4036, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.33% (0.3543 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.25% (0.3561 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.24% (0.3543 => 0.4083, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.81% (0.3694 => 0.4241, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions: 14.42% (0.3828 => 0.4380, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.36% (0.3927 => 0.4491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.13% (0.3886 => 0.4435, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.23% (2.2022 => 2.4936, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.94% (7.0540 => 7.9670, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.50% (0.1432 => 0.1611, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.26% (1.7609 => 1.9415, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.15% (0.6030 => 0.6582, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.75% (0.8172 => 0.8887, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.2065 => 0.2241, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 8.19% (0.1440 => 0.1558, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.97% (0.7326 => 0.7910, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.52% (0.3817 => 0.4104, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.14% (9.4845 => 10.1616, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.00% (0.2271 => 0.2430, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.96% (0.2700 => 0.2888, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.90% (0.7835 => 0.8376, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2758 => 0.2946, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.4879 => 0.5211, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.74% (8.1363 => 8.6850, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3307 => 0.3530, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.70% (0.7433 => 0.7931, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.65% (0.7115 => 0.7588, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.55% (0.5860 => 0.6244, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 6.54% (0.3423 => 0.3647, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (4.2646 => 4.5425, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.45% (0.2107 => 0.2243, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 6.44% (10.4361 => 11.1077, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3121 => 0.3321, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.5569 => 0.5925, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.25% (3.3354 => 3.5439, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.6675 => 0.7091, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.3050 => 1.3861, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.20% (0.8067 => 0.8567, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (1.5415 => 1.6369, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.06% (4.9449 => 5.2447, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.06% (5.0018 => 5.3049, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 5.88% (5.7591 => 6.0979, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.82% (0.3180 => 0.3365, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.9765 => 1.0323, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.57% (1.1642 => 1.2290, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 5.35% (1.5603 => 1.6437, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1861 => 1.2490, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 5.13% (3.8723 => 4.0710, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.4103 => 0.4306, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.94% (0.5020 => 0.5268, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.90% (2.0273 => 2.1267, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.84% (7.9617 => 8.3469, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4636 => 0.4860, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.74% (1.0722 => 1.1230, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.67% (0.6450 => 0.6751, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.62% (0.6456 => 0.6754, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 4.61% (21.9371 => 22.9475, std. dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3422 => 0.3578, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.50% (0.5981 => 0.6250, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 4.47% (2.2969 => 2.3995, std. dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.35% (0.3865 => 0.4033, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4289 => 0.4470, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.3826 => 0.3987, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.3650 => 0.3803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.15% (0.2891 => 0.3011, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.11% (0.3162 => 0.3292, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 4.10% (0.8921 => 0.9287, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.09% (0.4203 => 0.4375, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.4186 => 1.4756, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.00% (14.3668 => 14.9412, std. dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.94% (0.3684 => 0.3829, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5859 => 1.6478, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.89% (2.0665 => 2.1468, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.86% (0.3935 => 0.4087, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4620 => 0.4795, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.3098 => 0.3215, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.77% (0.3603 => 0.3739, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 3.72% (0.2877 => 0.2984, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 3.68% (0.4048 => 0.4197, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2872 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3232 => 0.3349, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.60% (0.3052 => 0.3162, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.60% (2.2024 => 2.2817, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.58% (0.2793 => 0.2893, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2802 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.50% (0.3283 => 0.3398, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1840 => 1.2200, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3169, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.8101 => 0.8303, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.00% (17.1811 => 17.3535, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0022) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3852, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.24% (4.2280 => 4.3651, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 1.88% (2.2771 => 2.3199, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7897, std. dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1302, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.06% (5.2763 => 3.2156, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.39% (5.3855 => 3.8567, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.03% (5.3526 => 3.8521, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1649, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.34% (2.9384 => 2.5759, std. dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -10.41% (22.1758 => 19.8667, std. dev.: 0.0262) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2753, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.43% (1.8329 => 1.7151, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5769, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1507, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5089, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4298, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: -2.73% (1.2373 => 1.2035, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0072, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9835, std. dev.: 0.0186) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 18:34:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 20:34:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913013445.6C6562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3736?compare_to=3733&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3736, Order: 163755, Start Time: 2012-09-13 00:25:03, End Time: 2012-09-13 01:36:03 To: 3733, Order: 163746, Start Time: 2012-09-12 22:58:04, End Time: 2012-09-13 00:09:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (45 on baseline) Performance Improvements: 1 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 897 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.15% (2.3025 => 2.5131, std. dev.: 0.0486) MultiSource/Applications/minisat/minisat: 7.78% (6.1574 => 6.6365, std. dev.: 0.0872) SingleSource/Benchmarks/Misc/whetstone: 2.03% (2.3288 => 2.3761, std. dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.27% (2.9819 => 2.9440, std. dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.87% (0.0745 => 0.0893, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.28% (0.1414 => 0.1517, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.86% (0.5309 => 0.5620, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.73% (0.6410 => 0.6777, std. dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 5.31% (2.1763 => 2.2919, std. dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: 3.95% (1.1653 => 1.2113, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.69% (0.6173 => 0.6401, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.5150 => 1.5672, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 3.08% (0.6915 => 0.7128, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.57% (29.3170 => 30.0699, std. dev.: 0.2774) MultiSource/Applications/hbd/hbd: 2.46% (1.3268 => 1.3594, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.34% (0.5937 => 0.6076, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.7639 => 0.7800, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.66% (0.7226 => 0.7346, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (6.2546 => 6.3249, std. dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.00% (8.2559 => 8.3385, std. dev.: 0.0274) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2271, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.19% (0.0766 => 0.0890, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std. dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 14.42% (0.3746 => 0.4286, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.31% (4.0101 => 4.5439, std. dev.: 0.0166) SingleSource/Benchmarks/Stanford/Puzzle: 12.21% (0.1433 => 0.1608, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6239, std. dev.: 0.0334) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.04% (1.0063 => 1.0872, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 8.01% (1.0194 => 1.1011, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: 6.62% (6.2244 => 6.6365, std. dev.: 0.0872) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.58% (2.3580 => 2.5131, std. dev.: 0.0486) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8066, std. dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.99% (40.4792 => 42.4981, std. dev.: 0.3575) SingleSource/Benchmarks/Misc/dt: 4.44% (0.9851 => 1.0288, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.32% (0.8498 => 0.8865, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.6308 => 0.6580, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8553, std. dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8718, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.60% (3.4080 => 3.5308, std. dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 2.77% (1.4184 => 1.4577, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 2.42% (8.5113 => 8.7175, std. dev.: 0.0476) MultiSource/Benchmarks/BitBench/five11/five11: 2.40% (5.1938 => 5.3185, std. dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.20% (0.5876 => 0.6005, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.76% (3.5520 => 3.6146, std. dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7216, std. dev.: 0.0354) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5302, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.81% (8.9977 => 8.8346, std. dev.: 0.0473) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.35% (0.3497 => 0.2086, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.50% (5.2665 => 4.0817, std. dev.: 0.1675) SingleSource/Benchmarks/Shootout-C++/ary3: -19.93% (1.7473 => 1.3991, std. dev.: 0.0546) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.41% (1.1647 => 0.9386, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -10.68% (0.1114 => 0.0995, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -9.35% (62.4126 => 56.5796, std. dev.: 0.0417) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.02% (3.2007 => 2.9440, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.43% (2.4457 => 2.2640, std. dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3666, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -6.86% (3.4230 => 3.1883, std. dev.: 0.0330) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3507, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.10% (2.9728 => 2.7914, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4103, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: -4.32% (0.2664 => 0.2549, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.25% (0.4140 => 0.3964, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.91% (1.7361 => 1.6683, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/methcall: -3.55% (9.2503 => 8.9216, std. dev.: 0.0400) SingleSource/Benchmarks/Misc/ffbench: -3.51% (1.4117 => 1.3622, std. dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.32% (3.7496 => 3.6253, std. dev.: 0.0200) MultiSource/Applications/lambda-0_1_3/lambda: -3.25% (7.6833 => 7.4339, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.94% (3.9413 => 3.8253, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.83% (1.1683 => 1.1352, std. dev.: 0.0112) MultiSource/Applications/aha/aha: -2.78% (3.4286 => 3.3332, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std. dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.36% (1.0686 => 1.0434, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4199, std. dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (92.7467 => 91.0692, std. dev.: 0.1645) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (9.3855 => 9.2160, std. dev.: 0.0204) MultiSource/Benchmarks/sim/sim: -1.73% (3.8907 => 3.8234, std. dev.: 0.0166) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.53% (3.8200 => 3.7616, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3075, std. dev.: 0.0169) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.02% (1.8739 => 1.8548, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 19:01:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 21:01:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120913020133.769392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3737?compare_to=3731&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3737, Order: 163746, Start Time: 2012-09-12 23:18:54, End Time: 2012-09-13 02:02:50 To: 3731, Order: 163734, Start Time: 2012-09-12 20:06:47, End Time: 2012-09-12 22:50:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.02% (1.0047 => 1.0149, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.97% (125.5158 => 131.7546, std. dev.: 0.1299) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.15% (0.3446 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.13% (0.3496 => 0.4025, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.11% (0.3442 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.09% (0.3465 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.47% (0.3643 => 0.4170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.5889 => 0.6441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5826 => 0.6367, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.70% (0.1620 => 0.1761, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.57% (0.7171 => 0.7714, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.45% (3.5627 => 3.8280, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.34% (1.6211 => 1.7401, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (1.3152 => 1.4068, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.70% (0.4361 => 0.4653, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 6.59% (1.5932 => 1.6982, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (0.4994 => 0.5315, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2738 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (0.3930 => 0.4177, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.25% (0.4029 => 0.4281, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.25% (0.5900 => 0.6269, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.22% (0.5000 => 0.5311, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.12% (4.2109 => 4.4684, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2875 => 0.3050, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (0.5026 => 0.5326, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.88% (2.7292 => 2.8896, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.74% (1.0781 => 1.1400, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2823 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2729 => 0.2883, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.63% (0.3004 => 0.3173, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.59% (0.3792 => 0.4004, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2813 => 0.2970, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.2866 => 0.3025, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3195 => 0.3372, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.54% (0.2780 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2803 => 0.2958, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.44% (0.2792 => 0.2944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.40% (2.0673 => 2.1789, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 5.39% (0.3096 => 0.3263, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.39% (0.9909 => 1.0443, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 5.34% (0.2811 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.27% (0.2750 => 0.2895, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.15% (0.3124 => 0.3285, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3060 => 0.3216, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.08% (0.2911 => 0.3059, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (1.9694 => 2.0688, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8205, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (1.9966 => 2.0969, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.96% (0.3267 => 0.3429, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.91% (0.3258 => 0.3418, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.88% (0.3317 => 0.3479, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.85% (2.1013 => 2.2032, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 4.83% (0.2566 => 0.2690, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (0.4658 => 0.4882, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (0.3890 => 0.4077, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3726 => 0.3902, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.71% (0.3903 => 0.4087, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.69% (0.3477 => 0.3640, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (4.4195 => 4.6265, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 4.66% (0.9697 => 1.0149, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3678 => 0.3849, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3625 => 0.3793, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.61% (0.3690 => 0.3860, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.60% (0.3282 => 0.3433, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (1.8794 => 1.9651, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 4.51% (23.5202 => 24.5821, std. dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.4139 => 0.4320, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.35% (0.4251 => 0.4436, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.35% (0.3981 => 0.4154, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 4.33% (1.4269 => 1.4887, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 4.32% (4.6177 => 4.8173, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 4.32% (0.4146 => 0.4325, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.3271 => 0.3409, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (2.1653 => 2.2566, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.2969 => 0.3093, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.04% (0.5546 => 0.5770, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.04% (0.7875 => 0.8193, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.71% (0.6634 => 0.6880, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.43% (0.6435 => 0.6656, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.40% (2.0346 => 2.0834, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (0.4847 => 0.4955, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (0.7426 => 0.7540, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (11.6398 => 11.7589, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6709, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1717, std. dev.: 0.1312) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8883, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6346, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std. dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5061, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4396, std. dev.: 0.0255) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5846, std. dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5744, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7992, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8059, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7753, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7591, std. dev.: 0.0759) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9578, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 19:02:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 21:02:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913020217.19C632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3738?compare_to=3734&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3738, Order: 163757, Start Time: 2012-09-13 00:49:19, End Time: 2012-09-13 02:03:34 To: 3734, Order: 163746, Start Time: 2012-09-12 23:06:49, End Time: 2012-09-13 00:21:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.36% (1.2174 => 1.2340, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.33% (0.7901 => 0.7796, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.80% (2.0176 => 2.3970, std. dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.45% (0.5748 => 0.6406, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3578 => 0.3960, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.41% (0.7061 => 0.7796, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 10.37% (0.3646 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3601 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3650 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3623 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.26% (0.3663 => 0.4039, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/for-in: 10.19% (0.3789 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.09% (0.3914 => 0.4309, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.06% (0.7710 => 0.8486, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.02% (0.4003 => 0.4404, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.90% (0.3940 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.75% (3.9660 => 4.3528, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.51% (0.2596 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 9.46% (1.3693 => 1.4988, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.69% (1.2193 => 1.3253, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.64% (0.9199 => 0.9994, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.49% (0.6959 => 0.7550, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.38% (1.4563 => 1.5783, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.20% (1.1364 => 1.2296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.97% (0.6283 => 0.6784, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.95% (0.2127 => 0.2296, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.93% (0.4062 => 0.4384, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.93% (0.5577 => 0.6019, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.81% (13.8202 => 14.8996, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.70% (0.4379 => 0.4716, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.65% (0.7506 => 0.8080, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (7.2180 => 7.7689, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.62% (0.3899 => 0.4196, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.52% (0.2914 => 0.3133, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 7.49% (1.0313 => 1.1085, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.35% (0.2925 => 0.3140, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.22% (0.2243 => 0.2405, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.21% (1.9828 => 2.1258, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.16% (1.1061 => 1.1853, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3293 => 0.3527, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2023 => 0.2166, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.01% (3.6692 => 3.9265, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.99% (3.8646 => 4.1348, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 6.96% (0.3220 => 0.3444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.87% (0.4016 => 0.4292, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.82% (0.8310 => 0.8877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.72% (0.7460 => 0.7961, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.56% (3.1889 => 3.3982, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.54% (0.3868 => 0.4121, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.50% (1.3813 => 1.4711, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.47% (0.6744 => 0.7180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.39% (1.3245 => 1.4092, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.38% (1.3819 => 1.4700, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 6.33% (2.1791 => 2.3171, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.28% (1.9270 => 2.0481, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 6.20% (0.4113 => 0.4368, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.18% (1.2749 => 1.3537, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.10% (4.3801 => 4.6472, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 6.04% (1.0594 => 1.1234, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.02% (4.4433 => 4.7107, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.6135 => 0.6493, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.81% (0.8698 => 0.9203, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 5.77% (16.6129 => 17.5717, std. dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: 5.76% (8.4961 => 8.9857, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.2140 => 0.2262, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.68% (14.8535 => 15.6966, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.48% (0.8818 => 0.9301, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.1333 => 1.1952, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (13.2842 => 14.0045, std. dev.: 0.0071) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.37% (14.5298 => 15.3095, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.12% (4.6629 => 4.9017, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.95% (6.5754 => 6.9012, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.91% (0.6576 => 0.6899, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.62% (3.2742 => 3.4256, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.14% (0.9108 => 0.9485, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.06% (1.5188 => 1.5804, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1862, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 3.96% (3.7467 => 3.8949, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6250 => 0.6493, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4995, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (2.1007 => 2.1741, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.74% (33.2944 => 34.2073, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5234, std. dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.43% (5.7573 => 7.5092, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0412) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.92% (1.2998 => 1.3768, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0767, std. dev.: 0.0529) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5940, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5161, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5952, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.44% (0.4657 => 0.4031, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7109, std. dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2749, std. dev.: 0.0476) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.67% (1.3780 => 1.2998, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9226, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5832, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.35% (26.5159 => 25.8934, std. dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2412, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0138) MultiSource/Applications/viterbi/viterbi: -1.22% (4.4810 => 4.4265, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.12% (7.3305 => 7.2482, std. dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0622, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2617, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 19:56:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 21:56:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913025633.5C8F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3739?compare_to=3735&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3739, Order: 163762, Start Time: 2012-09-13 01:38:19, End Time: 2012-09-13 02:57:49 To: 3735, Order: 163752, Start Time: 2012-09-12 23:50:18, End Time: 2012-09-13 01:09:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (134 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.80% (56.0473 => 54.4762, std. dev.: 0.0979) MultiSource/Benchmarks/llubenchmark/llu: -2.64% (3.8738 => 3.7716, std. dev.: 0.0271) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.43% (10.3673 => 14.9733, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 26.14% (0.1622 => 0.2046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.25% (0.3473 => 0.3968, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.96% (0.3561 => 0.4058, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.94% (0.3543 => 0.4037, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3497 => 0.3983, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.89% (0.3543 => 0.4035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3516 => 0.4002, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 13.48% (0.3694 => 0.4192, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.08% (7.0540 => 7.9765, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions: 13.06% (0.3828 => 0.4328, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.98% (2.2022 => 2.4881, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.91% (0.3927 => 0.4434, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.71% (0.3886 => 0.4380, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2464, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.06% (1.7609 => 1.9381, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1584 => 0.1723, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5925 => 0.6429, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.41% (0.8172 => 0.8859, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 8.20% (0.3282 => 0.3551, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.22% (0.7326 => 0.7855, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.06% (10.4361 => 11.1726, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (9.4845 => 10.1285, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.59% (8.1363 => 8.6727, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.54% (0.4615 => 0.4917, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.39% (0.7835 => 0.8336, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (4.2646 => 4.5303, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: 6.21% (0.7115 => 0.7557, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.18% (0.5860 => 0.6222, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.16% (0.3423 => 0.3634, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std. dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5390, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (1.5415 => 1.6338, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5569 => 0.5900, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.89% (0.3817 => 0.4042, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.89% (0.3109 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (5.0018 => 5.2892, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.9449 => 5.2290, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.3050 => 1.3796, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.8067 => 0.8528, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.5105 => 0.5395, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.67% (5.7591 => 6.0858, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.34% (0.9765 => 1.0286, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 5.14% (0.3387 => 0.3561, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.14% (1.1642 => 1.2240, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.08% (1.5603 => 1.6396, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.07% (1.1861 => 1.2462, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 4.81% (3.8723 => 4.0584, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5020 => 0.5257, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 4.61% (1.0722 => 1.1216, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4636 => 0.4849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3422 => 0.3579, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.57% (2.0273 => 2.1199, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.4064 => 0.4249, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.43% (0.6456 => 0.6742, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.38% (7.9617 => 8.3104, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.28% (0.6450 => 0.6726, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9371 => 22.8526, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4289 => 0.4464, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.08% (2.2969 => 2.3906, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3865 => 0.4018, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.95% (0.5981 => 0.6217, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (14.3668 => 14.9239, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8921 => 0.9265, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4203 => 0.4364, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.74% (0.3826 => 0.3969, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4620 => 0.4792, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.4186 => 1.4713, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.58% (0.3684 => 0.3816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.58% (0.4048 => 0.4193, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.58% (0.3603 => 0.3732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3162 => 0.3275, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0665 => 2.1391, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (1.5859 => 1.6404, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.20% (2.2024 => 2.2728, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.1840 => 1.2162, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.8101 => 0.8277, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.04% (17.1811 => 17.3598, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8965, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3126, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.29% (4.2280 => 4.3672, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2277, std. dev.: 0.0363) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3712, std. dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.09% (5.2763 => 3.2136, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.58% (5.3855 => 3.8465, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.22% (5.3526 => 3.8420, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1124, std. dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.29% (2.9384 => 2.5772, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.47% (22.1758 => 19.8536, std. dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.48% (1.5373 => 1.3762, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2668, std. dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std. dev.: 0.0014) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1516, std. dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: -3.39% (1.2373 => 1.1953, std. dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5120, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4214, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0132, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0202, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5770, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 20:01:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 22:01:32 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913030132.E00FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3740?compare_to=3736&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3740, Order: 163765, Start Time: 2012-09-13 01:52:18, End Time: 2012-09-13 03:02:52 To: 3736, Order: 163755, Start Time: 2012-09-13 00:25:03, End Time: 2012-09-13 01:36:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (58 on baseline) Performance Improvements: 1 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.39% (8.8346 => 9.2227, std. dev.: 0.0358) MultiSource/Applications/kimwitu++/kc: 1.49% (15.7099 => 15.9442, std. dev.: 0.0248) MultiSource/Applications/lua/lua: 1.39% (3.6060 => 3.6561, std. dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (2.4545 => 2.5920, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (0.3369 => 0.3498, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.89% (4.3134 => 4.4382, std. dev.: 0.0272) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.99% (2.6890 => 2.7425, std. dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.81% (1.2781 => 1.3012, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.6539 => 0.6645, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -1.72% (0.6580 => 0.6467, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.67% (0.5309 => 0.5663, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.6410 => 0.6808, std. dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 6.01% (2.1763 => 2.3070, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.41% (0.2552 => 0.2690, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.58% (0.6915 => 0.7232, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 4.41% (0.6173 => 0.6445, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 4.37% (1.1653 => 1.2162, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 4.14% (15.3105 => 15.9442, std. dev.: 0.0248) MultiSource/Applications/lemon/lemon: 3.58% (1.0046 => 1.0406, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3062 => 0.3165, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.00% (0.3901 => 0.4018, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3582 => 0.3688, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.73% (29.3170 => 30.1176, std. dev.: 0.1492) MultiSource/Applications/hbd/hbd: 2.71% (1.3268 => 1.3627, std. dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: 2.50% (8.9977 => 9.2227, std. dev.: 0.0358) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.5150 => 1.5501, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 2.05% (2.0972 => 2.1402, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (1.3935 => 1.4218, std. dev.: 0.0087) MultiSource/Applications/lua/lua: 1.61% (3.5980 => 3.6561, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.46% (12.6413 => 12.8261, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.11% (0.0766 => 0.0943, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.79% (0.0917 => 0.1071, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.91% (1.7426 => 2.0025, std. dev.: 0.0248) MultiSource/Applications/sgefa/sgefa: 14.42% (0.3746 => 0.4286, std. dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.12% (4.0101 => 4.5763, std. dev.: 0.0296) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.21% (0.2694 => 0.2942, std. dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 9.00% (0.1433 => 0.1562, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.72% (7.0025 => 7.6128, std. dev.: 0.0316) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.81% (0.2857 => 0.3080, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.74% (1.0063 => 1.0842, std. dev.: 0.0133) SingleSource/Benchmarks/McGill/chomp: 7.45% (1.0194 => 1.0953, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (15.8312 => 16.8107, std. dev.: 0.3522) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7930, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.35% (4.2129 => 4.4382, std. dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.81% (40.4792 => 42.4255, std. dev.: 0.5372) SingleSource/Benchmarks/Misc/fp-convert: 4.60% (15.2242 => 15.9246, std. dev.: 0.0312) SingleSource/Benchmarks/Misc/dt: 4.48% (0.9851 => 1.0292, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.65% (0.8498 => 0.8808, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.5587 => 0.5778, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 3.15% (1.4184 => 1.4631, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 3.06% (8.5113 => 8.7720, std. dev.: 0.0394) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.88% (2.6656 => 2.7425, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: 2.88% (0.6459 => 0.6645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.6308 => 0.6467, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.25% (1.2726 => 1.3012, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.12% (4.6127 => 4.7105, std. dev.: 0.0126) MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.1938 => 5.3030, std. dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 1.72% (14.4877 => 14.7365, std. dev.: 0.0123) MultiSource/Applications/siod/siod: 1.68% (3.5520 => 3.6118, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4455 => 2.4822, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5328, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 1.38% (2.5166 => 2.5514, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.45% (0.7738 => 0.7626, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.87% (5.2665 => 4.1148, std. dev.: 0.0913) SingleSource/Benchmarks/Shootout-C++/ary3: -20.24% (1.7473 => 1.3937, std. dev.: 0.0492) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.49% (1.1647 => 0.9377, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std. dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -9.16% (62.4126 => 56.6932, std. dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.34% (2.4457 => 2.2417, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.91% (3.2007 => 2.9474, std. dev.: 0.0252) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.11% (3.6254 => 3.3677, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (3.4230 => 3.1900, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3502, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7928, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4091, std. dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -4.38% (1.4117 => 1.3498, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/distray/distray: -3.90% (0.2664 => 0.2560, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.2959 => 1.2494, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.42% (1.1683 => 1.1283, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: -3.40% (7.6833 => 7.4222, std. dev.: 0.0564) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9451, std. dev.: 0.0214) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.17% (1.7361 => 1.6810, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4140 => 0.4017, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2911, std. dev.: 0.0371) MultiSource/Applications/aha/aha: -2.68% (3.4286 => 3.3366, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.39% (3.7496 => 3.6599, std. dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.34% (1.2722 => 1.2424, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.06% (2.8964 => 2.8366, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4182, std. dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -1.76% (3.8907 => 3.8224, std. dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (92.7467 => 91.1740, std. dev.: 0.4471) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2333, std. dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7685, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3285, std. dev.: 0.0686) MultiSource/Applications/JM/lencod/lencod: -1.14% (6.7458 => 6.6688, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/lists: -1.06% (16.5617 => 16.3864, std. dev.: 0.0415) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 20:44:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 22:44:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913034458.DA04F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3741?compare_to=3738&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3741, Order: 163765, Start Time: 2012-09-13 02:31:52, End Time: 2012-09-13 03:46:16 To: 3738, Order: 163757, Start Time: 2012-09-13 00:49:19, End Time: 2012-09-13 02:03:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.69% (78.5292 => 79.8527, std. dev.: 0.3322) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -1.82% (0.5500 => 0.5400, std. dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.83% (2.0176 => 2.3976, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.04% (0.3578 => 0.3973, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7061 => 0.7840, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.83% (0.3601 => 0.3991, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.82% (0.3623 => 0.4015, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3663 => 0.4059, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.80% (0.7710 => 0.8543, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3646 => 0.4038, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.66% (0.3650 => 0.4039, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3789 => 0.4192, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3914 => 0.4323, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.4003 => 0.4420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.30% (0.3940 => 0.4346, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.81% (3.9660 => 4.3552, std. dev.: 0.0078) MultiSource/Applications/hbd/hbd: 9.68% (1.3693 => 1.5019, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.5265 => 0.5749, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.84% (0.7038 => 0.7660, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.78% (0.9199 => 1.0007, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.75% (1.2193 => 1.3260, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4328 => 0.4703, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.54% (1.4563 => 1.5807, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2310, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.15% (0.4062 => 0.4393, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6283 => 0.6788, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.03% (0.7506 => 0.8109, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.00% (0.5577 => 0.6023, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.90% (13.8202 => 14.9120, std. dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.86% (0.4379 => 0.4723, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.2914 => 0.3141, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.77% (7.2180 => 7.7785, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3899 => 0.4198, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3756 => 0.4041, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.55% (1.0313 => 1.1092, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.43% (0.4390 => 0.4716, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3293 => 0.3537, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.4791 => 0.5145, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.33% (1.9828 => 2.1281, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.3489 => 0.3744, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3485 => 0.3739, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.25% (1.1061 => 1.1863, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.08% (0.3107 => 0.3327, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.08% (3.6692 => 3.9289, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2761 => 0.2956, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5637 => 0.6035, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.99% (3.8646 => 4.1349, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.7460 => 0.7964, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 6.74% (0.8310 => 0.8870, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.73% (3.1889 => 3.4035, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3453 => 0.3684, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.58% (1.3245 => 1.4116, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.55% (1.3813 => 1.4718, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 6.51% (1.9270 => 2.0525, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (1.3819 => 1.4707, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.4113 => 0.4377, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.41% (0.6744 => 0.7176, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.24% (4.3801 => 4.6532, std. dev.: 0.0080) MultiSource/Applications/siod/siod: 6.22% (2.1791 => 2.3147, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.18% (4.4433 => 4.7177, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.05% (1.0594 => 1.1235, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (1.2749 => 1.3518, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.90% (0.6135 => 0.6497, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.85% (0.8698 => 0.9207, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.84% (16.6129 => 17.5831, std. dev.: 0.0182) MultiSource/Benchmarks/mafft/pairlocalalign: 5.81% (8.4961 => 8.9901, std. dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.78% (14.8535 => 15.7120, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1333 => 1.1964, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 5.51% (14.5298 => 15.3311, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9984, std. dev.: 0.0216) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.33% (0.8818 => 0.9288, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.04% (6.5754 => 6.9067, std. dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.6576 => 0.6905, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.92% (4.6629 => 4.8924, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.68% (3.2742 => 3.4275, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2292 => 1.2861, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4805 => 0.5021, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1948, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (1.5188 => 1.5816, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 4.07% (3.7467 => 3.8993, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6250 => 0.6502, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2785 => 6.5079, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.65% (2.1007 => 2.1773, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.76% (33.2944 => 34.2149, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5425, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0455) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3790, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6971, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9832, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1019, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6010, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5950, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.93% (0.4657 => 0.4055, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.84% (22.5627 => 21.6959, std. dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2719, std. dev.: 0.0112) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.51% (1.3780 => 1.3021, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1506, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9225, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5911, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.16% (26.5159 => 25.9437, std. dev.: 0.0238) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2451, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2274, std. dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0605, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 21:27:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 23:27:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913042713.A5C392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3742?compare_to=3740&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3742, Order: 163772, Start Time: 2012-09-13 03:18:13, End Time: 2012-09-13 04:28:33 To: 3740, Order: 163765, Start Time: 2012-09-13 01:52:18, End Time: 2012-09-13 03:02:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 17 (70 on baseline) Performance Improvements: 0 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 884 (785 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.57% (0.4397 => 0.4642, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.31% (0.8722 => 0.9185, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.27% (0.2943 => 0.3098, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5503 => 0.5759, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.23% (0.3072 => 0.3202, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 3.18% (0.4210 => 0.4344, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.13% (0.5844 => 0.6027, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.97% (0.5455 => 0.5617, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4527 => 0.4636, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.1833 => 1.2067, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8308 => 0.8462, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.2573 => 1.2761, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.20% (1.3627 => 1.3791, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.05% (0.0527 => 0.0659, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 15.13% (0.0714 => 0.0822, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.28% (1.8128 => 1.8542, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.65% (2.2417 => 2.2786, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.68% (0.0745 => 0.0914, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.55% (0.1414 => 0.1549, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 5.78% (2.1763 => 2.3020, std. dev.: 0.0261) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.62% (0.6410 => 0.6770, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.53% (0.3026 => 0.3163, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 4.45% (0.6173 => 0.6448, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 4.26% (0.3217 => 0.3354, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3582 => 0.3729, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.1653 => 1.2124, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.6915 => 0.7190, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.94% (1.3268 => 1.3791, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.68% (15.3105 => 15.8732, std. dev.: 0.1206) MultiSource/Applications/lemon/lemon: 3.57% (1.0046 => 1.0405, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.7722 => 0.7982, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.5150 => 1.5645, std. dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: 3.09% (29.3170 => 30.2216, std. dev.: 0.2315) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.41% (1.1440 => 1.1716, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.35% (3.0225 => 3.0936, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.04% (1.3935 => 1.4219, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.1827 => 1.2067, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.97% (0.7226 => 0.7368, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.87% (3.5980 => 3.6652, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.86% (1.4113 => 1.4375, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 1.83% (13.3238 => 13.5681, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.77% (1.1672 => 1.1879, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.73% (0.9029 => 0.9185, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (12.6413 => 12.8550, std. dev.: 0.0567) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.0689 => 1.0840, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (6.2546 => 6.3423, std. dev.: 0.0242) MultiSource/Applications/siod/siod: 1.36% (2.0972 => 2.1258, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.31% (8.2186 => 8.3263, std. dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.0758 => 3.1144, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 1.17% (4.7455 => 4.8008, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 1.12% (14.6079 => 14.7713, std. dev.: 0.0284) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 32.06% (0.0499 => 0.0659, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0139) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std. dev.: 0.0407) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3746 => 0.4276, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.83% (4.0101 => 4.5647, std. dev.: 0.0112) SingleSource/Benchmarks/Stanford/Puzzle: 13.40% (0.1433 => 0.1625, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.17% (0.2694 => 0.2995, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.94% (7.0025 => 7.6283, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.92% (1.0063 => 1.0961, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.87% (4.2129 => 4.5023, std. dev.: 0.0461) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.55% (0.2857 => 0.3044, std. dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: 6.45% (1.0194 => 1.0852, std. dev.: 0.0176) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8086, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.79% (15.2242 => 15.9529, std. dev.: 0.0536) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.17% (40.4792 => 42.1657, std. dev.: 0.5584) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8713, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.48% (0.8498 => 0.8794, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 3.32% (1.4184 => 1.4655, std. dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.70% (0.5587 => 0.5738, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 2.59% (8.5113 => 8.7320, std. dev.: 0.0488) MultiSource/Benchmarks/BitBench/five11/five11: 2.58% (5.1938 => 5.3280, std. dev.: 0.0299) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.54% (2.6656 => 2.7334, std. dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.74% (2.5166 => 2.5603, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 1.55% (14.4877 => 14.7118, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 1.46% (3.5520 => 3.6040, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5314, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (4.6127 => 4.6658, std. dev.: 0.0158) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.06% (4.0659 => 4.1091, std. dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.46% (0.3497 => 0.2047, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.37% (5.2665 => 4.0882, std. dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/ary3: -20.40% (1.7473 => 1.3909, std. dev.: 0.0761) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.40% (1.1647 => 0.9388, std. dev.: 0.0278) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5302, std. dev.: 0.1149) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.41% (3.2007 => 2.9635, std. dev.: 0.0537) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3665, std. dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.83% (2.4457 => 2.2786, std. dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: -6.82% (3.4230 => 3.1897, std. dev.: 0.0651) SingleSource/Benchmarks/Misc/richards_benchmark: -6.60% (1.4441 => 1.3488, std. dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/fibo: -5.11% (4.6355 => 4.3985, std. dev.: 0.0143) MultiSource/Applications/SPASS/SPASS: -4.76% (8.5323 => 8.1260, std. dev.: 0.0861) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.58% (61.1734 => 58.3711, std. dev.: 1.0752) SingleSource/Benchmarks/Shootout-C++/methcall: -3.76% (9.2503 => 8.9026, std. dev.: 0.0674) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.30% (1.1683 => 1.1297, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.27% (1.7361 => 1.6793, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -3.19% (7.6833 => 7.4381, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.7496 => 3.6391, std. dev.: 0.0184) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.95% (0.4140 => 0.4018, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std. dev.: 0.0075) MultiSource/Applications/aha/aha: -2.82% (3.4286 => 3.3318, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2883, std. dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.64% (1.2722 => 1.2386, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.41% (2.8964 => 2.8267, std. dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4186, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2304, std. dev.: 0.0392) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0926 => 1.0772, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std. dev.: 0.0602) SingleSource/Benchmarks/Shootout-C++/lists: -1.21% (16.5617 => 16.3605, std. dev.: 0.0509) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.05% (1.8739 => 1.8542, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 21:44:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Sep 2012 23:44:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913044418.BBA572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3743?compare_to=3739&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3743, Order: 163772, Start Time: 2012-09-13 03:26:07, End Time: 2012-09-13 04:45:36 To: 3739, Order: 163762, Start Time: 2012-09-13 01:38:19, End Time: 2012-09-13 02:57:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (125 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 2.28% (1.1953 => 1.2225, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.23% (54.4762 => 55.6898, std. dev.: 0.4441) SingleSource/Benchmarks/Misc/lowercase: 1.17% (7.9602 => 8.0530, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.46% (14.9733 => 14.7544, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.32% (10.3673 => 14.7544, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 25.77% (0.1622 => 0.2040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3543 => 0.4061, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 14.54% (0.3473 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3543 => 0.4042, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3516 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.04% (0.3497 => 0.3988, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.82% (0.3561 => 0.4053, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3694 => 0.4197, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (2.2022 => 2.4926, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.12% (7.0540 => 7.9792, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 13.11% (0.3927 => 0.4442, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.94% (0.3886 => 0.4389, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.81% (1.7609 => 1.9513, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.35% (0.3282 => 0.3556, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.62% (0.8172 => 0.8795, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.10% (0.7326 => 0.7846, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 7.07% (10.4361 => 11.1743, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 6.85% (0.7835 => 0.8372, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 6.74% (9.4845 => 10.1240, std. dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (8.1363 => 8.6766, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7433 => 0.7902, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.29% (0.3307 => 0.3515, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.29% (4.2646 => 4.5328, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.25% (0.5860 => 0.6226, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3423 => 0.3635, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.16% (0.7115 => 0.7553, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.13% (0.3817 => 0.4051, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.07% (0.5569 => 0.5907, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 5.93% (3.3354 => 3.5333, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (1.5415 => 1.6329, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 5.85% (0.3109 => 0.3291, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.3050 => 1.3810, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (5.0018 => 5.2907, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.9449 => 5.2295, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.74% (0.6675 => 0.7058, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.61% (5.7591 => 6.0821, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.8067 => 0.8519, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.50% (0.5105 => 0.5386, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.34% (0.3092 => 0.3257, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9765 => 1.0282, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4299 => 0.4526, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.18% (1.1642 => 1.2245, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 4.97% (1.5603 => 1.6378, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.95% (1.1861 => 1.2448, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 4.76% (3.8723 => 4.0565, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.69% (0.3387 => 0.3546, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.58% (2.0273 => 2.1201, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.5020 => 0.5246, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (7.9617 => 8.3188, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 4.43% (1.0722 => 1.1197, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.25% (0.6450 => 0.6724, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.14% (0.4103 => 0.4273, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.11% (21.9371 => 22.8382, std. dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6456 => 0.6721, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4636 => 0.4826, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5981 => 0.6225, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 4.07% (2.2969 => 2.3904, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.96% (0.4064 => 0.4225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.90% (0.8921 => 0.9269, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (14.3668 => 14.9211, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.4186 => 1.4704, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4289 => 0.4443, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.50% (0.3826 => 0.3960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.4203 => 0.4348, std. dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.41% (0.3136 => 0.3243, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.40% (0.4620 => 0.4777, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6385, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.4048 => 0.4180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0665 => 2.1338, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3603 => 0.3718, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (2.2024 => 2.2682, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.8101 => 0.8327, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.1840 => 1.2161, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.89% (1.2842 => 1.3085, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std. dev.: 0.0037) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3835, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.1396 => 1.2156, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7560, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3504, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2299, std. dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.12% (2.2771 => 2.3026, std. dev.: 0.0060) MultiSource/Applications/lua/lua: 1.05% (26.0924 => 26.3665, std. dev.: 0.0204) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1298, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.86% (5.2763 => 3.2260, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.38% (5.3855 => 3.8571, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.05% (5.3526 => 3.8512, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1781, std. dev.: 0.0307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.82% (2.9384 => 2.5911, std. dev.: 0.0128) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8584, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2683, std. dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5034, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4252, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9902, std. dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0067, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4228, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5767, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -1.20% (1.2373 => 1.2225, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2310, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8552, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 22:13:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 00:13:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120913051335.34B612A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3744?compare_to=3737&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3744, Order: 163765, Start Time: 2012-09-13 02:31:19, End Time: 2012-09-13 05:14:52 To: 3737, Order: 163746, Start Time: 2012-09-12 23:18:54, End Time: 2012-09-13 02:02:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 15.44% (0.3465 => 0.4000, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 15.44% (0.3446 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.31% (0.3442 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.31% (0.3488 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.30% (0.3496 => 0.4031, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.20% (0.3460 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.16% (0.3469 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.68% (0.3650 => 0.4186, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.66% (0.3643 => 0.4177, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.37% (0.3724 => 0.4259, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5826 => 0.6369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.5889 => 0.6434, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.1620 => 0.1762, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7171 => 0.7718, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 7.46% (1.5932 => 1.7120, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.38% (3.5627 => 3.8258, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (1.6211 => 1.7396, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.06% (1.3152 => 1.4081, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.79% (0.4361 => 0.4657, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (0.4994 => 0.5324, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.5900 => 0.6286, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.49% (0.5026 => 0.5352, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.5000 => 0.5317, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (0.3930 => 0.4176, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.11% (0.4029 => 0.4275, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.09% (0.3004 => 0.3187, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.02% (4.2109 => 4.4643, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2738 => 0.2899, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.7292 => 2.8883, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.83% (0.3792 => 0.4013, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.76% (1.0781 => 1.1402, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.53% (0.2875 => 0.3034, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.48% (0.2866 => 0.3023, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (0.3890 => 0.4095, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.2736 => 0.2880, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.26% (0.3195 => 0.3363, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.23% (0.2811 => 0.2958, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.23% (0.9909 => 1.0427, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: 5.23% (0.2813 => 0.2960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2792 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.2823 => 0.2968, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.13% (5.5417 => 5.8258, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (2.0673 => 2.1732, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.11% (0.2780 => 0.2922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.09% (0.2729 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.05% (2.1013 => 2.2075, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 5.03% (0.2803 => 0.2944, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.98% (0.2911 => 0.3056, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.3096 => 0.3250, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.96% (1.9694 => 2.0670, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.94% (1.9966 => 2.0952, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.3903 => 0.4095, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.87% (0.3267 => 0.3426, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.82% (0.3258 => 0.3415, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (0.4658 => 0.4882, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3060 => 0.3207, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3124 => 0.3274, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3317 => 0.3474, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.71% (0.4139 => 0.4334, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.3362 => 0.3520, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (1.8794 => 1.9676, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.66% (0.3348 => 0.3504, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.64% (0.3726 => 0.3899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.63% (0.3477 => 0.3638, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3625 => 0.3791, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.51% (4.6177 => 4.8260, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (2.1653 => 2.2627, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 4.49% (0.3678 => 0.3843, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (4.4195 => 4.6144, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 4.39% (1.4269 => 1.4895, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.36% (0.5546 => 0.5788, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (0.4251 => 0.4435, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.27% (0.6634 => 0.6917, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.3845 => 0.4009, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.23% (0.7875 => 0.8208, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3690 => 0.3846, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.3271 => 0.3409, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.2969 => 0.3094, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.20% (23.5202 => 24.5083, std. dev.: 0.0076) MultiSource/Applications/hbd/hbd: 4.19% (0.9697 => 1.0103, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.3981 => 0.4143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.2737 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.6435 => 0.6677, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.5012 => 0.5197, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.54% (2.0346 => 2.0862, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.29% (0.4847 => 0.4958, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (0.7426 => 0.7567, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (11.6398 => 11.7721, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (4.6926 => 4.7434, std. dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6683, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1665, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6413, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2017, std. dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5016, std. dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4444, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5944, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5422, std. dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7854, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.91% (0.2402 => 0.2236, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8042, std. dev.: 0.0102) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.30% (17.2379 => 16.8419, std. dev.: 0.0364) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5819, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.67% (0.6293 => 0.6188, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9754, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 12 22:27:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 00:27:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913052739.BE6702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3745?compare_to=3741&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3745, Order: 163772, Start Time: 2012-09-13 04:14:27, End Time: 2012-09-13 05:28:57 To: 3741, Order: 163765, Start Time: 2012-09-13 02:31:52, End Time: 2012-09-13 03:46:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (173 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.15% (0.4020 => 0.4227, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.05% (55.7510 => 56.3361, std. dev.: 0.1768) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.93% (2.0176 => 2.3995, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.86% (0.5818 => 0.6508, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.76% (0.5748 => 0.6424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.73% (0.7061 => 0.7889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3578 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.41% (0.3646 => 0.4062, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.39% (0.3601 => 0.4011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3650 => 0.4062, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3623 => 0.4031, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.25% (0.3663 => 0.4075, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.16% (0.3789 => 0.4212, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.01% (0.3914 => 0.4345, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.97% (0.4003 => 0.4442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.89% (0.3940 => 0.4369, std. dev.: 0.0092) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.71% (0.7710 => 0.8536, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.15% (3.9660 => 4.3686, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.02% (0.2596 => 0.2856, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.96% (1.3693 => 1.5057, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.22% (1.2193 => 1.3317, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.01% (0.4328 => 0.4718, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.97% (0.9199 => 1.0024, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.94% (0.7038 => 0.7667, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.74% (1.4563 => 1.5836, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.65% (1.1364 => 1.2347, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.62% (0.5577 => 0.6058, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.35% (0.4062 => 0.4401, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.34% (0.2781 => 0.3013, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2782 => 0.3010, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 8.19% (13.8202 => 14.9514, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (7.2180 => 7.8055, std. dev.: 0.0114) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.11% (0.4379 => 0.4734, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.07% (0.7506 => 0.8112, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.04% (0.3022 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.02% (0.6283 => 0.6787, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2726 => 0.2941, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3485 => 0.3758, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.75% (0.2607 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.74% (0.3293 => 0.3548, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.70% (0.2690 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.68% (0.2655 => 0.2859, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2760 => 0.2972, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.63% (0.3580 => 0.3853, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.61% (0.3756 => 0.4042, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2761 => 0.2971, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.59% (1.0313 => 1.1096, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.59% (1.9828 => 2.1332, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 7.57% (0.2628 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.52% (0.2937 => 0.3158, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.52% (0.4390 => 0.4720, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.49% (0.4791 => 0.5150, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.45% (3.6692 => 3.9427, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3107 => 0.3338, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.42% (0.3192 => 0.3429, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.42% (0.3246 => 0.3487, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.42% (0.3220 => 0.3459, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2765 => 0.2969, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.37% (1.1061 => 1.1876, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.36% (0.5637 => 0.6052, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.32% (0.4016 => 0.4310, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.27% (0.3149 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (3.8646 => 4.1409, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.12% (0.7460 => 0.7991, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.10% (0.3534 => 0.3785, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.08% (0.3868 => 0.4142, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.04% (1.3245 => 1.4177, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 7.00% (3.1889 => 3.4120, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 6.99% (0.8310 => 0.8891, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4764, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.88% (1.3819 => 1.4770, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.73% (0.6744 => 0.7198, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 6.66% (1.9270 => 2.0554, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 6.54% (0.2859 => 0.3046, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.49% (4.3801 => 4.6645, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.44% (4.4433 => 4.7295, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 6.42% (2.1791 => 2.3189, std. dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 6.32% (1.0594 => 1.1264, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.22% (1.2749 => 1.3542, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.6135 => 0.6512, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.11% (14.8535 => 15.7613, std. dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (8.4961 => 9.0076, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.99% (0.8698 => 0.9219, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.98% (16.6129 => 17.6056, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.92% (0.6576 => 0.6965, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.91% (0.3755 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.76% (1.1333 => 1.1986, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.72% (0.3131 => 0.3310, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.67% (14.5298 => 15.3539, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.62% (13.2842 => 14.0312, std. dev.: 0.0207) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.58% (0.8818 => 0.9310, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.39% (0.3245 => 0.3420, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.32% (6.5754 => 6.9253, std. dev.: 0.0258) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.05% (4.6629 => 4.8983, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.02% (1.2292 => 1.2909, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.67% (3.2742 => 3.4272, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.4805 => 0.5029, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.27% (0.9108 => 0.9497, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.6250 => 0.6513, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.20% (4.9865 => 5.1957, std. dev.: 0.0125) MultiSource/Applications/lua/lua: 4.19% (3.7467 => 3.9035, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.16% (1.5188 => 1.5820, std. dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (6.2785 => 6.5244, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.1007 => 2.1784, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.05% (0.3511 => 0.3618, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.72% (33.2944 => 34.2015, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5490, std. dev.: 0.0249) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.36% (5.7573 => 7.5055, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2678, std. dev.: 0.0391) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.97% (1.0895 => 1.3506, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3824, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.97% (10.7476 => 11.0669, std. dev.: 0.0343) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6053, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0092) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5867, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.63% (0.4657 => 0.4069, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.6998, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2557, std. dev.: 0.0305) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.77% (1.3780 => 1.2985, std. dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9245, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5972, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8971, std. dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2422, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.1080 => 4.0570, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8731, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5619, std. dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2614, std. dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4351, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 00:21:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 02:21:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913072106.430602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3746?compare_to=3742&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3746, Order: 163774, Start Time: 2012-09-13 06:11:21, End Time: 2012-09-13 07:22:24 To: 3742, Order: 163772, Start Time: 2012-09-13 03:18:13, End Time: 2012-09-13 04:28:33 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (56 on baseline) Performance Improvements: 2 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5513 => 0.5683, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 6.44% (8.1260 => 8.6494, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.59% (58.3711 => 61.0491, std. dev.: 0.9819) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.62% (4.4771 => 4.5496, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/ReedSolomon: 1.53% (8.7320 => 8.8659, std. dev.: 0.0154) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.29% (2.8267 => 2.8633, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 1.10% (8.9026 => 9.0003, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.00% (1.6137 => 1.6299, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (0.9185 => 0.8974, std. dev.: 0.0070) MultiSource/Applications/hbd/hbd: -1.30% (1.3791 => 1.3612, std. dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.04% (0.5309 => 0.5683, std. dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: 6.11% (2.1763 => 2.3093, std. dev.: 0.0211) MultiSource/Applications/minisat/minisat: 5.88% (0.6173 => 0.6536, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.6410 => 0.6748, std. dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 4.90% (15.3105 => 16.0610, std. dev.: 0.2134) MultiSource/Applications/lambda-0_1_3/lambda: 4.11% (0.6915 => 0.7199, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.04% (0.2552 => 0.2655, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (1.1653 => 1.2107, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.69% (0.3582 => 0.3714, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.31% (0.3901 => 0.4030, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.91% (29.3170 => 30.1693, std. dev.: 0.0399) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.5150 => 1.5585, std. dev.: 0.0097) MultiSource/Applications/d/make_dparser: 2.64% (3.0225 => 3.1023, std. dev.: 0.0177) MultiSource/Applications/hbd/hbd: 2.59% (1.3268 => 1.3612, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 2.58% (1.1440 => 1.1735, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.7226 => 0.7398, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.30% (0.8569 => 0.8766, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.27% (13.3238 => 13.6267, std. dev.: 0.0746) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.95% (8.2559 => 8.4171, std. dev.: 0.0393) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.68% (6.2546 => 6.3594, std. dev.: 0.0334) MultiSource/Applications/oggenc/oggenc: 1.63% (4.7455 => 4.8227, std. dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (4.0318 => 4.0825, std. dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: 1.09% (8.2186 => 8.3083, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3394, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std. dev.: 0.0338) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.05% (0.0917 => 0.1055, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std. dev.: 0.0237) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.60% (4.0101 => 4.5556, std. dev.: 0.0693) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1433 => 0.1598, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6210, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.62% (1.0063 => 1.0830, std. dev.: 0.0221) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.32% (0.2857 => 0.3066, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3301 => 0.3505, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (27.1724 => 28.8417, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/fp-convert: 4.51% (15.2242 => 15.9103, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 4.17% (8.5113 => 8.8659, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: 3.78% (0.9851 => 1.0223, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8734, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4651, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.72% (2.6656 => 2.7382, std. dev.: 0.0175) MultiSource/Benchmarks/BitBench/five11/five11: 2.66% (5.1938 => 5.3321, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 1.90% (14.4877 => 14.7629, std. dev.: 0.0428) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (2.4455 => 2.4917, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.79% (4.6127 => 4.6951, std. dev.: 0.0208) MultiSource/Applications/siod/siod: 1.51% (3.5520 => 3.6055, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5338, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 1.37% (8.5323 => 8.6494, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout/hash: 1.27% (4.3016 => 4.3564, std. dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.6110 => 1.6299, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.29% (0.3497 => 0.2053, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.75% (5.2665 => 4.1209, std. dev.: 0.0581) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.20% (1.1647 => 0.9411, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.39% (62.4126 => 56.5530, std. dev.: 0.0895) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.74% (3.2007 => 2.9210, std. dev.: 0.0601) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.48% (2.4457 => 2.2384, std. dev.: 0.0761) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.11% (3.6254 => 3.3678, std. dev.: 0.0186) MultiSource/Applications/SIBsim4/SIBsim4: -6.77% (3.4230 => 3.1914, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3567, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4052, std. dev.: 0.0316) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.91% (1.7361 => 1.6683, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.88% (1.8739 => 1.8012, std. dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.65% (1.1683 => 1.1256, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.65% (0.4140 => 0.3989, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -3.17% (7.6833 => 7.4396, std. dev.: 0.0346) SingleSource/Benchmarks/Misc/ffbench: -2.90% (1.4117 => 1.3708, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8294, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2861, std. dev.: 0.0093) MultiSource/Applications/aha/aha: -2.73% (3.4286 => 3.3350, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -2.70% (9.2503 => 9.0003, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.56% (3.7496 => 3.6535, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4182, std. dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.91% (45.4683 => 44.5995, std. dev.: 0.2758) MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (92.7467 => 90.9919, std. dev.: 0.1411) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2231, std. dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.3569 => 2.3234, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7683, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3189, std. dev.: 0.0163) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.8964 => 2.8633, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 00:39:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 02:39:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913073948.4B28E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3747?compare_to=3745&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3747, Order: 163774, Start Time: 2012-09-13 06:23:34, End Time: 2012-09-13 07:41:01 To: 3745, Order: 163772, Start Time: 2012-09-13 04:14:27, End Time: 2012-09-13 05:28:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (733 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.47% (0.5344 => 0.5476, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.94% (2.0176 => 2.3997, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.83% (0.7061 => 0.7896, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 11.81% (0.5818 => 0.6505, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 11.79% (0.3578 => 0.4000, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.67% (0.5748 => 0.6419, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3601 => 0.4012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.41% (0.3663 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.38% (0.3789 => 0.4220, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3646 => 0.4060, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: 11.34% (0.3623 => 0.4034, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.34% (0.7710 => 0.8584, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3650 => 0.4063, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.01% (0.3914 => 0.4345, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.97% (0.4003 => 0.4442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.84% (0.3940 => 0.4367, std. dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.59% (0.2596 => 0.2871, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 10.45% (0.1062 => 0.1173, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.13% (3.9660 => 4.3679, std. dev.: 0.1123) MultiSource/Applications/hbd/hbd: 9.97% (1.3693 => 1.5058, std. dev.: 0.0453) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.57% (0.5265 => 0.5769, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.27% (0.1327 => 0.1450, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.10% (1.2193 => 1.3303, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.04% (1.4563 => 1.5879, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: 8.99% (0.4328 => 0.4717, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.98% (0.6959 => 0.7584, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.96% (0.9199 => 1.0023, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std. dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 8.63% (0.2781 => 0.3021, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.60% (1.1364 => 1.2341, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 8.47% (0.7506 => 0.8142, std. dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 8.29% (13.8202 => 14.9661, std. dev.: 0.2883) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 8.22% (0.4062 => 0.4396, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2782 => 0.3010, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.14% (0.3022 => 0.3268, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.07% (7.2180 => 7.8004, std. dev.: 0.0352) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.06% (0.2914 => 0.3149, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.06% (0.4379 => 0.4732, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.05% (0.5577 => 0.6026, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6283 => 0.6788, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.89% (0.3485 => 0.3760, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.88% (0.3580 => 0.3862, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.87% (0.3293 => 0.3552, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.79% (0.2607 => 0.2810, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.77% (0.3489 => 0.3760, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.73% (1.9828 => 2.1360, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.72% (0.2655 => 0.2860, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2761 => 0.2974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.3756 => 0.4045, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.65% (0.2628 => 0.2829, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.63% (0.4390 => 0.4725, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2726 => 0.2934, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2966 => 0.3191, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2765 => 0.2974, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (3.6692 => 3.9455, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wc: 7.52% (0.2937 => 0.3158, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.48% (0.2995 => 0.3219, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.4016 => 0.4315, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.3107 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.2988 => 0.3209, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3149 => 0.3381, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.34% (0.5637 => 0.6051, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 7.29% (3.8646 => 4.1464, std. dev.: 0.1027) SingleSource/Benchmarks/Shootout-C++/lists1: 7.13% (0.3534 => 0.3786, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 7.09% (3.1889 => 3.4151, std. dev.: 0.0661) SingleSource/Benchmarks/Shootout-C++/moments: 7.06% (0.3868 => 0.4141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3192 => 0.3417, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.02% (1.3819 => 1.4789, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.98% (0.3453 => 0.3694, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.97% (1.3813 => 1.4776, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 6.87% (0.8310 => 0.8881, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4113 => 0.4395, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.85% (1.3245 => 1.4152, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 6.75% (1.9270 => 2.0571, std. dev.: 0.0425) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (1.2749 => 1.3582, std. dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/objinst: 6.52% (0.2945 => 0.3137, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.47% (4.3801 => 4.6635, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.44% (4.4433 => 4.7293, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 6.38% (1.0594 => 1.1270, std. dev.: 0.0122) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.2140 => 0.2276, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.06% (0.8698 => 0.9225, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.05% (8.4961 => 9.0098, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.97% (0.3755 => 0.3979, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.69% (0.8818 => 0.9320, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (13.2842 => 14.0225, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.29% (4.6629 => 4.9098, std. dev.: 0.0876) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.81% (0.4805 => 0.5036, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (3.2742 => 3.4242, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6250 => 0.6521, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.24% (4.9865 => 5.1981, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.04% (1.5188 => 1.5802, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.86% (6.2785 => 6.5211, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.1007 => 2.1787, std. dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.02% (0.3511 => 0.3617, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.78% (33.2944 => 34.2205, std. dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std. dev.: 0.0464) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.55% (0.2093 => 0.2230, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6983, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6021, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5986, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.67% (0.4657 => 0.4067, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (22.5627 => 21.7189, std. dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0235) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2659, std. dev.: 0.0200) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.38% (1.3780 => 1.2901, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std. dev.: 0.0397) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std. dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.43% (8.8259 => 8.6114, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2387, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.19% (4.1080 => 4.0593, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.14% (7.3305 => 7.2468, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 5.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 00:45:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 02:45:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913074515.823CA2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3748?compare_to=3743&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3748, Order: 163774, Start Time: 2012-09-13 06:23:42, End Time: 2012-09-13 07:46:33 To: 3743, Order: 163772, Start Time: 2012-09-13 03:26:07, End Time: 2012-09-13 04:45:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (119 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (730 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (0.8795 => 0.8905, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.27% (55.6898 => 56.3974, std. dev.: 0.1171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.39% (10.3673 => 14.7622, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 25.71% (0.1622 => 0.2039, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 14.31% (0.3473 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.01% (0.3497 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.91% (0.3543 => 0.4036, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.91% (0.3516 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.89% (0.3543 => 0.4035, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.82% (0.3561 => 0.4053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3694 => 0.4196, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (2.2022 => 2.4927, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.12% (7.0540 => 7.9796, std. dev.: 0.0110) SingleSource/UnitTests/ObjC/parameter-passing: 13.04% (0.3927 => 0.4439, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.92% (0.3886 => 0.4388, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.80% (1.1194 => 1.2515, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.81% (1.7609 => 1.9513, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.97% (0.8172 => 0.8905, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.47% (0.3177 => 0.3446, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 8.35% (0.3282 => 0.3556, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.58% (0.1940 => 0.2087, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.50% (0.2107 => 0.2265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7326 => 0.7847, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: 7.05% (0.7835 => 0.8387, std. dev.: 0.0212) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.01% (0.4879 => 0.5221, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 7.00% (10.4361 => 11.1665, std. dev.: 0.1855) SingleSource/Benchmarks/McGill/chomp: 6.95% (0.1655 => 0.1770, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.74% (9.4845 => 10.1241, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2271 => 0.2422, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.60% (0.2758 => 0.2940, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.57% (0.3121 => 0.3326, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5569 => 0.5934, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.50% (8.1363 => 8.6648, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.48% (0.2700 => 0.2875, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.5860 => 0.6236, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3423 => 0.3638, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (4.2646 => 4.5313, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.06% (0.7115 => 0.7546, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.05% (0.3817 => 0.4048, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.02% (1.5415 => 1.6343, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.6675 => 0.7062, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.78% (4.9449 => 5.2308, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.3050 => 1.3801, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.73% (5.0018 => 5.2886, std. dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 5.73% (5.7591 => 6.0893, std. dev.: 0.1144) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.8067 => 0.8527, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.62% (0.5105 => 0.5392, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4299 => 0.4531, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.32% (1.1861 => 1.2492, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 5.27% (0.3092 => 0.3255, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.15% (0.9765 => 1.0268, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 5.04% (1.5603 => 1.6390, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.94% (0.3441 => 0.3611, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 4.70% (3.8723 => 4.0543, std. dev.: 0.0119) MultiSource/Benchmarks/sim/sim: 4.61% (0.3387 => 0.3543, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (7.9617 => 8.3207, std. dev.: 0.0124) MultiSource/Applications/lemon/lemon: 4.50% (1.0722 => 1.1204, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.49% (0.2603 => 0.2720, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.41% (0.4103 => 0.4284, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.5020 => 0.5237, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6456 => 0.6730, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.11% (0.8921 => 0.9288, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5981 => 0.6226, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 4.06% (0.3422 => 0.3561, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.4064 => 0.4229, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.4636 => 0.4824, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.88% (1.4186 => 1.4737, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (14.3668 => 14.9045, std. dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3865 => 0.4004, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4289 => 0.4441, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.52% (0.4203 => 0.4351, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.48% (0.3826 => 0.3959, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.44% (1.1840 => 1.2247, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.4620 => 0.4775, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6385, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (2.0665 => 2.1343, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.4048 => 0.4178, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.20% (0.3684 => 0.3802, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (2.2024 => 2.2687, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.8101 => 0.8279, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.03% (1.2842 => 1.3103, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.95% (1.1145 => 1.3703, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0043) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4145, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2142, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7595, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3509, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2298, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1299, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.82% (5.2763 => 3.2283, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.41% (5.3855 => 3.8557, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.93% (5.3526 => 3.8576, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1695, std. dev.: 0.0352) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.95% (2.9384 => 2.5873, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8767, std. dev.: 0.4221) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2796, std. dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4834, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.67% (0.3463 => 0.3232, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7169, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.17% (1.6805 => 1.5768, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5129, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4229, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.61% (10.2830 => 10.0145, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -2.59% (1.2373 => 1.2053, std. dev.: 0.0111) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9897, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5794, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 01:28:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 03:28:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120913082832.508062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3749?compare_to=3744&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3749, Order: 163772, Start Time: 2012-09-13 05:43:03, End Time: 2012-09-13 08:29:50 To: 3744, Order: 163765, Start Time: 2012-09-13 02:31:19, End Time: 2012-09-13 05:14:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (767 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.78% (115.9380 => 130.7571, std. dev.: 1.1277) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.99% (0.3446 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.94% (0.3488 => 0.4044, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 15.87% (0.3465 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.87% (0.3460 => 0.4009, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.83% (0.3442 => 0.3987, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 15.76% (0.3496 => 0.4047, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.71% (0.3469 => 0.4014, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 15.26% (0.3643 => 0.4199, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.15% (0.3650 => 0.4203, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.88% (0.3724 => 0.4278, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.44% (0.1620 => 0.1773, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 9.20% (0.1619 => 0.1768, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5826 => 0.6360, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.07% (0.5889 => 0.6423, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.98% (3.5627 => 3.8469, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 7.83% (1.5932 => 1.7179, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.76% (1.6211 => 1.7469, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.51% (0.4994 => 0.5369, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.50% (1.3152 => 1.4139, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7171 => 0.7699, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.5900 => 0.6332, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.14% (0.5026 => 0.5385, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.2014 => 0.2157, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.86% (0.4361 => 0.4660, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.74% (0.3930 => 0.4195, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.74% (0.5000 => 0.5337, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 6.68% (0.4029 => 0.4298, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.42% (1.0781 => 1.1473, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 6.38% (4.2109 => 4.4797, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.33% (0.3792 => 0.4032, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (2.7292 => 2.8999, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.2866 => 0.3039, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.2736 => 0.2895, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (0.4658 => 0.4917, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.46% (5.5417 => 5.8443, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.43% (2.1013 => 2.2153, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (1.9694 => 2.0758, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (1.9966 => 2.1035, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.3903 => 0.4110, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.24% (0.3890 => 0.4094, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.18% (0.2566 => 0.2699, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.16% (0.2714 => 0.2854, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.15% (0.2875 => 0.3023, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2813 => 0.2956, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.07% (0.3195 => 0.3357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (0.2823 => 0.2966, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.06% (0.3004 => 0.3156, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.01% (0.2792 => 0.2932, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.00% (0.2738 => 0.2875, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.97% (0.9909 => 1.0401, std. dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 4.94% (2.1653 => 2.2723, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 4.92% (4.6177 => 4.8449, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.87% (0.2729 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.87% (0.2750 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.86% (1.8794 => 1.9708, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.83% (2.0673 => 2.1671, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (4.4195 => 4.6328, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2803 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2780 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.74% (0.3060 => 0.3205, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.3362 => 0.3521, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 4.72% (0.3096 => 0.3242, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.71% (0.4139 => 0.4334, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.68% (1.4269 => 1.4937, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.67% (0.2911 => 0.3047, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.67% (0.5546 => 0.5805, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.64% (0.9697 => 1.0147, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3258 => 0.3408, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.54% (0.6634 => 0.6935, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: 4.52% (0.7875 => 0.8231, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.47% (0.3845 => 0.4017, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.46% (0.3317 => 0.3465, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3726 => 0.3892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.44% (0.4146 => 0.4330, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.41% (0.2969 => 0.3100, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.3348 => 0.3495, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3282 => 0.3426, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3477 => 0.3629, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.3625 => 0.3782, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.12% (0.4251 => 0.4426, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (0.2691 => 0.2799, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3690 => 0.3837, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.2737 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.89% (0.3981 => 0.4136, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.86% (23.5202 => 24.4292, std. dev.: 0.0376) MultiSource/Applications/minisat/minisat: 3.75% (0.3336 => 0.3461, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.6435 => 0.6669, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.43% (0.5012 => 0.5184, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.61% (2.0346 => 2.0877, std. dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 2.56% (0.4847 => 0.4971, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (0.7426 => 0.7577, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.00% (0.5361 => 0.5468, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (11.6398 => 11.7741, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.07% (4.6926 => 4.7427, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.2122 => 0.2290, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6754, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std. dev.: 0.1083) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6376, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1966, std. dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5094, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4537, std. dev.: 0.0138) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (2.0820 => 2.1065, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5929, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5748, std. dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7903, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7944, std. dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6920, std. dev.: 0.1090) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0028) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7760, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5729, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9669, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 01:47:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 03:47:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913084748.7AF332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3750?compare_to=3746&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3750, Order: 163782, Start Time: 2012-09-13 07:38:17, End Time: 2012-09-13 08:49:08 To: 3746, Order: 163774, Start Time: 2012-09-13 06:11:21, End Time: 2012-09-13 07:22:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (44 on baseline) Performance Improvements: 10 (34 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 888 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 4.51% (0.3389 => 0.3542, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.10% (1.8012 => 1.8570, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.29% (1.1256 => 1.1401, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -4.73% (0.4316 => 0.4112, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -4.55% (0.2859 => 0.2729, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.65% (0.4420 => 0.4303, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.42% (4.3013 => 4.1974, std. dev.: 0.0396) MultiSource/Applications/kimwitu++/kc: -2.10% (16.0610 => 15.7244, std. dev.: 0.0598) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.92% (8.4171 => 8.2555, std. dev.: 0.0611) MultiSource/Applications/hexxagon/hexxagon: -1.56% (0.9475 => 0.9327, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.31% (1.4054 => 1.3870, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.22% (4.0825 => 4.0328, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -1.78% (8.8659 => 8.7085, std. dev.: 0.0344) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.54% (0.0745 => 0.0898, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.85% (0.6410 => 0.6785, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 5.67% (0.5309 => 0.5610, std. dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 5.30% (2.1763 => 2.2916, std. dev.: 0.0293) MultiSource/Applications/SIBsim4/SIBsim4: 4.39% (1.1653 => 1.2164, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3582 => 0.3728, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 3.84% (0.6173 => 0.6410, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 3.33% (0.6915 => 0.7145, std. dev.: 0.0053) MultiSource/Applications/lemon/lemon: 3.07% (1.0046 => 1.0354, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 2.70% (15.3105 => 15.7244, std. dev.: 0.0598) MultiSource/Benchmarks/Bullet/bullet: 2.40% (29.3170 => 30.0208, std. dev.: 0.1896) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5150 => 1.5513, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.2546 => 6.3320, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.16% (1.2021 => 1.2161, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (8.2186 => 8.3015, std. dev.: 0.0258) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0288) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.54% (0.0766 => 0.0931, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std. dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (4.0101 => 4.5400, std. dev.: 0.0246) MultiSource/Applications/sgefa/sgefa: 12.07% (0.3746 => 0.4198, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.06% (0.2694 => 0.2992, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 9.08% (7.0025 => 7.6385, std. dev.: 0.0085) SingleSource/Benchmarks/Stanford/Puzzle: 8.09% (0.1433 => 0.1549, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.89% (15.8312 => 17.0796, std. dev.: 0.4764) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.53% (0.2857 => 0.3072, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.54% (1.0063 => 1.0721, std. dev.: 0.0255) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7941, std. dev.: 0.0610) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.3301 => 0.3484, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.84% (4.2129 => 4.4168, std. dev.: 0.0562) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8477, std. dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/health/health: 3.57% (0.3420 => 0.3542, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.78% (2.4455 => 2.5135, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 2.32% (8.5113 => 8.7085, std. dev.: 0.0344) MultiSource/Benchmarks/BitBench/five11/five11: 2.07% (5.1938 => 5.3015, std. dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 1.65% (14.4877 => 14.7274, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.62% (2.3453 => 2.3834, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5325, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.29% (0.3497 => 0.2088, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.34% (5.2665 => 4.0898, std. dev.: 0.1033) SingleSource/Benchmarks/Shootout-C++/ary3: -20.17% (1.7473 => 1.3949, std. dev.: 0.0591) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.35% (1.1647 => 0.9393, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/moments: -10.86% (0.1114 => 0.0993, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -9.23% (62.4126 => 56.6497, std. dev.: 0.1023) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.17% (3.6023 => 3.3081, std. dev.: 0.1067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9436, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.49% (2.4457 => 2.2625, std. dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: -7.09% (3.4230 => 3.1802, std. dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.06% (3.6254 => 3.3693, std. dev.: 0.0285) SingleSource/Benchmarks/Misc/richards_benchmark: -6.42% (1.4441 => 1.3514, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.10% (2.9728 => 2.7916, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: -5.85% (1.4117 => 1.3291, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4106, std. dev.: 0.0466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.61% (1.7361 => 1.6735, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -3.42% (7.6833 => 7.4204, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (9.2503 => 8.9364, std. dev.: 0.0517) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.01% (3.9413 => 3.8226, std. dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.83% (3.7496 => 3.6434, std. dev.: 0.0094) SingleSource/Benchmarks/McGill/misr: -2.79% (0.4296 => 0.4176, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0317) MultiSource/Applications/aha/aha: -2.62% (3.4286 => 3.3389, std. dev.: 0.0182) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.59% (1.2959 => 1.2623, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.58% (2.8964 => 2.8216, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.41% (1.1683 => 1.1401, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (9.3855 => 9.2378, std. dev.: 0.0434) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7659, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3103, std. dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 02:22:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 04:22:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913092242.A47512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3751?compare_to=3747&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3751, Order: 163783, Start Time: 2012-09-13 08:09:42, End Time: 2012-09-13 09:24:00 To: 3747, Order: 163774, Start Time: 2012-09-13 06:23:34, End Time: 2012-09-13 07:41:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 15 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 955 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.38% (0.4000 => 0.3825, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: -4.24% (0.4081 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.24% (0.4034 => 0.3863, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.4220 => 0.4044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.16% (0.4012 => 0.3845, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.06% (0.4060 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.01% (0.4063 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.4067 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.87% (0.4367 => 0.4198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.80% (0.4345 => 0.4180, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.74% (0.4442 => 0.4276, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.01% (0.7896 => 0.7658, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -2.26% (0.6419 => 0.6274, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.20% (0.6505 => 0.6362, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.09% (0.8584 => 0.8405, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.93% (2.0176 => 2.3996, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.46% (3.9660 => 4.3411, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5748 => 0.6274, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.01% (0.7710 => 0.8405, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.89% (1.3693 => 1.4910, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 8.81% (0.7038 => 0.7658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.72% (0.9199 => 1.0001, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.56% (1.2193 => 1.3237, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.49% (0.6959 => 0.7550, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.45% (0.7061 => 0.7658, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.26% (1.1364 => 1.2303, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.13% (1.4563 => 1.5747, std. dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9383, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.6283 => 0.6774, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5577 => 0.6007, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4062 => 0.4373, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.2781 => 0.2993, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.56% (1.0313 => 1.1093, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.4791 => 0.5153, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.46% (0.3246 => 0.3488, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.3899 => 0.4188, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (0.4379 => 0.4699, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0083) MultiSource/Applications/Burg/burg: 7.21% (1.1061 => 1.1858, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.13% (7.2180 => 7.7329, std. dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 7.08% (0.2995 => 0.3207, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3580 => 0.3833, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.96% (0.8310 => 0.8888, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (3.6692 => 3.9225, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.89% (0.7506 => 0.8023, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3646 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.4003 => 0.4276, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.80% (0.3293 => 0.3517, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.78% (3.8646 => 4.1265, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (1.9828 => 2.1171, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.73% (0.3789 => 0.4044, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.70% (3.1889 => 3.4026, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3663 => 0.3908, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.68% (0.3220 => 0.3435, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.57% (0.7460 => 0.7950, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 6.55% (0.3940 => 0.4198, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.47% (1.3819 => 1.4713, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.42% (1.3813 => 1.4700, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.31% (0.4390 => 0.4667, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 6.29% (2.1791 => 2.3161, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.20% (1.3245 => 1.4066, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 6.18% (1.9270 => 2.0461, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.17% (1.0594 => 1.1248, std. dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: 6.08% (1.2749 => 1.3524, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.03% (16.6129 => 17.6143, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 6.01% (14.8535 => 15.7461, std. dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 5.88% (8.4961 => 8.9954, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (13.2842 => 14.0462, std. dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (4.3801 => 4.6289, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.8698 => 0.9192, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.63% (4.4433 => 4.6936, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.57% (0.6576 => 0.6942, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.55% (0.8818 => 0.9307, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.53% (0.6135 => 0.6474, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.49% (0.2859 => 0.3016, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1333 => 1.1926, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 5.22% (14.5298 => 15.2885, std. dev.: 0.0130) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (6.5754 => 6.9123, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.95% (4.6629 => 4.8936, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (3.2742 => 3.4243, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.38% (4.9865 => 5.2051, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.12% (0.9108 => 0.9483, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.95% (1.5188 => 1.5788, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.90% (0.6250 => 0.6494, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.90% (3.7467 => 3.8928, std. dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.72% (6.2785 => 6.5119, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1007 => 2.1743, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.88% (33.2944 => 34.2528, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.86% (16.2614 => 16.5638, std. dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0489) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (3.1736 => 3.4175, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3793, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6972, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1144, std. dev.: 0.0405) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5944, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6001, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.68% (22.5627 => 21.7319, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2765, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2936, std. dev.: 0.0222) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5157, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6012, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -2.24% (26.5159 => 25.9223, std. dev.: 0.0487) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2409, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2441, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0606, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2293, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2617, std. dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4353, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 02:33:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 04:33:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913093358.458B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3752?compare_to=3748&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3752, Order: 163783, Start Time: 2012-09-13 08:15:09, End Time: 2012-09-13 09:35:16 To: 3748, Order: 163774, Start Time: 2012-09-13 06:23:42, End Time: 2012-09-13 07:46:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (114 on baseline) Performance Improvements: 14 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (735 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 1.49% (19.8767 => 20.1731, std. dev.: 0.0532) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (14.7622 => 14.9544, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.46% (0.5399 => 0.5532, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3987 => 0.3812, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3970 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.27% (0.4048 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.26% (0.4036 => 0.3864, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.21% (0.4035 => 0.3865, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.19% (0.4005 => 0.3837, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.15% (0.4196 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.4053 => 0.3885, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: -4.06% (0.4388 => 0.4210, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.04% (0.4333 => 0.4158, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.01% (0.4439 => 0.4261, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: -2.57% (0.6432 => 0.6267, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.45% (0.6532 => 0.6372, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.6648 => 8.5715, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.25% (10.3673 => 14.9544, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.86% (2.2022 => 2.4855, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.83% (7.0540 => 7.9587, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.24% (0.1566 => 0.1742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.88% (1.7609 => 1.9349, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3473 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3516 => 0.3837, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.10% (0.3561 => 0.3885, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3543 => 0.3865, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.06% (0.3543 => 0.3864, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.01% (0.3497 => 0.3812, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.88% (0.3694 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.62% (0.3828 => 0.4158, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.51% (0.3927 => 0.4261, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 8.34% (0.3886 => 0.4210, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.14% (0.1584 => 0.1713, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.71% (10.4361 => 11.2412, std. dev.: 0.0211) SingleSource/Benchmarks/Misc/oourafft: 7.65% (0.3282 => 0.3533, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1655 => 0.1763, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 6.37% (9.4845 => 10.0891, std. dev.: 0.0188) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2554 => 0.2710, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.81% (0.2700 => 0.2857, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.81% (0.3307 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.77% (0.5925 => 0.6267, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.76% (0.7115 => 0.7525, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 5.73% (0.7433 => 0.7859, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.72% (0.4615 => 0.4879, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.6030 => 0.6372, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.63% (0.5860 => 0.6190, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 5.58% (0.3423 => 0.3614, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.56% (0.3109 => 0.3282, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.53% (0.6675 => 0.7044, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.8172 => 0.8622, std. dev.: 0.0174) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2271 => 0.2395, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.41% (3.3354 => 3.5158, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.35% (8.1363 => 8.5715, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (1.5415 => 1.6239, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.30% (4.2646 => 4.4906, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.27% (1.3050 => 1.3738, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.21% (5.7591 => 6.0591, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.13% (0.5105 => 0.5367, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.10% (0.5569 => 0.5853, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.02% (0.7835 => 0.8228, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0111) MultiSource/Applications/Burg/burg: 4.95% (1.1642 => 1.2218, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.91% (4.9449 => 5.1877, std. dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (5.0018 => 5.2448, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.8067 => 0.8457, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.67% (0.9765 => 1.0221, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3121 => 0.3264, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 4.37% (1.5603 => 1.6285, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.3180 => 0.3318, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (1.1861 => 1.2368, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 4.25% (3.8723 => 4.0370, std. dev.: 0.0151) MultiSource/Applications/lemon/lemon: 4.24% (1.0722 => 1.1177, std. dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 4.22% (0.3387 => 0.3530, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 4.21% (0.4299 => 0.4480, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.15% (0.2603 => 0.2711, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.5020 => 0.5227, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.02% (7.9617 => 8.2820, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3441 => 0.3579, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6456 => 0.6709, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.90% (21.9371 => 22.7936, std. dev.: 0.0360) MultiSource/Applications/treecc/treecc: 3.88% (2.0273 => 2.1059, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 3.64% (2.2969 => 2.3804, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6450 => 0.6682, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (14.3668 => 14.8824, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3650 => 0.3780, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.52% (0.4064 => 0.4207, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.44% (0.8921 => 0.9228, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.38% (0.5981 => 0.6183, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.4103 => 0.4241, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3865 => 0.3989, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (1.5859 => 1.6351, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.4186 => 1.4621, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4203 => 0.4331, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.85% (2.0665 => 2.1253, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4620 => 0.4751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.4048 => 0.4160, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.2024 => 2.2608, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.43% (1.1840 => 1.2128, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.8101 => 0.8234, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.29% (1.2842 => 1.3008, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.04% (3.1578 => 3.3800, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3633, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std. dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 2.20% (0.5413 => 0.5532, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2302, std. dev.: 0.0280) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7876, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.02% (5.2763 => 3.2175, std. dev.: 0.0195) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.75% (5.3855 => 3.8372, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.32% (5.3526 => 3.8365, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1128, std. dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.31% (2.9384 => 2.5767, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -9.03% (22.1758 => 20.1731, std. dev.: 0.0532) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3798, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3074, std. dev.: 0.0787) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (1.8329 => 1.7186, std. dev.: 0.0169) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.19% (1.6805 => 1.5765, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std. dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5038, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4131, std. dev.: 0.0214) SingleSource/Benchmarks/McGill/chomp: -2.97% (1.2373 => 1.2006, std. dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -2.53% (10.2830 => 10.0232, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9964, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std. dev.: 0.0305) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5789, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 03:13:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 05:13:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913101338.831222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3753?compare_to=3750&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3753, Order: 163783, Start Time: 2012-09-13 09:05:03, End Time: 2012-09-13 10:14:57 To: 3750, Order: 163782, Start Time: 2012-09-13 07:38:17, End Time: 2012-09-13 08:49:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (46 on baseline) Performance Improvements: 7 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2083 => 0.2202, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.69% (0.4420 => 0.4539, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (0.4831 => 0.4941, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.14% (40.9467 => 42.6403, std. dev.: 0.2679) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.60% (1.5960 => 1.6216, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.57% (1.2712 => 1.2912, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.18% (1.2623 => 1.2772, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.16% (0.3224 => 0.3122, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -2.20% (3.9368 => 3.8502, std. dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.37% (1.2791 => 1.2616, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.22% (0.8675 => 0.8569, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.0744 => 1.0633, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/health/health: -4.40% (0.3542 => 0.3386, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.32% (2.5135 => 2.4802, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.07% (0.0745 => 0.0902, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.5309 => 0.5630, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 5.31% (2.1763 => 2.2918, std. dev.: 0.0378) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.6410 => 0.6749, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.23% (0.2552 => 0.2660, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.84% (0.6173 => 0.6410, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.52% (0.3582 => 0.3708, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.22% (1.1653 => 1.2028, std. dev.: 0.0065) MultiSource/Applications/lemon/lemon: 3.21% (1.0046 => 1.0368, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.95% (0.6915 => 0.7119, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.85% (15.3105 => 15.7473, std. dev.: 0.0242) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.5150 => 1.5479, std. dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 2.03% (29.3170 => 29.9121, std. dev.: 0.2053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.73% (0.7639 => 0.7771, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.62% (1.1672 => 1.1861, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.45% (3.0225 => 3.0664, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.06% (0.0766 => 0.0935, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.23% (0.0917 => 0.1075, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0226) MultiSource/Applications/sgefa/sgefa: 14.42% (0.3746 => 0.4286, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.38% (4.0101 => 4.5468, std. dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.99% (0.2694 => 0.2990, std. dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 10.82% (0.1433 => 0.1588, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.38% (1.0063 => 1.1007, std. dev.: 0.0213) SingleSource/Benchmarks/Shootout/lists: 8.96% (7.0025 => 7.6302, std. dev.: 0.0101) SingleSource/Benchmarks/McGill/chomp: 7.51% (1.0194 => 1.0960, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.14% (0.2857 => 0.3061, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.95% (27.1724 => 28.7889, std. dev.: 0.0660) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.34% (40.4792 => 42.6403, std. dev.: 0.2679) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.3301 => 0.3473, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 4.47% (15.2242 => 15.9041, std. dev.: 0.0222) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.24% (0.8498 => 0.8858, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (6.6312 => 6.8664, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 2.97% (5.1938 => 5.3480, std. dev.: 0.0469) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7222, std. dev.: 0.0152) MultiSource/Applications/siod/siod: 1.53% (3.5520 => 3.6064, std. dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.46% (1.2726 => 1.2912, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4455 => 2.4802, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5321, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 1.12% (2.5166 => 2.5448, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.60% (0.7738 => 0.7537, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.74% (5.2665 => 4.1215, std. dev.: 0.2627) SingleSource/Benchmarks/Shootout-C++/ary3: -20.51% (1.7473 => 1.3890, std. dev.: 0.0291) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.32% (1.1647 => 0.9397, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5457, std. dev.: 0.0600) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.84% (1.4034 => 1.2794, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.50% (3.2007 => 2.9288, std. dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.23% (2.4457 => 2.2688, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3636, std. dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -6.60% (3.4230 => 3.1972, std. dev.: 0.0337) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3507, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: -5.71% (1.4117 => 1.3311, std. dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.08% (0.4564 => 0.4332, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.52% (45.4683 => 43.4127, std. dev.: 0.3809) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.03% (0.4140 => 0.3973, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.98% (3.7496 => 3.6003, std. dev.: 0.0389) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.80% (1.7361 => 1.6702, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -3.44% (7.6833 => 7.4187, std. dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.2722 => 1.2317, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.00% (9.2503 => 8.9732, std. dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std. dev.: 0.0051) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3354, std. dev.: 0.0093) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4185, std. dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -1.95% (92.7467 => 90.9408, std. dev.: 0.6616) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2270, std. dev.: 0.0314) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.49% (3.8907 => 3.8327, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7647, std. dev.: 0.0134) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.44% (1.2959 => 1.2772, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (16.5617 => 16.3261, std. dev.: 0.0835) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std. dev.: 0.0397) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.23% (1.8739 => 1.8509, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 04:40:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 06:40:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120913114032.3440B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3754?compare_to=3749&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3754, Order: 163783, Start Time: 2012-09-13 08:58:18, End Time: 2012-09-13 11:41:50 To: 3749, Order: 163772, Start Time: 2012-09-13 05:43:03, End Time: 2012-09-13 08:29:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 28 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 942 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.4044 => 0.3846, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.4009 => 0.3813, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.88% (0.3997 => 0.3802, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.86% (0.4032 => 0.3836, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.82% (0.3987 => 0.3795, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.76% (0.4014 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.76% (0.4015 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.72% (0.4047 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.67% (0.4199 => 0.4003, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.53% (0.4278 => 0.4084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.52% (0.4203 => 0.4013, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.97% (0.6332 => 0.6144, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.82% (0.5385 => 0.5233, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: -2.74% (0.6423 => 0.6247, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.61% (0.6360 => 0.6194, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.39% (0.7699 => 0.7515, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.35% (0.5369 => 0.5243, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.34% (3.8469 => 3.7568, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.04% (2.1035 => 2.0606, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.94% (1.4139 => 1.3865, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.85% (1.7469 => 1.7146, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -1.80% (4.4797 => 4.3989, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.76% (2.0758 => 2.0393, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: -1.58% (0.8231 => 0.8101, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -1.53% (1.1473 => 1.1298, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -1.43% (1.0147 => 1.0002, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.12% (2.2153 => 2.1905, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -1.10% (2.2723 => 2.2473, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3465 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.33% (0.3446 => 0.3802, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.30% (0.3496 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.26% (0.3488 => 0.3846, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.26% (0.3442 => 0.3795, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.20% (0.3469 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.20% (0.3460 => 0.3813, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.95% (0.3650 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.88% (0.3643 => 0.4003, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.67% (0.3724 => 0.4084, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.14% (1.5932 => 1.7070, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.32% (0.5826 => 0.6194, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.08% (0.5889 => 0.6247, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (1.6211 => 1.7146, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (0.4361 => 0.4606, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.45% (3.5627 => 3.7568, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (1.3152 => 1.3865, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (2.7292 => 2.8729, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 5.11% (5.5417 => 5.8251, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.99% (0.4994 => 0.5243, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7171 => 0.7515, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1298, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.2736 => 0.2859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.46% (4.2109 => 4.3989, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 4.38% (1.8794 => 1.9617, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.3004 => 0.3135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.2866 => 0.2988, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.2823 => 0.2943, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (2.1013 => 2.1905, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 4.24% (0.4029 => 0.4200, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.23% (0.2813 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (2.0673 => 2.1540, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (0.3890 => 0.4053, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 4.17% (0.2780 => 0.2896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.5900 => 0.6144, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2811 => 0.2927, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.12% (0.5026 => 0.5233, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 4.12% (4.6177 => 4.8078, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (4.4195 => 4.6007, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 4.08% (0.9909 => 1.0313, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.05% (0.3060 => 0.3184, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2911 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.97% (0.3096 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3258 => 0.3387, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.96% (0.3362 => 0.3495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.3271 => 0.3400, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 3.89% (1.4269 => 1.4824, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 3.86% (0.4146 => 0.4306, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.84% (0.4139 => 0.4298, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.83% (0.3317 => 0.3444, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3625 => 0.3763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (0.3348 => 0.3475, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (2.1653 => 2.2473, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 3.78% (0.3678 => 0.3817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.77% (0.3477 => 0.3608, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 3.74% (0.6634 => 0.6882, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.70% (0.3726 => 0.3864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.59% (0.5546 => 0.5745, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 3.58% (23.5202 => 24.3624, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3282 => 0.3399, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (1.9694 => 2.0393, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.50% (0.2969 => 0.3073, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.50% (0.3690 => 0.3819, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.3084 => 0.3188, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3981 => 0.4114, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.22% (0.3845 => 0.3969, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 3.21% (0.3336 => 0.3443, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.21% (1.9966 => 2.0606, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 3.15% (0.9697 => 1.0002, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.6435 => 0.6636, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.07% (0.5012 => 0.5166, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.87% (0.7875 => 0.8101, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.38% (2.0346 => 2.0830, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (0.4847 => 0.4955, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (0.7426 => 0.7572, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (11.6398 => 11.7820, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (4.6926 => 4.7490, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8977, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std.dev.: 0.0580) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6479, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1980, std.dev.: 0.0139) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5036, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4538, std.dev.: 0.0232) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2206, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2797, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5993, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5660, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7926, std.dev.: 0.0177) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7725, std.dev.: 0.0817) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5781, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9664, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 06:17:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 08:17:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913131731.A31FE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3755?compare_to=3753&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3755, Order: 163787, Start Time: 2012-09-13 12:08:03, End Time: 2012-09-13 13:18:51 To: 3753, Order: 163783, Start Time: 2012-09-13 09:05:03, End Time: 2012-09-13 10:14:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (42 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 895 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.24% (1.3305 => 1.3470, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 4.00% (1.7419 => 1.8116, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.11% (2.6657 => 2.7220, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.92% (3.6003 => 3.6694, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/ffbench: 1.62% (1.3311 => 1.3526, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6216 => 1.5984, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.14% (0.9870 => 0.9884, std.dev.: 0.0200) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.5968 => 0.5965, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 0.48% (0.1651 => 0.1659, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.98% (0.1558 => 0.1496, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (0.3015 => 0.3065, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.2357 => 0.2364, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.47% (0.3139 => 0.3093, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.79% (0.2281 => 0.2263, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.88% (0.0452 => 0.0448, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 1.14% (0.0088 => 0.0089, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.09% (0.0241 => 0.0195, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.78% (0.0386 => 0.0383, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.09% (0.0293 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.71% (0.0281 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0322 => 0.0323, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -15.82% (0.0177 => 0.0149, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 11.83% (0.0169 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.35% (0.0253 => 0.0242, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -11.66% (0.0326 => 0.0288, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1426 => 0.1432, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -0.54% (1.4725 => 1.4646, std.dev.: 0.0458) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1570 => 0.1515, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.50% (0.3996 => 0.4016, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.35% (0.1405 => 0.1438, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.0639 => 0.0620, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.05% (0.0197 => 0.0203, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.29% (0.0620 => 0.0628, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1483 => 1.1474, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -77.27% (0.0022 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.84% (0.0543 => 0.0533, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.60% (0.0250 => 0.0141, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.7810 => 0.7799, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.30% (1.6110 => 1.6062, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.20% (4.1772 => 3.0408, std.dev.: 0.0575) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.27% (0.0745 => 0.0896, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.76% (0.5309 => 0.5668, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.32% (0.6410 => 0.6751, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 5.15% (2.1763 => 2.2883, std.dev.: 0.0286) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.66% (0.3582 => 0.3713, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.45% (0.6173 => 0.6386, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.6915 => 0.7146, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 3.31% (1.0046 => 1.0379, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5150 => 1.5513, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.52% (1.3268 => 1.3470, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.25% (1.1672 => 1.1818, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.24% (1.2021 => 1.2170, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.09% (1.1827 => 1.1956, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.94% (1.6538 => 2.3308, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 21.99% (3.4629 => 4.2243, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0279) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.44% (4.0101 => 4.5489, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 8.27% (7.0025 => 7.5814, std.dev.: 0.0327) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.73% (1.0063 => 1.0841, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: 7.01% (1.0194 => 1.0909, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.76% (0.3301 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8152, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.92% (40.4792 => 42.4692, std.dev.: 0.5654) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.88% (4.2129 => 4.4186, std.dev.: 0.0689) MultiSource/Benchmarks/Olden/tsp/tsp: 4.54% (1.7330 => 1.8116, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8769, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5399, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8719, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.11% (0.3508 => 0.3617, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 2.47% (8.5113 => 8.7213, std.dev.: 0.0764) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.12% (2.6656 => 2.7220, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.67% (4.6127 => 4.6897, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7209, std.dev.: 0.0564) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6083, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (2.4971 => 2.5279, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.08% (2.8599 => 2.8908, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.61% (0.7738 => 0.7459, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.07% (4.2815 => 4.2357, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.58% (0.3497 => 0.2078, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.34% (5.2665 => 4.0901, std.dev.: 0.1100) SingleSource/Benchmarks/Shootout-C++/ary3: -20.64% (1.7473 => 1.3867, std.dev.: 0.0529) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.48% (1.1647 => 0.9378, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.39% (62.4126 => 56.5546, std.dev.: 0.1667) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9389, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.18% (3.6254 => 3.3652, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.90% (3.6023 => 3.3539, std.dev.: 0.0405) MultiSource/Applications/SIBsim4/SIBsim4: -6.78% (3.4230 => 3.1908, std.dev.: 0.0356) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.73% (2.4457 => 2.2810, std.dev.: 0.0236) MultiSource/Benchmarks/FreeBench/distray/distray: -6.72% (0.2664 => 0.2485, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -6.46% (1.4441 => 1.3508, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.02% (0.4564 => 0.4335, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: -4.19% (1.4117 => 1.3526, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (9.2503 => 8.9366, std.dev.: 0.0286) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2303, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4504, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.87% (1.7361 => 1.6863, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0292) MultiSource/Applications/aha/aha: -2.81% (3.4286 => 3.3322, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.70% (1.1683 => 1.1367, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -2.21% (92.7467 => 90.7006, std.dev.: 0.6087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.14% (3.7496 => 3.6694, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/neural/neural: -2.01% (1.0926 => 1.0706, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.4876 => 3.4237, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2346, std.dev.: 0.0351) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3074, std.dev.: 0.0298) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.96% (0.9980 => 0.9884, std.dev.: 0.0200) MultiSource/Applications/sqlite3/sqlite3: -0.95% (0.6022 => 0.5965, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1666 => 0.1659, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.73% (0.1554 => 0.1496, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.58% (0.3083 => 0.3065, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.25% (0.2394 => 0.2364, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.58% (0.3175 => 0.3093, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (0.2302 => 0.2263, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.75% (0.0240 => 0.0195, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.27% (0.0301 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -15.82% (0.0177 => 0.0149, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -2.81% (0.0249 => 0.0242, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -11.38% (0.0325 => 0.0288, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -2.48% (1.5019 => 1.4646, std.dev.: 0.0458) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.93% (0.1501 => 0.1515, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.82% (0.4264 => 0.4016, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.26% (0.0589 => 0.0620, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.50% (0.0232 => 0.0203, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.72% (0.0639 => 0.0628, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.09% (1.1350 => 1.1474, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.33% (0.0637 => 0.0533, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.68% (0.0246 => 0.0141, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.42% (0.7541 => 0.7799, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.55% (1.5363 => 1.6062, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 06:32:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 08:32:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913133245.518362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3756?compare_to=3751&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3756, Order: 163787, Start Time: 2012-09-13 12:19:43, End Time: 2012-09-13 13:34:03 To: 3751, Order: 163783, Start Time: 2012-09-13 08:09:42, End Time: 2012-09-13 09:24:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.34% (54.4188 => 55.6935, std.dev.: 0.3583) MultiSource/Benchmarks/llubenchmark/llu: 2.20% (3.7957 => 3.8792, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.00% (2.0176 => 2.4010, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.44% (3.9660 => 4.3402, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.19% (0.5748 => 0.6276, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.08% (0.7710 => 0.8410, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.95% (1.3693 => 1.4919, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.81% (0.5265 => 0.5729, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.71% (0.9199 => 1.0000, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.64% (1.2193 => 1.3247, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.64% (0.6959 => 0.7560, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7061 => 0.7661, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2310, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8.21% (13.8202 => 14.9545, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.19% (1.4563 => 1.5756, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.83% (0.4791 => 0.5166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5577 => 0.6011, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.52% (1.0313 => 1.1089, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.47% (0.4379 => 0.4706, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (7.2180 => 7.7449, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.21% (0.2995 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1848, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.11% (0.8310 => 0.8901, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 7.10% (0.3578 => 0.3832, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (3.8646 => 4.1380, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3580 => 0.3830, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 6.95% (0.7506 => 0.8028, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.89% (3.6692 => 3.9220, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.4003 => 0.4278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3646 => 0.3895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3663 => 0.3911, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (1.9828 => 2.1169, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 6.76% (0.3789 => 0.4045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2243 => 0.2394, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.72% (0.3914 => 0.4177, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.69% (3.1889 => 3.4023, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/18-imp/imp: 6.68% (0.3220 => 0.3435, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.68% (0.3940 => 0.4203, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.49% (0.4390 => 0.4675, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.44% (1.3245 => 1.4098, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.31% (1.3813 => 1.4685, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.30% (1.3819 => 1.4689, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 6.28% (2.1791 => 2.3159, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1789 => 0.1901, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.26% (1.0594 => 1.1257, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.25% (1.9270 => 2.0474, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (1.2749 => 1.3531, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.99% (14.8535 => 15.7433, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 5.91% (16.6129 => 17.5946, std.dev.: 0.0299) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (8.4961 => 8.9981, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.81% (13.2842 => 14.0558, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.2859 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.73% (4.4433 => 4.6979, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.70% (4.3801 => 4.6297, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6576 => 0.6944, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.6135 => 0.6478, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.58% (0.8818 => 0.9310, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.56% (0.3131 => 0.3305, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.28% (14.5298 => 15.2976, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.1333 => 1.1921, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (6.5754 => 6.9146, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.06% (4.6629 => 4.8988, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3245 => 0.3407, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.65% (3.2742 => 3.4263, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.4805 => 0.5023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.42% (4.9865 => 5.2070, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.22% (0.9108 => 0.9492, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (1.5188 => 1.5819, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 3.94% (3.7467 => 3.8943, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6250 => 0.6495, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (6.2785 => 6.5153, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.1007 => 2.1795, std.dev.: 0.0187) MultiSource/Benchmarks/Bullet/bullet: 2.81% (33.2944 => 34.2305, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5556, std.dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6982, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5457, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.01% (10.7476 => 11.0713, std.dev.: 0.0080) MultiSource/Benchmarks/llubenchmark/llu: 2.81% (3.7731 => 3.8792, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6005, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5174, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6023, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.03% (7.9275 => 8.0091, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.17% (0.4657 => 0.3904, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7484, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.29% (20.3410 => 18.2479, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.58% (1.3780 => 1.3011, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5120, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9218, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5963, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.25% (26.5159 => 25.9187, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2402, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.23% (4.1080 => 4.0573, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2445, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 06:38:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 08:38:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913133814.E9B2F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3757?compare_to=3752&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3757, Order: 163787, Start Time: 2012-09-13 12:20:01, End Time: 2012-09-13 13:39:33 To: 3752, Order: 163783, Start Time: 2012-09-13 08:15:09, End Time: 2012-09-13 09:35:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (114 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (734 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.08% (0.3825 => 0.3981, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.79% (1.2006 => 1.2221, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3016 => 1.3163, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5665 => 0.5657, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -0.07% (15.7579 => 15.7466, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 0.05% (14.5800 => 14.5874, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: -0.00% (82.0564 => 82.0554, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.2803 => 4.2800, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2147 => 1.2146, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (7.3712 => 7.3715, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.6563 => 3.6558, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.6331 => 0.6331, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1424 => 0.1424, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0650 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.74% (63.2438 => 82.0554, std.dev.: 0.0186) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14239.03% (0.0720 => 10.3241, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.25% (10.3673 => 14.9544, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 26.39% (0.1622 => 0.2050, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.88% (2.2022 => 2.4858, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.81% (7.0540 => 7.9577, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2512, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.56% (0.1566 => 0.1747, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.94% (1.7609 => 1.9360, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3473 => 0.3798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.09% (0.3543 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.03% (0.3543 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.99% (0.3516 => 0.3832, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.99% (0.3561 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3694 => 0.4017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.62% (0.3828 => 0.4158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.48% (0.3927 => 0.4260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.34% (0.3886 => 0.4210, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.21% (0.1584 => 0.1714, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 7.77% (0.3282 => 0.3537, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 7.77% (10.4361 => 11.2465, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 6.77% (0.1655 => 0.1767, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.4879 => 0.5202, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.39% (9.4845 => 10.0906, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.11% (0.2700 => 0.2865, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.84% (0.7433 => 0.7867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.84% (0.3307 => 0.3500, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.81% (0.5925 => 0.6269, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.80% (0.6030 => 0.6380, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.69% (0.3109 => 0.3286, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.69% (0.7115 => 0.7520, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4615 => 0.4876, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.64% (0.2554 => 0.2698, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 5.55% (0.3423 => 0.3613, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.8172 => 0.8625, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2271 => 0.2395, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.6675 => 0.7039, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.44% (0.5860 => 0.6179, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.42% (0.2065 => 0.2177, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 5.41% (3.3354 => 3.5158, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.35% (0.5105 => 0.5378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.33% (8.1363 => 8.5701, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (4.2646 => 4.4909, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.26% (1.5415 => 1.6226, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.24% (1.3050 => 1.3734, std.dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 5.16% (5.7591 => 6.0564, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.5569 => 0.5856, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.94% (0.7835 => 0.8222, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.91% (5.0018 => 5.2473, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.89% (4.9449 => 5.1865, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.86% (0.2758 => 0.2892, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.85% (0.8067 => 0.8458, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 4.79% (0.3092 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.72% (0.9765 => 1.0226, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.68% (0.3121 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.60% (1.1642 => 1.2177, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 4.32% (3.8723 => 4.0396, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 4.25% (0.3387 => 0.3531, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.1861 => 1.2364, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 4.23% (1.5603 => 1.6263, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 4.22% (1.0722 => 1.1175, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.5020 => 0.5228, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.12% (0.4299 => 0.4476, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.11% (7.9617 => 8.2890, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.07% (0.2603 => 0.2709, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.92% (21.9371 => 22.7966, std.dev.: 0.0172) MultiSource/Applications/treecc/treecc: 3.86% (2.0273 => 2.1055, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6456 => 0.6697, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.72% (0.6450 => 0.6690, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (14.3668 => 14.8980, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.56% (0.5981 => 0.6194, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 3.53% (0.8921 => 0.9236, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 3.51% (2.2969 => 2.3775, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (0.4064 => 0.4205, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.45% (0.3650 => 0.3776, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3865 => 0.3998, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.4186 => 1.4624, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.05% (1.5859 => 1.6343, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (0.4620 => 0.4754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.4048 => 0.4161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.2024 => 2.2629, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0665 => 2.1228, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.49% (1.1840 => 1.2135, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.8101 => 0.8260, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3007, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3826, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2143, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3482, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7879, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.12% (26.0924 => 26.3840, std.dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.07% (5.2763 => 3.2149, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.68% (5.3855 => 3.8407, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.43% (5.3526 => 3.8308, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1131, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.26% (2.9384 => 2.5782, std.dev.: 0.0167) MultiSource/Applications/ClamAV/clamscan: -9.01% (22.1758 => 20.1771, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.75% (1.5373 => 1.3720, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.10% (19.9488 => 18.3332, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.18% (1.6805 => 1.5767, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.14% (1.5835 => 1.5021, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1514, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4308, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9927, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9851, std.dev.: 0.0204) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5082, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5784, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2317, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0112) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.19% (0.5229 => 0.5657, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 5.05% (14.9895 => 15.7466, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 3.05% (14.1553 => 14.5874, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 4.12% (4.1105 => 4.2800, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.94% (1.1048 => 1.2146, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.98% (7.1582 => 7.3715, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.57% (3.4629 => 3.6558, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.6222 => 0.6331, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.11% (0.1485 => 0.1424, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 07:44:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 09:44:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913144404.1363C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3758?compare_to=3755&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3758, Order: 163794, Start Time: 2012-09-13 13:35:00, End Time: 2012-09-13 14:45:23 To: 3755, Order: 163787, Start Time: 2012-09-13 12:08:03, End Time: 2012-09-13 13:18:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (48 on baseline) Performance Improvements: 1 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.19% (0.1624 => 0.1822, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.78% (0.7700 => 0.7991, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (1.3829 => 1.4096, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.21% (1.4024 => 1.4193, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 6.24% (0.2485 => 0.2640) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.26% (1.3250 => 1.3815, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (60.1937 => 61.4222, std.dev.: 0.2846) MultiSource/Applications/minisat/minisat: 1.83% (6.1489 => 6.2614, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.59% (21.9217 => 22.2693, std.dev.: 0.0545) SingleSource/Benchmarks/Misc/ReedSolomon: 1.32% (8.7213 => 8.8360, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.29% (2.0428 => 1.9960, std.dev.: 0.0159) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.15% (0.9884 => 0.9899, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.5965 => 0.5978, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: -1.27% (0.1659 => 0.1638, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.08% (0.1496 => 0.1557, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.91% (0.3065 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.30% (0.2364 => 0.2357, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (0.3093 => 0.3167, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.97% (0.2263 => 0.2285, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -16.29% (0.0448 => 0.0375, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: -2.27% (0.0088 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 21.54% (0.0195 => 0.0237, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0383 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.33% (0.0240 => 0.0296, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0279 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0323 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -12.08% (0.0149 => 0.0131, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.83% (0.0242 => 0.0244, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 2.78% (0.0288 => 0.0296, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1432 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.08% (1.4646 => 1.4950, std.dev.: 0.0247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.26% (0.1515 => 0.1519, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.94% (0.4016 => 0.4094, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.53% (0.1438 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.32% (0.0620 => 0.0556, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.82% (0.0203 => 0.0179, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.71% (0.0628 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.15% (1.1474 => 1.1606, std.dev.: 0.0360) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0016 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0005 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.0533 => 0.0558, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.71% (0.0141 => 0.0142, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7799 => 0.7807, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.03% (1.6062 => 1.6057, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -53.33% (0.0120 => 0.0056, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.75% (4.1772 => 3.0598, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.0745 => 0.0867, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.85% (0.1414 => 0.1525, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 5.50% (0.5309 => 0.5601, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 5.25% (2.1763 => 2.2905, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.02% (0.6410 => 0.6732, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.2552 => 0.2656, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.00% (0.6173 => 0.6420, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3582 => 0.3719, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.48% (0.7722 => 0.7991, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 3.18% (0.6915 => 0.7135, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 3.07% (15.3105 => 15.7805, std.dev.: 0.1229) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (1.5150 => 1.5602, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 2.89% (1.0046 => 1.0336, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 2.73% (29.3170 => 30.1162, std.dev.: 0.0519) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.7639 => 0.7785, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.16% (1.3935 => 1.4096, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.15% (13.3238 => 13.4772, std.dev.: 0.0535) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9966, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5574, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 13.40% (0.3746 => 0.4248, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 9.70% (0.1433 => 0.1572, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6278, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.37% (0.2857 => 0.3096, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.02% (0.2694 => 0.2910, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.86% (1.0063 => 1.0854, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 6.53% (1.0194 => 1.0860, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (27.1724 => 28.8186, std.dev.: 0.0859) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (0.3301 => 0.3471, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8232, std.dev.: 0.0481) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 3.81% (8.5113 => 8.8360, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.44% (4.2129 => 4.3578, std.dev.: 0.0360) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.6308 => 0.6476, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.50% (0.5876 => 0.6023, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.31% (2.6656 => 2.7271, std.dev.: 0.0144) MultiSource/Benchmarks/BitBench/five11/five11: 1.95% (5.1938 => 5.2949, std.dev.: 0.0372) MultiSource/Applications/hexxagon/hexxagon: 1.80% (14.4877 => 14.7483, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 1.64% (3.5520 => 3.6101, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4455 => 2.4822, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.43% (4.6127 => 4.6786, std.dev.: 0.0251) MultiSource/Benchmarks/Olden/bh/bh: 1.14% (2.5166 => 2.5452, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.1116 => 1.1242, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1817 => 0.1702, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -2.57% (0.7738 => 0.7539, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.07% (4.3380 => 4.2914, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0862, std.dev.: 0.0712) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.34% (1.1647 => 0.9395, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.28% (62.4126 => 56.6225, std.dev.: 0.1178) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.23% (1.4034 => 1.2879, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.14% (3.2007 => 2.9402, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.71% (2.4457 => 2.2571, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.25% (3.6254 => 3.3626, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: -6.66% (3.4230 => 3.1949, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -6.56% (1.4441 => 1.3494, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7923, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: -5.59% (1.4117 => 1.3328, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.49% (0.4564 => 0.4359, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.00% (45.4683 => 43.6475, std.dev.: 0.4066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.91% (0.4140 => 0.3978, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.61% (1.7361 => 1.6735, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9439, std.dev.: 0.0356) MultiSource/Applications/lambda-0_1_3/lambda: -3.20% (7.6833 => 7.4374, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.84% (3.7496 => 3.6431, std.dev.: 0.0192) MultiSource/Applications/aha/aha: -2.75% (3.4286 => 3.3342, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2890, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -2.61% (0.4296 => 0.4184, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1381, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -2.01% (92.7467 => 90.8807, std.dev.: 0.4346) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4205, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.87% (1.8739 => 1.8388, std.dev.: 0.0127) MultiSource/Benchmarks/sim/sim: -1.77% (3.8907 => 3.8217, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (9.3855 => 9.2407, std.dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.47% (1.4021 => 1.3815, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3069, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7669, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.35% (16.5617 => 16.3387, std.dev.: 0.0801) MultiSource/Applications/JM/lencod/lencod: -1.27% (6.7458 => 6.6603, std.dev.: 0.0212) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.81% (0.9980 => 0.9899, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: -0.73% (0.6022 => 0.5978, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: -1.68% (0.1666 => 0.1638, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1554 => 0.1557, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.32% (0.3083 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.55% (0.2394 => 0.2357, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.25% (0.3175 => 0.3167, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.74% (0.2302 => 0.2285, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -16.48% (0.0449 => 0.0375, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -25.99% (0.0177 => 0.0131, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -8.92% (0.0325 => 0.0296, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -0.46% (1.5019 => 1.4950, std.dev.: 0.0247) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.20% (0.1501 => 0.1519, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.99% (0.4264 => 0.4094, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.36% (0.1344 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.0589 => 0.0556, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.84% (0.0232 => 0.0179, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.26% (1.1350 => 1.1606, std.dev.: 0.0360) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0024 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.40% (0.0637 => 0.0558, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.28% (0.0246 => 0.0142, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.53% (0.7541 => 0.7807, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.52% (1.5363 => 1.6057, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.00% (0.0070 => 0.0056, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 08:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 10:02:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120913150204.856D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3759?compare_to=3754&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3759, Order: 163787, Start Time: 2012-09-13 12:19:43, End Time: 2012-09-13 15:03:23 To: 3754, Order: 163783, Start Time: 2012-09-13 08:58:18, End Time: 2012-09-13 11:41:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.00% (2.0586 => 2.1203, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.60% (115.4799 => 118.4843, std.dev.: 0.1405) SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.7967 => 2.8263, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3446 => 0.3803, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3465 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.26% (0.3488 => 0.3846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.26% (0.3442 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3496 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.14% (0.3460 => 0.3811, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.12% (0.3469 => 0.3820, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.97% (0.3650 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.96% (0.3643 => 0.4006, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.64% (0.3724 => 0.4083, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.06% (1.5932 => 1.7057, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5826 => 0.6186, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.5889 => 0.6245, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.98% (1.3152 => 1.3938, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (1.6211 => 1.7155, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.66% (3.5627 => 3.7643, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (2.7292 => 2.8721, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.07% (5.5417 => 5.8229, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference: 4.81% (0.7171 => 0.7516, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1298, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (0.4994 => 0.5231, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (0.5026 => 0.5259, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.3004 => 0.3139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (2.1013 => 2.1931, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.2866 => 0.2991, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.30% (4.2109 => 4.3921, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 4.30% (0.2813 => 0.2934, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.29% (0.3195 => 0.3332, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.29% (0.2823 => 0.2944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.2780 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (2.0673 => 2.1540, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.17% (0.2566 => 0.2673, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 4.16% (0.2811 => 0.2928, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.16% (0.9909 => 1.0321, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (4.4195 => 4.6030, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 4.12% (0.4029 => 0.4195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2803 => 0.2918, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3267 => 0.3401, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.08% (0.5900 => 0.6141, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.05% (0.3060 => 0.3184, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.03% (0.3625 => 0.3771, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.3903 => 0.4059, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.96% (0.3890 => 0.4044, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 3.95% (0.6634 => 0.6896, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 3.94% (0.3096 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.93% (4.6177 => 4.7992, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 3.86% (0.3678 => 0.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.86% (0.3317 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3477 => 0.3611, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 3.84% (0.3726 => 0.3869, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.82% (0.3348 => 0.3476, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (2.1653 => 2.2466, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.72% (0.4139 => 0.4293, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4146 => 0.4300, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (1.8794 => 1.9491, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 3.68% (1.4269 => 1.4794, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.55% (0.3690 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (0.4658 => 0.4822, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.52% (0.5546 => 0.5741, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.3271 => 0.3386, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.51% (23.5202 => 24.3460, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.3084 => 0.3188, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (1.9694 => 2.0336, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (1.9966 => 2.0614, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 3.21% (0.3336 => 0.3443, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.19% (0.6435 => 0.6640, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.3845 => 0.3967, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.07% (0.9697 => 0.9995, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.05% (0.7875 => 0.8115, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.01% (0.5012 => 0.5163, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.31% (2.0346 => 2.0815, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (0.7426 => 0.7563, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (11.6398 => 11.7850, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.14% (4.6926 => 4.7461, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.34% (0.2162 => 0.3553, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1750, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8906, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6407, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2024, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5082, std.dev.: 0.0255) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (2.0820 => 2.1203, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4334, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2907, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5698, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7804, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7943, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.96% (17.2379 => 16.7285, std.dev.: 0.0553) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9679, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 08:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 10:15:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913151514.9CCA82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3760?compare_to=3756&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3760, Order: 163794, Start Time: 2012-09-13 14:02:19, End Time: 2012-09-13 15:16:32 To: 3756, Order: 163787, Start Time: 2012-09-13 12:19:43, End Time: 2012-09-13 13:34:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.43% (0.5340 => 0.5470, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.17% (55.6935 => 56.3435, std.dev.: 0.0721) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.85% (2.0176 => 2.3980, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.42% (3.9660 => 4.3397, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.04% (0.7710 => 0.8407, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 8.97% (1.3693 => 1.4921, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 8.91% (0.7038 => 0.7665, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.76% (0.5265 => 0.5726, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.70% (1.2193 => 1.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.61% (0.9199 => 0.9991, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.48% (0.6959 => 0.7549, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.34% (1.1364 => 1.2312, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.12% (1.4563 => 1.5746, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.10% (13.8202 => 14.9399, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.6283 => 0.6779, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.5577 => 0.6013, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.4791 => 0.5159, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.63% (0.4062 => 0.4372, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3246 => 0.3490, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.48% (1.0313 => 1.1084, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.4379 => 0.4701, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.30% (1.1061 => 1.1868, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.27% (0.5637 => 0.6047, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (7.2180 => 7.7312, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4390 => 0.4701, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4016 => 0.4300, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3580 => 0.3833, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.03% (0.2988 => 0.3198, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 6.97% (0.2925 => 0.3129, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 6.96% (0.8310 => 0.8888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.91% (0.3489 => 0.3730, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.89% (3.8646 => 4.1310, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.89% (0.7506 => 0.8023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.85% (3.6692 => 3.9206, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.85% (1.9828 => 2.1186, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.85% (0.3578 => 0.3823, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (0.7460 => 0.7970, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 6.73% (0.3623 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3646 => 0.3891, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.70% (0.3789 => 0.4043, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3663 => 0.3908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.62% (0.4003 => 0.4268, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.61% (0.3220 => 0.3433, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.60% (0.3650 => 0.3891, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.59% (3.1889 => 3.3989, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.45% (0.6744 => 0.7179, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.35% (1.3813 => 1.4690, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.31% (2.1791 => 2.3167, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.26% (1.3819 => 1.4684, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 6.23% (1.0594 => 1.1254, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.20% (0.4113 => 0.4368, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.3192 => 0.3389, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.12% (16.6129 => 17.6303, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.09% (1.9270 => 2.0443, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 5.99% (1.2749 => 1.3513, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.92% (14.8535 => 15.7333, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (8.4961 => 8.9876, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.70% (0.8698 => 0.9194, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.6135 => 0.6484, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.3801 => 4.6264, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (4.4433 => 4.6927, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.2859 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.59% (13.2842 => 14.0262, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.40% (0.8818 => 0.9294, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1333 => 1.1934, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 5.25% (14.5298 => 15.2920, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.19% (0.6576 => 0.6917, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (6.5754 => 6.9062, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.97% (4.6629 => 4.8948, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.53% (3.2742 => 3.4225, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.31% (4.9865 => 5.2014, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.12% (0.9108 => 0.9483, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.08% (1.5188 => 1.5808, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.96% (3.7467 => 3.8949, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6250 => 0.6496, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.56% (2.1007 => 2.1755, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (6.2785 => 6.5003, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.74% (33.2944 => 34.2074, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5559, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.98% (1.8175 => 2.2897, std.dev.: 0.0329) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3789, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.84% (0.3139 => 0.3291, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6975, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1150, std.dev.: 0.0653) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5947, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5922, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7477, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.32% (20.3410 => 18.2411, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.79% (1.3780 => 1.2982, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.88% (0.4867 => 0.4678, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9239, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6069, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.21% (26.5159 => 25.9304, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0601, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2280, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2474, std.dev.: 0.0206) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4311, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 08:26:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 10:26:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913152630.CDED92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3761?compare_to=3757&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3761, Order: 163794, Start Time: 2012-09-13 14:08:16, End Time: 2012-09-13 15:27:48 To: 3757, Order: 163787, Start Time: 2012-09-13 12:20:01, End Time: 2012-09-13 13:39:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (114 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (734 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.22% (78.5528 => 80.3004, std.dev.: 0.3822) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.43% (1.3163 => 1.2975, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.48% (0.5657 => 0.5684, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.06% (15.7466 => 15.7564, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: -0.11% (14.5874 => 14.5708, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -0.18% (82.0554 => 81.9077, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.2800 => 4.2749, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2146 => 1.2138, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (7.3715 => 7.3588, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.6558 => 3.6562, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6331 => 0.6326, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1424 => 0.1425, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (0.0649 => 0.0670, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.51% (63.2438 => 81.9077, std.dev.: 0.0045) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14240.28% (0.0720 => 10.3250, std.dev.: 0.0096) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.97% (10.3673 => 14.8224, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 25.46% (0.1622 => 0.2035, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.99% (2.2022 => 2.4883, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.61% (7.0540 => 7.9434, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 12.43% (0.1432 => 0.1610, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.92% (0.1566 => 0.1737, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.99% (1.7609 => 1.9369, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 8.95% (0.3473 => 0.3784, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.86% (0.3543 => 0.3857, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 8.76% (0.3516 => 0.3824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3543 => 0.3849, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3497 => 0.3798, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3561 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3694 => 0.4005, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 8.39% (0.3828 => 0.4149, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.21% (0.1584 => 0.1714, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.15% (0.3927 => 0.4247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.13% (0.3886 => 0.4202, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.98% (0.3282 => 0.3544, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.82% (10.4361 => 11.2524, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.3177 => 0.3398, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 6.77% (0.1655 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.43% (9.4845 => 10.0948, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.42% (0.4879 => 0.5192, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.90% (0.7115 => 0.7535, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.89% (0.7433 => 0.7871, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/Hello: 5.72% (0.5925 => 0.6264, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.66% (0.3109 => 0.3285, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4615 => 0.4876, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.65% (0.7835 => 0.8278, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5860 => 0.6191, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.65% (0.6675 => 0.7052, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.63% (0.2700 => 0.2852, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.62% (0.6030 => 0.6369, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.56% (0.2554 => 0.2696, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7326 => 0.7723, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.40% (0.3423 => 0.3608, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.39% (5.7591 => 6.0695, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.39% (3.3354 => 3.5151, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2271 => 0.2392, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.2065 => 0.2174, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.5415 => 1.6227, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.3050 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (4.2646 => 4.4885, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.8172 => 0.8600, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.22% (8.1363 => 8.5613, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.17% (0.5105 => 0.5369, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.01% (0.5569 => 0.5848, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (5.0018 => 5.2467, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.84% (0.2107 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.82% (4.9449 => 5.1832, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: 4.72% (0.3092 => 0.3238, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.72% (0.9765 => 1.0226, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.71% (0.3121 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.66% (0.8067 => 0.8443, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.64% (0.2758 => 0.2886, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.55% (1.1642 => 1.2172, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 4.29% (3.8723 => 4.0385, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 4.22% (0.3387 => 0.3530, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.20% (0.5020 => 0.5231, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.20% (1.5603 => 1.6258, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 4.20% (1.0722 => 1.1172, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.18% (0.3180 => 0.3313, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (1.1861 => 1.2356, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.07% (0.4299 => 0.4474, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2603 => 0.2708, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.92% (0.3441 => 0.3576, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.90% (7.9617 => 8.2726, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 3.86% (21.9371 => 22.7848, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6456 => 0.6699, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.76% (2.0273 => 2.1035, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4636 => 0.4803, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6450 => 0.6682, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 3.57% (0.3422 => 0.3544, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.55% (14.3668 => 14.8772, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (0.4064 => 0.4206, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.47% (2.2969 => 2.3767, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/football/football: 3.46% (0.8921 => 0.9230, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.43% (0.5981 => 0.6186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.41% (0.4103 => 0.4243, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.4289 => 0.4428, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.16% (0.3865 => 0.3987, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (1.5859 => 1.6347, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4620 => 0.4761, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4203 => 0.4331, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.4186 => 1.4609, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3826 => 0.3938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.82% (0.4048 => 0.4162, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.2024 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0665 => 2.1234, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.1840 => 1.2123, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (0.8101 => 0.8227, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.25% (1.2842 => 1.3002, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3126, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4143, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7551, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (4.2280 => 4.3581, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7897, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5802, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.01% (5.2763 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.75% (5.3855 => 3.8372, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.42% (5.3526 => 3.8313, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0634, std.dev.: 0.0333) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.31% (2.9384 => 2.5768, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -9.01% (22.1758 => 20.1784, std.dev.: 0.0238) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.05% (19.9488 => 18.3428, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.44% (1.8329 => 1.7148, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.6805 => 1.5770, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1517, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5113, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4135, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0085, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: -2.23% (1.2373 => 1.2097, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0088, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5756, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (0.5229 => 0.5684, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 5.12% (14.9895 => 15.7564, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 2.94% (14.1553 => 14.5708, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 4.00% (4.1105 => 4.2749, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.87% (1.1048 => 1.2138, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.80% (7.1582 => 7.3588, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.58% (3.4629 => 3.6562, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.6222 => 0.6326, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.04% (0.1485 => 0.1425, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 09:12:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 11:12:32 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913161232.68BC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3762?compare_to=3758&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3762, Order: 163799, Start Time: 2012-09-13 15:01:14, End Time: 2012-09-13 16:13:52 To: 3758, Order: 163794, Start Time: 2012-09-13 13:35:00, End Time: 2012-09-13 14:45:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 22 (65 on baseline) Performance Improvements: 2 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 877 (787 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.62% (3.0920 => 3.2038, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (2.0315 => 2.0991, std.dev.: 0.0259) MultiSource/Applications/lemon/lemon: 2.39% (1.0336 => 1.0583, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 2.32% (15.7805 => 16.1460, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8425 => 0.8599, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 1.96% (4.7709 => 4.8644, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.60% (1.2078 => 1.2271, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 35.39% (0.1376 => 0.1863, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.24% (0.7778 => 1.0208, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.60% (3.0313 => 3.5647, std.dev.: 0.0994) SingleSource/Benchmarks/Shootout/heapsort: 15.87% (3.1066 => 3.5996, std.dev.: 0.0903) MultiSource/Benchmarks/Olden/bisort/bisort: 7.00% (0.6556 => 0.7015, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary3: 6.39% (1.3910 => 1.4799, std.dev.: 0.0259) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (4.5384 => 4.8060, std.dev.: 0.0801) MultiSource/Benchmarks/Olden/tsp/tsp: 3.41% (1.7513 => 1.8110, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (4.3578 => 4.4976, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (41.9821 => 43.1953, std.dev.: 0.4255) SingleSource/Benchmarks/Shootout/ary3: 2.62% (1.9966 => 2.0489, std.dev.: 0.0088) MultiSource/Benchmarks/llubenchmark/llu: 2.24% (1.9960 => 2.0407, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/hash: 1.64% (4.3098 => 4.3803, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.43% (2.9235 => 2.9654, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (3.1949 => 3.2292, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -17.16% (0.0647 => 0.0536, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.97% (2.3902 => 2.3430, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.02% (0.9899 => 0.9798, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.5978 => 0.5980, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -1.22% (0.1638 => 0.1618, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.58% (0.1557 => 0.1439, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.55% (0.3093 => 0.3045, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.15% (0.2357 => 0.2330, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.47% (0.3167 => 0.3182, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.57% (0.2285 => 0.2298, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 7.20% (0.0375 => 0.0402, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: -53.49% (0.0086 => 0.0040, std.dev.: 0.0023) SingleSource/UnitTests/2003-08-11-VaListArg: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.27% (0.0237 => 0.0240, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.74% (0.0190 => 0.0181, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0385 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.34% (0.0296 => 0.0297, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0279 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -23.75% (0.0320 => 0.0244, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 35.88% (0.0131 => 0.0178) SingleSource/UnitTests/Vector/Altivec/test1: -43.92% (0.0189 => 0.0106, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0244 => 0.0245, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -24.32% (0.0296 => 0.0224, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1430 => 0.1437, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: -10.45% (1.4950 => 1.3387, std.dev.: 0.0458) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.13% (0.1519 => 0.1441, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.32% (0.4094 => 0.4107, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1416 => 0.1415, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.65% (0.0556 => 0.0593, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.94% (0.0179 => 0.0195, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.33% (0.0645 => 0.0559, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1606 => 1.1549, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.50% (0.0008 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.05% (0.0558 => 0.0575, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.68% (0.0142 => 0.0160, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.29% (0.7807 => 0.7908, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.17% (1.6057 => 1.6029, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 73.21% (0.0056 => 0.0097, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.88% (4.1772 => 3.0960, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/except: 82450.00% (0.0006 => 0.4953, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.5309 => 0.5693, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.54% (0.6410 => 0.6765, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: 5.53% (2.1763 => 2.2967, std.dev.: 0.0363) MultiSource/Applications/kimwitu++/kc: 5.46% (15.3105 => 16.1460, std.dev.: 0.0181) MultiSource/Applications/lemon/lemon: 5.35% (1.0046 => 1.0583, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 4.70% (0.6173 => 0.6463, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.16% (3.0758 => 3.2038, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3582 => 0.3723, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.92% (0.3901 => 0.4054, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.6915 => 0.7182, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 3.68% (1.1653 => 1.2082, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.41% (0.4248 => 0.4393, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.0317 => 2.0991, std.dev.: 0.0259) MultiSource/Applications/oggenc/oggenc: 2.51% (4.7455 => 4.8644, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.49% (0.6069 => 0.6220, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8405 => 0.8599, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.08% (1.2021 => 1.2271, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 2.05% (3.0225 => 3.0845, std.dev.: 0.0104) MultiSource/Applications/siod/siod: 1.73% (2.0972 => 2.1334, std.dev.: 0.0123) MultiSource/Applications/SPASS/SPASS: 1.53% (13.3238 => 13.5273, std.dev.: 0.0643) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.49% (0.0263 => 0.0380, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 41.50% (1.6538 => 2.3401, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 31.47% (0.1417 => 0.1863, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2294, std.dev.: 0.0302) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.12% (0.8498 => 1.0208, std.dev.: 0.0320) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.54% (0.0766 => 0.0908, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.99% (0.0917 => 0.1082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.82% (3.0256 => 3.5647, std.dev.: 0.0994) SingleSource/Benchmarks/Shootout/ary3: 17.58% (1.7426 => 2.0489, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 13.61% (0.3746 => 0.4256, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5514, std.dev.: 0.0840) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: 11.93% (3.2159 => 3.5996, std.dev.: 0.0903) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.61% (0.2694 => 0.2953, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 9.15% (7.0025 => 7.6430, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bisort/bisort: 8.61% (0.6459 => 0.7015, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.40% (1.0063 => 1.0908, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.18% (0.3301 => 0.3571, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.76% (4.2129 => 4.4976, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.71% (40.4792 => 43.1953, std.dev.: 0.4255) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.67% (4.5056 => 4.8060, std.dev.: 0.0801) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8028, std.dev.: 0.0861) MultiSource/Benchmarks/Olden/tsp/tsp: 4.50% (1.7330 => 1.8110, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/dt: 4.45% (0.9851 => 1.0289, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8530, std.dev.: 0.0500) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5403, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.73% (0.6308 => 0.6543, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.96% (2.6656 => 2.7446, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.64% (0.5876 => 0.6031, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 2.31% (5.1938 => 5.3138, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (2.4455 => 2.5009, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.6127 => 4.7090, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/bh/bh: 1.96% (2.5166 => 2.5659, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 1.91% (3.5520 => 3.6197, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 1.89% (14.4877 => 14.7608, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout/hash: 1.83% (4.3016 => 4.3803, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.72% (2.9152 => 2.9654, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5320, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.07% (4.0659 => 4.1093, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: 1.04% (2.4013 => 2.4262, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -17.92% (0.0653 => 0.0536, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.29% (0.5740 => 0.5494, std.dev.: 0.0094) MultiSource/Applications/spiff/spiff: -3.97% (0.7738 => 0.7431, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.17% (4.2815 => 4.2312, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.39% (5.2665 => 4.2452, std.dev.: 0.0786) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.39% (1.1647 => 0.9389, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -15.30% (1.7473 => 1.4799, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1624, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.24% (62.4126 => 56.6484, std.dev.: 0.0934) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.05% (2.4457 => 2.2732, std.dev.: 0.0450) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3764, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/richards_benchmark: -6.13% (1.4441 => 1.3556, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std.dev.: 0.0163) MultiSource/Applications/SIBsim4/SIBsim4: -5.66% (3.4230 => 3.2292, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.76% (0.4140 => 0.3943, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.63% (1.7361 => 1.6557, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ffbench: -4.58% (1.4117 => 1.3470, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/methcall: -3.41% (9.2503 => 8.9348, std.dev.: 0.0306) MultiSource/Applications/lambda-0_1_3/lambda: -2.99% (7.6833 => 7.4535, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -2.75% (3.4286 => 3.3343, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.68% (1.1683 => 1.1370, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2945, std.dev.: 0.0194) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.99% (1.2722 => 1.2469, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4226, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: -1.81% (1.0926 => 1.0728, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.81% (3.7496 => 3.6817, std.dev.: 0.0186) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.78% (2.8964 => 2.8447, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6119 => 0.6018, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -1.33% (3.8907 => 3.8390, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.27% (9.3855 => 9.2665, std.dev.: 0.0266) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.26% (25.6658 => 25.3418, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.82% (0.9980 => 0.9798, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: -0.70% (0.6022 => 0.5980, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -2.88% (0.1666 => 0.1618, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.40% (0.1554 => 0.1439, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.23% (0.3083 => 0.3045, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.67% (0.2394 => 0.2330, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.22% (0.3175 => 0.3182, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.17% (0.2302 => 0.2298, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -10.47% (0.0449 => 0.0402, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: -55.06% (0.0089 => 0.0040, std.dev.: 0.0023) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.73% (0.0192 => 0.0181, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -24.69% (0.0324 => 0.0244, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178) SingleSource/UnitTests/Vector/Altivec/test1: -43.92% (0.0189 => 0.0106, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -31.08% (0.0325 => 0.0224, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: -10.87% (1.5019 => 1.3387, std.dev.: 0.0458) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.00% (0.1501 => 0.1441, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.68% (0.4264 => 0.4107, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.1344 => 0.1415, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.68% (0.0589 => 0.0593, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.95% (0.0232 => 0.0195, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.52% (0.0639 => 0.0559, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.75% (1.1350 => 1.1549, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0637 => 0.0575, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.96% (0.0246 => 0.0160, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.87% (0.7541 => 0.7908, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.34% (1.5363 => 1.6029, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.57% (0.0070 => 0.0097, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 09:57:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 11:57:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913165748.C007C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3763?compare_to=3760&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3763, Order: 163804, Start Time: 2012-09-13 15:44:52, End Time: 2012-09-13 16:59:06 To: 3760, Order: 163794, Start Time: 2012-09-13 14:02:19, End Time: 2012-09-13 15:16:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.81% (3.7831 => 3.8514, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.90% (2.0176 => 2.3990, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.50% (0.1072 => 0.1206, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.52% (3.9660 => 4.3436, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 9.21% (0.7038 => 0.7686, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.99% (0.7710 => 0.8403, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5818 => 0.6336, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.83% (1.3693 => 1.4902, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.75% (1.2193 => 1.3260, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.72% (0.5265 => 0.5724, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5748 => 0.6243, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.57% (0.9199 => 0.9987, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.45% (0.6959 => 0.7547, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 8.24% (0.1589 => 0.1720, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.23% (0.4328 => 0.4684, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.15% (13.8202 => 14.9465, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.12% (1.1364 => 1.2287, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.12% (1.4563 => 1.5745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.00% (0.7061 => 0.7626, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.6283 => 0.6783, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.5577 => 0.6013, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.69% (1.0313 => 1.1106, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.46% (0.3899 => 0.4190, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.37% (1.1061 => 1.1876, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2781 => 0.2980, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (3.8646 => 4.1410, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 7.10% (0.8310 => 0.8900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3022 => 0.3236, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7269, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: 7.04% (0.2243 => 0.2401, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.96% (0.2760 => 0.2952, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.95% (0.7506 => 0.8028, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.5637 => 0.6029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3580 => 0.3828, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (3.6692 => 3.9225, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.3220 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.75% (2.1791 => 2.3261, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.70% (0.4016 => 0.4285, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3756 => 0.4007, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3489 => 0.3722, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.57% (3.1889 => 3.3985, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.54% (0.2690 => 0.2866, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.52% (0.6744 => 0.7184, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.50% (0.3293 => 0.3507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.49% (1.9828 => 2.1115, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.2966 => 0.3158, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (0.7460 => 0.7942, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.44% (0.2655 => 0.2826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.40% (0.1657 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.32% (0.1789 => 0.1902, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.27% (1.9270 => 2.0479, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4390 => 0.4665, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.26% (1.3245 => 1.4074, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.24% (16.6129 => 17.6497, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/ary: 6.21% (0.3107 => 0.3300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.20% (0.3868 => 0.4108, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.98% (14.8535 => 15.7420, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.2749 => 1.3511, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.92% (4.4433 => 4.7063, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.89% (8.4961 => 8.9963, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.85% (0.6135 => 0.6494, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.79% (1.3813 => 1.4613, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.3801 => 4.6307, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 5.72% (0.4003 => 0.4232, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (1.3819 => 1.4608, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.65% (0.3578 => 0.3780, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.62% (0.8818 => 0.9314, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (13.2842 => 14.0280, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.56% (0.8698 => 0.9182, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 5.54% (0.3789 => 0.3999, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.54% (0.3646 => 0.3848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3914 => 0.4129, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.46% (0.3940 => 0.4155, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.44% (0.3601 => 0.3797, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.41% (0.3663 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.40% (0.3650 => 0.3847, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1333 => 1.1939, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.30% (0.3623 => 0.3815, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.30% (0.2321 => 0.2444, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3755 => 0.3947) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.06% (0.6576 => 0.6909, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.06% (4.6629 => 4.8990, std.dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (6.5754 => 6.9063, std.dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: 5.00% (14.5298 => 15.2564, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (3.2742 => 3.4313, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.56% (0.9108 => 0.9523, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (4.9865 => 5.2042, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.26% (1.5188 => 1.5835, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2292 => 1.2791, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 4.02% (3.7467 => 3.8974, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6250 => 0.6485, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.73% (2.1007 => 2.1791, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (6.2785 => 6.5022, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 2.81% (33.2944 => 34.2289, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 1.65% (16.2614 => 16.5292, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5146, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 25.38% (1.8175 => 2.2787, std.dev.: 0.0332) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.85% (1.2998 => 1.3759, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6986, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5468, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0763, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5945, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.08% (3.7731 => 3.8514, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1423, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5929, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.16% (0.4657 => 0.3858, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.47% (22.5627 => 21.7788, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2586, std.dev.: 0.0631) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std.dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std.dev.: 0.0180) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9219, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5925, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.23% (26.5159 => 25.9234, std.dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2373, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8588, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std.dev.: 0.0268) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2441, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4963, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0627, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2613, std.dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 10:14:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 12:14:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913171428.20C6D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3764?compare_to=3761&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3764, Order: 163805, Start Time: 2012-09-13 15:56:13, End Time: 2012-09-13 17:15:45 To: 3761, Order: 163794, Start Time: 2012-09-13 14:08:16, End Time: 2012-09-13 15:27:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (114 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (734 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.06% (3.4347 => 3.4711, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.96% (14.8224 => 14.5323, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: -1.50% (0.7723 => 0.7607, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.32% (3.8568 => 3.8057, std.dev.: 0.0197) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.55% (0.5684 => 0.5653, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: -0.07% (15.7564 => 15.7452, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 0.19% (14.5708 => 14.5992, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 0.04% (81.9077 => 81.9406, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.2749 => 4.2879, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2138 => 1.2154, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.3588 => 7.3692, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.05% (3.6562 => 3.6543, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.28% (0.6326 => 0.6308, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1425 => 0.1424, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.13% (0.0670 => 0.0649, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.56% (63.2438 => 81.9406, std.dev.: 0.0205) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.69% (0.0720 => 10.3217, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.17% (10.3673 => 14.5323, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 26.45% (0.1622 => 0.2051, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.13% (2.2022 => 2.4914, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.07% (7.0540 => 7.9762, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.08% (1.1194 => 1.2546, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.14% (1.7609 => 1.9395, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3543 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.40% (0.1584 => 0.1717, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.26% (0.3282 => 0.3553, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.18% (0.3473 => 0.3757, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.02% (0.3543 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.01% (0.3497 => 0.3777, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.95% (0.3561 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.80% (0.3694 => 0.3982, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.78% (10.4361 => 11.2480, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 7.63% (0.3828 => 0.4120, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 7.61% (0.3927 => 0.4226, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.46% (0.3886 => 0.4176, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.89% (0.4879 => 0.5215, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.65% (9.4845 => 10.1149, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7433 => 0.7887, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.85% (0.7115 => 0.7531, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 5.76% (0.2554 => 0.2701, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.74% (3.3354 => 3.5270, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.72% (0.3307 => 0.3496, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.68% (0.4615 => 0.4877, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.65% (0.6675 => 0.7052, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 5.60% (0.3109 => 0.3283, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.58% (5.7591 => 6.0806, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 5.43% (0.3423 => 0.3609, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.41% (0.5105 => 0.5381, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.37% (0.2271 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.5860 => 0.6173, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.33% (1.3050 => 1.3746, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (4.2646 => 4.4899, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.2065 => 0.2174, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.8172 => 0.8603, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.24% (1.5415 => 1.6223, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.22% (8.1363 => 8.5608, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 5.11% (0.3092 => 0.3250, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.08% (0.5569 => 0.5852, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.8067 => 0.8471, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.94% (0.2107 => 0.2211, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.87% (4.9449 => 5.1858, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (5.0018 => 5.2454, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.75% (0.9765 => 1.0229, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 4.70% (0.7835 => 0.8203, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.66% (1.1642 => 1.2185, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 4.56% (0.5925 => 0.6195, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.54% (0.6030 => 0.6304, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.38% (3.8723 => 4.0420, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 4.34% (1.0722 => 1.1187, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.3180 => 0.3317, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.29% (1.1861 => 1.2370, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.28% (0.3387 => 0.3532, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.26% (1.5603 => 1.6267, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.23% (0.2603 => 0.2713, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.18% (21.9371 => 22.8551, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.14% (7.9617 => 8.2910, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.5020 => 0.5224, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 4.05% (0.4299 => 0.4473, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.90% (2.2969 => 2.3864, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 3.84% (0.7326 => 0.7607, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 3.77% (2.0273 => 2.1038, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.8921 => 0.9257, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.75% (0.6450 => 0.6692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.67% (0.6456 => 0.6693, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (14.3668 => 14.8692, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5981 => 0.6190, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4636 => 0.4793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.34% (0.4103 => 0.4240, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.24% (1.5859 => 1.6373, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.19% (0.3422 => 0.3531, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.15% (0.4064 => 0.4192, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.4186 => 1.4623, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.07% (0.3650 => 0.3762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3865 => 0.3979, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.89% (2.2024 => 2.2660, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3826 => 0.3935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.84% (0.4289 => 0.4411, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.4203 => 0.4321, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.4620 => 0.4744, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.52% (0.4048 => 0.4150, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.1840 => 1.2136, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1163, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.8101 => 0.8238, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.00% (1.2842 => 1.2971, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3804, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3477, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.32% (0.9540 => 0.9666, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2337, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7885, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5819, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.82% (5.2763 => 3.2281, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.43% (5.3855 => 3.8546, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.17% (5.3526 => 3.8450, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1690, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.91% (2.9384 => 2.5885, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -9.11% (22.1758 => 20.1561, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2921, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.43% (1.8329 => 1.7150, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.15% (1.6805 => 1.5771, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5071, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4228, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0117, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -1.96% (1.2373 => 1.2130, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (8.1563 => 8.0298, std.dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5785, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.11% (0.5229 => 0.5653, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 5.04% (14.9895 => 15.7452, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 3.14% (14.1553 => 14.5992, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (4.1105 => 4.2879, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.01% (1.1048 => 1.2154, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (7.1582 => 7.3692, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.53% (3.4629 => 3.6543, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (0.6222 => 0.6308, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.11% (0.1485 => 0.1424, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 11:16:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 13:16:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120913181621.CB8DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3765?compare_to=3759&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3765, Order: 163802, Start Time: 2012-09-13 15:34:05, End Time: 2012-09-13 18:17:39 To: 3759, Order: 163787, Start Time: 2012-09-13 12:19:43, End Time: 2012-09-13 15:03:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.15% (1.3488 => 1.3643, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.70% (2.1203 => 2.0843, std.dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.90% (0.3465 => 0.3808, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.90% (0.3446 => 0.3787, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.88% (0.3442 => 0.3782, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3488 => 0.3832, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 9.84% (0.3496 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3469 => 0.3808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3460 => 0.3798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.56% (0.3650 => 0.3999, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 9.53% (0.3643 => 0.3990, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.37% (0.3724 => 0.4073, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.59% (1.5932 => 1.7141, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5826 => 0.6184, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.08% (0.5889 => 0.6247, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (1.6211 => 1.7146, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7629, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.47% (1.3152 => 1.3872, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.20% (5.5417 => 5.8296, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (2.7292 => 2.8700, std.dev.: 0.0094) MultiSource/Applications/d/make_dparser: 4.93% (1.0781 => 1.1312, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (0.3930 => 0.4122, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7171 => 0.7515, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.71% (0.2736 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.68% (0.2566 => 0.2686, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.60% (4.2109 => 4.4045, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (2.1013 => 2.1962, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (4.4195 => 4.6166, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.38% (0.5026 => 0.5246, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (1.8794 => 1.9590, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2875 => 0.2996, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.3903 => 0.4066, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3195 => 0.3327, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.12% (2.1653 => 2.2546, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 4.12% (1.4269 => 1.4857, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (0.5900 => 0.6143, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 4.11% (4.6177 => 4.8076, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2823 => 0.2939, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.4139 => 0.4308, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (0.4658 => 0.4848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.3004 => 0.3126, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 4.05% (0.6634 => 0.6903, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (2.0673 => 2.1496, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3258 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2750 => 0.2857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3267 => 0.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2811 => 0.2917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3060 => 0.3175, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.73% (0.5546 => 0.5753, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2803 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.70% (0.2729 => 0.2830, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.67% (23.5202 => 24.3836, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.53% (0.3317 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.49% (0.3726 => 0.3856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3477 => 0.3597, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 3.45% (0.3336 => 0.3451, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.44% (0.3084 => 0.3190, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (1.9694 => 2.0367, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.41% (0.4251 => 0.4396, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4146 => 0.4287, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (1.9966 => 2.0635, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3690 => 0.3811, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.24% (0.7875 => 0.8130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.17% (0.3981 => 0.4107, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.6435 => 0.6633, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.06% (0.9697 => 0.9994, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.5012 => 0.5159, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.72% (2.0346 => 2.0900, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.27% (0.4847 => 0.4957, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (0.7426 => 0.7583, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (0.5361 => 0.5470, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (11.6398 => 11.8000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.37% (4.6926 => 4.7570, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6729, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.71% (0.2122 => 0.2222, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1652, std.dev.: 0.0561) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6318, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1952, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5042, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4490, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2805, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5884, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5377, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.73% (28.1477 => 25.9732, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7874, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7961, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7754, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.53% (0.6293 => 0.6134, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8396, std.dev.: 0.0771) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5670, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9553, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.4999, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 11:43:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 13:43:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913184306.1ADC72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3766?compare_to=3763&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3766, Order: 163810, Start Time: 2012-09-13 17:30:03, End Time: 2012-09-13 18:44:24 To: 3763, Order: 163804, Start Time: 2012-09-13 15:44:52, End Time: 2012-09-13 16:59:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (54.3849 => 55.6708, std.dev.: 0.4520) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.91% (2.0176 => 2.3992, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.63% (0.1072 => 0.1186) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.62% (3.9660 => 4.3476, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.45% (0.2721 => 0.2978, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.36% (0.2596 => 0.2839, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.35% (0.7710 => 0.8431, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 9.17% (1.3693 => 1.4949, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.08% (0.5265 => 0.5743, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 9.05% (0.7038 => 0.7675, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.86% (1.2193 => 1.3273, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.82% (0.9199 => 1.0010, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.78% (0.6959 => 0.7570, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5818 => 0.6323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5748 => 0.6237, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.4563 => 1.5778, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.33% (1.1364 => 1.2311, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 8.11% (13.8202 => 14.9408, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.98% (0.5577 => 0.6022, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: 7.90% (0.7061 => 0.7619, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.83% (0.6283 => 0.6775, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.3899 => 0.4202, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.73% (1.0313 => 1.1110, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2127 => 0.2291, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.39% (1.1061 => 1.1878, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.36% (7.2180 => 7.7489, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.31% (0.5637 => 0.6049, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.25% (0.7506 => 0.8050, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.21% (0.2995 => 0.3211, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.20% (3.8646 => 4.1430, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.09% (0.8310 => 0.8899, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.08% (0.3756 => 0.4022, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.03% (1.9828 => 2.1222, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.00% (0.2243 => 0.2400, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.99% (0.3220 => 0.3445, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.92% (0.2023 => 0.2163, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.91% (3.6692 => 3.9227, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.7460 => 0.7975, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 6.89% (0.3293 => 0.3520, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2761 => 0.2949, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 6.78% (3.1889 => 3.4050, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3107 => 0.3315, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.65% (0.4390 => 0.4682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.59% (2.1791 => 2.3226, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.51% (0.6744 => 0.7183, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.3245 => 1.4096, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.42% (1.9270 => 2.0508, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3650 => 0.3882, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.29% (0.3578 => 0.3803, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.0594 => 1.1259, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.27% (0.4003 => 0.4254, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3914 => 0.4158, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 6.23% (0.3789 => 0.4025, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.17% (0.3940 => 0.4183, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3646 => 0.3869, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3525, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 6.06% (0.3663 => 0.3885, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.05% (0.3601 => 0.3819, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.04% (14.8535 => 15.7508, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 5.96% (16.6129 => 17.6033, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions-3: 5.93% (0.3623 => 0.3838, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (8.4961 => 8.9996, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.91% (1.3813 => 1.4630, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.91% (1.3819 => 1.4636, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4113 => 0.4356, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.2859 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.85% (0.8698 => 0.9207, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.81% (4.3801 => 4.6344, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.79% (4.4433 => 4.7007, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.6135 => 0.6490, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (13.2842 => 14.0497, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6576 => 0.6944, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 5.59% (0.3131 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.51% (1.1333 => 1.1957, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.35% (0.8818 => 0.9290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.26% (14.5298 => 15.2940, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (6.5754 => 6.9135, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.96% (0.3245 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.77% (3.2742 => 3.4305, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.75% (4.6629 => 4.8846, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.43% (0.4805 => 0.5018, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2292 => 1.2835, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.35% (0.9108 => 0.9504, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.32% (1.5188 => 1.5844, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.05% (0.6250 => 0.6503, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.05% (3.7467 => 3.8983, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (4.9865 => 5.1842, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.79% (2.1007 => 2.1803, std.dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.79% (6.2785 => 6.5163, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.25% (0.3511 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.60% (33.2944 => 34.1616, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5557, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5489, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0763, std.dev.: 0.0683) MultiSource/Benchmarks/llubenchmark/llu: 2.71% (3.7731 => 3.8752, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5889, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4459, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5962, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6877, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.10% (7.9275 => 8.0149, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7103, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2533, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2729 => 3.1510, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9219, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5861, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.23% (26.5159 => 25.9236, std.dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2433, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2399, std.dev.: 0.0275) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2252, std.dev.: 0.0423) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0597, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2617, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 13:25:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 15:25:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913202540.6E20C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3767?compare_to=3766&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3767, Order: 163820, Start Time: 2012-09-13 19:12:41, End Time: 2012-09-13 20:26:58 To: 3766, Order: 163810, Start Time: 2012-09-13 17:30:03, End Time: 2012-09-13 18:44:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.24% (1.2937 => 1.3098, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (2.0176 => 2.4140, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.48% (3.9660 => 4.3419, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5748 => 0.6282, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.09% (0.7038 => 0.7678, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.01% (1.3693 => 1.4927, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.00% (0.7710 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.83% (0.5265 => 0.5730, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.77% (0.9199 => 1.0006, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3242, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.56% (0.6959 => 0.7555, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.25% (1.1364 => 1.2301, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.18% (13.8202 => 14.9504, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.05% (1.4563 => 1.5736, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.90% (0.4062 => 0.4383, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.6283 => 0.6772, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.67% (0.5577 => 0.6005, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.58% (0.4791 => 0.5154, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 7.55% (1.0313 => 1.1092, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.28% (1.1061 => 1.1866, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.3756 => 0.4026, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.10% (3.8646 => 4.1390, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.10% (1.9828 => 2.1235, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2655 => 0.2843, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7269, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.94% (0.2925 => 0.3128, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 6.93% (0.8310 => 0.8886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.90% (0.7506 => 0.8024, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.83% (0.5637 => 0.6022, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.78% (3.6692 => 3.9179, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.75% (0.3868 => 0.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.7460 => 0.7959, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.62% (2.1791 => 2.3233, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.61% (0.4390 => 0.4680, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.35% (3.1889 => 3.3915, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 6.30% (0.6744 => 0.7169, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.30% (16.6129 => 17.6592, std.dev.: 0.0115) MultiSource/Applications/treecc/treecc: 6.29% (1.9270 => 2.0483, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/trivial-interface: 6.26% (0.3578 => 0.3802, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.4003 => 0.4251, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.16% (0.3914 => 0.4155, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.15% (0.3789 => 0.4022, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.14% (1.0594 => 1.1245, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3646 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.08% (0.3601 => 0.3820, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.07% (0.3940 => 0.4179, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.00% (0.3650 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.99% (0.3623 => 0.3840, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.95% (0.6576 => 0.6967, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.93% (0.8698 => 0.9214, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.89% (1.2749 => 1.3500, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.78% (14.8535 => 15.7126, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/05-eks/eks: 5.76% (0.4113 => 0.4350, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (1.3813 => 1.4608, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.70% (8.4961 => 8.9801, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.70% (1.3819 => 1.4606, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.67% (0.2859 => 0.3021, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3755 => 0.3962, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.6135 => 0.6472, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.49% (4.3801 => 4.6207, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.44% (4.4433 => 4.6852, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9988, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1333 => 1.1923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.13% (14.5298 => 15.2758, std.dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (6.5754 => 6.9059, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.01% (3.2742 => 3.4383, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.91% (0.8818 => 0.9251, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.80% (4.6629 => 4.8867, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2842, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.41% (0.4805 => 0.5017, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.40% (4.9865 => 5.2059, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (1.5188 => 1.5828, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.19% (0.9108 => 0.9490, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6250 => 0.6510, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.95% (3.7467 => 3.8947, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.77% (2.1007 => 2.1800, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.56% (0.3511 => 0.3636, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (6.2785 => 6.4967, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 2.79% (33.2944 => 34.2242, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.75% (16.2614 => 16.5466, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5196, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.74% (1.1560 => 1.2570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.56% (1.9199 => 1.9882, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0769, std.dev.: 0.0468) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5990, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5185, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4456, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5867, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.71% (0.4657 => 0.3879, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.69% (22.5627 => 21.7296, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2615, std.dev.: 0.0239) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.78% (0.4867 => 0.4683, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1496, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9240, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5781, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.36% (26.5159 => 25.8906, std.dev.: 0.0261) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2438, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2413, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0627, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5629, std.dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2617, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 13:55:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 15:55:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913205543.10D1E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3768?compare_to=3764&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3768, Order: 163824, Start Time: 2012-09-13 19:37:10, End Time: 2012-09-13 20:57:01 To: 3764, Order: 163805, Start Time: 2012-09-13 15:56:13, End Time: 2012-09-13 17:15:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (121 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 940 (725 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.93% (14.5323 => 15.2484, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 1.90% (11.2480 => 11.4615, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (3.8450 => 3.9159, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (7.9762 => 8.1109, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (3.8546 => 3.9179, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.61% (2.4914 => 2.5315, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 1.52% (0.7607 => 0.7723, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.30% (3.2281 => 3.2700, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.20% (1.9395 => 1.9628, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (8.2910 => 8.3760, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (0.5653 => 0.5736, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 0.64% (15.7452 => 15.8460, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 0.56% (14.5992 => 14.6812, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 1.72% (81.9406 => 83.3517, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 0.39% (4.2879 => 4.3047, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.58% (1.2154 => 1.2225, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.50% (7.3692 => 7.4062, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (3.6543 => 3.6731, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.81% (0.6308 => 0.6359, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1424 => 0.1427, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (0.0649 => 0.0670, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.79% (63.2438 => 83.3517, std.dev.: 0.0118) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14252.36% (0.0720 => 10.3337, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.08% (10.3673 => 15.2484, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 27.62% (0.1622 => 0.2070, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.98% (7.0540 => 8.1109, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.95% (2.2022 => 2.5315, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.07% (1.1194 => 1.2657, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.47% (1.7609 => 1.9628, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 9.83% (10.4361 => 11.4615, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3473 => 0.3800, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.17% (0.3543 => 0.3868, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.14% (0.3543 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.10% (0.3516 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.09% (0.3497 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3561 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.85% (0.3694 => 0.4021, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.70% (0.3828 => 0.4161, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.68% (0.3927 => 0.4268, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.52% (0.3886 => 0.4217, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.96% (0.3177 => 0.3430, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.4879 => 0.5259, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.64% (9.4845 => 10.2092, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2554 => 0.2719, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.39% (0.8172 => 0.8694, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4615 => 0.4907, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.23% (0.5105 => 0.5423, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.20% (0.7433 => 0.7894, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.19% (0.8067 => 0.8566, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.10% (5.7591 => 6.1102, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 6.08% (0.3423 => 0.3631, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (8.1363 => 8.6290, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5860 => 0.6207, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.88% (1.5415 => 1.6322, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (4.2646 => 4.5131, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.81% (4.9449 => 5.2321, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.80% (3.3354 => 3.5290, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (5.0018 => 5.2865, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 5.64% (0.5925 => 0.6259, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3441 => 0.3634, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.53% (0.5569 => 0.5877, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.3092 => 0.3263, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.44% (0.7835 => 0.8261, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7326 => 0.7723, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9765 => 1.0282, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.20% (7.9617 => 8.3760, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 5.12% (21.9371 => 23.0599, std.dev.: 0.0200) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2234, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.3180 => 0.3340, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.92% (1.5603 => 1.6370, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.84% (0.3387 => 0.3551, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.75% (1.1861 => 1.2424, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 4.72% (3.8723 => 4.0552, std.dev.: 0.0109) MultiSource/Applications/lemon/lemon: 4.71% (1.0722 => 1.1227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.58% (0.8921 => 0.9330, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.20% (2.0273 => 2.1124, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6456 => 0.6727, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6450 => 0.6720, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 4.08% (2.2969 => 2.3906, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4636 => 0.4823, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.4064 => 0.4226, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.4103 => 0.4266, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.95% (0.5981 => 0.6217, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.87% (1.4186 => 1.4735, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5859 => 1.6466, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.51% (14.3668 => 14.8715, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.43% (0.4203 => 0.4347, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.4048 => 0.4181, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (2.0665 => 2.1337, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.23% (2.2024 => 2.2735, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1840 => 1.2199, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.3684 => 0.3795, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.8101 => 0.8267, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.75% (1.2842 => 1.3067, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3811, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7451, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3486, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2235, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5849, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1299, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2700, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.25% (5.3855 => 3.9179, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.84% (5.3526 => 3.9159, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1415, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.57% (2.9384 => 2.5984, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.36% (22.1758 => 20.3219, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2827, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8485, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4082, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5098, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0115, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: -2.59% (1.2373 => 1.2053, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9893, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5796, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.22% (1.0313 => 1.0187, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2340, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.70% (0.5229 => 0.5736, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.71% (14.9895 => 15.8460, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 3.72% (14.1553 => 14.6812, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (4.1105 => 4.3047, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.65% (1.1048 => 1.2225, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.46% (7.1582 => 7.4062, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.07% (3.4629 => 3.6731, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.6222 => 0.6359, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 13:56:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 15:56:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913205602.83D882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3769?compare_to=3762&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3769, Order: 163826, Start Time: 2012-09-13 19:45:33, End Time: 2012-09-13 20:57:22 To: 3762, Order: 163799, Start Time: 2012-09-13 15:01:14, End Time: 2012-09-13 16:13:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (45 on baseline) Performance Improvements: 3 (33 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 889 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.78% (0.0536 => 0.0642, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.19% (0.2003 => 0.2147, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 3.45% (0.4027 => 0.4166, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 2.44% (0.7431 => 0.7612, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (1.3952 => 1.4185, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.33% (0.8898 => 0.9016, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 5.15% (3.5386 => 3.7209, std.dev.: 0.0476) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.74% (0.6018 => 0.6123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.41% (1.6557 => 1.6791, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.86% (0.8599 => 0.8439, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.18% (1.2846 => 1.2694, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -4.71% (3.5996 => 3.4300, std.dev.: 0.0412) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.33% (0.9798 => 1.0026, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 0.74% (0.5980 => 0.6024, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 3.15% (0.1618 => 0.1669, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.62% (0.1439 => 0.1563, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.61% (0.3045 => 0.3155, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.63% (0.2330 => 0.2368, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.22% (0.3182 => 0.3175, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.91% (0.2298 => 0.2277, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 12.69% (0.0402 => 0.0453, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: 120.00% (0.0040 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 3.45% (0.0087 => 0.0090, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.67% (0.0240 => 0.0236, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.08% (0.0181 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.71% (0.0385 => 0.0363, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.68% (0.0297 => 0.0302, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.16% (0.0278 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.48% (0.0244 => 0.0272, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0178 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 80.19% (0.0106 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 44.20% (0.0224 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1437 => 0.1429, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 0.99% (1.3387 => 1.3520, std.dev.: 0.0632) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.23% (0.1441 => 0.1502, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4107 => 0.4035, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.53% (0.1415 => 0.1365, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.56% (0.0593 => 0.0560, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.97% (0.0195 => 0.0232, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.51% (0.0559 => 0.0601, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1549 => 1.1493, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.13% (0.0575 => 0.0557, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.37% (0.0160 => 0.0145, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.32% (0.7908 => 0.7804, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.36% (1.6029 => 1.5971, std.dev.: 0.0093) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.74% (0.0097 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.19% (4.1772 => 3.0831, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/except: 81316.67% (0.0006 => 0.4885, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.82% (0.5309 => 0.5671, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.35% (0.6410 => 0.6753, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.21% (0.2552 => 0.2685, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 4.86% (2.1763 => 2.2820, std.dev.: 0.0272) MultiSource/Applications/kimwitu++/kc: 4.48% (15.3105 => 15.9960, std.dev.: 0.2351) MultiSource/Applications/SIBsim4/SIBsim4: 3.65% (1.1653 => 1.2078, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: 3.50% (0.6915 => 0.7157, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.49% (1.5150 => 1.5679, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.32% (0.3582 => 0.3701, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 2.79% (29.3170 => 30.1337, std.dev.: 0.3090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.15% (0.7639 => 0.7803, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (1.3935 => 1.4185, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.96% (1.7426 => 2.0033, std.dev.: 0.0573) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.20% (4.0101 => 4.5395, std.dev.: 0.1387) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.76% (0.0917 => 0.1034, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 11.24% (0.1433 => 0.1594, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.80% (7.0025 => 7.6187, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.84% (1.0063 => 1.0852, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: 7.10% (1.0194 => 1.0918, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.07% (0.2857 => 0.3059, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (0.3301 => 0.3533, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: 6.66% (3.2159 => 3.4300, std.dev.: 0.0412) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.51% (40.4792 => 43.1131, std.dev.: 0.1271) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8145, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8545, std.dev.: 0.0456) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5377, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/five11/five11: 2.72% (5.1938 => 5.3350, std.dev.: 0.0362) SingleSource/Benchmarks/Misc/ReedSolomon: 2.48% (8.5113 => 8.7224, std.dev.: 0.0587) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.45% (2.6656 => 2.7308, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.26% (38.9255 => 39.8037, std.dev.: 0.1422) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.83% (2.4455 => 2.4902, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 1.69% (3.5520 => 3.6122, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/bh/bh: 1.51% (2.5166 => 2.5547, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (4.6127 => 4.6813, std.dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5307, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.12% (2.8599 => 2.8920, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.98% (0.4596 => 0.4367, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.18% (0.3497 => 0.2057, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.61% (5.2665 => 4.1812, std.dev.: 0.0925) SingleSource/Benchmarks/Shootout-C++/ary3: -20.56% (1.7473 => 1.3881, std.dev.: 0.0624) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.27% (1.1647 => 0.9403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5285, std.dev.: 0.1285) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.63% (1.4034 => 1.2823, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.42% (3.2007 => 2.9633, std.dev.: 0.0790) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3660, std.dev.: 0.0278) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1854, std.dev.: 0.0285) SingleSource/Benchmarks/Misc/richards_benchmark: -6.56% (1.4441 => 1.3493, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: -5.25% (4.6355 => 4.3920, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4140 => 0.3938, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.87% (1.4021 => 1.3479, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.52% (3.7496 => 3.6176, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (9.2503 => 8.9294, std.dev.: 0.0150) MultiSource/Applications/lambda-0_1_3/lambda: -3.29% (7.6833 => 7.4306, std.dev.: 0.0761) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.28% (1.7361 => 1.6791, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0099) MultiSource/Applications/aha/aha: -2.81% (3.4286 => 3.3324, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2864, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: -2.68% (0.4296 => 0.4181, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -2.14% (1.0926 => 1.0692, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4184, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (9.3855 => 9.2140, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.65% (3.8907 => 3.8266, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (92.7467 => 91.2857, std.dev.: 0.1051) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3155, std.dev.: 0.0315) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.46% (0.9980 => 1.0026, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.6022 => 0.6024, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 0.18% (0.1666 => 0.1669, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (0.3083 => 0.3155, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.09% (0.2394 => 0.2368, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3175 => 0.3175, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (0.2302 => 0.2277, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.67% (0.0240 => 0.0236, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.92% (0.0390 => 0.0363, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.05% (0.0324 => 0.0272, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -9.98% (1.5019 => 1.3520, std.dev.: 0.0632) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1501 => 0.1502, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.37% (0.4264 => 0.4035, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.56% (0.1344 => 0.1365, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.92% (0.0589 => 0.0560, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0639 => 0.0601, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.26% (1.1350 => 1.1493, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.56% (0.0637 => 0.0557, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.06% (0.0246 => 0.0145, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.49% (0.7541 => 0.7804, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.96% (1.5363 => 1.5971, std.dev.: 0.0093) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 15:22:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 17:22:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913222254.025B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3770?compare_to=3769&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3770, Order: 163837, Start Time: 2012-09-13 21:13:30, End Time: 2012-09-13 22:24:12 To: 3769, Order: 163826, Start Time: 2012-09-13 19:45:33, End Time: 2012-09-13 20:57:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (43 on baseline) Performance Improvements: 4 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 32.79% (0.0427 => 0.0567, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: 9.74% (8.1999 => 8.9989, std.dev.: 0.1463) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.99% (1.3479 => 1.3882, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.67% (3.6176 => 3.6780, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.03% (2.5480 => 2.5743, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.92% (0.7612 => 0.7390, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -9.29% (3.7209 => 3.3753, std.dev.: 0.0530) MultiSource/Applications/SPASS/SPASS: -4.93% (8.5492 => 8.1281, std.dev.: 0.1372) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.14% (39.8037 => 39.3499, std.dev.: 0.1409) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.36% (1.0026 => 0.9789, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: -1.18% (0.6024 => 0.5953, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: -2.88% (0.1669 => 0.1621, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.41% (0.1563 => 0.1541, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.14% (0.3155 => 0.3056, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.04% (0.2368 => 0.2296, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.96% (0.3175 => 0.3081, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.83% (0.2277 => 0.2258, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -16.34% (0.0453 => 0.0379, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: -2.27% (0.0088 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -37.78% (0.0090 => 0.0056, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.85% (0.0236 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.68% (0.0363 => 0.0380, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.65% (0.0302 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.18% (0.0272 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -2.22% (0.0180 => 0.0176, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -2.09% (0.0191 => 0.0187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.81% (0.0246 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -5.88% (0.0323 => 0.0304, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.76% (1.3520 => 1.4704, std.dev.: 0.0303) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.86% (0.1502 => 0.1474, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.77% (0.4035 => 0.4268, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.22% (0.1365 => 0.1409, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.46% (0.0560 => 0.0613) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0232 => 0.0174, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0601 => 0.0600, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1493 => 1.1464, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.69% (0.0557 => 0.0542, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.69% (0.0145 => 0.0175, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (0.7804 => 0.7819, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.36% (1.5971 => 1.6028, std.dev.: 0.0076) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -68.60% (0.0121 => 0.0038, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.71% (4.1772 => 3.0614, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/except: 82550.00% (0.0006 => 0.4959, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 5.31% (0.5309 => 0.5591, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 5.29% (2.1763 => 2.2914, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.68% (0.6410 => 0.6710, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3582 => 0.3729, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.2552 => 0.2652, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.10% (29.3170 => 29.9320, std.dev.: 0.2331) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.7639 => 0.7778, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 1.35% (2.0972 => 2.1255, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.06% (3.0225 => 3.0545, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.35% (0.0263 => 0.0377, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3375, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0293) MultiSource/Applications/sgefa/sgefa: 14.23% (0.3746 => 0.4279, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5537, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6126, std.dev.: 0.0487) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.48% (1.0063 => 1.0916, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.53% (0.2857 => 0.3072, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 7.29% (1.0194 => 1.0937, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.27% (0.3301 => 0.3541, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.13% (0.2694 => 0.2886, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8160, std.dev.: 0.1112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.74% (40.4792 => 42.3968, std.dev.: 0.5368) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.15% (4.2129 => 4.3876, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8471, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.70% (3.4080 => 3.5340, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.57% (6.6312 => 6.8679, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.86% (0.5876 => 0.6044, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5113 => 8.7531, std.dev.: 0.0685) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.79% (2.6656 => 2.7401, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.76% (0.5587 => 0.5741, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.22% (0.6308 => 0.6448, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/five11/five11: 2.21% (5.1938 => 5.3086, std.dev.: 0.0341) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.6127 => 4.7073, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4455 => 2.4852, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7226, std.dev.: 0.0103) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6083, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5325, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (38.9255 => 39.3499, std.dev.: 0.1409) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2080 => 0.1936, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: -4.50% (0.7738 => 0.7390, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -2.38% (0.9425 => 0.9201, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.45% (5.2665 => 4.0843, std.dev.: 0.1308) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.48% (1.1647 => 0.9378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -9.29% (62.4126 => 56.6156, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.41% (2.4457 => 2.2400, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.28% (3.2007 => 2.9357, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.24% (3.6254 => 3.3630, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: -6.93% (3.4230 => 3.1858, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: -6.59% (1.4441 => 1.3489, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (3.6023 => 3.3753, std.dev.: 0.0530) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4140 => 0.3938, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: -4.74% (8.5323 => 8.1281, std.dev.: 0.1372) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.65% (45.4683 => 43.3546, std.dev.: 0.6305) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.48% (1.7361 => 1.6583, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (9.2503 => 8.9585, std.dev.: 0.0394) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (7.6833 => 7.4451, std.dev.: 0.0071) MultiSource/Applications/aha/aha: -2.87% (3.4286 => 3.3303, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: -2.79% (0.4296 => 0.4176, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.74% (1.1683 => 1.1363, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.53% (1.2722 => 1.2400, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4194, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.91% (3.7496 => 3.6780, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1544, std.dev.: 0.5091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2284, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.42% (3.8907 => 3.8355, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3073, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/oourafft: -1.23% (3.8200 => 3.7729, std.dev.: 0.0127) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.91% (0.9980 => 0.9789, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: -1.15% (0.6022 => 0.5953, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: -2.70% (0.1666 => 0.1621, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.84% (0.1554 => 0.1541, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.88% (0.3083 => 0.3056, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.09% (0.2394 => 0.2296, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.96% (0.3175 => 0.3081, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.91% (0.2302 => 0.2258, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -15.59% (0.0449 => 0.0379, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -37.78% (0.0090 => 0.0056, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.56% (0.0390 => 0.0380, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0324 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -1.06% (0.0189 => 0.0187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -6.46% (0.0325 => 0.0304, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -2.10% (1.5019 => 1.4704, std.dev.: 0.0303) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.80% (0.1501 => 0.1474, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.09% (0.4264 => 0.4268, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.84% (0.1344 => 0.1409, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0232 => 0.0174, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0639 => 0.0600, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.00% (1.1350 => 1.1464, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.91% (0.0637 => 0.0542, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.86% (0.0246 => 0.0175, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.69% (0.7541 => 0.7819, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.33% (1.5363 => 1.6028, std.dev.: 0.0076) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.71% (0.0070 => 0.0038, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 15:43:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 17:43:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120913224342.8A4E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3771?compare_to=3768&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3771, Order: 163837, Start Time: 2012-09-13 21:25:36, End Time: 2012-09-13 22:45:00 To: 3768, Order: 163824, Start Time: 2012-09-13 19:37:10, End Time: 2012-09-13 20:57:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (119 on baseline) Performance Improvements: 7 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 942 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.13% (7.9639 => 8.0536, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.48% (0.7723 => 0.7609, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.34% (8.1109 => 8.0025, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.29% (2.5315 => 2.4988, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.19% (3.9179 => 3.8711, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.17% (3.9159 => 3.8701, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.05% (3.2700 => 3.2358, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.63% (80.9264 => 77.9916, std.dev.: 1.0214) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -1.05% (0.5736 => 0.5676, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -0.37% (15.8460 => 15.7868, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: -0.41% (14.6812 => 14.6217, std.dev.: 0.0216) MultiSource/Benchmarks/Bullet/bullet: -0.59% (83.3517 => 82.8620, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: -0.30% (4.3047 => 4.2917, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2225 => 1.2218, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (7.4062 => 7.3845, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.11% (3.6731 => 3.6689, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.6359 => 0.6352, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1427 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.13% (0.0670 => 0.0649, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.02% (63.2438 => 82.8620, std.dev.: 0.0044) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14246.94% (0.0720 => 10.3298, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.40% (10.3673 => 15.1780, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 25.71% (0.1622 => 0.2039, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.47% (2.2022 => 2.4988, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.45% (7.0540 => 8.0025, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 12.92% (0.1432 => 0.1617, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.24% (1.1194 => 1.2564, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.74% (1.7609 => 1.9501, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 9.45% (10.4361 => 11.4223, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3543 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3543 => 0.3850, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 8.62% (0.3282 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3561 => 0.3867, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3516 => 0.3816, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3694 => 0.4008, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3828 => 0.4141, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.3927 => 0.4246, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 8.03% (0.3886 => 0.4198, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.94% (9.4845 => 10.1423, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2700 => 0.2867) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.5860 => 0.6216, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.6675 => 0.7080, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.93% (0.7433 => 0.7874, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.91% (0.2554 => 0.2705, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4615 => 0.4887, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.87% (0.7115 => 0.7533, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.86% (0.8172 => 0.8651, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.72% (0.2271 => 0.2401, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.71% (4.2646 => 4.5080, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.70% (1.3050 => 1.3794, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.70% (0.5105 => 0.5396, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.67% (0.3423 => 0.3617, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (1.5415 => 1.6286, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (8.1363 => 8.5933, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5569 => 0.5879, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 5.55% (5.7591 => 6.0790, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 5.51% (3.3354 => 3.5191, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.42% (0.2065 => 0.2177, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.19% (5.0018 => 5.2615, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.15% (4.9449 => 5.1997, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.8067 => 0.8481, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.11% (0.2758 => 0.2899, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3121 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.04% (0.9765 => 1.0257, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.94% (0.3441 => 0.3611, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.93% (0.7835 => 0.8221, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4299 => 0.4507, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.78% (1.1642 => 1.2198, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (7.9617 => 8.3329, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 4.64% (0.3387 => 0.3544, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.61% (0.5925 => 0.6198, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.56% (0.5020 => 0.5249, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.56% (1.0722 => 1.1211, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 4.48% (0.6030 => 0.6300, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2387, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.38% (3.8723 => 4.0420, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 4.32% (21.9371 => 22.8853, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 4.25% (1.5603 => 1.6266, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.08% (0.4636 => 0.4825, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.00% (0.4103 => 0.4267, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 3.97% (0.8921 => 0.9275, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.95% (0.6450 => 0.6705, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.88% (2.0273 => 2.1060, std.dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference: 3.86% (0.7326 => 0.7609, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.84% (2.2969 => 2.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.84% (0.4064 => 0.4220, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3650 => 0.3785, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.68% (1.5859 => 1.6443, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.68% (0.5981 => 0.6201, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3865 => 0.4004, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.40% (0.3826 => 0.3956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.4186 => 1.4662, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (14.3668 => 14.8320, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 3.18% (0.4620 => 0.4767, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.07% (2.0665 => 2.1300, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (2.2024 => 2.2688, std.dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.1840 => 1.2196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.8101 => 0.8258, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.53% (1.2842 => 1.3039, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.01% (3.1595 => 3.4127, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3452, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std.dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7879, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3747, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.67% (5.2763 => 3.2358, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.12% (5.3855 => 3.8711, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.70% (5.3526 => 3.8701, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2010, std.dev.: 0.0247) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.76% (2.9384 => 2.5929, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: -8.67% (22.1758 => 20.2526, std.dev.: 0.0238) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (19.9488 => 18.2458, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5839, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4956, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4222, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0059, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: -2.42% (1.2373 => 1.2074, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6781, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5082, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (8.1563 => 8.0171, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2233, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.32% (14.9895 => 15.7868, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 3.29% (14.1553 => 14.6217, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/gs/gs: 4.41% (4.1105 => 4.2917, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.59% (1.1048 => 1.2218, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (7.1582 => 7.3845, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.95% (3.4629 => 3.6689, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.6222 => 0.6352, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 16:50:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 18:50:53 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120913235053.172C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3772?compare_to=3770&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3772, Order: 163850, Start Time: 2012-09-13 22:40:25, End Time: 2012-09-13 23:52:12 To: 3770, Order: 163837, Start Time: 2012-09-13 21:13:30, End Time: 2012-09-13 22:24:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 22 (52 on baseline) Performance Improvements: 1 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 878 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.80% (0.2989 => 0.3222, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.89% (0.2641 => 0.2823, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.86% (0.2085 => 0.2228, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 5.95% (0.2890 => 0.3062, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.22% (0.1936 => 0.2037, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.7518 => 0.7846, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (4.1875 => 4.2869, std.dev.: 0.0261) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (4.2466 => 4.3395, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (4.1870 => 4.2736, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.01% (0.7171 => 0.7315, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.00% (1.3959 => 1.4238, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.84% (0.5431 => 0.5531, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (6.2290 => 6.3407, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.74% (1.3901 => 1.4143, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8152 => 3.8772, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.13% (1.1860 => 1.1994, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.0696 => 3.1033, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 6.81% (0.1528 => 0.1632, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.28% (1.6583 => 1.6796, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 1.26% (1.3876 => 1.4051, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: 1.02% (8.7531 => 8.8423, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/hash: 1.02% (4.2955 => 4.3391, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.28% (4.6680 => 4.5149, std.dev.: 0.0386) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.43% (0.9789 => 1.0027, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.24% (0.5953 => 0.6027, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 0.31% (0.1621 => 0.1626, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.86% (0.1541 => 0.1585, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.52% (0.3056 => 0.3072, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.31% (0.2296 => 0.2372, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (0.3081 => 0.3191, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.30% (0.2258 => 0.2310, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 11.87% (0.0379 => 0.0424, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: 1.16% (0.0086 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 60.71% (0.0056 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -36.13% (0.0238 => 0.0152, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.17% (0.0189 => 0.0195, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.63% (0.0380 => 0.0390, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.36% (0.0294 => 0.0298, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.60% (0.0278 => 0.0288, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.92% (0.0316 => 0.0272, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -32.95% (0.0176 => 0.0118, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: 4.81% (0.0187 => 0.0196, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 1.64% (0.0244 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 6.91% (0.0304 => 0.0325, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -4.46% (1.4704 => 1.4048, std.dev.: 0.0420) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.49% (0.1474 => 0.1496, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.91% (0.4268 => 0.4229, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.1409 => 0.1497, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.95% (0.0613 => 0.0552, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0174 => 0.0203, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.50% (0.0600 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1464 => 1.1492, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0542 => 0.0542, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.00% (0.0175 => 0.0147, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7819 => 0.7807, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.24% (1.6028 => 1.6066, std.dev.: 0.0052) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 218.42% (0.0038 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.47% (4.1772 => 3.0713, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/except: 82000.00% (0.0006 => 0.4926, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 6.48% (0.5309 => 0.5653, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 5.38% (2.1763 => 2.2934, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.21% (0.6410 => 0.6744, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.17% (0.2552 => 0.2684, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.19% (0.3582 => 0.3732, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.94% (15.3105 => 15.9130, std.dev.: 0.1529) MultiSource/Applications/lemon/lemon: 3.74% (1.0046 => 1.0422, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/18-imp/imp: 3.26% (0.3217 => 0.3322, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 3.22% (0.6915 => 0.7138, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 3.09% (1.1653 => 1.2013, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.5150 => 1.5597, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.74% (29.3170 => 30.1206, std.dev.: 0.3101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.7639 => 0.7811, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 1.97% (2.0972 => 2.1385, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.49% (1.3935 => 1.4143, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.1827 => 1.1994, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.38% (6.2546 => 6.3407, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Bubblesort: 39.54% (0.0263 => 0.0367, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2291, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.68% (0.0917 => 0.1070, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.88% (0.0766 => 0.0880, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9994, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.97% (4.0101 => 4.5703, std.dev.: 0.0294) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 12.09% (0.3746 => 0.4199, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 8.78% (7.0025 => 7.6173, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.95% (0.2857 => 0.3084, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.89% (1.0063 => 1.0857, std.dev.: 0.0280) SingleSource/Benchmarks/McGill/chomp: 7.07% (1.0194 => 1.0915, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8082, std.dev.: 0.0597) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8219, std.dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 3.89% (8.5113 => 8.8423, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (4.2129 => 4.3617, std.dev.: 0.0433) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.42% (0.3508 => 0.3628, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.6308 => 0.6483, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.59% (2.6656 => 2.7347, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.1938 => 5.3028, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.09% (0.5876 => 0.5999, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.75% (14.4877 => 14.7410, std.dev.: 0.0323) MultiSource/Applications/siod/siod: 1.66% (3.5520 => 3.6108, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5340, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.46% (38.9255 => 39.4924, std.dev.: 0.1903) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.26% (4.0659 => 4.1170, std.dev.: 0.0196) SingleSource/Benchmarks/Dhrystone/dry: 1.04% (2.4013 => 2.4263, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.98% (0.3497 => 0.2099, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.99% (5.2665 => 4.1084, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/ary3: -19.58% (1.7473 => 1.4051, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.29% (1.1647 => 0.9400, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5341, std.dev.: 0.1066) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.07% (2.4457 => 2.2483, std.dev.: 0.0312) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.72% (3.2007 => 2.9535, std.dev.: 0.0440) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.08% (3.6254 => 3.3687, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -7.05% (3.4230 => 3.1817, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3519, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: -5.14% (1.4117 => 1.3391, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4078, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.61% (3.6023 => 3.4363, std.dev.: 0.0605) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.25% (1.7361 => 1.6796, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.18% (1.1683 => 1.1311, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -3.08% (7.6833 => 7.4464, std.dev.: 0.0541) SingleSource/Benchmarks/Shootout-C++/methcall: -3.08% (9.2503 => 8.9656, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.04% (3.9413 => 3.8214, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: -2.98% (0.4296 => 0.4168, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2860, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -2.67% (3.4286 => 3.3369, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.12% (2.3580 => 2.3079, std.dev.: 0.0190) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.86% (2.8964 => 2.8425, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2305, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.57% (92.7467 => 91.2949, std.dev.: 0.5408) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -1.50% (3.8200 => 3.7627, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3200, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.23% (1.8739 => 1.8508, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.47% (0.9980 => 1.0027, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 0.08% (0.6022 => 0.6027, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -2.40% (0.1666 => 0.1626, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.99% (0.1554 => 0.1585, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (0.3083 => 0.3072, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2394 => 0.2372, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.50% (0.3175 => 0.3191, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.35% (0.2302 => 0.2310, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -5.57% (0.0449 => 0.0424, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -36.67% (0.0240 => 0.0152, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.05% (0.0324 => 0.0272, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -33.33% (0.0177 => 0.0118, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -6.47% (1.5019 => 1.4048, std.dev.: 0.0420) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.82% (0.4264 => 0.4229, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.38% (0.1344 => 0.1497, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.28% (0.0589 => 0.0552, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.50% (0.0232 => 0.0203, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0639 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.25% (1.1350 => 1.1492, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.91% (0.0637 => 0.0542, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.24% (0.0246 => 0.0147, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.53% (0.7541 => 0.7807, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.58% (1.5363 => 1.6066, std.dev.: 0.0052) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 16:56:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 18:56:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120913235613.5C4952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3773?compare_to=3767&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3773, Order: 163849, Start Time: 2012-09-13 22:43:17, End Time: 2012-09-13 23:57:30 To: 3767, Order: 163820, Start Time: 2012-09-13 19:12:41, End Time: 2012-09-13 20:26:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.78% (2.0176 => 2.4166, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (3.9660 => 4.3315, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.67% (0.2596 => 0.2821, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.64% (0.7038 => 0.7646, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 8.43% (1.3693 => 1.4847, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.38% (0.9199 => 0.9970, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.2721 => 0.2949, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.31% (0.7710 => 0.8351, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (1.2193 => 1.3203, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.26% (0.5265 => 0.5700, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.18% (0.6959 => 0.7528, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 8.13% (0.7061 => 0.7635, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.5818 => 0.6288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4328 => 0.4677, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5748 => 0.6205, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.91% (0.1327 => 0.1432, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.89% (1.1364 => 1.2261, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.87% (13.8202 => 14.9080, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.75% (1.4563 => 1.5692, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5577 => 0.5996, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.6283 => 0.6749, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.26% (0.4062 => 0.4357, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.19% (1.0313 => 1.1055, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.05% (0.3246 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3899 => 0.4174, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.4791 => 0.5127, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.97% (0.1435 => 0.1535, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.89% (1.1061 => 1.1823, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.86% (0.2127 => 0.2273, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.81% (0.4379 => 0.4677, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.76% (7.2180 => 7.7057, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 6.74% (0.2995 => 0.3197, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.74% (0.5637 => 0.6017, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.2914 => 0.3110, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 6.68% (0.8310 => 0.8865, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.66% (0.3756 => 0.4006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3580 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (3.8646 => 4.1169, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4016 => 0.4278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.50% (1.9828 => 2.1117, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.49% (3.6692 => 3.9073, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.41% (0.7506 => 0.7987, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3220 => 0.3424, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.32% (0.2925 => 0.3110, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.32% (0.3293 => 0.3501, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.30% (0.6576 => 0.6990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2696 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.20% (0.3868 => 0.4108, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.18% (0.7460 => 0.7921, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 6.18% (0.3107 => 0.3299, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.13% (0.3149 => 0.3342, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.13% (0.4390 => 0.4659, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.08% (2.1791 => 2.3115, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 5.96% (0.6744 => 0.7146, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.96% (1.0594 => 1.1225, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.90% (3.1889 => 3.3772, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 5.87% (1.2749 => 1.3498, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 5.84% (1.9270 => 2.0396, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.83% (1.3245 => 1.4017, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.49% (16.6129 => 17.5248, std.dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 5.47% (14.8535 => 15.6662, std.dev.: 0.0186) MultiSource/Benchmarks/mafft/pairlocalalign: 5.40% (8.4961 => 8.9545, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 5.37% (0.3578 => 0.3770, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.4003 => 0.4217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (1.3819 => 1.4555, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.6135 => 0.6459, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 5.27% (0.3646 => 0.3838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.27% (0.8698 => 0.9156, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 5.26% (0.3914 => 0.4120, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.25% (0.3789 => 0.3988, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (13.2842 => 13.9808, std.dev.: 0.0187) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3813 => 1.4535, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.22% (0.3601 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.19% (0.3663 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (4.4433 => 4.6728, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.12% (0.3650 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (4.3801 => 4.6015, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.05% (0.3623 => 0.3806, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.97% (0.8818 => 0.9256, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.3755 => 0.3937, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1333 => 1.1881, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.73% (14.5298 => 15.2174, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.62% (0.3245 => 0.3395, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (6.5754 => 6.8791, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2321 => 0.2428, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.27% (4.6629 => 4.8621, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.23% (3.2742 => 3.4128, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2777, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (0.9108 => 0.9461, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.81% (0.4805 => 0.4988, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1743, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (1.5188 => 1.5752, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.49% (0.6250 => 0.6468, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 3.46% (3.7467 => 3.8764, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (6.2785 => 6.4800, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.10% (2.1007 => 2.1659, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.54% (33.2944 => 34.1404, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 1.38% (16.2614 => 16.4860, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.91% (1.8175 => 2.2702, std.dev.: 0.0428) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5455, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.26% (1.9199 => 1.9824, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0923, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5979, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.63% (3.7731 => 3.8345, std.dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5963, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.41% (0.4657 => 0.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.07% (22.5627 => 21.6450, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2912, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.32% (1.3780 => 1.2909, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5714, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -2.20% (26.5159 => 25.9318, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2439, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2401, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.21% (4.1080 => 4.0583, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2561, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2320, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 17:31:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 19:31:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914003139.9F5AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3774?compare_to=3771&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3774, Order: 163850, Start Time: 2012-09-13 23:13:38, End Time: 2012-09-14 00:32:58 To: 3771, Order: 163837, Start Time: 2012-09-13 21:25:36, End Time: 2012-09-13 22:45:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (116 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (731 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.29% (54.3313 => 56.6594, std.dev.: 0.0352) MultiSource/Benchmarks/llubenchmark/llu: 1.59% (3.7699 => 3.8298, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -5.36% (15.1780 => 14.3646, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.33% (0.5676 => 0.5657, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -0.30% (15.7868 => 15.7390, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: -0.51% (14.6217 => 14.5472, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: -1.26% (82.8620 => 81.8187, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/gs/gs: -0.23% (4.2917 => 4.2819, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.56% (1.2218 => 1.2150, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.38% (7.3845 => 7.3567, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.83% (3.6689 => 3.6383, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.55% (0.6352 => 0.6317, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1427 => 0.1427, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.37% (63.2438 => 81.8187, std.dev.: 0.0229) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14242.78% (0.0720 => 10.3268, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.56% (10.3673 => 14.3646, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 26.70% (0.1622 => 0.2055, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.24% (2.2022 => 2.4937, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.86% (7.0540 => 7.9613, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.43% (0.1566 => 0.1745, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.64% (1.7609 => 1.9483, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.64% (10.4361 => 11.3381, std.dev.: 0.0112) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.52% (0.1584 => 0.1719, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3473 => 0.3767, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.26% (0.3282 => 0.3553, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.24% (0.3543 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.21% (0.3543 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.13% (0.3516 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.12% (0.3561 => 0.3850, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.99% (0.3694 => 0.3989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.86% (0.3828 => 0.4129, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.3927 => 0.4231, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.57% (0.3886 => 0.4180, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.27% (0.3177 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 6.65% (0.1655 => 0.1765, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (9.4845 => 10.1137, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.8172 => 0.8676, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 5.95% (0.3109 => 0.3294, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.85% (0.7433 => 0.7868, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.72% (0.4615 => 0.4879, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.67% (0.2700 => 0.2853, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.62% (0.7115 => 0.7515, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.3050 => 1.3768, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.46% (8.1363 => 8.5806, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.6675 => 0.7039, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5860 => 0.6178, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 5.40% (0.3423 => 0.3608, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.38% (0.3307 => 0.3485, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.32% (0.2554 => 0.2690, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.24% (5.7591 => 6.0607, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.5105 => 0.5372, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (4.2646 => 4.4876, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14% (1.5415 => 1.6207, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.13% (3.3354 => 3.5065, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5569 => 0.5854, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.03% (0.3121 => 0.3278, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.99% (5.0018 => 5.2513, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2758 => 0.2894, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.89% (4.9449 => 5.1865, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.80% (0.9765 => 1.0234, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.80% (0.7835 => 0.8211, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.79% (1.1642 => 1.2200, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 4.69% (0.3092 => 0.3237, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.69% (0.8067 => 0.8445, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.66% (0.6030 => 0.6311, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.61% (0.5925 => 0.6198, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.42% (0.4299 => 0.4489, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.38% (0.2603 => 0.2717, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.31% (0.3387 => 0.3533, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.3180 => 0.3317, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.27% (1.0722 => 1.1180, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.24% (0.5020 => 0.5233, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1861 => 1.2362, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.19% (7.9617 => 8.2955, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.18% (0.3441 => 0.3585, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.14% (3.8723 => 4.0325, std.dev.: 0.0099) MultiSource/Applications/hbd/hbd: 4.08% (1.5603 => 1.6239, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 3.79% (0.7326 => 0.7604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.78% (0.8921 => 0.9258, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.78% (21.9371 => 22.7654, std.dev.: 0.0120) MultiSource/Applications/treecc/treecc: 3.75% (2.0273 => 2.1034, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6456 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 3.64% (2.2969 => 2.3806, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.64% (0.6450 => 0.6685, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.59% (0.5981 => 0.6196, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.4636 => 0.4795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.4064 => 0.4203, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.4103 => 0.4236, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6366, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.15% (1.4186 => 1.4633, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.07% (0.3650 => 0.3762, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8010, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash: 2.96% (0.4289 => 0.4416, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.92% (0.3865 => 0.3978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.88% (0.4203 => 0.4324, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.2024 => 2.2599, std.dev.: 0.0179) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.1840 => 1.2146, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.58% (0.4620 => 0.4739, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.50% (0.4048 => 0.4149, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (2.0665 => 2.1131, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.8101 => 0.8231, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.09% (1.2842 => 1.2982, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3804, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3504, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 1.37% (3.7781 => 3.8298, std.dev.: 0.0142) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2258, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5812, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 1.11% (26.0924 => 26.3821, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.47% (5.2763 => 3.2467, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.39% (5.3855 => 3.8567, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.98% (5.3526 => 3.8547, std.dev.: 0.0116) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1746, std.dev.: 0.0239) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.84% (2.9384 => 2.5905, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.82% (22.1758 => 20.2196, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (19.9488 => 18.2387, std.dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.16% (1.5835 => 1.5018, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4988, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: -3.00% (1.2373 => 1.2002, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4241, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0087, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9863, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5779, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2189, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.19% (0.5229 => 0.5657, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.00% (14.9895 => 15.7390, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 2.77% (14.1553 => 14.5472, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 4.17% (4.1105 => 4.2819, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.97% (1.1048 => 1.2150, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.77% (7.1582 => 7.3567, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.07% (3.4629 => 3.6383, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.6222 => 0.6317, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 17:45:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 19:45:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914004544.655572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3775?compare_to=3765&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3775, Order: 163841, Start Time: 2012-09-13 22:02:53, End Time: 2012-09-14 00:46:42 To: 3765, Order: 163802, Start Time: 2012-09-13 15:34:05, End Time: 2012-09-13 18:17:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (112 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (781 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.09% (1.5924 => 1.6098, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.39% (1.7141 => 1.6902, std.dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.52% (0.3488 => 0.3820, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3442 => 0.3769, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 9.44% (0.3465 => 0.3792, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.40% (0.3446 => 0.3770, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.37% (0.3469 => 0.3794, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3460 => 0.3780, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3643 => 0.3977, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.99% (0.3650 => 0.3978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.3724 => 0.4058, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.09% (1.5932 => 1.6902, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 5.84% (0.5826 => 0.6166, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.5889 => 0.6223, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.58% (3.5627 => 3.7614, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (1.3152 => 1.3877, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.20% (2.7292 => 2.8711, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 5.04% (5.5417 => 5.8208, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.2736 => 0.2863, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.63% (1.0781 => 1.1280, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.63% (0.4994 => 0.5225, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (0.5026 => 0.5257, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (0.3930 => 0.4110, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.41% (0.7171 => 0.7487, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.26% (4.2109 => 4.3903, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (0.5000 => 0.5213, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.22% (0.4029 => 0.4199, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3195 => 0.3329, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (4.4195 => 4.5981, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (2.1013 => 2.1862, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.01% (0.2566 => 0.2669, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.99% (2.0673 => 2.1497, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 3.99% (1.8794 => 1.9543, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.2823 => 0.2934, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.92% (0.2911 => 0.3025, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.91% (4.6177 => 4.7982, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2792 => 0.2901, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.89% (0.6634 => 0.6892, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3124 => 0.3245, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.87% (0.9909 => 1.0292, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.86% (0.5900 => 0.6128, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.86% (0.3890 => 0.4040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.84% (0.3096 => 0.3215, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.84% (0.2811 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.84% (0.4139 => 0.4298, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.3903 => 0.4052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2803 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2813 => 0.2920, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (2.1653 => 2.2450, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 3.67% (0.3267 => 0.3387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3258 => 0.3377, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.64% (1.4269 => 1.4789, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 3.64% (0.5546 => 0.5748, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.63% (0.3362 => 0.3484, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3348 => 0.3469, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.57% (0.3477 => 0.3601, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.56% (0.3625 => 0.3754, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.51% (0.3678 => 0.3807, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.3271 => 0.3385, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (0.4658 => 0.4816, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.39% (0.4251 => 0.4395, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4146 => 0.4284, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (1.9694 => 2.0347, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 3.21% (23.5202 => 24.2750, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3690 => 0.3808, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.18% (0.3336 => 0.3442, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.3981 => 0.4104, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.99% (1.9966 => 2.0562, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.98% (0.9697 => 0.9986, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.83% (0.3845 => 0.3954, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.6435 => 0.6614, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.77% (0.7875 => 0.8093, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.30% (2.0346 => 2.0814, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (4.6926 => 4.7479, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6721, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8976, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6389, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2002, std.dev.: 0.0586) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5038, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4534, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5904, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5269, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/ary2: -9.08% (0.2402 => 0.2184, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7911, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7989, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8539, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5701, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.73% (0.6293 => 0.6184, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9748, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 18:18:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 20:18:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914011821.AED192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3776?compare_to=3772&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3776, Order: 163858, Start Time: 2012-09-14 00:08:22, End Time: 2012-09-14 01:19:41 To: 3772, Order: 163850, Start Time: 2012-09-13 22:40:25, End Time: 2012-09-13 23:52:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (45 on baseline) Performance Improvements: 4 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.08% (1.1387 => 1.1510, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.50% (3.4363 => 3.7627, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/mandel-2: 3.43% (3.0713 => 3.1765, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (2.3991 => 2.4411, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.83% (1.4143 => 1.3884, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.66% (4.2869 => 4.2157, std.dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -7.37% (0.9008 => 0.8344, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.02% (3.7135 => 3.6385, std.dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.12% (1.0027 => 0.9915, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: -0.91% (0.6027 => 0.5972, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: 2.71% (0.1626 => 0.1670, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.21% (0.1585 => 0.1550, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (0.3072 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.67% (0.2372 => 0.2356, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.76% (0.3191 => 0.3103, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.34% (0.2310 => 0.2279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 6.37% (0.0424 => 0.0451, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 55.26% (0.0152 => 0.0236, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.05% (0.0195 => 0.0191, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0298 => 0.0298, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.43% (0.0288 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 19.12% (0.0272 => 0.0324) SingleSource/UnitTests/Vector/Altivec/casts: 50.85% (0.0118 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.57% (0.0196 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -7.26% (0.0248 => 0.0230, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -8.62% (0.0325 => 0.0297, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1429 => 0.1435, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 5.00% (1.4048 => 1.4751, std.dev.: 0.0293) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.87% (0.1496 => 0.1453, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.01% (0.4229 => 0.4017, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1497 => 0.1438, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.23% (0.0552 => 0.0614, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.32% (0.0203 => 0.0228, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1492 => 1.1448, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.21% (0.0542 => 0.0554, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.13% (0.0147 => 0.0181, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7807 => 0.7806, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: - (1.6066 => 1.6066, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -23.96% (4.1772 => 3.1765, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/except: 82300.00% (0.0006 => 0.4944, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.5309 => 0.5624, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 5.20% (2.1763 => 2.2895, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.34% (0.6410 => 0.6688, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.24% (0.3582 => 0.3734, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.79% (0.6173 => 0.6407, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3217 => 0.3336, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.22% (15.3105 => 15.8034, std.dev.: 0.0683) MultiSource/Applications/lemon/lemon: 3.22% (1.0046 => 1.0369, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 3.12% (0.6915 => 0.7131, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.1653 => 1.1951, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.5150 => 1.5508, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 2.27% (29.3170 => 29.9837, std.dev.: 0.2349) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7722 => 0.7892, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: 1.33% (3.0225 => 3.0626, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 1.26% (2.0972 => 2.1236, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.23% (1.1672 => 1.1816, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std.dev.: 0.0155) MultiSource/Applications/sgefa/sgefa: 13.69% (0.3746 => 0.4259, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.24% (4.0101 => 4.5412, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6239, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.91% (0.2694 => 0.2907, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.67% (0.2857 => 0.3076, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.14% (1.0063 => 1.0781, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.98% (27.1724 => 28.7980, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.45% (3.6023 => 3.7627, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8315, std.dev.: 0.0562) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 3.82% (8.5113 => 8.8368, std.dev.: 0.0380) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 2.61% (5.1938 => 5.3295, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.32% (2.6656 => 2.7275, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 1.57% (14.4877 => 14.7146, std.dev.: 0.0238) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (2.4042 => 2.4411, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 1.51% (3.5520 => 3.6058, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/whetstone: 1.51% (2.3453 => 2.3808, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5317, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.60% (0.7738 => 0.7537, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.38% (0.3497 => 0.2120, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.06% (5.2665 => 4.1572, std.dev.: 0.2091) SingleSource/Benchmarks/Shootout-C++/ary3: -20.17% (1.7473 => 1.3948, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.47% (1.1647 => 0.9379, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.47% (62.4126 => 56.5025, std.dev.: 0.2090) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9427, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3664, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3506, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: -6.07% (3.4230 => 3.2151, std.dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.03% (4.6355 => 4.4022, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -3.57% (9.2503 => 8.9205, std.dev.: 0.0528) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.38% (1.8739 => 1.8105, std.dev.: 0.0246) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1333, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -2.98% (7.6833 => 7.4544, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6385, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.76% (1.7361 => 1.6881, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -2.76% (3.4286 => 3.3340, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std.dev.: 0.0281) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.38% (1.2959 => 1.2650, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2268, std.dev.: 0.0137) MultiSource/Benchmarks/sim/sim: -1.63% (3.8907 => 3.8274, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7669, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/lists: -1.08% (16.5617 => 16.3829, std.dev.: 0.0398) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.65% (0.9980 => 0.9915, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: -0.83% (0.6022 => 0.5972, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: 0.24% (0.1666 => 0.1670, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.26% (0.1554 => 0.1550, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.52% (0.3083 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.59% (0.2394 => 0.2356, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.27% (0.3175 => 0.3103, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.00% (0.2302 => 0.2279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.67% (0.0240 => 0.0236, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -7.63% (0.0249 => 0.0230, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -8.62% (0.0325 => 0.0297, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1429 => 0.1435, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -1.78% (1.5019 => 1.4751, std.dev.: 0.0293) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.20% (0.1501 => 0.1453, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.79% (0.4264 => 0.4017, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.24% (0.0589 => 0.0614, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.72% (0.0232 => 0.0228, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.86% (1.1350 => 1.1448, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.03% (0.0637 => 0.0554, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.42% (0.0246 => 0.0181, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.51% (0.7541 => 0.7806, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.58% (1.5363 => 1.6066, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 18:38:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 20:38:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914013837.1C9AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3777?compare_to=3773&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3777, Order: 163858, Start Time: 2012-09-14 00:25:49, End Time: 2012-09-14 01:39:55 To: 3773, Order: 163849, Start Time: 2012-09-13 22:43:17, End Time: 2012-09-13 23:57:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.79% (2.0176 => 2.4169, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.82% (0.1410 => 0.1619, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.26% (0.1588 => 0.1735, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.18% (3.9660 => 4.3302, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.63% (0.2596 => 0.2820, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 8.58% (0.7038 => 0.7642, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.44% (0.9199 => 0.9975, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.41% (0.5265 => 0.5708, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.40% (1.3693 => 1.4843, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.35% (1.2193 => 1.3211, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.30% (0.7710 => 0.8350, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.13% (0.6959 => 0.7525, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 8.02% (0.4328 => 0.4675, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.01% (1.1364 => 1.2274, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.91% (0.1327 => 0.1432, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.87% (13.8202 => 14.9084, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.82% (1.4563 => 1.5702, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.77% (0.5818 => 0.6270, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7061 => 0.7605, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.60% (0.5748 => 0.6185, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1589 => 0.1708, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.35% (0.5577 => 0.5987, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.34% (0.6283 => 0.6744, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.31% (1.0313 => 1.1067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.18% (0.3246 => 0.3479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4062 => 0.4351, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.10% (0.3899 => 0.4176, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.08% (0.4791 => 0.5130, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.01% (0.2781 => 0.2976, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.99% (0.4379 => 0.4685, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2127 => 0.2275, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.94% (0.2995 => 0.3203, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3485 => 0.3726, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.83% (0.5637 => 0.6022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.75% (0.8310 => 0.8871, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.72% (1.1061 => 1.1804, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (7.2180 => 7.7008, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.2914 => 0.3108, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.50% (0.3756 => 0.4000, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.49% (0.7506 => 0.7993, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3580 => 0.3812, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.46% (3.8646 => 4.1143, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3220 => 0.3428, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.44% (3.6692 => 3.9054, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.40% (0.4016 => 0.4273, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.39% (0.2925 => 0.3112, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2607 => 0.2773, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.2243 => 0.2385, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.29% (0.3293 => 0.3500, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.27% (0.7460 => 0.7928, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.27% (1.9828 => 2.1071, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.2937 => 0.3121, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.18% (0.2023 => 0.2148, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.16% (0.2988 => 0.3172, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 6.14% (2.1791 => 2.3129, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3534 => 0.3747, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3107 => 0.3294, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.01% (0.1865 => 0.1977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.00% (0.3868 => 0.4100, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.00% (3.1889 => 3.3801, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.97% (1.3245 => 1.4036, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3149 => 0.3336, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.87% (1.9270 => 2.0402, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 5.83% (1.0594 => 1.1212, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.83% (0.6744 => 0.7137, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.73% (1.2749 => 1.3479, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.61% (0.3192 => 0.3371, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.56% (16.6129 => 17.5366, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.50% (0.6576 => 0.6938, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 5.49% (14.8535 => 15.6693, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 5.44% (8.4961 => 8.9583, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4113 => 0.4334, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.32% (0.8698 => 0.9161, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.25% (0.6135 => 0.6457, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.18% (1.3819 => 1.4535, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (13.2842 => 13.9685, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (1.3813 => 1.4523, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.13% (4.3801 => 4.6050, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (4.4433 => 4.6665, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.91% (0.8818 => 0.9251, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.88% (1.1333 => 1.1886, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 4.87% (0.4003 => 0.4198, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 4.85% (0.3914 => 0.4104, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.84% (0.3578 => 0.3751, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.80% (14.5298 => 15.2270, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 4.79% (6.5754 => 6.8901, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.75% (0.3789 => 0.3969, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.64% (0.3646 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.61% (0.3623 => 0.3790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.59% (0.3940 => 0.4121, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.55% (0.3601 => 0.3765, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.50% (0.3663 => 0.3828, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.48% (4.6629 => 4.8719, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.48% (0.2321 => 0.2425, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.47% (0.3650 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.43% (3.2742 => 3.4191, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.41% (0.3245 => 0.3388, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.96% (0.9108 => 0.9469, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.87% (1.2292 => 1.2768, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (1.5188 => 1.5774, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.84% (4.9865 => 5.1779, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.83% (0.4805 => 0.4989, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 3.59% (3.7467 => 3.8812, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 3.55% (0.6250 => 0.6472, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1733, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.15% (6.2785 => 6.4762, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.38% (33.2944 => 34.0883, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.53% (16.2614 => 16.5108, std.dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.72% (1.2998 => 1.3741, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0006, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.12% (10.7476 => 11.0834, std.dev.: 0.0409) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6094, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5157, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6854, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.89% (0.4657 => 0.3824, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.08% (22.5627 => 21.6415, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2774, std.dev.: 0.0325) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.56% (1.3780 => 1.3014, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.47% (3.0263 => 2.9214, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.23% (26.5159 => 25.9240, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2399, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2335, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0597, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2300, std.dev.: 0.0150) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4340, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 19:19:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 21:19:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914021930.CAC4F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3778?compare_to=3774&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3778, Order: 163860, Start Time: 2012-09-14 01:01:22, End Time: 2012-09-14 02:20:49 To: 3774, Order: 163850, Start Time: 2012-09-13 23:13:38, End Time: 2012-09-14 00:32:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (117 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (730 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.26% (14.3646 => 14.8323, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (78.7853 => 80.3935, std.dev.: 0.5139) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5657 => 0.5656, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.04% (15.7390 => 15.7455, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 0.22% (14.5472 => 14.5790, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.06% (81.8187 => 82.6837, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: -0.07% (4.2819 => 4.2791, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.12% (1.2150 => 1.2136, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (7.3567 => 7.3666, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.48% (3.6383 => 3.6559, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.13% (0.6317 => 0.6325, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1427 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0649 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.74% (63.2438 => 82.6837, std.dev.: 0.0123) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14246.94% (0.0720 => 10.3298, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.07% (10.3673 => 14.8323, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 27.13% (0.1622 => 0.2062, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.09% (2.2022 => 2.5124, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.45% (7.0540 => 8.0027, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.19% (1.1194 => 1.2558, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.17% (0.1566 => 0.1741, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.07% (1.7609 => 1.9383, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 9.13% (10.4361 => 11.3888, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 8.53% (0.3282 => 0.3562, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.46% (0.1584 => 0.1718, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.40% (0.3473 => 0.3730, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.28% (0.3543 => 0.3801, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.15% (0.3497 => 0.3747, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.11% (0.3543 => 0.3795, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.05% (0.3516 => 0.3764, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.05% (0.3561 => 0.3812, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.85% (0.3694 => 0.3947, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.83% (0.4879 => 0.5212, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3828 => 0.4089, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.80% (0.3927 => 0.4194, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.59% (0.3886 => 0.4142, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 6.59% (0.1655 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.56% (9.4845 => 10.1065, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.04% (0.2700 => 0.2863, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.69% (0.3109 => 0.3286, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.65% (0.7115 => 0.7517, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.64% (0.7433 => 0.7852, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.58% (5.7591 => 6.0804, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.56% (0.6675 => 0.7046, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2271 => 0.2392, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.29% (0.5105 => 0.5375, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.27% (8.1363 => 8.5649, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.3423 => 0.3603, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (1.3050 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.25% (0.2554 => 0.2688, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5860 => 0.6167, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: 5.22% (3.3354 => 3.5095, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.5415 => 1.6214, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.10% (4.2646 => 4.4821, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.8172 => 0.8580, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.94% (0.5569 => 0.5844, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.87% (4.9449 => 5.1856, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.84% (0.2107 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.81% (0.8067 => 0.8455, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.0018 => 5.2400, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 4.75% (0.3092 => 0.3239, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.3121 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.71% (0.2758 => 0.2888, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.57% (0.7835 => 0.8193, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.51% (0.9765 => 1.0205, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.46% (0.3387 => 0.3538, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9371 => 22.9127, std.dev.: 0.0117) MultiSource/Applications/Burg/burg: 4.34% (1.1642 => 1.2147, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.30% (0.2603 => 0.2715, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.30% (0.6030 => 0.6289, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.27% (0.5925 => 0.6178, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.18% (1.0722 => 1.1170, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.16% (0.3441 => 0.3584, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (7.9617 => 8.2907, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.13% (1.1861 => 1.2351, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.11% (3.8723 => 4.0314, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.5020 => 0.5226, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 4.09% (0.4299 => 0.4475, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.3180 => 0.3308, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.94% (1.5603 => 1.6218, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6456 => 0.6707, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 3.60% (2.2969 => 2.3795, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 3.56% (0.8921 => 0.9239, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.54% (2.0273 => 2.0991, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.50% (0.6450 => 0.6676, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4636 => 0.4798, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.48% (0.7326 => 0.7581, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5981 => 0.6184, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.4064 => 0.4201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.30% (0.3422 => 0.3535, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.29% (0.4103 => 0.4238, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.26% (1.5859 => 1.6376, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4203 => 0.4337, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.18% (0.3865 => 0.3988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.4186 => 1.4588, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.2024 => 2.2648, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7691, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4620 => 0.4747, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.72% (0.3826 => 0.3930, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.69% (0.3935 => 0.4041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.1840 => 1.2139, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1163, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (0.8101 => 0.8224, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.13% (1.2842 => 1.2987, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (4.2280 => 4.3505, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2365, std.dev.: 0.0299) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7894, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3740, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.93% (5.2763 => 3.2225, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.80% (5.3855 => 3.8881, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.49% (5.3526 => 3.8814, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1113, std.dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.98% (2.9384 => 2.5863, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.80% (22.1758 => 20.2233, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.49% (1.5373 => 1.3760, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2538, std.dev.: 0.0825) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5072, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4151, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9823, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -2.42% (1.2373 => 1.2074, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0011, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4227, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5760, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.17% (0.5229 => 0.5656, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.04% (14.9895 => 15.7455, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 2.99% (14.1553 => 14.5790, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (4.1105 => 4.2791, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.85% (1.1048 => 1.2136, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (7.1582 => 7.3666, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.57% (3.4629 => 3.6559, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.6222 => 0.6325, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 19:44:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 21:44:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914024408.77C912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3779?compare_to=3776&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3779, Order: 163863, Start Time: 2012-09-14 01:35:10, End Time: 2012-09-14 02:45:27 To: 3776, Order: 163858, Start Time: 2012-09-14 00:08:22, End Time: 2012-09-14 01:19:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (47 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.55% (0.4389 => 0.4545, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 2.86% (1.3167 => 1.3543, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (2.4304 => 2.5852, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.40% (43.3338 => 44.3726, std.dev.: 0.3697) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.73% (1.8105 => 1.8419, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (1.0781 => 1.0917, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.08% (1.2914 => 1.2775, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.23% (0.9915 => 0.9892, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 0.49% (0.5972 => 0.6001, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1670 => 0.1651, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1550 => 0.1551, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.88% (0.3067 => 0.3040, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.76% (0.2356 => 0.2374, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (0.3103 => 0.3183, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.18% (0.2279 => 0.2283, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0451 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 2.25% (0.0089 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.27% (0.0236 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0191 => 0.0191, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0386 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.71% (0.0298 => 0.0278, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0178 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -17.99% (0.0189 => 0.0155, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 8.70% (0.0230 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 9.76% (0.0297 => 0.0326, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1435 => 0.1441, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 3.00% (1.4751 => 1.5193, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.54% (0.1453 => 0.1548, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.30% (0.4017 => 0.4270, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.70% (0.1438 => 0.1356, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0614 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.02% (0.0228 => 0.0244, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1448 => 1.1474, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.35% (0.0554 => 0.0567, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.44% (0.0181 => 0.0256, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7806 => 0.7807, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: - (1.6066 => 1.6066, std.dev.: 0.0097) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.17% (0.0120 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.43% (4.1772 => 3.1150, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0015) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.14% (0.1414 => 0.1515, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 6.99% (0.5309 => 0.5680, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 5.99% (2.1763 => 2.3067, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.57% (0.6410 => 0.6703, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.6915 => 0.7203, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.82% (0.6173 => 0.6409, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 3.54% (15.3105 => 15.8520, std.dev.: 0.1287) MultiSource/Applications/lemon/lemon: 3.51% (1.0046 => 1.0399, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.46% (0.3582 => 0.3706, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 3.42% (1.1653 => 1.2051, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.55% (29.3170 => 30.0651, std.dev.: 0.2429) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5150 => 1.5505, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.7639 => 0.7815, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.07% (1.3268 => 1.3543, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 1.63% (1.1440 => 1.1627, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.32% (1.1672 => 1.1826, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.83% (0.0263 => 0.0373, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.04% (3.4629 => 4.2262, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.41% (0.0766 => 0.0930, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.88% (0.0917 => 0.1081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std.dev.: 0.0256) MultiSource/Applications/sgefa/sgefa: 13.75% (0.3746 => 0.4261, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5542, std.dev.: 0.0242) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.65% (0.2694 => 0.2981, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 8.63% (1.0194 => 1.1074, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.49% (1.0063 => 1.0917, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.36% (7.0025 => 7.5882, std.dev.: 0.0874) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7998, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8434, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (40.4792 => 42.0496, std.dev.: 0.4411) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.82% (0.7609 => 0.7900, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.25% (0.5876 => 0.6067, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 2.45% (8.5113 => 8.7197, std.dev.: 0.0630) MultiSource/Benchmarks/BitBench/five11/five11: 2.24% (5.1938 => 5.3104, std.dev.: 0.0160) MultiSource/Applications/hexxagon/hexxagon: 1.69% (14.4877 => 14.7329, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4833, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.52% (2.8599 => 2.9034, std.dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (2.4971 => 2.5350, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.30% (1.6110 => 1.6319, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.69% (0.3497 => 0.2039, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.77% (5.2665 => 4.1198, std.dev.: 0.0985) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.28% (1.1647 => 0.9401, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: -17.86% (1.7473 => 1.4353, std.dev.: 0.0607) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1570, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/moments: -10.95% (0.1114 => 0.0992, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.39% (62.4126 => 56.5495, std.dev.: 0.1631) SingleSource/Benchmarks/BenchmarkGame/recursive: -9.18% (2.4457 => 2.2212, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.24% (3.2007 => 2.9370, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.24% (3.6254 => 3.3629, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -6.56% (3.4230 => 3.1986, std.dev.: 0.0572) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3507, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4078, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.40% (1.7361 => 1.6597, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/ffbench: -3.64% (1.4117 => 1.3603, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.34% (61.1734 => 59.1312, std.dev.: 0.5073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.19% (1.1683 => 1.1310, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -3.11% (7.6833 => 7.4441, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.09% (0.4140 => 0.4012, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -3.06% (9.2503 => 8.9674, std.dev.: 0.0555) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.99% (1.2722 => 1.2341, std.dev.: 0.0100) MultiSource/Applications/aha/aha: -2.85% (3.4286 => 3.3308, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8296, std.dev.: 0.0301) MultiSource/Applications/SPASS/SPASS: -2.83% (8.5323 => 8.2910, std.dev.: 0.0644) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/misr: -2.72% (0.4296 => 0.4179, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.41% (45.4683 => 44.3726, std.dev.: 0.3697) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.20% (3.7496 => 3.6671, std.dev.: 0.0257) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (9.3855 => 9.1908, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4224, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.81% (1.0686 => 1.0493, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.71% (1.8739 => 1.8419, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: -1.60% (3.8907 => 3.8284, std.dev.: 0.0173) MultiSource/Benchmarks/PAQ8p/paq8p: -1.56% (92.7467 => 91.3036, std.dev.: 0.3633) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0767, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0755) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7667, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.88% (0.9980 => 0.9892, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: -0.35% (0.6022 => 0.6001, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -0.90% (0.1666 => 0.1651, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1554 => 0.1551, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.39% (0.3083 => 0.3040, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.84% (0.2394 => 0.2374, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.25% (0.3175 => 0.3183, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.83% (0.2302 => 0.2283, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.64% (0.0301 => 0.0278, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -17.99% (0.0189 => 0.0155, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1429 => 0.1441, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.16% (1.5019 => 1.5193, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.13% (0.1501 => 0.1548, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.14% (0.4264 => 0.4270, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.89% (0.1344 => 0.1356, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.0589 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.17% (0.0232 => 0.0244, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.09% (1.1350 => 1.1474, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.99% (0.0637 => 0.0567, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (0.0246 => 0.0256, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.53% (0.7541 => 0.7807, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.58% (1.5363 => 1.6066, std.dev.: 0.0097) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.00% (0.0070 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 20:21:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 22:21:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914032113.CC9982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3780?compare_to=3777&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3780, Order: 163865, Start Time: 2012-09-14 02:08:06, End Time: 2012-09-14 03:22:24 To: 3777, Order: 163858, Start Time: 2012-09-14 00:25:49, End Time: 2012-09-14 01:39:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (161 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.13% (54.6663 => 56.3794, std.dev.: 0.0988) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.38% (78.9251 => 80.8022, std.dev.: 0.3168) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.77% (2.0176 => 2.4164, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.82% (0.1410 => 0.1619, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.26% (0.1588 => 0.1735, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.18% (3.9660 => 4.3301, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.71% (0.2596 => 0.2822, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 8.68% (0.7038 => 0.7649, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.53% (0.7710 => 0.8368, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 8.49% (1.3693 => 1.4856, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.45% (0.6959 => 0.7547, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.39% (0.9199 => 0.9971, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.2721 => 0.2948, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.34% (0.5265 => 0.5704, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.33% (1.2193 => 1.3209, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4328 => 0.4676, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.99% (0.1327 => 0.1433, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.93% (1.1364 => 1.2265, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.92% (13.8202 => 14.9144, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.80% (1.4563 => 1.5699, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.5818 => 0.6271, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.68% (0.7061 => 0.7603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.64% (0.5748 => 0.6187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.42% (0.5577 => 0.5991, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.37% (0.6283 => 0.6746, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.24% (0.3246 => 0.3481, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.22% (1.0313 => 1.1058, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4062 => 0.4351, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.03% (0.3899 => 0.4173, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.01% (0.2995 => 0.3205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.88% (0.3022 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.86% (0.2127 => 0.2273, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.83% (0.5637 => 0.6022, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.83% (0.4379 => 0.4678, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.72% (1.1061 => 1.1804, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.71% (3.8646 => 4.1240, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.67% (7.2180 => 7.6998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.65% (0.8310 => 0.8863, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.63% (0.3756 => 0.4005, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.59% (0.2914 => 0.3106, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.54% (0.3580 => 0.3814, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.53% (0.3489 => 0.3717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4016 => 0.4276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.47% (0.2937 => 0.3127, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2243 => 0.2388, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.43% (3.6692 => 3.9053, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3220 => 0.3426, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.39% (0.7506 => 0.7986, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.37% (0.7460 => 0.7935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.32% (1.9828 => 2.1082, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.28% (0.2023 => 0.2150, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.2925 => 0.3108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.19% (2.1791 => 2.3140, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.08% (3.1889 => 3.3829, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.3868 => 0.4102, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 6.01% (0.6744 => 0.7149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.3534 => 0.3745, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (1.3245 => 1.4030, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.84% (1.9270 => 2.0395, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1209, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.2749 => 1.3477, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.63% (16.6129 => 17.5489, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.6576 => 0.6944, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.51% (14.8535 => 15.6719, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 5.40% (8.4961 => 8.9551, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4113 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.28% (0.2859 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.28% (0.8698 => 0.9157, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.20% (0.6135 => 0.6454, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (1.3819 => 1.4534, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4524, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.14% (13.2842 => 13.9670, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (4.3801 => 4.6027, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (4.4433 => 4.6674, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3755 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.89% (0.8818 => 0.9249, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.85% (0.3914 => 0.4104, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.85% (1.1333 => 1.1883, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.80% (14.5298 => 15.2268, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/parameter-passing: 4.80% (0.4003 => 0.4195, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.75% (0.3578 => 0.3748, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 4.72% (0.3789 => 0.3968, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (6.5754 => 6.8815, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 4.62% (0.3940 => 0.4122, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.61% (0.3623 => 0.3790, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.58% (0.3646 => 0.3813, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2321 => 0.2427, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.54% (4.6629 => 4.8747, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/synchronized: 4.53% (0.3663 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.53% (0.3601 => 0.3764, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.49% (0.3650 => 0.3814, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.44% (0.3245 => 0.3389, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.36% (3.2742 => 3.4169, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.94% (0.9108 => 0.9467, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2292 => 1.2774, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.87% (4.9865 => 5.1793, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.85% (0.4805 => 0.4990, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.74% (1.5188 => 1.5756, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 3.57% (3.7467 => 3.8804, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.42% (0.6250 => 0.6464, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.1007 => 2.1700, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.08% (6.2785 => 6.4718, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 2.42% (33.2944 => 34.1000, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5152, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5204, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2734, std.dev.: 0.0460) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5460, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0952, std.dev.: 0.0542) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6058, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5163, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5835, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.82% (0.4657 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.04% (22.5627 => 21.6509, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2532, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std.dev.: 0.0090) SingleSource/UnitTests/Vector/multiplies: -5.24% (2.6470 => 2.5084, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8978, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2343, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2322, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8694, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (4.1080 => 4.0633, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5632, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4355, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 4.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 20:57:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 22:57:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914035741.9B6692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3781?compare_to=3775&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3781, Order: 163860, Start Time: 2012-09-14 01:15:21, End Time: 2012-09-14 03:59:00 To: 3775, Order: 163841, Start Time: 2012-09-13 22:02:53, End Time: 2012-09-14 00:46:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (0.7527 => 0.7636, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.32% (24.2750 => 24.5966, std.dev.: 0.0207) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (11.7483 => 11.8793, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3488 => 0.3811, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3460 => 0.3779, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.20% (0.3446 => 0.3763, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.17% (0.3469 => 0.3787, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/for-in: 9.15% (0.3496 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.15% (0.3442 => 0.3757, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.15% (0.3465 => 0.3782, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.93% (0.3650 => 0.3976, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3643 => 0.3966, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.75% (0.3724 => 0.4050, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.04% (1.5932 => 1.7053, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.76% (1.6211 => 1.7144, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 5.68% (0.5826 => 0.6157, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.55% (0.5889 => 0.6216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (0.4361 => 0.4590, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (1.3152 => 1.3831, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (2.7292 => 2.8687, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 5.11% (5.5417 => 5.8248, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.09% (3.5627 => 3.7441, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.60% (0.2566 => 0.2684, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (0.3930 => 0.4110, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (0.5000 => 0.5229, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 4.58% (23.5202 => 24.5966, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2750 => 0.2872, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 4.39% (0.3004 => 0.3136, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 4.39% (0.6634 => 0.6925, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 4.32% (0.3336 => 0.3480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.29% (1.0781 => 1.1243, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.3084 => 0.3215, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.24% (0.7171 => 0.7475, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (4.4195 => 4.6037, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.14% (4.2109 => 4.3851, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2823 => 0.2939, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.10% (2.0673 => 2.1521, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2813 => 0.2928, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.08% (0.5026 => 0.5231, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 4.07% (0.3267 => 0.3400, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.05% (0.3060 => 0.3184, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.3362 => 0.3497, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (1.8794 => 1.9547, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3348 => 0.3482, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.99% (0.2729 => 0.2838) SingleSource/Benchmarks/Shootout-C++/matrix: 3.99% (0.2780 => 0.2891, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.98% (0.2811 => 0.2923, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.97% (0.4029 => 0.4189, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (2.1013 => 2.1843, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 3.94% (4.6177 => 4.7998, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.92% (0.2911 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3124 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3625 => 0.3765, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 3.84% (0.3726 => 0.3869, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.80% (0.3317 => 0.3443, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.3903 => 0.4051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.78% (0.3678 => 0.3817, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (0.3890 => 0.4037, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (2.1653 => 2.2464, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3477 => 0.3607, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.74% (0.4146 => 0.4301, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 3.69% (1.4269 => 1.4796, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.4139 => 0.4288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.60% (0.3282 => 0.3400, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.5900 => 0.6109, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.5012 => 0.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.50% (0.3690 => 0.3819, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.3845 => 0.3979, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (0.4658 => 0.4819, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.44% (0.5546 => 0.5737, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.43% (0.6435 => 0.6656, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.25% (2.0346 => 2.1007, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (1.9694 => 2.0301, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.08% (1.9966 => 2.0580, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.07% (0.7875 => 0.8117, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.95% (0.9697 => 0.9983, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 2.91% (0.4847 => 0.4988, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (0.7426 => 0.7636, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (0.5361 => 0.5495, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (0.5584 => 0.5712, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (11.6398 => 11.8793, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.04% (4.6926 => 4.7882, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.15% (0.2122 => 0.2295, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6635, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1664, std.dev.: 0.0394) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8886, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6252, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1931, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5044, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4498, std.dev.: 0.0175) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.48% (3.1722 => 3.2192, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5912, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4690, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5529, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7932, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9599, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8023, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.18% (0.6293 => 0.6156, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -2.11% (17.2379 => 16.8738, std.dev.: 0.0355) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9610, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 21:07:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Sep 2012 23:07:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914040730.DE3AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3782?compare_to=3778&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3782, Order: 163866, Start Time: 2012-09-14 02:49:16, End Time: 2012-09-14 04:08:49 To: 3778, Order: 163860, Start Time: 2012-09-14 01:01:22, End Time: 2012-09-14 02:20:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (733 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.55% (0.5656 => 0.5687, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.01% (15.7455 => 15.7440, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: -0.05% (14.5790 => 14.5715, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 0.01% (82.6837 => 82.6959, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.2791 => 4.2834, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2136 => 1.2135, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.3666 => 7.3653, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.6559 => 3.6555, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.02% (0.6325 => 0.6326, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.0650 => 0.0686) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.76% (63.2438 => 82.6959, std.dev.: 0.0046) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14252.92% (0.0720 => 10.3341, std.dev.: 0.0069) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.15% (10.3673 => 14.8404, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 27.31% (0.1622 => 0.2065, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.03% (2.2022 => 2.5112, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.48% (7.0540 => 8.0048, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: 12.50% (0.1432 => 0.1611) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.43% (1.1194 => 1.2585, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.37% (0.1566 => 0.1744, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.07% (1.7609 => 1.9382, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 9.17% (10.4361 => 11.3934, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/oourafft: 8.38% (0.3282 => 0.3557, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.33% (0.1584 => 0.1716, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3473 => 0.3734, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.39% (0.3516 => 0.3776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.31% (0.3543 => 0.3802, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.28% (0.3543 => 0.3801, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 7.25% (0.3561 => 0.3819, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.23% (0.3497 => 0.3750, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.17% (0.3694 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3828 => 0.4099, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/parameter-passing: 7.00% (0.3927 => 0.4202, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.90% (0.3886 => 0.4154, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.83% (0.4879 => 0.5212, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 6.53% (9.4845 => 10.1038, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.4615 => 0.4881, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.74% (0.2700 => 0.2855, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 5.69% (0.3109 => 0.3286, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.64% (5.7591 => 6.0839, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.56% (0.7433 => 0.7846, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.55% (0.7835 => 0.8270, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.52% (0.7115 => 0.7508, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.6675 => 0.7042, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.37% (0.2271 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.32% (0.2554 => 0.2690, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.24% (3.3354 => 3.5102, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.24% (8.1363 => 8.5625, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (1.3050 => 1.3732, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.22% (0.5860 => 0.6166, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.21% (0.5105 => 0.5371, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 5.20% (0.3423 => 0.3601, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.15% (4.2646 => 4.4842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.10% (1.5415 => 1.6201, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5569 => 0.5841, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 4.85% (0.3092 => 0.3242, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.8172 => 0.8565, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.80% (5.0018 => 5.2418, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.76% (0.8067 => 0.8451, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.75% (0.2107 => 0.2207, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.73% (4.9449 => 5.1788, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (0.9765 => 1.0206, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.50% (21.9371 => 22.9245, std.dev.: 0.0196) SingleSource/UnitTests/ObjC++/property-reference-object: 4.48% (0.6030 => 0.6300, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.41% (0.5925 => 0.6186, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.36% (1.1642 => 1.2150, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.5020 => 0.5237, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.23% (0.2603 => 0.2713, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.18% (1.0722 => 1.1170, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 4.17% (3.8723 => 4.0336, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.15% (0.3180 => 0.3312, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 4.14% (0.4299 => 0.4477, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3441 => 0.3583, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.11% (1.1861 => 1.2349, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.04% (7.9617 => 8.2831, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.87% (1.5603 => 1.6207, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 3.79% (0.6456 => 0.6701, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.73% (0.4636 => 0.4809, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 3.67% (2.2969 => 2.3811, std.dev.: 0.0141) MultiSource/Applications/treecc/treecc: 3.65% (2.0273 => 2.1013, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 3.60% (0.7326 => 0.7590, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 3.55% (0.8921 => 0.9238, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.52% (0.4064 => 0.4207, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (0.6450 => 0.6673, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.33% (0.5981 => 0.6180, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.29% (0.4103 => 0.4238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.4203 => 0.4341, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (1.5859 => 1.6377, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.13% (0.3865 => 0.3986, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4289 => 0.4413, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.4620 => 0.4752, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.4186 => 1.4587, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.82% (14.3668 => 14.7716, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.2024 => 2.2613, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.57% (0.4048 => 0.4152, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.57% (0.3935 => 0.4036, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.1840 => 1.2140, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (0.8101 => 0.8224, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.16% (1.2842 => 1.2991, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3809, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.10% (4.2280 => 4.3592, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2439, std.dev.: 0.0398) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7884, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5809, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 1.09% (26.0924 => 26.3765, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.82% (5.2763 => 3.2278, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.79% (5.3855 => 3.8887, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.40% (5.3526 => 3.8860, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0860, std.dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.90% (2.9384 => 2.5888, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.85% (22.1758 => 20.2143, std.dev.: 0.0294) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2886, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5078, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4131, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.59% (10.2830 => 10.0170, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/chomp: -2.49% (1.2373 => 1.2065, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0102, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5786, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.76% (0.5229 => 0.5687, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.03% (14.9895 => 15.7440, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 2.94% (14.1553 => 14.5715, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (4.1105 => 4.2834, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.84% (1.1048 => 1.2135, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (7.1582 => 7.3653, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.56% (3.4629 => 3.6555, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.6222 => 0.6326, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 22:03:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 00:03:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914050341.00F462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3783?compare_to=3780&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3783, Order: 163866, Start Time: 2012-09-14 03:50:42, End Time: 2012-09-14 05:04:59 To: 3780, Order: 163865, Start Time: 2012-09-14 02:08:06, End Time: 2012-09-14 03:22:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.57% (2.0176 => 2.4124, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.82% (0.1410 => 0.1619, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.32% (3.9660 => 4.3357, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.67% (0.2596 => 0.2821, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.64% (0.7038 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.56% (0.7710 => 0.8370, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.45% (0.5265 => 0.5710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.36% (1.2193 => 1.3212, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.33% (0.9199 => 0.9965, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 8.30% (1.3693 => 1.4830, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.15% (0.6959 => 0.7526, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.99% (0.1327 => 0.1433, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.97% (1.1364 => 1.2270, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.4563 => 1.5707, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.82% (0.7061 => 0.7613, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.79% (13.8202 => 14.8962, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (0.4328 => 0.4658, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.61% (0.5818 => 0.6261, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.46% (0.3246 => 0.3488, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 7.45% (0.5748 => 0.6176, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1589 => 0.1707, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.5577 => 0.5989, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.37% (0.6283 => 0.6746, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.31% (1.0313 => 1.1067, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4379 => 0.4688, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.99% (0.4791 => 0.5126, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2127 => 0.2274, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.87% (7.2180 => 7.7142, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.84% (1.1061 => 1.1818, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.81% (0.5637 => 0.6021, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.77% (0.3485 => 0.3721, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.74% (0.8310 => 0.8870, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.2914 => 0.3108, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.65% (0.7506 => 0.8005, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.56% (3.8646 => 4.1181, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9092, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 6.50% (0.2925 => 0.3115, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3220 => 0.3428, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2243 => 0.2386, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3580 => 0.3806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.3489 => 0.3709, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.30% (0.7460 => 0.7930, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.27% (0.4016 => 0.4268, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.27% (0.2966 => 0.3152, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.21% (2.1791 => 2.3145, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.3756 => 0.3989, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.16% (3.1889 => 3.3852, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.08% (1.9828 => 2.1033, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2655 => 0.2816, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.3868 => 0.4102, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.97% (0.2628 => 0.2785, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.87% (0.6744 => 0.7140, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.87% (0.6576 => 0.6962, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 5.87% (1.9270 => 2.0401, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.87% (1.3245 => 1.4022, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1209, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.3534 => 0.3739, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.76% (0.3107 => 0.3286, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.74% (0.4390 => 0.4642, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.68% (0.3149 => 0.3328, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.66% (1.2749 => 1.3471, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.57% (16.6129 => 17.5376, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.55% (14.8535 => 15.6782, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.39% (8.4961 => 8.9541, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.32% (0.4113 => 0.4332, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.32% (1.3819 => 1.4554, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.3801 => 4.6098, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (1.3813 => 1.4534, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.21% (0.8698 => 0.9151, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (13.2842 => 13.9746, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.6135 => 0.6450, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (4.4433 => 4.6690, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 5.05% (0.3131 => 0.3289, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.97% (0.8818 => 0.9256, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.2504 => 0.2628, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1333 => 1.1881, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 4.81% (14.5298 => 15.2292, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/trivial-interface: 4.78% (0.3578 => 0.3749, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 4.78% (0.3914 => 0.4101, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.77% (0.4003 => 0.4194, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.72% (0.3789 => 0.3968, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.72% (0.3940 => 0.4126, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.68% (4.6629 => 4.8811, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 4.66% (0.3646 => 0.3816, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (6.5754 => 6.8799, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/synchronized: 4.61% (0.3663 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2321 => 0.2428, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.61% (0.3601 => 0.3767, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 4.61% (0.3623 => 0.3790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3755 => 0.3926, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.49% (0.3650 => 0.3814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.38% (0.3245 => 0.3387, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.28% (3.2742 => 3.4144, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.02% (0.9108 => 0.9474, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.89% (0.4805 => 0.4992, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1744, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2751, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5188 => 1.5737, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 3.58% (3.7467 => 3.8807, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1702, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.6250 => 0.6454, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.16% (6.2785 => 6.4769, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.63% (33.2944 => 34.1716, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5219, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std.dev.: 0.0418) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.73% (1.1560 => 1.2569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (3.1736 => 3.4174, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0028, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5460, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.98% (10.7476 => 11.0677, std.dev.: 0.0620) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6026, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2064, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.91% (0.4657 => 0.3823, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.21% (22.5627 => 21.6118, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2729, std.dev.: 0.0298) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.25% (1.3780 => 1.2919, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.76% (0.4867 => 0.4684, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9225, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9182, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.16% (26.5159 => 25.9430, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2453, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2301, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2272, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0608, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2599, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4358, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 22:54:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 00:54:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914055448.4D7D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3784?compare_to=3779&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3784, Order: 163871, Start Time: 2012-09-14 04:45:40, End Time: 2012-09-14 05:56:09 To: 3779, Order: 163863, Start Time: 2012-09-14 01:35:10, End Time: 2012-09-14 02:45:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 12 (53 on baseline) Performance Improvements: 0 (33 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 889 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.15% (0.2745 => 0.2859, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.13% (0.5679 => 0.5857, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5444 => 0.5609, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.88% (0.4545 => 0.4676, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.53% (0.7710 => 0.7905, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.8907 => 0.9086, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.90% (0.5881 => 0.5993, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.4074 => 1.4299, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (4.2326 => 4.2762, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.57% (21.3220 => 24.0014, std.dev.: 1.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (42.0496 => 43.6813, std.dev.: 0.5393) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.61% (1.2510 => 1.2712, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.91% (0.9892 => 1.0081, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 0.43% (0.6001 => 0.6027, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 1.82% (0.1651 => 0.1681, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.81% (0.1551 => 0.1523, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.26% (0.3040 => 0.3139, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.34% (0.2374 => 0.2382, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.38% (0.3183 => 0.3171, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.45% (0.2283 => 0.2227, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0450 => 0.0453, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -17.05% (0.0088 => 0.0073, std.dev.: 0.0008) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0239 => 0.0243, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.62% (0.0191 => 0.0196, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.63% (0.0278 => 0.0229, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.42% (0.0281 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0321 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 10.97% (0.0155 => 0.0172, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0250 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -25.46% (0.0326 => 0.0243, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1441 => 0.1446, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -2.97% (1.5193 => 1.4742, std.dev.: 0.0292) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.26% (0.1548 => 0.1513, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.03% (0.4270 => 0.4098, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.31% (0.1356 => 0.1428, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.30% (0.0639 => 0.0554, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.28% (0.0244 => 0.0252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.75% (0.0571 => 0.0561, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1474 => 1.1452, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.88% (0.0567 => 0.0562, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.56% (0.0256 => 0.0260, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7807 => 0.7813, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.07% (1.6066 => 1.6077, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 146.94% (0.0049 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.36% (4.1772 => 3.1180, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/except: 82333.33% (0.0006 => 0.4946, std.dev.: 0.0184) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.34% (0.1414 => 0.1546, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.34% (0.6410 => 0.6752, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 5.00% (2.1763 => 2.2851, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.63% (0.3582 => 0.3748, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.6915 => 0.7201, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.7722 => 0.8032, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3217 => 0.3338, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.56% (0.6173 => 0.6393, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 3.55% (1.0046 => 1.0403, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.1653 => 1.2057, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.5150 => 1.5645, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 2.70% (29.3170 => 30.1086, std.dev.: 0.1592) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.1672 => 1.1925, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.02% (0.7226 => 0.7372, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 1.92% (1.1440 => 1.1660, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7784 => 0.7905, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.51% (1.1827 => 1.2005, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (1.4113 => 1.4299, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.0689 => 1.0798, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 30.66% (0.0499 => 0.0652, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 21.92% (3.4629 => 4.2218, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 14.20% (0.3746 => 0.4278, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (4.0101 => 4.5524, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 13.36% (21.1721 => 24.0014, std.dev.: 1.0347) SingleSource/Benchmarks/Stanford/Puzzle: 11.86% (0.1433 => 0.1603, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6077, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.12% (1.0063 => 1.0880, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.91% (40.4792 => 43.6813, std.dev.: 0.5393) SingleSource/Benchmarks/McGill/chomp: 6.55% (1.0194 => 1.0862, std.dev.: 0.0151) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7989, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.52% (0.9851 => 1.0296, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.00% (0.3301 => 0.3433, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7909, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 2.43% (8.5113 => 8.7185, std.dev.: 0.0473) MultiSource/Benchmarks/BitBench/five11/five11: 2.14% (5.1938 => 5.3050, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.09% (2.6656 => 2.7212, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/whetstone: 1.91% (2.3453 => 2.3900, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4455 => 2.4847, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.57% (14.4877 => 14.7156, std.dev.: 0.0223) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5311, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.30% (4.6127 => 4.6725, std.dev.: 0.0201) MultiSource/Applications/spiff/spiff: 1.12% (2.8599 => 2.8919, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 1.08% (2.5166 => 2.5438, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.40% (5.2665 => 4.0867, std.dev.: 0.0750) SingleSource/Benchmarks/Shootout-C++/ary3: -20.99% (1.7473 => 1.3806, std.dev.: 0.0675) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.28% (1.1647 => 0.9401, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5461, std.dev.: 0.0388) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.97% (3.2007 => 2.9457, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.56% (2.4457 => 2.2609, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.19% (3.6254 => 3.3648, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: -6.75% (3.4230 => 3.1918, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3512, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.99% (4.6355 => 4.4044, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: -4.89% (1.4117 => 1.3427, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.08% (1.7361 => 1.6653, std.dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: -3.13% (7.6833 => 7.4431, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/methcall: -3.07% (9.2503 => 8.9666, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8283, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.46% (0.4140 => 0.4038, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.13% (1.0686 => 1.0458, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -1.93% (3.8907 => 3.8157, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.91% (1.2959 => 1.2712, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.90% (3.7496 => 3.6782, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2249, std.dev.: 0.0334) MultiSource/Benchmarks/PAQ8p/paq8p: -1.67% (92.7467 => 91.2010, std.dev.: 0.2773) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3061, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.33% (1.8739 => 1.8490, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.01% (0.9980 => 1.0081, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 0.08% (0.6022 => 0.6027, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 0.90% (0.1666 => 0.1681, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.99% (0.1554 => 0.1523, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.82% (0.3083 => 0.3139, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.50% (0.2394 => 0.2382, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.13% (0.3175 => 0.3171, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.26% (0.2302 => 0.2227, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -17.98% (0.0089 => 0.0073, std.dev.: 0.0008) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.92% (0.0301 => 0.0229, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -8.99% (0.0189 => 0.0172, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -25.23% (0.0325 => 0.0243, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1429 => 0.1446, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -1.84% (1.5019 => 1.4742, std.dev.: 0.0292) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.80% (0.1501 => 0.1513, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.89% (0.4264 => 0.4098, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.1344 => 0.1428, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.94% (0.0589 => 0.0554, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.62% (0.0232 => 0.0252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.21% (0.0639 => 0.0561, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.90% (1.1350 => 1.1452, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 233.33% (0.0006 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.77% (0.0637 => 0.0562, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (0.0246 => 0.0260, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.61% (0.7541 => 0.7813, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.65% (1.5363 => 1.6077, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 22:55:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 00:55:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914055521.EEB202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3785?compare_to=3782&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3785, Order: 163870, Start Time: 2012-09-14 04:37:14, End Time: 2012-09-14 05:56:40 To: 3782, Order: 163866, Start Time: 2012-09-14 02:49:16, End Time: 2012-09-14 04:08:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.21% (0.5687 => 0.5699, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.13% (15.7440 => 15.7640, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 0.38% (14.5715 => 14.6269, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 0.14% (82.6959 => 82.8080, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 0.24% (4.2834 => 4.2936, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.2135 => 1.2154, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (7.3653 => 7.3709, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.27% (3.6555 => 3.6653, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6326 => 0.6324, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1428 => 0.1427, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.39% (0.0686 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.93% (63.2438 => 82.8080, std.dev.: 0.0016) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.03% (0.0720 => 10.3313, std.dev.: 0.0034) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.38% (10.3673 => 14.9682, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/richards_benchmark: 26.94% (0.1622 => 0.2059, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.83% (2.2022 => 2.5067, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.23% (7.0540 => 7.9871, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.16% (1.1194 => 1.2555, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 12.15% (0.1432 => 0.1606, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.37% (0.1566 => 0.1744, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (1.7609 => 1.9391, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.19% (10.4361 => 11.3947, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3473 => 0.3745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3561 => 0.3834, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3543 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3543 => 0.3813, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3516 => 0.3782, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3694 => 0.3966, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.36% (0.3927 => 0.4216, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3828 => 0.4108, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.18% (0.3886 => 0.4165, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.4879 => 0.5218, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 6.58% (9.4845 => 10.1083, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7433 => 0.7884, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.92% (0.7115 => 0.7536, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 5.89% (0.3109 => 0.3292, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.4615 => 0.4881, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.64% (0.2554 => 0.2698, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.63% (0.6675 => 0.7051, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.62% (5.7591 => 6.0829, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.60% (0.5860 => 0.6188, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (8.1363 => 8.5864, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 5.49% (0.3423 => 0.3611, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.47% (3.3354 => 3.5179, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (4.2646 => 4.4951, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.38% (1.3050 => 1.3752, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.2065 => 0.2175, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.31% (0.5105 => 0.5376, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.8172 => 0.8603, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.22% (0.2758 => 0.2902, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.21% (1.5415 => 1.6218, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.03% (0.8067 => 0.8473, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (5.0018 => 5.2532, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.01% (4.9449 => 5.1924, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.94% (0.5569 => 0.5844, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.86% (0.7835 => 0.8216, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.77% (0.9765 => 1.0231, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.68% (1.1642 => 1.2187, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 4.62% (21.9371 => 22.9514, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/09-vor/vor: 4.53% (0.3180 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.5020 => 0.5247, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.49% (0.2603 => 0.2720, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.49% (0.5925 => 0.6191, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.43% (1.0722 => 1.1197, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 4.41% (0.6030 => 0.6296, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 4.37% (3.8723 => 4.0416, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.36% (0.3441 => 0.3591, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.32% (1.1861 => 1.2373, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.28% (0.3387 => 0.3532, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.28% (7.9617 => 8.3023, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 4.16% (0.4299 => 0.4478, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.15% (1.5603 => 1.6251, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.4636 => 0.4822, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.6456 => 0.6715, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.94% (2.0273 => 2.1071, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.86% (2.2969 => 2.3855, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.81% (0.8921 => 0.9261, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.69% (0.6450 => 0.6688, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 3.64% (0.7326 => 0.7593, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5981 => 0.6191, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (0.4064 => 0.4205, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.33% (1.5859 => 1.6387, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.4289 => 0.4428, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8120, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.07% (0.3650 => 0.3762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.4186 => 1.4612, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.95% (0.3826 => 0.3939, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.84% (2.2024 => 2.2649, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (0.4620 => 0.4750, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.72% (0.4048 => 0.4158, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.1840 => 1.2157, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (2.0665 => 2.1193, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.8101 => 0.8244, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2842 => 1.3014, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3635, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 2.26% (3.7781 => 3.8635, std.dev.: 0.0316) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2444, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7892, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3729, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/fbench: 1.04% (2.2771 => 2.3007, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.88% (5.2763 => 3.2250, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.97% (5.3855 => 3.8790, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.59% (5.3526 => 3.8759, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1496, std.dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.00% (2.9384 => 2.5858, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -8.70% (22.1758 => 20.2475, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2889, std.dev.: 0.0581) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4102, std.dev.: 0.0163) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5074, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9876, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.34% (1.2373 => 1.2083, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0182, std.dev.: 0.0094) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5787, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (0.5229 => 0.5699, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.17% (14.9895 => 15.7640, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 3.33% (14.1553 => 14.6269, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (4.1105 => 4.2936, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.01% (1.1048 => 1.2154, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.97% (7.1582 => 7.3709, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.84% (3.4629 => 3.6653, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.6222 => 0.6324, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 13 23:46:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 01:46:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914064609.E5DFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3786?compare_to=3783&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3786, Order: 163873, Start Time: 2012-09-14 05:33:10, End Time: 2012-09-14 06:47:28 To: 3783, Order: 163866, Start Time: 2012-09-14 03:50:42, End Time: 2012-09-14 05:04:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (162 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.29% (1.2153 => 1.2310, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.55% (2.0176 => 2.4121, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.32% (3.9660 => 4.3356, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.84% (0.7038 => 0.7660, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.53% (0.7710 => 0.8368, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.52% (1.3693 => 1.4859, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.48% (0.9199 => 0.9979, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.46% (1.2193 => 1.3225, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.45% (0.5265 => 0.5710, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.32% (0.6959 => 0.7538, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.10% (1.1364 => 1.2284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.02% (0.4328 => 0.4675, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.99% (1.4563 => 1.5727, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 7.95% (13.8202 => 14.9183, std.dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference: 7.69% (0.7061 => 0.7604, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.62% (0.5577 => 0.6002, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.37% (0.6283 => 0.6746, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.33% (1.0313 => 1.1069, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.30% (0.5818 => 0.6243, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.13% (0.5748 => 0.6158, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4062 => 0.4351, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.08% (0.4791 => 0.5130, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3899 => 0.4174, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.01% (1.1061 => 1.1836, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.91% (0.2995 => 0.3202, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (7.2180 => 7.7123, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.2914 => 0.3113, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.77% (0.8310 => 0.8873, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.73% (3.8646 => 4.1245, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.62% (0.4016 => 0.4282, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.62% (0.3580 => 0.3817, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.59% (0.7506 => 0.8001, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.55% (3.6692 => 3.9094, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.47% (0.3756 => 0.3999, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (1.9828 => 2.1109, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.41% (0.3293 => 0.3504, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.38% (2.1791 => 2.3182, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.38% (0.7460 => 0.7936, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3220 => 0.3425, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.28% (0.2023 => 0.2150, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.13% (0.3868 => 0.4105, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.09% (1.9270 => 2.0443, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.08% (3.1889 => 3.3829, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.3534 => 0.3748, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.03% (1.3245 => 1.4044, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3107 => 0.3294, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.01% (0.4390 => 0.4654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.98% (0.3192 => 0.3383, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.98% (0.6744 => 0.7147, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3149 => 0.3337, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.88% (1.0594 => 1.1217, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.69% (1.2749 => 1.3475, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 5.63% (16.6129 => 17.5475, std.dev.: 0.0191) MultiSource/Applications/JM/lencod/lencod: 5.58% (14.8535 => 15.6830, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.50% (8.4961 => 8.9631, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6135 => 0.6469, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.39% (1.3813 => 1.4558, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (1.3819 => 1.4561, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.8698 => 0.9165, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 5.36% (0.3789 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.4003 => 0.4217, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.34% (0.3914 => 0.4123, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.34% (0.3578 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 5.32% (0.4113 => 0.4332, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.29% (0.3646 => 0.3839, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (13.2842 => 13.9794, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (4.4433 => 4.6745, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.3801 => 4.6076, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 5.19% (0.3601 => 0.3788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.15% (0.3940 => 0.4143, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.15% (0.3650 => 0.3838, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.08% (0.3663 => 0.3849, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.02% (0.3623 => 0.3805, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (1.1333 => 1.1901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.98% (0.3755 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.90% (0.8818 => 0.9250, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.85% (14.5298 => 15.2351, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (6.5754 => 6.8869, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.59% (0.3245 => 0.3394, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.48% (3.2742 => 3.4208, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 4.38% (4.6629 => 4.8672, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2292 => 1.2787, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (1.5188 => 1.5789, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (0.4805 => 0.4991, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1769, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 3.77% (3.7467 => 3.8878, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.56% (2.1007 => 2.1754, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6250 => 0.6467, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (6.2785 => 6.4846, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 2.24% (33.2944 => 34.0406, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5214, std.dev.: 0.0354) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4162, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5471, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0793, std.dev.: 0.0489) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6058, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1831, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5961, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.46% (0.4657 => 0.3844, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.03% (22.5627 => 21.6535, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2721, std.dev.: 0.0345) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.79% (1.3780 => 1.2982, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9221, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.8259 => 8.5580, std.dev.: 0.0352) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9056, std.dev.: 0.0213) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2508, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (4.1080 => 4.0561, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2388, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2389, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4349, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2624, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 00:10:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 02:10:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914071048.B60932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3787?compare_to=3781&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3787, Order: 163870, Start Time: 2012-09-14 04:27:16, End Time: 2012-09-14 07:12:08 To: 3781, Order: 163860, Start Time: 2012-09-14 01:15:21, End Time: 2012-09-14 03:59:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (791 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.22% (2.4409 => 2.4952, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -5.40% (0.2295 => 0.2171, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.92% (0.3488 => 0.3799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3465 => 0.3773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3496 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.85% (0.3446 => 0.3751, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3469 => 0.3776, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.82% (0.3460 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.80% (0.3442 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.60% (0.3650 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3643 => 0.3956, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.38% (0.3724 => 0.4036, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.32% (1.5932 => 1.7098, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.58% (1.3152 => 1.3886, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.41% (0.5826 => 0.6141, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (1.6211 => 1.7087, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 5.38% (0.5889 => 0.6206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.04% (2.7292 => 2.8667, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (3.5627 => 3.7415, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 4.96% (5.5417 => 5.8163, std.dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.64% (0.2738 => 0.2865, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.50% (0.3930 => 0.4107, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.39% (1.0781 => 1.1254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 4.27% (4.2109 => 4.3905, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (4.4195 => 4.6065, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2875 => 0.2996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.20% (0.7171 => 0.7472, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 4.06% (23.5202 => 24.4758, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2813 => 0.2926, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (2.1013 => 2.1855, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.96% (4.6177 => 4.8006, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2792 => 0.2902, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.94% (0.9909 => 1.0299, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (1.8794 => 1.9519, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.84% (0.6634 => 0.6889, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2803 => 0.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (0.3890 => 0.4038, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3267 => 0.3391, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.3903 => 0.4051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.75% (0.3096 => 0.3212, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.74% (2.1653 => 2.2463, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.3625 => 0.3760, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.70% (0.4029 => 0.4178, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3348 => 0.3471, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.65% (0.4139 => 0.4290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.58% (1.4269 => 1.4780, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 3.51% (0.3678 => 0.3807, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.4251 => 0.4398, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.44% (0.5546 => 0.5737, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.42% (0.3336 => 0.3450, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3690 => 0.3816, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.40% (0.3084 => 0.3189, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (0.4658 => 0.4812, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.6435 => 0.6646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.5012 => 0.5172, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (1.9694 => 2.0303, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.99% (0.3845 => 0.3960, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.91% (2.0346 => 2.0939, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.86% (1.9966 => 2.0537, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.79% (0.7875 => 0.8095, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.77% (0.9697 => 0.9966, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.63% (0.7426 => 0.7621, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (0.5361 => 0.5483, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.06% (0.5584 => 0.5699, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.87% (4.6926 => 4.7805, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.65% (3.3903 => 3.6156, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6747, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1712, std.dev.: 0.0378) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6311, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2040, std.dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5100, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4429, std.dev.: 0.1586) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5679, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: -10.78% (0.2402 => 0.2143, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7892, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.82% (17.2379 => 16.7525, std.dev.: 0.1030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9715, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 00:21:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 02:21:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914072126.EE5F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3788?compare_to=3784&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3788, Order: 163874, Start Time: 2012-09-14 06:11:32, End Time: 2012-09-14 07:22:47 To: 3784, Order: 163871, Start Time: 2012-09-14 04:45:40, End Time: 2012-09-14 05:56:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (48 on baseline) Performance Improvements: 12 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 879 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.10% (1.0837 => 1.0956, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.36% (0.7544 => 0.7948, std.dev.: 0.0156) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.61% (4.0867 => 4.2341, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (0.3433 => 0.3543, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: 1.72% (4.3076 => 4.3816, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 1.60% (7.0037 => 7.1160, std.dev.: 0.0367) SingleSource/Benchmarks/Misc/ffbench: 1.49% (1.3427 => 1.3627, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.39% (1.6112 => 1.6336, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.7185 => 8.8381, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.03% (5.8631 => 5.9234, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.50% (0.1429 => 0.1279, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.42% (0.8032 => 0.7275, std.dev.: 0.0248) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.83% (0.7905 => 0.7523, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.34% (0.4676 => 0.4473, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.16% (0.9086 => 0.8708, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.10% (0.5857 => 0.5617, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: -2.40% (0.4249 => 0.4147, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.19% (0.5609 => 0.5486, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.04% (1.4299 => 1.4007, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.89% (0.5714 => 0.5606, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.55% (1.5645 => 1.5402, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.39% (3.6782 => 3.6272, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.14% (1.0081 => 0.9865, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 0.90% (0.6027 => 0.6081, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: -1.55% (0.1681 => 0.1655, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.63% (0.1523 => 0.1563, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (0.3139 => 0.3145, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.34% (0.2382 => 0.2350, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.88% (0.3171 => 0.3199, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.2227 => 0.2324, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel: -3.09% (0.0453 => 0.0439, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: 21.92% (0.0073 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -13.58% (0.0243 => 0.0210, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.76% (0.0196 => 0.0122, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0388 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.44% (0.0229 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.64% (0.0183 => 0.0180, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 11.05% (0.0172 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.59% (0.0251 => 0.0242, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 35.39% (0.0243 => 0.0329, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1446 => 0.1429, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.34% (1.4742 => 1.4939, std.dev.: 0.0390) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.85% (0.1513 => 0.1485, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.85% (0.4098 => 0.4063, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.59% (0.1428 => 0.1465, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.14% (0.0554 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -35.32% (0.0252 => 0.0163, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.30% (0.0561 => 0.0630, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.81% (1.1452 => 1.1545, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0020 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.85% (0.0562 => 0.0546, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.62% (0.0260 => 0.0144, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7813 => 0.7814, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.17% (1.6077 => 1.6104, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.20% (0.0121 => 0.0053, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.97% (4.1772 => 3.0924, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/except: 82616.67% (0.0006 => 0.4963, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.99% (0.0745 => 0.0879, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5309 => 0.5626, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: 5.62% (2.1763 => 2.2985, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.54% (0.6410 => 0.6765, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.96% (0.3582 => 0.3724, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 3.78% (15.3105 => 15.8885, std.dev.: 0.1481) MultiSource/Applications/minisat/minisat: 3.64% (0.6173 => 0.6398, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.91% (29.3170 => 30.1696, std.dev.: 0.1288) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std.dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: 2.00% (13.3238 => 13.5904, std.dev.: 0.0969) MultiSource/Applications/Burg/burg: 1.86% (1.1440 => 1.1653, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.82% (1.8798 => 1.9140, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.5150 => 1.5402, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (8.2186 => 8.3341, std.dev.: 0.0263) MultiSource/Benchmarks/nbench/nbench: 1.25% (1.0821 => 1.0956, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 52.09% (0.0263 => 0.0400, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2301, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout/ary3: 15.33% (1.7426 => 2.0098, std.dev.: 0.0222) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.72% (0.0917 => 0.1052, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.36% (0.3746 => 0.4284, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 14.31% (0.1433 => 0.1638, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.51% (4.0101 => 4.5520, std.dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.87% (0.2694 => 0.2933, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 8.86% (7.0025 => 7.6228, std.dev.: 0.0280) SingleSource/Benchmarks/McGill/chomp: 8.29% (1.0194 => 1.1039, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.67% (0.2857 => 0.3076, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.33% (0.3301 => 0.3543, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8071, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8228, std.dev.: 0.0657) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 3.84% (8.5113 => 8.8381, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (4.2129 => 4.3692, std.dev.: 0.0598) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 2.79% (1.4184 => 1.4580, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.41% (2.6656 => 2.7298, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 2.06% (6.9722 => 7.1160, std.dev.: 0.0367) MultiSource/Benchmarks/BitBench/five11/five11: 2.05% (5.1938 => 5.3004, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/hash: 1.86% (4.3016 => 4.3816, std.dev.: 0.0146) MultiSource/Applications/hexxagon/hexxagon: 1.84% (14.4877 => 14.7544, std.dev.: 0.0610) MultiSource/Benchmarks/Olden/bh/bh: 1.83% (2.5166 => 2.5626, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 1.69% (3.5520 => 3.6120, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4455 => 2.4840, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.40% (1.6110 => 1.6336, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.56% (0.9029 => 0.8708, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.68% (0.4596 => 0.4473, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: -2.49% (0.4253 => 0.4147, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.14% (0.5740 => 0.5617, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: -2.03% (0.7738 => 0.7581, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.14% (4.2815 => 4.2327, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.60% (5.2665 => 4.2341, std.dev.: 0.0487) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.42% (1.1647 => 0.9385, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: -11.99% (8.1594 => 7.1808, std.dev.: 0.0732) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5279, std.dev.: 0.1128) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.99% (1.4034 => 1.2772, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.91% (3.2007 => 2.9154, std.dev.: 0.0437) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.26% (2.4457 => 2.2436, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.98% (3.6254 => 3.3723, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: -6.57% (3.4230 => 3.1982, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7961, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std.dev.: 0.0533) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.45% (1.7361 => 1.6588, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.25% (0.4564 => 0.4370, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.51% (9.2503 => 8.9258, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/ffbench: -3.47% (1.4117 => 1.3627, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.37% (1.1683 => 1.1289, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.26% (3.7496 => 3.6272, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.24% (0.4140 => 0.4006, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.00% (45.4683 => 44.1042, std.dev.: 0.3485) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4554, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2908, std.dev.: 0.0160) MultiSource/Applications/aha/aha: -2.47% (3.4286 => 3.3439, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.13% (1.2722 => 1.2451, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.09% (2.8964 => 2.8359, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: -1.83% (92.7467 => 91.0457, std.dev.: 0.2886) MultiSource/Benchmarks/sim/sim: -1.72% (3.8907 => 3.8238, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2344, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4876 => 3.4330, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.55% (1.0686 => 1.0520, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: -1.49% (3.8200 => 3.7631, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.23% (25.6658 => 25.3511, std.dev.: 0.0280) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.15% (0.9980 => 0.9865, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 0.98% (0.6022 => 0.6081, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: -0.66% (0.1666 => 0.1655, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.3083 => 0.3145, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.84% (0.2394 => 0.2350, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.76% (0.3175 => 0.3199, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.96% (0.2302 => 0.2324, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel: -2.23% (0.0449 => 0.0439, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0240 => 0.0210, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.46% (0.0192 => 0.0122, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -2.81% (0.0249 => 0.0242, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.53% (1.5019 => 1.4939, std.dev.: 0.0390) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.07% (0.1501 => 0.1485, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.71% (0.4264 => 0.4063, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.00% (0.1344 => 0.1465, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.17% (0.0589 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.74% (0.0232 => 0.0163, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.41% (0.0639 => 0.0630, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.72% (1.1350 => 1.1545, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.29% (0.0637 => 0.0546, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.46% (0.0246 => 0.0144, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.62% (0.7541 => 0.7814, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.82% (1.5363 => 1.6104, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.29% (0.0070 => 0.0053, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 00:46:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 02:46:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914074622.E9D372A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3789?compare_to=3785&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3789, Order: 163874, Start Time: 2012-09-14 06:25:03, End Time: 2012-09-14 07:47:42 To: 3785, Order: 163870, Start Time: 2012-09-14 04:37:14, End Time: 2012-09-14 05:56:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (736 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9567 => 8.0559, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.58% (0.5699 => 0.5666, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 0.15% (15.7640 => 15.7882, std.dev.: 0.3595) MultiSource/Applications/kimwitu++/kc: 0.17% (14.6269 => 14.6511, std.dev.: 0.0184) MultiSource/Benchmarks/Bullet/bullet: 0.05% (82.8080 => 82.8504, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/gs/gs: 0.20% (4.2936 => 4.3023, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.22% (1.2154 => 1.2181, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.3709 => 7.3751, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.08% (3.6653 => 3.6683, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.22% (0.6324 => 0.6338, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1427 => 0.1428, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (0.0649 => 0.0684, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.00% (63.2438 => 82.8504, std.dev.: 0.0201) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.64% (0.0720 => 10.3303, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.31% (10.3673 => 14.9612, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 26.76% (0.1622 => 0.2056, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.61% (2.2022 => 2.5019, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.14% (7.0540 => 7.9812, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 12.01% (0.1432 => 0.1604, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.49% (0.1566 => 0.1746, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.53% (1.7609 => 1.9288, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 9.25% (10.4361 => 11.4013, std.dev.: 0.0836) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.95% (0.3543 => 0.3860, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3473 => 0.3771, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.52% (0.1584 => 0.1719, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3516 => 0.3812, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.32% (0.3497 => 0.3788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.30% (0.3543 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.26% (0.3561 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.01% (0.3694 => 0.3990, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.94% (0.3927 => 0.4239, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.94% (0.3828 => 0.4132, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 6.83% (0.1655 => 0.1768, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.76% (9.4845 => 10.1255, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 6.70% (0.2554 => 0.2725, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7433 => 0.7882, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.3307 => 0.3502, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4615 => 0.4886, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 5.86% (0.7115 => 0.7532, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.78% (0.6675 => 0.7061, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.76% (0.3423 => 0.3620, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5860 => 0.6194, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (8.1363 => 8.5943, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (1.3050 => 1.3783, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.60% (5.7591 => 6.0817, std.dev.: 0.0889) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.8067 => 0.8513, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.52% (0.5105 => 0.5387, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.50% (5.0018 => 5.2768, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.42% (0.2271 => 0.2394, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.39% (4.2646 => 4.4945, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.5415 => 1.6242, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.32% (0.5569 => 0.5865, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.8172 => 0.8597, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9765 => 1.0269, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.00% (4.9449 => 5.1922, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.90% (0.3121 => 0.3274, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.75% (21.9371 => 22.9798, std.dev.: 0.0346) SingleSource/UnitTests/ObjC++/property-reference-object: 4.53% (0.6030 => 0.6303, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.51% (1.0722 => 1.1206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.51% (0.5925 => 0.6192, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.50% (0.3180 => 0.3323, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.49% (1.1861 => 1.2393, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.4103 => 0.4286, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 4.43% (3.8723 => 4.0440, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (7.9617 => 8.3129, std.dev.: 0.0120) MultiSource/Benchmarks/sim/sim: 4.40% (0.3387 => 0.3536, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.39% (0.3441 => 0.3592, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 4.37% (1.5603 => 1.6285, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.28% (0.5020 => 0.5235, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 4.23% (0.4299 => 0.4481, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6450 => 0.6720, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6456 => 0.6716, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.82% (0.8921 => 0.9262, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 3.82% (0.7326 => 0.7606, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4636 => 0.4812, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4203 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.62% (0.3422 => 0.3546, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.56% (0.5981 => 0.6194, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3865 => 0.3998, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (1.5859 => 1.6397, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3603 => 0.3725, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (14.3668 => 14.8420, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 3.14% (0.4048 => 0.4175, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.12% (0.4620 => 0.4764, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.4186 => 1.4624, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0665 => 2.1262, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.2024 => 2.2652, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.1840 => 1.2160, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.8101 => 0.8245, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 7.18% (3.1578 => 3.3844, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7601, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3449, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 1.21% (2.2771 => 2.3046, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2216, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 1.13% (26.0924 => 26.3878, std.dev.: 0.0145) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.98% (5.2763 => 3.2196, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.39% (5.3855 => 3.8566, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.84% (5.3526 => 3.8623, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0601, std.dev.: 0.0504) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.39% (2.9384 => 2.5743, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -8.81% (22.1758 => 20.2225, std.dev.: 0.0504) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.56% (19.9488 => 18.2404, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (1.8329 => 1.7167, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0477) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.14% (8.6802 => 8.4075, std.dev.: 0.0156) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: -2.97% (1.2373 => 1.2006, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9921, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0182, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5787, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2195, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.36% (0.5229 => 0.5666, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 5.33% (14.9895 => 15.7882, std.dev.: 0.3595) MultiSource/Applications/kimwitu++/kc: 3.50% (14.1553 => 14.6511, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (4.1105 => 4.3023, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.26% (1.1048 => 1.2181, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.03% (7.1582 => 7.3751, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.93% (3.4629 => 3.6683, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.6222 => 0.6338, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 01:32:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 03:32:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914083258.EE9042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3790?compare_to=3786&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3790, Order: 163878, Start Time: 2012-09-14 07:19:57, End Time: 2012-09-14 08:34:17 To: 3786, Order: 163873, Start Time: 2012-09-14 05:33:10, End Time: 2012-09-14 06:47:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.48% (7.9401 => 8.0573, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.28% (2.0176 => 2.4066, std.dev.: 0.0154) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.37% (3.9660 => 4.3377, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.09% (0.7710 => 0.8411, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 8.92% (0.7038 => 0.7666, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 8.76% (1.3693 => 1.4892, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5265 => 0.5725, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.66% (0.9199 => 0.9996, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.55% (1.2193 => 1.3236, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.54% (0.6959 => 0.7553, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (0.4328 => 0.4689, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.17% (1.1364 => 1.2293, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.04% (1.4563 => 1.5734, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 7.96% (13.8202 => 14.9206, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.85% (0.5577 => 0.6015, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.77% (0.5818 => 0.6270, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.69% (0.5748 => 0.6190, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.46% (0.3899 => 0.4190, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.34% (1.0313 => 1.1070, std.dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.32% (0.6283 => 0.6743, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4062 => 0.4359, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 7.29% (1.1061 => 1.1867, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.24% (0.4791 => 0.5138, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.15% (0.7061 => 0.7566, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.00% (0.3485 => 0.3729, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.98% (3.6692 => 3.9253, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (7.2180 => 7.7178, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (3.8646 => 4.1316, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 6.89% (0.7506 => 0.8023, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.81% (0.8310 => 0.8876, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.73% (0.3580 => 0.3821, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.71% (0.3293 => 0.3514, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/09-vor/vor: 6.70% (0.2925 => 0.3121, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.68% (0.7460 => 0.7958, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.67% (0.4016 => 0.4284, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.66% (0.3756 => 0.4006, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (1.9828 => 2.1123, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.49% (2.1791 => 2.3206, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.2937 => 0.3125, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.38% (0.2696 => 0.2868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.33% (0.3868 => 0.4113, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.22% (3.1889 => 3.3873, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.13% (1.3245 => 1.4057, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.08% (1.9270 => 2.0442, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 6.08% (0.6744 => 0.7154, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.08% (0.3192 => 0.3386, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.96% (16.6129 => 17.6032, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3534 => 0.3744, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.88% (1.0594 => 1.1217, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (1.3819 => 1.4617, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/parameter-passing: 5.77% (0.4003 => 0.4234, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 5.76% (0.3578 => 0.3784, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 5.73% (1.2749 => 1.3480, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.71% (14.8535 => 15.7021, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/synchronized: 5.71% (0.3663 => 0.3872, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 5.70% (0.3914 => 0.4137, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.68% (0.3646 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.2859 => 0.3019, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.58% (0.3601 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.57% (0.6135 => 0.6477, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.54% (8.4961 => 8.9669, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/property: 5.53% (0.3940 => 0.4158, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.48% (0.8698 => 0.9175, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.47% (0.3623 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.1333 => 1.1952, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.45% (0.3650 => 0.3849, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.3813 => 1.4564, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6137, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.33% (4.4433 => 4.6802, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.25% (0.8818 => 0.9281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (13.2842 => 13.9812, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.98% (14.5298 => 15.2539, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.98% (0.3755 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.88% (6.5754 => 6.8963, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.68% (0.3245 => 0.3397, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (3.2742 => 3.4242, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 4.45% (4.6629 => 4.8702, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.30% (0.9108 => 0.9500, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.10% (1.2292 => 1.2796, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.94% (4.9865 => 5.1830, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5781, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (0.4805 => 0.4991, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8907, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.63% (0.6250 => 0.6477, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (2.1007 => 2.1756, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (6.2785 => 6.4979, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.56% (33.2944 => 34.1458, std.dev.: 0.0283) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5205, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 25.67% (1.8175 => 2.2840, std.dev.: 0.0406) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3798, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.2093 => 0.2197, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6983, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1132, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5935, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5883, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.20% (0.4657 => 0.3856, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.91% (22.5627 => 21.6815, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2624, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.20% (2.6470 => 2.5094, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std.dev.: 0.0198) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9250, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.8259 => 8.5685, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9086, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2438, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2352, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.1080 => 4.0572, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2350, std.dev.: 0.0214) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.05% (6.6320 => 6.5622, std.dev.: 0.0134) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 01:48:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 03:48:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914084841.98BDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3791?compare_to=3788&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3791, Order: 163878, Start Time: 2012-09-14 07:38:27, End Time: 2012-09-14 08:50:02 To: 3788, Order: 163874, Start Time: 2012-09-14 06:11:32, End Time: 2012-09-14 07:22:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 21 (59 on baseline) Performance Improvements: 3 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 877 (791 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.23% (0.1279 => 0.1397, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.7275 => 0.7805, std.dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.87% (0.2955 => 0.3158, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.48% (0.8708 => 0.9272, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.33% (0.4473 => 0.4756, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.47% (0.5617 => 0.5924, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.7523 => 0.7795, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5486 => 0.5655, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1787 => 1.2111, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.7303 => 0.7501, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.46% (4.2952 => 4.4009, std.dev.: 0.0230) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (6.3045 => 6.4589, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.98% (1.4021 => 1.4299, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8816 => 3.9480, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (1.3990 => 1.4194, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.34% (1.5402 => 1.5608, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.0898 => 3.1284, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (4.0446 => 4.0950, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.87% (2.4814 => 2.6022, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.03% (1.6588 => 1.6759, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.01% (2.9154 => 2.9447, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -6.64% (3.3576 => 3.1345, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/ReedSolomon: -1.31% (8.8381 => 8.7223, std.dev.: 0.0140) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.20% (1.2451 => 1.2301, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.49% (0.9865 => 0.9913, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -0.89% (0.6081 => 0.6027, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 1.33% (0.1655 => 0.1677, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.96% (0.1563 => 0.1578, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.70% (0.3145 => 0.3167, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.2350 => 0.2403, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.75% (0.3199 => 0.3223, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.67% (0.2324 => 0.2262, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 3.42% (0.0439 => 0.0454, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 2.25% (0.0089 => 0.0091, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.38% (0.0210 => 0.0184, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 59.02% (0.0122 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0389 => 0.0391, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.99% (0.0324 => 0.0256, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0180 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.57% (0.0191 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.07% (0.0242 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -1.82% (0.0329 => 0.0323, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1429 => 0.1436, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -2.48% (1.4939 => 1.4568, std.dev.: 0.0235) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.64% (0.1485 => 0.1539, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.23% (0.4063 => 0.4013, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.41% (0.1465 => 0.1459, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.25% (0.0588 => 0.0613, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 55.83% (0.0163 => 0.0254, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.63% (0.0630 => 0.0626, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1545 => 1.1508, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 68.75% (0.0016 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.41% (0.0546 => 0.0581, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 83.33% (0.0144 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7814 => 0.7807, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.12% (1.6104 => 1.6085, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.43% (0.0053 => 0.0048, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.59% (4.1772 => 3.0665, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/except: 82000.00% (0.0006 => 0.4926, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.53% (0.5309 => 0.5709, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.18% (0.6410 => 0.6806, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 5.98% (2.1763 => 2.3064, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.37% (0.2552 => 0.2689, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.99% (0.3008 => 0.3158, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.33% (0.3582 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.7226 => 0.7501, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.76% (1.1672 => 1.2111, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 3.68% (1.0046 => 1.0416, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3.66% (1.1653 => 1.2080, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 3.54% (15.3105 => 15.8524, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.48% (0.4596 => 0.4756, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 3.36% (0.6915 => 0.7147, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.35% (0.6173 => 0.6380, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 3.29% (29.3170 => 30.2822, std.dev.: 0.1589) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.2546 => 6.4589, std.dev.: 0.0475) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5740 => 0.5924, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.5150 => 1.5608, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.45% (0.5520 => 0.5655, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (12.6413 => 12.9217, std.dev.: 0.0610) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.86% (1.3935 => 1.4194, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8796 => 3.9480, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.71% (0.6069 => 0.6173, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.0758 => 3.1284, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (4.0318 => 4.0950, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.4408 => 1.4623, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (4.3380 => 4.4009, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.0317 => 2.0547, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.41% (0.0766 => 0.0930, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std.dev.: 0.0302) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.16% (4.0101 => 4.5781, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.74% (0.0917 => 0.1043, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 10.61% (0.1433 => 0.1585, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6104, std.dev.: 0.0421) SingleSource/Benchmarks/McGill/chomp: 7.07% (1.0194 => 1.0915, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.04% (1.0063 => 1.0771, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.98% (27.1724 => 28.7962, std.dev.: 0.1316) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 4.66% (0.9851 => 1.0310, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.69% (0.5587 => 0.5793, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: 3.68% (15.2242 => 15.7842, std.dev.: 0.0740) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.60% (3.0256 => 3.1345, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.93% (2.6656 => 2.7436, std.dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.71% (2.4042 => 2.4694, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/ReedSolomon: 2.48% (8.5113 => 8.7223, std.dev.: 0.0140) MultiSource/Benchmarks/BitBench/five11/five11: 2.33% (5.1938 => 5.3150, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.13% (0.5876 => 0.6001, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.66% (14.4877 => 14.7281, std.dev.: 0.0771) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (2.4455 => 2.4848, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5316, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.5166 => 2.5432, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.52% (5.2665 => 4.1331, std.dev.: 0.1093) SingleSource/Benchmarks/Shootout-C++/ary3: -20.50% (1.7473 => 1.3891, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.47% (1.1647 => 0.9379, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std.dev.: 0.0818) SingleSource/Benchmarks/Shootout-C++/moments: -10.77% (0.1114 => 0.0994, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5467, std.dev.: 0.2921) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.18% (2.4457 => 2.2456, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9447, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3669, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -6.97% (3.4230 => 3.1844, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7917, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -5.19% (1.4441 => 1.3692, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4096, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -4.12% (0.4296 => 0.4119, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.47% (1.7361 => 1.6759, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.31% (1.2722 => 1.2301, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -3.23% (7.6833 => 7.4349, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.21% (3.7496 => 3.6294, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/ffbench: -3.07% (1.4117 => 1.3684, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -3.01% (9.2503 => 8.9718, std.dev.: 0.0331) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.92% (1.2959 => 1.2581, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1353, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.73% (1.4021 => 1.3638, std.dev.: 0.0128) MultiSource/Applications/aha/aha: -2.71% (3.4286 => 3.3358, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.51% (45.4683 => 44.3287, std.dev.: 0.1774) MultiSource/Benchmarks/FreeBench/neural/neural: -2.08% (1.0926 => 1.0699, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.93% (2.8964 => 2.8404, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: -1.73% (3.4876 => 3.4271, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2286, std.dev.: 0.0143) MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (92.7467 => 91.2123, std.dev.: 0.2155) SingleSource/Benchmarks/Misc/oourafft: -1.44% (3.8200 => 3.7650, std.dev.: 0.0176) MultiSource/Benchmarks/sim/sim: -1.43% (3.8907 => 3.8351, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3069, std.dev.: 0.0806) MultiSource/Applications/lua/lua: -1.05% (29.5232 => 29.2124, std.dev.: 0.0691) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.67% (0.9980 => 0.9913, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 0.08% (0.6022 => 0.6027, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 0.66% (0.1666 => 0.1677, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.54% (0.1554 => 0.1578, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (0.3083 => 0.3167, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.38% (0.2394 => 0.2403, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (0.3175 => 0.3223, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.74% (0.2302 => 0.2262, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -23.33% (0.0240 => 0.0184, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.99% (0.0324 => 0.0256, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1429 => 0.1436, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -3.00% (1.5019 => 1.4568, std.dev.: 0.0235) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1501 => 0.1539, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.89% (0.4264 => 0.4013, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1344 => 0.1459, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.48% (0.0232 => 0.0254, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0639 => 0.0626, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.39% (1.1350 => 1.1508, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.79% (0.0637 => 0.0581, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.0246 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.53% (0.7541 => 0.7807, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.70% (1.5363 => 1.6085, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.43% (0.0070 => 0.0048, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 02:35:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 04:35:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914093509.DA0C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3792?compare_to=3789&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3792, Order: 163878, Start Time: 2012-09-14 08:16:22, End Time: 2012-09-14 09:36:29 To: 3789, Order: 163874, Start Time: 2012-09-14 06:25:03, End Time: 2012-09-14 07:47:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (114 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (734 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.09% (2.1319 => 2.1086, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5666 => 0.5674, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -0.14% (15.7882 => 15.7664, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: -0.40% (14.6511 => 14.5932, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: -0.97% (82.8504 => 82.0432, std.dev.: 0.0802) MultiSource/Benchmarks/MallocBench/gs/gs: -0.31% (4.3023 => 4.2890, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2181 => 1.2188, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.48% (7.3751 => 7.3397, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.83% (3.6683 => 3.6377, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.36% (0.6338 => 0.6315, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1428 => 0.1427, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (0.0684 => 0.0648, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.73% (63.2438 => 82.0432, std.dev.: 0.0802) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14242.50% (0.0720 => 10.3266, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.89% (10.3673 => 15.0213, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: 25.15% (0.1622 => 0.2030, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.56% (2.2022 => 2.5008, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.95% (7.0540 => 7.9674, std.dev.: 0.0944) SingleSource/Benchmarks/Misc/flops: 12.08% (0.1432 => 0.1605, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2502, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.49% (0.1566 => 0.1746, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.70% (1.7609 => 1.9317, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 8.83% (10.4361 => 11.3572, std.dev.: 0.0291) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3473 => 0.3772, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.59% (0.1584 => 0.1720, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.38% (0.3497 => 0.3790, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.33% (0.3516 => 0.3809, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.33% (0.3543 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3543 => 0.3838, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 8.28% (0.3561 => 0.3856, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.17% (0.3282 => 0.3550, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3694 => 0.3993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3828 => 0.4137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.3927 => 0.4240, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.75% (0.3886 => 0.4187, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 6.89% (0.1655 => 0.1769, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 6.59% (9.4845 => 10.1094, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.5860 => 0.6211, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7433 => 0.7877, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.89% (0.2700 => 0.2859, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.4615 => 0.4883, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 5.69% (0.7115 => 0.7520, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.63% (0.6675 => 0.7051, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.60% (0.2554 => 0.2697, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 5.55% (0.3423 => 0.3613, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (4.2646 => 4.4999, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.47% (5.7591 => 6.0740, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.3050 => 1.3762, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.42% (0.2065 => 0.2177, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.34% (8.1363 => 8.5707, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.5415 => 1.6235, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.26% (4.9449 => 5.2052, std.dev.: 0.0545) MultiSource/Applications/d/make_dparser: 5.24% (3.3354 => 3.5102, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.8172 => 0.8597, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.19% (0.5569 => 0.5858, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.06% (0.3121 => 0.3279, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.03% (0.8067 => 0.8473, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (5.0018 => 5.2532, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 4.96% (0.7835 => 0.8224, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 4.95% (0.3092 => 0.3245, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2758 => 0.2894, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9765 => 1.0245, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3441 => 0.3603, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.69% (1.1642 => 1.2188, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 4.61% (0.4299 => 0.4497, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 4.53% (0.3180 => 0.3324, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.5020 => 0.5241, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.39% (1.0722 => 1.1193, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (1.1861 => 1.2381, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 4.32% (3.8723 => 4.0396, std.dev.: 0.0159) SingleSource/UnitTests/ObjC++/Hello: 4.30% (0.5925 => 0.6180, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.30% (7.9617 => 8.3038, std.dev.: 0.0110) SingleSource/UnitTests/ObjC++/property-reference-object: 4.26% (0.6030 => 0.6287, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.25% (0.3387 => 0.3531, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1086, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.99% (1.5603 => 1.6225, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 3.88% (21.9371 => 22.7891, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8921 => 0.9264, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 3.80% (2.2969 => 2.3841, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 3.70% (0.6456 => 0.6695, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.66% (0.5981 => 0.6200, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.62% (0.3422 => 0.3546, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 3.59% (0.7326 => 0.7589, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.4103 => 0.4246, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.4064 => 0.4201, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.35% (1.5859 => 1.6390, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.4186 => 1.4658, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.15% (0.3650 => 0.3765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.10% (0.3865 => 0.3985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4289 => 0.4421, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (2.2024 => 2.2667, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3935 => 0.4048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3826 => 0.3934, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.1840 => 1.2153, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.49% (2.0665 => 2.1180, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.8101 => 0.8234, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2842 => 1.3015, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (1.1396 => 1.2162, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3469, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.34% (2.2771 => 2.3076, std.dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.92% (5.2763 => 3.2228, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.40% (5.3855 => 3.8559, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.99% (5.3526 => 3.8544, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0587, std.dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.14% (2.9384 => 2.5816, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -8.87% (22.1758 => 20.2094, std.dev.: 0.0351) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2776, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7169, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5841, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -3.14% (1.2373 => 1.1984, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5085, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4259, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0067, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9999, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5789, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0141) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.51% (0.5229 => 0.5674, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.18% (14.9895 => 15.7664, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 3.09% (14.1553 => 14.5932, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (4.1105 => 4.2890, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.32% (1.1048 => 1.2188, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.54% (7.1582 => 7.3397, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.05% (3.4629 => 3.6377, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (0.6222 => 0.6315, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 03:15:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 05:15:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914101559.C693C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3793?compare_to=3791&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3793, Order: 163880, Start Time: 2012-09-14 09:05:42, End Time: 2012-09-14 10:17:19 To: 3791, Order: 163878, Start Time: 2012-09-14 07:38:27, End Time: 2012-09-14 08:50:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (47 on baseline) Performance Improvements: 13 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 881 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.90% (4.7896 => 4.9287, std.dev.: 0.0206) MultiSource/Applications/lemon/lemon: 2.68% (1.0416 => 1.0695, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.43% (21.3046 => 22.4623, std.dev.: 0.3551) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (4.3479 => 4.5003, std.dev.: 0.0399) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.05% (41.9052 => 43.1850, std.dev.: 0.3549) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.54% (1.2581 => 1.2900, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (3.1844 => 3.2448, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.99% (0.4756 => 0.4376, std.dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.14% (0.3158 => 0.2964, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.75% (0.9272 => 0.8832, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.02% (0.5924 => 0.5686, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.46% (1.2111 => 1.1692, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.15% (0.5655 => 0.5477, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.94% (4.4009 => 4.2717, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.81% (0.7501 => 0.7290, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -2.71% (3.9480 => 3.8411, std.dev.: 0.0402) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.71% (6.4589 => 6.2841, std.dev.: 0.0335) MultiSource/Benchmarks/nbench/nbench: -1.67% (1.0948 => 1.0765, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.57% (1.4299 => 1.4075, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.47% (1.4194 => 1.3986, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.44% (0.9913 => 0.9869, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 0.37% (0.6027 => 0.6049, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/08-main/main: -1.61% (0.1677 => 0.1650, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.64% (0.1578 => 0.1489, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.57% (0.3167 => 0.3149, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.00% (0.2403 => 0.2379, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.22% (0.3223 => 0.3216, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.68% (0.2262 => 0.2300, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -0.88% (0.0454 => 0.0450, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -66.67% (0.0087 => 0.0029, std.dev.: 0.0031) SingleSource/UnitTests/2003-08-11-VaListArg: -7.69% (0.0091 => 0.0084, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 28.80% (0.0184 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.43% (0.0194 => 0.0166, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0391 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.23% (0.0297 => 0.0228, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.63% (0.0286 => 0.0227, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0256 => 0.0284, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -43.89% (0.0180 => 0.0101, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -1.55% (0.0194 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -8.10% (0.0247 => 0.0227, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -0.31% (0.0323 => 0.0322, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1436 => 0.1427, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.96% (1.4568 => 1.4283, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1539 => 0.1541, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.47% (0.4013 => 0.4072, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.21% (0.1459 => 0.1383, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.01% (0.0613 => 0.0570, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.20% (0.0254 => 0.0190, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.83% (0.0626 => 0.0577, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1508 => 1.1531, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.69% (0.0581 => 0.0585, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.45% (0.0264 => 0.0144, std.dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.37% (0.7807 => 0.7836, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -0.11% (1.6085 => 1.6067, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -50.00% (0.0002 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 152.08% (0.0048 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.01% (4.1772 => 3.0907, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/except: 81833.33% (0.0006 => 0.4916, std.dev.: 0.0023) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.46% (1.0046 => 1.0695, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.5309 => 0.5637, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.6410 => 0.6776, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 4.83% (2.1763 => 2.2814, std.dev.: 0.0192) MultiSource/Applications/SIBsim4/SIBsim4: 4.78% (1.1653 => 1.2210, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 4.03% (0.6915 => 0.7194, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.97% (0.6173 => 0.6418, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 3.95% (15.3105 => 15.9151, std.dev.: 0.1666) MultiSource/Applications/oggenc/oggenc: 3.86% (4.7455 => 4.9287, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.80% (0.3582 => 0.3718, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.7639 => 0.7842, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.3901 => 0.4001, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.56% (29.3170 => 30.0674, std.dev.: 0.2376) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5150 => 1.5505, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.31% (1.6538 => 2.3370, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/ary3: 15.28% (1.7426 => 2.0089, std.dev.: 0.0653) MultiSource/Applications/sgefa/sgefa: 14.23% (0.3746 => 0.4279, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.54% (4.0101 => 4.5532, std.dev.: 0.0563) SingleSource/Benchmarks/Stanford/Puzzle: 12.63% (0.1433 => 0.1614, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.45% (0.0917 => 0.1022, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.43% (0.2694 => 0.2948, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 8.96% (7.0025 => 7.6302, std.dev.: 0.0262) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.91% (0.2857 => 0.3083, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 7.25% (1.0194 => 1.0933, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.82% (4.2129 => 4.5003, std.dev.: 0.0399) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.68% (40.4792 => 43.1850, std.dev.: 0.3549) MultiSource/Benchmarks/nbench/nbench: 6.09% (21.1721 => 22.4623, std.dev.: 0.3551) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (27.1724 => 28.8194, std.dev.: 0.1589) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (0.3301 => 0.3491, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.79% (3.4080 => 3.5370, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 3.73% (15.2242 => 15.7926, std.dev.: 0.0661) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (6.6312 => 6.8776, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 3.19% (5.1938 => 5.3593, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7575, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.74% (2.6656 => 2.7387, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4856, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7230, std.dev.: 0.0169) MultiSource/Applications/siod/siod: 1.62% (3.5520 => 3.6095, std.dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 1.33% (2.5166 => 2.5500, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.16% (2.9152 => 2.9490, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.77% (0.2080 => 0.1960, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -2.86% (0.7738 => 0.7517, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (0.9029 => 0.8832, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.53% (4.3380 => 4.2717, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.24% (0.3497 => 0.2055, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.21% (5.2665 => 4.0967, std.dev.: 0.2582) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.42% (1.1647 => 0.9385, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1576, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.39% (62.4126 => 56.5516, std.dev.: 0.0782) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.32% (2.4457 => 2.2423, std.dev.: 0.0330) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.94% (3.2007 => 2.9466, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.19% (3.6254 => 3.3648, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -6.37% (1.4441 => 1.3521, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: -5.31% (1.4117 => 1.3368, std.dev.: 0.0163) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (3.4230 => 3.2448, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/misr: -4.61% (0.4296 => 0.4098, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -3.87% (0.2664 => 0.2561, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.40% (1.7361 => 1.6771, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -3.22% (9.2503 => 8.9525, std.dev.: 0.0443) MultiSource/Applications/lambda-0_1_3/lambda: -3.12% (7.6833 => 7.4435, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.06% (3.7496 => 3.6347, std.dev.: 0.0413) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4140 => 0.4017, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.93% (1.1683 => 1.1341, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8298, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0088) MultiSource/Applications/aha/aha: -2.54% (3.4286 => 3.3415, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.37% (1.2722 => 1.2420, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.31% (45.4683 => 44.4190, std.dev.: 0.4012) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.00% (2.8964 => 2.8384, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (92.7467 => 91.1057, std.dev.: 0.1698) SingleSource/Benchmarks/Shootout-C++/hash2: -1.76% (3.4876 => 3.4263, std.dev.: 0.0208) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2246, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3080, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: -1.38% (3.8200 => 3.7673, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.11% (0.9980 => 0.9869, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 0.45% (0.6022 => 0.6049, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/08-main/main: -0.96% (0.1666 => 0.1650, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.18% (0.1554 => 0.1489, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.3083 => 0.3149, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.63% (0.2394 => 0.2379, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (0.3175 => 0.3216, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.09% (0.2302 => 0.2300, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -67.42% (0.0089 => 0.0029, std.dev.: 0.0031) SingleSource/UnitTests/2003-08-11-VaListArg: -6.67% (0.0090 => 0.0084, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.54% (0.0192 => 0.0166, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.25% (0.0301 => 0.0228, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.07% (0.0284 => 0.0227, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.35% (0.0324 => 0.0284, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -42.94% (0.0177 => 0.0101, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -8.84% (0.0249 => 0.0227, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1429 => 0.1427, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -4.90% (1.5019 => 1.4283, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.66% (0.1501 => 0.1541, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.50% (0.4264 => 0.4072, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.90% (0.1344 => 0.1383, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.23% (0.0589 => 0.0570, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.10% (0.0232 => 0.0190, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.70% (0.0639 => 0.0577, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.59% (1.1350 => 1.1531, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.16% (0.0637 => 0.0585, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.46% (0.0246 => 0.0144, std.dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.91% (0.7541 => 0.7836, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.58% (1.5363 => 1.6067, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 03:22:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 05:22:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914102249.320602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3794?compare_to=3790&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3794, Order: 163880, Start Time: 2012-09-14 09:09:35, End Time: 2012-09-14 10:24:08 To: 3790, Order: 163878, Start Time: 2012-09-14 07:19:57, End Time: 2012-09-14 08:34:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.62% (27.6110 => 29.4398, std.dev.: 0.1069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.56% (2.0176 => 2.4122, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.63% (3.9660 => 4.3480, std.dev.: 0.0089) MultiSource/Applications/hbd/hbd: 9.46% (1.3693 => 1.4988, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.43% (0.7038 => 0.7702, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.00% (0.7710 => 0.8404, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5265 => 0.5734, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.84% (1.2193 => 1.3271, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.84% (0.9199 => 1.0012, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.41% (1.1364 => 1.2320, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.4563 => 1.5777, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 8.11% (13.8202 => 14.9415, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.03% (0.5577 => 0.6025, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.85% (0.6283 => 0.6776, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.75% (1.0313 => 1.1112, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.69% (0.7061 => 0.7604, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 7.59% (1.1061 => 1.1901, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.49% (0.4791 => 0.5150, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2760 => 0.2963, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.4379 => 0.4701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.34% (0.5818 => 0.6245, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5748 => 0.6166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.18% (0.8310 => 0.8907, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 7.14% (3.8646 => 4.1405, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.13% (0.5637 => 0.6039, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.12% (7.2180 => 7.7320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.01% (1.9828 => 2.1218, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.98% (0.7506 => 0.8030, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3756 => 0.4018, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.91% (3.6692 => 3.9227, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.2925 => 0.3125, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3868 => 0.4128, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.61% (0.6576 => 0.7011, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.61% (2.1791 => 2.3231, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.48% (0.6744 => 0.7181, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.48% (1.3245 => 1.4103, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.46% (3.1889 => 3.3948, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.42% (0.3534 => 0.3761, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.38% (1.9270 => 2.0499, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (1.3819 => 1.4686, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.25% (1.2749 => 1.3546, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.25% (1.3813 => 1.4676, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.24% (1.0594 => 1.1255, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.88% (14.8535 => 15.7271, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 5.83% (16.6129 => 17.5813, std.dev.: 0.0262) MultiSource/Benchmarks/mafft/pairlocalalign: 5.82% (8.4961 => 8.9903, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (13.2842 => 14.0457, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/trivial-interface: 5.67% (0.3578 => 0.3781, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3914 => 0.4136, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3646 => 0.3851, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.62% (0.4003 => 0.4228, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.60% (4.3801 => 4.6256, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.2859 => 0.3019, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.55% (0.3601 => 0.3801, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.54% (0.3789 => 0.3999, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 5.53% (0.3131 => 0.3304, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.51% (0.6135 => 0.6473, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 5.49% (0.3663 => 0.3864, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.43% (14.5298 => 15.3194, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.41% (4.4433 => 4.6838, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.40% (0.3650 => 0.3847, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.33% (0.3623 => 0.3816, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.30% (0.3940 => 0.4149, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1333 => 1.1934, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.25% (0.3755 => 0.3952, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.24% (0.8818 => 0.9280, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9026, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.66% (3.2742 => 3.4268, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 4.63% (4.6629 => 4.8789, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 4.50% (1.2292 => 1.2845, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.27% (4.9865 => 5.1994, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4805 => 0.5009, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.16% (3.7467 => 3.9024, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (1.5188 => 1.5810, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.08% (0.6250 => 0.6505, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.1007 => 2.1785, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5066, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 2.86% (33.2944 => 34.2458, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5873, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 25.29% (1.8175 => 2.2771, std.dev.: 0.0427) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.2093 => 0.2247, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6971, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5458, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.12% (10.7476 => 11.0831, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5915, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.18% (7.9275 => 8.0214, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5927, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6849, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.24% (0.4657 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.65% (22.5627 => 21.7399, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2785, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.83% (1.3780 => 1.2977, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.64% (1.7688 => 1.7045, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9223, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5896, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.35% (0.6589 => 0.6434, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -2.22% (26.5159 => 25.9285, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2394, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2363, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.21% (4.1080 => 4.0581, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2595, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4342, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5639, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 03:23:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 05:23:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914102317.C3C152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3795?compare_to=3787&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3795, Order: 163878, Start Time: 2012-09-14 07:40:43, End Time: 2012-09-14 10:24:37 To: 3787, Order: 163870, Start Time: 2012-09-14 04:27:16, End Time: 2012-09-14 07:12:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (116 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.97% (0.2143 => 0.2271, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.09% (125.5393 => 130.6780, std.dev.: 0.5947) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.17% (2.0445 => 2.0888, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3465 => 0.3791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.38% (0.3496 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.38% (0.3488 => 0.3815, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 9.37% (0.3446 => 0.3769, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3442 => 0.3764, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.28% (0.3469 => 0.3791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.28% (0.3460 => 0.3781, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.07% (0.3650 => 0.3981, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.00% (0.3643 => 0.3971, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.81% (0.3724 => 0.4052, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.49% (1.5932 => 1.6966, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (1.6211 => 1.7139, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (0.4361 => 0.4606, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.49% (5.5417 => 5.8459, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (1.3152 => 1.3869, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.42% (3.5627 => 3.7558, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 5.29% (0.5826 => 0.6134, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 5.18% (0.5889 => 0.6194, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.08% (2.7292 => 2.8678, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.73% (0.3004 => 0.3146, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.71% (1.0781 => 1.1289, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.71% (4.2109 => 4.4091, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.63% (0.3195 => 0.3343, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (0.5000 => 0.5229, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.45% (0.2875 => 0.3003, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (4.4195 => 4.6148, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 4.36% (4.6177 => 4.8192, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 4.36% (23.5202 => 24.5452, std.dev.: 0.0100) MultiSource/Applications/siod/siod: 4.33% (0.6634 => 0.6921, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (2.1013 => 2.1910, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.3903 => 0.4069, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (1.8794 => 1.9592, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (0.5026 => 0.5239, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.4139 => 0.4313, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 4.19% (0.2813 => 0.2931, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.19% (0.4029 => 0.4198, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2823 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.15% (2.0673 => 2.1530, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.5900 => 0.6144, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.13% (0.3317 => 0.3454, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.13% (0.9909 => 1.0318, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference: 4.11% (0.7171 => 0.7466, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (2.1653 => 2.2542, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.08% (0.3060 => 0.3185, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.05% (0.4251 => 0.4423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.2780 => 0.2892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (0.3625 => 0.3770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.99% (0.3362 => 0.3496, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.96% (0.3084 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.95% (0.2811 => 0.2922, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.95% (1.4269 => 1.4832, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.93% (0.5546 => 0.5764, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.91% (0.3348 => 0.3479, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.89% (0.3678 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2911 => 0.3024, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.84% (0.3336 => 0.3464, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.79% (0.6435 => 0.6679, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3282 => 0.3406, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.77% (0.3477 => 0.3608, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.74% (0.3690 => 0.3828, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.3981 => 0.4125, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.60% (0.9697 => 1.0046, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.49% (0.5012 => 0.5187, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.49% (2.0346 => 2.1056, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.3271 => 0.3385, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.3845 => 0.3972, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.30% (1.9694 => 2.0344, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.22% (0.7426 => 0.7665, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.21% (1.9966 => 2.0606, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.06% (0.5361 => 0.5525, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (0.5584 => 0.5737, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (11.6398 => 11.9181, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.37% (4.6926 => 4.8038, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.34% (0.2162 => 0.3553, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6768, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-2: 4.33% (1.8057 => 1.8838, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6236, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2002, std.dev.: 0.0445) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5051, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2261, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4437, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5917, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5623, std.dev.: 0.0212) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7949, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9600) SingleSource/Benchmarks/Shootout-C++/ary2: -5.45% (0.2402 => 0.2271, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7752, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7642, std.dev.: 0.0733) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9619, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 04:29:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 06:29:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914112942.961142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3796?compare_to=3792&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3796, Order: 163884, Start Time: 2012-09-14 10:11:39, End Time: 2012-09-14 11:31:01 To: 3792, Order: 163878, Start Time: 2012-09-14 08:16:22, End Time: 2012-09-14 09:36:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (4 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (125 on baseline) Performance Improvements: 9 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (718 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 0.22% (20.2094 => 20.2529, std.dev.: 0.0119) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1693 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.49% (3.2228 => 3.2709, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.45% (8.3038 => 8.4238, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.44% (1.9317 => 1.9596, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.27% (1.6225 => 1.6431, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.18% (10.1094 => 10.2285, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.17% (54.4120 => 56.1357, std.dev.: 0.0830) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.78% (1.2502 => 1.1404, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.57% (3.8544 => 3.6013, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.44% (3.8559 => 3.6077, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -2.27% (11.3572 => 11.0989, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.16% (14.8293 => 14.6580, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.67% (0.0995 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.36% (0.9961 => 0.9527, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: -3.61% (12.5641 => 12.1108, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -2.14% (0.5464 => 0.5347, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.26% (0.5674 => 0.5689, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.68% (15.7664 => 15.8738, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 0.41% (14.5932 => 14.6534, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 0.57% (82.0432 => 82.5137, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: -0.07% (4.2890 => 4.2858, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.23% (1.2188 => 1.2216, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.87% (7.3397 => 7.4034, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.55% (3.6377 => 3.6577, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.87% (0.6315 => 0.6370, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.35% (0.1427 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/Bullet/bullet MultiSource/Applications/ClamAV/clamscan: -8.67% (22.1758 => 20.2529, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: 30.47% (63.2438 => 82.5137, std.dev.: 0.0167) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/Bullet/bullet MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14257.50% (0.0720 => 10.3374, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.79% (10.3673 => 14.9069, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 14.39% (0.1432 => 0.1638, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.80% (7.0540 => 8.0276, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.60% (2.2022 => 2.5017, std.dev.: 0.0165) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (1.7609 => 1.9596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3543 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.20% (0.3282 => 0.3584, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 9.20% (0.3543 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.18% (0.3561 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.15% (0.3497 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3516 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.93% (0.3694 => 0.4024, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.83% (0.3828 => 0.4166, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.81% (0.3927 => 0.4273, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.67% (0.3886 => 0.4223, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.84% (9.4845 => 10.2285, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.58% (0.4879 => 0.5249, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4615 => 0.4922, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 6.63% (0.3109 => 0.3315, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2554 => 0.2717, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (1.5415 => 1.6397, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.7433 => 0.7906, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.35% (10.4361 => 11.0989, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.31% (1.3050 => 1.3874, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.13% (0.6675 => 0.7084, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.08% (0.3423 => 0.3631, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (8.1363 => 8.6295, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.04% (0.2700 => 0.2863, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.96% (0.5860 => 0.6209, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (4.2646 => 4.5174, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.92% (5.7591 => 6.0999, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.86% (0.8172 => 0.8651, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.83% (3.3354 => 3.5298, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (7.9617 => 8.4238, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.69% (4.9449 => 5.2265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.69% (0.9765 => 1.0321, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5569 => 0.5885, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (5.0018 => 5.2855, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.52% (0.5105 => 0.5387, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.43% (0.3387 => 0.3571, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.42% (0.8067 => 0.8504, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.32% (0.7835 => 0.8252, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.31% (1.5603 => 1.6431, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.18% (0.2758 => 0.2901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.16% (0.5925 => 0.6231, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.3180 => 0.3344, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.11% (0.6030 => 0.6338, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.96% (1.1642 => 1.2220, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 4.85% (0.3092 => 0.3242, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.79% (1.0722 => 1.1236, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.77% (0.3441 => 0.3605, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5020 => 0.5259, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.72% (3.8723 => 4.0549, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.59% (1.1861 => 1.2406, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 4.46% (0.6456 => 0.6744, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.45% (0.3307 => 0.3454, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.38% (0.7326 => 0.7647, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8921 => 0.9311, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.22% (21.9371 => 22.8632, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6450 => 0.6720, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.16% (2.0273 => 2.1116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3422 => 0.3562, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5981 => 0.6225, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.01% (2.2969 => 2.3889, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.4064 => 0.4226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.86% (0.3650 => 0.3791, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3826 => 0.3970, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.5859 => 1.6453, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.68% (0.4289 => 0.4447, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.58% (1.4186 => 1.4694, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.50% (0.4203 => 0.4350, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4636 => 0.4798, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.1840 => 1.2238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.4048 => 0.4182, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.26% (0.3098 => 0.3199, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2738, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (2.0665 => 2.1322, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.8101 => 0.8290, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (14.3668 => 14.6580, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.88% (1.1194 => 1.1404, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 1.67% (1.2842 => 1.3057, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.8922 => 3.9321, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.77% (1.1396 => 1.2168, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (4.2280 => 4.3639, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7947, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2221, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.01% (5.2763 => 3.2709, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.01% (5.3855 => 3.6077, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.72% (5.3526 => 3.6013, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1630, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.88% (2.9384 => 2.5893, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2672, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (2.7294 => 2.5709, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.88% (5.0483 => 4.8021, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5051, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -3.02% (1.2373 => 1.1999, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -2.90% (12.4730 => 12.1108, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4340, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0053, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0110, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2245, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.01% (2.9346 => 2.9049, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.80% (0.5229 => 0.5689, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.90% (14.9895 => 15.8738, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 3.52% (14.1553 => 14.6534, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (4.1105 => 4.2858, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.57% (1.1048 => 1.2216, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (7.1582 => 7.4034, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.63% (3.4629 => 3.6577, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.6222 => 0.6370, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 04:43:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 06:43:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914114352.8ED912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3797?compare_to=3793&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3797, Order: 163886, Start Time: 2012-09-14 10:33:20, End Time: 2012-09-14 11:45:13 To: 3793, Order: 163880, Start Time: 2012-09-14 09:05:42, End Time: 2012-09-14 10:17:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 1 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (42 on baseline) Performance Improvements: 10 (43 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 884 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -0.16% (14.7615 => 14.7372, std.dev.: 0.0889) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 10.86% (0.1353 => 0.1500, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.89% (0.9385 => 1.1158, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.21% (2.4368 => 2.6612, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.40% (60.2560 => 61.7038, std.dev.: 0.0534) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (56.5516 => 57.5695, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.67% (1.6065 => 1.6333, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.57% (0.2960 => 0.1611, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.83% (1.4075 => 1.1143, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.12% (1.4174 => 1.1322, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -2.93% (4.9287 => 4.7844, std.dev.: 0.0491) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.47% (0.7290 => 0.7183, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.27% (15.8102 => 13.3965, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/ary3: -6.92% (1.4952 => 1.3917, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/flops: -5.84% (9.2842 => 8.7422, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: -1.75% (3.2448 => 3.1880, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (1.1207 => 1.1019, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.42% (0.9869 => 0.9910, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: -1.07% (0.6049 => 0.5984, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 0.55% (0.1650 => 0.1659, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.22% (0.1489 => 0.1522, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.84% (0.3149 => 0.3028, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.25% (0.2379 => 0.2278, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.30% (0.3216 => 0.3142, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2300 => 0.2293, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -6.89% (0.0450 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 196.55% (0.0029 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 5.95% (0.0084 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.59% (0.0237 => 0.0219, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.13% (0.0166 => 0.0111, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.88% (0.0386 => 0.0344, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.39% (0.0228 => 0.0295, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 23.79% (0.0227 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.32% (0.0284 => 0.0319, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 74.26% (0.0101 => 0.0176, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -1.57% (0.0191 => 0.0188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 7.93% (0.0227 => 0.0245, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -9.32% (0.0322 => 0.0292, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1427 => 0.0001) MultiSource/Applications/lemon/lemon: 3.23% (1.4283 => 1.4745, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -9.86% (0.1541 => 0.1389, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.89% (0.4072 => 0.4149, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.72% (0.1383 => 0.1476, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.54% (0.0570 => 0.0613, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.47% (0.0190 => 0.0227, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0577 => 0.0586, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1531 => 1.1518, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0016 => 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.89% (0.0585 => 0.0533, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.06% (0.0144 => 0.0170, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7836 => 0.7812, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0002 => 0.0005) SingleSource/Regression/C/uint64_to_float: -21.02% (1.6067 => 1.2690, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -63.64% (0.0121 => 0.0044, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 0.89% (14.6079 => 14.7372, std.dev.: 0.0889) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.48% (4.1772 => 3.0709, std.dev.: 0.0589) SingleSource/Benchmarks/Shootout-C++/except: 82366.67% (0.0006 => 0.4948, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.78% (0.0745 => 0.0870, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.5309 => 0.5640, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.37% (0.6410 => 0.6754, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 5.36% (2.1763 => 2.2930, std.dev.: 0.0308) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3582 => 0.3720, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 3.62% (1.0046 => 1.0410, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 3.44% (1.1653 => 1.2054, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5150 => 1.5548, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.55% (0.7639 => 0.7834, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 2.14% (29.3170 => 29.9456, std.dev.: 0.1966) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (1.3935 => 1.4215, std.dev.: 0.0107) MultiSource/Applications/hbd/hbd: 1.35% (1.3268 => 1.3447, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.01% (0.0263 => 0.0384, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std.dev.: 0.0228) MultiSource/Benchmarks/nbench/nbench: 15.70% (21.1721 => 24.4966, std.dev.: 1.2451) SingleSource/Benchmarks/Shootout/ary3: 15.22% (1.7426 => 2.0079, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.46% (4.0101 => 4.5901, std.dev.: 0.0358) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3746 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.69% (2.4042 => 2.6612, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout/lists: 8.89% (7.0025 => 7.6251, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.57% (0.2694 => 0.2925, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 8.51% (0.1433 => 0.1555, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.04% (1.0063 => 1.0872, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.97% (0.2857 => 0.3056, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.79% (4.2129 => 4.4990, std.dev.: 0.0742) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8128, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/dt: 3.94% (0.9851 => 1.0239, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5367, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8718, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: 3.45% (15.2242 => 15.7499, std.dev.: 0.0793) MultiSource/Benchmarks/Olden/power/power: 3.20% (1.4184 => 1.4638, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.10% (0.5876 => 0.6058, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.02% (2.6656 => 2.7461, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.84% (6.9722 => 7.1703, std.dev.: 0.0577) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.6308 => 0.6471, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 2.31% (3.5520 => 3.6339, std.dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: 1.78% (14.4877 => 14.7449, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (2.4971 => 2.5334, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.38% (1.6110 => 1.6333, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.23% (0.2996 => 0.1611, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.47% (1.4189 => 1.1143, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.78% (1.4113 => 1.1322, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.38% (0.2142 => 0.1984, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (0.9029 => 0.8832, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.35% (4.3380 => 4.2793, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.21% (0.3497 => 0.2056, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.62% (5.2665 => 4.1277, std.dev.: 0.0829) SingleSource/Benchmarks/Shootout-C++/ary3: -20.35% (1.7473 => 1.3917, std.dev.: 0.0310) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.38% (15.8312 => 13.3965, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1628, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -8.43% (9.5474 => 8.7422, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -7.76% (62.4126 => 57.5695, std.dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.36% (2.4457 => 2.2657, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3658, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: -6.87% (3.4230 => 3.1880, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3516, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.97% (4.6355 => 4.4050, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.20% (1.1647 => 1.1158, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.4140 => 0.3982, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.56% (1.7361 => 1.6743, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -3.52% (9.2503 => 8.9250, std.dev.: 0.0495) MultiSource/Applications/lambda-0_1_3/lambda: -3.41% (7.6833 => 7.4215, std.dev.: 0.0298) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.12% (1.1683 => 1.1319, std.dev.: 0.0070) MultiSource/Applications/aha/aha: -2.86% (3.4286 => 3.3305, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0153) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.40% (3.7496 => 3.6596, std.dev.: 0.0160) MultiSource/Benchmarks/sim/sim: -2.40% (3.8907 => 3.7974, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4213, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.80% (1.8739 => 1.8402, std.dev.: 0.0118) MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (92.7467 => 91.1182, std.dev.: 0.2182) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3150, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.35% (2.8964 => 2.8574, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.25% (9.3855 => 9.2679, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/lists: -1.07% (16.5617 => 16.3848, std.dev.: 0.0679) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.70% (0.9980 => 0.9910, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6022 => 0.5984, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1666 => 0.1659, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.06% (0.1554 => 0.1522, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.78% (0.3083 => 0.3028, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.85% (0.2394 => 0.2278, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (0.3175 => 0.3142, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -6.68% (0.0449 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.75% (0.0240 => 0.0219, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -42.19% (0.0192 => 0.0111, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.79% (0.0390 => 0.0344, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -10.15% (0.0325 => 0.0292, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1429 => 0.0001) MultiSource/Applications/lemon/lemon: -1.82% (1.5019 => 1.4745, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -7.46% (0.1501 => 0.1389, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.70% (0.4264 => 0.4149, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1344 => 0.1476, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.16% (0.0232 => 0.0227, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.29% (0.0639 => 0.0586, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.48% (1.1350 => 1.1518, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.33% (0.0637 => 0.0533, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.89% (0.0246 => 0.0170, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.59% (0.7541 => 0.7812, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -17.40% (1.5363 => 1.2690, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.14% (0.0070 => 0.0044, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 05:05:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 07:05:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914120540.D91942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3798?compare_to=3794&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3798, Order: 163886, Start Time: 2012-09-14 10:52:34, End Time: 2012-09-14 12:07:00 To: 3794, Order: 163880, Start Time: 2012-09-14 09:09:35, End Time: 2012-09-14 10:24:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 2 (2 on baseline) Performance Regressions: 2 (162 on baseline) Performance Improvements: 10 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 956 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -0.16% (15.3194 => 15.2942, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1572 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.84% (0.6245 => 0.6360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.50% (0.7604 => 0.7718, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.53% (0.2517 => 0.1371, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.83% (1.4686 => 1.1921, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.76% (1.4676 => 1.1923, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.52% (14.0457 => 13.8317, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.38% (0.0994 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.33% (0.9962 => 0.9531, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -3.72% (12.5458 => 12.0794, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.1048 => 27.7416, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.14% (2.3178 => 2.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.02% (7.2363 => 7.1624, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 5.26% (14.5298 => 15.2942, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1519 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.20% (2.0176 => 2.4049, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.81% (1.3693 => 1.5036, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.65% (3.9660 => 4.3487, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (0.7710 => 0.8442, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.36% (0.2596 => 0.2839, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.30% (0.7061 => 0.7718, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.17% (1.4563 => 1.5898, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.16% (0.9199 => 1.0042, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 9.08% (0.7038 => 0.7677, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 9.03% (0.4328 => 0.4719, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.03% (1.2193 => 1.3294, std.dev.: 0.0083) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.66% (0.5265 => 0.5721, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.58% (0.6959 => 0.7556, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 8.49% (0.4062 => 0.4407, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.44% (0.2655 => 0.2879, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.39% (1.1364 => 1.2318, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.3899 => 0.4219, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.12% (0.2782 => 0.3008, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.05% (13.8202 => 14.9329, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.98% (0.3485 => 0.3763, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3022 => 0.3263, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.6283 => 0.6782, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2760 => 0.2978, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.89% (0.5577 => 0.6017, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.86% (0.2966 => 0.3199, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hello: 7.83% (0.2607 => 0.2811, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.74% (0.4390 => 0.4730, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.72% (0.4379 => 0.4717, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.3756 => 0.4045, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 7.69% (1.0313 => 1.1106, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3580 => 0.3855, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.68% (0.3489 => 0.3757, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.67% (1.9828 => 2.1349, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.67% (0.2765 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.62% (0.3293 => 0.3544, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2761 => 0.2971, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3149 => 0.3388, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 7.57% (0.2628 => 0.2827, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.53% (0.3107 => 0.3341) SingleSource/Benchmarks/Shootout-C++/matrix: 7.53% (0.2988 => 0.3213, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.50% (0.4016 => 0.4317, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 7.43% (0.7506 => 0.8064, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.32% (1.1061 => 1.1871, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.31% (0.2995 => 0.3214, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.31% (0.2696 => 0.2893, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.3868 => 0.4148, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3192 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.21% (0.3453 => 0.3702, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (7.2180 => 7.7361, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.11% (0.8310 => 0.8901, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.05% (0.4791 => 0.5129, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.02% (3.6692 => 3.9267, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists1: 7.02% (0.3534 => 0.3782, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.69% (3.8646 => 4.1233, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.65% (0.7460 => 0.7956, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3971, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.41% (2.1791 => 2.3188, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.36% (0.6744 => 0.7173, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 6.34% (1.9270 => 2.0492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.27% (0.4003 => 0.4254, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.26% (0.3578 => 0.3802, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.26% (1.3245 => 1.4074, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 6.25% (0.3663 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.25% (0.6576 => 0.6987, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.0594 => 1.1252, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.20% (0.3646 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.16% (0.3914 => 0.4155, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.09% (0.8698 => 0.9228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.08% (0.3650 => 0.3872, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 6.07% (0.3131 => 0.3321, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 6.07% (16.6129 => 17.6208, std.dev.: 0.0322) SingleSource/UnitTests/ObjC/property: 6.07% (0.3940 => 0.4179, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (1.2749 => 1.3520, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 5.99% (0.3623 => 0.3840, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.98% (14.8535 => 15.7415, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.81% (0.3755 => 0.3973, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (8.4961 => 8.9880, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.3801 => 4.6318, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.66% (0.8818 => 0.9317, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6939, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.57% (0.6135 => 0.6477, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.15% (1.1333 => 1.1917, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 5.11% (0.2859 => 0.3005, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2292 => 1.2890, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.62% (4.6629 => 4.8783, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2321 => 0.2427, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.2742 => 3.4212, std.dev.: 0.0147) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (6.5754 => 6.8689, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.29% (0.9108 => 0.9499, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6250 => 0.6518, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.27% (0.4805 => 0.5010, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (13.2842 => 13.8317, std.dev.: 0.0125) MultiSource/Applications/lua/lua: 4.01% (3.7467 => 3.8971, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1866, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.5188 => 1.5796, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (6.2785 => 6.5144, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (2.1007 => 2.1796, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.3245 => 0.3366, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.28% (33.2944 => 34.0548, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.90% (16.2614 => 16.5706, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std.dev.: 0.0434) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.88% (1.0895 => 1.3497, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4159, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7041, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0795, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5935, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5894, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.02% (7.9275 => 8.0084, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -48.65% (0.2670 => 0.1371, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.73% (1.3819 => 1.1921, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.68% (1.3813 => 1.1923, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.84% (22.5627 => 21.6972, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2524, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2926, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.65% (0.9996 => 0.9531, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.88% (3.0263 => 2.9392, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5903, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -2.29% (7.3305 => 7.1624, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2397, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7416, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1047, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0594, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2346, std.dev.: 0.0203) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2600, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 06:10:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 08:10:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914131044.778B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3799?compare_to=3797&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3799, Order: 163898, Start Time: 2012-09-14 12:00:58, End Time: 2012-09-14 13:12:04 To: 3797, Order: 163886, Start Time: 2012-09-14 10:33:20, End Time: 2012-09-14 11:45:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 1 (10 on baseline) Performance Regressions: 9 (41 on baseline) Performance Improvements: 7 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 884 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -0.10% (14.7372 => 14.7219, std.dev.: 0.1619) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 87.21% (0.1611 => 0.3016, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.79% (1.1143 => 1.4017, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.70% (1.1322 => 1.4005, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.30% (0.4169 => 0.4515, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.74% (13.3965 => 16.4434, std.dev.: 0.6909) SingleSource/Benchmarks/Misc/flops: 6.30% (8.7422 => 9.2928, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.42% (0.7755 => 0.7943, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: 2.28% (2.3456 => 2.3990, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1019 => 1.1192, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.93% (1.1158 => 0.9381, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.88% (2.6612 => 2.4781, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.95% (0.6152 => 0.6032, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.75% (57.5695 => 56.5601, std.dev.: 0.0343) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.1703 => 7.0618, std.dev.: 0.0295) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6333 => 1.6119, std.dev.: 0.0055) MultiSource/Applications/lua/lua: -1.22% (29.8163 => 29.4528, std.dev.: 0.1348) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.94% (0.9910 => 0.9817, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 0.52% (0.5984 => 0.6015, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -2.53% (0.1659 => 0.1617, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.92% (0.1522 => 0.1508, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.42% (0.3028 => 0.3071, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.29% (0.2278 => 0.2353, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.64% (0.3142 => 0.3162, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.49% (0.2293 => 0.2213, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 6.21% (0.0419 => 0.0445, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0086 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.76% (0.0219 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 70.27% (0.0111 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.63% (0.0344 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0295 => 0.0295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.05% (0.0281 => 0.0264, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.63% (0.0319 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.57% (0.0176 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -21.28% (0.0188 => 0.0148, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -0.82% (0.0245 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 10.27% (0.0292 => 0.0322, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 143600.00% (0.0001 => 0.1437, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -3.15% (1.4745 => 1.4280, std.dev.: 0.0476) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 10.73% (0.1389 => 0.1538, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.70% (0.4149 => 0.4037, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.17% (0.1476 => 0.1385, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.99% (0.0613 => 0.0564, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.55% (0.0227 => 0.0169, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.41% (0.0586 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1518 => 1.1485, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.32% (0.0533 => 0.0556, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.12% (0.0170 => 0.0146, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7812 => 0.7810, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 26.81% (1.2690 => 1.6092, std.dev.: 0.0144) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 175.00% (0.0044 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.86% (4.1772 => 3.0969, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.56% (0.1414 => 0.1535, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.5309 => 0.5622, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 5.68% (2.1763 => 2.2999, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.41% (0.6410 => 0.6757, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 3.84% (0.6173 => 0.6410, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.1653 => 1.2057, std.dev.: 0.0074) MultiSource/Applications/hbd/hbd: 2.64% (1.3268 => 1.3618, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5150 => 1.5549, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.7639 => 0.7784, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.60% (1.1827 => 1.2016, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.17% (3.4629 => 4.2306, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 14.88% (1.7426 => 2.0019, std.dev.: 0.0353) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.40% (4.0101 => 4.5876, std.dev.: 0.0602) MultiSource/Applications/sgefa/sgefa: 14.26% (0.3746 => 0.4280, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.64% (3.0256 => 3.3474, std.dev.: 0.0862) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.06% (0.2694 => 0.2965, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 8.93% (0.1433 => 0.1561, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 8.70% (7.0025 => 7.6117, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.83% (1.0063 => 1.0851, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.77% (0.2857 => 0.3079, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 7.01% (1.0194 => 1.0909, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.91% (0.3301 => 0.3529, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8069, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.39% (0.7609 => 0.7943, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8567, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/ReedSolomon: 3.88% (8.5113 => 8.8412, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (2.4042 => 2.4781, std.dev.: 0.0208) MultiSource/Benchmarks/BitBench/five11/five11: 2.77% (5.1938 => 5.3375, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/hash: 2.57% (0.6308 => 0.6470, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 2.29% (2.3453 => 2.3990, std.dev.: 0.0096) MultiSource/Applications/siod/siod: 1.93% (3.5520 => 3.6205, std.dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 1.72% (14.4877 => 14.7370, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5352, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 1.29% (6.9722 => 7.0618, std.dev.: 0.0295) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.54% (0.7738 => 0.7619, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.61% (0.3497 => 0.2112, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.30% (5.2665 => 4.1449, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/ary3: -20.31% (1.7473 => 1.3925, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.46% (1.1647 => 0.9381, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1606, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -9.38% (62.4126 => 56.5601, std.dev.: 0.0343) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.54% (1.4034 => 1.2836, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.33% (2.4457 => 2.2419, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.63% (3.2007 => 2.9566, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3638, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -6.58% (3.4230 => 3.1976, std.dev.: 0.0510) SingleSource/Benchmarks/Misc/richards_benchmark: -6.23% (1.4441 => 1.3542, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -5.10% (1.4117 => 1.3397, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4085, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (9.2503 => 8.9109, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.64% (1.7361 => 1.6729, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -3.36% (7.6833 => 7.4254, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8297, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1353, std.dev.: 0.0126) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.67% (9.5474 => 9.2928, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -2.57% (3.4286 => 3.3405, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.17% (3.7496 => 3.6684, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.80% (3.8907 => 3.8208, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2276, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.8964 => 2.8492, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.50% (92.7467 => 91.3560, std.dev.: 0.4907) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3216, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/oourafft: -1.25% (3.8200 => 3.7724, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: -1.18% (16.5617 => 16.3663, std.dev.: 0.0629) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.63% (0.9980 => 0.9817, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -0.12% (0.6022 => 0.6015, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -2.94% (0.1666 => 0.1617, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.96% (0.1554 => 0.1508, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (0.3083 => 0.3071, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.71% (0.2394 => 0.2353, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (0.3175 => 0.3162, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.87% (0.2302 => 0.2213, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -0.89% (0.0449 => 0.0445, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.67% (0.0240 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.04% (0.0284 => 0.0264, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -21.69% (0.0189 => 0.0148, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -4.92% (1.5019 => 1.4280, std.dev.: 0.0476) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.47% (0.1501 => 0.1538, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.32% (0.4264 => 0.4037, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.05% (0.1344 => 0.1385, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.0589 => 0.0564, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.16% (0.0232 => 0.0169, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.19% (1.1350 => 1.1485, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.72% (0.0637 => 0.0556, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.65% (0.0246 => 0.0146, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.57% (0.7541 => 0.7810, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.75% (1.5363 => 1.6092, std.dev.: 0.0144) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 06:17:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 08:17:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914131737.E00BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3800?compare_to=3796&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3800, Order: 163897, Start Time: 2012-09-14 11:59:19, End Time: 2012-09-14 13:18:56 To: 3796, Order: 163884, Start Time: 2012-09-14 10:11:39, End Time: 2012-09-14 11:31:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 2 (1 on baseline) Performance Regressions: 9 (131 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 938 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 0.09% (20.2529 => 20.2717, std.dev.: 0.0116) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 169200.00% (0.0001 => 0.1693, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.33% (1.1404 => 1.2582, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.74% (3.6013 => 3.8799, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.66% (3.6077 => 3.8841, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (11.0989 => 11.4472, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (14.6580 => 14.8366, std.dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.83% (0.0859 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.59% (0.9527 => 0.9964, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.73% (12.1108 => 12.5625, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.08% (80.0179 => 80.8804, std.dev.: 0.3305) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.24% (14.9069 => 14.5732, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.16% (0.5689 => 0.5680, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -0.25% (15.8738 => 15.8346, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: -0.03% (14.6534 => 14.6492, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -0.34% (82.5137 => 82.2314, std.dev.: 0.0253) MultiSource/Benchmarks/MallocBench/gs/gs: 0.48% (4.2858 => 4.3064, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2216 => 1.2204, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (7.4034 => 7.3975, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (3.6577 => 3.6705, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.6370 => 0.6357, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.35% (0.1432 => 0.1427, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.02% (63.2438 => 82.2314, std.dev.: 0.0253) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14251.11% (0.0720 => 10.3328, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.57% (10.3673 => 14.5732, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.63% (7.0540 => 8.0152, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.62% (2.2022 => 2.5022, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.40% (1.1194 => 1.2582, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.19% (1.7609 => 1.9579, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 9.69% (10.4361 => 11.4472, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.52% (0.3561 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.49% (0.3497 => 0.3829, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.3282 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3694 => 0.4033, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3828 => 0.4176, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.01% (0.3927 => 0.4281, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.98% (0.3886 => 0.4235, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.59% (0.3177 => 0.3418, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.47% (9.4845 => 10.1931, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.46% (0.4879 => 0.5243, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.2554 => 0.2721, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7433 => 0.7900, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.15% (0.2700 => 0.2866, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.04% (0.7115 => 0.7545, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.99% (0.6675 => 0.7075, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.90% (0.2271 => 0.2405, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.86% (8.1363 => 8.6131, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (4.2646 => 4.5141, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 5.84% (5.7591 => 6.0957, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.84% (0.5860 => 0.6202, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 5.75% (3.3354 => 3.5272, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.58% (0.8172 => 0.8628, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.53% (4.9449 => 5.2185, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.53% (0.5569 => 0.5877, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.50% (5.0018 => 5.2770, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.46% (1.5415 => 1.6257, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.41% (7.9617 => 8.3927, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 5.39% (0.6030 => 0.6355, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.38% (0.5925 => 0.6244, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.31% (0.7835 => 0.8251, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.26% (0.2758 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.21% (0.8067 => 0.8487, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.3092 => 0.3251, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.13% (0.9765 => 1.0266, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.04% (1.5603 => 1.6390, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.98% (0.4299 => 0.4513, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.88% (1.1642 => 1.2210, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (1.1861 => 1.2437, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.73% (21.9371 => 22.9758, std.dev.: 0.0134) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.60% (0.7326 => 0.7663, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 4.58% (0.6456 => 0.6752, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 4.57% (1.0722 => 1.1212, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.48% (3.8723 => 4.0459, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 4.32% (0.3422 => 0.3570, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.17% (0.8921 => 0.9293, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.14% (0.6450 => 0.6717, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.12% (0.4103 => 0.4272, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.01% (0.3865 => 0.4020, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.00% (2.0273 => 2.1084, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3650 => 0.3796, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.87% (2.2969 => 2.3857, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.85% (0.4289 => 0.4454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4203 => 0.4363, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4636 => 0.4808, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.71% (0.4048 => 0.4198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.69% (0.3826 => 0.3967, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.68% (0.2905 => 0.3012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.3098 => 0.3209, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.54% (1.5859 => 1.6421, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.47% (0.3603 => 0.3728, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (2.0665 => 2.1380, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.4186 => 1.4669, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.38% (0.3162 => 0.3269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.34% (0.3232 => 0.3340, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (14.3668 => 14.8366, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/lists1: 3.20% (0.3684 => 0.3802, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.12% (2.2024 => 2.2711, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.1840 => 1.2195, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.8101 => 0.8275, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.96% (1.2842 => 1.3094, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3823, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3470, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2419, std.dev.: 0.0215) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3743, std.dev.: 0.0231) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.99% (5.2763 => 3.2716, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.88% (5.3855 => 3.8841, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.51% (5.3526 => 3.8799, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2265, std.dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.73% (2.9384 => 2.5938, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -8.59% (22.1758 => 20.2717, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2685, std.dev.: 0.0923) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.85% (4.8142 => 4.4842, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7165, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5841, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5085, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4168, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3293, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0063, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -2.30% (1.2373 => 1.2088, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0086, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std.dev.: 0.0063) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5784, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -1.27% (6.2999 => 6.2198, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.62% (0.5229 => 0.5680, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.64% (14.9895 => 15.8346, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 3.49% (14.1553 => 14.6492, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 4.77% (4.1105 => 4.3064, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.46% (1.1048 => 1.2204, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.34% (7.1582 => 7.3975, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.99% (3.4629 => 3.6705, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.6222 => 0.6357, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 06:35:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 08:35:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914133521.A30CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3801?compare_to=3795&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3801, Order: 163886, Start Time: 2012-09-14 10:52:57, End Time: 2012-09-14 13:36:41 To: 3795, Order: 163878, Start Time: 2012-09-14 07:40:43, End Time: 2012-09-14 10:24:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.96% (2.0888 => 2.1298, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.55% (0.3488 => 0.3821, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3465 => 0.3791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.38% (0.3442 => 0.3765, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.38% (0.3496 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.37% (0.3446 => 0.3769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3469 => 0.3792, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.31% (0.3460 => 0.3782, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.15% (0.3650 => 0.3984, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.83% (0.3724 => 0.4053, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.89% (1.5932 => 1.7029, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5826 => 0.6184, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 6.03% (0.5889 => 0.6244, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.87% (1.6211 => 1.7162, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.58% (1.3152 => 1.3886, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.39% (3.5627 => 3.7548, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (2.7292 => 2.8723, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8202, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 4.88% (1.0781 => 1.1307, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (0.5026 => 0.5270, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7171 => 0.7512, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.59% (0.3004 => 0.3142, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.55% (0.3930 => 0.4109, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.2736 => 0.2859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.46% (4.2109 => 4.3987, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 4.46% (23.5202 => 24.5690, std.dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (4.4195 => 4.6154, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.43% (1.8794 => 1.9626, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.33% (4.6177 => 4.8177, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.32% (0.3890 => 0.4058, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 4.14% (2.1653 => 2.2550, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (2.1013 => 2.1875, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2750 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.03% (2.0673 => 2.1507, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.03% (0.9909 => 1.0308, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.3271 => 0.3402, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.99% (0.2780 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.4139 => 0.4304, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.98% (0.5546 => 0.5767, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2813 => 0.2925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3267 => 0.3397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2823 => 0.2935, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.95% (0.6634 => 0.6896, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 3.95% (1.4269 => 1.4832, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 3.94% (0.3096 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.5900 => 0.6132, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3477 => 0.3612, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2911 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.88% (0.4251 => 0.4416, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.88% (0.2811 => 0.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3060 => 0.3178, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3124 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (0.4658 => 0.4836, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3690 => 0.3831, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3348 => 0.3472, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.70% (0.3084 => 0.3198, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.68% (0.3317 => 0.3439, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.66% (0.3336 => 0.3458, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.6435 => 0.6669, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.62% (0.4146 => 0.4296, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3282 => 0.3399, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.3981 => 0.4122, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (1.9694 => 2.0379, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (1.9966 => 2.0629, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 3.31% (2.0346 => 2.1020, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.27% (0.5012 => 0.5176, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.26% (0.7875 => 0.8132, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.15% (0.9697 => 1.0002, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.03% (0.7426 => 0.7651, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (0.5584 => 0.5750, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (0.4847 => 0.4985, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (0.5361 => 0.5511, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.27% (11.6398 => 11.9037, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.16% (4.6926 => 4.7938, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.2122 => 0.2256, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6698, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std.dev.: 0.1334) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8899, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6315, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.30% (2.0820 => 2.1298, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1907, std.dev.: 0.0099) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4584, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2856, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5957, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5859, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -8.87% (0.2402 => 0.2189, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7863, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0039) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7898, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7485, std.dev.: 0.0787) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.64% (0.6293 => 0.6190, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9563, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 06:48:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 08:48:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914134834.CA1432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3802?compare_to=3798&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3802, Order: 163898, Start Time: 2012-09-14 12:35:24, End Time: 2012-09-14 13:49:54 To: 3798, Order: 163886, Start Time: 2012-09-14 10:52:34, End Time: 2012-09-14 12:07:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 2 (0 on baseline) Performance Regressions: 14 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 954 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -0.18% (15.2942 => 15.2662, std.dev.: 0.0034) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 153800.00% (0.0001 => 0.1539, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 83.81% (0.1371 => 0.2520, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.11% (1.1923 => 1.4678, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.09% (1.1921 => 1.4673, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/BoolLiteralTest: 19.81% (0.3947 => 0.4729, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (13.8317 => 14.0172, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.45% (0.0861 => 0.0994) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.51% (0.9531 => 0.9961, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.91% (54.4480 => 56.5765, std.dev.: 0.0552) MultiSource/Applications/hexxagon/hexxagon: 3.87% (12.0794 => 12.5467, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.03% (0.5362 => 0.5471, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (27.7416 => 28.1010, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.15% (2.2914 => 2.3178, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (1.2926 => 1.3070, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.08% (7.1624 => 7.2395, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.02% (2.0176 => 2.4014, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.65% (3.9660 => 4.3488, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7061 => 0.7726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.21% (0.7710 => 0.8420, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.05% (0.7038 => 0.7675, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.00% (1.3693 => 1.4926, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.95% (0.5265 => 0.5736, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.88% (0.9199 => 1.0016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.83% (1.2193 => 1.3270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.71% (0.6959 => 0.7565, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.31% (1.1364 => 1.2308, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.23% (1.4563 => 1.5761, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 8.11% (13.8202 => 14.9417, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.98% (0.5577 => 0.6022, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3899 => 0.4198, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.6283 => 0.6764, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.58% (0.3246 => 0.3492, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1087, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.45% (0.2914 => 0.3131, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.4791 => 0.5145, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.31% (0.2995 => 0.3214, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.31% (0.5637 => 0.6049, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.30% (1.1061 => 1.1869, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (7.2180 => 7.7389, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8310 => 0.8903, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 7.12% (3.8646 => 4.1399, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.07% (0.7506 => 0.8037, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3756 => 0.4021, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.99% (3.6692 => 3.9258, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.94% (0.2925 => 0.3128, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.92% (0.2023 => 0.2163, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.92% (1.9828 => 2.1200, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.88% (0.7460 => 0.7973, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.84% (0.2690 => 0.2874, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.83% (0.2988 => 0.3192, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2761 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.48% (2.1791 => 2.3203, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.47% (3.1889 => 3.3953, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.39% (0.3789 => 0.4031, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.37% (0.3578 => 0.3806, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: 6.35% (0.4003 => 0.4257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.34% (0.3914 => 0.4162, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.33% (0.3663 => 0.3895, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.33% (1.3245 => 1.4083, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.32% (0.6744 => 0.7170, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.31% (0.3646 => 0.3876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.29% (0.3623 => 0.3851, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.27% (0.6576 => 0.6988, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (1.3813 => 1.4678, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.25% (0.3601 => 0.3826, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.25% (1.9270 => 2.0474, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.22% (0.3650 => 0.3877, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (1.3819 => 1.4673, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.14% (1.0594 => 1.1245, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.10% (0.4113 => 0.4364, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.01% (16.6129 => 17.6119, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 6.00% (14.8535 => 15.7445, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 5.83% (1.2749 => 1.3492, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (8.4961 => 8.9885, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.75% (0.8698 => 0.9198, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (4.4433 => 4.6960, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.61% (4.3801 => 4.6259, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.61% (0.6135 => 0.6479, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.2842 => 14.0172, std.dev.: 0.0171) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.36% (0.8818 => 0.9291, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.28% (1.1333 => 1.1931, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3755 => 0.3949, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (6.5754 => 6.9132, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: 5.07% (14.5298 => 15.2662, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8887, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.74% (3.2742 => 3.4293, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 4.36% (1.2292 => 1.2828, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.35% (0.9108 => 0.9504, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4805 => 0.5009, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (4.9865 => 5.1888, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.04% (1.5188 => 1.5802, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 3.93% (3.7467 => 3.8941, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (6.2785 => 6.5220, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.6250 => 0.6491, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.72% (2.1007 => 2.1789, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.2944 => 34.3054, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5356, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std.dev.: 0.0450) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.74% (1.1560 => 1.2570) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4166, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5467, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.93% (10.7476 => 11.0624, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6048, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5986, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.66% (0.4657 => 0.3881, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7107, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2582, std.dev.: 0.0539) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.7688 => 1.7053, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.34% (3.0263 => 2.9253, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5987, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8945, std.dev.: 0.0371) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2449, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2395, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0628, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 07:37:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 09:37:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914143700.553842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3803?compare_to=3799&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3803, Order: 163899, Start Time: 2012-09-14 13:28:17, End Time: 2012-09-14 14:38:21 To: 3799, Order: 163898, Start Time: 2012-09-14 12:00:58, End Time: 2012-09-14 13:12:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (50 on baseline) Performance Improvements: 8 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 888 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 3.44% (0.2908 => 0.3008, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.40% (0.5590 => 0.5724, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.25% (1.1697 => 1.1843, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.05% (4.2596 => 4.3044, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.14% (7.0618 => 7.1426, std.dev.: 0.0264) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -7.24% (0.1477 => 0.1370, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.97% (2.3976 => 2.3024, std.dev.: 0.0324) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.55% (40.5014 => 39.0630, std.dev.: 0.0770) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.99% (2.4781 => 2.4041, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.49% (44.6702 => 43.5566, std.dev.: 0.3896) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.65% (2.6150 => 2.5719, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: -1.41% (6.2557 => 6.1677, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.35% (60.3933 => 59.5780, std.dev.: 0.1850) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.95% (0.9817 => 0.9910, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -0.27% (0.6015 => 0.5999, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 2.29% (0.1617 => 0.1654, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.98% (0.1508 => 0.1553, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.46% (0.3071 => 0.3085, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.89% (0.2353 => 0.2332, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.19% (0.3162 => 0.3156, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (0.2213 => 0.2276, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/mandel: 1.12% (0.0445 => 0.0450, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -58.14% (0.0086 => 0.0036, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -51.69% (0.0089 => 0.0043, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.69% (0.0236 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.39% (0.0384 => 0.0371, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0295 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.06% (0.0264 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0321 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 26.35% (0.0148 => 0.0187, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0243 => 0.0244, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -0.31% (0.0322 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1437 => 0.1431, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.38% (1.4280 => 1.5048, std.dev.: 0.0178) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1538 => 0.1537, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.59% (0.4037 => 0.4061, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.22% (0.1385 => 0.1388, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.77% (0.0564 => 0.0574, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.59% (0.0169 => 0.0219, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.75% (0.0647 => 0.0571, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1485 => 1.1470, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.16% (0.0556 => 0.0568, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.04% (0.0146 => 0.0203, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7810 => 0.7811, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.58% (1.6092 => 1.5998, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.33% (4.1772 => 3.0773, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/except: 80716.67% (0.0006 => 0.4849, std.dev.: 0.0096) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.80% (0.5309 => 0.5617, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 5.24% (2.1763 => 2.2904, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.88% (0.6410 => 0.6723, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.2552 => 0.2654, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.91% (0.3582 => 0.3722, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 3.90% (0.6173 => 0.6414, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 3.85% (0.6915 => 0.7181, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.1653 => 1.2057, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 3.36% (1.0046 => 1.0384, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 3.10% (15.3105 => 15.7851, std.dev.: 0.0394) MultiSource/Benchmarks/Bullet/bullet: 2.34% (29.3170 => 30.0036, std.dev.: 0.2361) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.7639 => 0.7804, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.5150 => 1.5449, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.73% (1.1440 => 1.1638, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: 1.51% (1.3268 => 1.3468, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.47% (1.1672 => 1.1843, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.40% (3.0225 => 3.0649, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.40% (1.4408 => 1.4610, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 1.18% (13.3238 => 13.4806, std.dev.: 0.0488) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0087) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.90% (0.0917 => 0.1072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 15.18% (1.7426 => 2.0071, std.dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3746 => 0.4281, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.48% (4.0101 => 4.5507, std.dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.6000, std.dev.: 0.0172) SingleSource/Benchmarks/Stanford/Puzzle: 7.05% (0.1433 => 0.1534, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.72% (0.2857 => 0.3049, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.70% (1.0063 => 1.0737, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.92% (27.1724 => 28.7807, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8543, std.dev.: 0.0591) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.02% (40.4792 => 42.1052, std.dev.: 0.2269) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5374, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8719, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.32% (0.8498 => 0.8780, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 3.27% (1.4184 => 1.4648, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.44% (6.9722 => 7.1426, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/ReedSolomon: 2.44% (8.5113 => 8.7192, std.dev.: 0.0566) SingleSource/Benchmarks/Shootout-C++/hash: 2.05% (0.6308 => 0.6437, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: 2.01% (5.1938 => 5.2984, std.dev.: 0.0264) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7216, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 1.58% (3.5520 => 3.6080, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (2.4455 => 2.4788, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (2.4971 => 2.5301, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.29% (0.7738 => 0.7561, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.29% (0.3497 => 0.2123, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.54% (5.2665 => 4.0795, std.dev.: 0.1052) SingleSource/Benchmarks/Shootout-C++/ary3: -20.75% (1.7473 => 1.3847, std.dev.: 0.0384) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.46% (1.1647 => 0.9380, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.30% (8.1594 => 7.1556, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: -10.85% (2.4457 => 2.1803, std.dev.: 0.0514) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5281, std.dev.: 0.2155) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.47% (1.4034 => 1.2845, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9334, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3668, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: -6.89% (3.4230 => 3.1873, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -6.59% (1.4441 => 1.3489, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4103, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.32% (0.4564 => 0.4367, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: -4.27% (1.4117 => 1.3514, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.20% (45.4683 => 43.5566, std.dev.: 0.3896) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.21% (1.7361 => 1.6804, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: -3.10% (9.2503 => 8.9638, std.dev.: 0.0334) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.07% (0.4140 => 0.4013, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -3.03% (8.5323 => 8.2741, std.dev.: 0.0774) MultiSource/Applications/lambda-0_1_3/lambda: -3.01% (7.6833 => 7.4517, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0245) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.75% (1.2722 => 1.2372, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.75% (1.1683 => 1.1362, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2855, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3364, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.68% (3.7496 => 3.6492, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.61% (61.1734 => 59.5780, std.dev.: 0.1850) MultiSource/Benchmarks/FreeBench/neural/neural: -2.20% (1.0926 => 1.0686, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4216, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.70% (1.0686 => 1.0504, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2319, std.dev.: 0.0249) MultiSource/Benchmarks/sim/sim: -1.55% (3.8907 => 3.8303, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.53% (1.8739 => 1.8452, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3082, std.dev.: 0.0652) SingleSource/Benchmarks/Shootout-C++/lists: -1.32% (16.5617 => 16.3438, std.dev.: 0.0792) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.70% (0.9980 => 0.9910, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6022 => 0.5999, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -0.72% (0.1666 => 0.1654, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1554 => 0.1553, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3083 => 0.3085, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.59% (0.2394 => 0.2332, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.60% (0.3175 => 0.3156, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (0.2302 => 0.2276, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -59.55% (0.0089 => 0.0036, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -52.22% (0.0090 => 0.0043, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.87% (0.0390 => 0.0371, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.06% (0.0189 => 0.0187, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.19% (1.5019 => 1.5048, std.dev.: 0.0178) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.40% (0.1501 => 0.1537, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.76% (0.4264 => 0.4061, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.27% (0.1344 => 0.1388, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.0589 => 0.0574, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.60% (0.0232 => 0.0219, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.06% (1.1350 => 1.1470, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.83% (0.0637 => 0.0568, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (0.0246 => 0.0203, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.58% (0.7541 => 0.7811, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.13% (1.5363 => 1.5998, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 08:05:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 10:05:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914150533.D5C542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3804?compare_to=3800&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3804, Order: 163900, Start Time: 2012-09-14 13:47:08, End Time: 2012-09-14 15:06:52 To: 3800, Order: 163897, Start Time: 2012-09-14 11:59:19, End Time: 2012-09-14 13:18:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (14.5732 => 14.7218, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.11% (0.5680 => 0.5686, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.20% (15.8346 => 15.8665, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 0.12% (14.6492 => 14.6662, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 0.30% (82.2314 => 82.4777, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/gs/gs: -0.19% (4.3064 => 4.2982, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2204 => 1.2212, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (7.3975 => 7.4106, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.17% (3.6705 => 3.6767, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.60% (0.6357 => 0.6395, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1427 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.41% (63.2438 => 82.4777, std.dev.: 0.0233) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14250.00% (0.0720 => 10.3320, std.dev.: 0.0037) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.00% (10.3673 => 14.7218, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.00% (7.0540 => 8.0417, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.79% (2.2022 => 2.5059, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.05% (1.1194 => 1.2655, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.58% (1.7609 => 1.9649, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.72% (0.3828 => 0.4200, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 9.68% (10.4361 => 11.4468, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 9.65% (0.3927 => 0.4306, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.47% (0.3886 => 0.4254, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.87% (0.4879 => 0.5263, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.54% (9.4845 => 10.1995, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7433 => 0.7917, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.44% (0.4615 => 0.4912, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.2554 => 0.2715, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.22% (0.2700 => 0.2868, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.14% (0.7115 => 0.7552, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.03% (8.1363 => 8.6268, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5860 => 0.6210, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.6030 => 0.6386, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.87% (0.5925 => 0.6273, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.82% (1.5603 => 1.6511, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.81% (0.8172 => 0.8647, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.79% (4.2646 => 4.5115, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 5.77% (5.7591 => 6.0912, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 5.69% (3.3354 => 3.5252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.5105 => 0.5394, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (4.9449 => 5.2238, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.58% (5.0018 => 5.2809, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 5.56% (0.7835 => 0.8271, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.56% (1.5415 => 1.6272, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.53% (0.5569 => 0.5877, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (7.9617 => 8.4011, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9765 => 1.0276, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.8067 => 0.8489, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.21% (0.3092 => 0.3253, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.15% (0.7326 => 0.7703, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.14% (0.4299 => 0.4520, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.06% (0.3422 => 0.3595, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.05% (0.6456 => 0.6782, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4636 => 0.4864, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.89% (1.1642 => 1.2211, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.88% (0.2891 => 0.3032, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.84% (0.3180 => 0.3334, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2905 => 0.3045, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.81% (0.3865 => 0.4051, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.78% (0.3387 => 0.3549, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.75% (0.4103 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (0.4064 => 0.4257, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.5020 => 0.5256, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.65% (1.1861 => 1.2412, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.64% (0.4289 => 0.4488, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.63% (3.8723 => 4.0515, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.60% (0.3650 => 0.3818, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.59% (1.0722 => 1.1214, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.55% (21.9371 => 22.9357, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.43% (0.2756 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3826 => 0.3994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.35% (2.0665 => 2.1563, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 4.34% (0.2831 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3232 => 0.3371, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.3052 => 0.3183, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4203 => 0.4383, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.26% (0.3098 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.21% (0.2872 => 0.2993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 4.20% (0.4048 => 0.4218, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.20% (0.4620 => 0.4814, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3935 => 0.4099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3603 => 0.3753, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 4.10% (0.8921 => 0.9287, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.08% (0.6450 => 0.6713, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2802 => 0.2916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.03% (0.5981 => 0.6222, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.02% (2.0273 => 2.1088, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.97% (2.2969 => 2.3881, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.94% (0.3684 => 0.3829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.93% (0.2877 => 0.2990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3379 => 0.3509, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (1.5859 => 1.6429, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.4186 => 1.4693, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (14.3668 => 14.8555, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.2024 => 2.2708, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1840 => 1.2198, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.65% (1.2842 => 1.3182, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.8101 => 0.8270, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3827, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3498, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7883, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2253, std.dev.: 0.0397) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5777, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.75% (5.2763 => 3.2845, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.62% (5.3855 => 3.8980, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.27% (5.3526 => 3.8928, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2607, std.dev.: 0.0520) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.14% (2.9384 => 2.6111, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -8.46% (22.1758 => 20.2998, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (19.9488 => 18.2430, std.dev.: 0.0663) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7152, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -3.11% (1.2373 => 1.1988, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5108, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4177, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0049, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0139, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5776, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.21% (6.2999 => 6.2238, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.74% (0.5229 => 0.5686, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.85% (14.9895 => 15.8665, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 3.61% (14.1553 => 14.6662, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (4.1105 => 4.2982, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.54% (1.1048 => 1.2212, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.53% (7.1582 => 7.4106, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.17% (3.4629 => 3.6767, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.6222 => 0.6395, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 08:31:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 10:31:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914153116.562D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3805?compare_to=3802&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3805, Order: 163900, Start Time: 2012-09-14 14:18:07, End Time: 2012-09-14 15:32:34 To: 3802, Order: 163898, Start Time: 2012-09-14 12:35:24, End Time: 2012-09-14 13:49:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (79.7071 => 81.4273, std.dev.: 0.4288) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.05% (2.0176 => 2.4020, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.50% (3.9660 => 4.3427, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7061 => 0.7722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2596 => 0.2834, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.11% (0.7710 => 0.8412, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 8.92% (1.3693 => 1.4915, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 8.92% (0.7038 => 0.7666, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.79% (0.5265 => 0.5728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.75% (0.9199 => 1.0004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3242, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.58% (0.6959 => 0.7556, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.25% (1.1364 => 1.2301, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.15% (1.4563 => 1.5750, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8.01% (13.8202 => 14.9275, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash: 7.93% (0.4062 => 0.4384, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.84% (0.5577 => 0.6014, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.59% (0.6283 => 0.6760, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.51% (0.3899 => 0.4192, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.49% (0.4379 => 0.4707, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 7.49% (1.0313 => 1.1085, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.42% (0.3246 => 0.3487, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.31% (0.2914 => 0.3127, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.23% (1.1061 => 1.1861, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.20% (0.3485 => 0.3736, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.20% (0.3293 => 0.3530, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.15% (7.2180 => 7.7343, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.11% (0.4390 => 0.4702, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 7.09% (0.7506 => 0.8038, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 7.04% (0.2243 => 0.2401, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.02% (3.8646 => 4.1358, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 7.00% (0.8310 => 0.8892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.93% (3.6692 => 3.9236, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.2925 => 0.3127, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (0.7460 => 0.7970, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.83% (0.2607 => 0.2785) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.81% (1.9828 => 2.1179, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: 6.80% (0.2690 => 0.2873, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (0.2761 => 0.2943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.45% (2.1791 => 2.3196, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.37% (0.4003 => 0.4258, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.36% (0.3914 => 0.4163, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.35% (1.3245 => 1.4086, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.32% (0.3578 => 0.3804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.31% (0.3453 => 0.3671, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.28% (3.1889 => 3.3893, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: 6.28% (0.3646 => 0.3875, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.26% (1.9270 => 2.0477, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 6.24% (0.3940 => 0.4186, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.24% (0.3623 => 0.3849, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.22% (0.3601 => 0.3825, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.21% (0.6744 => 0.7163, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.19% (0.6576 => 0.6983, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/for-in: 6.18% (0.3789 => 0.4023, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.17% (1.3819 => 1.4671, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.16% (0.3650 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.15% (1.3813 => 1.4662, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.14% (0.3663 => 0.3888, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.13% (1.0594 => 1.1243, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.01% (16.6129 => 17.6117, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 6.01% (0.4113 => 0.4360, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.93% (14.8535 => 15.7339, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (1.2749 => 1.3490, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 5.74% (0.2859 => 0.3023, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.3801 => 4.6310, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9786, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.8698 => 0.9189, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (4.4433 => 4.6898, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6135 => 0.6469, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (13.2842 => 14.0060, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.41% (0.8818 => 0.9295, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1333 => 1.1926, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.03% (14.5298 => 15.2600, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9028, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.82% (4.6629 => 4.8876, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.70% (3.2742 => 3.4280, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (0.9108 => 0.9502, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: 4.22% (1.2292 => 1.2811, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (4.9865 => 5.1892, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.5188 => 1.5795, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.87% (6.2785 => 6.5212, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 3.86% (3.7467 => 3.8912, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6250 => 0.6488, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1007 => 2.1743, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2487, std.dev.: 0.0212) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5341, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std.dev.: 0.0550) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.86% (2.8606 => 2.9997, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6979, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1073, std.dev.: 0.0299) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5975, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.03% (1.4298 => 1.4445, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (22.5627 => 21.7037, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2877, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.66% (1.3780 => 1.3000, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.30% (3.0263 => 2.9265, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5918, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.15% (26.5159 => 25.9456, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2397, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2403, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2260, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0608, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.13% (6.6320 => 6.5569, std.dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4343, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 09:03:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 11:03:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914160345.98CE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3806?compare_to=3803&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3806, Order: 163900, Start Time: 2012-09-14 14:53:54, End Time: 2012-09-14 16:05:06 To: 3803, Order: 163899, Start Time: 2012-09-14 13:28:17, End Time: 2012-09-14 14:38:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (51 on baseline) Performance Improvements: 0 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.7237 => 0.7378, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.87% (0.5466 => 0.5568, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 51.96% (0.0204 => 0.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.03% (2.3024 => 2.4643, std.dev.: 0.0597) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.4849 => 0.5116, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.5846 => 0.6149, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (0.2459 => 0.2566, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.26% (2.8301 => 2.8941, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.69% (42.1052 => 42.8174, std.dev.: 0.1977) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.45% (2.7093 => 2.7487, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.19% (1.6115 => 1.6307, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.08% (0.9910 => 0.9803, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.5999 => 0.6002, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -2.66% (0.1654 => 0.1610, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.52% (0.1553 => 0.1545, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (0.3085 => 0.3074, std.dev.: 0.0228) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2332 => 0.2329, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.29% (0.3156 => 0.3165, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (0.2276 => 0.2336, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0450 => 0.0454, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 144.44% (0.0036 => 0.0088, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 106.98% (0.0043 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0240 => 0.0210, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0189 => 0.0189, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.23% (0.0371 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.68% (0.0294 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0280 => 0.0279, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0318 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.14% (0.0175 => 0.0177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.07% (0.0187 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 0.82% (0.0244 => 0.0246, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 2.49% (0.0321 => 0.0329, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1431 => 0.1430, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -1.48% (1.5048 => 1.4825, std.dev.: 0.0147) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.46% (0.1537 => 0.1530, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.57% (0.4061 => 0.4084, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.39% (0.1388 => 0.1449, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.0574 => 0.0563, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.13% (0.0219 => 0.0199, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.63% (0.0571 => 0.0586, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.77% (1.1470 => 1.1558, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.69% (0.0568 => 0.0530, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.70% (0.0203 => 0.0163, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (0.7811 => 0.7833, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.59% (1.5998 => 1.6093, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.81% (4.1772 => 3.1410, std.dev.: 0.0467) SingleSource/Benchmarks/Shootout-C++/except: 85166.67% (0.0006 => 0.5116, std.dev.: 0.0063) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.88% (0.5309 => 0.5674, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: 5.56% (2.1763 => 2.2973, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.40% (0.6410 => 0.6756, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.2552 => 0.2668, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3582 => 0.3723, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 3.60% (0.6173 => 0.6395, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 3.42% (1.1653 => 1.2051, std.dev.: 0.0121) MultiSource/Applications/lemon/lemon: 3.30% (1.0046 => 1.0378, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.6915 => 0.7136, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 3.16% (15.3105 => 15.7936, std.dev.: 0.1846) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.5150 => 1.5474, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.10% (0.7226 => 0.7378, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.42% (1.1672 => 1.1838, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2546 => 6.3226, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 22.19% (3.4629 => 4.2313, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 14.36% (0.3746 => 0.4284, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.66% (4.0101 => 4.5580, std.dev.: 0.0157) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 9.34% (7.0025 => 7.6567, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.70% (1.0063 => 1.0938, std.dev.: 0.0207) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.80% (0.2694 => 0.2904, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.49% (0.2857 => 0.3071, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.43% (1.0194 => 1.0951, std.dev.: 0.0258) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (15.8312 => 16.8117, std.dev.: 0.1603) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8091, std.dev.: 0.0751) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.78% (40.4792 => 42.8174, std.dev.: 0.1977) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 5.22% (0.5844 => 0.6149, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 4.27% (8.5113 => 8.8744, std.dev.: 0.1352) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8313, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.90% (4.2129 => 4.3771, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 3.32% (1.4184 => 1.4655, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.12% (2.6656 => 2.7487, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.52% (0.5876 => 0.6024, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 2.32% (5.1938 => 5.3143, std.dev.: 0.0441) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.20% (4.6127 => 4.7140, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.91% (14.4877 => 14.7650, std.dev.: 0.0446) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (2.4455 => 2.4895, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 1.62% (3.5520 => 3.6096, std.dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5326, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 1.26% (2.8599 => 2.8958, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.6110 => 1.6307, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 1.17% (7.4740 => 7.5611, std.dev.: 0.0292) MultiSource/Benchmarks/Olden/bh/bh: 1.16% (2.5166 => 2.5457, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.72% (0.7738 => 0.7450, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.18% (0.3497 => 0.2092, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.59% (5.2665 => 4.2350, std.dev.: 0.0647) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.37% (1.1647 => 0.9391, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.07% (8.1594 => 7.1744, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5343, std.dev.: 0.1211) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.70% (3.2007 => 2.9541, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3660, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: -6.70% (3.4230 => 3.1935, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.4441 => 1.3560, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4058, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.76% (0.4140 => 0.3943, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -4.35% (0.2664 => 0.2548, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: -3.86% (1.4117 => 1.3572, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.20% (1.7361 => 1.6805, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -3.12% (9.2503 => 8.9616, std.dev.: 0.0302) MultiSource/Applications/lambda-0_1_3/lambda: -3.01% (7.6833 => 7.4517, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.01% (3.7496 => 3.6369, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.80% (1.2722 => 1.2366, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3352, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.56% (1.1683 => 1.1384, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -2.22% (9.5474 => 9.3359, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: -1.79% (3.4876 => 3.4253, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (92.7467 => 91.1020, std.dev.: 0.3242) MultiSource/Benchmarks/FreeBench/neural/neural: -1.65% (1.0926 => 1.0746, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2351, std.dev.: 0.0269) MultiSource/Benchmarks/sim/sim: -1.48% (3.8907 => 3.8330, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.48% (1.0686 => 1.0528, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3254, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/oourafft: -1.24% (3.8200 => 3.7728, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.3569 => 2.3285, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.77% (0.9980 => 0.9803, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: -0.33% (0.6022 => 0.6002, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -3.36% (0.1666 => 0.1610, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.58% (0.1554 => 0.1545, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (0.3083 => 0.3074, std.dev.: 0.0228) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.72% (0.2394 => 0.2329, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.31% (0.3175 => 0.3165, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.48% (0.2302 => 0.2336, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0240 => 0.0210, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -1.29% (1.5019 => 1.4825, std.dev.: 0.0147) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.93% (0.1501 => 0.1530, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.22% (0.4264 => 0.4084, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.81% (0.1344 => 0.1449, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.41% (0.0589 => 0.0563, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0232 => 0.0199, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.29% (0.0639 => 0.0586, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.83% (1.1350 => 1.1558, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.80% (0.0637 => 0.0530, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.74% (0.0246 => 0.0163, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.87% (0.7541 => 0.7833, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.75% (1.5363 => 1.6093, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 09:47:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 11:47:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914164709.3D2452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3807?compare_to=3801&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3807, Order: 163900, Start Time: 2012-09-14 14:04:57, End Time: 2012-09-14 16:48:28 To: 3801, Order: 163886, Start Time: 2012-09-14 10:52:57, End Time: 2012-09-14 13:36:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.67% (53.9829 => 54.8852, std.dev.: 0.0721) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 10.84% (0.3496 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.79% (0.3465 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.75% (0.3469 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.74% (0.3446 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.69% (0.3488 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.66% (0.3460 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.63% (0.3442 => 0.3808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.36% (0.3650 => 0.4028, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3643 => 0.4018, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.04% (0.3724 => 0.4098, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.80% (1.5932 => 1.7015, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.71% (0.5826 => 0.6217, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.64% (0.5889 => 0.6280, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (1.6211 => 1.7221, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (3.5627 => 3.7773, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.82% (2.7292 => 2.8881, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.81% (0.4994 => 0.5284, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.75% (1.3152 => 1.3908, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (0.4361 => 0.4611, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.42% (5.5417 => 5.8420, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7171 => 0.7553, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 5.16% (1.0781 => 1.1337, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (0.5026 => 0.5276, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.90% (0.2875 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3195 => 0.3350, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.84% (23.5202 => 24.6578, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.3903 => 0.4091, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.79% (0.3004 => 0.3148, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.74% (4.2109 => 4.4106, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2714 => 0.2842, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (4.4195 => 4.6270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.69% (0.2792 => 0.2923, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.66% (4.6177 => 4.8328, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.4139 => 0.4330, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2738 => 0.2864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.52% (2.0673 => 2.1607, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 4.51% (0.6634 => 0.6933, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.49% (1.8794 => 1.9638, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2813 => 0.2939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.47% (0.2729 => 0.2851, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.45% (0.3890 => 0.4063, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.43% (0.2823 => 0.2948, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.42% (0.9909 => 1.0347, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2811 => 0.2934, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.36% (2.1653 => 2.2598, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 4.36% (2.1013 => 2.1930, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.35% (0.3060 => 0.3193, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.33% (0.2911 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3726 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.28% (1.4269 => 1.4879, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.4146 => 0.4323, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3124 => 0.3256, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.3362 => 0.3504, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3348 => 0.3488, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.3477 => 0.3620, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3690 => 0.3840, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.06% (0.5546 => 0.5771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3282 => 0.3415, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.02% (0.4251 => 0.4422, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (0.4658 => 0.4843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.94% (0.3678 => 0.3823, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (1.9694 => 2.0456, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.79% (0.3981 => 0.4132, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (1.9966 => 2.0721, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 3.71% (0.9697 => 1.0057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.69% (0.3336 => 0.3459, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.6435 => 0.6672, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.67% (0.3271 => 0.3391, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 3.63% (0.7875 => 0.8161, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.3845 => 0.3981, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.5012 => 0.5189, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.12% (2.0346 => 2.0980, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (0.4847 => 0.4985, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (0.7426 => 0.7623, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (0.5361 => 0.5497, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (0.5584 => 0.5713, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.23% (11.6398 => 11.8995, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (4.6926 => 4.7923, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6780, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8981, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std.dev.: 0.1447) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6472, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1982, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4449, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2209, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5848, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5737, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7851, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7994, std.dev.: 0.0086) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8541, std.dev.: 0.0555) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.76% (0.6293 => 0.6182, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9646, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 09:53:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 11:53:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914165336.9887E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3808?compare_to=3804&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3808, Order: 163902, Start Time: 2012-09-14 15:35:12, End Time: 2012-09-14 16:54:56 To: 3804, Order: 163900, Start Time: 2012-09-14 13:47:08, End Time: 2012-09-14 15:06:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (140 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.32% (1.3115 => 1.2942, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.06% (1.5532 => 1.5368, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5686 => 0.5699, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -0.01% (15.8665 => 15.8642, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: -0.06% (14.6662 => 14.6579, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: -0.01% (82.4777 => 82.4695, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 0.03% (4.2982 => 4.2993, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2212 => 1.2220, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.4106 => 7.4100, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.6767 => 3.6772, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6395 => 0.6399, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1427 => 0.1428, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.40% (63.2438 => 82.4695, std.dev.: 0.0195) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14251.39% (0.0720 => 10.3330, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.08% (10.3673 => 14.7303, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 26.20% (0.1622 => 0.2047, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.95% (7.0540 => 8.0378, std.dev.: 0.0342) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.80% (2.2022 => 2.5061, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.09% (1.1194 => 1.2659, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.56% (1.7609 => 1.9645, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 9.69% (10.4361 => 11.4472, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.84% (0.3177 => 0.3426, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.75% (0.4879 => 0.5257, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 7.51% (9.4845 => 10.1971, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.70% (0.7433 => 0.7931, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.43% (0.3109 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4615 => 0.4907, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.2554 => 0.2715, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.25% (0.7115 => 0.7560, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2271 => 0.2413, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.22% (0.2700 => 0.2868, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.14% (0.6675 => 0.7085, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (8.1363 => 8.6295, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.90% (0.7835 => 0.8297, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.89% (0.5860 => 0.6205, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.87% (0.8172 => 0.8652, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.3050 => 1.3815, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.82% (3.3354 => 3.5295, std.dev.: 0.0119) MultiSource/Applications/hbd/hbd: 5.81% (1.5603 => 1.6509, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.75% (5.7591 => 6.0903, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5569 => 0.5885, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (4.2646 => 4.5061, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.5105 => 0.5394, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (4.9449 => 5.2238, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5415 => 1.6275, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3121 => 0.3295, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.54% (5.0018 => 5.2789, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.49% (0.9765 => 1.0301, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.38% (7.9617 => 8.3898, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.27% (0.8067 => 0.8492, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.26% (0.2758 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.24% (0.3092 => 0.3254, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7326 => 0.7701, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.6456 => 0.6783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.06% (0.3422 => 0.3595, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.02% (1.1642 => 1.2227, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.4103 => 0.4308, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.97% (0.4064 => 0.4266, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 4.95% (0.4299 => 0.4512, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4636 => 0.4865, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.88% (0.2891 => 0.3032, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.82% (3.8723 => 4.0589, std.dev.: 0.0080) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2905 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.3180 => 0.3331, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.69% (1.1861 => 1.2417, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.68% (0.3650 => 0.3821, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3865 => 0.4045, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.2603 => 0.2724, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.64% (0.4289 => 0.4488, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 4.54% (21.9371 => 22.9324, std.dev.: 0.0209) MultiSource/Applications/lemon/lemon: 4.53% (1.0722 => 1.1208, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.49% (0.2831 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.43% (0.2756 => 0.2878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4203 => 0.4389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.42% (0.3232 => 0.3375, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.42% (0.3052 => 0.3187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3098 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.40% (0.3935 => 0.4108, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3826 => 0.3994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.37% (0.3136 => 0.3273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2871 => 0.2996) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.34% (2.0665 => 2.1561, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3162 => 0.3299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2802 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.28% (0.2872 => 0.2995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.22% (0.2793 => 0.2911, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.22% (0.3603 => 0.3755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.20% (0.4048 => 0.4218, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6450 => 0.6720, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 4.18% (0.4620 => 0.4813, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3684 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.10% (0.8921 => 0.9287, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.07% (0.2877 => 0.2994, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.96% (2.0273 => 2.1076, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 3.94% (2.2969 => 2.3873, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3379 => 0.3510) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5981 => 0.6209, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (1.5859 => 1.6416, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.4186 => 1.4682, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (14.3668 => 14.8488, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.08% (2.2024 => 2.2702, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.1840 => 1.2190, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.65% (1.2842 => 1.3182, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.8101 => 0.8271, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.01% (17.1811 => 17.3554, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.82% (1.1145 => 1.3688, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.96% (0.2944 => 0.3296, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3804, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3546, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2281, std.dev.: 0.0221) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.77% (5.2763 => 3.2835, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.65% (5.3855 => 3.8964, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.29% (5.3526 => 3.8921, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -14.54% (54.1659 => 46.2902, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.20% (2.9384 => 2.6092, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.43% (22.1758 => 20.3072, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2498, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.48% (1.8329 => 1.7142, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5840, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1516, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5031, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4146, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0093, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9888, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: -2.00% (1.2373 => 1.2126, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5766, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8556, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (0.5229 => 0.5699, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.84% (14.9895 => 15.8642, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 3.55% (14.1553 => 14.6579, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (4.1105 => 4.2993, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.61% (1.1048 => 1.2220, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.52% (7.1582 => 7.4100, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.19% (3.4629 => 3.6772, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.6222 => 0.6399, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 10:13:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 12:13:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914171357.F236F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3809?compare_to=3805&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3809, Order: 163903, Start Time: 2012-09-14 16:00:55, End Time: 2012-09-14 17:15:16 To: 3805, Order: 163900, Start Time: 2012-09-14 14:18:07, End Time: 2012-09-14 15:32:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.65% (81.4273 => 80.0812, std.dev.: 0.2232) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.76% (2.0176 => 2.3961, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.32% (0.1410 => 0.1626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.61% (3.9660 => 4.3470, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.22% (1.3693 => 1.4955, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.21% (0.7710 => 0.8420, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.13% (0.4328 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.09% (0.7038 => 0.7678, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.85% (0.9199 => 1.0013, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5265 => 0.5725, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.73% (1.2193 => 1.3258, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.62% (0.6959 => 0.7559, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5818 => 0.6312, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.34% (1.1364 => 1.2312, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5748 => 0.6226, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.11% (13.8202 => 14.9413, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.01% (1.4563 => 1.5730, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.90% (0.4062 => 0.4383, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.76% (0.5577 => 0.6010, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4379 => 0.4718, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6283 => 0.6765, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2726 => 0.2934, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 7.58% (0.2243 => 0.2413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.57% (0.2760 => 0.2969, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.45% (0.4791 => 0.5148, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.42% (0.2937 => 0.3155, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.40% (0.3756 => 0.4034, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.33% (1.1061 => 1.1872, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.31% (1.9828 => 2.1278, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary: 7.31% (0.3107 => 0.3334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4016 => 0.4309, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.27% (0.3149 => 0.3378, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.26% (0.3293 => 0.3532, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.21% (7.2180 => 7.7383, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 7.15% (0.2628 => 0.2816, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.14% (3.8646 => 4.1407, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.2988 => 0.3200, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.09% (0.7460 => 0.7989, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 7.07% (0.7506 => 0.8037, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.06% (0.4390 => 0.4700, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/moments: 7.06% (0.3868 => 0.4141, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.2925 => 0.3131, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.98% (0.8310 => 0.8890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.88% (3.6692 => 3.9215, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 6.83% (0.3220 => 0.3440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.83% (0.3192 => 0.3410, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.77% (0.6576 => 0.7021, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.66% (2.1791 => 2.3243, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.55% (0.4003 => 0.4265, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3578 => 0.3811, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.49% (0.3789 => 0.4035, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.46% (0.3914 => 0.4167, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 6.44% (0.3601 => 0.3833, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.3245 => 1.4096, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 6.34% (0.3646 => 0.3877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.33% (0.3650 => 0.3881, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.32% (1.9270 => 2.0487, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 6.29% (0.3940 => 0.4188, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 6.28% (0.3663 => 0.3893, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.26% (1.3819 => 1.4684, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.25% (3.1889 => 3.3883, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-3: 6.21% (0.3623 => 0.3848, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.18% (16.6129 => 17.6392, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4658, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.05% (1.0594 => 1.1235, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 6.00% (14.8535 => 15.7442, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.87% (0.8698 => 0.9209, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.84% (4.3801 => 4.6357, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (8.4961 => 8.9885, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.2749 => 1.3487, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.6135 => 0.6484, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.66% (4.4433 => 4.6950, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.57% (0.3755 => 0.3964, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.39% (0.8818 => 0.9293, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.32% (13.2842 => 13.9914, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1333 => 1.1926, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.06% (14.5298 => 15.2645, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 4.99% (6.5754 => 6.9035, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.96% (3.2742 => 3.4366, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2292 => 1.2873, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.69% (4.6629 => 4.8818, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.51% (0.9108 => 0.9519, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6250 => 0.6515) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.10% (4.9865 => 5.1908, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 4.02% (3.7467 => 3.8975, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.97% (1.5188 => 1.5791, std.dev.: 0.0170) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.94% (6.2785 => 6.5261, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.60% (2.1007 => 2.1764, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.77% (33.2944 => 34.2178, std.dev.: 0.0165) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5222, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.10% (1.2998 => 1.3791, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6969, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5468, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1219, std.dev.: 0.0616) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5980, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5910, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6864, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.08% (7.9275 => 8.0129, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.60% (0.4657 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (22.5627 => 21.7136, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2760, std.dev.: 0.0457) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std.dev.: 0.0107) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9235, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5905, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.22% (26.5159 => 25.9267, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2398, std.dev.: 0.0220) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2254, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8711, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0599, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4317, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2630, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 10:30:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 12:30:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914173016.E502B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3810?compare_to=3806&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3810, Order: 163905, Start Time: 2012-09-14 16:20:58, End Time: 2012-09-14 17:31:36 To: 3806, Order: 163900, Start Time: 2012-09-14 14:53:54, End Time: 2012-09-14 16:05:06 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (52 on baseline) Performance Improvements: 9 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 888 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.48% (0.2024 => 0.2135, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4120 => 0.4232, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.61% (1.3315 => 1.3662, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 1.32% (1.1485 => 1.1637, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.93% (4.7798 => 4.5441, std.dev.: 0.0779) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.67% (2.4643 => 2.3493, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/lists1: -4.31% (0.6149 => 0.5884, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/lpbench: -3.14% (4.2350 => 4.1019, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/ary3: -3.13% (1.4313 => 1.3865, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/except: -2.42% (0.5116 => 0.4992, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.23% (2.3020 => 2.2507, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/mason/mason: -2.21% (0.5014 => 0.4903, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ary3: -1.69% (2.0335 => 1.9991, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.76% (0.9803 => 0.9976, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -1.63% (0.6002 => 0.5904, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 3.04% (0.1610 => 0.1659, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.24% (0.1545 => 0.1495, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.55% (0.3074 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.15% (0.2329 => 0.2379, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.13% (0.3165 => 0.3169, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.71% (0.2336 => 0.2296, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -1.32% (0.0454 => 0.0448, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -4.55% (0.0088 => 0.0084, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -15.73% (0.0089 => 0.0075, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.62% (0.0210 => 0.0194, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0383 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.35% (0.0296 => 0.0218, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0279 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0318 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -27.51% (0.0189 => 0.0137, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -0.41% (0.0246 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -6.99% (0.0329 => 0.0306, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1430 => 0.1437, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 0.05% (1.4825 => 1.4832, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.59% (0.1530 => 0.1539, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.12% (0.4084 => 0.4089, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.83% (0.1449 => 0.1408, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.88% (0.0563 => 0.0613, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.53% (0.0199 => 0.0212, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.48% (0.0586 => 0.0624, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.60% (1.1558 => 1.1489, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 108.33% (0.0012 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.02% (0.0530 => 0.0546, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.11% (0.0163 => 0.0140, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.37% (0.7833 => 0.7804, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 66.67% (0.0003 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.32% (1.6093 => 1.6041, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.40% (4.1772 => 3.0327, std.dev.: 0.0852) SingleSource/Benchmarks/Shootout-C++/except: 83100.00% (0.0006 => 0.4992, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.54% (0.0745 => 0.0898, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.65% (0.5309 => 0.5662, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 5.30% (2.1763 => 2.2917, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.66% (0.2552 => 0.2671, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.62% (0.6410 => 0.6706, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.19% (0.6915 => 0.7205, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 3.92% (1.1653 => 1.2110, std.dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.80% (0.3582 => 0.3718, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.73% (0.6173 => 0.6403, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 3.21% (15.3105 => 15.8024, std.dev.: 0.0512) MultiSource/Applications/hbd/hbd: 2.97% (1.3268 => 1.3662, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5150 => 1.5561, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 2.49% (29.3170 => 30.0461, std.dev.: 0.0559) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.19% (0.7639 => 0.7806, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 2.07% (3.0225 => 3.0851, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6069 => 0.6180, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.72% (1.1440 => 1.1637, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 1.38% (2.0972 => 2.1262, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 1.30% (13.3238 => 13.4968, std.dev.: 0.0577) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3396, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout/ary3: 14.72% (1.7426 => 1.9991, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 14.10% (0.3746 => 0.4274, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.77% (4.0101 => 4.5621, std.dev.: 0.0625) SingleSource/Benchmarks/Stanford/Puzzle: 12.63% (0.1433 => 0.1614, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.76% (0.2694 => 0.2957, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 8.47% (7.0025 => 7.5957, std.dev.: 0.1146) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.02% (1.0063 => 1.0870, std.dev.: 0.0181) SingleSource/Benchmarks/McGill/chomp: 6.85% (1.0194 => 1.0892, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8022, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.3301 => 0.3490, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.53% (40.4792 => 42.3134, std.dev.: 0.6452) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.32% (0.8498 => 0.8865, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8284, std.dev.: 0.0739) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: 3.86% (0.9851 => 1.0231, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8386, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.77% (0.5587 => 0.5742, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.6308 => 0.6475, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: 2.22% (5.1938 => 5.3090, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.78% (4.6127 => 4.6946, std.dev.: 0.0203) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6084, std.dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: 1.56% (14.4877 => 14.7131, std.dev.: 0.0631) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (2.4971 => 2.5332, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4455 => 2.4807, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.27% (2.8599 => 2.8961, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.5166 => 2.5433, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.45% (0.7738 => 0.7471, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.92% (0.3497 => 0.2136, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.11% (5.2665 => 4.1019, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/ary3: -20.65% (1.7473 => 1.3865, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -20.00% (1.1647 => 0.9318, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.33% (62.4126 => 56.5879, std.dev.: 0.0678) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.97% (2.4457 => 2.2507, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.89% (3.2007 => 2.9481, std.dev.: 0.0516) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3654, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: -6.15% (3.4230 => 3.2126, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4080, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: -4.64% (1.4117 => 1.3462, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.03% (1.7361 => 1.6661, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/distray/distray: -3.79% (0.2664 => 0.2563, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.62% (0.4140 => 0.3990, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -3.43% (9.2503 => 8.9330, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.27% (1.2722 => 1.2306, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -3.26% (7.6833 => 7.4325, std.dev.: 0.0587) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.12% (1.1683 => 1.1319, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.94% (3.9413 => 3.8255, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: -2.84% (0.4296 => 0.4174, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0283) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3362, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.69% (3.7496 => 3.6486, std.dev.: 0.0279) MultiSource/Benchmarks/FreeBench/neural/neural: -2.19% (1.0926 => 1.0687, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0218) MultiSource/Benchmarks/sim/sim: -1.88% (3.8907 => 3.8175, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: -1.74% (92.7467 => 91.1308, std.dev.: 0.3166) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7699, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.18% (1.8739 => 1.8518, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.04% (0.9980 => 0.9976, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -1.96% (0.6022 => 0.5904, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1666 => 0.1659, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.80% (0.1554 => 0.1495, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (0.3083 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.63% (0.2394 => 0.2379, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.19% (0.3175 => 0.3169, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.26% (0.2302 => 0.2296, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -5.62% (0.0089 => 0.0084, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -16.67% (0.0090 => 0.0075, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.17% (0.0240 => 0.0194, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.57% (0.0301 => 0.0218, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -27.51% (0.0189 => 0.0137, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -5.85% (0.0325 => 0.0306, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -1.25% (1.5019 => 1.4832, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1501 => 0.1539, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.10% (0.4264 => 0.4089, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.76% (0.1344 => 0.1408, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.62% (0.0232 => 0.0212, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.35% (0.0639 => 0.0624, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.22% (1.1350 => 1.1489, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 316.67% (0.0006 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.29% (0.0637 => 0.0546, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.09% (0.0246 => 0.0140, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.49% (0.7541 => 0.7804, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.41% (1.5363 => 1.6041, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 11:41:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 13:41:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914184139.5FF412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3811?compare_to=3808&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3811, Order: 163910, Start Time: 2012-09-14 17:23:25, End Time: 2012-09-14 18:42:58 To: 3808, Order: 163902, Start Time: 2012-09-14 15:35:12, End Time: 2012-09-14 16:54:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (137 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.93% (14.7303 => 14.2987, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.40% (0.5699 => 0.5676, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -0.27% (15.8642 => 15.8213, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: -0.01% (14.6579 => 14.6566, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 0.14% (82.4695 => 82.5814, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.2993 => 4.2986, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.18% (1.2220 => 1.2198, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (7.4100 => 7.3991, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.22% (3.6772 => 3.6691, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.23% (0.6399 => 0.6384, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0648 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.58% (63.2438 => 82.5814, std.dev.: 0.0126) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14246.67% (0.0720 => 10.3296, std.dev.: 0.0029) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.92% (10.3673 => 14.2987, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 28.05% (0.1622 => 0.2077, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.74% (2.2022 => 2.5048, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.70% (7.0540 => 8.0202, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.78% (1.1194 => 1.2625, std.dev.: 0.0160) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.97% (1.7609 => 1.9540, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.68% (0.3543 => 0.3886, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.51% (0.3543 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.44% (0.3516 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.44% (0.3561 => 0.3897, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.18% (10.4361 => 11.3943, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3694 => 0.4033, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3828 => 0.4179, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.3927 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.96% (0.3886 => 0.4234, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.50% (0.3282 => 0.3561, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.4879 => 0.5245, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.21% (9.4845 => 10.1679, std.dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7433 => 0.7912, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.30% (0.2700 => 0.2870, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.24% (0.4615 => 0.4903, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 6.19% (0.2554 => 0.2712, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.18% (0.7115 => 0.7555, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.05% (0.3423 => 0.3630, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.6675 => 0.7073, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.94% (0.2271 => 0.2406, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (8.1363 => 8.6101, std.dev.: 0.0162) MultiSource/Applications/hbd/hbd: 5.81% (1.5603 => 1.6510, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 5.79% (5.7591 => 6.0927, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3805, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.78% (0.5860 => 0.6199, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.70% (0.8172 => 0.8638, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.68% (3.3354 => 3.5250, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.67% (4.2646 => 4.5063, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: 5.61% (0.6030 => 0.6368, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.60% (1.5415 => 1.6278, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5569 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2758 => 0.2910, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.46% (5.0018 => 5.2751, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.45% (4.9449 => 5.2142, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.36% (0.8067 => 0.8499, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.32% (0.2107 => 0.2219, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.31% (0.7835 => 0.8251, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 5.21% (0.3092 => 0.3253, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.09% (0.9765 => 1.0262, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.97% (1.1642 => 1.2221, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (7.9617 => 8.3498, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 4.86% (0.4299 => 0.4508, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7326 => 0.7676, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.68% (0.4636 => 0.4853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.65% (1.1861 => 1.2413, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.2603 => 0.2724, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.65% (0.6456 => 0.6756, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3441 => 0.3600, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.61% (0.3387 => 0.3543, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.58% (3.8723 => 4.0497, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 4.54% (1.0722 => 1.1209, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.4103 => 0.4288, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.44% (0.5020 => 0.5243, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9371 => 22.9039, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.36% (0.2891 => 0.3017, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3650 => 0.3809, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.20% (0.2831 => 0.2950, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2905 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3826 => 0.3985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3052 => 0.3177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4620 => 0.4808, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.04% (0.4203 => 0.4373, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.3098 => 0.3223, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.03% (0.6450 => 0.6710, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1085, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3603 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.93% (0.5981 => 0.6216, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 3.91% (2.2969 => 2.3868, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.4048 => 0.4206, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2872 => 0.2984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.87% (2.0665 => 2.1465, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8921 => 0.9265, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.2024 => 2.2850, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2802 => 0.2906, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.66% (0.3684 => 0.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (1.5859 => 1.6433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (0.2877 => 0.2981, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.61% (0.3379 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.4186 => 1.4662, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (14.3668 => 14.8385, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.1840 => 1.2181, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.63% (1.2842 => 1.3180, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.8101 => 0.8271, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3850, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (4.2280 => 4.3527, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2301, std.dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7880, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5794, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.23% (5.2763 => 3.2590, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.62% (5.3855 => 3.8979, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.16% (5.3526 => 3.8988, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2592, std.dev.: 0.0439) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.26% (2.9384 => 2.6075, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -8.58% (22.1758 => 20.2741, std.dev.: 0.0373) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2873, std.dev.: 0.0975) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.80% (1.6805 => 1.5831, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5049, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4262, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9989, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.18% (1.2373 => 1.2103, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0126, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6778, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4230, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5793, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.55% (14.9895 => 15.8213, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: 3.54% (14.1553 => 14.6566, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (4.1105 => 4.2986, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.41% (1.1048 => 1.2198, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.37% (7.1582 => 7.3991, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.95% (3.4629 => 3.6691, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.60% (0.6222 => 0.6384, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 11:56:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 13:56:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914185637.092562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3812?compare_to=3809&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3812, Order: 163910, Start Time: 2012-09-14 17:43:39, End Time: 2012-09-14 18:57:54 To: 3809, Order: 163903, Start Time: 2012-09-14 16:00:55, End Time: 2012-09-14 17:15:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.74% (54.5012 => 56.5405, std.dev.: 0.0681) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.54% (2.0176 => 2.3916, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.89% (0.1410 => 0.1620, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.70% (0.1413 => 0.1550, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.96% (3.9660 => 4.3215, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.82% (0.2596 => 0.2825, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.76% (1.3693 => 1.4893, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.68% (0.7710 => 0.8379, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.38% (0.7038 => 0.7628, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.32% (1.2193 => 1.3208, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.30% (0.5265 => 0.5702, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (0.9199 => 0.9958, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.12% (0.6959 => 0.7524, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.90% (1.1364 => 1.2262, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.76% (13.8202 => 14.8923, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.69% (1.4563 => 1.5683, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1327 => 0.1429, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6283 => 0.6753, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.41% (0.5577 => 0.5990, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3485 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.05% (0.3246 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3899 => 0.4174, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.01% (1.0313 => 1.1036, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.94% (0.2995 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.93% (0.4791 => 0.5123, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.92% (0.4379 => 0.4682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3489 => 0.3729, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.84% (0.3580 => 0.3825, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.2914 => 0.3113, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.82% (0.3022 => 0.3228, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 6.77% (1.1061 => 1.1810, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (7.2180 => 7.7063, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.74% (0.5637 => 0.6017, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.66% (0.3756 => 0.4006, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.65% (0.8310 => 0.8863, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.63% (0.7506 => 0.8004, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.56% (0.3293 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9092, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.52% (3.8646 => 4.1165, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.52% (1.9828 => 2.1120, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4016 => 0.4277, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (0.7460 => 0.7942, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.33% (0.3868 => 0.4113, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.2925 => 0.3108, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.18% (0.3220 => 0.3419, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.11% (0.1865 => 0.1979, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.98% (0.3192 => 0.3383, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.96% (0.6744 => 0.7146, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.93% (3.1889 => 3.3781, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3578 => 0.3790, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.90% (2.1791 => 2.3076, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3534 => 0.3742, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.87% (0.4003 => 0.4238, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.85% (1.0594 => 1.1214, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.84% (1.3245 => 1.4018, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3650 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.77% (0.3914 => 0.4140, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (1.3813 => 1.4608, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.72% (1.3819 => 1.4610, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.72% (0.6576 => 0.6952, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 5.71% (0.4113 => 0.4348, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.70% (1.9270 => 2.0368, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3623 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.61% (0.3940 => 0.4161, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.61% (14.8535 => 15.6862, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 5.56% (1.2749 => 1.3458, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 5.42% (8.4961 => 8.9563, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 5.35% (16.6129 => 17.5014, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.35% (0.8698 => 0.9163, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.27% (4.3801 => 4.6109, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (4.4433 => 4.6729, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.14% (0.3131 => 0.3292, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (13.2842 => 13.9650, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.10% (0.6135 => 0.6448, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.07% (0.8818 => 0.9265, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.95% (3.2742 => 3.4364, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.86% (0.2140 => 0.2244, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.82% (1.1333 => 1.1879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.79% (0.3755 => 0.3935, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2251, std.dev.: 0.0213) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (6.5754 => 6.8896, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 4.48% (4.6629 => 4.8718, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.41% (0.3245 => 0.3388, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.01% (0.9108 => 0.9473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.00% (0.4805 => 0.4997, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2783, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1732, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5188 => 1.5737, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 3.49% (3.7467 => 3.8774, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6250 => 0.6467, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (6.2785 => 6.4909, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.1007 => 2.1714, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2486, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5148, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std.dev.: 0.0487) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.72% (1.1560 => 1.2568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6971, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0748, std.dev.: 0.0571) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5938, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5178, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5942, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.94% (0.4657 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.02% (22.5627 => 21.6555, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2790, std.dev.: 0.0271) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3030, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5112, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1504, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9227, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9202, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5838, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.35% (26.5159 => 25.8923, std.dev.: 0.0290) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2315, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.21% (4.1080 => 4.0581, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2415, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2620, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 11:57:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 13:57:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914185702.EBBA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3813?compare_to=3810&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3813, Order: 163915, Start Time: 2012-09-14 17:47:41, End Time: 2012-09-14 18:58:23 To: 3810, Order: 163905, Start Time: 2012-09-14 16:20:58, End Time: 2012-09-14 17:31:36 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (46 on baseline) Performance Improvements: 1 (47 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 895 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.23% (22.2334 => 23.8414, std.dev.: 0.3595) MultiSource/Benchmarks/Olden/tsp/tsp: 4.78% (1.7481 => 1.8316, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (2.4706 => 2.5838, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.16% (2.6864 => 2.7445, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/ffbench: 1.30% (1.3462 => 1.3637, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.84% (0.5728 => 0.5508, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.75% (0.9976 => 0.9901, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.05% (0.5904 => 0.5966, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: -3.56% (0.1659 => 0.1600, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.21% (0.1495 => 0.1543, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (0.3091 => 0.3059, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.21% (0.2379 => 0.2384, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.50% (0.3169 => 0.3153, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.48% (0.2296 => 0.2307, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -4.46% (0.0448 => 0.0428, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: 5.95% (0.0084 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 18.67% (0.0075 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 23.71% (0.0194 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0191 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0384 => 0.0384, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 36.24% (0.0218 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.75% (0.0278 => 0.0237, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0321 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.81% (0.0178 => 0.0173, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 4.38% (0.0137 => 0.0143, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -0.41% (0.0245 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 6.54% (0.0306 => 0.0326) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1437 => 0.1432, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -4.72% (1.4832 => 1.4132, std.dev.: 0.0561) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.85% (0.1539 => 0.1449, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.57% (0.4089 => 0.4025, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.27% (0.1408 => 0.1376, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.0613 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.64% (0.0212 => 0.0164, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.88% (0.0624 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1489 => 1.1432, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -52.00% (0.0025 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.28% (0.0546 => 0.0539, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.71% (0.0140 => 0.0148, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7804 => 0.7800, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.16% (1.6041 => 1.6066, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -28.17% (4.1772 => 3.0004, std.dev.: 0.0538) SingleSource/Benchmarks/Shootout-C++/except: 82700.00% (0.0006 => 0.4968, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.13% (0.0745 => 0.0895, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.5309 => 0.5640, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 5.57% (2.1763 => 2.2976, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.24% (0.6410 => 0.6746, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.24% (0.3582 => 0.3734, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.86% (0.6173 => 0.6411, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 3.78% (1.0046 => 1.0426, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.1653 => 1.2092, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 3.53% (0.6915 => 0.7159, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.46% (1.5150 => 1.5522, std.dev.: 0.0079) MultiSource/Applications/Burg/burg: 2.13% (1.1440 => 1.1684, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: 2.00% (1.3268 => 1.3533, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.90% (29.3170 => 29.8744, std.dev.: 0.1176) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.36% (1.3935 => 1.4124, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0013, std.dev.: 0.0273) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3746 => 0.4285, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5637, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 12.61% (21.1721 => 23.8414, std.dev.: 0.3595) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.34% (0.0917 => 0.1021, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6240, std.dev.: 0.0525) SingleSource/Benchmarks/Stanford/Puzzle: 8.37% (0.1433 => 0.1553, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 6.85% (1.0194 => 1.0892, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.92% (27.1724 => 28.7817, std.dev.: 0.0671) MultiSource/Benchmarks/Olden/tsp/tsp: 5.69% (1.7330 => 1.8316, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8573, std.dev.: 0.0398) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5403, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8719, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/power/power: 3.22% (1.4184 => 1.4641, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.96% (2.6656 => 2.7445, std.dev.: 0.0173) MultiSource/Benchmarks/BitBench/five11/five11: 2.61% (5.1938 => 5.3294, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.16% (0.5876 => 0.6003, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: 1.96% (2.3453 => 2.3913, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.6127 => 4.6989, std.dev.: 0.0285) MultiSource/Applications/siod/siod: 1.61% (3.5520 => 3.6092, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7206, std.dev.: 0.0264) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5329, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.40% (2.8599 => 2.8999, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: 1.17% (2.4013 => 2.4294, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.35% (0.2080 => 0.1844, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.40% (0.2204 => 0.2085, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.32% (0.2142 => 0.2028, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.04% (0.5740 => 0.5508, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: -3.05% (0.7738 => 0.7502, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: -2.49% (0.4253 => 0.4147, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.13% (1.4189 => 1.4029, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.65% (5.2665 => 4.1788, std.dev.: 0.0729) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -20.24% (1.1647 => 0.9290, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: -20.23% (1.7473 => 1.3938, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout/sieve: -12.30% (8.1594 => 7.1554, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5455, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.41% (3.2007 => 2.9635, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.25% (2.4457 => 2.2684, std.dev.: 0.0360) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3734, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.63% (1.4021 => 1.3091, std.dev.: 0.0360) MultiSource/Applications/SIBsim4/SIBsim4: -6.53% (3.4230 => 3.1994, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: -6.53% (1.4441 => 1.3498, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.10% (0.4140 => 0.3929, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (4.6355 => 4.4047, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: -3.40% (1.4117 => 1.3637, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.35% (1.7361 => 1.6780, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.26% (1.2722 => 1.2307, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.16% (3.7496 => 3.6310, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4500, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.76% (1.1683 => 1.1361, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std.dev.: 0.0485) SingleSource/Benchmarks/McGill/misr: -2.72% (0.4296 => 0.4179, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -2.71% (9.2503 => 9.0000, std.dev.: 0.0136) MultiSource/Applications/aha/aha: -2.68% (3.4286 => 3.3367, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4180, std.dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: -1.83% (92.7467 => 91.0477, std.dev.: 0.1030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2248, std.dev.: 0.0165) MultiSource/Benchmarks/sim/sim: -1.67% (3.8907 => 3.8256, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3569 => 2.3237, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3152, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7683, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists: -1.33% (16.5617 => 16.3407, std.dev.: 0.0274) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.79% (0.9980 => 0.9901, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -0.93% (0.6022 => 0.5966, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: -3.96% (0.1666 => 0.1600, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.71% (0.1554 => 0.1543, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.78% (0.3083 => 0.3059, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2394 => 0.2384, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.69% (0.3175 => 0.3153, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2302 => 0.2307, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -4.68% (0.0449 => 0.0428, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.55% (0.0284 => 0.0237, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.26% (0.0177 => 0.0173, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -24.34% (0.0189 => 0.0143, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -5.91% (1.5019 => 1.4132, std.dev.: 0.0561) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.46% (0.1501 => 0.1449, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.61% (0.4264 => 0.4025, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.38% (0.1344 => 0.1376, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.36% (0.0589 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.31% (0.0232 => 0.0164, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.47% (0.0639 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.72% (1.1350 => 1.1432, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.38% (0.0637 => 0.0539, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.84% (0.0246 => 0.0148, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.43% (0.7541 => 0.7800, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.58% (1.5363 => 1.6066, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 12:59:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 14:59:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914195905.59EDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3814?compare_to=3807&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3814, Order: 163909, Start Time: 2012-09-14 17:16:44, End Time: 2012-09-14 20:00:24 To: 3807, Order: 163900, Start Time: 2012-09-14 14:04:57, End Time: 2012-09-14 16:48:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.03% (1.7015 => 1.7191, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 32.82% (56.3938 => 74.9000, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.43% (122.7478 => 125.7306, std.dev.: 1.0198) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3488 => 0.3838, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3446 => 0.3790, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3465 => 0.3809, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.87% (0.3496 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.86% (0.3460 => 0.3801, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3442 => 0.3781, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.74% (0.3469 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.51% (0.3650 => 0.3997, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.44% (0.3643 => 0.3987, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.26% (0.3724 => 0.4069, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 7.90% (1.5932 => 1.7191, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 5.89% (0.5826 => 0.6169, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.87% (1.3152 => 1.3924, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 5.82% (0.5889 => 0.6232, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (3.5627 => 3.7694, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (2.7292 => 2.8849, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (0.4361 => 0.4601, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.38% (5.5417 => 5.8401, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (0.4994 => 0.5251, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.06% (1.0781 => 1.1327, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (0.5000 => 0.5252, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2875 => 0.3012, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.73% (23.5202 => 24.6317, std.dev.: 0.0127) SingleSource/Regression/C++/ofstream_ctor: 4.66% (0.3004 => 0.3144, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.61% (0.6634 => 0.6940, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3195 => 0.3342, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.59% (0.7171 => 0.7500, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.5900 => 0.6170, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.55% (4.2109 => 4.4027, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.54% (0.3060 => 0.3199, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.51% (0.2725 => 0.2848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.51% (0.2792 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4146 => 0.4333, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.47% (0.2750 => 0.2873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.46% (0.2780 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0673 => 2.1595, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.43% (0.3271 => 0.3416, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.2736 => 0.2856, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (4.4195 => 4.6129, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 4.37% (0.2813 => 0.2936) MultiSource/Applications/hexxagon/hexxagon: 4.35% (0.9909 => 1.0340, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3267 => 0.3408, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.29% (0.2911 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.29% (0.2729 => 0.2846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (2.1653 => 2.2576, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 4.26% (4.6177 => 4.8145, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3258 => 0.3396, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (2.1013 => 2.1903, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.17% (0.4029 => 0.4197, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (1.8794 => 1.9574, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.3282 => 0.3417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3317 => 0.3451, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.03% (0.3477 => 0.3617, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3726 => 0.3876, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (0.3625 => 0.3770, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 3.99% (1.4269 => 1.4838, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.4139 => 0.4304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.93% (0.3890 => 0.4043, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.3903 => 0.4055, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4251 => 0.4412, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.68% (0.5546 => 0.5750, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.3981 => 0.4127, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.66% (0.3690 => 0.3825, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (1.9694 => 2.0407, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.3084 => 0.3194, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (0.4658 => 0.4823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.50% (0.9697 => 1.0036, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0663, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 3.43% (0.5012 => 0.5184, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.39% (0.3336 => 0.3449, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.3845 => 0.3971, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.16% (0.7875 => 0.8124, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.91% (2.0346 => 2.0938, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.68% (0.4847 => 0.4977, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (0.7426 => 0.7609, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (0.5361 => 0.5477, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.95% (0.5584 => 0.5693, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (11.6398 => 11.8585, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.85% (4.6926 => 4.7795, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6749, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8973, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 4.06% (14.0481 => 14.6179, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2000, std.dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5054, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4544, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.2451 => 1.2589, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6074, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5505, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8026, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.85% (17.2379 => 16.7474, std.dev.: 0.0983) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9752, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 13:29:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 15:29:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914202929.6B2752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3815?compare_to=3811&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3815, Order: 163921, Start Time: 2012-09-14 19:11:18, End Time: 2012-09-14 20:30:48 To: 3811, Order: 163910, Start Time: 2012-09-14 17:23:25, End Time: 2012-09-14 18:42:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (121 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (14.2987 => 14.5191, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.29% (0.5372 => 0.5495, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5676 => 0.5676, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 0.06% (15.8213 => 15.8310, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: -0.17% (14.6566 => 14.6318, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -0.12% (82.5814 => 82.4826, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 0.22% (4.2986 => 4.3079, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.2198 => 1.2204, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.42% (7.3991 => 7.3678, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.34% (3.6691 => 3.6568, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.67% (0.6384 => 0.6341, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1428 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0650 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.42% (63.2438 => 82.4826, std.dev.: 0.0077) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14248.33% (0.0720 => 10.3308, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.05% (10.3673 => 14.5191, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/richards_benchmark: 25.59% (0.1622 => 0.2037, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.82% (2.2022 => 2.5066, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.59% (7.0540 => 8.0124, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2577, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.54% (1.7609 => 1.9465, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.31% (10.4361 => 11.4079, std.dev.: 0.0142) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.59% (0.3282 => 0.3564, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.3177 => 0.3413, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.11% (9.4845 => 10.1587, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.4879 => 0.5225, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.44% (0.4615 => 0.4912, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2700 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.2554 => 0.2715, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2271 => 0.2414, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5925 => 0.6298, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7433 => 0.7900, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.6030 => 0.6404, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.11% (0.7115 => 0.7550, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5860 => 0.6218, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.07% (5.7591 => 6.1089, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 6.02% (0.3423 => 0.3629, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.96% (0.3307 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (8.1363 => 8.6204, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.93% (0.8172 => 0.8657, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.5415 => 1.6316, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (4.2646 => 4.5131, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 5.81% (3.3354 => 3.5293, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.78% (0.6675 => 0.7061, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.77% (4.9449 => 5.2301, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (1.3050 => 1.3802, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5569 => 0.5885, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (5.0018 => 5.2824, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.54% (0.8067 => 0.8514, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.48% (0.5105 => 0.5385, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.36% (0.7835 => 0.8255, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7326 => 0.7713, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9765 => 1.0272, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.04% (1.1642 => 1.2229, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: 5.00% (1.5603 => 1.6383, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (7.9617 => 8.3572, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.81% (1.1861 => 1.2432, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.73% (3.8723 => 4.0554, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 4.71% (1.0722 => 1.1227, std.dev.: 0.0146) MultiSource/Benchmarks/sim/sim: 4.69% (0.3387 => 0.3546, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3441 => 0.3601, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.5020 => 0.5247, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 4.37% (21.9371 => 22.8965, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.28% (0.6450 => 0.6726, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 4.19% (2.0273 => 2.1122, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 4.13% (2.2969 => 2.3917, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.6456 => 0.6715, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.97% (0.4636 => 0.4820, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 3.96% (0.8921 => 0.9274, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3422 => 0.3554, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.63% (1.5859 => 1.6434, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.4186 => 1.4695, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (14.3668 => 14.8619, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4289 => 0.4434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4203 => 0.4342, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.23% (0.3935 => 0.4062, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.22% (2.2024 => 2.2733, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4620 => 0.4768, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.14% (0.4048 => 0.4175, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.94% (0.3603 => 0.3709, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.92% (2.0665 => 2.1268, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2177, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.8101 => 0.8286, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.69% (1.2842 => 1.3059, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3821, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.18% (4.2280 => 4.3626, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7781 => 3.8544, std.dev.: 0.0243) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7881, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2280, std.dev.: 0.0380) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.65% (5.2763 => 3.2369, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.67% (5.3855 => 3.8956, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.33% (5.3526 => 3.8895, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1654, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.48% (2.9384 => 2.6011, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.46% (22.1758 => 20.3003, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2547, std.dev.: 0.1189) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1516, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5007, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4168, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0013, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9905, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5786, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 5.61% (14.9895 => 15.8310, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 3.37% (14.1553 => 14.6318, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.1105 => 4.3079, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.46% (1.1048 => 1.2204, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.93% (7.1582 => 7.3678, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.60% (3.4629 => 3.6568, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.6222 => 0.6341, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 13:39:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 15:39:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914203913.2254D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3816?compare_to=3812&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3816, Order: 163921, Start Time: 2012-09-14 19:26:10, End Time: 2012-09-14 20:40:31 To: 3812, Order: 163910, Start Time: 2012-09-14 17:43:39, End Time: 2012-09-14 18:57:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.68% (78.5083 => 81.3950, std.dev.: 0.5161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.25% (56.5405 => 54.7023, std.dev.: 0.5462) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.95% (2.0176 => 2.3999, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.78% (1.3693 => 1.5032, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.60% (3.9660 => 4.3467, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.49% (0.7061 => 0.7731, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.35% (0.7038 => 0.7696, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.11% (0.7710 => 0.8412, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 9.08% (0.4328 => 0.4721, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.89% (0.5265 => 0.5733, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.77% (1.2193 => 1.3262, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.71% (0.9199 => 1.0000, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.32% (1.4563 => 1.5774, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.30% (1.1364 => 1.2307, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 8.23% (13.8202 => 14.9576, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.98% (0.5577 => 0.6022, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.76% (0.2782 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.70% (0.3246 => 0.3496, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.61% (0.3756 => 0.4042, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.60% (1.0313 => 1.1097, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.56% (1.1061 => 1.1897, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 7.55% (0.2995 => 0.3221, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2760 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.53% (0.7506 => 0.8071, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3489 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.48% (0.2726 => 0.2930, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3578 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.41% (1.9828 => 2.1298, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.31% (0.2914 => 0.3127, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.27% (0.3646 => 0.3911, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.27% (7.2180 => 7.7425, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3107 => 0.3331, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.21% (0.3149 => 0.3376, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.20% (0.4016 => 0.4305, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.18% (0.3914 => 0.4195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2988 => 0.3202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 7.15% (0.3623 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.15% (0.8310 => 0.8904, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2243 => 0.2402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.2925 => 0.3131, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.96% (3.8646 => 4.1337, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3868 => 0.4136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.91% (3.6692 => 3.9227, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 6.89% (0.3192 => 0.3412, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.83% (0.4390 => 0.4690, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.83% (0.3220 => 0.3440, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3534 => 0.3774, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 6.62% (2.1791 => 2.3233, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 6.38% (3.1889 => 3.3922, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.35% (1.9270 => 2.0494, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 6.35% (0.6744 => 0.7172, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.34% (1.3245 => 1.4085, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.15% (16.6129 => 17.6341, std.dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 6.12% (1.0594 => 1.1242, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.07% (14.8535 => 15.7550, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.05% (0.8698 => 0.9224, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (1.3813 => 1.4644, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (1.3819 => 1.4647, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.82% (1.2749 => 1.3491, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (8.4961 => 8.9890, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.72% (0.6135 => 0.6486, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.71% (4.3801 => 4.6302, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.66% (4.4433 => 4.6950, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.65% (0.3755 => 0.3967, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.56% (0.8818 => 0.9308, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.46% (13.2842 => 14.0091, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1333 => 1.1934, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.26% (0.6576 => 0.6922, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2714, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 5.05% (6.5754 => 6.9073, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.99% (3.2742 => 3.4376, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.64% (4.6629 => 4.8792, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2858, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.20% (1.5188 => 1.5826, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1949, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6250 => 0.6509, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.00% (3.7467 => 3.8964, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.99% (6.2785 => 6.5293, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.84% (2.1007 => 2.1813, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.25% (0.3511 => 0.3625, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.12% (33.2944 => 34.3326, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 1.82% (16.2614 => 16.5567, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std.dev.: 0.0392) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6968, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5477, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.49% (10.7476 => 11.1231, std.dev.: 0.0364) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6066, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6023, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.89% (0.4657 => 0.3917, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.60% (22.5627 => 21.7504, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.32% (20.3410 => 18.2412, std.dev.: 0.0509) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.56% (1.3780 => 1.2876, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5125, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.32% (3.0263 => 2.9257, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5956, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.15% (26.5159 => 25.9451, std.dev.: 0.0220) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2481, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2385, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.1080 => 4.0572, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2304, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2632, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 14:58:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 16:58:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914215815.186ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3817?compare_to=3813&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3817, Order: 163928, Start Time: 2012-09-14 20:48:45, End Time: 2012-09-14 21:59:35 To: 3813, Order: 163915, Start Time: 2012-09-14 17:47:41, End Time: 2012-09-14 18:58:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (38 on baseline) Performance Improvements: 2 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (811 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.1844 => 0.2017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.11% (0.8728 => 0.8912, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 1.60% (0.7502 => 0.7622, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.22% (1.8807 => 1.9037, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (4.5063 => 4.9751, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.62% (0.7764 => 0.8356, std.dev.: 0.0226) MultiSource/Benchmarks/llubenchmark/llu: 1.08% (1.9958 => 2.0174, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.56% (1.4124 => 1.3904, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.14% (4.0560 => 4.0096, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.64% (0.9901 => 0.9838, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -0.15% (0.5966 => 0.5957, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: 2.12% (0.1600 => 0.1634, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1543 => 0.1558, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (0.3059 => 0.3064, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.34% (0.2384 => 0.2352, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.25% (0.3153 => 0.3161, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2307 => 0.2304, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 1.64% (0.0428 => 0.0435, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -66.29% (0.0089 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.00% (0.0240 => 0.0204, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.07% (0.0384 => 0.0353, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.01% (0.0297 => 0.0294, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.72% (0.0237 => 0.0279, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0320 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.16% (0.0173 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 31.47% (0.0143 => 0.0188, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 2.05% (0.0244 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -1.53% (0.0326 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1432 => 0.1426, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.13% (1.4132 => 1.5140, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.14% (0.1449 => 0.1509, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.82% (0.4025 => 0.4058, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.87% (0.1376 => 0.1388, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0581 => 0.0591, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.63% (0.0164 => 0.0229, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.30% (0.0642 => 0.0608, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.83% (1.1432 => 1.1527, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.67% (0.0539 => 0.0548, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.11% (0.0148 => 0.0136, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.7800 => 0.7817, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.23% (1.6066 => 1.6103, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.54% (4.1772 => 3.0686, std.dev.: 0.0462) SingleSource/Benchmarks/Shootout-C++/except: 82233.33% (0.0006 => 0.4940, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.65% (0.5309 => 0.5609, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: 4.99% (2.1763 => 2.2849, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.80% (0.6410 => 0.6718, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.7639 => 0.7906, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.1653 => 1.2031, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.48% (1.3268 => 1.3597, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 2.10% (29.3170 => 29.9337, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.5150 => 1.5433, std.dev.: 0.0080) MultiSource/Applications/Burg/burg: 1.61% (1.1440 => 1.1624, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.27% (1.8798 => 1.9037, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.93% (1.7426 => 2.0028, std.dev.: 0.0939) MultiSource/Applications/sgefa/sgefa: 14.26% (0.3746 => 0.4280, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.30% (4.0101 => 4.5433, std.dev.: 0.1307) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 10.61% (0.1433 => 0.1585, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.42% (4.5056 => 4.9751, std.dev.: 0.0161) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6080, std.dev.: 0.0766) SingleSource/Benchmarks/McGill/chomp: 7.01% (1.0194 => 1.0909, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (0.3301 => 0.3526, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2857 => 0.3051, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7914, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: 3.79% (0.9851 => 1.0224, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 2.60% (8.5113 => 8.7330, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 1.67% (14.4877 => 14.7303, std.dev.: 0.0256) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4455 => 2.4840, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5324, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 1.41% (3.5520 => 3.6022, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.15% (2.5166 => 2.5456, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.75% (0.4253 => 0.4136, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.62% (4.2815 => 4.2123, std.dev.: 0.0121) MultiSource/Applications/spiff/spiff: -1.50% (0.7738 => 0.7622, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.31% (4.3380 => 4.2813, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.30% (0.9029 => 0.8912, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.64% (0.3497 => 0.2041, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0914, std.dev.: 0.1316) SingleSource/Benchmarks/Shootout-C++/ary3: -21.10% (1.7473 => 1.3787, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -20.16% (1.1647 => 0.9299, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -9.21% (62.4126 => 56.6623, std.dev.: 0.0762) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (1.4034 => 1.2853, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.17% (2.4457 => 2.2458, std.dev.: 0.0266) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.17% (3.2007 => 2.9391, std.dev.: 0.0463) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.13% (3.6254 => 3.3670, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1853, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -5.98% (1.4441 => 1.3578, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -5.01% (4.6355 => 4.4033, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/ffbench: -4.61% (1.4117 => 1.3466, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.72% (1.7361 => 1.6715, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (9.2503 => 8.9104, std.dev.: 0.0567) MultiSource/Applications/lambda-0_1_3/lambda: -3.34% (7.6833 => 7.4268, std.dev.: 0.0230) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/misr: -3.33% (0.4296 => 0.4153, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.93% (3.9413 => 3.8257, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.93% (3.7496 => 3.6398, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0308) MultiSource/Applications/aha/aha: -2.68% (3.4286 => 3.3366, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.59% (1.1683 => 1.1380, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.52% (22.3381 => 21.7746, std.dev.: 0.1633) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2242, std.dev.: 0.0144) MultiSource/Benchmarks/PAQ8p/paq8p: -1.68% (92.7467 => 91.1889, std.dev.: 0.1932) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3569 => 2.3198, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.45% (1.8739 => 1.8468, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3079, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/oourafft: -1.19% (3.8200 => 3.7747, std.dev.: 0.0166) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.42% (0.9980 => 0.9838, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -1.08% (0.6022 => 0.5957, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: -1.92% (0.1666 => 0.1634, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.26% (0.1554 => 0.1558, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.62% (0.3083 => 0.3064, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.75% (0.2394 => 0.2352, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.44% (0.3175 => 0.3161, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.09% (0.2302 => 0.2304, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -3.12% (0.0449 => 0.0435, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.00% (0.0240 => 0.0204, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.49% (0.0390 => 0.0353, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 0.81% (1.5019 => 1.5140, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.53% (0.1501 => 0.1509, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.83% (0.4264 => 0.4058, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.27% (0.1344 => 0.1388, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.34% (0.0589 => 0.0591, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.29% (0.0232 => 0.0229, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.85% (0.0639 => 0.0608, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.56% (1.1350 => 1.1527, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.72% (0.0246 => 0.0136, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.66% (0.7541 => 0.7817, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.82% (1.5363 => 1.6103, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 15:17:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 17:17:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120914221748.9E2F72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3818?compare_to=3815&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3818, Order: 163928, Start Time: 2012-09-14 20:59:26, End Time: 2012-09-14 22:19:08 To: 3815, Order: 163921, Start Time: 2012-09-14 19:11:18, End Time: 2012-09-14 20:30:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (130 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (717 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (79.3041 => 80.9242, std.dev.: 0.4503) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.47% (55.6170 => 56.4347, std.dev.: 0.0322) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.70% (0.5676 => 0.5716, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.29% (15.8310 => 15.8766, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 0.45% (14.6318 => 14.6976, std.dev.: 0.0253) MultiSource/Benchmarks/Bullet/bullet: -0.14% (82.4826 => 82.3652, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3079 => 4.3105, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.2204 => 1.2224, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.28% (7.3678 => 7.3885, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.11% (3.6568 => 3.6608, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.35% (0.6341 => 0.6363, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1427 => 0.1428, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.23% (63.2438 => 82.3652, std.dev.: 0.0098) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14252.08% (0.0720 => 10.3335, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.37% (10.3673 => 14.5524, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 25.59% (0.1622 => 0.2037, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.44% (2.2022 => 2.4981, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.04% (7.0540 => 7.9739, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2539, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.02% (1.7609 => 1.9550, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.94% (10.4361 => 11.4735, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.33% (9.4845 => 10.1795, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.4879 => 0.5218, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5925 => 0.6325, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.68% (0.6030 => 0.6433, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 6.66% (0.3109 => 0.3316, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7433 => 0.7923, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2554 => 0.2719, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.44% (0.2700 => 0.2874, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.43% (0.1695 => 0.1804, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2271 => 0.2412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.14% (0.7115 => 0.7552, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.13% (0.3423 => 0.3633, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.13% (8.1363 => 8.6351, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5860 => 0.6219, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.11% (5.7591 => 6.1108, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.3050 => 1.3838, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.02% (0.6675 => 0.7077, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.95% (0.5105 => 0.5409, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (4.2646 => 4.5177, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 5.92% (3.3354 => 3.5330, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.90% (0.8172 => 0.8654, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.89% (5.0018 => 5.2965, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.5415 => 1.6318, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.84% (0.5569 => 0.5894, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.8067 => 0.8532, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.9449 => 5.2276, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.70% (0.2107 => 0.2227, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 5.64% (0.7835 => 0.8277, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 5.61% (0.7326 => 0.7737, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2758 => 0.2911, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1940 => 0.2047, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9765 => 1.0288, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (0.3092 => 0.3256, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.27% (1.5603 => 1.6426, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.23% (1.1642 => 1.2251, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 5.19% (0.4299 => 0.4522, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (7.9617 => 8.3607, std.dev.: 0.0158) MultiSource/Applications/lua/lua: 4.95% (3.8723 => 4.0638, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.1861 => 1.2444, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.88% (0.3441 => 0.3609, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5020 => 0.5259, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.54% (21.9371 => 22.9341, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.39% (0.6450 => 0.6733, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.36% (2.2969 => 2.3970, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.30% (2.0273 => 2.1145, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.29% (0.4636 => 0.4835, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8921 => 0.9303, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.24% (0.4103 => 0.4277, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.4064 => 0.4234, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5981 => 0.6225, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.99% (0.4289 => 0.4460, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.80% (1.5859 => 1.6461, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3650 => 0.3788, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (14.3668 => 14.8938, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.66% (0.3826 => 0.3966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.4186 => 1.4705, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.4203 => 0.4354, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3817 => 0.3950, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.44% (0.3136 => 0.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.4048 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.4620 => 0.4775, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (2.2024 => 2.2762, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.28% (0.3603 => 0.3721, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0665 => 2.1338, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 3.20% (0.3283 => 0.3388, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.1840 => 1.2212, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.12% (0.3684 => 0.3799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.8101 => 0.8297, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2842 => 1.3099, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3882, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.8922 => 3.9351, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (4.2280 => 4.3583, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7495, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 1.26% (2.2771 => 2.3059, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7886, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2227, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.61% (5.2763 => 3.2391, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.09% (5.3855 => 3.8726, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.75% (5.3526 => 3.8674, std.dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1363, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.13% (2.9384 => 2.5821, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -8.45% (22.1758 => 20.3022, std.dev.: 0.0279) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.69% (1.5373 => 1.3730, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2868, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7161, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.79% (1.6805 => 1.5832, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8040, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1507, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -3.22% (1.2373 => 1.1975, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5042, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4293, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0073, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9952, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5773, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.31% (0.5229 => 0.5716, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 5.92% (14.9895 => 15.8766, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 3.83% (14.1553 => 14.6976, std.dev.: 0.0253) MultiSource/Benchmarks/MallocBench/gs/gs: 4.87% (4.1105 => 4.3105, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.64% (1.1048 => 1.2224, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.22% (7.1582 => 7.3885, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.71% (3.4629 => 3.6608, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.6222 => 0.6363, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 15:21:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 17:21:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120914222146.D5B712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3819?compare_to=3816&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3819, Order: 163935, Start Time: 2012-09-14 21:08:43, End Time: 2012-09-14 22:23:05 To: 3816, Order: 163921, Start Time: 2012-09-14 19:26:10, End Time: 2012-09-14 20:40:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (164 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.7023 => 56.5323, std.dev.: 0.0333) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.32% (81.3950 => 80.3191, std.dev.: 0.3645) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.81% (2.0176 => 2.3972, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.89% (0.1410 => 0.1620, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.53% (1.3693 => 1.4998, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.34% (3.9660 => 4.3364, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.11% (0.7710 => 0.8412, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.01% (0.5818 => 0.6342, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.82% (0.2596 => 0.2825, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5748 => 0.6255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.58% (0.5265 => 0.5717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.51% (1.2193 => 1.3231, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.37% (0.9199 => 0.9969, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.33% (0.6959 => 0.7539, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.2721 => 0.2947, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.05% (1.1364 => 1.2279, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.98% (1.4563 => 1.5725, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.89% (13.8202 => 14.9109, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.6283 => 0.6761, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.44% (0.5577 => 0.5992, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.27% (1.0313 => 1.1063, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.08% (0.3756 => 0.4022, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2655 => 0.2843, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.07% (1.9828 => 2.1229, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.03% (1.1061 => 1.1839, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.93% (7.2180 => 7.7182, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4016 => 0.4294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.2914 => 0.3113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2761 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.71% (0.8310 => 0.8868, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.71% (3.8646 => 4.1241, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 6.70% (0.2925 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3868 => 0.4126, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.63% (0.7506 => 0.8004, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3578 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.60% (3.6692 => 3.9114, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.4390 => 0.4679, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.50% (0.3646 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3220 => 0.3429, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.47% (0.3601 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.47% (0.3650 => 0.3886, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.44% (0.3663 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.44% (0.3914 => 0.4166, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.41% (0.3789 => 0.4032, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.39% (0.7460 => 0.7937, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 6.34% (0.3534 => 0.3758, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.29% (0.3940 => 0.4188, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.26% (2.1791 => 2.3156, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: 6.18% (0.6744 => 0.7161, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.17% (3.1889 => 3.3855, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (1.3245 => 1.4039, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.92% (1.9270 => 2.0411, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 5.89% (1.0594 => 1.1218, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.74% (1.2749 => 1.3481, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.73% (1.3813 => 1.4605, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.73% (0.8698 => 0.9196, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.71% (0.4113 => 0.4348, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.70% (1.3819 => 1.4607, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.68% (0.8818 => 0.9319, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 5.68% (16.6129 => 17.5558, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 5.65% (14.8535 => 15.6926, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 5.53% (8.4961 => 8.9656, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6167, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.39% (4.4433 => 4.6830, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6135 => 0.6464, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (13.2842 => 13.9882, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.6576 => 0.6918, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.14% (0.3131 => 0.3292, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (1.1333 => 1.1895, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.91% (14.5298 => 15.2436, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2321 => 0.2431, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (6.5754 => 6.8867, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.70% (3.2742 => 3.4282, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.68% (0.3245 => 0.3397, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.58% (4.6629 => 4.8764, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2292 => 1.2833, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.11% (0.9108 => 0.9482, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6250 => 0.6495, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.91% (4.9865 => 5.1816, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5188 => 1.5769, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 3.67% (3.7467 => 3.8841, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (6.2785 => 6.4975, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.1007 => 2.1731, std.dev.: 0.0182) MultiSource/Benchmarks/Bullet/bullet: 2.89% (33.2944 => 34.2554, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.58% (16.2614 => 16.5184, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (3.1736 => 3.4184, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.74% (12.0921 => 12.5448, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.98% (10.7476 => 11.0679, std.dev.: 0.0517) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5997, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5160, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6007, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.91% (22.5627 => 21.6796, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2875, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.82% (1.3780 => 1.2978, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1508, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.35% (3.0263 => 2.9248, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5995, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.21% (26.5159 => 25.9287, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8670, std.dev.: 0.0179) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2367, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0601, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2553, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4312, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 16:11:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 18:11:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120914231112.D066F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3820?compare_to=3814&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3820, Order: 163928, Start Time: 2012-09-14 20:28:42, End Time: 2012-09-14 23:12:33 To: 3814, Order: 163909, Start Time: 2012-09-14 17:16:44, End Time: 2012-09-14 20:00:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.62% (2.0557 => 2.1301, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.02% (125.7306 => 129.5252, std.dev.: 0.9590) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3446 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.84% (0.3488 => 0.3901, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.80% (0.3442 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.72% (0.3465 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.62% (0.3469 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.56% (0.3460 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.29% (0.3650 => 0.4062, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.20% (0.3643 => 0.4051, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.01% (0.3724 => 0.4134, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.03% (1.5932 => 1.7211, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5826 => 0.6225, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.57% (2.7292 => 2.9085, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.44% (1.3152 => 1.3999, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.35% (0.4361 => 0.4638, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (3.5627 => 3.7868, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.21% (1.6211 => 1.7218, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.16% (0.5000 => 0.5308, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.2014 => 0.2131, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.72% (5.5417 => 5.8588, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.69% (0.4994 => 0.5278, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.62% (1.0781 => 1.1387, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.46% (0.3004 => 0.3168, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.41% (0.3195 => 0.3368, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.41% (0.7171 => 0.7559, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (0.3930 => 0.4141, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2875 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.23% (0.2813 => 0.2960, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.21% (0.9909 => 1.0425, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 5.20% (23.5202 => 24.7428, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (0.5026 => 0.5286, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 5.05% (0.2750 => 0.2889, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (2.1653 => 2.2743, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2823 => 0.2965, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.01% (4.2109 => 4.4220, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.2736 => 0.2873, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.00% (2.1013 => 2.2064, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.98% (0.2792 => 0.2931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2738 => 0.2874, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.96% (0.2780 => 0.2918, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2725 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.94% (2.0673 => 2.1694, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.92% (0.2803 => 0.2941, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.2866 => 0.3007, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.5900 => 0.6188, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 4.87% (0.2811 => 0.2948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.85% (0.3317 => 0.3478, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.84% (0.3060 => 0.3208, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3124 => 0.3275, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.81% (4.6177 => 4.8398, std.dev.: 0.0108) MultiSource/Applications/siod/siod: 4.78% (0.6634 => 0.6951, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (4.4195 => 4.6292, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3258 => 0.3412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.70% (0.4251 => 0.4451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.69% (0.3477 => 0.3640, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3678 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3362 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.64% (0.4139 => 0.4331, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (0.3890 => 0.4068, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (1.8794 => 1.9652, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3625 => 0.3790, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.3348 => 0.3500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4146 => 0.4334, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.51% (0.3726 => 0.3894, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3690 => 0.3856, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.3903 => 0.4077, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 4.42% (1.4269 => 1.4900, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3282 => 0.3426, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.35% (1.9694 => 2.0551, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.29% (0.5546 => 0.5784, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.25% (1.9966 => 2.0814, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.21% (0.9697 => 1.0105, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.3981 => 0.4148, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.05% (0.3084 => 0.3209, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.6435 => 0.6695, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.98% (0.3845 => 0.3998, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.5012 => 0.5211, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.80% (0.7875 => 0.8174, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 3.78% (0.3336 => 0.3462, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.2737 => 0.2838, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.41% (2.0346 => 2.1039, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 2.99% (0.4847 => 0.4992, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.97% (0.5361 => 0.5520, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (0.7426 => 0.7641, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (0.5584 => 0.5734, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (11.6398 => 11.9153, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.30% (4.6926 => 4.8003, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.58% (3.3903 => 3.6134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6692, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6290, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.31% (2.0820 => 2.1301, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2079, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5068, std.dev.: 0.0253) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4347, std.dev.: 0.0249) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5829, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5582, std.dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7866, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7925, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -3.13% (17.2379 => 16.6975, std.dev.: 0.0986) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.47% (16.2163 => 15.9787, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 16:27:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 18:27:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120914232746.644D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3821?compare_to=3817&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3821, Order: 163942, Start Time: 2012-09-14 22:17:42, End Time: 2012-09-14 23:29:07 To: 3817, Order: 163928, Start Time: 2012-09-14 20:48:45, End Time: 2012-09-14 21:59:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (59 on baseline) Performance Improvements: 2 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 889 (797 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.92% (8.8819 => 9.3191, std.dev.: 0.0833) MultiSource/Applications/siod/siod: 1.65% (2.1233 => 2.1583, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (1.0617 => 1.0785, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 8.97% (3.0122 => 3.2824, std.dev.: 0.0910) MultiSource/Benchmarks/Olden/tsp/tsp: 4.38% (1.7559 => 1.8328, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (41.9344 => 43.4905, std.dev.: 0.2690) SingleSource/Benchmarks/Shootout/ary3: 2.11% (2.0028 => 2.0450, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 1.95% (15.5782 => 15.8824, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.94% (2.6847 => 2.7369, std.dev.: 0.0159) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.85% (2.8307 => 2.8832, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.49% (0.5694 => 0.5552, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.96% (4.9751 => 4.5292, std.dev.: 0.1282) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.44% (0.9838 => 0.9795, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 0.60% (0.5957 => 0.5993, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 1.53% (0.1634 => 0.1659, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1558 => 0.1555, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (0.3064 => 0.3126, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.77% (0.2352 => 0.2334, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.60% (0.3161 => 0.3180, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.30% (0.2304 => 0.2311, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -3.22% (0.0435 => 0.0421, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -6.82% (0.0088 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 193.33% (0.0030 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.78% (0.0204 => 0.0226, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0190 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.63% (0.0353 => 0.0387, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.61% (0.0294 => 0.0254, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.79% (0.0279 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0318 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 2.86% (0.0175 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.13% (0.0188 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.56% (0.0321 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1426 => 0.1435, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -4.03% (1.5140 => 1.4530, std.dev.: 0.0464) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.33% (0.1509 => 0.1489, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.65% (0.4058 => 0.4125, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1388 => 0.1488, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.21% (0.0591 => 0.0572, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.31% (0.0229 => 0.0232, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.80% (0.0608 => 0.0591, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1527 => 1.1480, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.36% (0.0548 => 0.0550, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.94% (0.0136 => 0.0140, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7817 => 0.7810, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.32% (1.6103 => 1.6052, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.49% (0.0121 => 0.0095, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.59% (4.1772 => 3.0666, std.dev.: 0.0573) SingleSource/Benchmarks/Shootout-C++/except: 82566.67% (0.0006 => 0.4960, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.06% (0.0745 => 0.0887, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.65% (0.5309 => 0.5662, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.55% (0.6410 => 0.6766, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: 5.10% (2.1763 => 2.2874, std.dev.: 0.0261) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.49% (0.3582 => 0.3743, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.2552 => 0.2664, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 4.13% (1.1653 => 1.2134, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 3.92% (0.6173 => 0.6415, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 3.75% (1.0046 => 1.0423, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: 3.57% (8.9977 => 9.3191, std.dev.: 0.0833) MultiSource/Applications/kimwitu++/kc: 3.51% (15.3105 => 15.8474, std.dev.: 0.1160) MultiSource/Applications/lambda-0_1_3/lambda: 3.24% (0.6915 => 0.7139, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 2.91% (2.0972 => 2.1583, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.45% (0.7639 => 0.7826, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.40% (0.4248 => 0.4350, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6069 => 0.6209, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.86% (1.3268 => 1.3515, std.dev.: 0.0069) MultiSource/Applications/d/make_dparser: 1.65% (3.0225 => 3.0724, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: 22.77% (3.4629 => 4.2514, std.dev.: 0.0325) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.75% (0.0766 => 0.0902, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 17.35% (1.7426 => 2.0450, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.61% (0.0917 => 0.1051, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 14.36% (0.3746 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5525, std.dev.: 0.0170) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.51% (7.0025 => 7.5987, std.dev.: 0.0531) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.49% (3.0256 => 3.2824, std.dev.: 0.0910) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.46% (0.2857 => 0.3070, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.44% (40.4792 => 43.4905, std.dev.: 0.2690) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.31% (1.0063 => 1.0799, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.13% (0.2694 => 0.2886, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (0.3301 => 0.3531, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/chomp: 6.71% (1.0194 => 1.0878, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.20% (27.1724 => 28.8561, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/tsp/tsp: 5.76% (1.7330 => 1.8328, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/dt: 4.59% (0.9851 => 1.0303, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.32% (15.2242 => 15.8824, std.dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std.dev.: 0.0296) MultiSource/Benchmarks/Olden/power/power: 3.31% (1.4184 => 1.4654, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.6308 => 0.6511, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.67% (2.6656 => 2.7369, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5113 => 8.7242, std.dev.: 0.0683) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.47% (0.5876 => 0.6021, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 2.30% (5.1938 => 5.3132, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.6127 => 4.7055, std.dev.: 0.0270) MultiSource/Applications/hexxagon/hexxagon: 1.81% (14.4877 => 14.7501, std.dev.: 0.0066) MultiSource/Applications/siod/siod: 1.74% (3.5520 => 3.6137, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4854, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/whetstone: 1.59% (2.3453 => 2.3825, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5347, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.36% (38.9255 => 39.4543, std.dev.: 0.1931) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.24% (4.0659 => 4.1164, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.23% (2.9152 => 2.9512, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: 1.12% (2.8599 => 2.8918, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.5166 => 2.5436, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: 1.01% (2.4013 => 2.4256, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.92% (0.1841 => 0.1732, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.28% (0.5740 => 0.5552, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: -2.97% (0.7738 => 0.7508, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.45% (1.4189 => 1.3983, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.36% (5.2665 => 4.1945, std.dev.: 0.1647) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.31% (1.1647 => 0.9398, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: -17.41% (1.7473 => 1.4431, std.dev.: 0.0912) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -9.30% (62.4126 => 56.6101, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.28% (2.4457 => 2.2431, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.05% (3.2007 => 2.9429, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.27% (3.6254 => 3.3620, std.dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: -6.57% (3.4230 => 3.1980, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7919, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -5.00% (4.6355 => 4.4038, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/ffbench: -4.70% (1.4117 => 1.3453, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.38% (1.7361 => 1.6600, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/methcall: -3.85% (9.2503 => 8.8944, std.dev.: 0.0415) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.79% (0.4140 => 0.3983, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -3.20% (7.6833 => 7.4377, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8293, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.63% (9.5474 => 9.2960, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.50% (3.7496 => 3.6560, std.dev.: 0.0142) MultiSource/Applications/aha/aha: -2.48% (3.4286 => 3.3436, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.19% (1.2722 => 1.2443, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -1.77% (3.8907 => 3.8217, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.39% (9.3855 => 9.2554, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3204, std.dev.: 0.0705) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.85% (0.9980 => 0.9795, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -0.48% (0.6022 => 0.5993, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1666 => 0.1659, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (0.3083 => 0.3126, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.51% (0.2394 => 0.2334, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (0.3175 => 0.3180, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.39% (0.2302 => 0.2311, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -6.24% (0.0449 => 0.0421, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -7.87% (0.0089 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.83% (0.0240 => 0.0226, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.61% (0.0301 => 0.0254, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1429 => 0.1435, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -3.26% (1.5019 => 1.4530, std.dev.: 0.0464) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.80% (0.1501 => 0.1489, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.26% (0.4264 => 0.4125, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.71% (0.1344 => 0.1488, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.0589 => 0.0572, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.51% (0.0639 => 0.0591, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.15% (1.1350 => 1.1480, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.09% (0.0246 => 0.0140, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.57% (0.7541 => 0.7810, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.48% (1.5363 => 1.6052, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.71% (0.0070 => 0.0095, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 17:04:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 19:04:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915000411.996132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3822?compare_to=3819&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3822, Order: 163942, Start Time: 2012-09-14 22:51:18, End Time: 2012-09-15 00:05:31 To: 3819, Order: 163935, Start Time: 2012-09-14 21:08:43, End Time: 2012-09-14 22:23:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.95% (2.0176 => 2.4000, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.30% (1.3693 => 1.4967, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.28% (0.7061 => 0.7716, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.26% (3.9660 => 4.3334, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.14% (0.7710 => 0.8415, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5748 => 0.6266, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 8.77% (0.7038 => 0.7655, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.60% (0.5265 => 0.5718, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.45% (0.9199 => 0.9976, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.41% (1.2193 => 1.3218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.36% (0.6959 => 0.7541, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 8.32% (0.4328 => 0.4688, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.17% (1.1364 => 1.2293, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.06% (0.1327 => 0.1434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.03% (1.4563 => 1.5733, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.93% (0.5577 => 0.6019, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.85% (13.8202 => 14.9045, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6283 => 0.6751, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.41% (0.2781 => 0.2987, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.28% (0.3899 => 0.4183, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.25% (1.0313 => 1.1061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.24% (0.3246 => 0.3481, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.18% (0.3578 => 0.3835, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.12% (0.4791 => 0.5132, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3485 => 0.3732, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3022 => 0.3236, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7270, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.94% (0.3489 => 0.3731, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.93% (1.1061 => 1.1827, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.92% (0.5637 => 0.6027, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 6.88% (0.2995 => 0.3201, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3756 => 0.4013, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 6.83% (0.7506 => 0.8019, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.82% (0.3650 => 0.3899, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3789 => 0.4047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (1.9828 => 2.1177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.77% (0.3914 => 0.4179, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.76% (0.3580 => 0.3822, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.75% (3.6692 => 3.9170, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.74% (0.4003 => 0.4273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.72% (0.4016 => 0.4286, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.72% (0.3663 => 0.3909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3623 => 0.3866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.69% (0.8310 => 0.8866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2726 => 0.2908, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.65% (0.3293 => 0.3512, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.60% (0.2925 => 0.3118, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.58% (0.7460 => 0.7951, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.57% (3.8646 => 4.1185, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.54% (0.2937 => 0.3129, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.50% (0.3940 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3220 => 0.3425, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.31% (0.4390 => 0.4667, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.27% (3.1889 => 3.3887, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.17% (1.3819 => 1.4672, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.17% (1.3813 => 1.4665, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 6.15% (2.1791 => 2.3131, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 6.09% (0.6744 => 0.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (1.3245 => 1.4046, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.01% (1.9270 => 2.0429, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 5.88% (1.0594 => 1.1217, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.78% (1.2749 => 1.3486, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.73% (14.8535 => 15.7049, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 5.64% (0.4113 => 0.4345, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.63% (16.6129 => 17.5486, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.50% (4.3801 => 4.6212, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.8698 => 0.9176, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (4.4433 => 4.6869, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 5.47% (8.4961 => 8.9610, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.25% (0.6576 => 0.6921, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.22% (0.6135 => 0.6455, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.21% (0.3131 => 0.3294, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.19% (0.8818 => 0.9276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (13.2842 => 13.9615, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 5.07% (14.5298 => 15.2663, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.05% (1.1333 => 1.1905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3755 => 0.3943, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.2504 => 0.2628, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.77% (6.5754 => 6.8891, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.62% (0.3245 => 0.3395, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.57% (4.6629 => 4.8761, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.48% (3.2742 => 3.4210, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.9865 => 5.1920, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.04% (0.4805 => 0.4999, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (0.9108 => 0.9459, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.75% (3.7467 => 3.8872, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.5188 => 1.5757, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.6250 => 0.6478, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2785 => 6.5074, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.1007 => 2.1704, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.40% (33.2944 => 34.0942, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5499, std.dev.: 0.0202) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5112, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 26.40% (1.8175 => 2.2973, std.dev.: 0.0346) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6968, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5478, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1024, std.dev.: 0.0342) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4271 => 7.6143, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5953, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.15% (0.4657 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.08% (22.5627 => 21.6421, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.96% (20.3410 => 18.3143, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.69% (1.3780 => 1.2996, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.7688 => 1.7053, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9246, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8971, std.dev.: 0.0423) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2418, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0585, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2337, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5616, std.dev.: 0.0134) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4342, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.01% (7.3305 => 7.2568, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 17:05:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 19:05:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915000539.AF2102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3823?compare_to=3818&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3823, Order: 163942, Start Time: 2012-09-14 22:47:27, End Time: 2012-09-15 00:06:59 To: 3818, Order: 163928, Start Time: 2012-09-14 20:59:26, End Time: 2012-09-14 22:19:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.91% (0.5352 => 0.5454, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.68% (0.5716 => 0.5677, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.37% (15.8766 => 15.8186, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: -0.29% (14.6976 => 14.6545, std.dev.: 0.0198) MultiSource/Benchmarks/Bullet/bullet: 0.47% (82.3652 => 82.7549, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: -0.09% (4.3105 => 4.3065, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2224 => 1.2207, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.18% (7.3885 => 7.3749, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.07% (3.6608 => 3.6584, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.6363 => 0.6366, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1428 => 0.1427, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0649 => 0.0646, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.85% (63.2438 => 82.7549, std.dev.: 0.0073) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.14% (0.0720 => 10.3285, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.85% (10.3673 => 14.4985, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 26.63% (0.1622 => 0.2054, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.61% (2.2022 => 2.5019, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.07% (7.0540 => 7.9763, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.19% (1.1194 => 1.2558, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.83% (1.7609 => 1.9516, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.72% (0.3828 => 0.4200, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.68% (0.3927 => 0.4307, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 9.55% (10.4361 => 11.4323, std.dev.: 0.0200) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.17% (9.4845 => 10.1649, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.56% (0.3109 => 0.3313, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.50% (0.7433 => 0.7916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.37% (0.4615 => 0.4909, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2700 => 0.2867, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.18% (0.5860 => 0.6222, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.17% (0.6030 => 0.6402, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.07% (0.2554 => 0.2709, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.97% (0.7115 => 0.7540, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.6675 => 0.7071, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.3050 => 1.3817, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 5.87% (0.3423 => 0.3624, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (8.1363 => 8.6113, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 5.84% (5.7591 => 6.0952, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (4.2646 => 4.5134, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.74% (0.8172 => 0.8641, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.72% (3.3354 => 3.5261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.69% (0.5569 => 0.5886, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.68% (5.0018 => 5.2860, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.68% (1.5415 => 1.6290, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.64% (0.5105 => 0.5393, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.63% (1.5603 => 1.6482, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.50% (0.7835 => 0.8266, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.48% (4.9449 => 5.2157, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.42% (0.8067 => 0.8504, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.40% (0.2758 => 0.2907, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4299 => 0.4527, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.25% (0.9765 => 1.0278, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.17% (0.3092 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.99% (1.1642 => 1.2223, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.84% (0.5020 => 0.5263, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.80% (7.9617 => 8.3437, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.70% (1.1861 => 1.2418, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (0.3180 => 0.3329, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.65% (1.0722 => 1.1221, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.59% (3.8723 => 4.0502, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4636 => 0.4847, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 4.52% (0.6456 => 0.6748, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.4064 => 0.4245, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.4103 => 0.4282, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.29% (2.0273 => 2.1143, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.2831 => 0.2952, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.25% (0.6450 => 0.6724, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.22% (0.2891 => 0.3013, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 4.20% (0.8921 => 0.9296, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9371 => 22.8515, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.14% (0.3865 => 0.4025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3650 => 0.3801, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.08% (0.3826 => 0.3982, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.06% (2.2969 => 2.3901, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.05% (0.5981 => 0.6223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4289 => 0.4462, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.95% (0.3136 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.90% (0.4203 => 0.4367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2872 => 0.2980, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (2.0665 => 2.1442, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3283 => 0.3406, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.73% (0.4048 => 0.4199, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.69% (0.3603 => 0.3736) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (1.5859 => 1.6428, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.58% (0.2793 => 0.2893, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.4186 => 1.4684, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.3684 => 0.3813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.34% (0.3379 => 0.3492, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (14.3668 => 14.8378, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.23% (2.2024 => 2.2735, std.dev.: 0.0182) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.1840 => 1.2201, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2842 => 1.3132, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.8101 => 0.8275, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7483, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3543, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2309, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.58% (5.2763 => 3.2406, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.18% (5.3855 => 3.8676, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.85% (5.3526 => 3.8620, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2557, std.dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.63% (2.9384 => 2.5967, std.dev.: 0.0245) MultiSource/Applications/ClamAV/clamscan: -8.59% (22.1758 => 20.2715, std.dev.: 0.0364) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.17% (1.6925 => 1.4189, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2484, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5057, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4250, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9850, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.85% (1.3677 => 1.3287, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -2.55% (1.2373 => 1.2057, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0070, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5794, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2231, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.57% (0.5229 => 0.5677, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.53% (14.9895 => 15.8186, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 3.53% (14.1553 => 14.6545, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 4.77% (4.1105 => 4.3065, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.49% (1.1048 => 1.2207, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.03% (7.1582 => 7.3749, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.65% (3.4629 => 3.6584, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (0.6222 => 0.6366, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 17:55:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 19:55:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915005526.F2C112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3824?compare_to=3821&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3824, Order: 163948, Start Time: 2012-09-14 23:45:13, End Time: 2012-09-15 00:56:47 To: 3821, Order: 163942, Start Time: 2012-09-14 22:17:42, End Time: 2012-09-14 23:29:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (46 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2958 => 0.3093, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.35% (1.3991 => 1.4180, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.12% (1.3238 => 1.4181, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.31% (0.7569 => 0.7895, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.25% (21.4745 => 22.1731, std.dev.: 0.2329) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.0799 => 1.0916, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -2.56% (1.2928 => 1.2597, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.16% (0.9795 => 0.9909, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -0.90% (0.5993 => 0.5939, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -4.04% (0.1659 => 0.1592, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.79% (0.1555 => 0.1496, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.49% (0.3126 => 0.3017, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.39% (0.2334 => 0.2343, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.22% (0.3180 => 0.3173, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.82% (0.2311 => 0.2292, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 7.36% (0.0421 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 6.10% (0.0082 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.14% (0.0088 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.31% (0.0226 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.65% (0.0191 => 0.0121, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0387 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.93% (0.0254 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.84% (0.0321 => 0.0283, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -1.11% (0.0180 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.04% (0.0192 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.70% (0.0243 => 0.0252, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -15.03% (0.0326 => 0.0277, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1435 => 0.1431, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -0.43% (1.4530 => 1.4468, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.41% (0.1489 => 0.1468, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.42% (0.4125 => 0.4225, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.33% (0.1488 => 0.1379, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.72% (0.0572 => 0.0545, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.45% (0.0232 => 0.0166, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.97% (0.0591 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1480 => 1.1456, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.18% (0.0550 => 0.0527, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0140 => 0.0140, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.58% (0.7810 => 0.7855, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.42% (1.6052 => 1.6119, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.32% (0.0095 => 0.0089, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.68% (4.1772 => 3.0210, std.dev.: 0.0521) SingleSource/Benchmarks/Shootout-C++/except: 82116.67% (0.0006 => 0.4933, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.18% (0.0745 => 0.0873, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 7.44% (0.5309 => 0.5704, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 6.51% (2.1763 => 2.3179, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.2552 => 0.2702, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.46% (0.6410 => 0.6760, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.05% (0.3582 => 0.3727, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.77% (0.6173 => 0.6406, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 3.44% (0.6915 => 0.7153, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 3.14% (1.0046 => 1.0361, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 3.08% (15.3105 => 15.7825, std.dev.: 0.1472) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.7639 => 0.7873, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 2.59% (29.3170 => 30.0756, std.dev.: 0.1564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.59% (0.6069 => 0.6226, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.5150 => 1.5507, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.76% (1.3935 => 1.4180, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.06% (1.1672 => 1.1796, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/ary3: 14.81% (1.7426 => 2.0007, std.dev.: 0.0955) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.39% (4.0101 => 4.5470, std.dev.: 0.0245) SingleSource/Benchmarks/Stanford/Puzzle: 13.05% (0.1433 => 0.1620, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.32% (0.2694 => 0.2972, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 9.36% (7.0025 => 7.6577, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.48% (1.0063 => 1.0916, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.81% (40.4792 => 43.6397, std.dev.: 0.1732) SingleSource/Benchmarks/McGill/chomp: 6.67% (1.0194 => 1.0874, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7940, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/fp-convert: 4.53% (15.2242 => 15.9139, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/dt: 4.37% (0.9851 => 1.0281, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.76% (0.7609 => 0.7895, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.42% (2.6656 => 2.7567, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 3.33% (1.4184 => 1.4656, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 3.17% (5.1938 => 5.3582, std.dev.: 0.0472) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3508 => 0.3612, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5113 => 8.7531, std.dev.: 0.0537) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.14% (0.5876 => 0.6002, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (2.4455 => 2.4862, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7229, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.50% (1.6110 => 1.6352, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.09% (1.4324 => 1.4480, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 1.08% (2.5166 => 2.5439, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.99% (0.7738 => 0.7507, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.12% (0.3497 => 0.2059, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.39% (5.2665 => 4.1399, std.dev.: 0.1169) SingleSource/Benchmarks/Shootout-C++/ary3: -20.13% (1.7473 => 1.3956, std.dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.46% (1.1647 => 0.9380, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1594, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.38% (62.4126 => 56.5552, std.dev.: 0.1866) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.76% (2.4457 => 2.2315, std.dev.: 0.0498) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.61% (1.4034 => 1.2825, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.95% (3.2007 => 2.9464, std.dev.: 0.0299) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.06% (3.6254 => 3.3693, std.dev.: 0.0475) MultiSource/Applications/SIBsim4/SIBsim4: -6.93% (3.4230 => 3.1857, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7922, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/richards_benchmark: -5.39% (1.4441 => 1.3662, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.24% (0.4140 => 0.3923, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4103, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: -4.36% (1.4117 => 1.3501, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.04% (1.7361 => 1.6660, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9422, std.dev.: 0.0475) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.13% (1.1683 => 1.1317, std.dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (7.6833 => 7.4452, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8297, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6439, std.dev.: 0.0163) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.79% (1.2959 => 1.2597, std.dev.: 0.0120) MultiSource/Applications/aha/aha: -2.74% (3.4286 => 3.3347, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.53% (45.4683 => 44.3193, std.dev.: 0.3741) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.40% (1.2722 => 1.2417, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -1.79% (3.4876 => 3.4251, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2322, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -1.63% (92.7467 => 91.2348, std.dev.: 0.1442) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3302, std.dev.: 0.0184) MultiSource/Benchmarks/sim/sim: -1.29% (3.8907 => 3.8406, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/oourafft: -1.28% (3.8200 => 3.7711, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: -1.27% (16.5617 => 16.3521, std.dev.: 0.0761) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.3569 => 2.3281, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.71% (0.9980 => 0.9909, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -1.38% (0.6022 => 0.5939, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -4.44% (0.1666 => 0.1592, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.73% (0.1554 => 0.1496, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.14% (0.3083 => 0.3017, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.13% (0.2394 => 0.2343, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3175 => 0.3173, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.43% (0.2302 => 0.2292, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0449 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.98% (0.0192 => 0.0121, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.65% (0.0324 => 0.0283, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -14.77% (0.0325 => 0.0277, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -3.67% (1.5019 => 1.4468, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.20% (0.1501 => 0.1468, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.91% (0.4264 => 0.4225, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.60% (0.1344 => 0.1379, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.47% (0.0589 => 0.0545, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.45% (0.0232 => 0.0166, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.78% (0.0639 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.93% (1.1350 => 1.1456, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.27% (0.0637 => 0.0527, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.09% (0.0246 => 0.0140, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.16% (0.7541 => 0.7855, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.92% (1.5363 => 1.6119, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.14% (0.0070 => 0.0089, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 18:46:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 20:46:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915014650.E27052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3825?compare_to=3822&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3825, Order: 163950, Start Time: 2012-09-15 00:33:48, End Time: 2012-09-15 01:48:10 To: 3822, Order: 163942, Start Time: 2012-09-14 22:51:18, End Time: 2012-09-15 00:05:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (165 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5894 => 56.5220, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/fbench: 2.86% (2.2973 => 2.3629, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.14% (2.0176 => 2.4037, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.89% (0.1410 => 0.1620, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.76% (1.3693 => 1.5030, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.27% (0.7710 => 0.8425, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.27% (3.9660 => 4.3337, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.68% (0.5265 => 0.5722, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.47% (1.2193 => 1.3226, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.38% (0.9199 => 0.9970, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.36% (0.1327 => 0.1438, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.23% (0.6959 => 0.7532, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.13% (1.1364 => 1.2288, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.08% (1.4563 => 1.5739, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.81% (13.8202 => 14.8998, std.dev.: 0.0092) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.58% (0.5577 => 0.6000, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.3899 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.31% (0.6283 => 0.6742, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.24% (0.3246 => 0.3481, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.22% (1.0313 => 1.1058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.14% (0.3489 => 0.3738, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.13% (0.3578 => 0.3833, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (1.9828 => 2.1240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.03% (0.3868 => 0.4140, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.00% (7.2180 => 7.7232, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3756 => 0.4018, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.4791 => 0.5125, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.97% (0.2726 => 0.2916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.94% (1.1061 => 1.1829, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.93% (0.3650 => 0.3903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4016 => 0.4294, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.92% (0.5637 => 0.6027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.89% (0.4003 => 0.4279, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.89% (0.3293 => 0.3520, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3914 => 0.4183, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.84% (0.2995 => 0.3200, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.82% (0.7506 => 0.8018, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.70% (0.3940 => 0.4204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3107 => 0.3315, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.67% (0.8310 => 0.8864, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.64% (3.8646 => 4.1213, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.61% (3.6692 => 3.9119, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.54% (0.7460 => 0.7948, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3220 => 0.3429, std.dev.: 0.0068) MultiSource/Applications/d/make_dparser: 6.38% (3.1889 => 3.3925, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.34% (0.3534 => 0.3758, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.2243 => 0.2385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4659, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.09% (2.1791 => 2.3117, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.06% (1.3245 => 1.4048, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (1.3819 => 1.4652, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 5.99% (0.6744 => 0.7148, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.95% (1.9270 => 2.0417, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.92% (1.0594 => 1.1221, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.80% (4.3801 => 4.6341, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (1.2749 => 1.3483, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.71% (14.8535 => 15.7012, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 5.66% (0.4113 => 0.4346, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.63% (16.6129 => 17.5477, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.60% (0.8698 => 0.9185, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.57% (4.4433 => 4.6907, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.52% (8.4961 => 8.9650, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 5.28% (0.2859 => 0.3010, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.25% (0.6135 => 0.6457, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (13.2842 => 13.9809, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.23% (0.6576 => 0.6920, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.23% (0.8818 => 0.9279, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.05% (1.1333 => 1.1905, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.04% (14.5298 => 15.2623, std.dev.: 0.0109) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.79% (6.5754 => 6.8904, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (3.2742 => 3.4242, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 4.54% (4.6629 => 4.8748, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.53% (0.3245 => 0.3392, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2292 => 1.2831, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1859, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.90% (0.9108 => 0.9463, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.89% (0.4805 => 0.4992, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.79% (0.6250 => 0.6487, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.77% (3.7467 => 3.8879, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2785 => 6.5077, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.65% (1.5188 => 1.5742, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.29% (2.1007 => 2.1699, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.41% (33.2944 => 34.0981, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 1.88% (16.2614 => 16.5679, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 30.01% (1.8175 => 2.3629, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2557, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.2093 => 0.2197, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6979, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.01% (10.7476 => 11.0716, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6064, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2067, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5884, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.02% (22.5627 => 21.6559, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2862, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.44% (1.3780 => 1.2892, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5963, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.21% (26.5159 => 25.9302, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2430, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2335, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2208, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.14% (4.1080 => 4.0612, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2627, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4360, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 18:53:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 20:53:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915015349.6EA1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3826?compare_to=3823&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3826, Order: 163950, Start Time: 2012-09-15 00:35:18, End Time: 2012-09-15 01:55:09 To: 3823, Order: 163942, Start Time: 2012-09-14 22:47:27, End Time: 2012-09-15 00:06:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (134 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.44% (79.0161 => 80.9432, std.dev.: 0.2397) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5677 => 0.5678, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.28% (15.8186 => 15.8636, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 0.35% (14.6545 => 14.7054, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 0.09% (82.7549 => 82.8270, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.3065 => 4.3084, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2207 => 1.2204, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.3749 => 7.3776, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.23% (3.6584 => 3.6668, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6366 => 0.6364, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1427 => 0.1428, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0646 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.96% (63.2438 => 82.8270, std.dev.: 0.0098) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.58% (0.0720 => 10.3317, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.95% (10.3673 => 14.6128, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 26.08% (0.1622 => 0.2045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.56% (2.2022 => 2.5008, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.28% (7.0540 => 7.9905, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.13% (0.1566 => 0.1756, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.81% (1.7609 => 1.9513, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.27% (10.4361 => 11.5080, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.80% (0.3694 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.60% (0.3927 => 0.4304, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.58% (9.4845 => 10.2038, std.dev.: 0.0150) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.27% (0.3177 => 0.3408, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7433 => 0.7917, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.50% (0.3109 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.39% (0.4615 => 0.4910, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2554 => 0.2717, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.28% (0.7115 => 0.7562, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.5860 => 0.6224, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2271 => 0.2412, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.6675 => 0.7086, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.13% (0.5105 => 0.5418, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.02% (0.3423 => 0.3629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.01% (0.5925 => 0.6281, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.00% (5.7591 => 6.1048, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.3050 => 1.3826, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3121 => 0.3306, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (1.5415 => 1.6323, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.89% (8.1363 => 8.6154, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (4.2646 => 4.5154, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.84% (0.8172 => 0.8649, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 5.80% (0.6030 => 0.6380, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.75% (3.3354 => 3.5273, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.70% (0.2107 => 0.2227, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.68% (1.5603 => 1.6489, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5569 => 0.5885, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.58% (4.9449 => 5.2209, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.57% (5.0018 => 5.2805, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: 5.56% (0.7835 => 0.8271, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.8067 => 0.8506, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.34% (0.9765 => 1.0286, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4299 => 0.4526, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.24% (0.3092 => 0.3254, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2234, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (7.9617 => 8.3613, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.98% (0.7326 => 0.7691, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.90% (0.5020 => 0.5266, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.87% (0.3180 => 0.3335, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.82% (1.0722 => 1.1239, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.76% (3.8723 => 4.0567, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.75% (1.1861 => 1.2424, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3422 => 0.3578, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4636 => 0.4847, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6456 => 0.6745, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.36% (0.6450 => 0.6731, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.4064 => 0.4240, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.4103 => 0.4280, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.31% (2.0273 => 2.1147, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8921 => 0.9300, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4289 => 0.4470, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.5981 => 0.6231, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 4.18% (21.9371 => 22.8536, std.dev.: 0.0164) MultiSource/Applications/siod/siod: 4.17% (2.2969 => 2.3927, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3865 => 0.4019, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.84% (1.5859 => 1.6468, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4203 => 0.4362, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.71% (0.4048 => 0.4198, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.4186 => 1.4704, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.58% (0.3603 => 0.3732, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.53% (2.0665 => 2.1394, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.3684 => 0.3813, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (14.3668 => 14.8623, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.41% (2.2024 => 2.2774, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.1840 => 1.2219, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2842 => 1.3116, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.00% (17.1811 => 17.3533, std.dev.: 0.0211) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (3.1578 => 3.3857, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7585, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3511, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7893, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5807, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3625, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.56% (5.2763 => 3.2415, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.42% (5.3855 => 3.8551, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.06% (5.3526 => 3.8509, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1018, std.dev.: 0.0427) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.86% (2.9384 => 2.5899, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -8.60% (22.1758 => 20.2690, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2907, std.dev.: 0.0816) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4993, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4251, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9827, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.24% (1.2373 => 1.2096, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9989, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5798, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.59% (0.5229 => 0.5678, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.83% (14.9895 => 15.8636, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 3.89% (14.1553 => 14.7054, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 4.81% (4.1105 => 4.3084, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.46% (1.1048 => 1.2204, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.07% (7.1582 => 7.3776, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.89% (3.4629 => 3.6668, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6222 => 0.6364, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 19:22:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 21:22:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915022231.21A332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3827?compare_to=3824&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3827, Order: 163954, Start Time: 2012-09-15 01:12:40, End Time: 2012-09-15 02:23:51 To: 3824, Order: 163948, Start Time: 2012-09-14 23:45:13, End Time: 2012-09-15 00:56:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (44 on baseline) Performance Improvements: 3 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.62% (8.8668 => 9.4534, std.dev.: 0.0903) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 18.58% (3.1585 => 3.7454, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout/heapsort: 16.89% (3.2155 => 3.7587, std.dev.: 0.0402) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.35% (4.1399 => 4.3199, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/ary3: 2.40% (2.0007 => 2.0487, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.2315 => 2.2591, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -4.30% (0.3093 => 0.2960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.16% (4.0645 => 4.0175, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.96% (43.6397 => 41.9119, std.dev.: 0.6074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.04% (0.9909 => 0.9806, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.5939 => 0.5949, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 1.26% (0.1592 => 0.1612, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.67% (0.1496 => 0.1486, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.43% (0.3017 => 0.3030, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (0.2343 => 0.2369, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.19% (0.3173 => 0.3167, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.87% (0.2292 => 0.2312, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -12.39% (0.0452 => 0.0396, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: -4.60% (0.0087 => 0.0083, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.01% (0.0238 => 0.0188, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 57.02% (0.0121 => 0.0190, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0387 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.01% (0.0297 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.75% (0.0286 => 0.0281, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.78% (0.0283 => 0.0322, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0178 => 0.0178, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -8.42% (0.0190 => 0.0174, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.98% (0.0252 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 5.78% (0.0277 => 0.0293, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: - (0.1431 => 0.1431, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 0.63% (1.4468 => 1.4559, std.dev.: 0.0217) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.43% (0.1468 => 0.1447, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.91% (0.4225 => 0.4060, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.25% (0.1379 => 0.1410, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.55% (0.0545 => 0.0542, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.66% (0.0166 => 0.0192, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.73% (0.0644 => 0.0562, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.65% (1.1456 => 1.1530, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.42% (0.0527 => 0.0545, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.57% (0.0140 => 0.0159, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.7855 => 0.7812, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.20% (1.6119 => 1.6086, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.96% (0.0089 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.13% (4.1772 => 3.0439, std.dev.: 0.0493) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.13% (0.0745 => 0.0895, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.5309 => 0.5627, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 5.20% (2.1763 => 2.2894, std.dev.: 0.0222) SingleSource/UnitTests/Vector/constpool: 5.06% (8.9977 => 9.4534, std.dev.: 0.0903) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.68% (0.6410 => 0.6710, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.13% (0.3582 => 0.3730, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3.64% (1.1653 => 1.2077, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.45% (0.6173 => 0.6386, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 3.00% (1.0046 => 1.0347, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.53% (0.6915 => 0.7090, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.46% (1.5150 => 1.5522, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.7639 => 0.7810, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.29% (3.0225 => 3.0616, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.50% (1.6538 => 2.3401, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.79% (3.0256 => 3.7454, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/matrix: 22.21% (3.4629 => 4.2319, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/ary3: 17.57% (1.7426 => 2.0487, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.10% (0.0766 => 0.0897, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: 16.88% (3.2159 => 3.7587, std.dev.: 0.0402) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3746 => 0.4282, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.74% (0.0917 => 0.1043, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.15% (4.0101 => 4.5374, std.dev.: 0.0151) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6258, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.84% (1.0063 => 1.0852, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (0.3301 => 0.3540, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.23% (1.0194 => 1.0931, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.04% (0.2857 => 0.3058, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8047, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: 4.42% (0.9851 => 1.0286, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 4.35% (15.2242 => 15.8869, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.80% (4.2129 => 4.3730, std.dev.: 0.0572) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.5587 => 0.5778, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 3.19% (1.4184 => 1.4636, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.6308 => 0.6501, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.42% (0.5876 => 0.6018, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 2.38% (8.5113 => 8.7139, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4853, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7206, std.dev.: 0.0248) MultiSource/Applications/siod/siod: 1.46% (3.5520 => 3.6038, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.56% (0.7738 => 0.7540, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.62% (4.2815 => 4.2121, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.28% (1.4189 => 1.4008, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.27% (8.2559 => 8.1514, std.dev.: 0.0391) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.51% (1.1647 => 0.9375, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -17.97% (5.2665 => 4.3199, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary3: -17.03% (1.7473 => 1.4498, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1645, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: -9.61% (0.1114 => 0.1007, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.29% (62.4126 => 56.6141, std.dev.: 0.0811) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.07% (3.2007 => 2.9424, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.63% (2.4457 => 2.2591, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.32% (3.6254 => 3.3602, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1854, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.4441 => 1.3561, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: -5.77% (1.4117 => 1.3302, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4140 => 0.3938, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -4.80% (4.6355 => 4.4131, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.36% (9.2503 => 8.9393, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.23% (1.7361 => 1.6800, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/misr: -3.17% (0.4296 => 0.4160, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -3.05% (7.6833 => 7.4489, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.96% (1.1683 => 1.1337, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.91% (3.7496 => 3.6406, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (3.9413 => 3.8316, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2948, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -2.64% (3.4286 => 3.3381, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.49% (1.0686 => 1.0420, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4217, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -1.79% (92.7467 => 91.0892, std.dev.: 0.1967) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2299, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.54% (3.8907 => 3.8307, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.3569 => 2.3223, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7684, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3306, std.dev.: 0.0033) MultiSource/Benchmarks/llubenchmark/llu: -1.18% (2.0192 => 1.9954, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.74% (0.9980 => 0.9806, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -1.21% (0.6022 => 0.5949, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: -3.24% (0.1666 => 0.1612, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.38% (0.1554 => 0.1486, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.72% (0.3083 => 0.3030, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.04% (0.2394 => 0.2369, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.25% (0.3175 => 0.3167, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2302 => 0.2312, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -11.80% (0.0449 => 0.0396, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: -6.74% (0.0089 => 0.0083, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.67% (0.0240 => 0.0188, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -7.94% (0.0189 => 0.0174, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -9.85% (0.0325 => 0.0293, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -3.06% (1.5019 => 1.4559, std.dev.: 0.0217) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.60% (0.1501 => 0.1447, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.91% (0.1344 => 0.1410, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.98% (0.0589 => 0.0542, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.24% (0.0232 => 0.0192, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.05% (0.0639 => 0.0562, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.59% (1.1350 => 1.1530, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.37% (0.0246 => 0.0159, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.59% (0.7541 => 0.7812, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.71% (1.5363 => 1.6086, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 19:23:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 21:23:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915022314.1DCE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3828?compare_to=3820&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3828, Order: 163945, Start Time: 2012-09-14 23:40:47, End Time: 2012-09-15 02:24:29 To: 3820, Order: 163928, Start Time: 2012-09-14 20:28:42, End Time: 2012-09-14 23:12:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.11% (129.5252 => 126.7906, std.dev.: 0.2777) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 10.94% (0.3446 => 0.3823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3460 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.91% (0.3465 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3488 => 0.3868, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.84% (0.3442 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3469 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.73% (0.3496 => 0.3871, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 10.63% (0.3650 => 0.4038, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.43% (0.3643 => 0.4023, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.15% (0.3724 => 0.4102, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.24% (1.5932 => 1.7086, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5826 => 0.6218, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.5889 => 0.6285, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.32% (0.2738 => 0.2911, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (1.6211 => 1.7223, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.3004 => 0.3188, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.10% (3.5627 => 3.7802, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.09% (1.3152 => 1.3953, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (2.7292 => 2.8944, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (0.4361 => 0.4621, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2875 => 0.3045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2823 => 0.2987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2729 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.71% (0.3362 => 0.3554, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.67% (0.3195 => 0.3376, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2811 => 0.2969, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.55% (0.2792 => 0.2947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.54% (0.2780 => 0.2934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2803 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.3096 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.50% (2.0673 => 2.1811, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.47% (0.9909 => 1.0451, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.46% (0.3317 => 0.3498, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2813 => 0.2965, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2911 => 0.3068, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3258 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3267 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (0.5000 => 0.5265, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3060 => 0.3221, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7171 => 0.7546, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.20% (1.0781 => 1.1342, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.18% (5.5417 => 5.8289, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (0.5026 => 0.5286, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.12% (0.3124 => 0.3284, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 5.11% (0.3678 => 0.3866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3726 => 0.3915, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 5.02% (0.9697 => 1.0184, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.96% (0.3348 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.3282 => 0.3444, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.5900 => 0.6188, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4146 => 0.4347, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (0.4251 => 0.4457, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.2736 => 0.2868, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.82% (0.3981 => 0.4173, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.79% (4.2109 => 4.4126, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 4.77% (0.3477 => 0.3643, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (4.4195 => 4.6294, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 4.71% (23.5202 => 24.6278, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3690 => 0.3862, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 4.66% (4.6177 => 4.8328, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 4.63% (2.1013 => 2.1986, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 4.60% (0.2566 => 0.2684, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (1.8794 => 1.9646, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 4.52% (0.4029 => 0.4211, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (2.1653 => 2.2626, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.4139 => 0.4324, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.43% (0.3903 => 0.4076, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (0.3890 => 0.4061, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.3845 => 0.4013, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.26% (0.6435 => 0.6709, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.5012 => 0.5223, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (1.9694 => 2.0511, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 4.09% (1.4269 => 1.4853, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.08% (0.5546 => 0.5772, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 4.02% (0.6634 => 0.6901, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (1.9966 => 2.0754, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (0.4658 => 0.4840, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.70% (0.3271 => 0.3392, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.70% (0.3084 => 0.3198, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.56% (0.7875 => 0.8155, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 3.03% (2.0346 => 2.0962, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 2.70% (0.4847 => 0.4978, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (0.7426 => 0.7605, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.37% (0.5361 => 0.5488, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (11.6398 => 11.9112, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (0.5584 => 0.5708, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.06% (4.6926 => 4.7892, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.33% (0.5917 => 0.6706, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.55% (0.2122 => 0.2261, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-2: 5.21% (1.8057 => 1.8998, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6700, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std.dev.: 0.0540) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6381, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2092, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std.dev.: 0.0224) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4455, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5339, std.dev.: 0.0359) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8025, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.69% (3.3665 => 3.2424, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8014, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.66% (17.2379 => 16.7797, std.dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9610, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 20:29:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 22:29:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915032920.C364B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3829?compare_to=3825&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3829, Order: 163959, Start Time: 2012-09-15 02:16:24, End Time: 2012-09-15 03:30:39 To: 3825, Order: 163950, Start Time: 2012-09-15 00:33:48, End Time: 2012-09-15 01:48:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.03% (3.7727 => 3.8493, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (1.2892 => 1.3099, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.82% (2.0176 => 2.3974, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.71% (1.3693 => 1.5022, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.32% (3.9660 => 4.3355, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.24% (0.5748 => 0.6279, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.23% (0.7710 => 0.8422, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7061 => 0.7701, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 8.97% (0.7038 => 0.7669, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.96% (0.4328 => 0.4716, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3241, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.55% (0.5265 => 0.5715, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.45% (0.9199 => 0.9976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.15% (0.6959 => 0.7526, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.10% (1.1364 => 1.2285, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 8.03% (13.8202 => 14.9305, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.00% (1.4563 => 1.5728, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.72% (0.6283 => 0.6768, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.66% (0.5577 => 0.6004, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.61% (0.2760 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2726 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.51% (0.3756 => 0.4038, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2765 => 0.2972, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.43% (0.4791 => 0.5147, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.43% (0.3580 => 0.3846, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.43% (0.4390 => 0.4716, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.3107 => 0.3337, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.40% (0.3149 => 0.3382, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.39% (0.3489 => 0.3747, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.38% (0.3293 => 0.3536, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (1.9828 => 2.1290, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.34% (1.0313 => 1.1070, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.20% (0.4016 => 0.4305, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.09% (7.2180 => 7.7296, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.06% (0.3868 => 0.4141, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3192 => 0.3416, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.98% (1.1061 => 1.1833, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3453 => 0.3693, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8310 => 0.8878, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.77% (3.6692 => 3.9175, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.75% (0.7506 => 0.8013, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.63% (3.8646 => 4.1210, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.62% (0.7460 => 0.7954, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.55% (0.3220 => 0.3431, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3578 => 0.3811, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.45% (0.3646 => 0.3881, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.36% (0.3601 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.34% (0.3914 => 0.4162, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.33% (0.3789 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.33% (0.3663 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.32% (0.3623 => 0.3852, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.4003 => 0.4256, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.28% (3.1889 => 3.3891, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3650 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.17% (0.3940 => 0.4183, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.14% (1.0594 => 1.1244, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.08% (2.1791 => 2.3116, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.08% (0.6744 => 0.7154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.3245 => 1.4043, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 5.94% (1.9270 => 2.0415, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (8.4961 => 9.0001, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 5.92% (1.2749 => 1.3504, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.88% (1.3819 => 1.4631, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.86% (1.3813 => 1.4623, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.85% (0.8698 => 0.9207, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.85% (14.8535 => 15.7220, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.65% (0.2140 => 0.2261, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.65% (16.6129 => 17.5515, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.58% (0.8818 => 0.9310, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (4.3801 => 4.6213, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.50% (4.4433 => 4.6875, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.46% (0.2859 => 0.3015, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9769, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.6576 => 0.6914, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2504 => 0.2632, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.08% (6.5754 => 6.9096, std.dev.: 0.0227) MultiSource/Applications/oggenc/oggenc: 5.04% (4.6629 => 4.8977, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1333 => 1.1902, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.98% (14.5298 => 15.2528, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2321 => 0.2430, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.67% (1.2292 => 1.2866, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.66% (3.2742 => 3.4268, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.3245 => 0.3396, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.23% (0.9108 => 0.9493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.16% (4.9865 => 5.1939, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4805 => 0.5004, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.13% (0.6250 => 0.6508, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (6.2785 => 6.5225, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (1.5188 => 1.5762, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 3.69% (3.7467 => 3.8850, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.1007 => 2.1728, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.3511 => 0.3630, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.79% (33.2944 => 34.2229, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5256, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5150, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std.dev.: 0.0410) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (3.1736 => 3.4183, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3798, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6982, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.95% (10.7476 => 11.0650, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6015, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7731 => 3.8493, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.54% (8.3908 => 8.5197, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.11% (7.9275 => 8.0153, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5932, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.51% (0.4657 => 0.3888, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (22.5627 => 21.7169, std.dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2763, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9241, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5803, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9066, std.dev.: 0.0429) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2471, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2383, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0594, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 20:42:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Sep 2012 22:42:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915034201.2D3722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3830?compare_to=3826&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3830, Order: 163959, Start Time: 2012-09-15 02:23:39, End Time: 2012-09-15 03:43:21 To: 3826, Order: 163950, Start Time: 2012-09-15 00:35:18, End Time: 2012-09-15 01:55:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (135 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (712 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (14.6128 => 14.8828, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5678 => 0.5676, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -0.34% (15.8636 => 15.8101, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: -0.44% (14.7054 => 14.6401, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -0.52% (82.8270 => 82.3955, std.dev.: 0.0450) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.3084 => 4.3101, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.20% (1.2204 => 1.2179, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (7.3776 => 7.3844, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.34% (3.6668 => 3.6542, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.20% (0.6364 => 0.6377, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.62% (0.0649 => 0.0653, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.28% (63.2438 => 82.3955, std.dev.: 0.0450) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14256.11% (0.0720 => 10.3364, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.56% (10.3673 => 14.8828, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 26.14% (0.1622 => 0.2046, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.81% (2.2022 => 2.5063, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.14% (7.0540 => 7.9807, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.31% (1.1194 => 1.2572, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.59% (1.7609 => 1.9474, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 10.23% (10.4361 => 11.5040, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 9.35% (0.3497 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.32% (0.3561 => 0.3893, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.31% (0.3543 => 0.3873, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3828 => 0.4175, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.01% (0.3694 => 0.4027, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.3927 => 0.4278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.78% (0.3886 => 0.4227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.65% (0.1584 => 0.1721, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.23% (0.1438 => 0.1542, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.3177 => 0.3404, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.11% (9.4845 => 10.1590, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: 7.01% (0.1440 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7433 => 0.7904, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.03% (0.2271 => 0.2408, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.02% (0.3307 => 0.3506, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.93% (0.2700 => 0.2860, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.89% (0.7115 => 0.7534, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.89% (0.6675 => 0.7068, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.89% (0.5860 => 0.6205, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.82% (5.7591 => 6.0940, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3423 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (8.1363 => 8.5983, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (1.5415 => 1.6289, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (1.3050 => 1.3784, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8172 => 0.8631, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5925 => 0.6257, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (4.2646 => 4.5009, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.54% (0.9765 => 1.0306, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 5.54% (1.5603 => 1.6467, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 5.53% (3.3354 => 3.5199, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.34% (5.0018 => 5.2687, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.5105 => 0.5377, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.30% (4.9449 => 5.2071, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.8067 => 0.8491, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.19% (0.5569 => 0.5858, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.18% (0.2758 => 0.2901, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.17% (0.7835 => 0.8240, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.85% (0.3422 => 0.3588, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.84% (1.1642 => 1.2205, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 4.78% (0.3387 => 0.3549, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.72% (0.4636 => 0.4855, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.70% (7.9617 => 8.3362, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.70% (0.4064 => 0.4255, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.68% (0.6456 => 0.6758, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.64% (0.7326 => 0.7666, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 4.61% (0.4299 => 0.4497, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.56% (0.4103 => 0.4290, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.56% (21.9371 => 22.9368, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.53% (0.2603 => 0.2721, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.53% (3.8723 => 4.0478, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2891 => 0.3020, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.44% (1.1861 => 1.2388, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.44% (0.5020 => 0.5243, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 4.40% (1.0722 => 1.1194, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.40% (0.3865 => 0.4035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4289 => 0.4474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3650 => 0.3807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3052 => 0.3181, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2756 => 0.2870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.13% (0.2831 => 0.2948, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.3136 => 0.3264, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.07% (2.0273 => 2.1099, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3232 => 0.3362, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.00% (0.3098 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.00% (0.6450 => 0.6708, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.00% (0.4203 => 0.4371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2793 => 0.2904, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.97% (2.0665 => 2.1486, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3826 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.95% (0.8921 => 0.9273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.91% (0.3603 => 0.3744, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3283 => 0.3411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2802 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3684 => 0.3827, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.86% (2.2969 => 2.3856, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4048 => 0.4203, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (0.3935 => 0.4085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4620 => 0.4796, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5981 => 0.6206, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3379 => 0.3503, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (0.2877 => 0.2981, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (1.5859 => 1.6416, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.4186 => 1.4659, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (14.3668 => 14.8301, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.02% (2.2024 => 2.2689, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.81% (1.1840 => 1.2173, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.30% (1.2842 => 1.3137, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (3.1578 => 3.3854, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (4.2280 => 4.3609, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7522, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7902, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2272, std.dev.: 0.0370) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3648, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2489, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.24% (5.3855 => 3.8645, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.91% (5.3526 => 3.8585, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1733, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.76% (2.9384 => 2.5927, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.73% (22.1758 => 20.2391, std.dev.: 0.0278) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3113, std.dev.: 0.0961) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.72% (1.6805 => 1.5843, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5084, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4261, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0107, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/chomp: -2.43% (1.2373 => 1.2072, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9886, std.dev.: 0.0207) SingleSource/UnitTests/Vector/multiplies: -1.77% (2.5528 => 2.5077, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -1.37% (4.6441 => 4.5804, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2302, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.47% (14.9895 => 15.8101, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: 3.42% (14.1553 => 14.6401, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 4.86% (4.1105 => 4.3101, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.24% (1.1048 => 1.2179, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (7.1582 => 7.3844, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.52% (3.4629 => 3.6542, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.6222 => 0.6377, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 22:11:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 00:11:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915051154.2F5732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3831?compare_to=3829&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3831, Order: 163962, Start Time: 2012-09-15 03:58:57, End Time: 2012-09-15 05:13:13 To: 3829, Order: 163959, Start Time: 2012-09-15 02:16:24, End Time: 2012-09-15 03:30:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.39% (2.0176 => 2.4089, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.55% (3.9660 => 4.3447, std.dev.: 0.0148) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.5818 => 0.6356, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.12% (0.7710 => 0.8413, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 9.08% (0.7038 => 0.7677, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5748 => 0.6264, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4911, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.79% (0.9199 => 1.0008, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.77% (0.5265 => 0.5727, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7061 => 0.7679, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.6959 => 0.7564, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.64% (1.2193 => 1.3247, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.29% (1.1364 => 1.2306, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.24% (13.8202 => 14.9587, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.15% (1.4563 => 1.5750, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.95% (0.3899 => 0.4209, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.94% (0.5577 => 0.6020, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.77% (0.6283 => 0.6771, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3246 => 0.3495, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.67% (1.0313 => 1.1104, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.31% (0.2995 => 0.3214, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 7.23% (1.1061 => 1.1861, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.08% (7.2180 => 7.7290, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (3.8646 => 4.1379, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.03% (0.7506 => 0.8034, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.03% (0.8310 => 0.8894, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.99% (0.4390 => 0.4697, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.86% (3.6692 => 3.9209, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.80% (0.2925 => 0.3124, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.79% (1.9828 => 2.1175, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.75% (0.4016 => 0.4287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.68% (0.3220 => 0.3435, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.67% (2.1791 => 2.3245, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.57% (0.3914 => 0.4171, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (0.2761 => 0.2942, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3578 => 0.3811, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.47% (1.3245 => 1.4102, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 6.42% (0.4003 => 0.4260, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.39% (0.3646 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.39% (0.3601 => 0.3831, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.35% (1.9270 => 2.0494, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 6.34% (0.3453 => 0.3672, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.33% (0.3789 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.33% (0.3663 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.32% (0.3623 => 0.3852, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.31% (3.1889 => 3.3902, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.30% (0.3650 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.23% (1.0594 => 1.1254, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.18% (0.6744 => 0.7161, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.17% (16.6129 => 17.6384, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.06% (1.3813 => 1.4650, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.04% (1.3819 => 1.4653, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.92% (14.8535 => 15.7334, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.2749 => 1.3487, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.3801 => 4.6320, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 5.74% (0.2859 => 0.3023, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (8.4961 => 8.9831, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6135 => 0.6481, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.60% (4.4433 => 4.6920, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.50% (0.8818 => 0.9303, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (13.2842 => 13.9972, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.33% (1.1333 => 1.1937, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.22% (0.3755 => 0.3951, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.13% (14.5298 => 15.2758, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.11% (0.6576 => 0.6912, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.01% (4.6629 => 4.8965, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.99% (3.2742 => 3.4375, std.dev.: 0.0163) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (6.5754 => 6.9021, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.39% (0.9108 => 0.9508, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2825, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.14% (4.9865 => 5.1927, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.05% (1.5188 => 1.5803, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.00% (3.7467 => 3.8964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.6250 => 0.6491, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.1007 => 2.1785, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5063, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 2.93% (33.2944 => 34.2684, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: 1.64% (16.2614 => 16.5287, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6984, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.33% (10.7476 => 11.1054, std.dev.: 0.0559) SingleSource/Benchmarks/Misc/flops-6: 3.31% (1.9199 => 1.9835, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6030, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6866, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5883, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.51% (0.4657 => 0.3888, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.87% (22.5627 => 21.6896, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2562, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3001, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5153, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9240, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6016, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -2.19% (26.5159 => 25.9352, std.dev.: 0.0392) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2442, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2392, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0609, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std.dev.: 0.0326) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 22:23:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 00:23:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915052318.8CDA12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3832?compare_to=3827&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3832, Order: 163962, Start Time: 2012-09-15 04:14:33, End Time: 2012-09-15 05:24:40 To: 3827, Order: 163954, Start Time: 2012-09-15 01:12:40, End Time: 2012-09-15 02:23:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 20 (56 on baseline) Performance Improvements: 6 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 875 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.47% (0.1404 => 0.1537, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.77% (0.4469 => 0.4727, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.65% (0.5626 => 0.5944, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.68% (0.2199 => 0.2302, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.65% (0.2731 => 0.2858, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.49% (0.2960 => 0.3093, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 3.69% (1.3235 => 1.3724, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.79% (0.7181 => 0.7381, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.52% (1.2516 => 1.2832, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.50% (0.7642 => 0.7833, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.35% (0.8801 => 0.9008, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8289 => 3.9019, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.1801 => 1.1948, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (1.3932 => 1.4095, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.05% (3.5878 => 3.6255, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.69% (0.3938 => 0.4044, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 1.93% (2.3503 => 2.3956, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 1.92% (6.7326 => 6.8618, std.dev.: 0.0296) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.51% (0.8682 => 0.8813, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.11% (2.6955 => 2.7254, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.74% (9.4534 => 9.1943, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -18.44% (3.7587 => 3.0655, std.dev.: 0.1716) SingleSource/Benchmarks/Shootout-C++/ackermann: -12.00% (3.5946 => 3.1633, std.dev.: 0.1511) SingleSource/Benchmarks/Shootout-C++/heapsort: -11.87% (3.7454 => 3.3010, std.dev.: 0.0956) SingleSource/Benchmarks/CoyoteBench/lpbench: -5.54% (4.3199 => 4.0805, std.dev.: 0.0544) SingleSource/Benchmarks/Shootout/ary3: -2.53% (2.0487 => 1.9969, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.13% (0.9806 => 1.0015, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 0.81% (0.5949 => 0.5997, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 1.67% (0.1612 => 0.1639, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.68% (0.1486 => 0.1511, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (0.3030 => 0.3097, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.63% (0.2369 => 0.2384, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.48% (0.3167 => 0.3214, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.48% (0.2312 => 0.2301, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 8.84% (0.0396 => 0.0431, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: 6.02% (0.0083 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 28.72% (0.0188 => 0.0242, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.47% (0.0190 => 0.0134, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0385 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0300 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.90% (0.0281 => 0.0256, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0322 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0178 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 9.20% (0.0174 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -5.26% (0.0247 => 0.0234, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 11.26% (0.0293 => 0.0326, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1431 => 0.1452, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.67% (1.4559 => 1.4948, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 9.95% (0.1447 => 0.1591, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.48% (0.4060 => 0.4242, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.85% (0.1410 => 0.1422, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.50% (0.0542 => 0.0626, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.46% (0.0192 => 0.0262, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0562 => 0.0562, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1530 => 1.1485, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.37% (0.0545 => 0.0543, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.08% (0.0159 => 0.0210, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7812 => 0.7796, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.08% (1.6086 => 1.6073, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.61% (0.0121 => 0.0113, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.91% (4.1772 => 3.0949, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/except: 82816.67% (0.0006 => 0.4975, std.dev.: 0.0066) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.00% (0.0745 => 0.0894, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.70% (0.1414 => 0.1537, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.33% (0.5309 => 0.5645, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.69% (0.6410 => 0.6775, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 5.03% (2.1763 => 2.2857, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.2552 => 0.2675, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 3.79% (0.6915 => 0.7177, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.55% (0.5740 => 0.5944, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 3.44% (1.3268 => 1.3724, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.39% (0.6173 => 0.6382, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3.13% (1.1653 => 1.2018, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 2.92% (1.0046 => 1.0339, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.85% (0.4596 => 0.4727, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 2.82% (15.3105 => 15.7423, std.dev.: 0.0299) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.76% (0.7722 => 0.7935, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5150 => 1.5558, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.60% (29.3170 => 30.0803, std.dev.: 0.2728) SingleSource/UnitTests/Vector/constpool: 2.19% (8.9977 => 9.1943, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.15% (0.7226 => 0.7381, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.04% (0.7639 => 0.7795, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.88% (3.0225 => 3.0794, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 1.34% (1.1440 => 1.1593, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (1.3935 => 1.4095, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (6.2546 => 6.3246, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.05% (0.0263 => 0.0392, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 21.83% (3.4629 => 4.2189, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 14.26% (0.3746 => 0.4280, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.84% (4.0101 => 4.5649, std.dev.: 0.0194) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.35% (0.1433 => 0.1567, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.10% (3.0256 => 3.3010, std.dev.: 0.0956) SingleSource/Benchmarks/Shootout/lists: 8.46% (7.0025 => 7.5946, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.46% (1.0063 => 1.0814, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.30% (4.2129 => 4.5203, std.dev.: 0.0613) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.23% (0.2857 => 0.3035, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8049, std.dev.: 0.2303) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.21% (0.5876 => 0.6182, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (0.3301 => 0.3460, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8524, std.dev.: 0.0573) SingleSource/Benchmarks/Misc/dt: 3.96% (0.9851 => 1.0241, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.71% (0.8498 => 0.8813, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.66% (3.4080 => 3.5329, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7576, std.dev.: 0.0455) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 2.34% (5.1938 => 5.3154, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (2.6656 => 2.7254, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: 2.14% (2.3453 => 2.3956, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 1.72% (6.7458 => 6.8618, std.dev.: 0.0296) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7212, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4455 => 2.4804, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5316, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (4.5056 => 4.5631, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.46% (0.7738 => 0.7625, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.52% (5.2665 => 4.0805, std.dev.: 0.0544) SingleSource/Benchmarks/Shootout-C++/ary3: -20.67% (1.7473 => 1.3862, std.dev.: 0.0626) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.34% (1.1647 => 0.9395, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1564, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -12.19% (3.6023 => 3.1633, std.dev.: 0.1511) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -9.31% (62.4126 => 56.6003, std.dev.: 0.0706) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.54% (3.2007 => 2.9275, std.dev.: 0.0295) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.85% (2.4457 => 2.2536, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3638, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3502, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.12% (2.9728 => 2.7909, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: -6.09% (3.4230 => 3.2145, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4100, std.dev.: 0.0389) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.74% (61.1734 => 58.2768, std.dev.: 0.9766) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.82% (1.7361 => 1.6697, std.dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: -3.51% (7.6833 => 7.4140, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/methcall: -3.02% (9.2503 => 8.9707, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6437, std.dev.: 0.0383) SingleSource/Benchmarks/McGill/misr: -2.77% (0.4296 => 0.4177, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0091) MultiSource/Applications/aha/aha: -2.70% (3.4286 => 3.3359, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.33% (1.1683 => 1.1411, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.02% (2.8964 => 2.8379, std.dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2222, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.47% (3.8907 => 3.8335, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: -1.47% (92.7467 => 91.3864, std.dev.: 0.5238) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3054, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7668, std.dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.35% (0.9980 => 1.0015, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -0.42% (0.6022 => 0.5997, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -1.62% (0.1666 => 0.1639, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.77% (0.1554 => 0.1511, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.45% (0.3083 => 0.3097, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2394 => 0.2384, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.23% (0.3175 => 0.3214, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2302 => 0.2301, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -4.01% (0.0449 => 0.0431, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.21% (0.0192 => 0.0134, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.86% (0.0284 => 0.0256, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -6.02% (0.0249 => 0.0234, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -0.47% (1.5019 => 1.4948, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.00% (0.1501 => 0.1591, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.52% (0.4264 => 0.4242, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.80% (0.1344 => 0.1422, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.28% (0.0589 => 0.0626, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.93% (0.0232 => 0.0262, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.05% (0.0639 => 0.0562, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.19% (1.1350 => 1.1485, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.63% (0.0246 => 0.0210, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.38% (0.7541 => 0.7796, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.62% (1.5363 => 1.6073, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 61.43% (0.0070 => 0.0113, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 22:30:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 00:30:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915053032.431842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3833?compare_to=3830&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3833, Order: 163962, Start Time: 2012-09-15 04:11:49, End Time: 2012-09-15 05:31:52 To: 3830, Order: 163959, Start Time: 2012-09-15 02:23:39, End Time: 2012-09-15 03:43:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (122 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (725 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 19.46% (0.3942 => 0.4709, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (0.8631 => 0.8734, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.58% (54.9557 => 56.3741, std.dev.: 0.0999) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (1.2940 => 1.3109, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.18% (2.1486 => 2.1232, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.53% (3.8527 => 3.7554, std.dev.: 0.0295) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.32% (0.5676 => 0.5694, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.42% (15.8101 => 15.8762, std.dev.: 0.0222) MultiSource/Applications/kimwitu++/kc: 0.42% (14.6401 => 14.7009, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 0.03% (82.3955 => 82.4215, std.dev.: 0.0258) MultiSource/Benchmarks/MallocBench/gs/gs: -0.03% (4.3101 => 4.3090, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.39% (1.2179 => 1.2226, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (7.3844 => 7.3663, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (3.6542 => 3.6728, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.66% (0.6377 => 0.6335, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.61% (0.0653 => 0.0649, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.32% (63.2438 => 82.4215, std.dev.: 0.0258) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14258.89% (0.0720 => 10.3384, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.15% (10.3673 => 14.9444, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 26.02% (0.1622 => 0.2044, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.75% (2.2022 => 2.5270, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (7.0540 => 8.0482, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.28% (1.1194 => 1.2569, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.97% (1.7609 => 1.9540, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 10.33% (10.4361 => 11.5139, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.13% (0.3543 => 0.3902, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 9.55% (0.3561 => 0.3901, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3694 => 0.4039, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3828 => 0.4181, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.14% (0.3927 => 0.4286, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.98% (0.3886 => 0.4235, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.60% (9.4845 => 10.2057, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.4879 => 0.5238, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 7.22% (0.1440 => 0.1544, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.98% (0.1906 => 0.2039, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.88% (0.8172 => 0.8734, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2554 => 0.2718, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.42% (5.7591 => 6.1286, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.37% (0.4615 => 0.4909, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.26% (0.2700 => 0.2869, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.10% (0.7115 => 0.7549, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.04% (0.6675 => 0.7078, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.02% (0.3423 => 0.3629, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5860 => 0.6212, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.3050 => 1.3833, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.96% (3.3354 => 3.5342, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.91% (8.1363 => 8.6173, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (1.5415 => 1.6323, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (4.2646 => 4.5152, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.87% (0.3307 => 0.3501, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.86% (0.2271 => 0.2404, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.5105 => 0.5401, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.9449 => 5.2228, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.8067 => 0.8517, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5569 => 0.5878, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (5.0018 => 5.2779, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.40% (0.2758 => 0.2907, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.31% (0.7835 => 0.8251, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 5.27% (1.1642 => 1.2256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9765 => 1.0279, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.19% (0.4299 => 0.4522, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.18% (7.9617 => 8.3744, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/Hello: 5.18% (0.5925 => 0.6232) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.3092 => 0.3251, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.06% (0.6030 => 0.6335, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.87% (1.0722 => 1.1244, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (1.1861 => 1.2434, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/09-vor/vor: 4.78% (0.3180 => 0.3332, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.74% (3.8723 => 4.0560, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.60% (0.5020 => 0.5251, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: 4.51% (1.5603 => 1.6307, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 4.47% (21.9371 => 22.9185, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.42% (0.6450 => 0.6735, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.32% (2.0273 => 2.1149, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 4.31% (2.2969 => 2.3959, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.29% (0.8921 => 0.9304, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 4.23% (0.7326 => 0.7636, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6456 => 0.6719) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.79% (1.4186 => 1.4724, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5859 => 1.6444, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4636 => 0.4807, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.62% (0.4064 => 0.4211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.54% (0.3422 => 0.3543, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (14.3668 => 14.8741, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.4289 => 0.4438, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.45% (0.3162 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.35% (0.4203 => 0.4344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2737, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.1840 => 1.2220, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3603 => 0.3716, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.97% (0.4620 => 0.4757, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.4048 => 0.4168, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0665 => 2.1232, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.8101 => 0.8285, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3779, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3843, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (4.2280 => 4.3619, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7490, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.34% (2.2771 => 2.3075, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7901, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.44% (5.2763 => 3.2480, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.93% (5.3855 => 3.8814, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.52% (5.3526 => 3.8797, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1205, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.72% (2.9384 => 2.5941, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.47% (22.1758 => 20.2973, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4279, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2917, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7174, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5841, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5127, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4233, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9839, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/chomp: -2.90% (1.2373 => 1.2014, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0004, std.dev.: 0.0093) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5068, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.6441 => 4.5875, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.89% (0.5229 => 0.5694, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.92% (14.9895 => 15.8762, std.dev.: 0.0222) MultiSource/Applications/kimwitu++/kc: 3.85% (14.1553 => 14.7009, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (4.1105 => 4.3090, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.66% (1.1048 => 1.2226, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (7.1582 => 7.3663, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.06% (3.4629 => 3.6728, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6222 => 0.6335, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 14 22:35:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 00:35:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915053521.9E1842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3834?compare_to=3828&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3834, Order: 163960, Start Time: 2012-09-15 02:52:53, End Time: 2012-09-15 05:36:41 To: 3828, Order: 163945, Start Time: 2012-09-14 23:40:47, End Time: 2012-09-15 02:24:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.86% (126.7906 => 130.4217, std.dev.: 0.6506) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.73% (1.0184 => 1.0008, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -1.16% (1.0451 => 1.0330, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3496 => 0.3852, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.18% (0.3488 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3465 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3446 => 0.3796, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3442 => 0.3790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.06% (0.3469 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.06% (0.3460 => 0.3808, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.81% (0.3650 => 0.4008, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3643 => 0.3998, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 9.53% (0.3724 => 0.4079, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.17% (1.5932 => 1.7074, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.24% (1.3152 => 1.3973, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5889 => 0.6237, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (1.6211 => 1.7166, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (2.7292 => 2.8876, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (0.4361 => 0.4609, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.60% (5.5417 => 5.8519, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (3.5627 => 3.7597, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 5.07% (1.0781 => 1.1328, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 4.93% (0.3004 => 0.3152, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.5000 => 0.5243, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (0.5026 => 0.5270, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.80% (23.5202 => 24.6486, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (0.3930 => 0.4118, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.73% (0.7171 => 0.7510, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 4.64% (4.2109 => 4.4061, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 4.60% (0.6634 => 0.6939, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.57% (2.1013 => 2.1973, std.dev.: 0.0131) MultiSource/Benchmarks/nbench/nbench: 4.56% (0.2566 => 0.2683, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (4.4195 => 4.6208, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.49% (0.2738 => 0.2861, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2875 => 0.3002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.35% (4.6177 => 4.8184, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: 4.25% (0.9909 => 1.0330, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (0.3890 => 0.4054, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 4.21% (0.2780 => 0.2897, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (1.8794 => 1.9583, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 4.18% (2.1653 => 2.2559, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.3903 => 0.4066, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (0.4658 => 0.4851, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (0.3625 => 0.3775, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3267 => 0.3402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.12% (0.2813 => 0.2929, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (2.0673 => 2.1522, std.dev.: 0.0113) MultiSource/Applications/spiff/spiff: 4.10% (0.4029 => 0.4194, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2811 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.3362 => 0.3497, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.01% (1.4269 => 1.4841, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.5900 => 0.6136, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3258 => 0.3387, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (1.9694 => 2.0461, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3317 => 0.3446, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.84% (0.4139 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3477 => 0.3610, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 3.82% (0.3348 => 0.3476, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4251 => 0.4412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.78% (0.3726 => 0.3867, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.77% (0.5546 => 0.5755, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.76% (0.4146 => 0.4302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3678 => 0.3815, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.70% (0.6435 => 0.6673, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.3845 => 0.3987, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.66% (0.3336 => 0.3458, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.58% (0.3690 => 0.3822, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.54% (2.0346 => 2.1066, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.51% (0.5012 => 0.5188, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (1.9966 => 2.0648, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.39% (0.3981 => 0.4116, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 3.21% (0.9697 => 1.0008, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (0.7426 => 0.7648, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (0.4847 => 0.4990, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (0.5361 => 0.5517, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (0.5584 => 0.5727, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (11.6398 => 11.9205, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.19% (4.6926 => 4.7956, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6661, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8916, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6278, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1948, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5068, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4358, std.dev.: 0.0208) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5929, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5624, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7833, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7924, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.73% (0.6293 => 0.6121, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -2.11% (17.2379 => 16.8735, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5781, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9743, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 00:24:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 02:24:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915072404.6CF7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3835?compare_to=3832&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3835, Order: 163963, Start Time: 2012-09-15 06:14:40, End Time: 2012-09-15 07:25:24 To: 3832, Order: 163962, Start Time: 2012-09-15 04:14:33, End Time: 2012-09-15 05:24:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (51 on baseline) Performance Improvements: 2 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.87% (0.0512 => 0.0624, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.16% (3.1633 => 3.5163, std.dev.: 0.0937) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.12% (15.8496 => 17.2947, std.dev.: 0.3777) SingleSource/Benchmarks/Shootout/heapsort: 6.30% (3.0655 => 3.2585, std.dev.: 0.0654) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.98% (1.3613 => 1.4155, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.78% (0.5944 => 0.5660, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.60% (0.4727 => 0.4604, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.35% (1.0015 => 0.9980, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 0.33% (0.5997 => 0.6017, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 2.07% (0.1639 => 0.1673, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.11% (0.1511 => 0.1558, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.52% (0.3097 => 0.3113, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.42% (0.2384 => 0.2394, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.11% (0.3214 => 0.3114, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.35% (0.2301 => 0.2270, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -13.46% (0.0431 => 0.0373, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: 2.27% (0.0088 => 0.0090, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0242 => 0.0241, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 43.28% (0.0134 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.00% (0.0300 => 0.0264, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 10.94% (0.0256 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0180 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.05% (0.0190 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 5.98% (0.0234 => 0.0248, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -6.13% (0.0326 => 0.0306, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -1.10% (0.1452 => 0.1436, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.18% (1.4948 => 1.5124, std.dev.: 0.0166) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.02% (0.1591 => 0.1543, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.99% (0.4242 => 0.4200, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.52% (0.1422 => 0.1372, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.95% (0.0626 => 0.0657, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.94% (0.0262 => 0.0215, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.77% (0.0562 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1485 => 1.1503, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.67% (0.0015 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.63% (0.0543 => 0.0579, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.57% (0.0210 => 0.0249, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.7796 => 0.7753, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.17% (1.6073 => 1.6101, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.08% (0.0113 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.29% (4.1772 => 3.0373, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/except: 82233.33% (0.0006 => 0.4940, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.5309 => 0.5630, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.01% (0.6410 => 0.6795, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 5.39% (2.1763 => 2.2937, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.35% (0.2552 => 0.2663, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3582 => 0.3728, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.88% (0.6915 => 0.7183, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 3.58% (1.0046 => 1.0406, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.58% (0.6173 => 0.6394, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 3.50% (1.1653 => 1.2061, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 3.30% (15.3105 => 15.8162, std.dev.: 0.1341) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.5150 => 1.5589, std.dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: 2.14% (29.3170 => 29.9432, std.dev.: 0.1687) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.7639 => 0.7781, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (1.3935 => 1.4120, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.05% (0.0499 => 0.0624, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.45% (0.0917 => 0.1077, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3746 => 0.4285, std.dev.: 0.0144) MultiSource/Benchmarks/nbench/nbench: 13.96% (21.1721 => 24.1277, std.dev.: 1.1334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.14% (4.0101 => 4.5369, std.dev.: 0.0494) SingleSource/Benchmarks/Stanford/Puzzle: 11.10% (0.1433 => 0.1592, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.24% (15.8312 => 17.2947, std.dev.: 0.3777) SingleSource/Benchmarks/Shootout/lists: 8.51% (7.0025 => 7.5986, std.dev.: 0.0245) SingleSource/Benchmarks/McGill/chomp: 7.46% (1.0194 => 1.0954, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.44% (1.0063 => 1.0812, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.50% (4.2129 => 4.4866, std.dev.: 0.0274) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8156, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.3301 => 0.3481, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.34% (40.4792 => 42.2344, std.dev.: 0.6296) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.15% (0.8498 => 0.8851, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8121, std.dev.: 0.0609) SingleSource/Benchmarks/Misc/ReedSolomon: 3.82% (8.5113 => 8.8361, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.05% (0.3508 => 0.3615, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.80% (2.6656 => 2.7402, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.12% (4.6127 => 4.7104, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/five11/five11: 2.05% (5.1938 => 5.3004, std.dev.: 0.0356) MultiSource/Applications/hexxagon/hexxagon: 1.72% (14.4877 => 14.7364, std.dev.: 0.0630) MultiSource/Applications/siod/siod: 1.60% (3.5520 => 3.6087, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5321, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (2.4455 => 2.4794, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.23% (1.2726 => 1.2882, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (4.6414 => 4.6889, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.52% (0.3497 => 0.2045, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.44% (5.2665 => 4.0845, std.dev.: 0.0517) SingleSource/Benchmarks/Shootout-C++/ary3: -20.09% (1.7473 => 1.3963, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.28% (1.1647 => 0.9401, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1566, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -9.28% (62.4126 => 56.6196, std.dev.: 0.0612) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.40% (3.2007 => 2.9318, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2878, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.65% (2.4457 => 2.2585, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.25% (3.6254 => 3.3625, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -6.01% (3.4230 => 3.2172, std.dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -5.63% (1.4441 => 1.3628, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: -5.18% (4.6355 => 4.3953, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: -4.45% (1.4117 => 1.3489, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.39% (1.7361 => 1.6773, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -3.12% (9.2503 => 8.9617, std.dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.98% (1.1683 => 1.1335, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/misr: -2.84% (0.4296 => 0.4174, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -2.84% (7.6833 => 7.4652, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2870, std.dev.: 0.0053) MultiSource/Applications/aha/aha: -2.51% (3.4286 => 3.3427, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.35% (1.8739 => 1.8298, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.28% (3.7496 => 3.6642, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4195, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2388, std.dev.: 0.0168) MultiSource/Benchmarks/PAQ8p/paq8p: -1.47% (92.7467 => 91.3808, std.dev.: 0.1475) MultiSource/Benchmarks/FreeBench/neural/neural: -1.42% (1.0926 => 1.0771, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7662, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3115, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: -1.34% (3.8907 => 3.8386, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: - (0.9980 => 0.9980, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: -0.08% (0.6022 => 0.6017, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 0.42% (0.1666 => 0.1673, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.26% (0.1554 => 0.1558, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.97% (0.3083 => 0.3113, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2394 => 0.2394, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.92% (0.3175 => 0.3114, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (0.2302 => 0.2270, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -16.93% (0.0449 => 0.0373, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.29% (0.0301 => 0.0264, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -5.85% (0.0325 => 0.0306, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1429 => 0.1436, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 0.70% (1.5019 => 1.5124, std.dev.: 0.0166) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.80% (0.1501 => 0.1543, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.50% (0.4264 => 0.4200, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.08% (0.1344 => 0.1372, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.54% (0.0589 => 0.0657, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.33% (0.0232 => 0.0215, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.35% (1.1350 => 1.1503, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 133.33% (0.0006 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.11% (0.0637 => 0.0579, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.22% (0.0246 => 0.0249, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.81% (0.7541 => 0.7753, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.80% (1.5363 => 1.6101, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 00:44:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 02:44:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915074415.E12582A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3836?compare_to=3831&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3836, Order: 163963, Start Time: 2012-09-15 06:27:38, End Time: 2012-09-15 07:45:36 To: 3831, Order: 163962, Start Time: 2012-09-15 03:58:57, End Time: 2012-09-15 05:13:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (158 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (712 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5049 => 56.4684, std.dev.: 0.2640) SingleSource/Benchmarks/Misc/lowercase: 1.50% (7.9252 => 8.0444, std.dev.: 0.0119) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.38% (2.0176 => 2.4086, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.61% (3.9660 => 4.3471, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.26% (0.7710 => 0.8424, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.5818 => 0.6356, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.21% (0.7038 => 0.7686, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.88% (1.3693 => 1.4909, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.87% (0.5265 => 0.5732, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.77% (0.9199 => 1.0006, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.69% (1.2193 => 1.3252, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.58% (0.6959 => 0.7556, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.30% (13.8202 => 14.9673, std.dev.: 0.3342) SingleSource/Benchmarks/Shootout-C++/hash: 8.27% (0.4062 => 0.4398, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.26% (1.1364 => 1.2303, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.18% (1.4563 => 1.5754, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.01% (0.1435 => 0.1550, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.00% (0.5577 => 0.6023, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3899 => 0.4198, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 7.61% (1.0313 => 1.1098, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.5637 => 0.6045, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.10% (3.8646 => 4.1388, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4390 => 0.4701, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.08% (0.8310 => 0.8898, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (7.2180 => 7.7283, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3580 => 0.3833, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.98% (0.7460 => 0.7981, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (3.6692 => 3.9245, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.86% (1.9828 => 2.1189, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.82% (0.4016 => 0.4290, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.80% (0.2925 => 0.3124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.80% (0.2690 => 0.2873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.3914 => 0.4174, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.61% (0.3220 => 0.3433, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.3868 => 0.4122, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.54% (0.3578 => 0.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 6.44% (0.3601 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.42% (0.3646 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.41% (0.3789 => 0.4032, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.33% (0.3663 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.33% (0.3650 => 0.3881, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.32% (16.6129 => 17.6624, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4076, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.24% (0.6744 => 0.7165, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 6.23% (1.0594 => 1.1254, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.19% (1.3813 => 1.4668, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (1.3819 => 1.4663, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 5.89% (14.8535 => 15.7280, std.dev.: 0.2883) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.87% (0.6135 => 0.6495, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.78% (1.2749 => 1.3486, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 5.72% (8.4961 => 8.9822, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.70% (0.8698 => 0.9194, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.67% (4.3801 => 4.6283, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.2859 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.59% (4.4433 => 4.6916, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.54% (0.6576 => 0.6940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.50% (0.8818 => 0.9303, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (13.2842 => 14.0047, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 5.23% (4.6629 => 4.9069, std.dev.: 0.0911) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1333 => 1.1922, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2689, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.96% (3.2742 => 3.4366, std.dev.: 0.0200) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2292 => 1.2830, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (0.9108 => 0.9506, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.07% (4.9865 => 5.1895, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 3.98% (3.7467 => 3.8960, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (1.5188 => 1.5790, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6250 => 0.6493, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.62% (2.1007 => 2.1768, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (6.2785 => 6.5039, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.96% (33.2944 => 34.2797, std.dev.: 0.0169) MultiSource/Applications/sqlite3/sqlite3: 1.66% (16.2614 => 16.5311, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4123, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (0.2093 => 0.2220, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5483, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6028, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5987, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.65% (22.5627 => 21.7397, std.dev.: 0.0438) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2513, std.dev.: 0.0412) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.59% (1.3780 => 1.3010, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9238, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5843, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8983, std.dev.: 0.0316) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2413, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2376, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std.dev.: 0.0120) MultiSource/Applications/viterbi/viterbi: -1.13% (4.4810 => 4.4302, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2595, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (4.1080 => 4.0642, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 00:48:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 02:48:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915074841.122322A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3837?compare_to=3833&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3837, Order: 163963, Start Time: 2012-09-15 06:27:49, End Time: 2012-09-15 07:50:01 To: 3833, Order: 163962, Start Time: 2012-09-15 04:11:49, End Time: 2012-09-15 05:31:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (113 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (734 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.88% (0.5694 => 0.5744, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 0.07% (15.8762 => 15.8872, std.dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 0.08% (14.7009 => 14.7127, std.dev.: 0.0265) MultiSource/Benchmarks/Bullet/bullet: 0.07% (82.4215 => 82.4824, std.dev.: 0.0494) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.3090 => 4.3136, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2226 => 1.2220, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.3663 => 7.3700, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.35% (3.6728 => 3.6599, std.dev.: 0.0666) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.49% (0.6335 => 0.6366, std.dev.: 0.0121) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.0649 => 0.0686, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.42% (63.2438 => 82.4824, std.dev.: 0.0494) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14254.86% (0.0720 => 10.3355, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.05% (10.3673 => 14.9344, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 26.08% (0.1622 => 0.2045, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.77% (2.2022 => 2.5275, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.28% (7.0540 => 8.0613, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 13.97% (0.1432 => 0.1632, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.09% (0.1566 => 0.1771, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.56% (1.1194 => 1.2600, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.97% (1.7609 => 1.9540, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 10.39% (10.4361 => 11.5206, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.57% (0.3543 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3497 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.52% (0.3561 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.50% (0.3516 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3828 => 0.4179, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.3927 => 0.4285, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 8.96% (0.3886 => 0.4234, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.69% (9.4845 => 10.2138, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.4879 => 0.5254, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.45% (0.1906 => 0.2048, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.40% (0.3177 => 0.3412, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.8172 => 0.8755, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (0.4615 => 0.4942, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 6.45% (5.7591 => 6.1304, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7433 => 0.7902, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.5860 => 0.6224, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 6.17% (0.7115 => 0.7554, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.05% (0.3423 => 0.3630, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.03% (0.2271 => 0.2408, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (8.1363 => 8.6263, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (4.2646 => 4.5181, std.dev.: 0.0112) MultiSource/Applications/Burg/burg: 5.94% (1.1642 => 1.2333, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: 5.92% (3.3354 => 3.5328, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.90% (1.3050 => 1.3820, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.90% (1.5415 => 1.6324, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.83% (0.8067 => 0.8537, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.79% (0.2107 => 0.2229, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.78% (4.9449 => 5.2306, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.63% (5.0018 => 5.2832, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5569 => 0.5880, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 5.50% (0.7835 => 0.8266, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.37% (0.2758 => 0.2906, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3121 => 0.3287, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.27% (0.9765 => 1.0280, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (7.9617 => 8.3803, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.3092 => 0.3251, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5925 => 0.6225, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.01% (0.6030 => 0.6332, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.91% (0.3180 => 0.3336, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.88% (3.8723 => 4.0611, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: 4.86% (1.5603 => 1.6362, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (1.1861 => 1.2437, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7326 => 0.7681, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 4.81% (1.0722 => 1.1238, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 4.52% (21.9371 => 22.9281, std.dev.: 0.0394) MultiSource/Applications/treecc/treecc: 4.40% (2.0273 => 2.1164, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.37% (0.6450 => 0.6732, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 4.33% (2.2969 => 2.3964, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8921 => 0.9303, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.1840 => 1.2314, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.68% (0.4103 => 0.4254, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4636 => 0.4806, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (14.3668 => 14.8916, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.4186 => 1.4699, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists: 3.57% (0.3422 => 0.3544, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.35% (0.3826 => 0.3954, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4203 => 0.4340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3603 => 0.3716, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.89% (0.4048 => 0.4165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.73% (2.0665 => 2.1229, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.8101 => 0.8274, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3843, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3853, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3497, std.dev.: 0.0372) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7885, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2236, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5752, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2489, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.91% (5.3855 => 3.8825, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.43% (5.3526 => 3.8844, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1367, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.65% (2.9384 => 2.5960, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -8.41% (22.1758 => 20.3106, std.dev.: 0.0460) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.58% (1.5373 => 1.3747, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2565, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.85% (4.8142 => 4.4844, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5022, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.6802 => 8.4385, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0082, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/chomp: -2.57% (1.2373 => 1.2055, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0095, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5091, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5766, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7049, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2275, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.85% (0.5229 => 0.5744, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.99% (14.9895 => 15.8872, std.dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 3.94% (14.1553 => 14.7127, std.dev.: 0.0265) MultiSource/Benchmarks/MallocBench/gs/gs: 4.94% (4.1105 => 4.3136, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.61% (1.1048 => 1.2220, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.96% (7.1582 => 7.3700, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.69% (3.4629 => 3.6599, std.dev.: 0.0666) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (0.6222 => 0.6366, std.dev.: 0.0121) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 01:50:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 03:50:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915085011.E9D352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3838?compare_to=3835&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3838, Order: 163964, Start Time: 2012-09-15 07:40:56, End Time: 2012-09-15 08:51:33 To: 3835, Order: 163963, Start Time: 2012-09-15 06:14:40, End Time: 2012-09-15 07:25:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (47 on baseline) Performance Improvements: 2 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 897 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 1.10% (3.8698 => 3.9123, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.06% (3.0373 => 3.1302, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.02% (1.8970 => 1.8776, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -34.52% (0.0310 => 0.0203, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.86% (0.9980 => 0.9894, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -0.48% (0.6017 => 0.5988, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -2.33% (0.1673 => 0.1634, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1558 => 0.1568, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.44% (0.3113 => 0.3037, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2394 => 0.2398, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (0.3114 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (0.2270 => 0.2335, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 21.18% (0.0373 => 0.0452, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -2.22% (0.0090 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.41% (0.0241 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0388 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.53% (0.0264 => 0.0223, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0322 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0179 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0248 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.98% (0.0306 => 0.0309, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0011 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1436 => 0.1433, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -0.39% (1.5124 => 1.5065, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1543 => 0.1543, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.62% (0.4200 => 0.4006, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.50% (0.1372 => 0.1420, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.59% (0.0657 => 0.0594, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.56% (0.0215 => 0.0188, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.16% (0.0645 => 0.0573, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1503 => 1.1507, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.25% (0.0579 => 0.0621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.70% (0.0249 => 0.0185, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.76% (0.7753 => 0.7812, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.08% (1.6101 => 1.6088, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.70% (0.0121 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.06% (4.1772 => 3.1302, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 82066.67% (0.0006 => 0.4930, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.55% (0.5309 => 0.5657, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.23% (0.6410 => 0.6745, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: 4.82% (2.1763 => 2.2812, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.2552 => 0.2672, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3582 => 0.3729, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.24% (0.6173 => 0.6373, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 3.11% (0.6915 => 0.7130, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 3.09% (15.3105 => 15.7829, std.dev.: 0.1192) MultiSource/Applications/lemon/lemon: 2.87% (1.0046 => 1.0334, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.1653 => 1.1983, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5150 => 1.5514, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 2.24% (29.3170 => 29.9741, std.dev.: 0.1313) MultiSource/Applications/d/make_dparser: 1.56% (3.0225 => 3.0696, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.43% (0.0263 => 0.0393, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2289, std.dev.: 0.0336) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.12% (0.0917 => 0.1074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 15.53% (1.7426 => 2.0133, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3746 => 0.4281, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5574, std.dev.: 0.0209) SingleSource/Benchmarks/Stanford/Puzzle: 12.00% (0.1433 => 0.1605, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 11.86% (21.1721 => 23.6822, std.dev.: 0.4598) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.28% (0.2694 => 0.2998, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 8.96% (7.0025 => 7.6299, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/chomp: 8.67% (1.0194 => 1.1078, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.32% (1.0063 => 1.0800, std.dev.: 0.0115) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (27.1724 => 28.8214, std.dev.: 0.0694) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (0.3301 => 0.3471, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.12% (40.4792 => 42.5507, std.dev.: 0.4583) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.11% (0.2857 => 0.3003, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 4.35% (15.2242 => 15.8870, std.dev.: 0.0431) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.34% (0.8498 => 0.8867, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/dt: 4.05% (0.9851 => 1.0250, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.92% (4.2129 => 4.3782, std.dev.: 0.0614) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.79% (3.4080 => 3.5372, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (6.6312 => 6.8753, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 2.91% (8.5113 => 8.7590, std.dev.: 0.0611) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.28% (2.6656 => 2.7265, std.dev.: 0.0228) MultiSource/Benchmarks/BitBench/five11/five11: 2.02% (5.1938 => 5.2987, std.dev.: 0.0282) MultiSource/Applications/siod/siod: 1.66% (3.5520 => 3.6109, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 1.64% (14.4877 => 14.7258, std.dev.: 0.0236) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4455 => 2.4819, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.29% (4.6127 => 4.6723, std.dev.: 0.0224) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.62% (0.7738 => 0.7535, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.20% (4.2815 => 4.2301, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.89% (5.2665 => 4.1661, std.dev.: 0.0514) SingleSource/Benchmarks/Shootout-C++/ary3: -20.07% (1.7473 => 1.3967, std.dev.: 0.0442) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.30% (1.1647 => 0.9399, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -9.51% (62.4126 => 56.4743, std.dev.: 0.1791) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9333, std.dev.: 0.0375) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.23% (1.4034 => 1.2879, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.43% (2.4457 => 2.2641, std.dev.: 0.0308) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.06% (3.6254 => 3.3696, std.dev.: 0.0266) MultiSource/Applications/SIBsim4/SIBsim4: -6.85% (3.4230 => 3.1884, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/richards_benchmark: -6.49% (1.4441 => 1.3504, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/methcall: -5.41% (9.2503 => 8.7500, std.dev.: 0.1271) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (4.6355 => 4.4045, std.dev.: 0.0341) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: -4.12% (1.4117 => 1.3535, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/misr: -3.68% (0.4296 => 0.4138, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -3.62% (7.6833 => 7.4051, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.57% (3.7496 => 3.6159, std.dev.: 0.0340) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.30% (1.7361 => 1.6788, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0210) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.76% (1.2722 => 1.2371, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -2.64% (3.4286 => 3.3381, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/flops: -2.64% (9.5474 => 9.2956, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.46% (1.1683 => 1.1396, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.44% (0.4140 => 0.4039, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4170, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2304, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.3569 => 2.3215, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3328, std.dev.: 0.0615) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.86% (0.9980 => 0.9894, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -0.56% (0.6022 => 0.5988, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -1.92% (0.1666 => 0.1634, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1554 => 0.1568, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.49% (0.3083 => 0.3037, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2394 => 0.2398, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.23% (0.3175 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.43% (0.2302 => 0.2335, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0449 => 0.0452, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.91% (0.0301 => 0.0223, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -4.92% (0.0325 => 0.0309, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1429 => 0.1433, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 0.31% (1.5019 => 1.5065, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.80% (0.1501 => 0.1543, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.05% (0.4264 => 0.4006, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.65% (0.1344 => 0.1420, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.85% (0.0589 => 0.0594, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.97% (0.0232 => 0.0188, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.33% (0.0639 => 0.0573, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.38% (1.1350 => 1.1507, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.51% (0.0637 => 0.0621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.80% (0.0246 => 0.0185, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.59% (0.7541 => 0.7812, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.72% (1.5363 => 1.6088, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.71% (0.0070 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 01:51:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 03:51:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915085101.E7ED42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3839?compare_to=3834&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3839, Order: 163962, Start Time: 2012-09-15 06:05:08, End Time: 2012-09-15 08:52:21 To: 3834, Order: 163960, Start Time: 2012-09-15 02:52:53, End Time: 2012-09-15 05:36:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (106 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (789 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.04% (1.7074 => 1.7252, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3465 => 0.3811, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 9.98% (0.3496 => 0.3845, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3446 => 0.3788, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3488 => 0.3832, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3469 => 0.3811, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3442 => 0.3781, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-3: 9.71% (0.3460 => 0.3796, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/property: 9.53% (0.3650 => 0.3998, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: 9.47% (0.3643 => 0.3988, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/parameter-passing: 9.21% (0.3724 => 0.4067, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 8.29% (1.5932 => 1.7252, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.04% (1.6211 => 1.7190, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.76% (0.5889 => 0.6228, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (1.3152 => 1.3909, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.64% (3.5627 => 3.7635, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 5.63% (5.5417 => 5.8539, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (0.4994 => 0.5272, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (0.4361 => 0.4602, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (2.7292 => 2.8793, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.39% (0.1968 => 0.2074, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.36% (0.5000 => 0.5268, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.22% (1.0781 => 1.1344, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 5.03% (0.6634 => 0.6968, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.01% (0.5026 => 0.5278, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.81% (4.2109 => 4.4136, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.69% (0.5900 => 0.6177, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 4.65% (23.5202 => 24.6146, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.2866 => 0.2998, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.57% (0.9909 => 1.0362, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 4.56% (0.2566 => 0.2683, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.53% (0.3903 => 0.4080, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (1.8794 => 1.9634, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 4.46% (4.6177 => 4.8236, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 4.43% (2.1013 => 2.1944, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (0.3890 => 0.4062, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (4.4195 => 4.6132, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.36% (1.4269 => 1.4891, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.36% (2.1653 => 2.2596, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3195 => 0.3333, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2823 => 0.2941, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.4139 => 0.4311, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.13% (0.3271 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (0.4658 => 0.4847, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3726 => 0.3876, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2813 => 0.2926, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (2.0673 => 2.1501, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2911 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 3.92% (0.2803 => 0.2913, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.88% (0.5546 => 0.5761, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (1.9694 => 2.0440, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (0.2691 => 0.2792, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3625 => 0.3761, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (1.9966 => 2.0710, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3282 => 0.3399, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.54% (0.3336 => 0.3454, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 3.52% (0.7875 => 0.8152, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.51% (0.5012 => 0.5188, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.35% (2.0346 => 2.1028, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 3.31% (0.9697 => 1.0018, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (0.7426 => 0.7652, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (0.4847 => 0.4989, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (0.5361 => 0.5516, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (0.5584 => 0.5727, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (11.6398 => 11.9205, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (4.6926 => 4.7992, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6645, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1606, std.dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: 2.57% (14.0481 => 14.4090, std.dev.: 0.1052) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5082, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 1.73% (15.8721 => 16.1459, std.dev.: 0.0315) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4478, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2811, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5855, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4797, std.dev.: 0.0318) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.37% (25.4195 => 16.1756, std.dev.: 0.1938) SingleSource/Benchmarks/Shootout-C++/ary2: -9.66% (0.2402 => 0.2170, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8076, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8048, std.dev.: 0.1577) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9640, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 02:27:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 04:27:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915092724.E49FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3840?compare_to=3836&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3840, Order: 163964, Start Time: 2012-09-15 08:14:08, End Time: 2012-09-15 09:28:44 To: 3836, Order: 163963, Start Time: 2012-09-15 06:27:38, End Time: 2012-09-15 07:45:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.81% (2.0176 => 2.4172, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.35% (3.9660 => 4.3368, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7038 => 0.7683, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.7710 => 0.8392, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.72% (0.5748 => 0.6249, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.69% (1.3693 => 1.4883, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.52% (0.9199 => 0.9983, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.49% (1.2193 => 1.3228, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.48% (0.6959 => 0.7549, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.45% (1.4563 => 1.5794, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.43% (0.5265 => 0.5709, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.36% (0.4328 => 0.4690, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7061 => 0.7636, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.13% (1.1364 => 1.2288, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 8.08% (13.8202 => 14.9365, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5577 => 0.6007, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.71% (0.4062 => 0.4375, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.58% (0.6283 => 0.6759, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 7.46% (1.0313 => 1.1082, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.42% (0.3246 => 0.3487, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.24% (1.1061 => 1.1862, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.22% (0.4791 => 0.5137, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3022 => 0.3236, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.00% (0.3485 => 0.3729, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5637 => 0.6031, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2127 => 0.2275, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 6.94% (0.8310 => 0.8887, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.90% (0.3580 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3489 => 0.3729, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (7.2180 => 7.7109, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.83% (3.6692 => 3.9197, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.82% (0.7506 => 0.8018, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.78% (3.8646 => 4.1265, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.76% (0.3756 => 0.4010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.75% (0.4016 => 0.4287, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.74% (0.3293 => 0.3515, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.72% (1.9828 => 2.1160, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.70% (0.2655 => 0.2833, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2765 => 0.2948, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.60% (0.2925 => 0.3118, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.57% (0.7460 => 0.7950, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2726 => 0.2905, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.55% (0.3220 => 0.3431, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.53% (2.1791 => 2.3215, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.41% (0.3868 => 0.4116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3107 => 0.3304, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.31% (1.0594 => 1.1263, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.29% (0.3149 => 0.3347, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.27% (3.1889 => 3.3889, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2696 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.24% (0.4390 => 0.4664, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 6.18% (0.6744 => 0.7161, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 6.16% (1.9270 => 2.0457, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.16% (0.6576 => 0.6981, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.10% (1.3245 => 1.4053, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3534 => 0.3747, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.99% (16.6129 => 17.6085, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.96% (1.3819 => 1.4643, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4113 => 0.4356, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.90% (1.3813 => 1.4628, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 5.87% (0.4003 => 0.4238, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.84% (0.3578 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.83% (0.3914 => 0.4142, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 5.82% (14.8535 => 15.7173, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/synchronized: 5.79% (0.3663 => 0.3875, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.75% (0.8818 => 0.9325, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 5.74% (1.2749 => 1.3481, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.68% (0.3646 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.67% (0.3601 => 0.3805, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.63% (0.3940 => 0.4162, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.61% (8.4961 => 8.9724, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3650 => 0.3854, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 5.58% (0.3623 => 0.3825, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.55% (0.8698 => 0.9181, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.52% (4.3801 => 4.6221, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9986, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (4.4433 => 4.6811, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.03% (0.3755 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1333 => 1.1902, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.00% (3.2742 => 3.4378, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 4.93% (14.5298 => 15.2462, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 4.88% (6.5754 => 6.8961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2321 => 0.2432, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.76% (4.6629 => 4.8847, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (0.9108 => 0.9503, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2804, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4805 => 0.5003, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1871, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.5188 => 1.5796, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 3.78% (3.7467 => 3.8883, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.6250 => 0.6484, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.62% (2.1007 => 2.1767, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (6.2785 => 6.4963, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 2.89% (33.2944 => 34.2551, std.dev.: 0.0186) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5362, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2651, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.2093 => 0.2217, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6979, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5476, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0974, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5988, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5115, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1423, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5866, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.11% (0.4657 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.94% (22.5627 => 21.6738, std.dev.: 0.0268) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2959, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std.dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9239, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6138, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -2.27% (26.5159 => 25.9136, std.dev.: 0.0370) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2478, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8578, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2357, std.dev.: 0.0243) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0628, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 02:37:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 04:37:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915093734.793542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3841?compare_to=3837&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3841, Order: 163964, Start Time: 2012-09-15 08:18:51, End Time: 2012-09-15 09:38:54 To: 3837, Order: 163963, Start Time: 2012-09-15 06:27:49, End Time: 2012-09-15 07:50:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (119 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.30% (0.3888 => 0.4405, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.14% (1.2055 => 1.2193, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 1.14% (3.7053 => 3.7475, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.01% (14.9344 => 14.6344, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.70% (0.5744 => 0.5704, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.29% (15.8872 => 15.8404, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: -0.14% (14.7127 => 14.6928, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 0.04% (82.4824 => 82.5153, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/gs/gs: -0.51% (4.3136 => 4.2918, std.dev.: 0.0851) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.25% (1.2220 => 1.2189, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.3700 => 7.3740, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.13% (3.6599 => 3.6553, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.47% (0.6366 => 0.6336, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1428 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.19% (0.0686 => 0.0671, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.47% (63.2438 => 82.5153, std.dev.: 0.0206) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14258.19% (0.0720 => 10.3379, std.dev.: 0.0130) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.16% (10.3673 => 14.6344, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.12% (2.2022 => 2.5132, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/flops: 13.83% (0.1432 => 0.1630, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.52% (7.0540 => 8.0074, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.32% (1.1194 => 1.2573, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.72% (1.7609 => 1.9497, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 9.71% (10.4361 => 11.4496, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3543 => 0.3875, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3473 => 0.3785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.65% (0.3561 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3543 => 0.3849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3516 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3694 => 0.4005, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.31% (0.3828 => 0.4146, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 8.23% (0.3927 => 0.4250, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.00% (0.3886 => 0.4197, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.43% (9.4845 => 10.1895, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.4879 => 0.5227, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.8172 => 0.8726, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.10% (0.7115 => 0.7549, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.08% (1.5415 => 1.6353, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.08% (0.7433 => 0.7885, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (0.4615 => 0.4893, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.2554 => 0.2706, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.3307 => 0.3502, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.89% (5.7591 => 6.0984, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.6675 => 0.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.82% (0.5105 => 0.5402, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3806, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.78% (0.5860 => 0.6199, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 5.73% (0.3423 => 0.3619, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 5.70% (3.3354 => 3.5255, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (8.1363 => 8.5963, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (4.2646 => 4.5014, std.dev.: 0.0733) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.41% (4.9449 => 5.2125, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (5.0018 => 5.2695, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.21% (0.8067 => 0.8487, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9765 => 1.0270, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.16% (0.3121 => 0.3282, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 5.15% (0.5925 => 0.6230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5569 => 0.5854, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.07% (0.6030 => 0.6336, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.03% (0.7835 => 0.8229, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.00% (0.2758 => 0.2896, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.98% (1.1642 => 1.2222, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (7.9617 => 8.3545, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3441 => 0.3600, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.60% (1.5603 => 1.6320, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 4.59% (1.0722 => 1.1214, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.55% (3.8723 => 4.0483, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.5020 => 0.5247, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.49% (1.1861 => 1.2393, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 4.40% (0.3180 => 0.3320, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.31% (0.6450 => 0.6728, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.30% (0.7326 => 0.7641, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 4.29% (2.0273 => 2.1142, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 4.28% (21.9371 => 22.8761, std.dev.: 0.0234) MultiSource/Applications/siod/siod: 4.19% (2.2969 => 2.3931, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 4.17% (0.8921 => 0.9293, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 4.09% (0.6456 => 0.6720, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.4636 => 0.4824, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.4064 => 0.4221, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3422 => 0.3550, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (14.3668 => 14.8699, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.4186 => 1.4676, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.42% (0.3865 => 0.3997, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3935 => 0.4068, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.29% (2.2024 => 2.2748, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.4289 => 0.4428, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.04% (0.4048 => 0.4171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4620 => 0.4760, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.1840 => 1.2192, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0665 => 2.1259, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 2.71% (0.3684 => 0.3784, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.52% (1.2842 => 1.3037, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7495, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0083) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2504, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 1.30% (3.6994 => 3.7475, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7896, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.56% (5.2763 => 3.2420, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.21% (5.3855 => 3.8665, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.64% (5.3526 => 3.8731, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1012, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.85% (2.9384 => 2.5901, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.64% (22.1758 => 20.2605, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2880, std.dev.: 0.0197) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.87% (0.3463 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.48% (1.8329 => 1.7141, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5061, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4280, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9975, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0074, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: -1.45% (1.2373 => 1.2193, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5768, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2333, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.08% (0.5229 => 0.5704, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.68% (14.9895 => 15.8404, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 3.80% (14.1553 => 14.6928, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 4.41% (4.1105 => 4.2918, std.dev.: 0.0851) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.33% (1.1048 => 1.2189, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (7.1582 => 7.3740, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.56% (3.4629 => 3.6553, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6222 => 0.6336, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 05:05:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 07:05:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915120513.AC5212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3842?compare_to=3839&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3842, Order: 163964, Start Time: 2012-09-15 09:21:04, End Time: 2012-09-15 12:06:33 To: 3839, Order: 163962, Start Time: 2012-09-15 06:05:08, End Time: 2012-09-15 08:52:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (779 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 26.49% (0.4133 => 0.5228, std.dev.: 0.0277) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 2.36% (16.1756 => 16.5567, std.dev.: 0.0167) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3488 => 0.3835, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3442 => 0.3763, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3496 => 0.3822, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 9.32% (0.3465 => 0.3788, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 9.28% (0.3469 => 0.3791, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.28% (0.3460 => 0.3781, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 9.15% (0.3650 => 0.3984, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3643 => 0.3966, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 8.78% (0.3724 => 0.4051, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 7.34% (1.5932 => 1.7102, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5826 => 0.6179, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5889 => 0.6238, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.80% (1.3152 => 1.3915, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.70% (1.6211 => 1.7135, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.49% (0.2566 => 0.2707, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7171 => 0.7564, std.dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 5.38% (5.5417 => 5.8398, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.33% (2.7292 => 2.8746, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 5.32% (1.0781 => 1.1355, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.31% (3.5627 => 3.7518, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.23% (0.4994 => 0.5255, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (0.3930 => 0.4132, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (0.5026 => 0.5280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 4.99% (0.6634 => 0.6965, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.5900 => 0.6184, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.78% (4.2109 => 4.4123, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 4.70% (23.5202 => 24.6261, std.dev.: 0.0237) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (4.4195 => 4.6230, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 4.53% (0.3336 => 0.3487, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.41% (0.9909 => 1.0346, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 4.39% (4.6177 => 4.8206, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 4.38% (2.1013 => 2.1934, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (1.8794 => 1.9606, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 4.32% (0.4146 => 0.4325, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2875 => 0.2999, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.28% (2.1653 => 2.2579, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.23% (0.3195 => 0.3330, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.97% (1.4269 => 1.4835, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.95% (0.4029 => 0.4188, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2813 => 0.2924, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (2.0673 => 2.1485, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.88% (0.3348 => 0.3478, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.82% (0.3060 => 0.3177, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.3903 => 0.4052, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3267 => 0.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2803 => 0.2909, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.72% (0.3282 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.61% (0.4658 => 0.4826, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.61% (0.5546 => 0.5746, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.3084 => 0.3194, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.3678 => 0.3809, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 3.55% (0.4251 => 0.4402, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 3.44% (2.0346 => 2.1046, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.3981 => 0.4117, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3690 => 0.3815, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.3271 => 0.3380, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.31% (1.9694 => 2.0345, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.23% (1.9966 => 2.0610, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.23% (0.7875 => 0.8129, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.09% (0.9697 => 0.9997, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (0.7426 => 0.7641, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.87% (0.4847 => 0.4986, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (0.5361 => 0.5503, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (0.5584 => 0.5718, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.19% (11.6398 => 11.8948, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.15% (4.6926 => 4.7934, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6680, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1714, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8879, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2044, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5045, std.dev.: 0.0219) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4501, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.42% (1.0927 => 1.1082, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6007, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5567, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7929, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.1050) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7942, std.dev.: 0.1287) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9724, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.4998, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 06:17:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 08:17:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915131704.5A5CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3843?compare_to=3838&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3843, Order: 163965, Start Time: 2012-09-15 12:07:48, End Time: 2012-09-15 13:18:26 To: 3838, Order: 163964, Start Time: 2012-09-15 07:40:56, End Time: 2012-09-15 08:51:33 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (56 on baseline) Performance Improvements: 13 (45 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 877 (790 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7130 => 0.7250, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.35% (3.5949 => 3.6435, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 1.18% (1.0334 => 1.0456, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.64% (0.9399 => 1.1151, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.36% (2.4224 => 2.6734, std.dev.: 0.0503) MultiSource/Applications/lua/lua: 3.58% (29.2822 => 30.3310, std.dev.: 0.0971) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (4.3782 => 4.5052, std.dev.: 0.0233) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (56.4743 => 57.5898, std.dev.: 0.3053) SingleSource/Benchmarks/Shootout-C++/methcall: 1.91% (8.7500 => 8.9167, std.dev.: 0.0371) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.83% (0.6077 => 0.6188, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.09% (42.5507 => 43.0142, std.dev.: 0.1245) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.66% (0.0587 => 0.0319, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.81% (0.2970 => 0.1639, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -21.05% (1.4102 => 1.1133, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.02% (1.4079 => 1.1120, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -2.64% (14.5642 => 14.1793, std.dev.: 0.0545) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -16.59% (0.5002 => 0.4172, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -12.16% (1.6788 => 1.4746, std.dev.: 0.0395) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.81% (14.4770 => 13.2018, std.dev.: 0.0984) SingleSource/Benchmarks/Misc/flops: -5.81% (9.2956 => 8.7552, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: -5.45% (23.6822 => 22.3906, std.dev.: 0.1018) MultiSource/Benchmarks/Olden/bisort/bisort: -3.46% (0.6789 => 0.6554, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (2.5526 => 2.5151, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.18% (1.1174 => 1.1042, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.19% (0.9894 => 0.9875, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: -0.07% (0.5988 => 0.5984, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 6.49% (0.1634 => 0.1740, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1568 => 0.1563, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.43% (0.3037 => 0.3050, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.21% (0.2398 => 0.2321, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.89% (0.3214 => 0.3121, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.80% (0.2335 => 0.2293, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -1.77% (0.0452 => 0.0444, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -39.67% (0.0242 => 0.0146, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -43.30% (0.0194 => 0.0110, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.06% (0.0389 => 0.0381, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.62% (0.0223 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.21% (0.0285 => 0.0273, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.55% (0.0323 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -52.22% (0.0180 => 0.0086, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/test1: -3.63% (0.0193 => 0.0186, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0248 => 0.0244, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -21.04% (0.0309 => 0.0244, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1433 => 0.1454, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -1.61% (1.5065 => 1.4822, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.49% (0.1543 => 0.1566, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.07% (0.4006 => 0.4169, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.10% (0.1420 => 0.1376, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.06% (0.0594 => 0.0558, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.32% (0.0188 => 0.0178, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.44% (0.0573 => 0.0587, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1507 => 1.1481, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -81.48% (0.0027 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -61.90% (0.0021 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.12% (0.0621 => 0.0583, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.54% (0.0185 => 0.0186, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (0.7812 => 0.7794, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 6.50% (1.6088 => 1.7133, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.65% (0.0102 => 0.0120, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.65% (4.1772 => 3.1058, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.67% (0.5309 => 0.5663, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 6.21% (2.1763 => 2.3114, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.34% (0.6410 => 0.6752, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.86% (0.3582 => 0.3756, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 4.84% (0.6915 => 0.7250, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.2552 => 0.2661, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 4.10% (15.3105 => 15.9386, std.dev.: 0.0888) MultiSource/Applications/minisat/minisat: 4.08% (0.6173 => 0.6425, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.08% (1.0046 => 1.0456, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.89% (1.5150 => 1.5739, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 3.36% (1.1653 => 1.2044, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.7639 => 0.7889, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.1672 => 1.1890, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.6069 => 0.6181, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 1.80% (2.0972 => 2.1350, std.dev.: 0.0106) MultiSource/Applications/d/make_dparser: 1.80% (3.0225 => 3.0768, std.dev.: 0.0207) MultiSource/Benchmarks/Bullet/bullet: 1.78% (29.3170 => 29.8378, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.1827 => 1.2031, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.67% (0.7226 => 0.7347, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.26% (3.5980 => 3.6435, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 22.19% (3.4629 => 4.2313, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0034, std.dev.: 0.0369) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3746 => 0.4275, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5538, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 11.79% (0.1433 => 0.1602, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.20% (2.4042 => 2.6734, std.dev.: 0.0503) SingleSource/Benchmarks/Shootout/lists: 9.07% (7.0025 => 7.6375, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.86% (1.0063 => 1.0854, std.dev.: 0.0266) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.11% (0.2857 => 0.3060, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 7.10% (1.0194 => 1.0918, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.94% (4.2129 => 4.5052, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.26% (40.4792 => 43.0142, std.dev.: 0.1245) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8065, std.dev.: 0.0553) MultiSource/Benchmarks/nbench/nbench: 5.76% (21.1721 => 22.3906, std.dev.: 0.1018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.07% (0.5876 => 0.6115, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8381, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.05% (2.6656 => 2.7468, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 2.74% (29.5232 => 30.3310, std.dev.: 0.0971) SingleSource/Benchmarks/Misc/ReedSolomon: 2.58% (8.5113 => 8.7313, std.dev.: 0.0571) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 2.37% (5.1938 => 5.3167, std.dev.: 0.0382) MultiSource/Applications/siod/siod: 2.18% (3.5520 => 3.6295, std.dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: 1.71% (14.4877 => 14.7360, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.67% (2.4455 => 2.4863, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5314, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.15% (2.4013 => 2.4289, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/hash: 1.09% (4.3016 => 4.3484, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -46.02% (0.0591 => 0.0319, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.29% (0.2996 => 0.1639, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.63% (1.4189 => 1.1120, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -21.12% (1.4113 => 1.1133, std.dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: -2.93% (14.6079 => 14.1793, std.dev.: 0.0545) MultiSource/Applications/spiff/spiff: -1.85% (0.7738 => 0.7595, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.98% (5.2665 => 4.1614, std.dev.: 0.1341) SingleSource/Benchmarks/Shootout-C++/ary3: -18.37% (1.7473 => 1.4264, std.dev.: 0.0992) MultiSource/Benchmarks/FreeBench/mason/mason: -16.63% (0.5004 => 0.4172, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.61% (15.8312 => 13.2018, std.dev.: 0.0984) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.06% (1.7361 => 1.4746, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1642, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -8.30% (9.5474 => 8.7552, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.92% (3.2007 => 2.9473, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.76% (2.4457 => 2.2559, std.dev.: 0.0256) MultiSource/Benchmarks/mafft/pairlocalalign: -7.73% (62.4126 => 57.5898, std.dev.: 0.3053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.02% (3.6254 => 3.3709, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1854, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -6.22% (1.4441 => 1.3543, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: -5.70% (1.4117 => 1.3312, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/fibo: -4.79% (4.6355 => 4.4135, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.26% (1.1647 => 1.1151, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -4.05% (0.2664 => 0.2556, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -3.61% (9.2503 => 8.9167, std.dev.: 0.0371) MultiSource/Applications/lambda-0_1_3/lambda: -3.58% (7.6833 => 7.4083, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/misr: -2.86% (0.4296 => 0.4173, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6474, std.dev.: 0.0178) MultiSource/Applications/aha/aha: -2.60% (3.4286 => 3.3394, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -2.56% (3.8907 => 3.7910, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.53% (1.1683 => 1.1387, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.4876 => 3.4238, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (9.3855 => 9.2183, std.dev.: 0.0218) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.46% (92.7467 => 91.3946, std.dev.: 0.2617) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3179, std.dev.: 0.0331) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7698, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.21% (1.8739 => 1.8512, std.dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.05% (0.9980 => 0.9875, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6022 => 0.5984, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 4.44% (0.1666 => 0.1740, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.07% (0.3083 => 0.3050, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.05% (0.2394 => 0.2321, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.70% (0.3175 => 0.3121, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -1.11% (0.0449 => 0.0444, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -39.17% (0.0240 => 0.0146, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -42.71% (0.0192 => 0.0110, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.31% (0.0390 => 0.0381, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.27% (0.0301 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.87% (0.0284 => 0.0273, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -51.41% (0.0177 => 0.0086, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/test1: -1.59% (0.0189 => 0.0186, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -24.92% (0.0325 => 0.0244, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.75% (0.1429 => 0.1454, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -1.31% (1.5019 => 1.4822, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.33% (0.1501 => 0.1566, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.23% (0.4264 => 0.4169, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.38% (0.1344 => 0.1376, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.26% (0.0589 => 0.0558, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.15% (1.1350 => 1.1481, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0024 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.48% (0.0637 => 0.0583, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.39% (0.0246 => 0.0186, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.35% (0.7541 => 0.7794, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.52% (1.5363 => 1.7133, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 06:33:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 08:33:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915133323.3ADC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3844?compare_to=3840&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3844, Order: 163965, Start Time: 2012-09-15 12:19:55, End Time: 2012-09-15 13:34:41 To: 3840, Order: 163964, Start Time: 2012-09-15 08:14:08, End Time: 2012-09-15 09:28:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 8 (164 on baseline) Performance Improvements: 14 (41 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 948 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 5.65% (0.2391 => 0.2526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.94% (5.1871 => 5.4435, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 4.34% (34.2551 => 35.7401, std.dev.: 0.0280) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 45.92% (7.2357 => 10.5586, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 7.17% (2.0921 => 2.2422, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.17% (1.9694 => 2.0515, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.80% (78.4292 => 81.4087, std.dev.: 0.2141) SingleSource/Regression/C/uint64_to_float: 3.73% (0.5420 => 0.5622, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.53% (0.2530 => 0.1378, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.28% (0.0621 => 0.0346, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.30% (1.4628 => 1.1659, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.28% (1.4643 => 1.1673, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.92% (0.0733 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.11% (0.3014 => 0.2860, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -3.31% (15.2462 => 14.7409, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.20% (13.9986 => 13.8309, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.08% (0.0994 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -8.84% (0.2184 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.56% (0.9962 => 0.9607, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.1018 => 27.7410, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.14% (2.3180 => 2.2915, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (2.0176 => 2.4141, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 12.62% (0.2243 => 0.2526, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.54% (0.4328 => 0.4741, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.37% (3.9660 => 4.3376, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.20% (0.9199 => 1.0045, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.16% (4.9865 => 5.4435, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 9.14% (0.7038 => 0.7681, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.13% (1.4563 => 1.5893, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5818 => 0.6343, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.01% (1.3693 => 1.4927, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.88% (0.7710 => 0.8395, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 8.85% (0.2925 => 0.3184, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5748 => 0.6255, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.78% (1.2193 => 1.3263, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.76% (0.5265 => 0.5726, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.71% (0.6959 => 0.7565, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.47% (0.4390 => 0.4762, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2309, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7061 => 0.7647, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 8.26% (13.8202 => 14.9619, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.86% (0.6283 => 0.6777, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.3899 => 0.4203, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.75% (0.5577 => 0.6009, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 7.70% (1.0313 => 1.1107, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.58% (0.3485 => 0.3749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 7.35% (33.2944 => 35.7401, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4016 => 0.4311, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.29% (1.1061 => 1.1867, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.21% (0.2995 => 0.3211, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 7.10% (0.8310 => 0.8900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.08% (0.3756 => 0.4022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.00% (1.9828 => 2.1215, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (7.2180 => 7.7222, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.90% (0.2914 => 0.3115, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.87% (0.4791 => 0.5120, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.81% (0.7506 => 0.8017, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.78% (2.1791 => 2.3269, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3453 => 0.3685, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.58% (16.6129 => 17.7063, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 6.58% (3.8646 => 4.1189, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.52% (0.6576 => 0.7005, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.45% (0.7460 => 0.7941, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.33% (3.1889 => 3.3909, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 6.33% (0.6744 => 0.7171, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 6.29% (1.9270 => 2.0482, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.0594 => 1.1259, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 6.27% (0.4003 => 0.4254) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.14% (1.3245 => 1.4058, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 6.04% (0.3789 => 0.4018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.00% (0.3131 => 0.3319, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.00% (0.8698 => 0.9220, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.95% (0.3578 => 0.3791, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.95% (0.3914 => 0.4147, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3663 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.92% (0.3650 => 0.3866, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (1.2749 => 1.3499, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.88% (3.6692 => 3.8848, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.81% (0.3940 => 0.4169, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3623 => 0.3833, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.79% (14.8535 => 15.7130, std.dev.: 0.0174) MultiSource/Benchmarks/mafft/pairlocalalign: 5.77% (8.4961 => 8.9860, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.72% (0.6135 => 0.6486, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.59% (0.4113 => 0.4343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (4.3801 => 4.6233, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.51% (0.8818 => 0.9304, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.43% (4.4433 => 4.6844, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (3.2742 => 3.4337, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1333 => 1.1882, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 4.79% (4.6629 => 4.8863, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.38% (1.5188 => 1.5853, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.31% (0.9108 => 0.9501, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.29% (6.5754 => 6.8575, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2815, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (13.2842 => 13.8309, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.90% (2.1007 => 2.1827, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 3.83% (3.7467 => 3.8902, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.2785 => 6.5080, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.27% (0.3245 => 0.3351, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.25% (16.2614 => 16.6272, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 1.45% (14.5298 => 14.7409, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 44.04% (7.3305 => 10.5586, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std.dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1736 => 3.3982, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.59% (0.2093 => 0.2231, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.57% (1.9433 => 2.0515, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.63% (12.0921 => 12.6524, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.77% (11.2619 => 11.6870, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0967, std.dev.: 0.0182) SingleSource/Regression/C/uint64_to_float: 3.17% (0.5449 => 0.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5853, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -48.39% (0.2670 => 0.1378, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -16.97% (0.0707 => 0.0587, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.96% (0.4657 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.59% (1.3813 => 1.1659, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.53% (1.3819 => 1.1673, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.66% (22.5627 => 21.5121, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.04% (0.2238 => 0.1991, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2583, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.26% (1.3780 => 1.2918, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.89% (0.9996 => 0.9607, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: -2.87% (3.0263 => 2.9395, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5869, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -1.71% (26.5159 => 26.0623, std.dev.: 0.0338) MultiSource/Benchmarks/mafft/pairlocalalign: -1.71% (28.2225 => 27.7410, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2484, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2226, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8714, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.16% (6.6320 => 6.5550, std.dev.: 0.0137) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4344, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2618, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 06:39:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 08:39:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915133932.D5A9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3845?compare_to=3841&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3845, Order: 163965, Start Time: 2012-09-15 12:19:45, End Time: 2012-09-15 13:40:53 To: 3841, Order: 163964, Start Time: 2012-09-15 08:18:51, End Time: 2012-09-15 09:38:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (2 on baseline) New Passes: 4 (3 on baseline) Performance Regressions: 9 (117 on baseline) Performance Improvements: 16 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 16 (16 on baseline) Unchanged Tests: 923 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.3478 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2621 => 0.0003) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/Bullet/bullet: 14.78% (82.5153 => 94.7150, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.95% (3.6553 => 5.7734, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/Bullet/bullet: 9450000.00% (0.0001 => 9.4501, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9969200.00% (0.0001 => 9.9693, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: 44.31% (0.0246 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 36.66% (0.2706 => 0.3698, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 21.27% (0.1119 => 0.1357, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.3320 => 0.3481, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.4824 => 0.5035, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 3.10% (14.6344 => 15.0876, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.93% (0.5463 => 0.5623, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.31% (54.8688 => 56.1348, std.dev.: 0.1789) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (1.2928 => 1.3128, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -18.96% (0.0849 => 0.0688, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.64% (1.2573 => 1.1361, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.53% (3.8731 => 3.5428, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.38% (3.8665 => 3.5426, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.43% (0.4068 => 0.3847, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.83% (0.3248 => 0.3091, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -3.13% (20.2605 => 19.6269, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.41% (14.8699 => 14.6596, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (2.5132 => 2.4796, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.26% (8.0074 => 7.9064, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -21.20% (2.0703 => 1.6313, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.17% (0.0995 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -10.56% (0.2196 => 0.1964, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.86% (2.0350 => 1.9362, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.31% (0.9963 => 0.9633, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: -2.15% (1.3862 => 1.3564) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.54% (0.5704 => 0.5673, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.14% (15.8404 => 15.8181, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: -0.22% (14.6928 => 14.6611, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: -0.41% (4.2918 => 4.2744, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.2189 => 1.2163, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.40% (7.3740 => 7.3445, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.45% (0.6336 => 0.6428, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.35% (0.1427 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (0.0671 => 0.0689, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.72% (3.4629 => 5.7734, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14266.81% (0.0720 => 10.3441, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9969200.00% (0.0001 => 9.9693, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: 49.79% (0.0237 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 49.76% (63.2438 => 94.7150, std.dev.: 0.0244) MultiSource/Benchmarks/PAQ8p/paq8p: 45.53% (10.3673 => 15.0876, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 44.79% (0.2554 => 0.3698, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 28.50% (0.1056 => 0.1357, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 25.52% (0.1622 => 0.2036, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (2.2022 => 2.4796, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.08% (7.0540 => 7.9064, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 10.49% (0.1440 => 0.1591, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.06% (1.7609 => 1.9380, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.3180 => 0.3481, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 8.74% (10.4361 => 11.3482, std.dev.: 0.0084) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.61% (0.4636 => 0.5035, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3473 => 0.3771, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3543 => 0.3847, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 8.44% (0.3543 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.38% (0.3927 => 0.4256, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.35% (0.3497 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.30% (0.3516 => 0.3808, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.26% (0.3561 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3828 => 0.4139, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.07% (0.3694 => 0.3992, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.85% (0.3886 => 0.4191, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.68% (0.3282 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.92% (9.4845 => 10.1413, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.77% (0.3177 => 0.3392, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (0.8172 => 0.8719, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.56% (0.1906 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.43% (1.5415 => 1.6406, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.14% (0.7115 => 0.7552, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.87% (0.3423 => 0.3624, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.83% (1.3050 => 1.3811, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.80% (0.5860 => 0.6200, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.6675 => 0.7062, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (4.2646 => 4.5031, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 5.59% (3.3354 => 3.5217, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.57% (5.7591 => 6.0801, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2700 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.51% (0.9765 => 1.0303, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.40% (8.1363 => 8.5753, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.35% (0.5569 => 0.5867, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 5.29% (0.6030 => 0.6349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.5105 => 0.5372, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2107 => 0.2217, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (4.9449 => 5.2007, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 5.09% (0.7835 => 0.8234, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.07% (0.8067 => 0.8476, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (5.0018 => 5.2550, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 5.05% (0.3387 => 0.3558, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2758 => 0.2895, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.78% (1.1642 => 1.2199, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.58% (0.4299 => 0.4496, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3441 => 0.3598, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.52% (3.8723 => 4.0475, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7326 => 0.7654, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 4.46% (1.0722 => 1.1200, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.44% (0.5020 => 0.5243, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.38% (2.0273 => 2.1160, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 4.29% (21.9371 => 22.8780, std.dev.: 0.0069) MultiSource/Applications/hbd/hbd: 4.29% (1.5603 => 1.6272, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.28% (7.9617 => 8.3028, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.15% (1.1861 => 1.2353, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3921, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 4.09% (0.8921 => 0.9286, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6456 => 0.6714, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.84% (0.6450 => 0.6698, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4620 => 0.4795, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.5981 => 0.6207, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (1.5859 => 1.6448, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.40% (0.3650 => 0.3774, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.29% (0.3826 => 0.3952, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2730, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (1.4186 => 1.4640, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.87% (0.4048 => 0.4164, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2177, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (2.0665 => 2.1222, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (14.3668 => 14.6596, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.83% (0.8101 => 0.8249, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.52% (17.1811 => 17.4415, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.49% (1.1194 => 1.1361, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3012, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (3.1578 => 3.3922, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.88% (0.5413 => 0.5623, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2210, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.73% (5.2763 => 3.2327, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.22% (5.3855 => 3.5426, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.81% (5.3526 => 3.5428, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -15.17% (0.0811 => 0.0688, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1564, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.79% (2.9384 => 2.5921, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -11.49% (22.1758 => 19.6269, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -11.77% (10.7105 => 9.4501, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: -9.12% (0.2161 => 0.1964, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2682, std.dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7161, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (2.0360 => 1.9362, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -4.87% (5.0483 => 4.8023, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1516, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.25% (0.9957 => 0.9633, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5024, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4230, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9928, std.dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.64% (1.2373 => 1.2046, std.dev.: 0.0059) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.83% (2.5528 => 2.5061, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0190, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: -1.51% (4.6441 => 4.5738, std.dev.: 0.0097) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4227, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2282, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.05% (2.9346 => 2.9039, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.49% (0.5229 => 0.5673, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.53% (14.9895 => 15.8181, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 3.57% (14.1553 => 14.6611, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 3.99% (4.1105 => 4.2744, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.09% (1.1048 => 1.2163, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.60% (7.1582 => 7.3445, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.6222 => 0.6428, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.44% (0.2116 => 0.0689, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 07:42:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 09:42:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915144255.C412C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3846?compare_to=3843&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3846, Order: 163967, Start Time: 2012-09-15 13:34:08, End Time: 2012-09-15 14:44:17 To: 3843, Order: 163965, Start Time: 2012-09-15 12:07:48, End Time: 2012-09-15 13:18:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (47 on baseline) Performance Improvements: 2 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 897 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.53% (0.7595 => 0.7711, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 1.87% (4.1614 => 4.2392, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.99% (8.6087 => 8.2649, std.dev.: 0.1251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.96% (61.6228 => 59.1856, std.dev.: 0.2325) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.17% (0.9875 => 0.9892, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 0.07% (0.5984 => 0.5988, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 2.41% (0.1740 => 0.1782, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1563 => 0.1573, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.56% (0.3050 => 0.3067, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (0.2321 => 0.2349, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.19% (0.3121 => 0.3158, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2293 => 0.2292, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -10.81% (0.0444 => 0.0396, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: -1.15% (0.0087 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 63.01% (0.0146 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 28.18% (0.0110 => 0.0141, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.79% (0.0381 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.92% (0.0240 => 0.0295, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.20% (0.0273 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.26% (0.0318 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 103.49% (0.0086 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.61% (0.0186 => 0.0189) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0244 => 0.0245, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 33.20% (0.0244 => 0.0325, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1454 => 0.1452, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 0.69% (1.4822 => 1.4924, std.dev.: 0.0108) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.04% (0.1566 => 0.1534, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.28% (0.4169 => 0.4074, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.1376 => 0.1444, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.97% (0.0558 => 0.0547, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.06% (0.0178 => 0.0187, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.70% (0.0587 => 0.0597, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1481 => 1.1473, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 120.00% (0.0005 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.83% (0.0583 => 0.0549, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.89% (0.0186 => 0.0223, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7794 => 0.7810, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7133 => 1.7130, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.30% (4.1772 => 3.1202, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/except: 82066.67% (0.0006 => 0.4930, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.5309 => 0.5629, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 5.34% (2.1763 => 2.2925, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3582 => 0.3736, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 4.07% (0.6173 => 0.6424, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.78% (1.5150 => 1.5722, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 3.69% (15.3105 => 15.8750, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.6915 => 0.7149, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 3.34% (1.1653 => 1.2042, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 3.29% (1.0046 => 1.0377, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 2.01% (1.3268 => 1.3535, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.77% (0.5636 => 0.5736, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.23% (29.3170 => 29.6762, std.dev.: 0.1172) MultiSource/Applications/SPASS/SPASS: 1.22% (13.3238 => 13.4860, std.dev.: 0.0461) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.12% (0.0917 => 0.1074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.65% (1.7426 => 1.9979, std.dev.: 0.0194) MultiSource/Applications/sgefa/sgefa: 14.01% (0.3746 => 0.4271, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5526, std.dev.: 0.0551) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.87% (2.4042 => 2.6656, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.32% (0.2694 => 0.2972, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6219, std.dev.: 0.0284) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.45% (1.0063 => 1.0813, std.dev.: 0.0257) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.30% (0.2857 => 0.3037, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8098, std.dev.: 0.0802) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: 4.53% (0.9851 => 1.0297, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.39% (40.4792 => 42.2564, std.dev.: 0.3725) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5390, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 3.75% (15.2242 => 15.7944, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8715, std.dev.: 0.0168) MultiSource/Benchmarks/Bullet/bullet: 3.46% (6.9722 => 7.2131, std.dev.: 0.0317) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.99% (0.3508 => 0.3613, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 2.70% (29.5232 => 30.3204, std.dev.: 0.1389) MultiSource/Applications/siod/siod: 2.32% (3.5520 => 3.6345, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/five11/five11: 2.30% (5.1938 => 5.3133, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.23% (4.6127 => 4.7157, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.98% (2.6656 => 2.7183, std.dev.: 0.0192) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7225, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5319, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.13% (2.8599 => 2.8923, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -46.19% (0.0591 => 0.0318, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.46% (0.2996 => 0.1634, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.00% (1.4189 => 1.0926, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.92% (1.4113 => 1.1161, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: -2.94% (14.6079 => 14.1783, std.dev.: 0.0297) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -20.72% (1.7473 => 1.3853, std.dev.: 0.0449) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.51% (5.2665 => 4.2392, std.dev.: 0.0216) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.70% (15.8312 => 12.8703, std.dev.: 0.2398) MultiSource/Benchmarks/FreeBench/mason/mason: -16.05% (0.5004 => 0.4201, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.56% (1.7361 => 1.4834, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7469, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -7.76% (62.4126 => 57.5673, std.dev.: 0.1835) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.76% (3.2007 => 2.9524, std.dev.: 0.0361) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.08% (3.6254 => 3.3689, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.07% (2.4457 => 2.2729, std.dev.: 0.0125) MultiSource/Applications/SIBsim4/SIBsim4: -7.01% (3.4230 => 3.1829, std.dev.: 0.0437) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -5.83% (1.4441 => 1.3599, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (4.6355 => 4.4013, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -4.49% (0.4296 => 0.4103, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.21% (0.4564 => 0.4372, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.07% (1.1647 => 1.1173, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.68% (1.2959 => 1.2482, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: -3.66% (7.6833 => 7.4018, std.dev.: 0.0718) SingleSource/Benchmarks/Shootout-C++/methcall: -3.59% (9.2503 => 8.9184, std.dev.: 0.0496) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.25% (61.1734 => 59.1856, std.dev.: 0.2325) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.89% (1.1683 => 1.1345, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8295, std.dev.: 0.0258) MultiSource/Applications/aha/aha: -2.64% (3.4286 => 3.3380, std.dev.: 0.0158) MultiSource/Benchmarks/sim/sim: -2.45% (3.8907 => 3.7954, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.31% (3.7496 => 3.6630, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.25% (1.0686 => 1.0446, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.76% (1.8739 => 1.8409, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2270, std.dev.: 0.0386) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7659, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3134, std.dev.: 0.0534) MultiSource/Benchmarks/PAQ8p/paq8p: -1.02% (92.7467 => 91.8009, std.dev.: 0.2791) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.88% (0.9980 => 0.9892, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.56% (0.6022 => 0.5988, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 6.96% (0.1666 => 0.1782, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.22% (0.1554 => 0.1573, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.52% (0.3083 => 0.3067, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.88% (0.2394 => 0.2349, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3175 => 0.3158, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.43% (0.2302 => 0.2292, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -11.80% (0.0449 => 0.0396, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -26.56% (0.0192 => 0.0141, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -0.63% (1.5019 => 1.4924, std.dev.: 0.0108) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.20% (0.1501 => 0.1534, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.46% (0.4264 => 0.4074, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.44% (0.1344 => 0.1444, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.40% (0.0232 => 0.0187, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0639 => 0.0597, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.08% (1.1350 => 1.1473, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.81% (0.0637 => 0.0549, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.35% (0.0246 => 0.0223, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.57% (0.7541 => 0.7810, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.50% (1.5363 => 1.7130, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 08:16:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 10:16:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915151638.52E132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3847?compare_to=3844&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3847, Order: 163967, Start Time: 2012-09-15 14:03:17, End Time: 2012-09-15 15:17:57 To: 3844, Order: 163965, Start Time: 2012-09-15 12:19:55, End Time: 2012-09-15 13:34:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (162 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.19% (3.6864 => 3.7303, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.20% (81.4087 => 78.8017, std.dev.: 0.7988) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.71% (2.0176 => 2.4152, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 12.35% (0.2243 => 0.2520, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.45% (0.4328 => 0.4737, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.38% (3.9660 => 4.3382, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.22% (4.9865 => 5.4461, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.10% (0.9199 => 1.0036, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.04% (0.4390 => 0.4787, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 9.02% (0.7038 => 0.7673, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.00% (0.5265 => 0.5739, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 8.97% (1.3693 => 1.4921, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.95% (1.4563 => 1.5867, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.7710 => 0.8392, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.82% (0.2596 => 0.2825, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.79% (0.2925 => 0.3182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5748 => 0.6253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.76% (1.2193 => 1.3261, std.dev.: 0.0100) SingleSource/UnitTests/ObjC++/property-reference: 8.62% (0.7061 => 0.7670, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.45% (0.2721 => 0.2951, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.45% (0.6959 => 0.7547, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.44% (1.1364 => 1.2323, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 8.10% (13.8202 => 14.9403, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0135) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.5577 => 0.6006, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.68% (1.0313 => 1.1105, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3485 => 0.3748, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.52% (0.4016 => 0.4318, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 7.27% (33.2944 => 35.7133, std.dev.: 0.0107) MultiSource/Applications/Burg/burg: 7.26% (1.1061 => 1.1864, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.11% (0.8310 => 0.8901, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5637 => 0.6035, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3756 => 0.4020, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.01% (1.9828 => 2.1217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.93% (7.2180 => 7.7184, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.4791 => 0.5122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.89% (0.3293 => 0.3520, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 6.83% (0.7506 => 0.8019, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 6.64% (2.1791 => 2.3239, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.57% (16.6129 => 17.7039, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.43% (3.8646 => 4.1132, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 6.43% (3.1889 => 3.3940, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 6.39% (0.6744 => 0.7175, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.37% (0.6576 => 0.6995, std.dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 6.32% (1.0594 => 1.1264, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/parameter-passing: 6.22% (0.4003 => 0.4252, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.21% (1.9270 => 2.0466, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.20% (1.3245 => 1.4066, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions: 6.06% (0.3914 => 0.4151, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 6.02% (14.8535 => 15.7476, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.98% (0.8698 => 0.9218, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.97% (0.3131 => 0.3318, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.91% (0.3789 => 0.4013, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.89% (0.3650 => 0.3865, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.87% (3.6692 => 3.8844, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 5.84% (0.3663 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.84% (0.3646 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3601 => 0.3811, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.81% (0.4113 => 0.4352, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 5.80% (1.2749 => 1.3489, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 5.76% (0.3940 => 0.4167, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.75% (8.4961 => 8.9843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.74% (0.3623 => 0.3831, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.61% (0.6135 => 0.6479, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.46% (4.3801 => 4.6192, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (4.4433 => 4.6818, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.34% (0.8818 => 0.9289, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.86% (3.2742 => 3.4333, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.81% (1.1333 => 1.1878, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.79% (4.6629 => 4.8863, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.39% (0.2321 => 0.2423, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.29% (6.5754 => 6.8575, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.26% (0.9108 => 0.9496, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4805 => 0.5009, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.19% (1.5188 => 1.5825, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.11% (13.2842 => 13.8298, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.74% (3.7467 => 3.8869, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.68% (2.1007 => 2.1781, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.2785 => 6.5035, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3245 => 0.3357, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.29% (16.2614 => 16.6335, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 1.51% (14.5298 => 14.7492, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 44.03% (7.3305 => 10.5582, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5118, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2691, std.dev.: 0.0433) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.92% (3.1736 => 3.3932, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3780, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (1.9433 => 2.0517, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.64% (12.0921 => 12.6527, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6850, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 3.49% (10.7476 => 11.1227, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 3.21% (0.5449 => 0.5624) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4271 => 7.6113, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5877, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -48.39% (0.2670 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -16.97% (0.0707 => 0.0587) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.63% (1.3813 => 1.1654, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.46% (1.3819 => 1.1682, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.79% (22.5627 => 21.4810, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.22% (0.2238 => 0.1987, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2699, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.91% (1.3780 => 1.2966, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.78% (0.9996 => 0.9518, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0100) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.87% (3.0263 => 2.9393, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5833, std.dev.: 0.0228) MultiSource/Benchmarks/Olden/bh/bh: -2.67% (1.9762 => 1.9234, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7424, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2511, std.dev.: 0.0045) MultiSource/Applications/lua/lua: -1.60% (26.5159 => 26.0913, std.dev.: 0.0516) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2155, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8703, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (4.1080 => 4.0634, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4336, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 08:18:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 10:18:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915151811.CC9022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3848?compare_to=3842&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3848, Order: 163966, Start Time: 2012-09-15 12:35:19, End Time: 2012-09-15 15:19:31 To: 3842, Order: 163964, Start Time: 2012-09-15 09:21:04, End Time: 2012-09-15 12:06:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.10% (69.9793 => 74.9489, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 2.21% (14.3205 => 14.6373, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -20.87% (0.5228 => 0.4137, std.dev.: 0.0400) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.55% (0.3488 => 0.3821, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3465 => 0.3795, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3442 => 0.3769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3496 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.46% (0.3446 => 0.3772, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.45% (0.3460 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.18% (0.3650 => 0.3985, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.00% (0.3724 => 0.4059, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.81% (1.5932 => 1.7177, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (0.4361 => 0.4634, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (1.6211 => 1.7193, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5826 => 0.6175, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.94% (1.3152 => 1.3933, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (0.2691 => 0.2850, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 5.83% (5.5417 => 5.8647, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (3.5627 => 3.7692, std.dev.: 0.0095) MultiSource/Benchmarks/nbench/nbench: 5.77% (0.2566 => 0.2714, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.76% (0.5889 => 0.6228, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.59% (1.0781 => 1.1384, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (2.7292 => 2.8811, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7171 => 0.7554, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.5000 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (4.4195 => 4.6472, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (0.5026 => 0.5283, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 5.10% (4.2109 => 4.4257, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: 5.04% (2.1013 => 2.2073, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 5.03% (4.6177 => 4.8499, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2738 => 0.2871, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.85% (0.6634 => 0.6956, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.80% (0.3336 => 0.3496, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.2866 => 0.3003, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (0.3890 => 0.4075, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (2.1653 => 2.2662, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.61% (0.9909 => 1.0366, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3195 => 0.3342, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.50% (1.8794 => 1.9639, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 4.44% (23.5202 => 24.5642, std.dev.: 0.0253) MultiSource/Applications/spiff/spiff: 4.42% (0.4029 => 0.4207, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2875 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.3903 => 0.4074, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.5900 => 0.6156, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.32% (0.2823 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.30% (0.2813 => 0.2934, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.29% (1.4269 => 1.4881, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 4.25% (2.0346 => 2.1211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2792 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.21% (0.2780 => 0.2897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (2.0673 => 2.1534, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.3084 => 0.3211, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.12% (0.3060 => 0.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2803 => 0.2918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (0.4658 => 0.4849, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3362 => 0.3498, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (1.9694 => 2.0478, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3258 => 0.3387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4146 => 0.4310, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.92% (0.3625 => 0.3767, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.4139 => 0.4301, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.91% (0.5546 => 0.5763, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.88% (0.3348 => 0.3478, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.83% (0.3317 => 0.3444, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3477 => 0.3610, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4251 => 0.4413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.78% (0.3678 => 0.3817, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.6435 => 0.6677, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3282 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3690 => 0.3824, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (1.9966 => 2.0686, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.2969 => 0.3076, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.57% (0.7875 => 0.8156, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.57% (0.9697 => 1.0043, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.5012 => 0.5186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (0.7426 => 0.7659, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (0.5361 => 0.5513, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (0.5584 => 0.5729, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.38% (11.6398 => 11.9171, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.20% (4.6926 => 4.7957, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6785, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8973, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1756, std.dev.: 0.0156) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6373, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2007, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5088, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4460, std.dev.: 0.0109) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5866, std.dev.: 0.0347) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5235, std.dev.: 0.0305) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8022, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7957, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7656, std.dev.: 0.0518) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9627, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 08:28:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 10:28:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915152857.44B132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3849?compare_to=3845&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3849, Order: 163967, Start Time: 2012-09-15 14:09:28, End Time: 2012-09-15 15:30:18 To: 3845, Order: 163965, Start Time: 2012-09-15 12:19:45, End Time: 2012-09-15 13:40:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (3 on baseline) Performance Regressions: 1 (116 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 18 (16 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.78% (1.2046 => 1.2261, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.31% (0.8719 => 0.8605, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5673 => 0.5671, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -0.04% (15.8181 => 15.8110, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 0.12% (14.6611 => 14.6790, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/gs/gs: 0.07% (4.2744 => 4.2775, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2163 => 1.2166, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.3445 => 7.3466, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.26% (0.6428 => 0.6411, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.95% (0.0689 => 0.0648, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.71% (3.4629 => 5.7729, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14269.17% (0.0720 => 10.3458, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9967500.00% (0.0001 => 9.9676, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: 49.79% (0.0237 => 0.0355, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 49.73% (63.2438 => 94.6955, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 45.56% (10.3673 => 15.0909, std.dev.: 0.0186) MultiSource/Benchmarks/McCat/08-main/main: 44.99% (0.2554 => 0.3703, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 28.31% (0.1056 => 0.1355, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 25.52% (0.1622 => 0.2036, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.85% (0.1432 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.59% (2.2022 => 2.4795, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.14% (7.0540 => 7.9101, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.49% (0.1440 => 0.1591, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.07% (1.7609 => 1.9382, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.72% (0.3180 => 0.3489, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.83% (10.4361 => 11.3579, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3473 => 0.3772, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.43% (0.3927 => 0.4258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3543 => 0.3840, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.37% (0.4636 => 0.5024, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 8.30% (0.3516 => 0.3808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.29% (0.3497 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.28% (0.3561 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.27% (0.3543 => 0.3836, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3694 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3828 => 0.4135, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.90% (0.3886 => 0.4193, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.74% (0.3282 => 0.3536, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.86% (9.4845 => 10.1354, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.77% (0.3177 => 0.3392) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (1.5415 => 1.6363, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 6.12% (0.7433 => 0.7888, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.4615 => 0.4897, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 5.99% (0.7115 => 0.7541, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (4.2646 => 4.5111, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.3050 => 1.3799, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.73% (0.5860 => 0.6196, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.70% (0.3121 => 0.3299, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.67% (0.2700 => 0.2853, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.66% (0.6675 => 0.7053, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.64% (3.3354 => 3.5236, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.64% (5.7591 => 6.0840, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.42% (0.2271 => 0.2394, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.41% (8.1363 => 8.5765, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.40% (0.5569 => 0.5870, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9765 => 1.0292, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 5.33% (0.5925 => 0.6241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.30% (0.8172 => 0.8605, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.27% (0.5105 => 0.5374, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.8067 => 0.8481, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (5.0018 => 5.2537, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 5.03% (0.7835 => 0.8229, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.03% (4.9449 => 5.1934, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.00% (0.2758 => 0.2896, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.82% (1.1642 => 1.2203, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.63% (3.8723 => 4.0515, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.56% (0.4299 => 0.4495, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (7.9617 => 8.3167, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 4.45% (1.0722 => 1.1199, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.34% (1.5603 => 1.6280, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.26% (0.5020 => 0.5234, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.25% (21.9371 => 22.8703, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.21% (1.1861 => 1.2360, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8921 => 0.9290, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.09% (2.0273 => 2.1102, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 4.03% (2.2969 => 2.3895, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.92% (0.4103 => 0.4264, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.90% (0.6456 => 0.6708, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.85% (0.4620 => 0.4798, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6450 => 0.6693, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.68% (0.5981 => 0.6201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.62% (0.3422 => 0.3546, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (1.5859 => 1.6429, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.48% (0.3307 => 0.3422, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.42% (0.3865 => 0.3997, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.4186 => 1.4639, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.4203 => 0.4333, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (2.2024 => 2.2704, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.1840 => 1.2183, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: 2.89% (0.4048 => 0.4165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.64% (2.0665 => 2.1210, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (0.8101 => 0.8246, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (14.3668 => 14.6215, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.61% (1.1194 => 1.1374, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.40% (17.1811 => 17.4219, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2842 => 1.3013, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (3.1578 => 3.3913, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 3.90% (0.5413 => 0.5624, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2204, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.74% (5.2763 => 3.2322, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.19% (5.3855 => 3.5443, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.92% (5.3526 => 3.5368, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -15.17% (0.0811 => 0.0688, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1975, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.86% (2.9384 => 2.5899, std.dev.: 0.0220) MultiSource/Applications/ClamAV/clamscan: -11.40% (22.1758 => 19.6476, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -11.75% (10.7105 => 9.4517, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.12% (0.2161 => 0.1964, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2878, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7168, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7609, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.91% (2.0360 => 1.9360, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.87% (5.0483 => 4.8024, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.48% (0.9957 => 0.9610, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5074, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4134, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -2.61% (10.2830 => 10.0147, std.dev.: 0.0107) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9832, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.6441 => 4.5754, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.45% (0.5229 => 0.5671, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.48% (14.9895 => 15.8110, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 3.70% (14.1553 => 14.6790, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/gs/gs: 4.06% (4.1105 => 4.2775, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.12% (1.1048 => 1.2166, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.63% (7.1582 => 7.3466, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.6222 => 0.6411, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 09:47:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 11:47:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915164716.005372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3850?compare_to=3846&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3850, Order: 163968, Start Time: 2012-09-15 15:37:41, End Time: 2012-09-15 16:48:37 To: 3846, Order: 163967, Start Time: 2012-09-15 13:34:08, End Time: 2012-09-15 14:44:17 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 13 (40 on baseline) Performance Improvements: 7 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 881 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 87.39% (0.1634 => 0.3062, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 85.53% (0.0318 => 0.0590, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.04% (1.0926 => 1.4208, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 29.03% (1.1161 => 1.4401, std.dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 2.97% (14.1783 => 14.6000, std.dev.: 0.1293) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.2641 => 4.3472, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.2564 => 1.2734, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 16.64% (0.4201 => 0.4900, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 13.07% (1.4834 => 1.6773, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 6.19% (8.7469 => 9.2882, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.35% (2.2731 => 2.3948, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1024 => 1.1186, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.26% (1.8409 => 1.8641, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.30% (0.7711 => 0.7534, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.80% (1.1173 => 0.9408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -11.33% (3.5172 => 3.1187, std.dev.: 0.1506) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.08% (2.6656 => 2.4502, std.dev.: 0.0761) MultiSource/Applications/lua/lua: -3.36% (30.3204 => 29.3021, std.dev.: 0.2420) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.48% (4.2392 => 4.1340, std.dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (57.5673 => 56.5271, std.dev.: 0.2176) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.83% (0.9892 => 0.9612, std.dev.: 0.0203) MultiSource/Applications/sqlite3/sqlite3: -0.25% (0.5988 => 0.5973, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: -7.52% (0.1782 => 0.1648, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.69% (0.1573 => 0.1515, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3067 => 0.3066, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.66% (0.2349 => 0.2263, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.60% (0.3158 => 0.3139, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.44% (0.2292 => 0.2282, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel: -1.26% (0.0396 => 0.0391, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: 1.16% (0.0086 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0238 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.04% (0.0141 => 0.0189, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0384 => 0.0383, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.02% (0.0295 => 0.0292, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0279 => 0.0278, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0322 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.57% (0.0175 => 0.0176, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -38.10% (0.0189 => 0.0117, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: 1.63% (0.0245 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -45.45% (0.0011 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1452 => 0.1433, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -3.43% (1.4924 => 1.4412, std.dev.: 0.0369) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.39% (0.1534 => 0.1540, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4074 => 0.4069, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.28% (0.1444 => 0.1448, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.31% (0.0547 => 0.0587, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.37% (0.0187 => 0.0212, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.87% (0.0597 => 0.0550, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1473 => 1.1486, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.09% (0.0011 => 0.0010, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.56% (0.0549 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.52% (0.0223 => 0.0204, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.7810 => 0.7814, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -7.11% (1.7130 => 1.5912, std.dev.: 0.0079) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.47% (4.1772 => 3.0715, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/except: 82116.67% (0.0006 => 0.4933, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.30% (0.6410 => 0.6878, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 6.20% (0.5309 => 0.5638, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 6.00% (2.1763 => 2.3068, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.97% (0.3582 => 0.3760, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 4.16% (0.6173 => 0.6430, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (1.1653 => 1.2087, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (1.5150 => 1.5635, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.55% (29.3170 => 30.0660, std.dev.: 0.1546) MultiSource/Applications/hbd/hbd: 1.84% (1.3268 => 1.3512, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 1.59% (3.0225 => 3.0707, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2289, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9988, std.dev.: 0.0383) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.05% (4.0101 => 4.5734, std.dev.: 0.1105) MultiSource/Applications/sgefa/sgefa: 13.99% (0.3746 => 0.4270, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.54% (0.0917 => 0.1032, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 12.07% (0.1433 => 0.1606, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6065, std.dev.: 0.0284) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.09% (0.2694 => 0.2912, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 7.25% (1.0194 => 1.0933, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.04% (1.0063 => 1.0771, std.dev.: 0.0203) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8078, std.dev.: 0.1123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.67% (40.4792 => 42.7725, std.dev.: 0.4656) SingleSource/Benchmarks/Misc/dt: 4.26% (0.9851 => 1.0271, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.04% (15.2242 => 15.8399, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.58% (3.4080 => 3.5299, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 3.07% (8.5113 => 8.7727, std.dev.: 0.0502) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.76% (2.6656 => 2.7391, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.6127 => 4.7052, std.dev.: 0.0311) MultiSource/Applications/siod/siod: 1.77% (3.5520 => 3.6148, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.74% (14.4877 => 14.7398, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (4.5056 => 4.5753, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4455 => 2.4815, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (2.4971 => 2.5246, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.64% (0.7738 => 0.7534, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.38% (0.3497 => 0.2085, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.50% (5.2665 => 4.1340, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/ary3: -20.67% (1.7473 => 1.3861, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.22% (1.1647 => 0.9408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5271, std.dev.: 0.2176) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.24% (2.4457 => 2.2687, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3641, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (3.4230 => 3.2058, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7961, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -5.76% (1.4441 => 1.3609, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4099, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/ffbench: -4.75% (1.4117 => 1.3446, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.4140 => 0.3980, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.39% (1.7361 => 1.6773, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -3.20% (7.6833 => 7.4371, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.13% (3.7496 => 3.6323, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/methcall: -3.01% (9.2503 => 8.9722, std.dev.: 0.0161) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.96% (1.2722 => 1.2346, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2882, std.dev.: 0.0194) MultiSource/Applications/aha/aha: -2.40% (3.4286 => 3.3464, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.38% (1.1683 => 1.1405, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -1.89% (1.0926 => 1.0719, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -1.83% (92.7467 => 91.0454, std.dev.: 0.1952) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8230, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: -1.72% (3.4876 => 3.4275, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2389, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7667, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.3569 => 2.3243, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3149, std.dev.: 0.0201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -3.69% (0.9980 => 0.9612, std.dev.: 0.0203) MultiSource/Applications/sqlite3/sqlite3: -0.81% (0.6022 => 0.5973, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: -1.08% (0.1666 => 0.1648, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.51% (0.1554 => 0.1515, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.55% (0.3083 => 0.3066, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.47% (0.2394 => 0.2263, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (0.3175 => 0.3139, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.87% (0.2302 => 0.2282, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel: -12.92% (0.0449 => 0.0391, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.99% (0.0301 => 0.0292, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -38.10% (0.0189 => 0.0117, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1429 => 0.1433, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -4.04% (1.5019 => 1.4412, std.dev.: 0.0369) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.60% (0.1501 => 0.1540, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.57% (0.4264 => 0.4069, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.74% (0.1344 => 0.1448, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.34% (0.0589 => 0.0587, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.62% (0.0232 => 0.0212, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.93% (0.0639 => 0.0550, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.20% (1.1350 => 1.1486, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.00% (0.0024 => 0.0018, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.16% (0.0637 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (0.0246 => 0.0204, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.62% (0.7541 => 0.7814, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.57% (1.5363 => 1.5912, std.dev.: 0.0079) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 10:03:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 12:03:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915170300.E64382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3851?compare_to=3847&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3851, Order: 163968, Start Time: 2012-09-15 15:49:44, End Time: 2012-09-15 17:04:20 To: 3847, Order: 163967, Start Time: 2012-09-15 14:03:17, End Time: 2012-09-15 15:17:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 15 (165 on baseline) Performance Improvements: 8 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 947 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 83.89% (0.1378 => 0.2534, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 80.58% (0.0345 => 0.0623, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.51% (1.1654 => 1.4627, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.20% (1.1682 => 1.4626, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: 24.70% (0.0587 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.28% (0.2862 => 0.3013, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.53% (14.7492 => 15.2699, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (13.8298 => 14.0234, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (21.4810 => 21.7101, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.30% (0.0863 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 9.81% (0.1987 => 0.2182, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.63% (0.9518 => 0.9959, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: 2.19% (1.3564 => 1.3861, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (27.7424 => 28.1025, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.15% (2.2915 => 2.3179, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2520 => 0.2393, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.64% (5.4461 => 5.1936, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -4.34% (35.7133 => 34.1643, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.17% (0.4787 => 0.4683, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -31.49% (10.5582 => 7.2336, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -6.58% (2.2423 => 2.0947, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.07% (2.0517 => 1.9681, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -3.97% (0.5624 => 0.5401, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.51% (2.0176 => 2.4112, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.31% (3.9660 => 4.3351, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7061 => 0.7713, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.09% (0.5818 => 0.6347, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.00% (0.7710 => 0.8404, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 8.94% (0.7038 => 0.7667, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 8.87% (0.5748 => 0.6258, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.71% (1.3693 => 1.4886, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.62% (0.5265 => 0.5719, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.50% (1.2193 => 1.3229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.4563 => 1.5797, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.38% (0.6959 => 0.7542, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.21% (0.1327 => 0.1436, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.13% (1.1364 => 1.2288, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.10% (13.8202 => 14.9394, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.74% (0.6283 => 0.6769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.5577 => 0.6006, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.56% (0.4062 => 0.4369, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.45% (0.4791 => 0.5148, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.44% (1.0313 => 1.1080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.29% (0.3756 => 0.4030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (1.9828 => 2.1241, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.12% (0.8310 => 0.8902, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.02% (0.4016 => 0.4298, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 7.02% (1.1061 => 1.1837, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.95% (7.2180 => 7.7199, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.87% (3.8646 => 4.1300, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.2914 => 0.3113, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 6.75% (0.7506 => 0.8013, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.70% (3.6692 => 3.9152, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.61% (2.1791 => 2.3232, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.50% (0.7460 => 0.7945, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.34% (0.6576 => 0.6993, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.23% (16.6129 => 17.6480, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.20% (3.1889 => 3.3866, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.12% (1.3245 => 1.4056, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.12% (1.0594 => 1.1242, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 6.08% (1.9270 => 2.0442, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 6.08% (0.6744 => 0.7154, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.06% (0.3914 => 0.4151, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.97% (0.4003 => 0.4242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.89% (1.3813 => 1.4627, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.86% (0.3789 => 0.4011, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.84% (1.2749 => 1.3494, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.84% (1.3819 => 1.4626, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.82% (14.8535 => 15.7179, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.8698 => 0.9193, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.66% (8.4961 => 8.9771, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/05-eks/eks: 5.59% (0.4113 => 0.4343, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.57% (0.8818 => 0.9309, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (13.2842 => 14.0234, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.51% (0.6135 => 0.6473, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.39% (4.4433 => 4.6827, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.32% (4.3801 => 4.6131, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2699, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (1.1333 => 1.1904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.86% (6.5754 => 6.8948, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (3.2742 => 3.4313, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2321 => 0.2430, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.58% (4.6629 => 4.8764, std.dev.: 0.0156) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.25% (0.9108 => 0.9495, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (1.5188 => 1.5827, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.15% (4.9865 => 5.1936, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.1007 => 2.1778, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 3.66% (3.7467 => 3.8839, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4992, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 2.61% (33.2944 => 34.1643, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5388, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/fbench: 25.58% (1.8175 => 2.2824, std.dev.: 0.0363) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.98% (0.2093 => 0.2239, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5481, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0992, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5926, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5152, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1837, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6010, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6861, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (22.5627 => 21.7101, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2660, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.77% (1.3780 => 1.2985, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9216, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5991, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8952, std.dev.: 0.0257) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2365, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2336, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2243, std.dev.: 0.0376) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.19% (4.1080 => 4.0591, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: -1.18% (4.4810 => 4.4282, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2626, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 10:17:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 12:17:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915171716.184CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3852?compare_to=3849&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3852, Order: 163968, Start Time: 2012-09-15 15:59:05, End Time: 2012-09-15 17:18:37 To: 3849, Order: 163967, Start Time: 2012-09-15 14:09:28, End Time: 2012-09-15 15:30:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 4 (2 on baseline) New Passes: 2 (1 on baseline) Performance Regressions: 15 (120 on baseline) Performance Improvements: 6 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 16 (18 on baseline) Unchanged Tests: 927 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/Bullet/bullet: -13.45% (94.6955 => 81.9570, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++-EH/spirit: -36.71% (5.7729 => 3.6534, std.dev.: 0.0054) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/Bullet/bullet: -100.00% (9.4517 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (9.9676 => 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: 483333.33% (0.0009 => 4.3509, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1087266.67% (0.0003 => 3.2621, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 23.69% (0.0688 => 0.0851, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.09% (1.1374 => 1.2522, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.53% (3.5368 => 3.8384, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.37% (3.5443 => 3.8408, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.20% (0.3843 => 0.4043, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3093 => 0.3248, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.99% (19.6476 => 20.2356, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (14.6215 => 14.8265, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 26.38% (1.6409 => 2.0737, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.58% (0.0860 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 11.97% (0.1964 => 0.2199) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.05% (1.9360 => 2.0337, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.4582 => 56.5024, std.dev.: 0.0582) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.66% (0.9610 => 0.9962, std.dev.: 0.0030) SingleSource/UnitTests/Vector/build2: 2.19% (1.3564 => 1.3861, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: -30.42% (0.0355 => 0.0247) MultiSource/Benchmarks/McCat/08-main/main: -27.03% (0.3703 => 0.2702, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: -17.49% (0.1355 => 0.1118, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.82% (0.3489 => 0.3321, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.48% (0.5024 => 0.4799, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.44% (0.5624 => 0.5487, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.05% (0.5671 => 0.5668, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.06% (15.8110 => 15.8009, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: -0.30% (14.6790 => 14.6346, std.dev.: 0.0281) MultiSource/Benchmarks/MallocBench/gs/gs: 0.42% (4.2775 => 4.2956, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2166 => 1.2164, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (7.3466 => 7.3643, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.37% (0.6411 => 0.6323, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.28% (0.1432 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (0.0648 => 0.0661, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.59% (63.2438 => 81.9570, std.dev.: 0.0154) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14243.47% (0.0720 => 10.3273, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.68% (10.3673 => 15.1029, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 25.65% (0.1622 => 0.2038, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.71% (2.2022 => 2.4822, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.45% (7.0540 => 7.9325, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.56% (0.1566 => 0.1747, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.88% (1.7609 => 1.9348, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.37% (10.4361 => 11.4143, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.98% (0.3543 => 0.3861, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.59% (0.1584 => 0.1720, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.52% (0.3473 => 0.3769, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.30% (0.3543 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.26% (0.3497 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.26% (0.3561 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3516 => 0.3806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.01% (0.3694 => 0.3990, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.99% (0.3828 => 0.4134, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.3927 => 0.4240, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.88% (0.1625 => 0.1753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 7.77% (0.3282 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.75% (0.3886 => 0.4187, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.89% (9.4845 => 10.1381, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.4879 => 0.5200, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7433 => 0.7887, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4615 => 0.4890, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.87% (0.7115 => 0.7533, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.85% (0.2700 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.77% (0.6675 => 0.7060, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.68% (0.3307 => 0.3495, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.65% (1.3050 => 1.3787, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 5.61% (0.3423 => 0.3615, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.59% (5.7591 => 6.0813, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5860 => 0.6186, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.53% (3.3354 => 3.5198, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.51% (1.5415 => 1.6265, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.48% (0.5105 => 0.5385, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.48% (4.2646 => 4.4985, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.44% (8.1363 => 8.5791, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (0.8172 => 0.8609, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 5.25% (0.5925 => 0.6236, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.14% (0.6030 => 0.6340, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (5.0018 => 5.2583, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.12% (0.8067 => 0.8480, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.11% (0.2758 => 0.2899, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.06% (0.3121 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.9765 => 1.0255, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.00% (0.7835 => 0.8227, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.93% (4.9449 => 5.1888, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4299 => 0.4507, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.72% (1.1642 => 1.2192, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.2603 => 0.2724, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.61% (3.8723 => 4.0508, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 4.48% (1.0722 => 1.1202, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2387, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.43% (0.3180 => 0.3321, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.40% (21.9371 => 22.9019, std.dev.: 0.0197) MultiSource/Benchmarks/sim/sim: 4.37% (0.3387 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.34% (0.5020 => 0.5238, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.34% (0.7326 => 0.7644, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (7.9617 => 8.2938, std.dev.: 0.0115) MultiSource/Applications/hbd/hbd: 4.13% (1.5603 => 1.6248, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.08% (2.0273 => 2.1100, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.00% (0.4103 => 0.4267, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 3.96% (0.8921 => 0.9274, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 3.94% (2.2969 => 2.3875, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.88% (0.6450 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6456 => 0.6704, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.73% (0.3136 => 0.3253, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.73% (0.5981 => 0.6204, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (1.5859 => 1.6432, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (0.4636 => 0.4799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.48% (0.3422 => 0.3541, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.4064 => 0.4204, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.4186 => 1.4662, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.29% (0.3865 => 0.3992, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.26% (0.3162 => 0.3265, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8265, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.4203 => 0.4332, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (2.2024 => 2.2688, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (0.4620 => 0.4750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.1840 => 1.2168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.4048 => 0.4160, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.65% (2.0665 => 2.1212, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.8101 => 0.8258, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.29% (1.2842 => 1.3008, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.06% (17.1811 => 17.3630, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3835, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7550, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3509, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7898, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2264, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5768, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3626, std.dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.80% (5.2763 => 3.2290, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.68% (5.3855 => 3.8408, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.29% (5.3526 => 3.8384, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1554, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.85% (2.9384 => 2.5902, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -8.75% (22.1758 => 20.2356, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2588, std.dev.: 0.0718) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5097, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4248, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9878, std.dev.: 0.0287) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.76% (2.5528 => 2.5078, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0130, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5781, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.40% (0.5229 => 0.5668, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.41% (14.9895 => 15.8009, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 3.39% (14.1553 => 14.6346, std.dev.: 0.0281) MultiSource/Benchmarks/MallocBench/gs/gs: 4.50% (4.1105 => 4.2956, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.10% (1.1048 => 1.2164, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.88% (7.1582 => 7.3643, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.50% (3.4629 => 3.6534, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.6222 => 0.6323, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.76% (0.2116 => 0.0661, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 11:15:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 13:15:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915181536.5B33B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3853?compare_to=3850&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3853, Order: 163972, Start Time: 2012-09-15 17:04:55, End Time: 2012-09-15 18:16:57 To: 3850, Order: 163968, Start Time: 2012-09-15 15:37:41, End Time: 2012-09-15 16:48:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (47 on baseline) Performance Improvements: 3 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.84% (0.1882 => 0.1992, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.26% (21.7378 => 22.6631, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/whetstone: 2.21% (2.3491 => 2.4011, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.05% (2.3243 => 2.3488, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.98% (1.4401 => 1.4116, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6878 => 0.6770, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -4.94% (6.4698 => 6.1500, std.dev.: 0.0390) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.14% (0.9612 => 0.9818, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: -0.20% (0.5973 => 0.5961, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 1.15% (0.1648 => 0.1667, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.65% (0.1515 => 0.1490, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.62% (0.3066 => 0.3085, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.66% (0.2263 => 0.2278, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3139 => 0.3157, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.35% (0.2282 => 0.2290, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 14.07% (0.0391 => 0.0446, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0238 => 0.0237, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.06% (0.0189 => 0.0191, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0383 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.95% (0.0292 => 0.0225, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0278 => 0.0279, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0320 => 0.0319, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0176 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 43.59% (0.0117 => 0.0168, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -2.48% (0.0323 => 0.0315, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -16.67% (0.0006 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1433 => 0.1436, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 2.30% (1.4412 => 1.4743, std.dev.: 0.0238) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.58% (0.1540 => 0.1549, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.4069 => 0.4067, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1448 => 0.1391, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.18% (0.0587 => 0.0539, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.66% (0.0212 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.36% (0.0550 => 0.0574, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1486 => 1.1516, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 50.00% (0.0010 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -72.22% (0.0018 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.50% (0.0585 => 0.0547, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.49% (0.0204 => 0.0205, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7814 => 0.7806, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.72% (1.5912 => 1.6026, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.46% (4.1772 => 3.0721, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/except: 83066.67% (0.0006 => 0.4990, std.dev.: 0.0021) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.48% (0.0745 => 0.0905, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 6.45% (2.1763 => 2.3166, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/bigfib: 5.63% (0.5309 => 0.5608, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.62% (0.6410 => 0.6770, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.09% (0.2552 => 0.2682, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.55% (0.3582 => 0.3745, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.49% (0.6915 => 0.7156, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 3.33% (1.0046 => 1.0381, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 3.30% (0.6173 => 0.6377, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5150 => 1.5618, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.93% (1.1653 => 1.1994, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 2.81% (15.3105 => 15.7411, std.dev.: 0.1174) MultiSource/Benchmarks/Bullet/bullet: 2.64% (29.3170 => 30.0903, std.dev.: 0.1664) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.43% (12.6413 => 12.8218, std.dev.: 0.0659) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Bubblesort: 38.40% (0.0263 => 0.0364, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.54% (1.7426 => 1.9960, std.dev.: 0.0246) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3746 => 0.4276, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.29% (4.0101 => 4.5431, std.dev.: 0.0190) SingleSource/Benchmarks/Stanford/Puzzle: 12.21% (0.1433 => 0.1608, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.23% (0.0917 => 0.1020, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6259, std.dev.: 0.0763) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.69% (0.2694 => 0.2928, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.28% (0.2857 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.27% (1.0063 => 1.0795, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 7.21% (1.0194 => 1.0929, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7948, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (0.3301 => 0.3478, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/dt: 4.27% (0.9851 => 1.0272, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.91% (0.8498 => 0.8745, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: 2.81% (8.5113 => 8.7504, std.dev.: 0.0505) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 2.65% (15.2242 => 15.6283, std.dev.: 0.1250) MultiSource/Benchmarks/Bullet/bullet: 2.55% (6.9722 => 7.1502, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/whetstone: 2.38% (2.3453 => 2.4011, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7148, std.dev.: 0.0120) MultiSource/Benchmarks/BitBench/five11/five11: 2.12% (5.1938 => 5.3041, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 1.74% (14.4877 => 14.7397, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/bh/bh: 1.59% (2.5166 => 2.5565, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.45% (22.3381 => 22.6631, std.dev.: 0.0263) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5310, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.42% (0.7738 => 0.7473, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.12% (0.3497 => 0.2094, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.62% (5.2665 => 4.0752, std.dev.: 0.0668) SingleSource/Benchmarks/Shootout-C++/ary3: -20.75% (1.7473 => 1.3847, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.67% (1.1647 => 0.9356, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.52% (3.6023 => 3.2593, std.dev.: 0.0893) MultiSource/Benchmarks/mafft/pairlocalalign: -9.43% (62.4126 => 56.5258, std.dev.: 0.0506) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2856, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.38% (3.2007 => 2.9324, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.23% (3.6254 => 3.3632, std.dev.: 0.0377) MultiSource/Applications/SIBsim4/SIBsim4: -7.05% (3.4230 => 3.1816, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: -6.79% (1.4441 => 1.3460, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.32% (2.4457 => 2.2912, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.25% (2.9728 => 2.7869, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4059, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: -4.94% (1.4117 => 1.3420, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.84% (0.4140 => 0.3981, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.55% (1.7361 => 1.6744, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -3.30% (7.6833 => 7.4300, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.26% (1.2722 => 1.2307, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.87% (1.4021 => 1.3618, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6422, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -2.81% (3.4286 => 3.3323, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.80% (1.1683 => 1.1356, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: -2.79% (0.4296 => 0.4176, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -2.69% (9.2503 => 9.0019, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/neural/neural: -2.22% (1.0926 => 1.0683, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4180, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (92.7467 => 91.2178, std.dev.: 0.5267) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2387, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3091, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7677, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.5617 => 16.3683, std.dev.: 0.0192) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.62% (0.9980 => 0.9818, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: -1.01% (0.6022 => 0.5961, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.06% (0.1666 => 0.1667, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.12% (0.1554 => 0.1490, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3083 => 0.3085, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.85% (0.2394 => 0.2278, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.57% (0.3175 => 0.3157, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.52% (0.2302 => 0.2290, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -0.67% (0.0449 => 0.0446, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.25% (0.0301 => 0.0225, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -11.11% (0.0189 => 0.0168, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -3.08% (0.0325 => 0.0315, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1429 => 0.1436, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.84% (1.5019 => 1.4743, std.dev.: 0.0238) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.20% (0.1501 => 0.1549, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.62% (0.4264 => 0.4067, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.50% (0.1344 => 0.1391, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.49% (0.0589 => 0.0539, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.79% (0.0232 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0639 => 0.0574, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.46% (1.1350 => 1.1516, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.13% (0.0637 => 0.0547, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.67% (0.0246 => 0.0205, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.51% (0.7541 => 0.7806, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.32% (1.5363 => 1.6026, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 11:32:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 13:32:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915183221.F21FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3854?compare_to=3848&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3854, Order: 163968, Start Time: 2012-09-15 15:49:50, End Time: 2012-09-15 18:33:42 To: 3848, Order: 163966, Start Time: 2012-09-15 12:35:19, End Time: 2012-09-15 15:19:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.77% (2.0745 => 2.1319, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3469 => 0.3803, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3465 => 0.3794, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.49% (0.3488 => 0.3819, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.49% (0.3446 => 0.3773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.48% (0.3460 => 0.3788, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3442 => 0.3768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3496 => 0.3827, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.18% (0.3650 => 0.3985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3643 => 0.3977, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.3724 => 0.4058, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 7.61% (1.5932 => 1.7145, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (0.4361 => 0.4634, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.03% (1.6211 => 1.7189, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.03% (1.3152 => 1.3945, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.5826 => 0.6173, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (3.5627 => 3.7686, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.5889 => 0.6229, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.75% (5.5417 => 5.8602, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (0.5026 => 0.5310, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.58% (2.7292 => 2.8816, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.45% (1.0781 => 1.1369, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (0.4994 => 0.5264, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.2866 => 0.3020, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7171 => 0.7553, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.19% (4.4195 => 4.6490, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.2736 => 0.2873, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.96% (4.2109 => 4.4199, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 4.91% (4.6177 => 4.8445, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.87% (2.1013 => 2.2036, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (0.5000 => 0.5242, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (2.1653 => 2.2666, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 4.61% (0.2691 => 0.2815, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.60% (0.3890 => 0.4069, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.54% (0.3195 => 0.3340, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.52% (0.2875 => 0.3005, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.5900 => 0.6166, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.50% (23.5202 => 24.5776, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 4.46% (0.3004 => 0.3138, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.44% (0.9909 => 1.0349, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 4.43% (1.8794 => 1.9626, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (0.4658 => 0.4863, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 4.37% (0.6634 => 0.6924, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.3845 => 0.4013, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.32% (0.2823 => 0.2945, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.32% (2.0346 => 2.1224, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.3903 => 0.4070, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.20% (0.2738 => 0.2853, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.18% (1.4269 => 1.4866, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.15% (0.3060 => 0.3187, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.15% (2.0673 => 2.1530, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2811 => 0.2927, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.07% (0.3124 => 0.3251, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.06% (0.5546 => 0.5771, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.4139 => 0.4306, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.3362 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.98% (0.4146 => 0.4311, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 3.97% (0.3096 => 0.3219, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3258 => 0.3387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.95% (0.2911 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.92% (0.3267 => 0.3395, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.86% (0.3317 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.86% (0.3084 => 0.3203, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.84% (0.3336 => 0.3464, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3477 => 0.3610, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.82% (0.7875 => 0.8176, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.76% (0.4251 => 0.4411, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.76% (0.3348 => 0.3474, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.3271 => 0.3394, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3678 => 0.3814, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.65% (0.6435 => 0.6670, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3690 => 0.3824, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (1.9966 => 2.0682, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (1.9694 => 2.0399, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.58% (0.9697 => 1.0044, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.57% (0.2969 => 0.3075, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.55% (0.5012 => 0.5190, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 3.51% (0.4847 => 0.5017, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.08% (0.7426 => 0.7655, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (0.5361 => 0.5510, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (0.5584 => 0.5729, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (11.6398 => 11.9125, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.25% (4.6926 => 4.7981, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6641, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1737, std.dev.: 0.0678) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6347, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.40% (2.0820 => 2.1319, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5088, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4500, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2893, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5859, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5879, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9737, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7933, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8039, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8534, std.dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5720, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.67% (0.6293 => 0.6188, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9641, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7152, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 11:45:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 13:45:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915184547.85C9E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3855?compare_to=3851&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3855, Order: 163972, Start Time: 2012-09-15 17:32:39, End Time: 2012-09-15 18:47:08 To: 3851, Order: 163968, Start Time: 2012-09-15 15:49:44, End Time: 2012-09-15 17:04:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.68% (2.0176 => 2.4147, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.36% (3.9660 => 4.3372, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.7038 => 0.7663, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.83% (1.3693 => 1.4902, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (0.7710 => 0.8390, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5748 => 0.6251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.63% (0.9199 => 0.9993, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.51% (1.2193 => 1.3231, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.51% (1.4563 => 1.5802, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.49% (0.2721 => 0.2952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.47% (0.5265 => 0.5711, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.6959 => 0.7543, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 8.39% (0.4328 => 0.4691, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.36% (0.1327 => 0.1438, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.17% (13.8202 => 14.9490, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.14% (1.1364 => 1.2289, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.64% (0.5577 => 0.6003, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.4791 => 0.5145, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.39% (0.3899 => 0.4187, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 7.05% (0.8310 => 0.8896, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.02% (1.1061 => 1.1837, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3489 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3580 => 0.3830, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (7.2180 => 7.7220, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3756 => 0.4018, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.97% (0.4016 => 0.4296, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.5637 => 0.6026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.87% (0.7506 => 0.8022, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.85% (1.9828 => 2.1186, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.2914 => 0.3112, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.74% (0.3293 => 0.3515, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.74% (3.8646 => 4.1251, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.69% (3.6692 => 3.9147, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2726 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4390 => 0.4678, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.53% (2.1791 => 2.3214, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 6.53% (0.2988 => 0.3183, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3220 => 0.3429, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.44% (0.3868 => 0.4117, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.41% (0.7460 => 0.7938, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.33% (0.6744 => 0.7171, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.24% (3.1889 => 3.3880, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 6.24% (1.9270 => 2.0472, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.18% (1.0594 => 1.1249, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.17% (1.3245 => 1.4062, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.08% (0.3192 => 0.3386, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.04% (16.6129 => 17.6162, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (1.3819 => 1.4647, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.95% (0.3914 => 0.4147, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.93% (0.3623 => 0.3838, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (1.3813 => 1.4631, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/for-in: 5.91% (0.3789 => 0.4013, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.90% (0.4003 => 0.4239, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3601 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3663 => 0.3878, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.84% (0.3650 => 0.3863, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.83% (1.2749 => 1.3492, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 5.82% (14.8535 => 15.7186, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.70% (8.4961 => 8.9800, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.8698 => 0.9192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.50% (13.2842 => 14.0147, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/bh/bh: 5.46% (0.2859 => 0.3015, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4113 => 0.4336, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6135 => 0.6467, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.40% (0.8818 => 0.9294, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.38% (4.4433 => 4.6822, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6142, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2703, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.03% (1.1333 => 1.1903, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.91% (6.5754 => 6.8981, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.83% (3.2742 => 3.4324, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.67% (4.6629 => 4.8805, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.24% (0.9108 => 0.9494, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.18% (0.4805 => 0.5006, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.12% (1.5188 => 1.5814, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1859, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6250 => 0.6488, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.81% (3.7467 => 3.8893, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.1007 => 2.1795, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2785 => 6.4980, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 2.58% (33.2944 => 34.1543, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 1.85% (16.2614 => 16.5628, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std.dev.: 0.0511) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (0.2093 => 0.2214, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5454, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.99% (10.7476 => 11.0691, std.dev.: 0.0765) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6013, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7731 => 3.8315, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4460, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5915, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.88% (0.4657 => 0.3871) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (22.5627 => 21.7073, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2770, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std.dev.: 0.0067) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9206, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6006, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9097, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8693, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2411, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0596, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2314, std.dev.: 0.0281) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4353, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 13:28:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 15:28:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915202856.005992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3856?compare_to=3855&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3856, Order: 163974, Start Time: 2012-09-15 19:15:49, End Time: 2012-09-15 20:30:15 To: 3855, Order: 163972, Start Time: 2012-09-15 17:32:39, End Time: 2012-09-15 18:47:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.80% (2.0176 => 2.4171, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.44% (3.9660 => 4.3405, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 9.30% (0.7061 => 0.7718, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.11% (0.7710 => 0.8412, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 9.09% (0.7038 => 0.7678, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.80% (0.5748 => 0.6254, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.80% (1.3693 => 1.4898, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.75% (0.9199 => 1.0004, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.64% (0.6959 => 0.7560, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.64% (1.2193 => 1.3246, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.49% (0.5265 => 0.5712, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.23% (0.5577 => 0.6036, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.22% (1.1364 => 1.2298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.4563 => 1.5759, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 8.17% (0.4062 => 0.4394, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 8.15% (13.8202 => 14.9471, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.4791 => 0.5145, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.29% (0.8310 => 0.8916, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4390 => 0.4710, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.21% (1.1061 => 1.1858, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.17% (0.5637 => 0.6041, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.10% (0.2760 => 0.2956, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.08% (0.3489 => 0.3736, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4379 => 0.4688, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.04% (0.3580 => 0.3832, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.02% (0.4016 => 0.4298, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (7.2180 => 7.7177, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.90% (1.9828 => 2.1197, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.85% (3.8646 => 4.1292, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: 6.74% (0.3293 => 0.3515, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.73% (3.6692 => 3.9162, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.70% (0.7506 => 0.8009, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.58% (0.3220 => 0.3432, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6.40% (2.1791 => 2.3186, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2243 => 0.2386, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.33% (0.7460 => 0.7932, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983) MultiSource/Applications/d/make_dparser: 6.31% (3.1889 => 3.3902, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.22% (1.9270 => 2.0468, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.20% (1.0594 => 1.1251, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 6.18% (0.3578 => 0.3799, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.15% (1.3245 => 1.4060, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3646 => 0.3869, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.08% (0.6576 => 0.6976, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.07% (16.6129 => 17.6220, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.05% (0.3601 => 0.3819, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3914 => 0.4150, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 6.01% (1.2749 => 1.3515, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.95% (1.3819 => 1.4641, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.92% (0.4003 => 0.4240, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.88% (14.8535 => 15.7268, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4620, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3650 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3623 => 0.3832, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.71% (0.8698 => 0.9195, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.67% (0.6135 => 0.6483, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.64% (8.4961 => 8.9751, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.52% (0.4113 => 0.4340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0083, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.38% (4.3801 => 4.6159, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.36% (0.8818 => 0.9291, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (4.4433 => 4.6811, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.18% (14.5298 => 15.2826, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.03% (1.1333 => 1.1903, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.96% (0.3245 => 0.3406, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.91% (6.5754 => 6.8981, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.81% (3.2742 => 3.4316, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2321 => 0.2431, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.67% (4.6629 => 4.8805, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2292 => 1.2818, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.27% (0.9108 => 0.9497, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (1.5188 => 1.5811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.05% (4.9865 => 5.1887, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.6250 => 0.6492, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.72% (3.7467 => 3.8862, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.68% (2.1007 => 2.1780, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (6.2785 => 6.5000, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: 2.59% (33.2944 => 34.1554, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 1.74% (16.2614 => 16.5438, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std.dev.: 0.0432) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4131, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5483, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9832, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.94% (10.7476 => 11.0631, std.dev.: 0.0735) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5967, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6875, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5895, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.92% (0.4657 => 0.3869, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (22.5627 => 21.7062, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2799, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.29% (1.3780 => 1.2913, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.36% (3.0263 => 2.9246, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.25% (0.4867 => 0.4709, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5895, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.26% (26.5159 => 25.9170, std.dev.: 0.0349) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2403, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0585, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2342, std.dev.: 0.0240) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4351, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2635, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 14:00:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 16:00:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915210039.7EA792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3857?compare_to=3852&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3857, Order: 163980, Start Time: 2012-09-15 19:42:21, End Time: 2012-09-15 21:01:59 To: 3852, Order: 163968, Start Time: 2012-09-15 15:59:05, End Time: 2012-09-15 17:18:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.29% (56.5024 => 54.6441, std.dev.: 0.0737) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (0.5668 => 0.5672, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.04% (15.8009 => 15.8071, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 0.32% (14.6346 => 14.6809, std.dev.: 0.0184) MultiSource/Benchmarks/Bullet/bullet: 0.25% (81.9570 => 82.1578, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 0.26% (4.2956 => 4.3069, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2164 => 1.2178, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.3643 => 7.3634, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (3.6534 => 3.6594, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6323 => 0.6327, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1428 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (0.0661 => 0.0674, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.91% (63.2438 => 82.1578, std.dev.: 0.0116) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14254.03% (0.0720 => 10.3349, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.29% (10.3673 => 15.0628, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: 25.15% (0.1622 => 0.2030, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.75% (7.0540 => 7.9537, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.71% (2.2022 => 2.4820, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.76% (1.1194 => 1.2510, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.90% (1.7609 => 1.9353, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.44% (10.4361 => 11.4208, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.09% (0.3543 => 0.3865, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1625 => 0.1768, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3473 => 0.3773, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3497 => 0.3792, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.40% (0.3561 => 0.3860, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 8.38% (0.3543 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.33% (0.3516 => 0.3809, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3828 => 0.4141, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.3927 => 0.4246, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.12% (0.3694 => 0.3994, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.87% (0.3886 => 0.4192, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 7.74% (0.3282 => 0.3536, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.91% (9.4845 => 10.1401, std.dev.: 0.0170) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.56% (0.4879 => 0.5199, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.43% (0.7433 => 0.7911, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.13% (0.7115 => 0.7551, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4615 => 0.4895, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.93% (0.2700 => 0.2860, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.6675 => 0.7069, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.87% (0.5860 => 0.6204, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.83% (0.2554 => 0.2703, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3423 => 0.3621, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.77% (0.2271 => 0.2402, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.74% (0.5105 => 0.5398, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.3050 => 1.3798, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 5.69% (5.7591 => 6.0870, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.62% (1.5415 => 1.6281, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.60% (4.2646 => 4.5035, std.dev.: 0.0097) MultiSource/Applications/d/make_dparser: 5.57% (3.3354 => 3.5213, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (8.1363 => 8.5845, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.46% (0.5569 => 0.5873, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.38% (0.8172 => 0.8612, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 5.32% (0.5925 => 0.6240, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 5.27% (0.6030 => 0.6348, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.22% (0.2758 => 0.2902, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.8067 => 0.8488, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (5.0018 => 5.2583, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.11% (4.9449 => 5.1974, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 5.08% (0.7835 => 0.8233, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 5.08% (0.3092 => 0.3249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9765 => 1.0258, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.87% (1.1642 => 1.2209, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 4.79% (0.4299 => 0.4505, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3441 => 0.3603, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.2603 => 0.2724, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.64% (1.0722 => 1.1220, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.60% (3.8723 => 4.0504, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.59% (1.1861 => 1.2405, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.48% (0.5020 => 0.5245, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7326 => 0.7653, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (7.9617 => 8.3067, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: 4.31% (1.5603 => 1.6275, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.29% (0.4103 => 0.4279, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.27% (2.2969 => 2.3949, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.22% (2.0273 => 2.1129, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3826 => 0.3983, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.10% (0.8921 => 0.9287, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.02% (21.9371 => 22.8190, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6456 => 0.6714, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.97% (0.6450 => 0.6706, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4636 => 0.4817, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.87% (1.5859 => 1.6473, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5981 => 0.6210, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.68% (0.3422 => 0.3548, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.59% (0.3650 => 0.3781, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (1.4186 => 1.4672, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (14.3668 => 14.8548, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.4289 => 0.4431, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.2024 => 2.2750, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4203 => 0.4340, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.01% (0.4048 => 0.4170, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.88% (2.0665 => 2.1260, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.1840 => 1.2172, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.8101 => 0.8263, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.72% (1.2842 => 1.3063, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3614, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7504, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2218, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.92% (5.2763 => 3.2227, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.67% (5.3855 => 3.8413, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.30% (5.3526 => 3.8380, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1405, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.12% (2.9384 => 2.5822, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.76% (22.1758 => 20.2343, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2687, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -3.46% (1.2373 => 1.1945, std.dev.: 0.0150) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5030, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0107, std.dev.: 0.0153) SingleSource/UnitTests/Vector/multiplies: -1.86% (2.5528 => 2.5052, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0147, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.6441 => 4.5813, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2216, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.47% (0.5229 => 0.5672, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.45% (14.9895 => 15.8071, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 3.71% (14.1553 => 14.6809, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (4.1105 => 4.3069, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.23% (1.1048 => 1.2178, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (7.1582 => 7.3634, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.67% (3.4629 => 3.6594, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.6222 => 0.6327, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 14:23:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 16:23:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915212323.C20482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3858?compare_to=3853&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3858, Order: 163981, Start Time: 2012-09-15 20:13:20, End Time: 2012-09-15 21:24:46 To: 3853, Order: 163972, Start Time: 2012-09-15 17:04:55, End Time: 2012-09-15 18:16:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (53 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 889 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.2934 => 0.3056, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.75% (0.4501 => 0.4670, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.68% (0.5451 => 0.5597, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.23% (0.7473 => 0.7640, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.23% (0.5601 => 0.5726, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.77% (1.1679 => 1.1886, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 1.29% (1.8700 => 1.8942, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.49% (0.7611 => 0.7877, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.49% (2.6853 => 2.7254, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: 1.47% (15.6283 => 15.8585, std.dev.: 0.0403) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.30% (2.5111 => 2.4282, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.94% (60.5119 => 59.3381, std.dev.: 0.4302) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.48% (0.9818 => 0.9963, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.5961 => 0.5958, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -2.22% (0.1667 => 0.1630, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.03% (0.1490 => 0.1565, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (0.3085 => 0.3079, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (0.2278 => 0.2309, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.84% (0.3157 => 0.3099, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2290 => 0.2290, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -4.93% (0.0446 => 0.0424, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 2.30% (0.0087 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -29.96% (0.0237 => 0.0166, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.57% (0.0191 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.31% (0.0383 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.78% (0.0225 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.30% (0.0279 => 0.0214, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.17% (0.0319 => 0.0277, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 1.70% (0.0176 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.07% (0.0168 => 0.0141, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 2.88% (0.0243 => 0.0250, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 4.13% (0.0315 => 0.0328, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 60.00% (0.0005 => 0.0008, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1436 => 0.1432, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 2.17% (1.4743 => 1.5063, std.dev.: 0.0157) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.23% (0.1549 => 0.1468, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.17% (0.4067 => 0.4060, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.51% (0.1391 => 0.1370, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.75% (0.0539 => 0.0570, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.50% (0.0200 => 0.0219, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.39% (0.0574 => 0.0582, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1516 => 1.1498, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.67% (0.0015 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.76% (0.0547 => 0.0584, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.32% (0.0205 => 0.0149, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7806 => 0.7799, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.29% (1.6026 => 1.6072, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.53% (4.1772 => 3.1109, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/except: 82783.33% (0.0006 => 0.4973, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.10% (0.5309 => 0.5686, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 6.75% (2.1763 => 2.3233, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.38% (0.6410 => 0.6755, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.98% (0.2552 => 0.2679, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.44% (0.3582 => 0.3741, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 3.66% (1.0046 => 1.0414, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/18-imp/imp: 3.64% (0.3217 => 0.3334, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.6915 => 0.7160, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.99% (15.3105 => 15.7684, std.dev.: 0.0666) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.95% (0.7722 => 0.7950, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.30% (29.3170 => 29.9901, std.dev.: 0.2262) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.7639 => 0.7808, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.83% (1.1672 => 1.1886, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 1.77% (3.0225 => 3.0760, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.7226 => 0.7331, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 1.21% (2.0972 => 2.1226, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0138) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.25% (0.0917 => 0.1066, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.93% (0.0766 => 0.0888, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 14.54% (1.7426 => 1.9960, std.dev.: 0.0337) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3746 => 0.4277, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5496, std.dev.: 0.0296) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.98% (7.0025 => 7.6315, std.dev.: 0.0308) SingleSource/Benchmarks/McGill/chomp: 7.99% (1.0194 => 1.1008, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.91% (0.2857 => 0.3083, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (0.3301 => 0.3538, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.07% (1.0063 => 1.0774, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8151, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/fp-convert: 4.17% (15.2242 => 15.8585, std.dev.: 0.0403) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (40.4792 => 41.9952, std.dev.: 0.3574) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.69% (4.2129 => 4.3682, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.52% (0.7609 => 0.7877, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.02% (0.3508 => 0.3614, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.00% (0.8498 => 0.8753, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5113 => 8.7552, std.dev.: 0.0349) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 2.69% (5.1938 => 5.3337, std.dev.: 0.0381) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.67% (0.5876 => 0.6033, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (2.6656 => 2.7254, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash: 2.09% (0.6308 => 0.6440, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4455 => 2.4878, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.61% (14.4877 => 14.7216, std.dev.: 0.0340) MultiSource/Applications/siod/siod: 1.52% (3.5520 => 3.6061, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.10% (2.8599 => 2.8915, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.26% (0.3497 => 0.2089, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.25% (5.2665 => 4.1472, std.dev.: 0.1064) SingleSource/Benchmarks/Shootout-C++/ary3: -20.43% (1.7473 => 1.3903, std.dev.: 0.0672) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.46% (1.1647 => 0.9380, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -9.27% (62.4126 => 56.6298, std.dev.: 0.1779) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.27% (3.2007 => 2.9361, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.77% (2.4457 => 2.2557, std.dev.: 0.0307) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.26% (3.6254 => 3.3621, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -6.75% (3.4230 => 3.1920, std.dev.: 0.0296) MultiSource/Benchmarks/FreeBench/distray/distray: -6.57% (0.2664 => 0.2489, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -6.14% (1.4441 => 1.3554, std.dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: -3.74% (1.4117 => 1.3589, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.48% (45.4683 => 43.8875, std.dev.: 0.4905) MultiSource/Applications/lambda-0_1_3/lambda: -3.35% (7.6833 => 7.4261, std.dev.: 0.0427) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.30% (1.2722 => 1.2302, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.07% (1.1683 => 1.1324, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.00% (61.1734 => 59.3381, std.dev.: 0.4302) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.98% (1.7361 => 1.6843, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.89% (3.7496 => 3.6413, std.dev.: 0.0244) SingleSource/Benchmarks/McGill/misr: -2.89% (0.4296 => 0.4172, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0285) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3355, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -2.63% (9.5474 => 9.2963, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.07% (1.8739 => 1.8351, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4188, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -1.73% (92.7467 => 91.1442, std.dev.: 0.5182) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.48% (3.8907 => 3.8333, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7661, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.40% (9.3855 => 9.2542, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3135, std.dev.: 0.0599) MultiSource/Applications/lua/lua: -1.01% (29.5232 => 29.2264, std.dev.: 0.0423) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.17% (0.9980 => 0.9963, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.06% (0.6022 => 0.5958, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -2.16% (0.1666 => 0.1630, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.71% (0.1554 => 0.1565, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (0.3083 => 0.3079, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.55% (0.2394 => 0.2309, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.39% (0.3175 => 0.3099, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.52% (0.2302 => 0.2290, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -5.57% (0.0449 => 0.0424, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -30.83% (0.0240 => 0.0166, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.65% (0.0284 => 0.0214, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.51% (0.0324 => 0.0277, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -25.40% (0.0189 => 0.0141, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 0.92% (0.0325 => 0.0328, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -20.00% (0.0010 => 0.0008, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 0.29% (1.5019 => 1.5063, std.dev.: 0.0157) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.20% (0.1501 => 0.1468, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.93% (0.1344 => 0.1370, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.23% (0.0589 => 0.0570, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.60% (0.0232 => 0.0219, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.1350 => 1.1498, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.32% (0.0637 => 0.0584, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.43% (0.0246 => 0.0149, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.42% (0.7541 => 0.7799, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.61% (1.5363 => 1.6072, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 14:44:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 16:44:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120915214447.019F82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3859?compare_to=3854&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3859, Order: 163974, Start Time: 2012-09-15 19:02:21, End Time: 2012-09-15 21:46:08 To: 3854, Order: 163968, Start Time: 2012-09-15 15:49:50, End Time: 2012-09-15 18:33:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (116 on baseline) Performance Improvements: 2 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (778 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.16% (109.4230 => 118.3487, std.dev.: 0.1081) SingleSource/Benchmarks/Shootout-C++/fibo: 1.13% (12.2314 => 12.3695, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.40% (2.1319 => 2.0595, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.81% (128.4816 => 126.1541, std.dev.: 0.5953) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 9.68% (0.3460 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3446 => 0.3779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.66% (0.3488 => 0.3825, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3442 => 0.3774, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3496 => 0.3832, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.57% (0.3469 => 0.3801, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 9.55% (0.3465 => 0.3796, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.37% (0.3650 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3643 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.13% (0.3724 => 0.4064, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.48% (1.5932 => 1.7123, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (0.4361 => 0.4627, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.5889 => 0.6245, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (1.6211 => 1.7170, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (1.3152 => 1.3912, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.61% (0.2566 => 0.2710, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.61% (5.5417 => 5.8524, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.59% (3.5627 => 3.7618, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8786, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 5.41% (0.7171 => 0.7559, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (0.5000 => 0.5265, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2738 => 0.2881, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.20% (1.0781 => 1.1342, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.2075 => 0.2182, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (0.5026 => 0.5273, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.90% (4.2109 => 4.4172, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (4.4195 => 4.6356, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.81% (0.3930 => 0.4119, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.77% (2.1013 => 2.2016, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.76% (0.3195 => 0.3347, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.73% (4.6177 => 4.8360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.70% (0.2875 => 0.3010, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.63% (0.9909 => 1.0368, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.5900 => 0.6172, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3625 => 0.3791, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.2823 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (2.1653 => 2.2634, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/methcall: 4.44% (0.2813 => 0.2938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2750 => 0.2871, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (2.0673 => 2.1581, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 4.38% (1.8794 => 1.9617, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 4.38% (23.5202 => 24.5500, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.28% (0.3060 => 0.3191, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.25% (0.3267 => 0.3406, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.25% (0.4658 => 0.4856, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.3271 => 0.3409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.21% (0.2780 => 0.2897, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.19% (0.3362 => 0.3503, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.19% (0.2911 => 0.3033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.3258 => 0.3394, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.17% (0.4029 => 0.4197, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3124 => 0.3254, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.13% (1.4269 => 1.4859, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3096 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3348 => 0.3485, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.4139 => 0.4306, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3317 => 0.3450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3726 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.3903 => 0.4059, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 4.00% (0.3678 => 0.3825, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.99% (0.3084 => 0.3207, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4251 => 0.4418, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.91% (0.3477 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (1.9694 => 2.0449, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3282 => 0.3406, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.77% (2.0346 => 2.1114, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 3.71% (0.5546 => 0.5752, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.6435 => 0.6674, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.71% (0.3690 => 0.3827, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.66% (0.3336 => 0.3458, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.3981 => 0.4126, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (1.9966 => 2.0682, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.5012 => 0.5191, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.53% (0.9697 => 1.0039, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.39% (0.7875 => 0.8142, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 3.12% (0.4847 => 0.4998, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.07% (0.7426 => 0.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (0.5361 => 0.5518, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (0.5584 => 0.5725, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (11.6398 => 11.9089, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.24% (4.6926 => 4.7979, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 5.14% (1.8057 => 1.8985, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6695, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1651, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6508, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5004, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4410, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5873, std.dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5215, std.dev.: 0.0346) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7871, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: -6.20% (0.2402 => 0.2253, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7665, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9641, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 15:13:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 17:13:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915221313.9EB702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3860?compare_to=3856&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3860, Order: 163984, Start Time: 2012-09-15 21:00:05, End Time: 2012-09-15 22:14:32 To: 3856, Order: 163974, Start Time: 2012-09-15 19:15:49, End Time: 2012-09-15 20:30:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (164 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.04% (54.8735 => 56.5415, std.dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.2913 => 1.3063, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.71% (2.0176 => 2.4153, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.39% (3.9660 => 4.3384, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7061 => 0.7722, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.13% (0.7710 => 0.8414, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.92% (0.7038 => 0.7666, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.90% (0.2596 => 0.2827, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.70% (0.9199 => 0.9999, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.68% (1.3693 => 1.4882, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.55% (0.5265 => 0.5715, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.51% (1.2193 => 1.3231, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.49% (0.2721 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.46% (0.6959 => 0.7548, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 8.29% (13.8202 => 14.9659, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.22% (1.1364 => 1.2298, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.21% (0.1327 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.14% (1.4563 => 1.5748, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.2781 => 0.2993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5577 => 0.5997, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 7.51% (1.0313 => 1.1088, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.44% (0.3899 => 0.4189, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.28% (0.4791 => 0.5140, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.18% (0.4390 => 0.4705, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.10% (0.2760 => 0.2956, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 7.09% (1.1061 => 1.1845, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3022 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2127 => 0.2277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.95% (1.9828 => 2.1207, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.93% (0.8310 => 0.8886, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (7.2180 => 7.7162, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.5637 => 0.6026, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.3756 => 0.4014, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.82% (3.8646 => 4.1282, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.77% (3.6692 => 3.9176, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 6.70% (0.7506 => 0.8009, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.69% (0.2914 => 0.3109, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (0.7460 => 0.7942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3220 => 0.3426, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.36% (0.6576 => 0.6994, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.32% (2.1791 => 2.3168, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.23% (0.6744 => 0.7164, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.0594 => 1.1252, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390) MultiSource/Applications/d/make_dparser: 6.20% (3.1889 => 3.3867, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (1.3245 => 1.4064, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.17% (0.1865 => 0.1980, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.15% (1.9270 => 2.0456, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.04% (0.3578 => 0.3794, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.02% (1.3819 => 1.4651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.97% (16.6129 => 17.6046, std.dev.: 0.0324) SingleSource/UnitTests/ObjC/exceptions-4: 5.95% (0.3646 => 0.3863, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.92% (0.4003 => 0.4240, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3663 => 0.3878, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 5.86% (0.3789 => 0.4011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.85% (0.3623 => 0.3835, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4619, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3601 => 0.3811, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3650 => 0.3862, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 5.77% (1.2749 => 1.3485, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 5.77% (14.8535 => 15.7100, std.dev.: 0.0117) SingleSource/UnitTests/ObjC/property: 5.69% (0.3940 => 0.4164, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6135 => 0.6481, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 5.62% (8.4961 => 8.9735, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.60% (0.8818 => 0.9312, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.45% (4.3801 => 4.6188, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 5.45% (0.4113 => 0.4337, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (13.2842 => 14.0071, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (4.4433 => 4.6786, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1333 => 1.1909, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.07% (14.5298 => 15.2671, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.85% (6.5754 => 6.8943, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.82% (3.2742 => 3.4321, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.81% (0.3245 => 0.3401, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.65% (0.2321 => 0.2429, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.59% (4.6629 => 4.8769, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 4.30% (1.2292 => 1.2820, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.18% (0.4805 => 0.5006, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.15% (0.9108 => 0.9486, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (1.5188 => 1.5816, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (4.9865 => 5.1875, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/bigfib: 3.82% (0.6250 => 0.6489, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.1007 => 2.1785, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 3.65% (3.7467 => 3.8833, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (6.2785 => 6.4955, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 2.56% (33.2944 => 34.1471, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5399, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5199, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.11% (1.8175 => 2.2557, std.dev.: 0.0330) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3780, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.52% (1.9199 => 1.9875, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.15% (10.7476 => 11.0861, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5984, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1835, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5977, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.86% (0.4657 => 0.3872, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (22.5627 => 21.7078, std.dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2826, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9234, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5804, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9081, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2407, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2387, std.dev.: 0.0337) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.20% (6.6320 => 6.5527, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.14% (4.1080 => 4.0613, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2609, std.dev.: 0.0146) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4356, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 15:48:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 17:48:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120915224857.3D5322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3861?compare_to=3857&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3861, Order: 163984, Start Time: 2012-09-15 21:30:29, End Time: 2012-09-15 22:50:14 To: 3857, Order: 163980, Start Time: 2012-09-15 19:42:21, End Time: 2012-09-15 21:01:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (116 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (731 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.17% (0.5341 => 0.5457, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.78% (0.5672 => 0.5716, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.02% (15.8071 => 15.8109, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: -0.00% (14.6809 => 14.6804, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 0.01% (82.1578 => 82.1640, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3069 => 4.3042, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2178 => 1.2175, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.3634 => 7.3666, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.6594 => 3.6614, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.6327 => 0.6327, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0674 => 0.0675, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.92% (63.2438 => 82.1640, std.dev.: 0.0147) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.36% (0.0720 => 10.3301, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.36% (10.3673 => 15.0697, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: 25.28% (0.1622 => 0.2032, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.72% (2.2022 => 2.4824, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.71% (7.0540 => 7.9509, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 12.50% (0.1432 => 0.1611, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.85% (1.7609 => 1.9344, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 9.41% (10.4361 => 11.4186, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3473 => 0.3777, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.50% (0.3543 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.47% (0.3543 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.46% (0.3497 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.45% (0.3561 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3694 => 0.3996, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3828 => 0.4140, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.3927 => 0.4244, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.87% (0.3886 => 0.4192, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.74% (0.3282 => 0.3536, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.03% (9.4845 => 10.1515, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.4879 => 0.5198, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.50% (0.7433 => 0.7916, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 6.11% (0.7115 => 0.7550, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (0.4615 => 0.4896, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.6675 => 0.7079, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.99% (0.5105 => 0.5411, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.93% (0.2700 => 0.2860, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.91% (0.2554 => 0.2705, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.90% (0.2271 => 0.2405, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.87% (0.5860 => 0.6204, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.84% (0.3307 => 0.3500, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.78% (5.7591 => 6.0919, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.77% (1.3050 => 1.3803, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (1.5415 => 1.6289, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.65% (3.3354 => 3.5239, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (4.2646 => 4.5043, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.47% (8.1363 => 8.5813, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.46% (0.5569 => 0.5873, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 5.45% (0.7835 => 0.8262, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 5.38% (0.5925 => 0.6244, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.8067 => 0.8494, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.8172 => 0.8597, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.6030 => 0.6343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.18% (0.9765 => 1.0271, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.3092 => 0.3251, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (4.9449 => 5.1983, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.12% (5.0018 => 5.2577, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 5.02% (0.7326 => 0.7694, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.02% (1.1642 => 1.2226, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.77% (0.4299 => 0.4504, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.67% (3.8723 => 4.0533, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.66% (1.0722 => 1.1222, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.1861 => 1.2397, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.46% (0.5020 => 0.5244, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (7.9617 => 8.3134, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 4.41% (0.8921 => 0.9314, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.29% (1.5603 => 1.6273, std.dev.: 0.0074) MultiSource/Applications/treecc/treecc: 4.29% (2.0273 => 2.1142, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 4.25% (2.2969 => 2.3945, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.02% (21.9371 => 22.8188, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3826 => 0.3979, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6456 => 0.6714, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.95% (0.6450 => 0.6705, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6463, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5981 => 0.6206, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (0.4064 => 0.4216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.68% (0.3422 => 0.3548, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (1.4186 => 1.4688, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.53% (0.3650 => 0.3779, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (14.3668 => 14.8463, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4289 => 0.4430, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2737, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.07% (0.4620 => 0.4762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.4048 => 0.4167, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.1840 => 1.2187, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (2.0665 => 2.1243, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.8101 => 0.8254, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.01% (3.1595 => 3.4127, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3841, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 6.74% (1.1396 => 1.2164, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7522, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3483, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7893, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2179, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5802, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3704, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.87% (5.2763 => 3.2256, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.69% (5.3855 => 3.8405, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.26% (5.3526 => 3.8397, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1221, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.14% (2.9384 => 2.5818, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.69% (22.1758 => 20.2485, std.dev.: 0.0310) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.44% (1.5373 => 1.3768, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2735, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7174, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5840, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5027, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -3.08% (1.2373 => 1.1992, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4224, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0032, std.dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9880, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5785, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2271, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.31% (0.5229 => 0.5716, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 5.48% (14.9895 => 15.8109, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 3.71% (14.1553 => 14.6804, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (4.1105 => 4.3042, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.20% (1.1048 => 1.2175, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (7.1582 => 7.3666, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.73% (3.4629 => 3.6614, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.6222 => 0.6327, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 5.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 15:49:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 17:49:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120915224930.050682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3862?compare_to=3858&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3862, Order: 163985, Start Time: 2012-09-15 21:40:26, End Time: 2012-09-15 22:50:51 To: 3858, Order: 163981, Start Time: 2012-09-15 20:13:20, End Time: 2012-09-15 21:24:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (58 on baseline) Performance Improvements: 3 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.0369 => 2.0601, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 1.04% (1.1536 => 1.1656, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.66% (2.8119 => 2.8866, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.61% (1.8351 => 1.8646, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.14% (0.5597 => 0.5421, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.72% (0.4670 => 0.4543, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.17% (0.3538 => 0.3426, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.73% (0.9963 => 0.9890, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 0.69% (0.5958 => 0.5999, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 1.72% (0.1630 => 0.1658, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1565 => 0.1568, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (0.3079 => 0.3087, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.78% (0.2309 => 0.2350, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.97% (0.3099 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.35% (0.2290 => 0.2282, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 6.84% (0.0424 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 45.18% (0.0166 => 0.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0194 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.29% (0.0388 => 0.0383, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.17% (0.0214 => 0.0270, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.88% (0.0277 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0179 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 35.46% (0.0141 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.60% (0.0250 => 0.0254, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: -0.30% (0.0328 => 0.0327, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 37.50% (0.0008 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1432 => 0.1437, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -0.82% (1.5063 => 1.4939, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.68% (0.1468 => 0.1566, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.29% (0.4060 => 0.4234, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1370 => 0.1372, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.37% (0.0570 => 0.0669, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.11% (0.0219 => 0.0210, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.82% (0.0582 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1498 => 1.1474, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 68.75% (0.0016 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.37% (0.0584 => 0.0576, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 56.38% (0.0149 => 0.0233, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7799 => 0.7815, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.11% (1.6072 => 1.6090, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.31% (0.0121 => 0.0117, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.07% (4.1772 => 3.0881, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/except: 82933.33% (0.0006 => 0.4982, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.76% (0.5309 => 0.5668, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 5.84% (2.1763 => 2.3034, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.6410 => 0.6772, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.80% (0.3582 => 0.3754, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.35% (0.2552 => 0.2663, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.7722 => 0.8036, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.76% (0.6173 => 0.6405, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 3.66% (1.1653 => 1.2080, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: 3.56% (0.6915 => 0.7161, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 3.41% (1.0046 => 1.0389, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 3.17% (15.3105 => 15.7953, std.dev.: 0.0634) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.5150 => 1.5512, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.7639 => 0.7784, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 1.89% (29.3170 => 29.8721, std.dev.: 0.0967) MultiSource/Applications/Burg/burg: 1.89% (1.1440 => 1.1656, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.87% (1.1827 => 1.2048, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.62% (0.7226 => 0.7343, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 1.60% (2.0972 => 2.1308, std.dev.: 0.0111) MultiSource/Applications/d/make_dparser: 1.53% (3.0225 => 3.0688, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.0317 => 2.0601, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (1.4408 => 1.4577, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (8.2186 => 8.3089, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2546 => 6.3223, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.45% (0.0499 => 0.0621, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 18.57% (21.1721 => 25.1041, std.dev.: 0.5038) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.67% (0.0917 => 0.1079, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.0766 => 0.0878, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0583) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3746 => 0.4276, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.28% (4.0101 => 4.5428, std.dev.: 0.0182) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.10% (0.2694 => 0.2993, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6055, std.dev.: 0.0348) SingleSource/Benchmarks/McGill/chomp: 8.25% (1.0194 => 1.1035, std.dev.: 0.0316) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.39% (0.2857 => 0.3068, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.11% (1.0063 => 1.0678, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8033, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8323, std.dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5386, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/dt: 3.83% (0.9851 => 1.0228, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (0.3301 => 0.3426, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8717, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 3.27% (1.4184 => 1.4648, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.99% (0.3508 => 0.3613, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.95% (0.8498 => 0.8749, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.81% (0.5876 => 0.6041, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.44% (2.6656 => 2.7307, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/ReedSolomon: 2.38% (8.5113 => 8.7140, std.dev.: 0.0769) MultiSource/Benchmarks/BitBench/five11/five11: 2.11% (5.1938 => 5.3036, std.dev.: 0.0212) MultiSource/Applications/hexxagon/hexxagon: 1.67% (14.4877 => 14.7298, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.57% (6.9722 => 7.0816, std.dev.: 0.0351) MultiSource/Applications/siod/siod: 1.54% (3.5520 => 3.6066, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.50% (4.6127 => 4.6820, std.dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5312, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 1.31% (2.5166 => 2.5496, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.20% (0.7738 => 0.7568, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.69% (0.3497 => 0.2039, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.08% (5.2665 => 4.1036, std.dev.: 0.1147) SingleSource/Benchmarks/Shootout-C++/ary3: -20.47% (1.7473 => 1.3896, std.dev.: 0.1219) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.29% (1.1647 => 0.9400, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -9.37% (62.4126 => 56.5666, std.dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.44% (2.4457 => 2.2394, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9394, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3636, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/distray/distray: -6.68% (0.2664 => 0.2486, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -6.42% (1.4441 => 1.3514, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: -6.27% (3.4230 => 3.2085, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.71% (1.7361 => 1.6543, std.dev.: 0.0222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -3.36% (7.6833 => 7.4254, std.dev.: 0.0244) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2308, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/ffbench: -3.23% (1.4117 => 1.3661, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.07% (1.1683 => 1.1324, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/misr: -2.79% (0.4296 => 0.4176, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -2.77% (3.4286 => 3.3337, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -2.76% (9.2503 => 8.9951, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.27% (1.2959 => 1.2665, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.18% (45.4683 => 44.4767, std.dev.: 0.2873) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.16% (3.7496 => 3.6686, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (92.7467 => 90.9925, std.dev.: 0.4455) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2320, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4876 => 3.4323, std.dev.: 0.0179) MultiSource/Benchmarks/sim/sim: -1.51% (3.8907 => 3.8320, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0926 => 1.0772, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3098, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7685, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.3569 => 2.3298, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.90% (0.9980 => 0.9890, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6022 => 0.5999, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -0.48% (0.1666 => 0.1658, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1554 => 0.1568, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (0.3083 => 0.3087, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.84% (0.2394 => 0.2350, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.47% (0.3175 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.87% (0.2302 => 0.2282, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.93% (0.0284 => 0.0270, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -0.53% (1.5019 => 1.4939, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.33% (0.1501 => 0.1566, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.70% (0.4264 => 0.4234, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.08% (0.1344 => 0.1372, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.58% (0.0589 => 0.0669, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.09% (1.1350 => 1.1474, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.58% (0.0637 => 0.0576, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.28% (0.0246 => 0.0233, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.63% (0.7541 => 0.7815, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.73% (1.5363 => 1.6090, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.14% (0.0070 => 0.0117, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 16:56:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 18:56:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120915235610.BC6B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3863?compare_to=3860&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3863, Order: 163986, Start Time: 2012-09-15 22:43:02, End Time: 2012-09-15 23:57:31 To: 3860, Order: 163984, Start Time: 2012-09-15 21:00:05, End Time: 2012-09-15 22:14:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.99% (2.0176 => 2.4210, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (3.9660 => 4.3438, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7061 => 0.7726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 9.02% (0.7038 => 0.7673, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.96% (0.7710 => 0.8401, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.79% (1.3693 => 1.4897, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.64% (0.9199 => 0.9994, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3241, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.57% (0.5265 => 0.5716, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.38% (1.4563 => 1.5783, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 8.24% (13.8202 => 14.9590, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.24% (1.1364 => 1.2300, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.96% (0.5577 => 0.6021, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.71% (0.4062 => 0.4375, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.70% (1.0313 => 1.1107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.65% (0.4379 => 0.4714, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.54% (0.3899 => 0.4193, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.51% (0.2995 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3485 => 0.3740, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.18% (0.5637 => 0.6042, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1849, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 7.10% (0.8310 => 0.8900, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.00% (0.3756 => 0.4019, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3489 => 0.3733, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.97% (0.2914 => 0.3117, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 6.96% (0.2760 => 0.2952, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.93% (7.2180 => 7.7185, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 6.93% (3.8646 => 4.1323, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 6.91% (0.7506 => 0.8025, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.85% (0.4016 => 0.4291, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.84% (0.2966 => 0.3169, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.84% (0.2690 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.84% (3.6692 => 3.9201, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.83% (1.9828 => 2.1183, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.73% (0.3107 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.68% (0.3220 => 0.3435, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3149 => 0.3359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.55% (2.1791 => 2.3218, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 6.54% (0.3868 => 0.4121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 6.47% (1.9270 => 2.0517, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.40% (0.6576 => 0.6997, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.36% (3.1889 => 3.3918, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.30% (1.3245 => 1.4080, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.0594 => 1.1259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 6.24% (0.6744 => 0.7165, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 6.13% (16.6129 => 17.6313, std.dev.: 0.0292) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.05% (1.3813 => 1.4648, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.04% (1.3819 => 1.4653, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.95% (14.8535 => 15.7373, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 5.84% (1.2749 => 1.3494, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 5.84% (0.3578 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.83% (0.3914 => 0.4142, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.82% (0.8698 => 0.9204, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.79% (0.3646 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.77% (0.4003 => 0.4234, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (8.4961 => 8.9831, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.71% (0.3663 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.62% (0.6135 => 0.6480, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 5.58% (0.3940 => 0.4160, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (13.2842 => 14.0200, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.52% (4.3801 => 4.6218, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (4.4433 => 4.6868, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.47% (0.8818 => 0.9300, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.45% (0.4113 => 0.4337, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (1.1333 => 1.1919, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 5.14% (14.5298 => 15.2760, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3245 => 0.3407, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (6.5754 => 6.9031, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.97% (3.2742 => 3.4369, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.74% (4.6629 => 4.8841, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.29% (0.9108 => 0.9499, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.27% (0.4805 => 0.5010, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (1.5188 => 1.5830, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.21% (4.9865 => 5.1964, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6250 => 0.6500, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.86% (3.7467 => 3.8915, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.84% (2.1007 => 2.1814, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (6.2785 => 6.5018, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.91% (0.3511 => 0.3613, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 2.80% (33.2944 => 34.2264, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.82% (16.2614 => 16.5570, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2676, std.dev.: 0.0414) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5459, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.52% (1.9199 => 1.9874, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1010, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5937, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1834, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5857, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.07% (0.4657 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.68% (22.5627 => 21.7332, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2784, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.78% (1.3780 => 1.2984, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9218, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5948, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8990, std.dev.: 0.0298) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2465, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2262, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0604, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2460, std.dev.: 0.0194) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4355, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2628, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 17:15:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 19:15:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916001517.009A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3864?compare_to=3862&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3864, Order: 163986, Start Time: 2012-09-15 23:06:22, End Time: 2012-09-16 00:16:39 To: 3862, Order: 163985, Start Time: 2012-09-15 21:40:26, End Time: 2012-09-15 22:50:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (49 on baseline) Performance Improvements: 2 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 7.86% (3.0176 => 3.2548, std.dev.: 0.0567) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.59% (3.0490 => 3.2500, std.dev.: 0.0558) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.61% (21.2951 => 22.4895, std.dev.: 0.2894) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (2.4733 => 2.5914, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.67% (1.6543 => 1.6820, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -14.17% (25.1041 => 21.5461, std.dev.: 0.9644) MultiSource/Applications/SPASS/SPASS: -2.11% (8.4157 => 8.2382, std.dev.: 0.0580) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.01% (0.9890 => 0.9990, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -0.17% (0.5999 => 0.5989, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: -1.63% (0.1658 => 0.1631, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.96% (0.1568 => 0.1553, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (0.3087 => 0.3075, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.11% (0.2350 => 0.2277, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.16% (0.3160 => 0.3155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2282 => 0.2273, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel: -0.66% (0.0453 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 2.30% (0.0087 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.20% (0.0241 => 0.0214, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.78% (0.0383 => 0.0386, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0298 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.81% (0.0270 => 0.0283, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0321 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0178 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0191 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.97% (0.0254 => 0.0249, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 0.31% (0.0327 => 0.0328, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.91% (0.0011 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1437 => 0.1438, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -0.54% (1.4939 => 1.4859, std.dev.: 0.0212) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.57% (0.1566 => 0.1575, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.10% (0.4234 => 0.4018, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.44% (0.1372 => 0.1366, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.48% (0.0669 => 0.0639, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.81% (0.0210 => 0.0202, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.77% (0.0645 => 0.0582, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.25% (1.1474 => 1.1503, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.81% (0.0576 => 0.0621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0233 => 0.0255, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7815 => 0.7809, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -1.19% (1.6090 => 1.5899, std.dev.: 0.0073) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.85% (0.0117 => 0.0116, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.14% (4.1772 => 3.0852, std.dev.: 0.1090) SingleSource/Benchmarks/Shootout-C++/except: 82766.67% (0.0006 => 0.4972, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 6.39% (2.1763 => 2.3154, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/bigfib: 5.22% (0.5309 => 0.5586, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.66% (0.3582 => 0.3749, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 4.08% (0.6173 => 0.6425, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 3.86% (1.0046 => 1.0434, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 3.26% (15.3105 => 15.8093, std.dev.: 0.1208) MultiSource/Applications/SIBsim4/SIBsim4: 3.20% (1.1653 => 1.2026, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 2.95% (0.6915 => 0.7119, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 2.57% (29.3170 => 30.0697, std.dev.: 0.1094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.7639 => 0.7778, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.47% (3.0225 => 3.0670, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.35% (1.1672 => 1.1830, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 1.18% (4.7455 => 4.8014, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 1.04% (13.3238 => 13.4618, std.dev.: 0.0388) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3746 => 0.4282, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.20% (4.0101 => 4.5797, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.58% (0.0766 => 0.0870, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.84% (0.2694 => 0.2986, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.15% (0.2857 => 0.3147, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.03% (1.0063 => 1.0972, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/lists: 8.48% (7.0025 => 7.5964, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (3.0256 => 3.2500, std.dev.: 0.0558) SingleSource/Benchmarks/McGill/chomp: 6.80% (1.0194 => 1.0887, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8040, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.42% (40.4792 => 42.6738, std.dev.: 0.5054) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.40% (4.2129 => 4.4406, std.dev.: 0.0558) SingleSource/Benchmarks/Misc/fp-convert: 4.25% (15.2242 => 15.8705, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/dt: 4.00% (0.9851 => 1.0245, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.71% (0.8498 => 0.8813, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.5587 => 0.5778, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 3.00% (5.1938 => 5.3496, std.dev.: 0.0300) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.00% (0.5876 => 0.6052, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.19% (2.6656 => 2.7240, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.6459 => 0.6578, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.64% (14.4877 => 14.7254, std.dev.: 0.0280) MultiSource/Applications/siod/siod: 1.57% (3.5520 => 3.6078, std.dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (2.4971 => 2.5323, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 1.16% (2.5166 => 2.5458, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.78% (0.7738 => 0.7523, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -1.39% (0.9425 => 0.9294, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.42% (5.2665 => 4.1384, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: -19.96% (1.7473 => 1.3985, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.27% (1.1647 => 0.9403, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: -12.63% (3.6023 => 3.1473, std.dev.: 0.1602) SingleSource/Benchmarks/Shootout/sieve: -12.06% (8.1594 => 7.1756, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.38% (62.4126 => 56.5606, std.dev.: 0.0835) SingleSource/Benchmarks/BenchmarkGame/recursive: -9.02% (2.4457 => 2.2251, std.dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.24% (3.2007 => 2.9369, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3673, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: -6.89% (3.4230 => 3.1872, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3567, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4062, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -4.56% (0.4296 => 0.4100, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -3.45% (8.5323 => 8.2382, std.dev.: 0.0580) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2308, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.12% (1.7361 => 1.6820, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.07% (1.1683 => 1.1324, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4549, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -2.86% (9.2503 => 8.9862, std.dev.: 0.0278) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.78% (1.2959 => 1.2599, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2882, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.32% (3.7496 => 3.6625, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4213, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.45% (3.8907 => 3.8341, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: -1.45% (92.7467 => 91.4010, std.dev.: 0.3328) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7647, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3248, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.26% (9.3855 => 9.2676, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout-C++/lists: -1.15% (16.5617 => 16.3705, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -1.14% (29.5232 => 29.1864, std.dev.: 0.1020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.10% (0.9980 => 0.9990, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -0.55% (0.6022 => 0.5989, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: -2.10% (0.1666 => 0.1631, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1554 => 0.1553, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.26% (0.3083 => 0.3075, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.89% (0.2394 => 0.2277, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.63% (0.3175 => 0.3155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (0.2302 => 0.2273, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.83% (0.0240 => 0.0214, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 0.92% (0.0325 => 0.0328, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1429 => 0.1438, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.07% (1.5019 => 1.4859, std.dev.: 0.0212) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.93% (0.1501 => 0.1575, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.77% (0.4264 => 0.4018, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.64% (0.1344 => 0.1366, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.0589 => 0.0639, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0232 => 0.0202, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.35% (1.1350 => 1.1503, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.51% (0.0637 => 0.0621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.66% (0.0246 => 0.0255, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.55% (0.7541 => 0.7809, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.49% (1.5363 => 1.5899, std.dev.: 0.0073) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 65.71% (0.0070 => 0.0116, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 17:36:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 19:36:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916003659.1D0312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3865?compare_to=3861&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3865, Order: 163986, Start Time: 2012-09-15 23:18:48, End Time: 2012-09-16 00:38:20 To: 3861, Order: 163984, Start Time: 2012-09-15 21:30:29, End Time: 2012-09-15 22:50:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (733 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.2955 => 1.3159, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.70% (0.5716 => 0.5676, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -0.19% (15.8109 => 15.7815, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: -0.34% (14.6804 => 14.6308, std.dev.: 0.0249) MultiSource/Benchmarks/Bullet/bullet: 0.16% (82.1640 => 82.2929, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: -0.10% (4.3042 => 4.2998, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2175 => 1.2190, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.3666 => 7.3766, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.02% (3.6614 => 3.6621, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6327 => 0.6331, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1429 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.85% (0.0675 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.12% (63.2438 => 82.2929, std.dev.: 0.0065) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14248.19% (0.0720 => 10.3307, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.67% (10.3673 => 15.1017, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: 25.22% (0.1622 => 0.2031, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.09% (2.2022 => 2.4905, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.01% (7.0540 => 7.9719, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2577, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.49% (0.1566 => 0.1746, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.52% (1.7609 => 1.9461, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 9.39% (10.4361 => 11.4157, std.dev.: 0.0175) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1584 => 0.1723, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3473 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3543 => 0.3836, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.24% (0.3543 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.16% (0.3516 => 0.3803, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.12% (0.3561 => 0.3850, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.3282 => 0.3542, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.90% (0.3694 => 0.3986, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.86% (0.3828 => 0.4129, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.3927 => 0.4235, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.67% (0.3886 => 0.4184, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.02% (0.3177 => 0.3400, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.4879 => 0.5218, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 6.83% (0.1655 => 0.1768, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.80% (9.4845 => 10.1293, std.dev.: 0.0135) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7433 => 0.7897, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 6.08% (0.3109 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.84% (0.3307 => 0.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.83% (0.6675 => 0.7064, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.4615 => 0.4883, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.80% (0.7115 => 0.7528, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.70% (0.2700 => 0.2854, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.68% (5.7591 => 6.0861, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.68% (0.2554 => 0.2699, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.67% (0.3423 => 0.3617, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5925 => 0.6260, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.60% (0.5860 => 0.6188, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.58% (0.5105 => 0.5390, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (1.3050 => 1.3772, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.50% (3.3354 => 3.5189, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.47% (4.2646 => 4.4979, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.46% (8.1363 => 8.5808, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: 5.46% (0.6030 => 0.6359, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.40% (1.5415 => 1.6248, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.8172 => 0.8597, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.5569 => 0.5856, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.15% (0.2758 => 0.2900, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.09% (0.7835 => 0.8234, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.07% (5.0018 => 5.2554, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.03% (4.9449 => 5.1936, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.8067 => 0.8471, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.00% (0.9765 => 1.0253, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.72% (1.1642 => 1.2192, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 4.63% (0.4299 => 0.4498, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.53% (0.2603 => 0.2721, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.53% (1.0722 => 1.1208, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.49% (0.3387 => 0.3539, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.44% (0.5020 => 0.5243, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.41% (3.8723 => 4.0431, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.41% (1.1861 => 1.2384, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.40% (1.5603 => 1.6289, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.35% (7.9617 => 8.3077, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 4.19% (2.2969 => 2.3932, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.04% (2.0273 => 2.1092, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 4.03% (21.9371 => 22.8221, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 4.01% (0.8921 => 0.9279, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.6456 => 0.6710, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.84% (0.4636 => 0.4814, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5981 => 0.6210, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6450 => 0.6694, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.73% (1.5859 => 1.6451, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (0.3422 => 0.3549, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.62% (0.4064 => 0.4211, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3865 => 0.3998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4289 => 0.4436, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8501, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.4186 => 1.4657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4203 => 0.4337, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (2.2024 => 2.2688, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.4048 => 0.4169, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.97% (0.4620 => 0.4757, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.85% (2.0665 => 2.1253, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.1840 => 1.2176, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (0.8101 => 0.8246, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.54% (1.2842 => 1.3040, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8965, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.90% (1.1145 => 1.3697, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3829, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (4.2280 => 4.3658, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7571, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7896, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2271, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.63% (5.2763 => 3.2382, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.34% (5.3855 => 3.8590, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.97% (5.3526 => 3.8555, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1756, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.64% (2.9384 => 2.5963, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -8.67% (22.1758 => 20.2522, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2806, std.dev.: 0.1388) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4955, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4194, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9972, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.01% (1.2373 => 1.2124, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0096, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5787, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2317, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 5.28% (14.9895 => 15.7815, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: 3.36% (14.1553 => 14.6308, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (4.1105 => 4.2998, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.34% (1.1048 => 1.2190, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.05% (7.1582 => 7.3766, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.75% (3.4629 => 3.6621, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.6222 => 0.6331, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 17:57:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 19:57:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916005726.3BB492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3866?compare_to=3859&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3866, Order: 163986, Start Time: 2012-09-15 22:14:47, End Time: 2012-09-16 00:58:46 To: 3859, Order: 163974, Start Time: 2012-09-15 19:02:21, End Time: 2012-09-15 21:46:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.52% (0.3488 => 0.3820, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 9.49% (0.3446 => 0.3773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.44% (0.3465 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.41% (0.3442 => 0.3766, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.34% (0.3460 => 0.3783, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.07% (0.3650 => 0.3981, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.3724 => 0.4057, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.90% (1.5932 => 1.7190, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5826 => 0.6195, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (0.4361 => 0.4634, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (1.3152 => 1.3968, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.13% (0.5889 => 0.6250, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (1.6211 => 1.7182, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.85% (0.2566 => 0.2716, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.69% (5.5417 => 5.8570, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7641, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (0.4994 => 0.5274, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (2.7292 => 2.8807, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (0.5000 => 0.5272, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (0.5026 => 0.5297, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.19% (1.0781 => 1.1341, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 5.19% (0.3004 => 0.3160, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.17% (0.6634 => 0.6977, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.00% (4.4195 => 4.6405, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (2.1013 => 2.2027, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 4.83% (4.2109 => 4.4141, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2738 => 0.2869, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.75% (4.6177 => 4.8371, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.2736 => 0.2863, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.62% (23.5202 => 24.6077, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (1.8794 => 1.9653, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.56% (0.2875 => 0.3006, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.55% (0.9909 => 1.0360, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3195 => 0.3338, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.43% (2.1653 => 2.2613, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (0.3890 => 0.4061, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 4.39% (0.2823 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3362 => 0.3507, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.30% (2.0673 => 2.1561, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2750 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.3903 => 0.4070, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.27% (0.4029 => 0.4201, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.19% (1.4269 => 1.4867, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.5900 => 0.6144, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.12% (0.3060 => 0.3186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2803 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3096 => 0.3223, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.4139 => 0.4308, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.07% (0.3124 => 0.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.03% (0.3625 => 0.3771, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (0.4658 => 0.4841, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.3084 => 0.3205, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3317 => 0.3447, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3477 => 0.3612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.86% (0.4146 => 0.4306, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.3726 => 0.3868, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4251 => 0.4413, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3282 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.81% (0.3678 => 0.3818, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (1.9694 => 2.0441, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 3.75% (2.0346 => 2.1108, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.3271 => 0.3393, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.71% (0.3690 => 0.3827, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.5012 => 0.5191, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.50% (0.2969 => 0.3073, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.48% (0.9697 => 1.0034, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.6435 => 0.6658, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (1.9966 => 2.0653, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.40% (0.7875 => 0.8143, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.3845 => 0.3972, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 3.14% (0.4847 => 0.4999, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (0.7426 => 0.7643, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (0.5361 => 0.5505, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.51% (0.5584 => 0.5724, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.23% (11.6398 => 11.8993, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.09% (4.6926 => 4.7908, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6705, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std.dev.: 0.1410) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8901, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6331, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2039, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5085, std.dev.: 0.0271) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4476, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.10% (50.0626 => 50.6113, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5639, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7850, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7977, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.14% (17.2379 => 16.8690, std.dev.: 0.0557) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5684, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9649, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 20:07:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 22:07:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916030749.460552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3867?compare_to=3864&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3867, Order: 163988, Start Time: 2012-09-16 01:58:22, End Time: 2012-09-16 03:09:11 To: 3864, Order: 163986, Start Time: 2012-09-15 23:06:22, End Time: 2012-09-16 00:16:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (49 on baseline) Performance Improvements: 4 (43 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (16.2233 => 17.2224, std.dev.: 0.2812) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.49% (2.2251 => 2.2804, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.28% (43.8409 => 44.8405, std.dev.: 0.2916) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.24% (1.2599 => 1.2881, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.16% (4.1384 => 4.2276, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.06% (1.8472 => 1.8667, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.72% (0.5785 => 0.5570, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.11% (0.4598 => 0.4455, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.71% (0.7829 => 0.7617, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (2.3154 => 2.2911, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.98% (0.9990 => 0.9892, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.07% (0.5989 => 0.6053, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -1.16% (0.1631 => 0.1612, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.45% (0.1553 => 0.1560, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (0.3075 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.75% (0.2277 => 0.2294, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.81% (0.3155 => 0.3098, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.31% (0.2273 => 0.2266, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -0.44% (0.0450 => 0.0448, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-07-VarArgs: -29.21% (0.0089 => 0.0063, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: -67.42% (0.0089 => 0.0029, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.62% (0.0214 => 0.0241, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0191 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0386 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0297 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0283 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.78% (0.0324 => 0.0315, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -45.20% (0.0177 => 0.0097, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: -2.62% (0.0191 => 0.0186, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.91% (0.0328 => 0.0325, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1438 => 0.1434, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -0.79% (1.4859 => 1.4741, std.dev.: 0.0361) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.97% (0.1575 => 0.1481, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.87% (0.4018 => 0.4093, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.54% (0.1366 => 0.1469, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -15.34% (0.0639 => 0.0541, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.96% (0.0202 => 0.0210, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0582 => 0.0581, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1503 => 1.1477, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.66% (0.0621 => 0.0561, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.96% (0.0255 => 0.0148, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7809 => 0.7833, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 1.09% (1.5899 => 1.6073, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.31% (0.0116 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -28.16% (4.1772 => 3.0007, std.dev.: 0.0942) SingleSource/Benchmarks/Shootout-C++/except: 83983.33% (0.0006 => 0.5045, std.dev.: 0.0014) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.05% (0.0745 => 0.0872, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.78% (0.1414 => 0.1524, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 5.28% (2.1763 => 2.2911, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.5309 => 0.5567, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.80% (0.3582 => 0.3754, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.34% (0.6410 => 0.6688, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 3.66% (0.6173 => 0.6399, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 3.42% (15.3105 => 15.8348, std.dev.: 0.0316) MultiSource/Applications/lemon/lemon: 3.30% (1.0046 => 1.0378, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.1653 => 1.2037, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 3.02% (0.6915 => 0.7124, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.5150 => 1.5459, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.7639 => 0.7779, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.80% (29.3170 => 29.8434, std.dev.: 0.1522) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.15% (0.0263 => 0.0387, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.50% (1.6538 => 2.3402, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.25% (4.0101 => 4.5816, std.dev.: 0.0174) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.23% (1.0063 => 1.0992, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6207, std.dev.: 0.0237) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.79% (15.8312 => 17.2224, std.dev.: 0.2812) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.07% (0.2857 => 0.3059, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.65% (40.4792 => 43.1698, std.dev.: 0.2765) SingleSource/Benchmarks/McGill/chomp: 6.56% (1.0194 => 1.0863, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (0.3301 => 0.3515, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8134, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.88% (4.2129 => 4.4185, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8557, std.dev.: 0.0600) SingleSource/Benchmarks/Misc/dt: 4.08% (0.9851 => 1.0253, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 3.19% (1.4184 => 1.4636, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.11% (0.3508 => 0.3617, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.05% (0.8498 => 0.8757, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.82% (2.6656 => 2.7407, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: 2.70% (8.5113 => 8.7415, std.dev.: 0.0525) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 2.31% (0.6308 => 0.6454, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.25% (4.6127 => 4.7167, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 1.94% (5.1938 => 5.2947, std.dev.: 0.0316) MultiSource/Applications/hexxagon/hexxagon: 1.68% (14.4877 => 14.7308, std.dev.: 0.0192) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6083, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4455 => 2.4815, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.5166 => 2.5473, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.07% (0.4596 => 0.4455, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.96% (0.5740 => 0.5570, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.43% (8.2559 => 8.1381, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.14% (0.9029 => 0.8926, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.05% (1.3935 => 1.3789, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.05% (4.2616 => 4.2170, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.49% (0.3497 => 0.2081, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.73% (5.2665 => 4.2276, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.47% (1.1647 => 0.9379, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -19.16% (1.7473 => 1.4126, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std.dev.: 0.1063) SingleSource/Benchmarks/Shootout-C++/moments: -10.68% (0.1114 => 0.0995, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.07% (62.4126 => 56.7492, std.dev.: 0.1240) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.96% (1.4034 => 1.2777, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.28% (3.2007 => 2.9358, std.dev.: 0.0307) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.06% (3.6254 => 3.3695, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -6.89% (3.4230 => 3.1871, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.76% (2.4457 => 2.2804, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/richards_benchmark: -6.39% (1.4441 => 1.3518, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4072, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.25% (0.4140 => 0.3964, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: -3.80% (1.4117 => 1.3581, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.78% (1.7361 => 1.6705, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (9.2503 => 8.9491, std.dev.: 0.0481) MultiSource/Applications/lambda-0_1_3/lambda: -3.09% (7.6833 => 7.4460, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1332, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8294, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -2.79% (3.4286 => 3.3330, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6473, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: -2.67% (9.5474 => 9.2922, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/misr: -2.58% (0.4296 => 0.4185, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4220, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (92.7467 => 91.0696, std.dev.: 0.4703) MultiSource/Benchmarks/FreeBench/neural/neural: -1.78% (1.0926 => 1.0732, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2296, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.52% (3.8907 => 3.8316, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/oourafft: -1.37% (3.8200 => 3.7677, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3147, std.dev.: 0.0919) MultiSource/Benchmarks/llubenchmark/llu: -1.26% (2.0192 => 1.9938, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.88% (0.9980 => 0.9892, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 0.51% (0.6022 => 0.6053, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -3.24% (0.1666 => 0.1612, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1554 => 0.1560, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (0.3083 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.18% (0.2394 => 0.2294, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.43% (0.3175 => 0.3098, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (0.2302 => 0.2266, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-07-VarArgs: -29.21% (0.0089 => 0.0063, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.78% (0.0324 => 0.0315, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -45.20% (0.0177 => 0.0097, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: -1.59% (0.0189 => 0.0186, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1429 => 0.1434, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -1.85% (1.5019 => 1.4741, std.dev.: 0.0361) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.33% (0.1501 => 0.1481, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.01% (0.4264 => 0.4093, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.1344 => 0.1469, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.15% (0.0589 => 0.0541, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.08% (0.0639 => 0.0581, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.12% (1.1350 => 1.1477, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.93% (0.0637 => 0.0561, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.84% (0.0246 => 0.0148, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.87% (0.7541 => 0.7833, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.62% (1.5363 => 1.6073, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 20:12:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 22:12:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916031259.237402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3868?compare_to=3863&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3868, Order: 163988, Start Time: 2012-09-16 01:59:50, End Time: 2012-09-16 03:14:18 To: 3863, Order: 163986, Start Time: 2012-09-15 22:43:02, End Time: 2012-09-15 23:57:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.80% (2.0176 => 2.4171, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.55% (3.9660 => 4.3449, std.dev.: 0.0021) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174) SingleSource/UnitTests/ObjC++/property-reference: 9.40% (0.7061 => 0.7725, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.13% (0.7710 => 0.8414, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 9.08% (0.7038 => 0.7677, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 8.84% (1.3693 => 1.4903, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.76% (0.9199 => 1.0005, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.61% (1.2193 => 1.3243, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.55% (0.5265 => 0.5715, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.45% (1.4563 => 1.5794, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.30% (1.1364 => 1.2307, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 8.15% (13.8202 => 14.9464, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.93% (0.6283 => 0.6781, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.84% (0.5577 => 0.6014, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.60% (1.0313 => 1.1097, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.57% (0.3899 => 0.4194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.56% (0.4062 => 0.4369, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.53% (0.4791 => 0.5152, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.38% (0.4379 => 0.4702, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.21% (1.1061 => 1.1858, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.11% (0.4390 => 0.4702, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 7.09% (0.8310 => 0.8899, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2127 => 0.2277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.04% (0.3580 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3489 => 0.3733, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.91% (7.2180 => 7.7169, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.89% (3.6692 => 3.9221, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: 6.87% (3.8646 => 4.1301, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.9828 => 2.1185, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.80% (0.2690 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.70% (0.2655 => 0.2833, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.70% (0.7506 => 0.8009, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.46% (0.6576 => 0.7001, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.46% (2.1791 => 2.3199, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.45% (3.1889 => 3.3946, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 6.45% (1.0594 => 1.1277, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.36% (0.6744 => 0.7173, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.32% (1.9270 => 2.0488, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.30% (1.3245 => 1.4080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.13% (16.6129 => 17.6309, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.04% (1.3819 => 1.4654, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.89% (14.8535 => 15.7290, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.89% (1.3813 => 1.4627, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.87% (0.8698 => 0.9209, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.82% (1.2749 => 1.3491, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 5.76% (0.3578 => 0.3784, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.75% (0.3914 => 0.4139, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.72% (8.4961 => 8.9822, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/parameter-passing: 5.70% (0.4003 => 0.4231, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.68% (0.3663 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.65% (0.3646 => 0.3852, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.65% (0.3789 => 0.4003, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.64% (0.3601 => 0.3804, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.6135 => 0.6478, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.59% (0.8818 => 0.9311, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.56% (0.3940 => 0.4159, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 5.55% (0.3623 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.2842 => 14.0162, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.42% (4.3801 => 4.6174, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.40% (4.4433 => 4.6833, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 5.35% (0.2859 => 0.3012, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.12% (14.5298 => 15.2733, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.10% (1.1333 => 1.1911, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.94% (6.5754 => 6.9001, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.86% (3.2742 => 3.4333, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 4.79% (4.6629 => 4.8863, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4805 => 0.5016, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.31% (0.9108 => 0.9501, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (1.5188 => 1.5841, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.30% (1.2292 => 1.2820, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.17% (4.9865 => 5.1943, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.88% (3.7467 => 3.8922, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.6250 => 0.6492, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.80% (2.1007 => 2.1806, std.dev.: 0.0182) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4992, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 2.75% (33.2944 => 34.2095, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5552, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5114, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5471, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0886, std.dev.: 0.0558) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5935, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0512, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.09% (0.4657 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.69% (22.5627 => 21.7296, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2601, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2926, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5122, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1506, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9241, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9182, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5714, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4832, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8978, std.dev.: 0.0374) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2423, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0604, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4341, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2612, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 20:18:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 22:18:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916031815.26FCF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3869?compare_to=3865&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3869, Order: 163988, Start Time: 2012-09-16 01:59:52, End Time: 2012-09-16 03:19:36 To: 3865, Order: 163986, Start Time: 2012-09-15 23:18:48, End Time: 2012-09-16 00:38:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (117 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (731 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.24% (54.7732 => 56.5476, std.dev.: 0.0538) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (78.6028 => 80.3409, std.dev.: 0.3966) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.2124 => 1.2277, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5676 => 0.5668, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.06% (15.7815 => 15.7914, std.dev.: 0.0224) MultiSource/Applications/kimwitu++/kc: 0.19% (14.6308 => 14.6589, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 0.00% (82.2929 => 82.2943, std.dev.: 0.0309) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.2998 => 4.2936, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2190 => 1.2185, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.3766 => 7.3722, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.12% (3.6621 => 3.6665, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6331 => 0.6335, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.12% (63.2438 => 82.2943, std.dev.: 0.0309) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14242.64% (0.0720 => 10.3267, std.dev.: 0.0054) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.72% (10.3673 => 15.1069, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 25.28% (0.1622 => 0.2032, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.08% (2.2022 => 2.4903, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.06% (7.0540 => 7.9755, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 12.78% (0.1432 => 0.1615, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.47% (1.1194 => 1.2590, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.57% (1.7609 => 1.9471, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 9.39% (10.4361 => 11.4157, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3473 => 0.3766, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.33% (0.3516 => 0.3809, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3543 => 0.3837, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.20% (0.3561 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.19% (0.3543 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.01% (0.3694 => 0.3990, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.98% (0.3282 => 0.3544, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3828 => 0.4133, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3927 => 0.4236, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.08% (0.3177 => 0.3402, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.93% (9.4845 => 10.1418, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.7433 => 0.7903, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.21% (0.7115 => 0.7557, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (0.4615 => 0.4893, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.6675 => 0.7073, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.93% (0.2700 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.83% (0.2554 => 0.2703, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.78% (0.5105 => 0.5400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.77% (0.5860 => 0.6198, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.3050 => 1.3798, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 5.70% (5.7591 => 6.0875, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (4.2646 => 4.5059, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2271 => 0.2399, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (1.5415 => 1.6274, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.57% (0.8172 => 0.8627, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 5.56% (0.6030 => 0.6365, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.55% (3.3354 => 3.5205, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (8.1363 => 8.5834, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.39% (0.5569 => 0.5869, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.32% (0.2107 => 0.2219, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7326 => 0.7712, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.19% (5.0018 => 5.2616, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.8067 => 0.8484, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.11% (4.9449 => 5.1976, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.04% (0.2758 => 0.2897, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.9765 => 1.0255, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.98% (0.3092 => 0.3246, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.95% (0.7835 => 0.8223, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.79% (1.1642 => 1.2200, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.70% (0.4299 => 0.4501, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.64% (1.0722 => 1.1220, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.55% (0.3387 => 0.3541, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 4.51% (1.5603 => 1.6307, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.48% (3.8723 => 4.0456, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.41% (1.1861 => 1.2384, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (7.9617 => 8.3126, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.5020 => 0.5241, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 4.20% (2.2969 => 2.3933, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3422 => 0.3562, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 4.09% (21.9371 => 22.8333, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 4.05% (0.8921 => 0.9282, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.03% (2.0273 => 2.1090, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.6456 => 0.6715, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6450 => 0.6707, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5981 => 0.6214, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3826 => 0.3974, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4636 => 0.4812, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (1.5859 => 1.6457, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.47% (0.3865 => 0.3999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4289 => 0.4435, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.38% (1.4186 => 1.4666, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8495, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4203 => 0.4342, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2732, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.18% (0.4620 => 0.4767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0665 => 2.1271, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.1840 => 1.2180, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.8101 => 0.8258, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.59% (1.2842 => 1.3046, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.01% (17.1811 => 17.3541, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (3.1578 => 3.3797, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.02% (4.2280 => 4.3557, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2254, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5851, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.62% (5.2763 => 3.2387, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.36% (5.3855 => 3.8583, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.95% (5.3526 => 3.8566, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1507, std.dev.: 0.0324) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.66% (2.9384 => 2.5957, std.dev.: 0.0236) MultiSource/Applications/ClamAV/clamscan: -8.56% (22.1758 => 20.2768, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2719, std.dev.: 0.0831) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7166, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.73% (1.6805 => 1.5842, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4095, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -2.84% (10.2830 => 9.9911, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0142, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.40% (0.5229 => 0.5668, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.35% (14.9895 => 15.7914, std.dev.: 0.0224) MultiSource/Applications/kimwitu++/kc: 3.56% (14.1553 => 14.6589, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (4.1105 => 4.2936, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.29% (1.1048 => 1.2185, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.99% (7.1582 => 7.3722, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.88% (3.4629 => 3.6665, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6222 => 0.6335, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 21:37:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 23:37:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916043747.5BBFA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3870?compare_to=3867&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3870, Order: 163992, Start Time: 2012-09-16 03:27:30, End Time: 2012-09-16 04:38:07 To: 3867, Order: 163988, Start Time: 2012-09-16 01:58:22, End Time: 2012-09-16 03:09:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (51 on baseline) Performance Improvements: 0 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 897 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.82% (0.2971 => 0.3144, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.05% (3.0007 => 3.0921, std.dev.: 0.0258) MultiSource/Applications/minisat/minisat: 1.54% (6.2139 => 6.3099, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.08% (2.8243 => 2.8548, std.dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.63% (0.9892 => 0.9954, std.dev.: 0.0160) MultiSource/Applications/sqlite3/sqlite3: -1.17% (0.6053 => 0.5982, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: -1.67% (0.1612 => 0.1585, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.77% (0.1560 => 0.1548, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.45% (0.3081 => 0.3095, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.32% (0.2294 => 0.2393, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.68% (0.3098 => 0.3181, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.90% (0.2266 => 0.2309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -1.12% (0.0448 => 0.0443, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 36.51% (0.0063 => 0.0086, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: 210.34% (0.0029 => 0.0090, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0241 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0386 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.69% (0.0299 => 0.0279, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0282 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.59% (0.0315 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 77.32% (0.0097 => 0.0172, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -41.94% (0.0186 => 0.0108, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -0.81% (0.0247 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1434 => 0.1432, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.65% (1.4741 => 1.5132, std.dev.: 0.0197) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.35% (0.1481 => 0.1501, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.12% (0.4093 => 0.4047, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.50% (0.1469 => 0.1447, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.45% (0.0541 => 0.0630, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.90% (0.0210 => 0.0185, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.36% (0.0581 => 0.0647, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1477 => 1.1490, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.42% (0.0561 => 0.0597, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.24% (0.0148 => 0.0212, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7833 => 0.7805, std.dev.: 0.0261) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0002 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.05% (1.6073 => 1.6081, std.dev.: 0.0217) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.98% (4.1772 => 3.0921, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/except: 83100.00% (0.0006 => 0.4992, std.dev.: 0.0052) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -20.00% (0.0005 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.20% (0.5309 => 0.5638, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 5.56% (2.1763 => 2.2972, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.07% (0.6410 => 0.6735, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.63% (0.3582 => 0.3748, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.37% (0.6173 => 0.6443, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 3.54% (1.0046 => 1.0402, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 3.24% (0.6915 => 0.7139, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 2.84% (1.1653 => 1.1984, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.72% (29.3170 => 30.1138, std.dev.: 0.2406) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.7639 => 0.7840, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5150 => 1.5504, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.2021 => 1.2206, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 1.45% (3.0225 => 3.0664, std.dev.: 0.0155) MultiSource/Applications/siod/siod: 1.42% (2.0972 => 2.1269, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (12.6413 => 12.8188, std.dev.: 0.0357) MultiSource/Applications/Burg/burg: 1.39% (1.1440 => 1.1599, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.23% (3.4629 => 4.2328, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/ary3: 14.91% (1.7426 => 2.0024, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.43% (4.0101 => 4.5486, std.dev.: 0.0124) SingleSource/Benchmarks/Stanford/Puzzle: 12.63% (0.1433 => 0.1614, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 11.96% (0.3746 => 0.4194, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6275, std.dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.40% (1.0063 => 1.0908, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (3.0256 => 3.2384, std.dev.: 0.0548) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.69% (0.2857 => 0.3048, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (4.2129 => 4.4914, std.dev.: 0.0391) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8089, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3301 => 0.3492, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/dt: 4.17% (0.9851 => 1.0262, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8281, std.dev.: 0.0306) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.6308 => 0.6505, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.85% (0.3508 => 0.3608, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 2.76% (5.1938 => 5.3372, std.dev.: 0.0379) SingleSource/Benchmarks/Misc/ReedSolomon: 2.60% (8.5113 => 8.7323, std.dev.: 0.0522) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.36% (4.6127 => 4.7215, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 2.33% (6.9722 => 7.1345, std.dev.: 0.0583) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.07% (2.6656 => 2.7209, std.dev.: 0.0124) MultiSource/Applications/siod/siod: 1.73% (3.5520 => 3.6135, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: 1.67% (14.4877 => 14.7299, std.dev.: 0.0175) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5352, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.37% (6.2244 => 6.3099, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4455 => 2.4781, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: 1.14% (4.3016 => 4.3505, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.24% (0.7738 => 0.7565, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -20.03% (1.7473 => 1.3973, std.dev.: 0.0748) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.60% (5.2665 => 4.2344, std.dev.: 0.0255) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.43% (1.1647 => 0.9384, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: -12.17% (8.1594 => 7.1667, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -9.23% (62.4126 => 56.6516, std.dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2877, std.dev.: 0.0286) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.58% (3.2007 => 2.9582, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.34% (2.4457 => 2.2662, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.18% (3.6254 => 3.3651, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -6.54% (1.4441 => 1.3496, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: -6.52% (3.4230 => 3.1998, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: -6.01% (1.4117 => 1.3269, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4104, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.92% (1.7361 => 1.6681, std.dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -3.34% (7.6833 => 7.4264, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/methcall: -3.20% (9.2503 => 8.9545, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2906, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.50% (45.4683 => 44.3309, std.dev.: 0.4395) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.43% (1.1683 => 1.1399, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -2.40% (3.4286 => 3.3462, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.37% (3.7496 => 3.6609, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2322, std.dev.: 0.0338) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.46% (3.8200 => 3.7641, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.44% (2.8964 => 2.8548, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3328, std.dev.: 0.0795) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.24% (1.8739 => 1.8506, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.26% (0.9980 => 0.9954, std.dev.: 0.0160) MultiSource/Applications/sqlite3/sqlite3: -0.66% (0.6022 => 0.5982, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: -4.86% (0.1666 => 0.1585, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.39% (0.1554 => 0.1548, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.39% (0.3083 => 0.3095, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2394 => 0.2393, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.19% (0.3175 => 0.3181, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.30% (0.2302 => 0.2309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -1.34% (0.0449 => 0.0443, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.31% (0.0301 => 0.0279, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0177 => 0.0172, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -42.86% (0.0189 => 0.0108, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 0.75% (1.5019 => 1.5132, std.dev.: 0.0197) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1501 => 0.1501, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.09% (0.4264 => 0.4047, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.66% (0.1344 => 0.1447, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.96% (0.0589 => 0.0630, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.26% (0.0232 => 0.0185, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.23% (1.1350 => 1.1490, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.28% (0.0637 => 0.0597, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.82% (0.0246 => 0.0212, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.50% (0.7541 => 0.7805, std.dev.: 0.0261) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.67% (1.5363 => 1.6081, std.dev.: 0.0217) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 21:42:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 23:42:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916044238.28E3F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3871?compare_to=3866&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3871, Order: 163988, Start Time: 2012-09-16 01:59:59, End Time: 2012-09-16 04:43:59 To: 3866, Order: 163986, Start Time: 2012-09-15 22:14:47, End Time: 2012-09-16 00:58:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.37% (54.0969 => 54.8392, std.dev.: 0.0691) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3496 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3465 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.40% (0.3488 => 0.3816, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3460 => 0.3785, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.38% (0.3442 => 0.3765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.15% (0.3650 => 0.3984, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.00% (0.3643 => 0.3971, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.83% (0.3724 => 0.4053, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.60% (1.5932 => 1.7143, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.1619 => 0.1728, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5826 => 0.6195, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.21% (0.5889 => 0.6255, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (0.4361 => 0.4630, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (1.6211 => 1.7170, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.90% (1.3152 => 1.3928, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7649, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.58% (0.5000 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (2.7292 => 2.8813, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.52% (5.5417 => 5.8476, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 5.49% (0.7171 => 0.7565, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (0.5026 => 0.5301, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.30% (1.0781 => 1.1352, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.2075 => 0.2182, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.5900 => 0.6201, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.07% (4.4195 => 4.6436, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 4.89% (4.2109 => 4.4168, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 4.84% (2.1013 => 2.2029, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 4.83% (0.2566 => 0.2690, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.70% (4.6177 => 4.8347, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (0.3890 => 0.4071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.2866 => 0.2998, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3195 => 0.3342, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 4.57% (23.5202 => 24.5950, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.52% (0.2875 => 0.3005, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (1.8794 => 1.9634, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 4.46% (0.6634 => 0.6930, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 4.45% (0.9909 => 1.0350, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.39% (0.2823 => 0.2947, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.37% (2.1653 => 2.2600, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 4.36% (0.2750 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.3903 => 0.4073, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.4139 => 0.4318, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2780 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.30% (0.2813 => 0.2934, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.28% (0.3060 => 0.3191, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.28% (1.4269 => 1.4879, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.27% (2.0673 => 2.1556, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2792 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.19% (0.4029 => 0.4198, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3124 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.19% (0.2911 => 0.3033, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2803 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3267 => 0.3401, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (0.3625 => 0.3770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.97% (0.3096 => 0.3219, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.96% (0.3336 => 0.3468, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3317 => 0.3448, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.95% (0.3726 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (0.4658 => 0.4841, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.93% (0.3845 => 0.3996, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.3084 => 0.3205, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.91% (0.3348 => 0.3479, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.89% (0.3678 => 0.3821, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3477 => 0.3610, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.81% (0.4146 => 0.4304, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4251 => 0.4413, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.3271 => 0.3395, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (1.9694 => 2.0433, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3282 => 0.3405, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.69% (2.0346 => 2.1096, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.66% (0.3690 => 0.3825, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (1.9966 => 2.0667, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.49% (0.5012 => 0.5187, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.35% (0.9697 => 1.0022, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 3.28% (0.4847 => 0.5006, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (0.7426 => 0.7648, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.87% (0.5361 => 0.5515, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (0.5584 => 0.5723, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (11.6398 => 11.8976, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.10% (4.6926 => 4.7910, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6725, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std.dev.: 0.1438) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8886, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6316, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1994, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5033, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4476, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5814, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4433, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5710, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8096, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7950, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7922, std.dev.: 0.0817) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5801, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.43% (16.2163 => 15.9852, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 21:56:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Sep 2012 23:56:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916045602.A687B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3872?compare_to=3868&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3872, Order: 163992, Start Time: 2012-09-16 03:42:53, End Time: 2012-09-16 04:57:24 To: 3868, Order: 163988, Start Time: 2012-09-16 01:59:50, End Time: 2012-09-16 03:14:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.11% (2.4171 => 2.3903, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.47% (2.0176 => 2.3903, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.79% (0.7710 => 0.8465, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 9.45% (0.7061 => 0.7728, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (3.9660 => 4.3315, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.7038 => 0.7663, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.79% (1.3693 => 1.4897, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.57% (0.5265 => 0.5716, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.51% (0.9199 => 0.9982, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.41% (1.2193 => 1.3218, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.38% (0.6959 => 0.7542, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.4563 => 1.5758, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.01% (1.1364 => 1.2274, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 7.91% (13.8202 => 14.9132, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.3899 => 0.4205, std.dev.: 0.0079) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.62% (0.5577 => 0.6002, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.51% (0.2023 => 0.2175, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6283 => 0.6753, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.35% (0.3756 => 0.4032, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.24% (0.4390 => 0.4708, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.21% (1.0313 => 1.1057, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.21% (0.2995 => 0.3211, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.21% (1.1061 => 1.1858, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.10% (1.9828 => 2.1235, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.97% (0.2914 => 0.3117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5637 => 0.6028, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.82% (7.2180 => 7.7106, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8310 => 0.8874, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 6.76% (3.8646 => 4.1258, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 6.73% (0.3107 => 0.3316, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.62% (0.7506 => 0.8003, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.60% (3.6692 => 3.9114, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.50% (0.2925 => 0.3115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2243 => 0.2386, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.31% (2.1791 => 2.3167, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.19% (0.6576 => 0.6983, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.18% (3.1889 => 3.3859, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 6.09% (0.6744 => 0.7155, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.06% (1.3245 => 1.4047, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 6.00% (1.0594 => 1.1230, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.99% (16.6129 => 17.6088, std.dev.: 0.0161) MultiSource/Applications/treecc/treecc: 5.98% (1.9270 => 2.0423, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.92% (0.4003 => 0.4240, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3914 => 0.4143, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.84% (0.3646 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3601 => 0.3811, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.78% (0.3650 => 0.3861, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.76% (0.4113 => 0.4350, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 5.75% (0.3789 => 0.4007, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 5.63% (14.8535 => 15.6899, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.61% (0.3940 => 0.4161, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.60% (1.2749 => 1.3463, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4592, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.54% (1.3813 => 1.4578, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.53% (8.4961 => 8.9657, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.48% (4.3801 => 4.6203, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6135 => 0.6464, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (4.4433 => 4.6777, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.26% (0.8818 => 0.9282, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (13.2842 => 13.9746, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: 5.11% (0.3131 => 0.3291, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (1.1333 => 1.1890, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8885, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 4.78% (14.5298 => 15.2250, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2321 => 0.2431, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (6.5754 => 6.8864, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.52% (3.2742 => 3.4221, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2292 => 1.2829, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (4.9865 => 5.1888, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (1.5188 => 1.5761, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.71% (3.7467 => 3.8856, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (6.2785 => 6.4965, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (2.1007 => 2.1711, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2498, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5090, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std.dev.: 0.0474) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4161, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (0.2093 => 0.2242, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1066, std.dev.: 0.0483) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5991, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5943, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.01% (0.4657 => 0.3865, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.96% (22.5627 => 21.6701, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2615, std.dev.: 0.0374) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.82% (0.4867 => 0.4681, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.48% (3.0263 => 2.9210, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5999, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.27% (26.5159 => 25.9145, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2362, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2414, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8720, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2294, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (4.1080 => 4.0638, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4341, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -1.01% (1.2308 => 1.2184, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 15 22:06:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 00:06:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916050603.0A7A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3873?compare_to=3869&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3873, Order: 163992, Start Time: 2012-09-16 03:48:00, End Time: 2012-09-16 05:07:24 To: 3869, Order: 163988, Start Time: 2012-09-16 01:59:52, End Time: 2012-09-16 03:19:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.12% (0.5668 => 0.5675, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.06% (15.7914 => 15.7824, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: -0.10% (14.6589 => 14.6440, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -0.67% (82.2943 => 81.7461, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.2936 => 4.2986, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.2185 => 1.2160, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (7.3722 => 7.3614, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.46% (3.6665 => 3.6495, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.19% (0.6335 => 0.6347, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.26% (63.2438 => 81.7461, std.dev.: 0.0183) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14241.53% (0.0720 => 10.3259, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.90% (10.3673 => 15.1263, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 25.22% (0.1622 => 0.2031, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.13% (2.2022 => 2.4913, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.79% (7.0540 => 7.9561, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.11% (1.1194 => 1.2550, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.73% (1.7609 => 1.9498, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 9.46% (10.4361 => 11.4232, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.86% (0.3543 => 0.3857, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3473 => 0.3773, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3497 => 0.3791, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.38% (0.3282 => 0.3557, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.24% (0.3543 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3561 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.13% (0.3516 => 0.3802, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.93% (0.3694 => 0.3987, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.92% (0.3828 => 0.4131, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3927 => 0.4236, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.57% (0.3886 => 0.4180, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.02% (0.3177 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.85% (9.4845 => 10.1338, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.4879 => 0.5203, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.13% (0.7433 => 0.7889, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.4615 => 0.4897, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.00% (0.2700 => 0.2862, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.96% (0.3307 => 0.3504, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.83% (0.2554 => 0.2703, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.80% (0.7115 => 0.7528, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.77% (0.6675 => 0.7060, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.72% (0.5860 => 0.6195, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.57% (4.2646 => 4.5021, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 5.55% (0.3423 => 0.3613, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (8.1363 => 8.5847, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (1.3050 => 1.3765, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.37% (5.7591 => 6.0684, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2107 => 0.2220, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 5.35% (0.5925 => 0.6242, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.31% (3.3354 => 3.5125, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 5.27% (0.6030 => 0.6348, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.3121 => 0.3285, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.15% (1.5415 => 1.6209, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (0.8172 => 0.8592, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.0018 => 5.2570, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (4.9449 => 5.1953, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.06% (0.8067 => 0.8475, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.04% (0.2758 => 0.2897, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.92% (0.3092 => 0.3244, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.90% (0.9765 => 1.0243, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.89% (0.7835 => 0.8218, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 4.72% (0.4299 => 0.4502, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.68% (1.1642 => 1.2187, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.56% (7.9617 => 8.3246, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.50% (0.3180 => 0.3323, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.48% (1.5603 => 1.6302, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 4.46% (1.0722 => 1.1200, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.40% (0.3387 => 0.3536, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.36% (0.5020 => 0.5239, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.36% (1.1861 => 1.2378, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 4.33% (3.8723 => 4.0398, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3422 => 0.3566, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.16% (21.9371 => 22.8500, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6456 => 0.6719, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4636 => 0.4821, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.96% (0.4064 => 0.4225, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.4103 => 0.4265, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.92% (0.6450 => 0.6703, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.86% (0.3650 => 0.3791, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.86% (2.0273 => 2.1055, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8921 => 0.9264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.77% (2.2969 => 2.3835, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5981 => 0.6203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4289 => 0.4442, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.48% (0.3826 => 0.3959, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (1.5859 => 1.6401, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.38% (0.4203 => 0.4345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.34% (0.3232 => 0.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.32% (0.3098 => 0.3201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.4048 => 0.4179, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.4186 => 1.4645, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (2.0665 => 2.1330, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8057, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary2: 3.05% (0.3379 => 0.3482, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.3684 => 0.3795, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (2.2024 => 2.2668, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.1840 => 1.2153, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.8101 => 0.8263, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.75% (1.2842 => 1.3067, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3833, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2142, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3633, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7526, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7886, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2203, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5801, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.65% (5.2763 => 3.2370, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.49% (5.3855 => 3.8512, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.12% (5.3526 => 3.8475, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0897, std.dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.14% (2.9384 => 2.5816, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: -8.84% (22.1758 => 20.2153, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.65% (19.9488 => 18.2239, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.43% (1.8329 => 1.7150, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5833, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1507, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5074, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4302, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0045, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -2.45% (1.2373 => 1.2070, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0075, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5768, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2184, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.53% (0.5229 => 0.5675, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 5.29% (14.9895 => 15.7824, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 3.45% (14.1553 => 14.6440, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (4.1105 => 4.2986, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.07% (1.1048 => 1.2160, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (7.1582 => 7.3614, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.39% (3.4629 => 3.6495, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.6222 => 0.6347, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 00:30:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 02:30:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916073024.53FA02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3874?compare_to=3870&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3874, Order: 163993, Start Time: 2012-09-16 06:21:19, End Time: 2012-09-16 07:31:46 To: 3870, Order: 163992, Start Time: 2012-09-16 03:27:30, End Time: 2012-09-16 04:38:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 12 (54 on baseline) Performance Improvements: 2 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 5.27% (0.2902 => 0.3055, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.12% (0.5579 => 0.5809, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.18% (0.7662 => 0.7906, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.38% (0.5578 => 0.5711, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.11% (0.7220 => 0.7372, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.30% (4.2255 => 4.2804, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.1889 => 1.2040, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.02% (15.6764 => 17.5608, std.dev.: 0.2331) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.32% (1.3068 => 1.3633, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/ffbench: 2.77% (1.3269 => 1.3636, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 2.20% (2.3456 => 2.3972, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 1.91% (1.3496 => 1.3754, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.08% (9.3496 => 9.1553, std.dev.: 0.0538) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.89% (7.1345 => 6.9999, std.dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.02% (0.9954 => 0.9956, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 0.43% (0.5982 => 0.6008, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.1585 => 0.1678, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1548 => 0.1548, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.74% (0.3095 => 0.3041, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.21% (0.2393 => 0.2388, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.85% (0.3181 => 0.3154, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2309 => 0.2314, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -7.67% (0.0443 => 0.0409, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0086 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -8.89% (0.0090 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.84% (0.0239 => 0.0237, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.74% (0.0190 => 0.0181, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0386 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.23% (0.0279 => 0.0288, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.71% (0.0282 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0320 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.91% (0.0172 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 75.93% (0.0108 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.22% (0.0245 => 0.0242, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -23.46% (0.0324 => 0.0248, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1432 => 0.1433, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -2.72% (1.5132 => 1.4721, std.dev.: 0.0402) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.87% (0.1501 => 0.1514, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.30% (0.4047 => 0.4035, std.dev.: 0.0585) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.97% (0.1447 => 0.1433, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.89% (0.0630 => 0.0574, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.70% (0.0185 => 0.0227, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.50% (0.0647 => 0.0592, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1490 => 1.1484, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -91.67% (0.0012 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.85% (0.0597 => 0.0574, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.02% (0.0212 => 0.0142, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7805 => 0.7816, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.14% (1.6081 => 1.6104, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.12% (4.1772 => 3.0861, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/except: 82083.33% (0.0006 => 0.4931, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.5309 => 0.5649, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 5.70% (2.1763 => 2.3003, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.37% (0.2552 => 0.2689, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.32% (0.6410 => 0.6751, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 4.03% (15.3105 => 15.9271, std.dev.: 0.0629) MultiSource/Applications/minisat/minisat: 3.94% (0.6173 => 0.6416, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 3.78% (1.0046 => 1.0426, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3.68% (1.1653 => 1.2082, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.7639 => 0.7838, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5150 => 1.5528, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 2.36% (29.3170 => 30.0088, std.dev.: 0.1112) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.02% (0.7226 => 0.7372, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.80% (1.1827 => 1.2040, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: 1.75% (8.9977 => 9.1553, std.dev.: 0.0538) MultiSource/Applications/d/make_dparser: 1.71% (3.0225 => 3.0741, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 1.54% (2.0972 => 2.1294, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 1.38% (13.3238 => 13.5077, std.dev.: 0.0682) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (0.8569 => 0.8679, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.15% (12.6413 => 12.7863, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (1.3935 => 1.4087, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0328) SingleSource/Benchmarks/Shootout/ary3: 15.06% (1.7426 => 2.0051, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3746 => 0.4282, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (4.0101 => 4.5398, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.93% (15.8312 => 17.5608, std.dev.: 0.2331) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.95% (0.2694 => 0.2935, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6217, std.dev.: 0.0410) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.26% (1.0063 => 1.0894, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.95% (0.2857 => 0.3084, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8058, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 4.48% (15.2242 => 15.9070, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.73% (3.4080 => 3.5351, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.71% (0.8498 => 0.8813, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.03% (0.5876 => 0.6054, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 2.77% (8.5113 => 8.7467, std.dev.: 0.0401) SingleSource/Benchmarks/Misc/whetstone: 2.21% (2.3453 => 2.3972, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/five11/five11: 2.19% (5.1938 => 5.3075, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/hash: 2.11% (0.6308 => 0.6441, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 1.76% (3.5520 => 3.6144, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4843, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 1.57% (14.4877 => 14.7146, std.dev.: 0.0302) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (2.4971 => 2.5301, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.24% (2.5166 => 2.5478, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.23% (5.2665 => 4.0959, std.dev.: 0.0859) SingleSource/Benchmarks/Shootout-C++/ary3: -20.37% (1.7473 => 1.3913, std.dev.: 0.0259) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.82% (1.1647 => 0.9338, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5326, std.dev.: 0.0611) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.45% (3.2007 => 2.9304, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.99% (2.4457 => 2.2504, std.dev.: 0.0373) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3657, std.dev.: 0.0227) MultiSource/Applications/SIBsim4/SIBsim4: -6.87% (3.4230 => 3.1878, std.dev.: 0.0229) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -4.76% (1.4441 => 1.3754, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.58% (61.1734 => 58.9813, std.dev.: 0.4932) SingleSource/Benchmarks/Misc/ffbench: -3.41% (1.4117 => 1.3636, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.34% (1.7361 => 1.6782, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.20% (1.1683 => 1.1309, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (7.6833 => 7.4453, std.dev.: 0.0301) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.05% (1.2722 => 1.2334, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/methcall: -2.84% (9.2503 => 8.9875, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8295, std.dev.: 0.0305) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.77% (1.4021 => 1.3633, std.dev.: 0.0146) MultiSource/Applications/aha/aha: -2.70% (3.4286 => 3.3359, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2894, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/misr: -2.68% (0.4296 => 0.4181, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.60% (3.7496 => 3.6521, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.08% (2.8964 => 2.8361, std.dev.: 0.0205) MultiSource/Benchmarks/sim/sim: -1.87% (3.8907 => 3.8178, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/neural/neural: -1.87% (1.0926 => 1.0722, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4225, std.dev.: 0.0245) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2247, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -1.60% (92.7467 => 91.2585, std.dev.: 0.0701) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.54% (1.8739 => 1.8451, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3083, std.dev.: 0.0370) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.24% (0.9980 => 0.9956, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -0.23% (0.6022 => 0.6008, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 0.72% (0.1666 => 0.1678, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.39% (0.1554 => 0.1548, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.36% (0.3083 => 0.3041, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.2394 => 0.2388, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.66% (0.3175 => 0.3154, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.52% (0.2302 => 0.2314, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -8.91% (0.0449 => 0.0409, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -8.89% (0.0090 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.73% (0.0192 => 0.0181, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.32% (0.0301 => 0.0288, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.81% (0.0249 => 0.0242, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -23.69% (0.0325 => 0.0248, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1429 => 0.1433, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.98% (1.5019 => 1.4721, std.dev.: 0.0402) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.87% (0.1501 => 0.1514, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.37% (0.4264 => 0.4035, std.dev.: 0.0585) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.62% (0.1344 => 0.1433, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.0589 => 0.0574, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.16% (0.0232 => 0.0227, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.36% (0.0639 => 0.0592, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.18% (1.1350 => 1.1484, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.0637 => 0.0574, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.28% (0.0246 => 0.0142, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.65% (0.7541 => 0.7816, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.82% (1.5363 => 1.6104, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 00:48:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 02:48:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916074858.320702A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3875?compare_to=3872&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3875, Order: 163993, Start Time: 2012-09-16 06:33:54, End Time: 2012-09-16 07:50:19 To: 3872, Order: 163992, Start Time: 2012-09-16 03:42:53, End Time: 2012-09-16 04:57:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.93% (54.4804 => 56.6227, std.dev.: 0.7058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.56% (2.0176 => 2.3920, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.50% (3.9660 => 4.3426, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.38% (0.7710 => 0.8433, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 9.29% (0.7061 => 0.7717, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5748 => 0.6271, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 9.07% (1.3693 => 1.4935, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 8.83% (0.4328 => 0.4710, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.75% (0.2721 => 0.2959, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.66% (0.5265 => 0.5721, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.64% (0.9199 => 0.9994, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.62% (1.2193 => 1.3244, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.51% (0.6959 => 0.7551, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.23% (0.3899 => 0.4220, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.07% (1.1364 => 1.2281, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 7.88% (13.8202 => 14.9096, std.dev.: 0.0091) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.83% (1.4563 => 1.5704, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.67% (0.5577 => 0.6005, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2760 => 0.2968, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.42% (0.5637 => 0.6055, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.41% (1.1061 => 1.1881, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 7.34% (1.0313 => 1.1070, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.4390 => 0.4712, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.30% (0.3246 => 0.3483, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.22% (0.2937 => 0.3149, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.11% (1.9828 => 2.1238, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 7.08% (0.2995 => 0.3207, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.98% (0.7506 => 0.8030, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.97% (0.2726 => 0.2916, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.86% (7.2180 => 7.7134, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 6.80% (3.8646 => 4.1274, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 6.76% (0.8310 => 0.8872, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.63% (3.6692 => 3.9124, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.61% (0.7460 => 0.7953, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 6.43% (2.1791 => 2.3192, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.31% (0.6576 => 0.6991, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.17% (16.6129 => 17.6372, std.dev.: 0.0301) MultiSource/Applications/minisat/minisat: 6.12% (0.6744 => 0.7157, std.dev.: 0.0068) MultiSource/Applications/d/make_dparser: 6.11% (3.1889 => 3.3839, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.10% (1.3245 => 1.4053, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.02% (1.9270 => 2.0430, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.95% (0.3646 => 0.3863, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 5.92% (0.4003 => 0.4240, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.92% (1.0594 => 1.1221, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 5.89% (0.3789 => 0.4012, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.4113 => 0.4355, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.87% (1.2749 => 1.3497, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.83% (0.3914 => 0.4142, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3650 => 0.3858, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (1.3819 => 1.4603, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.67% (14.8535 => 15.6955, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 5.66% (0.3940 => 0.4163, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6135 => 0.6481, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.57% (8.4961 => 8.9693, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.55% (1.3813 => 1.4579, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 5.35% (0.2859 => 0.3012, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.35% (4.3801 => 4.6145, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.34% (4.4433 => 4.6806, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.25% (0.8818 => 0.9281, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 5.24% (0.3131 => 0.3295, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (13.2842 => 13.9728, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.94% (4.6629 => 4.8934, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (1.1333 => 1.1893, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 4.88% (14.5298 => 15.2390, std.dev.: 0.0180) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (6.5754 => 6.8881, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2321 => 0.2431, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.36% (1.2292 => 1.2828, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.9108 => 0.9491, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.73% (3.7467 => 3.8866, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.43% (6.2785 => 6.4936, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 3.05% (33.2944 => 34.3083, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5048, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/fbench: 25.31% (1.8175 => 2.2775, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4171, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.91% (1.2998 => 1.3766, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0487) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6987, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5452, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0806, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4271 => 7.6115, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0116) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.00% (1.4298 => 1.4441, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.99% (0.4657 => 0.3866, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.97% (22.5627 => 21.6675, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2953, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9237, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5887, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9094, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2175, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2360, std.dev.: 0.0191) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4342, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 00:54:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 02:54:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916075457.360A42A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3876?compare_to=3873&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3876, Order: 163993, Start Time: 2012-09-16 06:33:54, End Time: 2012-09-16 07:56:18 To: 3873, Order: 163992, Start Time: 2012-09-16 03:48:00, End Time: 2012-09-16 05:07:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (743 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5675 => 0.5675, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 0.07% (15.7824 => 15.7931, std.dev.: 0.0244) MultiSource/Applications/kimwitu++/kc: -0.06% (14.6440 => 14.6354, std.dev.: 0.0247) MultiSource/Benchmarks/Bullet/bullet: 0.04% (81.7461 => 81.7822, std.dev.: 0.0749) MultiSource/Benchmarks/MallocBench/gs/gs: -0.00% (4.2986 => 4.2984, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2160 => 1.2176, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.3614 => 7.3603, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (3.6495 => 3.6506, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.25% (0.6347 => 0.6363, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (0.0648 => 0.0672, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.31% (63.2438 => 81.7822, std.dev.: 0.0749) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14255.28% (0.0720 => 10.3358, std.dev.: 0.0131) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.84% (10.3673 => 15.1196, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: 25.15% (0.1622 => 0.2030, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (2.2022 => 2.4915, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.87% (7.0540 => 7.9617, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: 12.50% (0.1432 => 0.1611, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2548, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.71% (1.7609 => 1.9495, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 9.34% (10.4361 => 11.4111, std.dev.: 0.0209) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.95% (0.3543 => 0.3860, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 8.56% (0.3282 => 0.3563, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3473 => 0.3764, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-3: 8.33% (0.3516 => 0.3809, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/synchronized: 8.26% (0.3561 => 0.3855, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: 8.24% (0.3543 => 0.3835, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-2: 8.18% (0.3497 => 0.3783, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3828 => 0.4135, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 7.88% (0.3694 => 0.3985, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3927 => 0.4236, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/property: 7.77% (0.3886 => 0.4188, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4615 => 0.4948, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 7.02% (9.4845 => 10.1500, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.4879 => 0.5202, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.01% (0.5105 => 0.5412, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.00% (0.2700 => 0.2862, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.3307 => 0.3502, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.84% (0.6675 => 0.7065, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.76% (0.7115 => 0.7525, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 5.68% (0.2554 => 0.2699, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5860 => 0.6192, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2271 => 0.2399, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8172 => 0.8631, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (4.2646 => 4.5039, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 5.61% (0.3423 => 0.3615, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.57% (3.3354 => 3.5212, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 5.52% (0.5925 => 0.6252, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.3050 => 1.3770, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (8.1363 => 8.5851, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.8067 => 0.8506, std.dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 5.41% (5.7591 => 6.0707, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.6030 => 0.6354, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.37% (0.2758 => 0.2906, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (5.0018 => 5.2670, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.26% (4.9449 => 5.2051, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.5569 => 0.5859, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (1.5415 => 1.6212, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3121 => 0.3280, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.9765 => 1.0250, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 4.96% (1.1642 => 1.2219, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 4.79% (0.3092 => 0.3240, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 4.74% (3.8723 => 4.0560, std.dev.: 0.0475) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (7.9617 => 8.3240, std.dev.: 0.0117) MultiSource/Applications/hbd/hbd: 4.55% (1.5603 => 1.6313, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.5020 => 0.5248, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.53% (0.2603 => 0.2721, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.45% (1.0722 => 1.1199, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.43% (0.3180 => 0.3321, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 4.40% (0.3387 => 0.3536, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.31% (1.1861 => 1.2372, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9371 => 22.8509, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6456 => 0.6718, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6450 => 0.6707, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 3.95% (2.0273 => 2.1073, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.80% (0.5981 => 0.6208, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 3.67% (2.2969 => 2.3813, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.32% (0.3136 => 0.3240, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.30% (1.5859 => 1.6382, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (2.0665 => 2.1344, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.23% (0.3935 => 0.4062, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.14% (1.4186 => 1.4632, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8023, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (2.2024 => 2.2662, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.1840 => 1.2181, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.91% (0.8101 => 0.8256, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.85% (1.2842 => 1.3079, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0796) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (4.2280 => 4.3520, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7879, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2222, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.66% (5.2763 => 3.2366, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.48% (5.3855 => 3.8516, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.04% (5.3526 => 3.8519, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0884, std.dev.: 0.9366) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.14% (2.9384 => 2.5817, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -8.78% (22.1758 => 20.2290, std.dev.: 0.0443) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3773, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3126, std.dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1515, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4154, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.80% (1.3677 => 1.3294, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.53% (10.2830 => 10.0233, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.2999 => 6.1671, std.dev.: 0.0339) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (8.1563 => 8.0235, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: -1.34% (4.6441 => 4.5818, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.53% (0.5229 => 0.5675, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 5.36% (14.9895 => 15.7931, std.dev.: 0.0244) MultiSource/Applications/kimwitu++/kc: 3.39% (14.1553 => 14.6354, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (4.1105 => 4.2984, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.21% (1.1048 => 1.2176, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (7.1582 => 7.3603, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.42% (3.4629 => 3.6506, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.6222 => 0.6363, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 00:57:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 02:57:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916075745.260462A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3877?compare_to=3871&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3877, Order: 163992, Start Time: 2012-09-16 05:12:26, End Time: 2012-09-16 07:59:04 To: 3871, Order: 163988, Start Time: 2012-09-16 01:59:59, End Time: 2012-09-16 04:43:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (781 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (2.0623 => 2.1003, std.dev.: 0.0128) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3446 => 0.3760, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3496 => 0.3814, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 9.09% (0.3442 => 0.3755, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3465 => 0.3779, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.06% (0.3488 => 0.3804, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/synchronized: 9.05% (0.3469 => 0.3783, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3460 => 0.3773, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/property: 8.74% (0.3650 => 0.3969, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions: 8.67% (0.3643 => 0.3959, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.3724 => 0.4043, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 6.67% (1.5932 => 1.6994, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (0.4361 => 0.4627, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.99% (0.5889 => 0.6242, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (3.5627 => 3.7666, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.64% (1.6211 => 1.7126, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (1.3152 => 1.3883, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 5.44% (0.7171 => 0.7561, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.44% (2.7292 => 2.8776, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (0.5000 => 0.5265, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.21% (0.5026 => 0.5288, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8205, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 4.77% (1.0781 => 1.1295, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.73% (0.3362 => 0.3521, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (0.3930 => 0.4113, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 4.63% (23.5202 => 24.6081, std.dev.: 0.0715) MultiSource/Applications/hexxagon/hexxagon: 4.61% (0.9909 => 1.0366, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.54% (0.5900 => 0.6168, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.52% (0.2875 => 0.3005, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (4.4195 => 4.6184, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 4.50% (4.2109 => 4.4002, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3195 => 0.3338, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.41% (0.2813 => 0.2937, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.2736 => 0.2856, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.36% (0.3258 => 0.3400, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2738 => 0.2857, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.32% (0.2823 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.30% (0.2811 => 0.2932, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2750 => 0.2868, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.28% (0.3060 => 0.3191, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.26% (0.2911 => 0.3035, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.25% (0.3267 => 0.3406, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 4.25% (2.1653 => 2.2574, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.23% (2.0673 => 2.1547, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (0.3890 => 0.4054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.20% (0.3096 => 0.3226, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.19% (0.6634 => 0.6912, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 4.17% (0.2803 => 0.2920, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.17% (4.6177 => 4.8103, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 4.16% (1.8794 => 1.9575, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4146 => 0.4318, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.13% (0.3903 => 0.4064, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (0.3625 => 0.3770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3317 => 0.3449, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 3.91% (0.3348 => 0.3479, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.91% (0.5546 => 0.5763, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3477 => 0.3611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.84% (0.3726 => 0.3869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.83% (0.4251 => 0.4414, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 3.82% (1.4269 => 1.4814, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.3084 => 0.3201, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3282 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3690 => 0.3824, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 3.61% (0.9697 => 1.0047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.3981 => 0.4124, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (1.9694 => 2.0399, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (0.4658 => 0.4824, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.54% (0.3336 => 0.3454, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.46% (1.9966 => 2.0657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.6435 => 0.6652, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.2969 => 0.3069, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.5012 => 0.5177, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 3.01% (0.4847 => 0.4993, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.99% (2.0346 => 2.0955, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (0.7426 => 0.7614, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (0.5361 => 0.5493, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.13% (0.5584 => 0.5703, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (11.6398 => 11.8721, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.94% (4.6926 => 4.7835, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6679, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1943, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std.dev.: 0.0263) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2286, std.dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4392, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2845, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5892, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5609, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7873, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.40% (0.6293 => 0.6142, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.47% (16.2163 => 15.9782, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 01:57:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 03:57:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916085712.7C6BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3878?compare_to=3874&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3878, Order: 163994, Start Time: 2012-09-16 07:47:17, End Time: 2012-09-16 08:58:34 To: 3874, Order: 163993, Start Time: 2012-09-16 06:21:19, End Time: 2012-09-16 07:31:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (46 on baseline) Performance Improvements: 6 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 889 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.06% (1.0825 => 1.0940, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.34% (21.2012 => 22.5461, std.dev.: 0.1071) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.18% (2.3332 => 2.4074, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.84% (4.6377 => 4.7232, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: 1.13% (2.3982 => 2.4254, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.06% (1.6054 => 1.6224, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.47% (0.5809 => 0.5491, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.94% (0.7906 => 0.7753, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.89% (0.9017 => 0.8847, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.62% (1.2040 => 1.1845, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.24% (17.5608 => 16.2890, std.dev.: 0.4020) SingleSource/Benchmarks/Misc/whetstone: -2.12% (2.3972 => 2.3464, std.dev.: 0.0193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.54% (0.9956 => 0.9902, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: -0.37% (0.6008 => 0.5986, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -0.83% (0.1678 => 0.1664, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.45% (0.1548 => 0.1555, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.73% (0.3041 => 0.3124, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.34% (0.2388 => 0.2396, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (0.3154 => 0.3189, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.09% (0.2314 => 0.2316, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -0.24% (0.0409 => 0.0408, std.dev.: 0.0083) SingleSource/UnitTests/2003-05-07-VarArgs: 2.33% (0.0086 => 0.0088) SingleSource/UnitTests/2003-08-11-VaListArg: 8.54% (0.0082 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0237 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.63% (0.0181 => 0.0193, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.82% (0.0288 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0280 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0321 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.05% (0.0190 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 3.31% (0.0242 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 30.65% (0.0248 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1433 => 0.1437, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.26% (1.4721 => 1.4906, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.71% (0.1514 => 0.1473, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.55% (0.4035 => 0.4057, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.56% (0.1433 => 0.1382, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.62% (0.0574 => 0.0612, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.31% (0.0227 => 0.0165, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.57% (0.0592 => 0.0625, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.57% (1.1484 => 1.1550, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.57% (0.0574 => 0.0565, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.15% (0.0142 => 0.0155, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.7816 => 0.7811, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.42% (1.6104 => 1.6036, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.60% (4.1772 => 3.0242, std.dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/except: 82250.00% (0.0006 => 0.4941, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 6.14% (2.1763 => 2.3099, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.51% (0.6410 => 0.6763, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.05% (0.3582 => 0.3763, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.2552 => 0.2678, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 3.91% (15.3105 => 15.9086, std.dev.: 0.0910) MultiSource/Applications/SIBsim4/SIBsim4: 3.85% (1.1653 => 1.2102, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 3.62% (1.0046 => 1.0410, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 3.60% (0.6915 => 0.7164, std.dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: 3.01% (29.3170 => 30.2001, std.dev.: 0.0886) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (1.5150 => 1.5576, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.67% (2.0972 => 2.1532, std.dev.: 0.0160) MultiSource/Applications/hbd/hbd: 2.42% (1.3268 => 1.3589, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6069 => 0.6174, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (8.2186 => 8.3198, std.dev.: 0.0155) MultiSource/Benchmarks/nbench/nbench: 1.10% (1.0821 => 1.0940, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.32% (1.6538 => 2.3371, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 15.16% (1.7426 => 2.0067, std.dev.: 0.0311) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.76% (4.0101 => 4.6018, std.dev.: 0.0354) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3746 => 0.4285, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/Puzzle: 12.91% (0.1433 => 0.1618, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.66% (7.0025 => 7.6088, std.dev.: 0.0299) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.60% (1.0063 => 1.0928, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 7.72% (1.0194 => 1.0981, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.35% (0.2857 => 0.3067, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8077, std.dev.: 0.0533) SingleSource/Benchmarks/Misc/fp-convert: 4.19% (15.2242 => 15.8622, std.dev.: 0.0514) SingleSource/Benchmarks/Misc/dt: 3.92% (0.9851 => 1.0237, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (6.6312 => 6.8743, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.10% (0.5876 => 0.6058, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5113 => 8.7562, std.dev.: 0.0496) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.6308 => 0.6468, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.49% (2.6656 => 2.7319, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.40% (4.6127 => 4.7232, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/five11/five11: 2.37% (5.1938 => 5.3170, std.dev.: 0.0428) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.09% (2.3580 => 2.4074, std.dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: 1.75% (14.4877 => 14.7413, std.dev.: 0.0746) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (2.4455 => 2.4811, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5329, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 1.14% (2.5166 => 2.5453, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.6061 => 1.6224, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.34% (0.5740 => 0.5491, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: -2.83% (0.7738 => 0.7519, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.02% (0.9029 => 0.8847, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.98% (0.3497 => 0.2134, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.42% (5.2665 => 4.1912, std.dev.: 0.0740) SingleSource/Benchmarks/Shootout-C++/ary3: -19.66% (1.7473 => 1.4037, std.dev.: 0.0399) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.34% (1.1647 => 0.9394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -9.30% (62.4126 => 56.6087, std.dev.: 0.0748) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.47% (1.4034 => 1.2845, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.28% (3.2007 => 2.9357, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.27% (2.4457 => 2.2435, std.dev.: 0.0622) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.09% (3.6254 => 3.3683, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: -6.68% (3.4230 => 3.1942, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -6.13% (1.4441 => 1.3556, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: -5.09% (1.4117 => 1.3398, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4105, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.91% (0.4140 => 0.3978, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6728, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2323, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.02% (1.1683 => 1.1330, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4555, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: -2.78% (9.2503 => 8.9930, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0080) MultiSource/Applications/aha/aha: -2.71% (3.4286 => 3.3358, std.dev.: 0.0125) SingleSource/Benchmarks/McGill/misr: -2.58% (0.4296 => 0.4185, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.32% (3.7496 => 3.6626, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4233, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.52% (2.8964 => 2.8525, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: -1.41% (3.8907 => 3.8357, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3175, std.dev.: 0.0680) SingleSource/Benchmarks/Misc/oourafft: -1.28% (3.8200 => 3.7712, std.dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.78% (0.9980 => 0.9902, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: -0.60% (0.6022 => 0.5986, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1666 => 0.1664, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (0.3083 => 0.3124, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2394 => 0.2396, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.44% (0.3175 => 0.3189, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.61% (0.2302 => 0.2316, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -9.13% (0.0449 => 0.0408, std.dev.: 0.0083) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.75% (1.5019 => 1.4906, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.87% (0.1501 => 0.1473, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.83% (0.1344 => 0.1382, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.88% (0.0232 => 0.0165, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.19% (0.0639 => 0.0625, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.76% (1.1350 => 1.1550, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.30% (0.0637 => 0.0565, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.99% (0.0246 => 0.0155, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.58% (0.7541 => 0.7811, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.38% (1.5363 => 1.6036, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 02:33:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 04:33:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916093314.D99FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3879?compare_to=3875&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3879, Order: 163996, Start Time: 2012-09-16 08:20:13, End Time: 2012-09-16 09:34:34 To: 3875, Order: 163993, Start Time: 2012-09-16 06:33:54, End Time: 2012-09-16 07:50:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (164 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.14% (79.4170 => 80.3214, std.dev.: 0.1980) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.73% (2.0176 => 2.3954, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3325, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.07% (0.7710 => 0.8409, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4912, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.64% (0.9199 => 0.9994, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.57% (0.5265 => 0.5716, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.49% (0.6959 => 0.7550, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.45% (1.2193 => 1.3223, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.43% (0.7061 => 0.7656, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.97% (1.1364 => 1.2270, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 7.88% (13.8202 => 14.9092, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.4563 => 1.5707, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.74% (0.6283 => 0.6769, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.66% (0.5577 => 0.6004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.64% (0.2760 => 0.2971, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3485 => 0.3748, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.37% (0.3756 => 0.4033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.32% (1.9828 => 2.1279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.22% (1.0313 => 1.1058, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.20% (0.4791 => 0.5136, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 7.20% (0.2988 => 0.3203, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.15% (0.3246 => 0.3478, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3293 => 0.3528, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.07% (1.1061 => 1.1843, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5637 => 0.6031, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.98% (0.2995 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.95% (0.3868 => 0.4137, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.91% (7.2180 => 7.7167, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 6.83% (0.7506 => 0.8019, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 6.82% (0.8310 => 0.8877, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 6.81% (3.8646 => 4.1279, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.72% (0.4390 => 0.4685, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.72% (0.7460 => 0.7961, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.61% (0.3220 => 0.3433, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.57% (3.6692 => 3.9101, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3534 => 0.3765, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2243 => 0.2388, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.23% (2.1791 => 2.3149, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 6.15% (0.3578 => 0.3798, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.15% (0.4003 => 0.4249, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.12% (0.3663 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.08% (1.9270 => 2.0442, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.06% (3.1889 => 3.3820, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.03% (0.6744 => 0.7151, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3646 => 0.3866, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 6.00% (0.3914 => 0.4149, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.99% (0.3940 => 0.4176, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.97% (0.3601 => 0.3816, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.95% (16.6129 => 17.6021, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (1.3245 => 1.4033, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.2945 => 0.3120, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.91% (1.0594 => 1.1220, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.86% (0.3650 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4113 => 0.4354, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.79% (1.3813 => 1.4613, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.78% (0.6576 => 0.6956, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.64% (1.3819 => 1.4599, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 5.61% (8.4961 => 8.9727, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 5.58% (1.2749 => 1.3460, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.51% (0.8818 => 0.9304, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.51% (14.8535 => 15.6720, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6135 => 0.6464, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (4.4433 => 4.6810, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6137, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (13.2842 => 13.9697, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 5.11% (0.3131 => 0.3291, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (1.1333 => 1.1898, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.87% (0.2504 => 0.2626, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.78% (4.6629 => 4.8859, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.77% (6.5754 => 6.8889, std.dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 4.74% (14.5298 => 15.2188, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.55% (3.2742 => 3.4232, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.50% (1.2292 => 1.2845, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.11% (0.9108 => 0.9482, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4805 => 0.5001, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6250 => 0.6502, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1866, std.dev.: 0.0218) MultiSource/Applications/lua/lua: 3.82% (3.7467 => 3.8900, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.74% (1.5188 => 1.5756, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2785 => 6.5005, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.1007 => 2.1731, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 2.78% (33.2944 => 34.2196, std.dev.: 0.0226) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4884, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2567, std.dev.: 0.0503) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (3.1736 => 3.4176, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0976, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6023, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5961, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4443, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.00% (22.5627 => 21.6607, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2840, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.63% (1.3780 => 1.3004, std.dev.: 0.0196) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5100, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1504, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9242, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6076, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9059, std.dev.: 0.0343) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2428, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2430, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.12% (4.1080 => 4.0618, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.12% (6.6320 => 6.5575, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2329, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4336, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 02:44:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 04:44:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916094454.3468F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3880?compare_to=3876&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3880, Order: 163996, Start Time: 2012-09-16 08:26:11, End Time: 2012-09-16 09:46:14 To: 3876, Order: 163993, Start Time: 2012-09-16 06:33:54, End Time: 2012-09-16 07:56:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (719 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.13% (6.1671 => 6.2367, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5675 => 0.5673, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: -0.07% (15.7931 => 15.7813, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 0.19% (14.6354 => 14.6638, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: 0.13% (81.7822 => 81.8853, std.dev.: 0.0734) MultiSource/Benchmarks/MallocBench/gs/gs: 0.14% (4.2984 => 4.3045, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2176 => 1.2159, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.3603 => 7.3640, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.09% (3.6506 => 3.6538, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.6363 => 0.6352, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0672 => 0.0671, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.48% (63.2438 => 81.8853, std.dev.: 0.0734) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.03% (0.0720 => 10.3313, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.32% (10.3673 => 15.0661, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 25.40% (0.1622 => 0.2034, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.21% (2.2022 => 2.4932, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.03% (7.0540 => 7.9734, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 12.08% (0.1432 => 0.1605, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2539, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.56% (0.1566 => 0.1747, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.55% (1.7609 => 1.9466, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.80% (10.4361 => 11.3545, std.dev.: 0.0288) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3516 => 0.3816, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 8.52% (0.3473 => 0.3769, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.47% (0.3282 => 0.3560, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3497 => 0.3791, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.40% (0.3561 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.38% (0.3543 => 0.3840, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3543 => 0.3840, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3828 => 0.4141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3694 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.00% (0.3927 => 0.4241, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.87% (0.3886 => 0.4192, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.08% (0.3177 => 0.3402, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (9.4845 => 10.1334, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (0.7433 => 0.7899, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.17% (0.8067 => 0.8565, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.5860 => 0.6220, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.04% (0.2700 => 0.2863, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.03% (0.7115 => 0.7544, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.3307 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5569 => 0.5895, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.71% (0.6675 => 0.7056, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.68% (5.7591 => 6.0864, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.67% (1.3050 => 1.3790, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (8.1363 => 8.5963, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (4.2646 => 4.5055, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2271 => 0.2399, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.61% (0.3423 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.54% (1.5415 => 1.6269, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 5.52% (0.5925 => 0.6252, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 5.37% (3.3354 => 3.5146, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.37% (0.5105 => 0.5379, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (0.8172 => 0.8609, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 5.34% (0.7835 => 0.8253, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.18% (4.9449 => 5.2011, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.16% (0.3121 => 0.3282, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (5.0018 => 5.2537, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 4.89% (1.1642 => 1.2211, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (0.9765 => 1.0241, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 4.86% (0.4299 => 0.4508, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.78% (0.6450 => 0.6758, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 4.67% (0.7326 => 0.7668, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (7.9617 => 8.3303, std.dev.: 0.0216) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.50% (1.5603 => 1.6305, std.dev.: 0.0089) MultiSource/Applications/lua/lua: 4.45% (3.8723 => 4.0447, std.dev.: 0.0126) MultiSource/Benchmarks/sim/sim: 4.43% (0.3387 => 0.3537, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.42% (1.1861 => 1.2385, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.41% (0.3422 => 0.3573, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.39% (1.0722 => 1.1193, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.39% (0.3441 => 0.3592, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.36% (0.5020 => 0.5239, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 4.17% (0.6456 => 0.6725, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.12% (21.9371 => 22.8417, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (0.4064 => 0.4228, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8921 => 0.9280, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.97% (0.4636 => 0.4820, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.80% (0.3865 => 0.4012, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.77% (2.0273 => 2.1038, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 3.77% (2.2969 => 2.3835, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3650 => 0.3785, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.68% (0.5981 => 0.6201, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3826 => 0.3962, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.46% (1.5859 => 1.6407, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.4186 => 1.4657, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.26% (0.3098 => 0.3199, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.4048 => 0.4179, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.16% (0.3603 => 0.3717, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.14% (2.0665 => 2.1313, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 3.04% (0.3684 => 0.3796, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.3668 => 14.8034, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.00% (2.2024 => 2.2685, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.1840 => 1.2149, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.8101 => 0.8283, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.27% (0.4162 => 0.4298, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (4.2280 => 4.3541, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7452, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2325, std.dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7893, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.70% (5.2763 => 3.2342, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.34% (5.3855 => 3.8592, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.88% (5.3526 => 3.8601, std.dev.: 0.0091) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0681, std.dev.: 0.0337) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.11% (2.9384 => 2.5825, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -8.85% (22.1758 => 20.2130, std.dev.: 0.0468) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2966, std.dev.: 0.0630) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.44% (1.8329 => 1.7149, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5114, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4166, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0139, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9972, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/Benchmarks/McGill/chomp: -1.59% (1.2373 => 1.2176, std.dev.: 0.0073) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5778, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2367, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.49% (0.5229 => 0.5673, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 5.28% (14.9895 => 15.7813, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 3.59% (14.1553 => 14.6638, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (4.1105 => 4.3045, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.06% (1.1048 => 1.2159, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.88% (7.1582 => 7.3640, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.51% (3.4629 => 3.6538, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.6222 => 0.6352, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 03:23:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 05:23:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916102321.96D4C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3881?compare_to=3878&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3881, Order: 163997, Start Time: 2012-09-16 09:14:27, End Time: 2012-09-16 10:24:43 To: 3878, Order: 163994, Start Time: 2012-09-16 07:47:17, End Time: 2012-09-16 08:58:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 12 (58 on baseline) Performance Improvements: 4 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 885 (796 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.58% (0.4302 => 0.4628, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5491 => 0.5876, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.79% (0.5867 => 0.5972, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.78% (1.1743 => 1.1952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.2506 => 1.2723, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8490 => 3.9119, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.4044 => 1.4269, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.7224 => 0.7329, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 1.23% (3.5956 => 3.6397, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.04% (1.3589 => 1.3731, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 29.67% (0.0509 => 0.0660) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (4.3350 => 4.4668, std.dev.: 0.0244) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.98% (3.1513 => 3.0889, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.02% (2.0720 => 2.0509, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.58% (2.4074 => 2.3212, std.dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.44% (4.1912 => 4.0890, std.dev.: 0.0216) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.25% (0.9902 => 1.0026, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 0.42% (0.5986 => 0.6011, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 0.06% (0.1664 => 0.1665, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1555 => 0.1556, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.54% (0.3124 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.00% (0.2396 => 0.2372, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.13% (0.3189 => 0.3185, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.64% (0.2316 => 0.2278, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 11.03% (0.0408 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.84% (0.0237 => 0.0235, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0193 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0385 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0299 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0281 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0320 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.12% (0.0179 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.56% (0.0192 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.40% (0.0250 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.62% (0.0324 => 0.0322, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 40.00% (0.0005 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.81% (0.1437 => 0.1463, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -0.91% (1.4906 => 1.4771, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.55% (0.1473 => 0.1540, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.49% (0.4057 => 0.4158, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.76% (0.1382 => 0.1434, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.72% (0.0612 => 0.0647, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.82% (0.0165 => 0.0234, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.56% (0.0625 => 0.0584, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.87% (1.1550 => 1.1449, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.53% (0.0565 => 0.0562, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 67.10% (0.0155 => 0.0259, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7811 => 0.7805, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 66.67% (0.0003 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.34% (1.6036 => 1.6090, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.81% (4.1772 => 3.0573, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.62% (0.1414 => 0.1550, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.07% (0.5309 => 0.5631, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 5.45% (2.1763 => 2.2949, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.2552 => 0.2683, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.05% (0.6410 => 0.6734, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.77% (0.3582 => 0.3753, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.62% (1.0046 => 1.0510, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.6915 => 0.7216, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 3.95% (0.6173 => 0.6417, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3217 => 0.3337, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2072, std.dev.: 0.0078) MultiSource/Applications/hbd/hbd: 3.49% (1.3268 => 1.3731, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.65% (29.3170 => 30.0943, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5150 => 1.5543, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.50% (0.7639 => 0.7830, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1672 => 1.1952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.37% (0.5740 => 0.5876, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.7722 => 0.7895, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.43% (0.7226 => 0.7329, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 1.16% (3.5980 => 3.6397, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (12.6413 => 12.7796, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.83% (0.0263 => 0.0373, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 32.26% (0.0499 => 0.0660) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.23% (0.0917 => 0.1075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 13.05% (0.3746 => 0.4235, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.05% (4.0101 => 4.5333, std.dev.: 0.0726) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.17% (0.2694 => 0.2995, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1433 => 0.1563, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6093, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.61% (1.0063 => 1.0829, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/chomp: 7.37% (1.0194 => 1.0945, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.32% (0.2857 => 0.3066, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.03% (4.2129 => 4.4668, std.dev.: 0.0244) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7991, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.3301 => 0.3481, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.78% (40.4792 => 42.4147, std.dev.: 0.3997) SingleSource/Benchmarks/Misc/fp-convert: 4.31% (15.2242 => 15.8803, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 3.21% (5.1938 => 5.3607, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.86% (0.5587 => 0.5747, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 2.55% (0.6308 => 0.6469, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.47% (0.5876 => 0.6021, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 2.41% (8.5113 => 8.7160, std.dev.: 0.0531) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.81% (1.2726 => 1.2956, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.6127 => 4.6944, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.5166 => 2.5589, std.dev.: 0.0089) MultiSource/Applications/siod/siod: 1.67% (3.5520 => 3.6114, std.dev.: 0.0186) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7219, std.dev.: 0.0332) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (2.4455 => 2.4788, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 1.23% (6.9722 => 7.0582, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.15% (0.3497 => 0.2058, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.36% (5.2665 => 4.0890, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.25% (1.1647 => 0.9405, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1571, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -9.44% (62.4126 => 56.5216, std.dev.: 0.0459) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.31% (3.2007 => 2.9347, std.dev.: 0.0776) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.71% (2.4457 => 2.2571, std.dev.: 0.0456) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.23% (3.6254 => 3.3632, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: -6.91% (3.4230 => 3.1865, std.dev.: 0.0666) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7927, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -5.93% (1.4441 => 1.3585, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: -5.34% (1.4117 => 1.3363, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/fibo: -5.04% (4.6355 => 4.4018, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.28% (1.7361 => 1.6618, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/distray/distray: -4.28% (0.2664 => 0.2550, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.86% (1.1683 => 1.1232, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: -3.32% (7.6833 => 7.4283, std.dev.: 0.0328) MultiSource/Applications/SPASS/SPASS: -3.25% (8.5323 => 8.2552, std.dev.: 0.0603) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.09% (3.7496 => 3.6339, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/methcall: -2.96% (9.2503 => 8.9765, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -2.73% (3.4286 => 3.3350, std.dev.: 0.0256) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.88% (3.8907 => 3.8174, std.dev.: 0.0267) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (9.3855 => 9.2107, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.79% (61.1734 => 60.0780, std.dev.: 0.3572) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1541, std.dev.: 0.1918) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0926 => 1.0763, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.3569 => 2.3221, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7657, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/hash2: -1.38% (3.4876 => 3.4394, std.dev.: 0.0183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.46% (0.9980 => 1.0026, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -0.18% (0.6022 => 0.6011, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -0.06% (0.1666 => 0.1665, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.13% (0.1554 => 0.1556, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.78% (0.3083 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2394 => 0.2372, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.31% (0.3175 => 0.3185, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (0.2302 => 0.2278, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.08% (0.0240 => 0.0235, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.38% (0.1429 => 0.1463, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.65% (1.5019 => 1.4771, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.60% (0.1501 => 0.1540, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.49% (0.4264 => 0.4158, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1344 => 0.1434, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.85% (0.0589 => 0.0647, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.86% (0.0232 => 0.0234, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.61% (0.0639 => 0.0584, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.87% (1.1350 => 1.1449, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.77% (0.0637 => 0.0562, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.0246 => 0.0259, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.50% (0.7541 => 0.7805, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.73% (1.5363 => 1.6090, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 04:10:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 06:10:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916111023.946192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3882?compare_to=3877&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3882, Order: 163996, Start Time: 2012-09-16 08:27:53, End Time: 2012-09-16 11:11:45 To: 3877, Order: 163992, Start Time: 2012-09-16 05:12:26, End Time: 2012-09-16 07:59:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.2091 => 0.2299, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.63% (0.2160 => 0.2260, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 2.48% (14.2842 => 14.6380, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.70% (0.3465 => 0.3801, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 9.70% (0.3496 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3446 => 0.3780, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3442 => 0.3775, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3469 => 0.3804, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.63% (0.3488 => 0.3824, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.57% (0.3460 => 0.3791, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.34% (0.3650 => 0.3991, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3643 => 0.3980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.13% (0.3724 => 0.4064, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.89% (1.5932 => 1.7030, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5826 => 0.6196, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.5889 => 0.6258, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.16% (1.6211 => 1.7209, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (0.4361 => 0.4627, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (3.5627 => 3.7755, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.7292 => 2.8882, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (1.3152 => 1.3912, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 5.70% (5.5417 => 5.8575, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (0.4994 => 0.5263, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.12% (1.0781 => 1.1333, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (0.5000 => 0.5252, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2823 => 0.2962, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.79% (4.2109 => 4.4125, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 4.78% (23.5202 => 24.6434, std.dev.: 0.0202) SingleSource/Regression/C++/ofstream_ctor: 4.69% (0.3004 => 0.3145, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.69% (0.2813 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.66% (0.3195 => 0.3344, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.61% (2.1013 => 2.1982, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.58% (0.5026 => 0.5256, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2803 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.53% (0.3903 => 0.4080, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (4.4195 => 4.6187, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 4.50% (4.6177 => 4.8257, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 4.50% (0.9909 => 1.0355, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.49% (0.9697 => 1.0132, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 4.48% (0.3258 => 0.3404, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.47% (1.4269 => 1.4907, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.47% (0.2911 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.44% (0.2792 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.42% (2.0673 => 2.1586, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.40% (0.6634 => 0.6926, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.39% (0.4029 => 0.4206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.3362 => 0.3508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (1.8794 => 1.9610, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 4.34% (0.2811 => 0.2933, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.5900 => 0.6156, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.3625 => 0.3782, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.29% (2.1653 => 2.2582, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 4.28% (0.3317 => 0.3459, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 4.23% (0.3336 => 0.3477, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4146 => 0.4321, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 4.20% (0.3096 => 0.3226, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.15% (0.5546 => 0.5776, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (0.4658 => 0.4848, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.07% (0.3124 => 0.3251, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3726 => 0.3877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.02% (0.3678 => 0.3826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4251 => 0.4421, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.96% (0.3084 => 0.3206, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.3271 => 0.3399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3282 => 0.3409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.79% (0.3690 => 0.3830, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3981 => 0.4130, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (1.9694 => 2.0429, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.73% (0.6435 => 0.6675, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (1.9966 => 2.0689, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.2969 => 0.3076, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.58% (0.7875 => 0.8157, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.43% (0.5012 => 0.5184, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.38% (2.0346 => 2.1033, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.3845 => 0.3973, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (0.4847 => 0.4989, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (0.7426 => 0.7640, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (0.5361 => 0.5504, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (0.5584 => 0.5726, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.22% (4.6926 => 4.7970, std.dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (11.6398 => 11.8973, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 5.21% (1.8057 => 1.8997, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6744, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1636, std.dev.: 0.0687) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6380, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2108, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4436, std.dev.: 0.0137) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2201, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5870, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4546, std.dev.: 0.1106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5582, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7869, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9600, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.91% (0.2402 => 0.2260, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7911, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7477, std.dev.: 0.0737) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.11% (0.6293 => 0.6160, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9607, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 04:15:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 06:15:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916111559.EDCD32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3883?compare_to=3879&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3883, Order: 163997, Start Time: 2012-09-16 10:03:03, End Time: 2012-09-16 11:17:21 To: 3879, Order: 163996, Start Time: 2012-09-16 08:20:13, End Time: 2012-09-16 09:34:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (164 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.85% (27.6516 => 29.5448, std.dev.: 0.0983) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.6306 => 56.5735, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.01% (41.6896 => 42.5293, std.dev.: 0.1379) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.71% (2.0176 => 2.3950, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.5818 => 0.6356, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.23% (3.9660 => 4.3320, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.08% (0.7710 => 0.8410, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.81% (1.3693 => 1.4899, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 8.80% (0.7038 => 0.7657, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.60% (0.5265 => 0.5718, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.53% (0.9199 => 0.9984, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.52% (0.6959 => 0.7552, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.49% (1.2193 => 1.3228, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.36% (0.7061 => 0.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.00% (1.1364 => 1.2273, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.92% (13.8202 => 14.9144, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.83% (1.4563 => 1.5703, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.81% (0.3022 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.62% (0.5577 => 0.6002, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.54% (0.6283 => 0.6757, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (1.9828 => 2.1272, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3489 => 0.3742, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.24% (0.3756 => 0.4028, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.21% (1.0313 => 1.1057, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.2988 => 0.3201, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.04% (1.1061 => 1.1840, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.01% (0.2995 => 0.3205, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.86% (7.2180 => 7.7131, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8310 => 0.8878, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.79% (0.7506 => 0.8016, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 6.75% (3.8646 => 4.1253, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.70% (0.4390 => 0.4684, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.58% (0.7460 => 0.7951, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9091, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2243 => 0.2388, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3220 => 0.3426, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.29% (2.1791 => 2.3162, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.11% (0.6744 => 0.7156, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/parameter-passing: 6.10% (0.4003 => 0.4247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.09% (0.3578 => 0.3796, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.08% (3.1889 => 3.3828, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.07% (16.6129 => 17.6205, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (1.3245 => 1.4046, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3914 => 0.4150, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3601 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3646 => 0.3865, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.97% (1.9270 => 2.0420, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3789 => 0.4015, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.92% (0.3650 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.4113 => 0.4355, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.87% (0.2945 => 0.3118, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.86% (0.3940 => 0.4171, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1209, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.70% (0.6576 => 0.6951, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.58% (1.3813 => 1.4584, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 5.58% (1.2749 => 1.3460, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.56% (14.8535 => 15.6792, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (1.3819 => 1.4586, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.52% (8.4961 => 8.9653, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6135 => 0.6467, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.40% (4.4433 => 4.6832, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (4.3801 => 4.6151, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.28% (0.8818 => 0.9284, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.25% (0.2859 => 0.3009, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (13.2842 => 13.9617, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1333 => 1.1882, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 4.80% (4.6629 => 4.8867, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.72% (14.5298 => 15.2159, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2321 => 0.2430, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (6.5754 => 6.8807, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.62% (3.2742 => 3.4254, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: 4.50% (1.2292 => 1.2845, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6250 => 0.6511, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.14% (0.9108 => 0.9485, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.4805 => 0.5002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1867, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.68% (1.5188 => 1.5747, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 3.67% (3.7467 => 3.8841, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (6.2785 => 6.4945, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.1007 => 2.1691, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.71% (33.2944 => 34.1981, std.dev.: 0.0196) MultiSource/Applications/sqlite3/sqlite3: 1.46% (16.2614 => 16.4994, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5189, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std.dev.: 0.0301) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.89% (1.2998 => 1.3763, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6969, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.97% (10.7476 => 11.0673, std.dev.: 0.0518) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4271 => 7.6113, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5918, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.01% (22.5627 => 21.6580, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2913, std.dev.: 0.0269) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.60% (1.7688 => 1.7052, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9224, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5924, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.33% (26.5159 => 25.8975, std.dev.: 0.0315) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2475, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.23% (4.1080 => 4.0574, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2250, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4316, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 04:33:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 06:33:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916113326.49E402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3884?compare_to=3880&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3884, Order: 163997, Start Time: 2012-09-16 10:14:50, End Time: 2012-09-16 11:34:48 To: 3880, Order: 163996, Start Time: 2012-09-16 08:26:11, End Time: 2012-09-16 09:46:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (724 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.11% (79.0074 => 79.8805, std.dev.: 0.1696) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5673 => 0.5673, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: -0.01% (15.7813 => 15.7797, std.dev.: 0.0334) MultiSource/Applications/kimwitu++/kc: 0.02% (14.6638 => 14.6674, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: -0.02% (81.8853 => 81.8723, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/gs/gs: -0.25% (4.3045 => 4.2936, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.15% (1.2159 => 1.2177, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.3640 => 7.3614, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.05% (3.6538 => 3.6520, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.02% (0.6352 => 0.6353, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1429 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0671 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.46% (63.2438 => 81.8723, std.dev.: 0.0169) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14256.53% (0.0720 => 10.3367, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.34% (10.3673 => 15.0681, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 25.46% (0.1622 => 0.2035, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.26% (2.2022 => 2.4943, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.89% (7.0540 => 7.9635, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.23% (1.1194 => 1.2563, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 12.08% (0.1432 => 0.1605, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.57% (1.7609 => 1.9470, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 8.83% (10.4361 => 11.3577, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3473 => 0.3771, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.44% (0.3282 => 0.3559, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 8.38% (0.3543 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.35% (0.3543 => 0.3839, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 8.35% (0.3497 => 0.3789, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/synchronized: 8.31% (0.3561 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3828 => 0.4137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.07% (0.3694 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.3927 => 0.4242, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (9.4845 => 10.1285, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.4879 => 0.5202, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (0.4615 => 0.4900, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.5860 => 0.6203, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.81% (0.6675 => 0.7063, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 5.70% (0.3423 => 0.3618, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.70% (5.7591 => 6.0871, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.66% (0.7115 => 0.7518, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (4.2646 => 4.5054, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.60% (0.5105 => 0.5391, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3121 => 0.3295, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (1.3050 => 1.3772, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (8.1363 => 8.5845, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.8172 => 0.8621, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 5.49% (0.5925 => 0.6250, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.41% (0.6030 => 0.6356, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.40% (0.5569 => 0.5870, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.38% (3.3354 => 3.5147, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2107 => 0.2220, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.32% (0.7835 => 0.8252, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (1.5415 => 1.6203, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.07% (4.9449 => 5.1957, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (5.0018 => 5.2548, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.8067 => 0.8471, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.86% (0.9765 => 1.0240, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.77% (1.1642 => 1.2197, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.2603 => 0.2724, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.60% (0.7326 => 0.7663, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 4.58% (0.4299 => 0.4496, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (7.9617 => 8.3259, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 4.49% (1.0722 => 1.1203, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.46% (1.1861 => 1.2390, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.44% (1.5603 => 1.6295, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 4.42% (3.8723 => 4.0433, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.4103 => 0.4283, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 4.37% (0.3387 => 0.3535, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.34% (0.5020 => 0.5238, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.25% (0.4636 => 0.4833, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (0.4064 => 0.4228, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.03% (21.9371 => 22.8222, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6456 => 0.6716, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.97% (2.0273 => 2.1078, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 3.83% (2.2969 => 2.3849, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/football/football: 3.79% (0.8921 => 0.9259, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6450 => 0.6694, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.71% (0.3826 => 0.3968, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3865 => 0.4004, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4289 => 0.4443, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (1.5859 => 1.6401, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.35% (0.3136 => 0.3241, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.4186 => 1.4634, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0665 => 2.1317, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (2.2024 => 2.2694, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7961, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3684 => 0.3792, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.1840 => 1.2160, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.8101 => 0.8250, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3837, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.97% (4.2280 => 4.3535, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7469, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 1.02% (26.0924 => 26.3597, std.dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2297, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.36% (5.3855 => 3.8581, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.96% (5.3526 => 3.8562, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0697, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.08% (2.9384 => 2.5834, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -8.81% (22.1758 => 20.2228, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2661, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5117, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5038, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4245, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9861, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.23% (1.2373 => 1.2097, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (8.1563 => 7.9942, std.dev.: 0.0213) SingleSource/UnitTests/Vector/multiplies: -1.76% (2.5528 => 2.5079, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5782, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2323, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.49% (0.5229 => 0.5673, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 5.27% (14.9895 => 15.7797, std.dev.: 0.0334) MultiSource/Applications/kimwitu++/kc: 3.62% (14.1553 => 14.6674, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (4.1105 => 4.2936, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.22% (1.1048 => 1.2177, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.84% (7.1582 => 7.3614, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.46% (3.4629 => 3.6520, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.6222 => 0.6353, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 07:22:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 09:22:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916142250.905672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3885?compare_to=3882&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3885, Order: 163997, Start Time: 2012-09-16 11:40:36, End Time: 2012-09-16 14:24:11 To: 3882, Order: 163996, Start Time: 2012-09-16 08:27:53, End Time: 2012-09-16 11:11:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.72% (2.0492 => 2.1254, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.87% (0.3465 => 0.3807, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.81% (0.3446 => 0.3784, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3442 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.60% (0.3488 => 0.3823, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3469 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.55% (0.3496 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.51% (0.3460 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.32% (0.3650 => 0.3990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.31% (0.3643 => 0.3982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.13% (0.3724 => 0.4064, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.79% (1.5932 => 1.7013, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 6.67% (0.1619 => 0.1727, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.40% (1.6211 => 1.7248, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5889 => 0.6254, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (3.5627 => 3.7729, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.71% (2.7292 => 2.8851, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.71% (1.3152 => 1.3903, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 5.53% (5.5417 => 5.8483, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.21% (0.5026 => 0.5288, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (0.4994 => 0.5252, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 5.04% (1.0781 => 1.1324, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7171 => 0.7525, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (0.3890 => 0.4081, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3195 => 0.3349, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.73% (0.2875 => 0.3011, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.72% (23.5202 => 24.6293, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.70% (0.9697 => 1.0153, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.2736 => 0.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.68% (0.2823 => 0.2955, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.67% (4.2109 => 4.4076, std.dev.: 0.0085) SingleSource/Regression/C++/ofstream_ctor: 4.63% (0.3004 => 0.3143, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2813 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (2.1013 => 2.1969, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.5900 => 0.6167, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.48% (4.6177 => 4.8244, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 4.47% (0.2750 => 0.2873, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.45% (0.9909 => 1.0350, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.44% (0.2792 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (4.4195 => 4.6150, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.41% (0.3060 => 0.3195, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.41% (2.0673 => 2.1585, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.40% (0.2725 => 0.2845, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.36% (0.2911 => 0.3038, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (2.1653 => 2.2589, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3267 => 0.3408, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.3903 => 0.4071, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (1.8794 => 1.9599, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4146 => 0.4321, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.20% (0.3477 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.19% (0.3362 => 0.3503, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 4.18% (1.4269 => 1.4866, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.17% (0.5546 => 0.5777, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3124 => 0.3254, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3348 => 0.3487, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 4.13% (0.3317 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3096 => 0.3223, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 4.10% (0.6634 => 0.6906, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4251 => 0.4425, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.4139 => 0.4307, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3726 => 0.3876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.3271 => 0.3398, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3282 => 0.3409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3690 => 0.3832, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (1.9966 => 2.0733, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (1.9694 => 2.0413, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.3981 => 0.4124, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.56% (0.6435 => 0.6664, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.50% (0.2969 => 0.3073, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.44% (0.7875 => 0.8146, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.5012 => 0.5183, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.39% (2.0346 => 2.1036, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.3845 => 0.3974, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.76% (0.4847 => 0.4981, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (0.7426 => 0.7630, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (0.5361 => 0.5505, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (0.5584 => 0.5717, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (11.6398 => 11.9056, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.10% (4.6926 => 4.7911, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6662, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6497, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.08% (2.0820 => 2.1254, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5015, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.49% (41.7953 => 42.4172, std.dev.: 0.0313) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (8.4155 => 8.5109, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5997, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5687, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7957, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7670, std.dev.: 0.0603) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9635, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 11:10:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 13:10:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916181046.043CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3886?compare_to=3881&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3886, Order: 163999, Start Time: 2012-09-16 17:01:13, End Time: 2012-09-16 18:12:09 To: 3881, Order: 163997, Start Time: 2012-09-16 09:14:27, End Time: 2012-09-16 10:24:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (55 on baseline) Performance Improvements: 0 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 896 (797 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.57% (2.3671 => 2.5699, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.26% (1.8012 => 1.8599, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.33% (3.6339 => 3.6823, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.31% (1.4272 => 1.4459, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.04% (2.7020 => 2.7301, std.dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.04% (1.0026 => 1.0022, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.78% (0.6011 => 0.5964, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 1.14% (0.1665 => 0.1684, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.51% (0.1556 => 0.1564, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (0.3107 => 0.3098, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.76% (0.2372 => 0.2390, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3185 => 0.3186, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.92% (0.2278 => 0.2299, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -1.10% (0.0453 => 0.0448, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.15% (0.0087 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.68% (0.0235 => 0.0177, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.81% (0.0191 => 0.0178, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0384 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.91% (0.0296 => 0.0243, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0282 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.13% (0.0320 => 0.0294, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.06% (0.0189 => 0.0187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.23% (0.0244 => 0.0247, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.31% (0.0322 => 0.0321, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -28.57% (0.0007 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.19% (0.1463 => 0.1431, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 2.55% (1.4771 => 1.5147, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1540 => 0.1542, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.26% (0.4158 => 0.4064, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.63% (0.1434 => 0.1382, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.26% (0.0647 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.66% (0.0234 => 0.0188, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0584 => 0.0585, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1449 => 1.1479, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.17% (0.0024 => 0.0011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.16% (0.0562 => 0.0591, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.62% (0.0259 => 0.0203, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.7805 => 0.7821, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.21% (1.6090 => 1.6056, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.19% (4.1772 => 3.0831, std.dev.: 0.0457) SingleSource/Benchmarks/Shootout-C++/except: 83150.00% (0.0006 => 0.4995, std.dev.: 0.0117) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.08% (0.5309 => 0.5632, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.63% (0.6410 => 0.6771, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 5.36% (2.1763 => 2.2929, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.21% (0.2552 => 0.2685, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (0.6915 => 0.7248, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 4.21% (0.6173 => 0.6433, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 3.67% (1.1653 => 1.2081, std.dev.: 0.0109) MultiSource/Applications/lemon/lemon: 3.63% (1.0046 => 1.0411, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 3.61% (15.3105 => 15.8636, std.dev.: 0.0487) MultiSource/Benchmarks/McCat/18-imp/imp: 3.61% (0.3217 => 0.3333, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.59% (1.3268 => 1.3744, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.5150 => 1.5580, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1672 => 1.1977, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.52% (29.3170 => 30.0572, std.dev.: 0.0786) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.7639 => 0.7813, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.81% (0.7226 => 0.7357, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 1.77% (2.0972 => 2.1344, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.40% (1.1827 => 1.1992, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 1.33% (3.5980 => 3.6460, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (1.3935 => 1.4098, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.50% (3.4629 => 4.2422, std.dev.: 0.0758) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9966, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5640, std.dev.: 0.0211) MultiSource/Applications/sgefa/sgefa: 13.67% (0.3746 => 0.4258, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6151, std.dev.: 0.0487) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.12% (1.0063 => 1.0880, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/chomp: 7.27% (1.0194 => 1.0935, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.90% (0.2857 => 0.3054, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (0.3301 => 0.3519, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8148, std.dev.: 0.0270) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.78% (4.2129 => 4.4566, std.dev.: 0.0602) SingleSource/Benchmarks/Misc/fp-convert: 3.95% (15.2242 => 15.8254, std.dev.: 0.0543) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5396, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8387, std.dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.56% (0.5587 => 0.5786, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.6308 => 0.6508, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.90% (40.4792 => 41.6544, std.dev.: 0.4114) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.42% (2.6656 => 2.7301, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/five11/five11: 2.31% (5.1938 => 5.3140, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 1.62% (14.4877 => 14.7227, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4455 => 2.4850, std.dev.: 0.0120) MultiSource/Applications/siod/siod: 1.51% (3.5520 => 3.6057, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5325, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.30% (2.9152 => 2.9531, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 1.27% (2.5166 => 2.5486, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.03% (2.8599 => 2.8894, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.55% (0.3497 => 0.2079, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: -20.54% (1.7473 => 1.3884, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.48% (1.1647 => 0.9378, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.01% (5.2665 => 4.2651, std.dev.: 0.1675) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -9.39% (62.4126 => 56.5492, std.dev.: 0.0505) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.14% (3.2007 => 2.9402, std.dev.: 0.0501) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3656, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.80% (2.4457 => 2.2793, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: -6.39% (3.4230 => 3.2041, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3526, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.23% (2.9728 => 2.7876, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: -5.36% (1.4117 => 1.3360, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4082, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.93% (1.7361 => 1.6678, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: -3.52% (9.2503 => 8.9247, std.dev.: 0.0459) MultiSource/Applications/lambda-0_1_3/lambda: -3.32% (7.6833 => 7.4280, std.dev.: 0.0330) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.02% (0.4140 => 0.4015, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.92% (1.2722 => 1.2351, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std.dev.: 0.0323) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -2.75% (3.4286 => 3.3342, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std.dev.: 0.0391) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.40% (1.2959 => 1.2648, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (92.7467 => 90.9917, std.dev.: 0.2039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.4876 => 3.4238, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.79% (3.7496 => 3.6823, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.58% (3.8907 => 3.8293, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2391, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7655, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.41% (2.8964 => 2.8555, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3082, std.dev.: 0.0315) MultiSource/Benchmarks/llubenchmark/llu: -1.24% (2.0192 => 1.9942, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: -1.12% (16.5617 => 16.3754, std.dev.: 0.0687) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.42% (0.9980 => 1.0022, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.96% (0.6022 => 0.5964, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 1.08% (0.1666 => 0.1684, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.49% (0.3083 => 0.3098, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.17% (0.2394 => 0.2390, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (0.3175 => 0.3186, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2302 => 0.2299, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.25% (0.0240 => 0.0177, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.29% (0.0192 => 0.0178, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.27% (0.0301 => 0.0243, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.26% (0.0324 => 0.0294, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.06% (0.0189 => 0.0187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 0.85% (1.5019 => 1.5147, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.73% (0.1501 => 0.1542, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.69% (0.4264 => 0.4064, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.83% (0.1344 => 0.1382, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.97% (0.0232 => 0.0188, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.45% (0.0639 => 0.0585, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.14% (1.1350 => 1.1479, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.17% (0.0024 => 0.0011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.22% (0.0637 => 0.0591, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (0.0246 => 0.0203, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.71% (0.7541 => 0.7821, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.51% (1.5363 => 1.6056, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 11:26:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 13:26:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916182608.BFF472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3887?compare_to=3883&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3887, Order: 163999, Start Time: 2012-09-16 17:13:13, End Time: 2012-09-16 18:27:30 To: 3883, Order: 163997, Start Time: 2012-09-16 10:03:03, End Time: 2012-09-16 11:17:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.71% (2.0176 => 2.3950, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3324, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.04% (0.7710 => 0.8407, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5748 => 0.6266, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 8.83% (1.3693 => 1.4902, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.66% (0.9199 => 0.9996, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.46% (1.2193 => 1.3225, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.6959 => 0.7543, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 8.38% (0.7061 => 0.7653, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4062 => 0.4390, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.01% (13.8202 => 14.9271, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.99% (1.1364 => 1.2272, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.85% (1.4563 => 1.5706, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.57% (0.5577 => 0.5999, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2760 => 0.2968, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.6283 => 0.6756, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.33% (1.9828 => 2.1282, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.24% (0.3246 => 0.3481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 7.19% (1.0313 => 1.1054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.17% (0.3293 => 0.3529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2655 => 0.2843, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.08% (1.1061 => 1.1844, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4016 => 0.4300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.03% (0.3868 => 0.4140, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.03% (0.2988 => 0.3198, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.98% (0.2995 => 0.3204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.90% (0.2914 => 0.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.84% (3.8646 => 4.1290, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.82% (7.2180 => 7.7105, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/football/football: 6.82% (0.8310 => 0.8877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.74% (0.7506 => 0.8012, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3453 => 0.3685, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.64% (0.2243 => 0.2392, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.60% (3.6692 => 3.9114, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.58% (0.7460 => 0.7951, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.54% (2.1791 => 2.3217, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3220 => 0.3428, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.15% (0.3578 => 0.3798, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.10% (0.4003 => 0.4247, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.09% (3.1889 => 3.3830, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 6.06% (0.3914 => 0.4151, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.3245 => 1.4043, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.00% (16.6129 => 17.6101, std.dev.: 0.0087) MultiSource/Applications/treecc/treecc: 5.99% (1.9270 => 2.0425, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 5.99% (0.3789 => 0.4016, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.97% (0.3650 => 0.3868, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 5.97% (0.3601 => 0.3816, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4113 => 0.4354, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.84% (0.6744 => 0.7138, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.84% (0.3940 => 0.4170, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.82% (0.3623 => 0.3834, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.80% (1.0594 => 1.1208, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.73% (0.8698 => 0.9196, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.70% (0.6576 => 0.6951, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.67% (1.2749 => 1.3472, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.3813 => 1.4582, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.57% (8.4961 => 8.9690, std.dev.: 0.0179) MultiSource/Applications/JM/lencod/lencod: 5.53% (14.8535 => 15.6746, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4580, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (4.4433 => 4.6868, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.46% (0.6135 => 0.6470, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6139, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.31% (0.8818 => 0.9286, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (13.2842 => 13.9618, std.dev.: 0.0155) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (1.1333 => 1.1887, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 4.82% (4.6629 => 4.8876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.70% (14.5298 => 15.2132, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2321 => 0.2430, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (6.5754 => 6.8796, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.54% (3.2742 => 3.4227, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.19% (0.6250 => 0.6512, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.18% (0.9108 => 0.9489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.02% (0.4805 => 0.4998, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1866, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8904, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.5188 => 1.5758, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.41% (6.2785 => 6.4928, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1703, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.78% (33.2944 => 34.2192, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5000, std.dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std.dev.: 0.0442) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.10% (1.2998 => 1.3791, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.98% (10.7476 => 11.0675, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5903, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1834, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5926, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.79% (0.4657 => 0.3875, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.97% (22.5627 => 21.6665, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2935, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.25% (2.6470 => 2.5080, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9217, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5805, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.28% (26.5159 => 25.9125, std.dev.: 0.0291) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2374, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (4.1080 => 4.0563, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2238, std.dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std.dev.: 0.0229) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 11:31:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 13:31:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916183152.9B3E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3888?compare_to=3884&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3888, Order: 163999, Start Time: 2012-09-16 17:13:30, End Time: 2012-09-16 18:33:14 To: 3884, Order: 163997, Start Time: 2012-09-16 10:14:50, End Time: 2012-09-16 11:34:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (126 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (722 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.69% (55.6771 => 56.6167, std.dev.: 0.0626) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.54% (1.3055 => 1.3256, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.46% (0.5673 => 0.5699, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -0.07% (15.7797 => 15.7691, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 0.01% (14.6674 => 14.6685, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -0.00% (81.8723 => 81.8691, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: -0.03% (4.2936 => 4.2922, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.15% (1.2177 => 1.2159, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.3614 => 7.3668, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.00% (3.6520 => 3.6519, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6353 => 0.6351, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.45% (63.2438 => 81.8691, std.dev.: 0.0186) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14248.75% (0.0720 => 10.3311, std.dev.: 0.0075) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.27% (10.3673 => 15.0605, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: 25.34% (0.1622 => 0.2033, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.24% (2.2022 => 2.4938, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.94% (7.0540 => 7.9671, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.01% (0.1432 => 0.1604, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (1.7609 => 1.9468, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 8.86% (10.4361 => 11.3605, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3473 => 0.3777, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1584 => 0.1722, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3543 => 0.3845, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 8.50% (0.3282 => 0.3561, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.35% (0.3497 => 0.3789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.34% (0.3561 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.33% (0.3543 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3828 => 0.4142, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3694 => 0.3991, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.3927 => 0.4240, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.90% (0.3886 => 0.4193, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.85% (9.4845 => 10.1342, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.4615 => 0.4898, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.08% (0.7433 => 0.7885, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.96% (0.3307 => 0.3504, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.83% (0.7115 => 0.7530, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.68% (5.7591 => 6.0860, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.60% (0.6675 => 0.7049, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.60% (0.5860 => 0.6188, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.57% (0.8172 => 0.8627, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.55% (8.1363 => 8.5876, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5925 => 0.6251, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (4.2646 => 4.4991, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 5.44% (0.6030 => 0.6358, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (1.3050 => 1.3759, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.5569 => 0.5868, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2107 => 0.2220, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.36% (3.3354 => 3.5141, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.35% (0.5105 => 0.5378, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.31% (0.7835 => 0.8251, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.5415 => 1.6213, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (5.0018 => 5.2576, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (4.9449 => 5.1953, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.06% (0.8067 => 0.8475, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 4.92% (0.3092 => 0.3244, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2758 => 0.2893, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.81% (0.9765 => 1.0235, std.dev.: 0.0083) MultiSource/Applications/Burg/burg: 4.78% (1.1642 => 1.2199, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (7.9617 => 8.3316, std.dev.: 0.0078) MultiSource/Applications/hbd/hbd: 4.61% (1.5603 => 1.6323, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.50% (0.3180 => 0.3323, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.46% (1.0722 => 1.1200, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (1.1861 => 1.2374, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 4.31% (0.3387 => 0.3533, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.30% (0.5020 => 0.5236, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.30% (3.8723 => 4.0388, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6456 => 0.6729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3422 => 0.3565, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4636 => 0.4827, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.02% (21.9371 => 22.8190, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.4064 => 0.4226, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.88% (0.6450 => 0.6700, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.88% (0.4103 => 0.4262, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3826 => 0.3973, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3650 => 0.3790, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.82% (2.0273 => 2.1048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.8921 => 0.9260, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 3.79% (2.2969 => 2.3839, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.78% (0.4289 => 0.4451, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3865 => 0.4005, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.5981 => 0.6193, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.47% (1.5859 => 1.6410, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.44% (0.3136 => 0.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.32% (0.3098 => 0.3201, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.4048 => 0.4179, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.21% (2.0665 => 2.1328, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.4186 => 1.4634, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (14.3668 => 14.7937, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.94% (2.2024 => 2.2672, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.1840 => 1.2159, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.8101 => 0.8253, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (3.1578 => 3.3858, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (1.1396 => 1.2162, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7531, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3483, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.62% (1.3045 => 1.3256, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2311, std.dev.: 0.0349) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7895, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5852, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.72% (5.2763 => 3.2331, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.37% (5.3855 => 3.8574, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.94% (5.3526 => 3.8573, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0708, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.11% (2.9384 => 2.5826, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.84% (22.1758 => 20.2154, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2656, std.dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4834, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.45% (1.8329 => 1.7146, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.93% (3.2827 => 3.1536, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5130, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4180, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/chomp: -2.81% (1.2373 => 1.2025, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0118, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9985, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5773, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2253, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (0.5229 => 0.5699, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.20% (14.9895 => 15.7691, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 3.63% (14.1553 => 14.6685, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 4.42% (4.1105 => 4.2922, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.06% (1.1048 => 1.2159, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (7.1582 => 7.3668, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.46% (3.4629 => 3.6519, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.6222 => 0.6351, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 12:37:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 14:37:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916193737.8D1202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3889?compare_to=3886&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3889, Order: 164000, Start Time: 2012-09-16 18:28:05, End Time: 2012-09-16 19:39:00 To: 3886, Order: 163999, Start Time: 2012-09-16 17:01:13, End Time: 2012-09-16 18:12:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (51 on baseline) Performance Improvements: 3 (33 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.15% (8.9044 => 9.2740, std.dev.: 0.0978) MultiSource/Applications/spiff/spiff: 2.51% (0.7543 => 0.7732, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.72% (43.5899 => 45.6491, std.dev.: 0.4784) SingleSource/Benchmarks/Misc/whetstone: 2.25% (2.3562 => 2.4091, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.35% (4.6608 => 4.7239, std.dev.: 0.0184) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (2.5699 => 2.6021, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.15% (4.5084 => 4.5604, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.49% (1.1977 => 1.1798, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -3.64% (4.2651 => 4.1100, std.dev.: 0.0459) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.83% (1.4459 => 1.4195, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.37% (1.0022 => 0.9985, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: -0.74% (0.5964 => 0.5920, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: -0.83% (0.1684 => 0.1670, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.45% (0.1564 => 0.1557, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3098 => 0.3101, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.2390 => 0.2396, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.88% (0.3186 => 0.3158, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.35% (0.2299 => 0.2307, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0448 => 0.0451, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -69.32% (0.0088 => 0.0027, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: 2.27% (0.0088 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 18.64% (0.0177 => 0.0210, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.06% (0.0178 => 0.0187, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0386 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.63% (0.0243 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.86% (0.0294 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.70% (0.0176 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.14% (0.0187 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.81% (0.0247 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: - (0.0321 => 0.0321, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1431 => 0.1432, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -8.13% (1.5147 => 1.3916, std.dev.: 0.0755) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.47% (0.1542 => 0.1473, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4064 => 0.4098, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.21% (0.1382 => 0.1454, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.01% (0.0613 => 0.0570, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.34% (0.0188 => 0.0230, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.13% (0.0585 => 0.0555, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1479 => 1.1478, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0016 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.55% (0.0011 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.03% (0.0591 => 0.0603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.36% (0.0203 => 0.0184, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.7821 => 0.7806, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 150.00% (0.0002 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.32% (1.6056 => 1.6004, std.dev.: 0.0130) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.98% (0.0121 => 0.0069, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.27% (4.1772 => 3.0800, std.dev.: 0.0556) SingleSource/Benchmarks/Shootout-C++/except: 81983.33% (0.0006 => 0.4925, std.dev.: 0.0092) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.54% (0.5309 => 0.5656, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 5.54% (2.1763 => 2.2969, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.6410 => 0.6743, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.91% (0.3582 => 0.3758, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.77% (15.3105 => 16.0402, std.dev.: 0.2141) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.6915 => 0.7231, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 4.33% (0.6173 => 0.6440, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 3.66% (1.3268 => 1.3753, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 3.09% (1.1440 => 1.1793, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: 3.07% (8.9977 => 9.2740, std.dev.: 0.0978) MultiSource/Applications/d/make_dparser: 2.84% (3.0225 => 3.1083, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.5150 => 1.5530, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 2.23% (29.3170 => 29.9694, std.dev.: 0.1878) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (1.2021 => 1.2179, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.12% (12.6413 => 12.7826, std.dev.: 0.0526) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.80% (0.0766 => 0.0910, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.94% (0.0917 => 0.1054, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 14.50% (0.3746 => 0.4289, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5557, std.dev.: 0.0208) SingleSource/Benchmarks/Stanford/Puzzle: 12.77% (0.1433 => 0.1616, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.60% (7.0025 => 7.6050, std.dev.: 0.0524) SingleSource/Benchmarks/McGill/chomp: 8.38% (1.0194 => 1.1048, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.05% (0.2857 => 0.3087, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.70% (1.0063 => 1.0838, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.46% (0.2694 => 0.2895, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7990, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.17% (40.4792 => 42.5738, std.dev.: 0.4094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3301 => 0.3470, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5399, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 3.76% (8.5113 => 8.8316, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/dt: 3.61% (0.9851 => 1.0207, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 3.53% (15.2242 => 15.7622, std.dev.: 0.0924) MultiSource/Benchmarks/Olden/power/power: 3.40% (1.4184 => 1.4666, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.01% (0.5876 => 0.6053, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 2.72% (2.3453 => 2.4091, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.41% (4.6127 => 4.7239, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/hash: 2.01% (0.6308 => 0.6435, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: 1.99% (5.1938 => 5.2971, std.dev.: 0.0296) MultiSource/Applications/siod/siod: 1.93% (3.5520 => 3.6207, std.dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: 1.79% (14.4877 => 14.7464, std.dev.: 0.0372) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4835, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.55% (2.5166 => 2.5556, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (2.4971 => 2.5349, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.21% (0.3497 => 0.2056, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.96% (5.2665 => 4.1100, std.dev.: 0.0459) SingleSource/Benchmarks/Shootout-C++/ary3: -20.74% (1.7473 => 1.3849, std.dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.46% (1.1647 => 0.9380, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.37% (8.1594 => 7.1499, std.dev.: 0.0484) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -9.32% (62.4126 => 56.5935, std.dev.: 0.0618) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.91% (2.4457 => 2.2279, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3671, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3515, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: -6.17% (3.4230 => 3.2119, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7922, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: -5.56% (1.4117 => 1.3332, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.27% (0.4140 => 0.3922, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -3.18% (7.6833 => 7.4388, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.94% (1.7361 => 1.6851, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: -2.92% (9.2503 => 8.9800, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1354, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3353, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.24% (3.7496 => 3.6657, std.dev.: 0.0260) MultiSource/Benchmarks/sim/sim: -1.92% (3.8907 => 3.8161, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4223, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: -1.67% (92.7467 => 91.1994, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2327, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.48% (61.1734 => 60.2697, std.dev.: 0.3003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.05% (0.9980 => 0.9985, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: -1.69% (0.6022 => 0.5920, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 0.24% (0.1666 => 0.1670, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1554 => 0.1557, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.58% (0.3083 => 0.3101, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2394 => 0.2396, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3175 => 0.3158, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2302 => 0.2307, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -69.66% (0.0089 => 0.0027, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0240 => 0.0210, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.60% (0.0192 => 0.0187, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -7.34% (1.5019 => 1.3916, std.dev.: 0.0755) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.87% (0.1501 => 0.1473, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.89% (0.4264 => 0.4098, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.1344 => 0.1454, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.23% (0.0589 => 0.0570, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.86% (0.0232 => 0.0230, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.15% (0.0639 => 0.0555, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.13% (1.1350 => 1.1478, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.34% (0.0637 => 0.0603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.20% (0.0246 => 0.0184, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.51% (0.7541 => 0.7806, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.17% (1.5363 => 1.6004, std.dev.: 0.0130) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.43% (0.0070 => 0.0069, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 12:55:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 14:55:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916195539.64E3F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3890?compare_to=3885&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3890, Order: 163999, Start Time: 2012-09-16 17:13:20, End Time: 2012-09-16 19:57:00 To: 3885, Order: 163997, Start Time: 2012-09-16 11:40:36, End Time: 2012-09-16 14:24:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -4.79% (0.2255 => 0.2147, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.59% (2.1254 => 2.0491, std.dev.: 0.0288) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3460 => 0.3798, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.75% (0.3465 => 0.3803, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3446 => 0.3781, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.72% (0.3488 => 0.3827, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.70% (0.3496 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3442 => 0.3774, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3469 => 0.3802, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.48% (0.3650 => 0.3996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.33% (0.3643 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.16% (0.3724 => 0.4065, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.79% (1.5932 => 1.7014, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5889 => 0.6262, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (1.6211 => 1.7211, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.00% (3.5627 => 3.7766, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.94% (0.4361 => 0.4620, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.90% (1.3152 => 1.3928, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (2.7292 => 2.8856, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (0.4994 => 0.5274, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.52% (5.5417 => 5.8475, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.08% (1.0781 => 1.1329, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (0.5026 => 0.5280, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (0.3930 => 0.4126, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 4.96% (0.7171 => 0.7527, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.95% (4.2109 => 4.4193, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 4.86% (2.1013 => 2.2034, std.dev.: 0.0067) SingleSource/Regression/C++/ofstream_ctor: 4.79% (0.3004 => 0.3148, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2875 => 0.3012, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.73% (23.5202 => 24.6319, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3195 => 0.3346, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.68% (0.2823 => 0.2955, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.66% (0.9909 => 1.0371, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 4.65% (0.2750 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.64% (0.2566 => 0.2685, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (1.8794 => 1.9656, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2813 => 0.2942, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (4.4195 => 4.6218, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (2.1653 => 2.2636, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.52% (4.6177 => 4.8263, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (0.3890 => 0.4064, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 4.44% (0.3267 => 0.3412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (2.0673 => 2.1589, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.41% (0.3060 => 0.3195, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2792 => 0.2915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.3258 => 0.3401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.33% (0.9697 => 1.0117, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.31% (0.6634 => 0.6920, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.29% (0.5900 => 0.6153, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (0.3625 => 0.3778, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.15% (1.4269 => 1.4861, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 4.13% (0.3726 => 0.3880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.12% (0.4146 => 0.4317, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.08% (0.3477 => 0.3619, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.02% (0.5546 => 0.5769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (0.4658 => 0.4845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4251 => 0.4419, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.3271 => 0.3398, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.3845 => 0.3992, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.75% (0.3336 => 0.3461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.74% (0.3690 => 0.3828, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0425, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.70% (0.6435 => 0.6673, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.65% (1.9966 => 2.0694, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.3981 => 0.4123, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 3.28% (2.0346 => 2.1014, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.84% (0.7426 => 0.7637, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (0.5361 => 0.5502, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (0.5584 => 0.5717, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (11.6398 => 11.9007, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (4.6926 => 4.7920, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6771, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std.dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6310, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4982, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4408, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5909, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5447, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8110, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0037) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7918, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -2.99% (17.2379 => 16.7224, std.dev.: 0.0601) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9747, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 13:08:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 15:08:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916200856.97C6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3891?compare_to=3887&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3891, Order: 164001, Start Time: 2012-09-16 18:55:54, End Time: 2012-09-16 20:10:17 To: 3887, Order: 163999, Start Time: 2012-09-16 17:13:13, End Time: 2012-09-16 18:27:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.77% (2.0176 => 2.3964, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.21% (3.9660 => 4.3312, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2596 => 0.2834, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.04% (0.7038 => 0.7674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4912, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.90% (0.7710 => 0.8396, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.6959 => 0.7564, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.60% (0.5265 => 0.5718, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.56% (0.9199 => 0.9986, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.48% (1.2193 => 1.3227, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.99% (1.1364 => 1.2272, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.96% (1.4563 => 1.5722, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.89% (13.8202 => 14.9111, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.74% (0.3022 => 0.3256, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.73% (0.5577 => 0.6008, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.57% (0.2760 => 0.2969, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.6283 => 0.6758, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (1.9828 => 2.1269, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.26% (0.4379 => 0.4697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3489 => 0.3742, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.19% (1.0313 => 1.1055, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.08% (0.2995 => 0.3207, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.06% (0.2988 => 0.3199, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.05% (1.1061 => 1.1841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.87% (0.8310 => 0.8881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.84% (3.8646 => 4.1289, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.2914 => 0.3113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.82% (7.2180 => 7.7104, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 6.78% (0.7506 => 0.8015, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.72% (0.4390 => 0.4685, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.2925 => 0.3120, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.64% (0.2243 => 0.2392, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.62% (0.7460 => 0.7954, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.55% (0.3220 => 0.3431, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9093, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3534 => 0.3765, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6.41% (2.1791 => 2.3187, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.15% (3.1889 => 3.3851, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.12% (0.3578 => 0.3797, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.12% (0.4003 => 0.4248, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.09% (0.3646 => 0.3868, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.06% (1.9270 => 2.0438, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.04% (1.3245 => 1.4045, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3914 => 0.4150, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.00% (16.6129 => 17.6105, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.97% (0.3650 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.97% (0.3601 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3789 => 0.4015, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3663 => 0.3881, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 5.93% (0.6744 => 0.7144, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 5.88% (0.3623 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.86% (0.3940 => 0.4171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1209, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.78% (0.6576 => 0.6956, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.74% (0.4113 => 0.4349, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.73% (1.3813 => 1.4604, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.71% (0.8698 => 0.9195, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.61% (14.8535 => 15.6862, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.60% (1.3819 => 1.4593, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.55% (1.2749 => 1.3457, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 5.49% (8.4961 => 8.9628, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.40% (0.6135 => 0.6466, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6141, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.32% (4.4433 => 4.6796, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.28% (0.8818 => 0.9284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (13.2842 => 13.9561, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1333 => 1.1902, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.87% (0.2504 => 0.2626, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.87% (4.6629 => 4.8899, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 4.84% (14.5298 => 15.2327, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2321 => 0.2430, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (6.5754 => 6.8807, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.62% (3.2742 => 3.4254, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.6250 => 0.6513, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.05% (0.9108 => 0.9477, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (4.9865 => 5.1880, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.5188 => 1.5772, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.68% (3.7467 => 3.8845, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (6.2785 => 6.4960, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (2.1007 => 2.1707, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 2.77% (33.2944 => 34.2177, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4927, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std.dev.: 0.0492) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4161, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6982, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0720, std.dev.: 0.0654) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6085, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5963, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.92% (22.5627 => 21.6772, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2706, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.92% (1.3780 => 1.2964, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5113, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5819, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.11% (26.5159 => 25.9556, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2406, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9932, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2411, std.dev.: 0.0165) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8731, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0626, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2405, std.dev.: 0.0357) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5653, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 13:22:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 15:22:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916202224.78E472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3892?compare_to=3888&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3892, Order: 164002, Start Time: 2012-09-16 19:03:53, End Time: 2012-09-16 20:23:45 To: 3888, Order: 163999, Start Time: 2012-09-16 17:13:30, End Time: 2012-09-16 18:33:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (721 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.5699 => 0.5709, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.00% (15.7691 => 15.7686, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 0.01% (14.6685 => 14.6698, std.dev.: 0.0166) MultiSource/Benchmarks/Bullet/bullet: 0.02% (81.8691 => 81.8867, std.dev.: 0.0283) MultiSource/Benchmarks/MallocBench/gs/gs: -0.00% (4.2922 => 4.2921, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.22% (1.2159 => 1.2186, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (7.3668 => 7.3605, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.00% (3.6519 => 3.6520, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.6351 => 0.6344, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (0.0649 => 0.0672, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.48% (63.2438 => 81.8867, std.dev.: 0.0283) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14250.42% (0.0720 => 10.3323, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.31% (10.3673 => 15.0649, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 25.40% (0.1622 => 0.2034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.34% (2.2022 => 2.4960, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.88% (7.0540 => 7.9629, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2548, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 12.08% (0.1432 => 0.1605) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.52% (1.7609 => 1.9462, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.77% (10.4361 => 11.3511, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3473 => 0.3777, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.65% (0.1584 => 0.1721, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 8.50% (0.3282 => 0.3561, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 8.38% (0.3543 => 0.3840, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.35% (0.3543 => 0.3839, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 8.35% (0.3497 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.30% (0.3516 => 0.3808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.23% (0.3561 => 0.3854, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3828 => 0.4136, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 8.01% (0.3694 => 0.3990, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.00% (0.1625 => 0.1755, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.00% (0.3927 => 0.4241, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.77% (0.3886 => 0.4188, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.92% (9.4845 => 10.1412, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.16% (0.7433 => 0.7891, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.8172 => 0.8671, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (0.4615 => 0.4896, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.01% (0.5105 => 0.5412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.3307 => 0.3505, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.96% (0.2700 => 0.2861, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.93% (0.7115 => 0.7537, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.6675 => 0.7069, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.80% (0.5860 => 0.6200, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.71% (5.7591 => 6.0878, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (4.2646 => 4.5040, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.3050 => 1.3776, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 5.55% (0.3423 => 0.3613, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (8.1363 => 8.5837, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.5569 => 0.5872, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 5.43% (0.5925 => 0.6247, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.42% (3.3354 => 3.5161, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.5415 => 1.6244, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 5.31% (0.6030 => 0.6350, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.26% (0.2758 => 0.2903, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.3121 => 0.3285, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.17% (0.3092 => 0.3252, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.9449 => 5.2001, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.09% (0.8067 => 0.8478, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.07% (5.0018 => 5.2554, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.9765 => 1.0250, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.84% (1.1642 => 1.2206, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (7.9617 => 8.3300, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 4.56% (0.7326 => 0.7660, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.49% (1.5603 => 1.6303, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 4.44% (1.0722 => 1.1198, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.40% (3.8723 => 4.0426, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.36% (1.1861 => 1.2378, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.5020 => 0.5237, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.31% (0.3387 => 0.3533, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.27% (0.3136 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3826 => 0.3989, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4636 => 0.4831, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.4103 => 0.4274, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6456 => 0.6719, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.06% (21.9371 => 22.8286, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.97% (0.6450 => 0.6706, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.96% (0.4064 => 0.4225, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.87% (2.0273 => 2.1057, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 3.84% (2.2969 => 2.3851, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.73% (0.3650 => 0.3786, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.72% (0.8921 => 0.9253, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5981 => 0.6192, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.49% (1.5859 => 1.6412, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.47% (0.3283 => 0.3397, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.38% (0.4620 => 0.4776, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.32% (0.3162 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3603 => 0.3720, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.4186 => 1.4646, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.4048 => 0.4179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.20% (0.3684 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (2.0665 => 2.1312, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (2.2024 => 2.2694, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7989, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.1840 => 1.2162, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.8101 => 0.8252, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.80% (1.2842 => 1.3073, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3125, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3830, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7582, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3635, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.23% (2.2771 => 2.3051, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2262, std.dev.: 0.0375) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.01% (26.0924 => 26.3547, std.dev.: 0.0186) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.68% (5.2763 => 3.2355, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.35% (5.3855 => 3.8585, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.94% (5.3526 => 3.8573, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0811, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.06% (2.9384 => 2.5839, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -8.77% (22.1758 => 20.2303, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4269, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (19.9488 => 18.2469, std.dev.: 0.0796) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7172, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5122, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4195, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/chomp: -2.85% (1.2373 => 1.2020, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9900, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0033, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5769, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7050, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.18% (0.5229 => 0.5709, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.20% (14.9895 => 15.7686, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 3.63% (14.1553 => 14.6698, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 4.42% (4.1105 => 4.2921, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.30% (1.1048 => 1.2186, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.83% (7.1582 => 7.3605, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.46% (3.4629 => 3.6520, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.96% (0.6222 => 0.6344, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 14:05:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 16:05:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916210504.244422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3893?compare_to=3889&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3893, Order: 164002, Start Time: 2012-09-16 19:55:02, End Time: 2012-09-16 21:06:27 To: 3889, Order: 164000, Start Time: 2012-09-16 18:28:05, End Time: 2012-09-16 19:39:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (54 on baseline) Performance Improvements: 1 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (1.4064 => 1.4270, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.0852 => 3.1209, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.01% (1.1896 => 1.2016, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.18% (21.9307 => 24.6023, std.dev.: 0.6030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.90% (1.6066 => 1.6372, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.56% (1.4195 => 1.4416, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.39% (2.2279 => 2.2588, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.23% (2.7129 => 2.7463, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.48% (1.2636 => 1.2322, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.27% (0.9985 => 1.0012, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 0.88% (0.5920 => 0.5972, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: -1.86% (0.1670 => 0.1639, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.45% (0.1557 => 0.1550, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (0.3101 => 0.3089, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.79% (0.2396 => 0.2377, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.44% (0.3158 => 0.3144, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.25% (0.2307 => 0.2255, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -11.31% (0.0451 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/2003-05-07-VarArgs: 207.41% (0.0027 => 0.0083, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.29% (0.0210 => 0.0219, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.43% (0.0187 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0386 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0298 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.19% (0.0323 => 0.0303, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -3.35% (0.0179 => 0.0173, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -40.84% (0.0191 => 0.0113, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.93% (0.0321 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -27.27% (0.0011 => 0.0008, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1432 => 0.1434, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.21% (1.3916 => 1.4919, std.dev.: 0.0277) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.97% (0.1473 => 0.1502, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.78% (0.4098 => 0.4171, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.99% (0.1454 => 0.1396, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.54% (0.0570 => 0.0613, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.87% (0.0230 => 0.0228, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.14% (0.0555 => 0.0639, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1478 => 1.1499, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0015 => 0.0010, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.46% (0.0603 => 0.0552, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.54% (0.0184 => 0.0183, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7806 => 0.7814, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.69% (1.6004 => 1.6114, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 75.36% (0.0069 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.58% (4.1772 => 3.0252, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/except: 82150.00% (0.0006 => 0.4935, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.5309 => 0.5646, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 5.84% (2.1763 => 2.3034, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.40% (0.6410 => 0.6756, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.98% (0.2552 => 0.2679, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.97% (0.3582 => 0.3760, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.18% (0.6173 => 0.6431, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 3.89% (15.3105 => 15.9056, std.dev.: 0.0863) MultiSource/Applications/hbd/hbd: 3.33% (1.3268 => 1.3710, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.90% (0.3901 => 0.4014, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.85% (29.3170 => 30.1515, std.dev.: 0.1296) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.7639 => 0.7828, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.3935 => 1.4270, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.5150 => 1.5503, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.98% (3.0225 => 3.0822, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.73% (1.2021 => 1.2229, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.60% (1.1827 => 1.2016, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.0758 => 3.1209, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.28% (4.7455 => 4.8061, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.4408 => 1.4589, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (6.2546 => 6.3329, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.41% (0.0766 => 0.0907, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 16.20% (21.1721 => 24.6023, std.dev.: 0.6030) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0369) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.09% (4.0101 => 4.5751, std.dev.: 0.0688) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 13.08% (0.3746 => 0.4236, std.dev.: 0.0097) SingleSource/Benchmarks/Stanford/Puzzle: 12.63% (0.1433 => 0.1614, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.95% (1.0063 => 1.1064, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6100, std.dev.: 0.0698) SingleSource/Benchmarks/McGill/chomp: 7.45% (1.0194 => 1.0953, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2857 => 0.3051, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8155, std.dev.: 0.0518) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.01% (40.4792 => 42.1039, std.dev.: 0.4553) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8292, std.dev.: 0.0281) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.87% (0.8498 => 0.8827, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 3.76% (8.5113 => 8.8312, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8736, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.03% (2.6656 => 2.7463, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.68% (14.4877 => 14.7314, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 1.68% (2.3453 => 2.3847, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (2.4455 => 2.4865, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.63% (1.6110 => 1.6372, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5339, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.09% (4.0659 => 4.1102, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.58% (5.2665 => 4.1829, std.dev.: 0.1360) SingleSource/Benchmarks/Shootout-C++/ary3: -20.20% (1.7473 => 1.3944, std.dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.45% (1.1647 => 0.9382, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0428) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5334, std.dev.: 0.2360) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.99% (3.2007 => 2.9449, std.dev.: 0.0682) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.64% (2.4457 => 2.2588, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.24% (3.6254 => 3.3630, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -6.53% (3.4230 => 3.1995, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.4441 => 1.3564, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.90% (4.6355 => 4.4083, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: -4.34% (1.4117 => 1.3504, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.13% (0.4140 => 0.3969, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: -3.87% (0.2664 => 0.2561, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6728, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (9.2503 => 8.9132, std.dev.: 0.0480) MultiSource/Applications/lambda-0_1_3/lambda: -3.27% (7.6833 => 7.4321, std.dev.: 0.0289) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2322, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8294, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2860, std.dev.: 0.0276) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0005) MultiSource/Applications/aha/aha: -2.65% (3.4286 => 3.3378, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.96% (3.7496 => 3.6761, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -1.75% (3.8907 => 3.8228, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4876 => 3.4288, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -1.64% (92.7467 => 91.2293, std.dev.: 0.4077) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.61% (1.8739 => 1.8438, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (9.3855 => 9.2457, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3165, std.dev.: 0.0757) SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.8200 => 3.7687, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.32% (0.9980 => 1.0012, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -0.83% (0.6022 => 0.5972, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: -1.62% (0.1666 => 0.1639, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.26% (0.1554 => 0.1550, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (0.3083 => 0.3089, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.2394 => 0.2377, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.98% (0.3175 => 0.3144, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.04% (0.2302 => 0.2255, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -10.91% (0.0449 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/2003-05-07-VarArgs: -6.74% (0.0089 => 0.0083, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.75% (0.0240 => 0.0219, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.06% (0.0192 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.48% (0.0324 => 0.0303, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -2.26% (0.0177 => 0.0173, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -40.21% (0.0189 => 0.0113, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -20.00% (0.0010 => 0.0008, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1429 => 0.1434, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -0.67% (1.5019 => 1.4919, std.dev.: 0.0277) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1501 => 0.1502, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.18% (0.4264 => 0.4171, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1344 => 0.1396, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.72% (0.0232 => 0.0228, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0639 => 0.0639, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.31% (1.1350 => 1.1499, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.34% (0.0637 => 0.0552, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.61% (0.0246 => 0.0183, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.62% (0.7541 => 0.7814, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.89% (1.5363 => 1.6114, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 14:51:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 16:51:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916215143.8B7342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3894?compare_to=3891&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3894, Order: 164003, Start Time: 2012-09-16 20:38:43, End Time: 2012-09-16 21:53:04 To: 3891, Order: 164001, Start Time: 2012-09-16 18:55:54, End Time: 2012-09-16 20:10:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (166 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.85% (79.9317 => 81.4118, std.dev.: 0.1485) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.2964 => 1.3111, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.00% (3.8164 => 3.7781, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.68% (2.0176 => 2.3944, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.21% (3.9660 => 4.3313, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.02% (0.7038 => 0.7673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.99% (1.3693 => 1.4924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (0.7710 => 0.8397, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.69% (0.9199 => 0.9998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.58% (0.5265 => 0.5717, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.58% (1.2193 => 1.3239, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.49% (0.6959 => 0.7550, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.13% (0.3899 => 0.4216, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.07% (1.4563 => 1.5738, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.01% (1.1364 => 1.2274, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 7.85% (13.8202 => 14.9055, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.67% (0.5577 => 0.6005, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.59% (0.6283 => 0.6760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.29% (1.0313 => 1.1065, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4379 => 0.4698, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.27% (0.3756 => 0.4029, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.18% (0.4791 => 0.5135, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (1.9828 => 2.1251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2655 => 0.2843, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.06% (1.1061 => 1.1842, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.99% (0.2988 => 0.3197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5637 => 0.6028, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.89% (3.8646 => 4.1309, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (7.2180 => 7.7143, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3149 => 0.3363, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.75% (0.7506 => 0.8013, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 6.75% (0.8310 => 0.8871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.56% (3.6692 => 3.9099, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4390 => 0.4676, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.32% (2.1791 => 2.3169, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.3245 => 1.4052, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.08% (16.6129 => 17.6231, std.dev.: 0.0303) SingleSource/UnitTests/ObjC/parameter-passing: 6.05% (0.4003 => 0.4245, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.02% (0.6744 => 0.7150, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.01% (3.1889 => 3.3807, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 6.01% (0.4113 => 0.4360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.96% (1.9270 => 2.0418, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/synchronized: 5.92% (0.3663 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.89% (0.3789 => 0.4012, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/property: 5.86% (0.3940 => 0.4171, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.85% (1.0594 => 1.1214, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-4: 5.84% (0.3646 => 0.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3601 => 0.3811, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3650 => 0.3862, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3623 => 0.3833, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.74% (0.8698 => 0.9197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.61% (14.8535 => 15.6864, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4591, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.58% (1.2749 => 1.3461, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (1.3813 => 1.4576, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.49% (8.4961 => 8.9623, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6135 => 0.6467, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.36% (4.3801 => 4.6147, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6791, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.30% (0.8818 => 0.9285, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.14% (13.2842 => 13.9668, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 5.05% (0.3131 => 0.3289, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1333 => 1.1900, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.84% (4.6629 => 4.8887, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2264, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2321 => 0.2432, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (6.5754 => 6.8829, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (3.2742 => 3.4240, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2841, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4805 => 0.5009, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.20% (4.9865 => 5.1959, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5188 => 1.5767, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.76% (3.7467 => 3.8877, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.51% (6.2785 => 6.4987, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (2.1007 => 2.1712, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.84% (33.2944 => 34.2391, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4961, std.dev.: 0.0263) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 26.02% (1.8175 => 2.2904, std.dev.: 0.0393) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6965, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0763, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5987, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.13% (3.6469 => 3.6881, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5942, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.00% (1.4298 => 1.4441, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.92% (0.4657 => 0.3869, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.04% (22.5627 => 21.6514, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2879, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9244, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5870, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.28% (26.5159 => 25.9116, std.dev.: 0.0291) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2407, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.22% (4.1080 => 4.0577, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2411, std.dev.: 0.0116) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2237, std.dev.: 0.0316) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4330, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2603, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 15:10:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 17:10:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916221041.718202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3895?compare_to=3892&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3895, Order: 164003, Start Time: 2012-09-16 20:52:20, End Time: 2012-09-16 22:12:02 To: 3892, Order: 164002, Start Time: 2012-09-16 19:03:53, End Time: 2012-09-16 20:23:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (721 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.60% (0.5709 => 0.5675, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 0.16% (15.7686 => 15.7946, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 0.02% (14.6698 => 14.6721, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 0.01% (81.8867 => 81.8933, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.2921 => 4.2978, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.2186 => 1.2173, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.3605 => 7.3632, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.09% (3.6520 => 3.6554, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.6344 => 0.6346, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1430 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (0.0672 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.49% (63.2438 => 81.8933, std.dev.: 0.0242) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.86% (0.0720 => 10.3319, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.16% (10.3673 => 15.1527, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/richards_benchmark: 26.51% (0.1622 => 0.2052, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.90% (2.2022 => 2.5083, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.43% (7.0540 => 8.0014, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.45% (1.1194 => 1.2588, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.76% (1.7609 => 1.9504, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.40% (0.3543 => 0.3876, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.26% (10.4361 => 11.4030, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.82% (0.3516 => 0.3826, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3497 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3543 => 0.3851, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3694 => 0.4007, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3828 => 0.4152, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.38% (0.3927 => 0.4256, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.26% (0.3886 => 0.4207, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.00% (0.1625 => 0.1755, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.27% (0.3177 => 0.3408, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.15% (9.4845 => 10.1628, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.4879 => 0.5218, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.7433 => 0.7906, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2700 => 0.2871, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 6.18% (0.3109 => 0.3301, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.96% (0.3307 => 0.3504, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 5.83% (0.7115 => 0.7530, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.82% (0.5860 => 0.6201, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.6675 => 0.7062, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.72% (5.7591 => 6.0888, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.70% (4.2646 => 4.5077, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 5.67% (0.3423 => 0.3617, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.66% (8.1363 => 8.5972, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.64% (0.5105 => 0.5393, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (0.8172 => 0.8630, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 5.59% (0.5925 => 0.6256, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.8067 => 0.8517, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 5.53% (3.3354 => 3.5198, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.3050 => 1.3771, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.49% (0.6030 => 0.6361, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.46% (0.5569 => 0.5873, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.5415 => 1.6255, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (5.0018 => 5.2671, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (4.9449 => 5.2065, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2107 => 0.2217, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.18% (0.2758 => 0.2901, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.17% (0.7835 => 0.8240, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 4.98% (0.3092 => 0.3246, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9765 => 1.0245, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 4.90% (1.1642 => 1.2213, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (7.9617 => 8.3495, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 4.79% (1.5603 => 1.6351, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 4.77% (0.4299 => 0.4504, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3441 => 0.3600, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.52% (1.0722 => 1.1207, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.43% (3.8723 => 4.0440, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.41% (1.1861 => 1.2384, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 4.40% (0.3387 => 0.3536, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.34% (0.5020 => 0.5238, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9371 => 22.8894, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3826 => 0.3989, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3422 => 0.3565, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.3136 => 0.3267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6456 => 0.6721, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4636 => 0.4826, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.09% (0.6450 => 0.6714, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (0.4064 => 0.4228, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.98% (2.0273 => 2.1080, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 3.96% (2.2969 => 2.3878, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 3.81% (0.8921 => 0.9261, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3865 => 0.4009, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.63% (0.5981 => 0.6198, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.4203 => 0.4348, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (1.5859 => 1.6401, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.4186 => 1.4670, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.40% (0.4620 => 0.4777, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3935 => 0.4067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.4048 => 0.4181, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.21% (2.0665 => 2.1329, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3603 => 0.3718, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (14.3668 => 14.8172, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.3684 => 0.3795, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.96% (2.2024 => 2.2675, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.75% (1.1840 => 1.2166, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.8101 => 0.8255, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3074, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (4.2280 => 4.3533, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7455, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.53% (0.9540 => 0.9686, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2330, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.47% (5.2763 => 3.2465, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.95% (5.3855 => 3.8803, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.51% (5.3526 => 3.8800, std.dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0907, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.87% (2.9384 => 2.5897, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -8.79% (22.1758 => 20.2263, std.dev.: 0.0181) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.16% (1.6925 => 1.4190, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3039, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.43% (1.8329 => 1.7151, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5081, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.6802 => 8.4362, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0036, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0028, std.dev.: 0.0135) SingleSource/UnitTests/Vector/multiplies: -1.83% (2.5528 => 2.5061, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5773, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8549, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.53% (0.5229 => 0.5675, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 5.37% (14.9895 => 15.7946, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 3.65% (14.1553 => 14.6721, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (4.1105 => 4.2978, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.18% (1.1048 => 1.2173, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.86% (7.1582 => 7.3632, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.56% (3.4629 => 3.6554, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.6222 => 0.6346, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.20% (0.2116 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 15:31:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 17:31:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120916223147.CBBF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3896?compare_to=3893&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3896, Order: 164005, Start Time: 2012-09-16 21:22:31, End Time: 2012-09-16 22:33:11 To: 3893, Order: 164002, Start Time: 2012-09-16 19:55:02, End Time: 2012-09-16 21:06:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (52 on baseline) Performance Improvements: 6 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2917 => 0.3066, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.83% (0.5571 => 0.5673, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.16% (1.4196 => 1.4361, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.59% (24.6023 => 21.5057, std.dev.: 0.9828) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (40.1004 => 39.2574, std.dev.: 0.2862) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.95% (1.6372 => 1.6052, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.45% (4.5542 => 4.4882, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/ReedSolomon: -1.32% (8.8312 => 8.7144, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.03% (1.4416 => 1.4268, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.89% (1.0012 => 0.9923, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.5972 => 0.5955, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 1.89% (0.1639 => 0.1670, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.65% (0.1550 => 0.1509, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (0.3089 => 0.3094, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.85% (0.2377 => 0.2333, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (0.3144 => 0.3131, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.42% (0.2255 => 0.2287, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 12.75% (0.0400 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 4.82% (0.0083 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 2.25% (0.0089 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.46% (0.0219 => 0.0218, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.27% (0.0117 => 0.0112, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0385 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0297 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.94% (0.0303 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -13.29% (0.0173 => 0.0150, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 42.48% (0.0113 => 0.0161, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -2.44% (0.0246 => 0.0240, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -7.10% (0.0324 => 0.0301, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -37.50% (0.0008 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1434 => 0.1431, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -0.37% (1.4919 => 1.4864, std.dev.: 0.0443) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.40% (0.1502 => 0.1538, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.20% (0.4171 => 0.4121, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.72% (0.1396 => 0.1420, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.36% (0.0613 => 0.0525, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.65% (0.0228 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.1499 => 1.1509, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0010 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.63% (0.0552 => 0.0543, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.65% (0.0183 => 0.0169, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.18% (0.7814 => 0.7800, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 0.01% (1.6114 => 1.6115, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.28% (0.0121 => 0.0065, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.85% (4.1772 => 3.0975, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/except: 82766.67% (0.0006 => 0.4972, std.dev.: 0.0106) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.44% (0.5309 => 0.5651, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 5.43% (2.1763 => 2.2945, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.12% (0.6410 => 0.6738, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.2552 => 0.2659, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.6915 => 0.7200, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 3.89% (0.6173 => 0.6413, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 3.84% (1.1653 => 1.2101, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 3.84% (1.0046 => 1.0432, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 3.59% (15.3105 => 15.8596, std.dev.: 0.1609) MultiSource/Applications/hbd/hbd: 2.94% (1.3268 => 1.3658, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.7639 => 0.7838, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 2.51% (29.3170 => 30.0530, std.dev.: 0.2029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5150 => 1.5528, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: 2.09% (1.1440 => 1.1679, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.92% (3.0225 => 3.0805, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.73% (0.7226 => 0.7351, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 1.70% (2.0972 => 2.1329, std.dev.: 0.0117) MultiSource/Applications/SPASS/SPASS: 1.68% (13.3238 => 13.5476, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.1827 => 1.1973, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.4189 => 1.4361, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0313) MultiSource/Applications/sgefa/sgefa: 13.96% (0.3746 => 0.4269, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5444, std.dev.: 0.0263) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6025, std.dev.: 0.0202) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.09% (0.2694 => 0.2912, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.75% (1.0063 => 1.0843, std.dev.: 0.0214) SingleSource/Benchmarks/McGill/chomp: 6.78% (1.0194 => 1.0885, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.51% (0.2857 => 0.3043, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8038, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8245, std.dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5369, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (40.4792 => 41.9192, std.dev.: 0.4615) SingleSource/Benchmarks/Misc/dt: 3.51% (0.9851 => 1.0197, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.6308 => 0.6517, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7144, std.dev.: 0.0249) MultiSource/Benchmarks/BitBench/five11/five11: 2.03% (5.1938 => 5.2994, std.dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: 1.78% (14.4877 => 14.7454, std.dev.: 0.0592) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4857, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 1.55% (3.5520 => 3.6071, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.53% (4.6127 => 4.6832, std.dev.: 0.0164) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5315, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 1.11% (2.5166 => 2.5446, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.41% (0.3497 => 0.2049, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.46% (5.2665 => 4.0835, std.dev.: 0.1369) SingleSource/Benchmarks/Shootout-C++/ary3: -20.55% (1.7473 => 1.3883, std.dev.: 0.0701) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.45% (1.1647 => 0.9382, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5455, std.dev.: 0.1440) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.22% (3.2007 => 2.9375, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.12% (2.4457 => 2.2471, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.24% (3.6254 => 3.3630, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -6.83% (3.4230 => 3.1893, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3516, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7921, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4080, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.06% (8.5323 => 8.1862, std.dev.: 0.1124) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.03% (0.4140 => 0.3973, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/misr: -3.82% (0.4296 => 0.4132, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.68% (1.7361 => 1.6722, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.34% (3.7496 => 3.6242, std.dev.: 0.0328) MultiSource/Applications/lambda-0_1_3/lambda: -3.24% (7.6833 => 7.4345, std.dev.: 0.0275) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -3.11% (9.2503 => 8.9629, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/ffbench: -3.01% (1.4117 => 1.3692, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0008) MultiSource/Applications/aha/aha: -2.80% (3.4286 => 3.3325, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2849, std.dev.: 0.0164) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.74% (1.2959 => 1.2604, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.52% (1.1683 => 1.1389, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -1.87% (3.8907 => 3.8179, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/neural/neural: -1.86% (1.0926 => 1.0723, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2163, std.dev.: 0.0106) MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (92.7467 => 91.0758, std.dev.: 0.1689) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: -1.43% (2.0192 => 1.9903, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.8200 => 3.7660, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3066, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.08% (4.5374 => 4.4882, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.57% (0.9980 => 0.9923, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -1.11% (0.6022 => 0.5955, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.24% (0.1666 => 0.1670, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.90% (0.1554 => 0.1509, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.36% (0.3083 => 0.3094, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.55% (0.2394 => 0.2333, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (0.3175 => 0.3131, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.65% (0.2302 => 0.2287, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.17% (0.0240 => 0.0218, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.67% (0.0192 => 0.0112, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -15.25% (0.0177 => 0.0150, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -14.81% (0.0189 => 0.0161, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -3.61% (0.0249 => 0.0240, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -7.38% (0.0325 => 0.0301, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.03% (1.5019 => 1.4864, std.dev.: 0.0443) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.47% (0.1501 => 0.1538, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.35% (0.4264 => 0.4121, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.65% (0.1344 => 0.1420, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.87% (0.0589 => 0.0525, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.21% (0.0232 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.40% (1.1350 => 1.1509, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (0.0246 => 0.0169, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.43% (0.7541 => 0.7800, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.89% (1.5363 => 1.6115, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.14% (0.0070 => 0.0065, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 16:08:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 18:08:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120916230801.E846E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3897?compare_to=3890&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3897, Order: 164003, Start Time: 2012-09-16 20:25:29, End Time: 2012-09-16 23:09:24 To: 3890, Order: 163999, Start Time: 2012-09-16 17:13:20, End Time: 2012-09-16 19:57:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.07% (0.3496 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3465 => 0.3777, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.97% (0.3488 => 0.3801, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3446 => 0.3754, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.87% (0.3460 => 0.3767, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3442 => 0.3747, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3469 => 0.3775, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.71% (0.3650 => 0.3968, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3643 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.40% (0.3724 => 0.4037, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.60% (1.5932 => 1.6984, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5826 => 0.6178, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 5.96% (0.5889 => 0.6240, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (0.4361 => 0.4611, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (3.5627 => 3.7666, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (1.3152 => 1.3884, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.33% (2.7292 => 2.8748, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.12% (5.5417 => 5.8254, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (0.5000 => 0.5241, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.79% (1.0781 => 1.1297, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.70% (0.7171 => 0.7508, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 4.69% (0.3004 => 0.3145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.64% (0.2566 => 0.2685, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.54% (4.2109 => 4.4020, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2750 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.49% (23.5202 => 24.5755, std.dev.: 0.0120) MultiSource/Applications/hexxagon/hexxagon: 4.45% (0.9909 => 1.0350, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (4.4195 => 4.6152, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.2736 => 0.2857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.39% (0.2823 => 0.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.35% (2.1653 => 2.2594, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.32% (0.5026 => 0.5243, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (2.1013 => 2.1919, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.31% (2.0673 => 2.1563, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2813 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.25% (0.3060 => 0.3190, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.23% (0.2811 => 0.2930, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.20% (4.6177 => 4.8118, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.16% (0.2911 => 0.3032, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.14% (0.4029 => 0.4196, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3096 => 0.3223, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.08% (0.5900 => 0.6141, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (0.3625 => 0.3773, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (1.8794 => 1.9559, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.99% (0.3084 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.98% (0.4146 => 0.4311, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3317 => 0.3449, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.96% (0.6634 => 0.6897, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 3.95% (1.4269 => 1.4833, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.94% (0.3678 => 0.3823, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 3.91% (0.3477 => 0.3613, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.84% (0.4139 => 0.4298, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.84% (0.5546 => 0.5759, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3282 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.3271 => 0.3396, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4251 => 0.4412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.74% (0.3690 => 0.3828, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.62% (0.9697 => 1.0048, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 3.54% (0.3336 => 0.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.45% (0.5012 => 0.5185, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.3981 => 0.4117, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (1.9694 => 2.0355, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.24% (0.7875 => 0.8130, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.22% (1.9966 => 2.0609, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 3.11% (2.0346 => 2.0979, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 2.76% (0.4847 => 0.4981, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (0.7426 => 0.7630, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (0.5361 => 0.5505, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (0.5584 => 0.5707, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.07% (4.6926 => 4.7898, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (11.6398 => 11.8755, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6751, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.0213) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6417, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5048, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4508, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5911, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5515, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7853, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8008, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.49% (17.2379 => 16.8094, std.dev.: 0.0296) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9652, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 16:46:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 18:46:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120916234644.504662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3898?compare_to=3894&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3898, Order: 164009, Start Time: 2012-09-16 22:33:43, End Time: 2012-09-16 23:48:06 To: 3894, Order: 164003, Start Time: 2012-09-16 20:38:43, End Time: 2012-09-16 21:53:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.28% (0.5386 => 0.5509, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.63% (2.0176 => 2.3935, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.55% (0.7710 => 0.8446, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.28% (0.5818 => 0.6358, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3324, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.11% (1.3693 => 1.4940, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.98% (0.7038 => 0.7670, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.90% (0.4328 => 0.4713, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.86% (0.2721 => 0.2962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.66% (0.5265 => 0.5721, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.53% (1.2193 => 1.3233, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.32% (0.6959 => 0.7538, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.05% (1.4563 => 1.5736, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.00% (1.1364 => 1.2273, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.83% (13.8202 => 14.9029, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.73% (0.5577 => 0.6008, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.6283 => 0.6758, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2765 => 0.2972, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2966 => 0.3187, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (1.9828 => 2.1293, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.2988 => 0.3207, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4390 => 0.4711, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 7.24% (1.0313 => 1.1060, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.24% (0.4791 => 0.5138, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.24% (0.3756 => 0.4028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.06% (1.1061 => 1.1842, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 6.95% (0.3868 => 0.4137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.89% (7.2180 => 7.7153, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 6.88% (3.8646 => 4.1303, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.82% (0.7506 => 0.8018, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 6.77% (0.8310 => 0.8873, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.2925 => 0.3120, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.63% (3.6692 => 3.9125, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.41% (2.1791 => 2.3187, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/exceptions: 6.18% (0.3914 => 0.4156, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.12% (0.4003 => 0.4248, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.3245 => 1.4052, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.07% (3.1889 => 3.3824, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.05% (0.6576 => 0.6974, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.03% (16.6129 => 17.6150, std.dev.: 0.0334) MultiSource/Benchmarks/McCat/05-eks/eks: 6.01% (0.4113 => 0.4360, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 5.99% (0.6744 => 0.7148, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3789 => 0.4015, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.96% (0.3940 => 0.4175, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.95% (0.3646 => 0.3863, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 5.94% (1.9270 => 2.0414, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3601 => 0.3813, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: 5.87% (0.2945 => 0.3118, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.86% (0.3650 => 0.3864, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1210, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.8698 => 0.9192, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.66% (1.2749 => 1.3470, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.64% (14.8535 => 15.6918, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (1.3819 => 1.4577, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.48% (8.4961 => 8.9615, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.3813 => 1.4561, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (4.3801 => 4.6154, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.34% (4.4433 => 4.6804, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.27% (0.8818 => 0.9283, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (13.2842 => 13.9643, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1333 => 1.1902, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.86% (4.6629 => 4.8896, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2321 => 0.2432, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.78% (14.5298 => 15.2236, std.dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (6.5754 => 6.8811, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 4.51% (1.2292 => 1.2846, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.2742 => 3.4213, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6250 => 0.6515, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.19% (4.9865 => 5.1952, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.16% (0.9108 => 0.9487, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4805 => 0.4996, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 3.80% (3.7467 => 3.8890, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.70% (1.5188 => 1.5750, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4997, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (2.1007 => 2.1713, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.92% (33.2944 => 34.2663, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4954, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 26.34% (1.8175 => 2.2963, std.dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.08% (1.2998 => 1.3788, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6972, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.99% (10.7476 => 11.0691, std.dev.: 0.0548) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5946, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6017, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.14% (1.4298 => 1.4461, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.05% (22.5627 => 21.6499, std.dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2842, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.18% (1.3780 => 1.2928, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.48% (3.0263 => 2.9211, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9179, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5942, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9054, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2566, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2390, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (4.1080 => 4.0615, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2334, std.dev.: 0.0333) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4321, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2610, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5653, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 16:58:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 18:58:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120916235841.3A8B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3899?compare_to=3895&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3899, Order: 164009, Start Time: 2012-09-16 22:40:29, End Time: 2012-09-17 00:00:03 To: 3895, Order: 164003, Start Time: 2012-09-16 20:52:20, End Time: 2012-09-16 22:12:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (721 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.35% (0.5675 => 0.5695, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -0.02% (15.7946 => 15.7920, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: -0.15% (14.6721 => 14.6506, std.dev.: 0.0152) MultiSource/Benchmarks/Bullet/bullet: -0.01% (81.8933 => 81.8883, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 0.23% (4.2978 => 4.3078, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2173 => 1.2170, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.3632 => 7.3628, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.02% (3.6554 => 3.6547, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.6346 => 0.6355, std.dev.: 0.0087) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1428 => 0.1429, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.30% (0.0694 => 0.0685, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.48% (63.2438 => 81.8883, std.dev.: 0.0026) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14256.67% (0.0720 => 10.3368, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.15% (10.3673 => 15.1523, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.93% (2.2022 => 2.5089, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.34% (7.0540 => 7.9950, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.46% (1.1194 => 1.2589, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.75% (1.7609 => 1.9502, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.42% (10.4361 => 11.4187, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/trivial-interface: 8.93% (0.3473 => 0.3783, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3543 => 0.3857, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.84% (0.3282 => 0.3572, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3561 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.75% (0.3543 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3497 => 0.3801, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.62% (0.3516 => 0.3819, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3694 => 0.4007, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.36% (0.3828 => 0.4148, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.28% (0.3927 => 0.4252, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.03% (0.3886 => 0.4198, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.12% (9.4845 => 10.1601, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.4879 => 0.5218, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7433 => 0.7907, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.37% (0.4615 => 0.4909, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2700 => 0.2867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.5569 => 0.5911, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 6.01% (0.3109 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.3307 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.91% (0.2554 => 0.2705, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 5.82% (0.7115 => 0.7529, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.81% (0.6675 => 0.7063, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (8.1363 => 8.5960, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (4.2646 => 4.5049, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5860 => 0.6189, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 5.61% (0.3423 => 0.3615, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.57% (5.7591 => 6.0799, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.8172 => 0.8622, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.3050 => 1.3768, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.47% (3.3354 => 3.5178, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 5.43% (0.5925 => 0.6247, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (1.5415 => 1.6249, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 5.37% (0.7835 => 0.8256, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 5.32% (0.6030 => 0.6351, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.8067 => 0.8495, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2107 => 0.2217, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.19% (5.0018 => 5.2614, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (4.9449 => 5.2006, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.15% (0.2758 => 0.2900, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.06% (0.3441 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 5.02% (1.5603 => 1.6386, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (0.9765 => 1.0241, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.82% (1.1642 => 1.2203, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.70% (7.9617 => 8.3360, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 4.70% (0.4299 => 0.4501, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.70% (0.7326 => 0.7670, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 4.55% (0.3387 => 0.3541, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.5020 => 0.5246, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 4.44% (1.0722 => 1.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2386, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.37% (0.3180 => 0.3319, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.37% (21.9371 => 22.8957, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 4.36% (3.8723 => 4.0413, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.25% (0.4636 => 0.4833, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.20% (0.4289 => 0.4469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3422 => 0.3564, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6456 => 0.6721, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.4103 => 0.4269, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.01% (0.4064 => 0.4227, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.98% (2.0273 => 2.1080, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.92% (0.6450 => 0.6703, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.79% (2.2969 => 2.3840, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.8921 => 0.9257, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3650 => 0.3787, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3865 => 0.4008, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.66% (0.5981 => 0.6200, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.55% (1.5859 => 1.6422, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.52% (0.4203 => 0.4351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.3136 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.4186 => 1.4675, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.33% (0.4048 => 0.4183, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.28% (0.3603 => 0.3721, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0665 => 2.1324, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (14.3668 => 14.8228, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (2.2024 => 2.2693, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.1840 => 1.2157, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.8101 => 0.8254, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.87% (1.2842 => 1.3082, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.83% (1.1145 => 1.3689, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.25% (3.1578 => 3.3868, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3514, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7880, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2272, std.dev.: 0.0161) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.02% (26.0924 => 26.3588, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.51% (5.2763 => 3.2443, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.98% (5.3855 => 3.8788, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.47% (5.3526 => 3.8821, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1167, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.94% (2.9384 => 2.5876, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.71% (22.1758 => 20.2452, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2597, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4950, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9834, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -2.89% (1.2373 => 1.2015, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.6802 => 8.4362, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9910, std.dev.: 0.0360) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5766, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2207, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.91% (0.5229 => 0.5695, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.35% (14.9895 => 15.7920, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: 3.50% (14.1553 => 14.6506, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.1105 => 4.3078, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.16% (1.1048 => 1.2170, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.86% (7.1582 => 7.3628, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.54% (3.4629 => 3.6547, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.14% (0.6222 => 0.6355, std.dev.: 0.0087) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 19:20:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Sep 2012 21:20:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120917022000.C64AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3900?compare_to=3897&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3900, Order: 164009, Start Time: 2012-09-16 23:37:50, End Time: 2012-09-17 02:21:23 To: 3897, Order: 164003, Start Time: 2012-09-16 20:25:29, End Time: 2012-09-16 23:09:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.18% (0.3870 => 0.4380, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3446 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3465 => 0.3795, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3488 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3442 => 0.3764, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3496 => 0.3822, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.31% (0.3460 => 0.3782, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3469 => 0.3790, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.07% (0.3650 => 0.3981, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3643 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.3724 => 0.4058, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.35% (1.5932 => 1.7103, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5826 => 0.6181, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.96% (1.6211 => 1.7177, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.79% (3.5627 => 3.7691, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.58% (1.3152 => 1.3886, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.46% (2.7292 => 2.8782, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 5.41% (5.5417 => 5.8416, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.33% (0.3004 => 0.3164, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (0.5000 => 0.5253, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.99% (1.0781 => 1.1319, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.95% (0.3195 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.87% (0.2875 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.76% (0.2750 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 4.74% (0.7171 => 0.7511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.68% (0.2823 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 4.62% (0.2813 => 0.2943, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.62% (4.2109 => 4.4055, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.61% (0.9909 => 1.0366, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.60% (0.2780 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2738 => 0.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3258 => 0.3407, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.54% (0.2729 => 0.2853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.54% (0.3060 => 0.3199, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.2911 => 0.3043, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 4.53% (0.3267 => 0.3415, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (2.0673 => 2.1609, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.48% (23.5202 => 24.5734, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.3096 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.45% (0.2811 => 0.2936, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 4.44% (4.6177 => 4.8229, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (4.4195 => 4.6150, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (0.5026 => 0.5248, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.3903 => 0.4071, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3625 => 0.3781, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.25% (0.6634 => 0.6916, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3678 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (2.1013 => 2.1901, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.5900 => 0.6149, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (1.8794 => 1.9587, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.4139 => 0.4313, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.20% (0.3690 => 0.3845, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 4.17% (2.1653 => 2.2556, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 4.16% (0.3317 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3726 => 0.3881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.12% (0.3348 => 0.3486, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.12% (0.4251 => 0.4426, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3282 => 0.3416, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.93% (0.3336 => 0.3467, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.3084 => 0.3205, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.91% (1.4269 => 1.4827, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.77% (0.5546 => 0.5755, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3981 => 0.4130, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.65% (0.6435 => 0.6670, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.3845 => 0.3985, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.61% (0.5012 => 0.5193, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (1.9694 => 2.0405, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.57% (0.9697 => 1.0043, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.49% (0.7875 => 0.8150, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.11% (2.0346 => 2.0978, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (0.7426 => 0.7639, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.87% (0.4847 => 0.4986, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (0.5361 => 0.5510, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (0.5584 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (11.6398 => 11.8982, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (4.6926 => 4.7942, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8927, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6377, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2095, std.dev.: 0.0453) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5057, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4516, std.dev.: 0.0135) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2908, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5946, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5792, std.dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7999, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8280, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5814, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (16.2163 => 15.9538, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 23:21:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 01:21:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917062126.484842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3901?compare_to=3896&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3901, Order: 164012, Start Time: 2012-09-17 05:11:47, End Time: 2012-09-17 06:22:50 To: 3896, Order: 164005, Start Time: 2012-09-16 21:22:31, End Time: 2012-09-16 22:33:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (49 on baseline) Performance Improvements: 1 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 896 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.34% (2.6771 => 2.7397, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.03% (1.2689 => 1.2946, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.47% (4.3062 => 4.3697, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/ReedSolomon: 1.46% (8.7144 => 8.8414, std.dev.: 0.0339) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.49% (45.4266 => 43.8400, std.dev.: 0.5549) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.16% (0.9923 => 0.9808, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 0.65% (0.5955 => 0.5994, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -2.51% (0.1670 => 0.1628, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.78% (0.1509 => 0.1566, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.87% (0.3094 => 0.3036, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.50% (0.2333 => 0.2298, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.72% (0.3131 => 0.3185, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.75% (0.2287 => 0.2247, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -0.44% (0.0451 => 0.0449, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.47% (0.0218 => 0.0243, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 69.64% (0.0112 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0384 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0296 => 0.0295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.71% (0.0282 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0321 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 18.00% (0.0150 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 17.39% (0.0161 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.75% (0.0240 => 0.0249, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 7.31% (0.0301 => 0.0323, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1431 => 0.1434, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -2.01% (1.4864 => 1.4565, std.dev.: 0.0236) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.06% (0.1538 => 0.1491, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.94% (0.4121 => 0.4201, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.24% (0.1420 => 0.1374, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 66.67% (0.0003 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.67% (0.0525 => 0.0581, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.46% (0.0206 => 0.0203, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1509 => 1.1474, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 140.00% (0.0005 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.31% (0.0543 => 0.0599, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.20% (0.0169 => 0.0193, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.47% (0.7800 => 0.7837, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.22% (1.6115 => 1.6080, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 86.15% (0.0065 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.85% (4.1772 => 3.0974, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/except: 81950.00% (0.0006 => 0.4923, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.07% (0.0745 => 0.0902, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.71% (0.5309 => 0.5665, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 6.00% (2.1763 => 2.3068, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.80% (0.6410 => 0.6782, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.33% (0.3582 => 0.3773, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.2552 => 0.2668, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.95% (0.6173 => 0.6417, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 3.80% (0.6915 => 0.7178, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3.56% (1.1653 => 1.2068, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.52% (1.0046 => 1.0400, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 3.48% (15.3105 => 15.8426, std.dev.: 0.0814) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.5150 => 1.5669, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 3.10% (29.3170 => 30.2270, std.dev.: 0.0553) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.7639 => 0.7827, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.73% (0.0263 => 0.0378, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/ary3: 14.84% (1.7426 => 2.0012, std.dev.: 0.0438) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5559, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.09% (0.0917 => 0.1037, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1433 => 0.1583, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6276, std.dev.: 0.0468) SingleSource/Benchmarks/McGill/chomp: 8.08% (1.0194 => 1.1018, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.96% (1.0063 => 1.0864, std.dev.: 0.0263) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.11% (0.2857 => 0.3060, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7958, std.dev.: 0.0532) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: 4.22% (0.9851 => 1.0267, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.98% (40.4792 => 42.0922, std.dev.: 0.2197) SingleSource/Benchmarks/Misc/ReedSolomon: 3.88% (8.5113 => 8.8414, std.dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (4.2129 => 4.3697, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 3.45% (15.2242 => 15.7492, std.dev.: 0.0785) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4646, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.78% (2.6656 => 2.7397, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash: 2.36% (0.6308 => 0.6457, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 2.11% (5.1938 => 5.3035, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.73% (1.2726 => 1.2946, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 1.63% (3.5520 => 3.6099, std.dev.: 0.0175) MultiSource/Applications/hexxagon/hexxagon: 1.60% (14.4877 => 14.7199, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4455 => 2.4828, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.6127 => 4.6790, std.dev.: 0.0233) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5312, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 1.04% (2.4013 => 2.4262, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.75% (0.3497 => 0.2037, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.04% (5.2665 => 4.1584, std.dev.: 0.0893) SingleSource/Benchmarks/Shootout-C++/ary3: -20.09% (1.7473 => 1.3962, std.dev.: 0.0489) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.41% (1.1647 => 0.9386, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.41% (62.4126 => 56.5390, std.dev.: 0.0960) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.69% (1.4034 => 1.2815, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9416, std.dev.: 0.0228) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.11% (3.6254 => 3.3675, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -6.93% (3.4230 => 3.1859, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.04% (2.4457 => 2.2981, std.dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4095, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/ffbench: -4.20% (1.4117 => 1.3524, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.58% (45.4683 => 43.8400, std.dev.: 0.5549) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (9.2503 => 8.9267, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.47% (1.7361 => 1.6758, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: -3.37% (7.6833 => 7.4242, std.dev.: 0.0396) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.98% (3.7496 => 3.6380, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.85% (0.4140 => 0.4022, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2901, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.63% (1.1683 => 1.1376, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.59% (1.2722 => 1.2393, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -1.86% (92.7467 => 91.0186, std.dev.: 0.2762) MultiSource/Benchmarks/FreeBench/neural/neural: -1.86% (1.0926 => 1.0723, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.85% (0.6119 => 0.6006, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.4876 => 3.4243, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -1.75% (3.8907 => 3.8225, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2235, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3178, std.dev.: 0.0535) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7683, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.72% (0.9980 => 0.9808, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: -0.46% (0.6022 => 0.5994, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -2.28% (0.1666 => 0.1628, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.77% (0.1554 => 0.1566, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.52% (0.3083 => 0.3036, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.01% (0.2394 => 0.2298, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.31% (0.3175 => 0.3185, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.39% (0.2302 => 0.2247, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1429 => 0.1434, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -3.02% (1.5019 => 1.4565, std.dev.: 0.0236) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.67% (0.1501 => 0.1491, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.48% (0.4264 => 0.4201, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.23% (0.1344 => 0.1374, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.36% (0.0589 => 0.0581, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.50% (0.0232 => 0.0203, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.21% (0.0639 => 0.0561, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.09% (1.1350 => 1.1474, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.0637 => 0.0599, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.54% (0.0246 => 0.0193, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.93% (0.7541 => 0.7837, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.67% (1.5363 => 1.6080, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 23:36:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 01:36:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917063635.9C63F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3902?compare_to=3898&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3902, Order: 164012, Start Time: 2012-09-17 05:23:41, End Time: 2012-09-17 06:37:58 To: 3898, Order: 164009, Start Time: 2012-09-16 22:33:43, End Time: 2012-09-16 23:48:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9519 => 8.0510, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.67% (2.0176 => 2.3943, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.32% (0.1410 => 0.1626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7061 => 0.7722, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.18% (3.9660 => 4.3300, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.98% (0.7710 => 0.8402, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4912, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.71% (0.4328 => 0.4705, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.70% (0.5265 => 0.5723, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.62% (0.9199 => 0.9992, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.55% (1.2193 => 1.3236, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.51% (0.6959 => 0.7551, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.10% (0.5577 => 0.6029, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.05% (1.4563 => 1.5736, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.96% (1.1364 => 1.2269, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.82% (13.8202 => 14.9013, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.74% (0.3022 => 0.3256, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.69% (0.3485 => 0.3753, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.58% (0.6283 => 0.6759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.57% (0.2760 => 0.2969, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.39% (0.3489 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.33% (0.3246 => 0.3484, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.27% (0.3756 => 0.4029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.23% (1.9828 => 2.1261, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.20% (1.0313 => 1.1056, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.20% (0.4016 => 0.4305, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2761 => 0.2956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.05% (0.3293 => 0.3525, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 7.03% (0.2988 => 0.3198, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.02% (1.1061 => 1.1838, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.95% (0.7506 => 0.8028, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.94% (0.2925 => 0.3128, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (3.8646 => 4.1317, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/moments: 6.90% (0.3868 => 0.4135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (7.2180 => 7.7146, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 6.82% (0.8310 => 0.8877, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 6.78% (0.3453 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.7460 => 0.7959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.52% (3.6692 => 3.9085, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.41% (2.1791 => 2.3188, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 6.15% (0.3578 => 0.3798, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.08% (1.9270 => 2.0442, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.07% (3.1889 => 3.3824, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/parameter-passing: 6.05% (0.4003 => 0.4245, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.04% (0.6576 => 0.6973, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.00% (1.3245 => 1.4040, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3789 => 0.4015, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.96% (16.6129 => 17.6026, std.dev.: 0.0293) MultiSource/Benchmarks/McCat/05-eks/eks: 5.96% (0.4113 => 0.4358, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.95% (0.3650 => 0.3867, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.90% (0.6744 => 0.7142, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.84% (0.3663 => 0.3877, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.82% (1.0594 => 1.1211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.79% (0.3940 => 0.4168, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3623 => 0.3832, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.73% (0.8698 => 0.9196, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.59% (14.8535 => 15.6845, std.dev.: 0.0189) MultiSource/Applications/SIBsim4/SIBsim4: 5.51% (1.2749 => 1.3452, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (1.3819 => 1.4578, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.47% (8.4961 => 8.9607, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.46% (0.6135 => 0.6470, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.3813 => 1.4563, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.35% (0.2859 => 0.3012, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6136, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6792, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.26% (0.8818 => 0.9282, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.19% (13.2842 => 13.9730, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.05% (0.3131 => 0.3289, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.89% (4.6629 => 4.8909, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.88% (1.1333 => 1.1886, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.87% (14.5298 => 15.2372, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 4.71% (6.5754 => 6.8851, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.51% (3.2742 => 3.4218, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.9108 => 0.9491, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.19% (0.6250 => 0.6512, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.15% (4.9865 => 5.1935, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4805 => 0.4994, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 3.81% (3.7467 => 3.8894, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (1.5188 => 1.5752, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2785 => 6.4980, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1703, std.dev.: 0.0201) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2499, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4927, std.dev.: 0.0233) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.87% (0.4846 => 0.6972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5101, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2733, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.74% (1.1560 => 1.2570, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4159, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.05% (1.2998 => 1.3784, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0028, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5485, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0722, std.dev.: 0.0377) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6028, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (1.9433 => 1.9708, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.22% (7.9275 => 8.0239, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4456, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5876, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.05% (22.5627 => 21.6484, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2810, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.94% (1.3780 => 1.2961, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9224, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5844, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.26% (26.5159 => 25.9172, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.23% (4.1080 => 4.0576, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2414, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4326, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2388, std.dev.: 0.0365) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 16 23:42:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 01:42:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917064211.77F072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3903?compare_to=3899&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3903, Order: 164012, Start Time: 2012-09-17 05:23:48, End Time: 2012-09-17 06:43:34 To: 3899, Order: 164009, Start Time: 2012-09-16 22:40:29, End Time: 2012-09-17 00:00:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (124 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (724 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.62% (77.8256 => 80.6460, std.dev.: 0.1942) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.6504 => 56.5652, std.dev.: 0.0522) SingleSource/Benchmarks/Misc/lowercase: 1.35% (7.9454 => 8.0528, std.dev.: 0.0200) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.44% (0.5695 => 0.5670, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.04% (15.7920 => 15.7981, std.dev.: 0.0283) MultiSource/Applications/kimwitu++/kc: 0.10% (14.6506 => 14.6655, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: -0.01% (81.8883 => 81.8770, std.dev.: 0.0318) MultiSource/Benchmarks/MallocBench/gs/gs: -0.32% (4.3078 => 4.2941, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2170 => 1.2177, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.3628 => 7.3638, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.12% (3.6547 => 3.6592, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.6355 => 0.6347, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1429 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.29% (0.0685 => 0.0687, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.46% (63.2438 => 81.8770, std.dev.: 0.0318) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.00% (0.0720 => 10.3284, std.dev.: 0.0067) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.06% (10.3673 => 15.1424, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 26.39% (0.1622 => 0.2050, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.94% (2.2022 => 2.5092, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.39% (7.0540 => 7.9983, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.36% (1.1194 => 1.2578, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.69% (0.1566 => 0.1749, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.76% (1.7609 => 1.9504, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.27% (10.4361 => 11.4031, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.84% (0.3282 => 0.3572, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.78% (0.3543 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3497 => 0.3803, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3694 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.39% (0.3828 => 0.4149, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.35% (0.3927 => 0.4255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.11% (0.3886 => 0.4201, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.08% (9.4845 => 10.1560, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.97% (0.4879 => 0.5219, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7433 => 0.7905, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.08% (0.3109 => 0.3298, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.96% (0.7115 => 0.7539, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.77% (0.6675 => 0.7060, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.72% (0.2271 => 0.2401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (8.1363 => 8.5987, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.67% (4.2646 => 4.5066, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 5.67% (0.3423 => 0.3617, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5860 => 0.6189, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.60% (5.7591 => 6.0816, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 5.59% (0.5925 => 0.6256, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.58% (0.5105 => 0.5390, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5415 => 1.6275, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.3050 => 1.3773, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 5.41% (0.6030 => 0.6356, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.40% (3.3354 => 3.5155, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.8172 => 0.8613, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.32% (0.5569 => 0.5865, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (5.0018 => 5.2654, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.25% (4.9449 => 5.2044, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.8067 => 0.8488, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.11% (0.2758 => 0.2899, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.03% (0.7835 => 0.8229, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: 4.85% (1.5603 => 1.6359, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.84% (1.1642 => 1.2205, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.81% (0.9765 => 1.0235, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (7.9617 => 8.3410, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.3180 => 0.3331, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.68% (0.4299 => 0.4500, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.57% (0.7326 => 0.7661, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.5020 => 0.5246, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.49% (1.0722 => 1.1203, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.43% (3.8723 => 4.0439, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.42% (1.1861 => 1.2385, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.37% (0.3387 => 0.3535, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.36% (21.9371 => 22.8939, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3422 => 0.3564, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.4636 => 0.4828, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.12% (0.6456 => 0.6722, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.4064 => 0.4229, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.94% (2.2969 => 2.3874, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3865 => 0.4017, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 3.89% (2.0273 => 2.1062, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.81% (0.8921 => 0.9261, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3826 => 0.3970, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3650 => 0.3787, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5981 => 0.6203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.4203 => 0.4348, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (1.5859 => 1.6405, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.41% (0.3136 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.39% (0.3098 => 0.3203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.36% (0.4048 => 0.4184, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 3.34% (0.3232 => 0.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.4186 => 1.4646, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0665 => 2.1335, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8106, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/lists1: 3.07% (0.3684 => 0.3797, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.2024 => 2.2698, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.75% (1.1840 => 1.2166, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.8101 => 0.8254, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.80% (1.2842 => 1.3073, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3481, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2401, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.49% (5.2763 => 3.2454, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.96% (5.3855 => 3.8799, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.57% (5.3526 => 3.8771, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0890, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.92% (2.9384 => 2.5880, std.dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: -8.78% (22.1758 => 20.2284, std.dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3022, std.dev.: 0.0757) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (1.8329 => 1.7144, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1511, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5054, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4263, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9920, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0034, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.6441 => 4.5754, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2261, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.43% (0.5229 => 0.5670, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 5.39% (14.9895 => 15.7981, std.dev.: 0.0283) MultiSource/Applications/kimwitu++/kc: 3.60% (14.1553 => 14.6655, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (4.1105 => 4.2941, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.22% (1.1048 => 1.2177, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (7.1582 => 7.3638, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.67% (3.4629 => 3.6592, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.6222 => 0.6347, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.53% (0.2116 => 0.0687, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 00:48:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 02:48:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917074841.B05F72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3904?compare_to=3901&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3904, Order: 164013, Start Time: 2012-09-17 06:38:38, End Time: 2012-09-17 07:50:04 To: 3901, Order: 164012, Start Time: 2012-09-17 05:11:47, End Time: 2012-09-17 06:22:50 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (50 on baseline) Performance Improvements: 2 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 896 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.19% (0.9396 => 0.9508, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.2671 => 8.3511, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 1.10% (15.7492 => 15.9218, std.dev.: 0.0242) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -5.76% (3.5399 => 3.3361, std.dev.: 0.0741) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.80% (2.2981 => 2.2338, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.22% (0.9808 => 0.9928, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -0.15% (0.5994 => 0.5985, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/08-main/main: 0.86% (0.1628 => 0.1642, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.77% (0.1566 => 0.1507, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.65% (0.3036 => 0.3086, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.09% (0.2298 => 0.2369, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.57% (0.3185 => 0.3135, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (0.2247 => 0.2313, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -3.12% (0.0449 => 0.0435, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.52% (0.0243 => 0.0215, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.95% (0.0190 => 0.0116, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0384 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.83% (0.0295 => 0.0266, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0280 => 0.0280, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.44% (0.0320 => 0.0261, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -22.03% (0.0177 => 0.0138, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -35.45% (0.0189 => 0.0122, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -8.05% (0.0323 => 0.0297, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1434 => 0.1431, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -0.30% (1.4565 => 1.4522, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1491 => 0.1494, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4201 => 0.4000, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.29% (0.1374 => 0.1370, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 500.00% (0.0001 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.51% (0.0581 => 0.0613, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.20% (0.0203 => 0.0244, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.44% (0.0561 => 0.0642, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.44% (1.1474 => 1.1524, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.34% (0.0599 => 0.0567, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.33% (0.0193 => 0.0175, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7837 => 0.7824, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.55% (1.6080 => 1.5992, std.dev.: 0.0047) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.65% (4.1772 => 3.1059, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/except: 83516.67% (0.0006 => 0.5017, std.dev.: 0.0012) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1159 => 0.1261, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 7.29% (0.5309 => 0.5696, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 6.17% (2.1763 => 2.3106, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: 5.62% (8.9977 => 9.5036, std.dev.: 0.1856) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.01% (0.6410 => 0.6731, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.80% (0.3582 => 0.3754, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 4.08% (0.6173 => 0.6425, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 3.66% (1.1653 => 1.2079, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.7639 => 0.7912, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 2.88% (29.3170 => 30.1602, std.dev.: 0.1716) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.5150 => 1.5508, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 1.71% (13.3238 => 13.5514, std.dev.: 0.0822) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (8.2186 => 8.3511, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 1.20% (3.5980 => 3.6413, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3397, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.67% (0.0766 => 0.0909, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9985, std.dev.: 0.0459) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.29% (0.0917 => 0.1048, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.39% (4.0101 => 4.5472, std.dev.: 0.0149) MultiSource/Applications/sgefa/sgefa: 13.03% (0.3746 => 0.4234, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 12.63% (0.1433 => 0.1614, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.80% (7.0025 => 7.6189, std.dev.: 0.0359) SingleSource/Benchmarks/McGill/chomp: 7.86% (1.0194 => 1.0995, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.24% (0.2694 => 0.2889, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.20% (0.2857 => 0.3034, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8097, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.54% (40.4792 => 42.7231, std.dev.: 0.4490) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.22% (4.2129 => 4.4330, std.dev.: 0.0601) SingleSource/Benchmarks/Misc/fp-convert: 4.58% (15.2242 => 15.9218, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5388, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (6.6312 => 6.8779, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.21% (2.6656 => 2.7512, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.79% (0.5587 => 0.5743, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (4.5056 => 4.6272, std.dev.: 0.0440) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.57% (0.5876 => 0.6027, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 2.25% (0.6308 => 0.6450, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/five11/five11: 2.17% (5.1938 => 5.3063, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.95% (2.4455 => 2.4932, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.64% (14.4877 => 14.7246, std.dev.: 0.0290) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5320, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.27% (4.0659 => 4.1177, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.25% (4.6127 => 4.6703, std.dev.: 0.0218) MultiSource/Applications/spiff/spiff: 1.10% (2.8599 => 2.8914, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.5166 => 2.5432, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.14% (8.2559 => 8.1614, std.dev.: 0.0283) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.33% (5.2665 => 4.0907, std.dev.: 0.1516) SingleSource/Benchmarks/Shootout-C++/ary3: -20.62% (1.7473 => 1.3870, std.dev.: 0.0400) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.40% (1.1647 => 0.9387, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0777) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.19% (62.4126 => 56.6799, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.66% (2.4457 => 2.2338, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.77% (3.2007 => 2.9519, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.39% (3.6023 => 3.3361, std.dev.: 0.0741) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.02% (3.6254 => 3.3709, std.dev.: 0.0271) MultiSource/Applications/SIBsim4/SIBsim4: -6.85% (3.4230 => 3.1886, std.dev.: 0.0230) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -5.91% (1.4441 => 1.3587, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (4.6355 => 4.4091, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: -4.46% (1.4117 => 1.3487, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/methcall: -3.78% (9.2503 => 8.9002, std.dev.: 0.0561) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.08% (1.7361 => 1.6826, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.97% (1.2722 => 1.2344, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -2.93% (7.6833 => 7.4585, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.85% (3.7496 => 3.6426, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.81% (3.9413 => 3.8305, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.73% (1.1683 => 1.1364, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -2.67% (3.4286 => 3.3371, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2944, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: -2.63% (0.4296 => 0.4183, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.81% (1.8739 => 1.8400, std.dev.: 0.0123) MultiSource/Benchmarks/sim/sim: -1.80% (3.8907 => 3.8208, std.dev.: 0.0150) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2277, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -1.64% (92.7467 => 91.2294, std.dev.: 0.1220) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3092, std.dev.: 0.0544) SingleSource/Benchmarks/Misc/oourafft: -1.30% (3.8200 => 3.7704, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.52% (0.9980 => 0.9928, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -0.61% (0.6022 => 0.5985, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/08-main/main: -1.44% (0.1666 => 0.1642, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.02% (0.1554 => 0.1507, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3083 => 0.3086, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.04% (0.2394 => 0.2369, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.26% (0.3175 => 0.3135, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.48% (0.2302 => 0.2313, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -3.12% (0.0449 => 0.0435, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.42% (0.0240 => 0.0215, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.58% (0.0192 => 0.0116, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.63% (0.0301 => 0.0266, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.44% (0.0324 => 0.0261, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -22.03% (0.0177 => 0.0138, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -35.45% (0.0189 => 0.0122, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -8.62% (0.0325 => 0.0297, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -3.31% (1.5019 => 1.4522, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.19% (0.4264 => 0.4000, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.93% (0.1344 => 0.1370, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.17% (0.0232 => 0.0244, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.47% (0.0639 => 0.0642, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.53% (1.1350 => 1.1524, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.99% (0.0637 => 0.0567, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.86% (0.0246 => 0.0175, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.75% (0.7541 => 0.7824, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.09% (1.5363 => 1.5992, std.dev.: 0.0047) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 01:08:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 03:08:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120917080839.C78E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3905?compare_to=3900&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3905, Order: 164012, Start Time: 2012-09-17 05:23:48, End Time: 2012-09-17 08:10:02 To: 3900, Order: 164009, Start Time: 2012-09-16 23:37:50, End Time: 2012-09-17 02:21:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (92 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.24% (124.1648 => 128.1878, std.dev.: 1.5107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.58% (0.3488 => 0.3822, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3469 => 0.3797, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.44% (0.3465 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.41% (0.3442 => 0.3766, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.38% (0.3496 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-3: 9.28% (0.3460 => 0.3781, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.07% (0.3650 => 0.3981, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.3724 => 0.4056, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.35% (1.5932 => 1.7103, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (1.6211 => 1.7212, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.08% (0.5889 => 0.6247, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5826 => 0.6180, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.49% (0.3004 => 0.3169, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.42% (5.5417 => 5.8419, std.dev.: 0.0066) MultiSource/Applications/d/make_dparser: 5.07% (1.0781 => 1.1328, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.94% (0.2875 => 0.3017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (0.3930 => 0.4122, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 4.79% (4.2109 => 4.4126, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.66% (0.3195 => 0.3344, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.66% (0.9909 => 1.0371, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.65% (0.2750 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.64% (0.2738 => 0.2865, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.64% (2.1013 => 2.1987, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 4.62% (0.2813 => 0.2943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.61% (0.2714 => 0.2839, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 4.61% (0.2823 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.59% (0.3267 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.59% (0.2811 => 0.2940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.58% (0.2792 => 0.2920, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.57% (23.5202 => 24.5949, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/matrix: 4.57% (0.2780 => 0.2907, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 4.53% (0.2803 => 0.2930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.51% (0.2729 => 0.2852, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.49% (0.4029 => 0.4210, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.48% (0.3258 => 0.3404, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3625 => 0.3787, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (2.1653 => 2.2618, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.44% (0.4146 => 0.4330, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3096 => 0.3232, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.34% (4.6177 => 4.8179, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (1.8794 => 1.9601, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 4.26% (0.3477 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.24% (0.3348 => 0.3490, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 4.24% (0.3726 => 0.3884, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.4139 => 0.4313, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3690 => 0.3843, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 4.13% (1.4269 => 1.4859, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/moments: 4.13% (0.3678 => 0.3830, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.13% (0.6634 => 0.6908, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4251 => 0.4421, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.93% (0.6435 => 0.6688, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.93% (0.5546 => 0.5764, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.79% (0.3981 => 0.4132, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.5012 => 0.5201, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.72% (0.3336 => 0.3460, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.69% (0.9697 => 1.0055, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.3845 => 0.3980, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.30% (0.7875 => 0.8135, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.20% (2.0346 => 2.0998, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (0.7426 => 0.7640, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (0.5361 => 0.5507, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (0.5584 => 0.5715, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.15% (4.6926 => 4.7934, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (11.6398 => 11.8889, std.dev.: 0.0438) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.53% (0.0734 => 0.0870, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.63% (15.4430 => 16.1585, std.dev.: 0.0264) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6377, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1976, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2276, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4416, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std.dev.: 0.0333) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5496, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7934, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7635, std.dev.: 0.0605) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.76% (0.6293 => 0.6182, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9628, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 01:24:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 03:24:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917082446.D81612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3906?compare_to=3902&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3906, Order: 164013, Start Time: 2012-09-17 07:11:05, End Time: 2012-09-17 08:26:08 To: 3902, Order: 164012, Start Time: 2012-09-17 05:23:41, End Time: 2012-09-17 06:37:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.18% (80.0059 => 80.9518, std.dev.: 0.3653) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.59% (2.0176 => 2.3926, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.43% (0.7710 => 0.8437, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.18% (3.9660 => 4.3302, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.94% (0.7038 => 0.7667, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 8.91% (1.3693 => 1.4913, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4328 => 0.4703, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.53% (0.5265 => 0.5714, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.49% (0.9199 => 0.9980, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.46% (1.2193 => 1.3224, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4062 => 0.4404, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.6959 => 0.7543, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.02% (1.4563 => 1.5731, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.92% (1.1364 => 1.2264, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 7.82% (13.8202 => 14.9013, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.5577 => 0.6006, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.54% (0.6283 => 0.6757, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.46% (0.2760 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.27% (1.0313 => 1.1063, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.26% (0.4379 => 0.4697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.22% (1.9828 => 2.1260, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3580 => 0.3838, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.16% (0.4791 => 0.5134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.12% (0.4016 => 0.4302, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.09% (1.1061 => 1.1845, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.07% (0.7506 => 0.8037, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.00% (0.2914 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (3.8646 => 4.1315, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8310 => 0.8878, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (7.2180 => 7.7099, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sieve: 6.81% (0.3453 => 0.3688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.56% (3.6692 => 3.9100, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.54% (0.7460 => 0.7948, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2243 => 0.2388, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3220 => 0.3427, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.38% (2.1791 => 2.3181, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 6.10% (0.4113 => 0.4364, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.10% (1.3245 => 1.4053, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.08% (16.6129 => 17.6226, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.05% (0.6744 => 0.7152, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.01% (3.1889 => 3.3807, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 6.00% (1.9270 => 2.0427, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 6.00% (0.3914 => 0.4149, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.00% (0.4003 => 0.4243, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.93% (0.6576 => 0.6966, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.89% (0.3789 => 0.4012, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3663 => 0.3878, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.86% (0.3650 => 0.3864, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1209, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3623 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.63% (0.8698 => 0.9188, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 5.54% (14.8535 => 15.6761, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 5.51% (1.2749 => 1.3451, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 5.49% (0.2859 => 0.3016, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.47% (1.3819 => 1.4575, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.46% (8.4961 => 8.9599, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.39% (1.3813 => 1.4558, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6141, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.24% (4.4433 => 4.6762, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9760, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.17% (0.8818 => 0.9274, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.01% (0.3131 => 0.3288, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.91% (14.5298 => 15.2432, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (1.1333 => 1.1887, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.2504 => 0.2625, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.81% (4.6629 => 4.8874, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.81% (0.3245 => 0.3401, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2321 => 0.2431, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (6.5754 => 6.8812, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.60% (3.2742 => 3.4249, std.dev.: 0.0231) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2292 => 1.2836, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.27% (4.9865 => 5.1993, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 4.19% (0.6250 => 0.6512, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.18% (0.4805 => 0.5006, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.05% (0.9108 => 0.9477, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.5188 => 1.5773, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 3.70% (3.7467 => 3.8852, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (6.2785 => 6.4960, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.40% (2.1007 => 2.1722, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.87% (33.2944 => 34.2490, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4808, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std.dev.: 0.0533) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.2093 => 0.2209, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.78% (1.9144 => 2.0059, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1190, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6018, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6874, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5896, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.00% (22.5627 => 21.6593, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2763, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.88% (0.4867 => 0.4678, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7057, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9237, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6068, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8964, std.dev.: 0.0259) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2326, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2345, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.21% (4.1080 => 4.0583, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 01:34:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 03:34:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917083402.6FD5A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3907?compare_to=3903&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3907, Order: 164014, Start Time: 2012-09-17 07:15:32, End Time: 2012-09-17 08:35:24 To: 3903, Order: 164012, Start Time: 2012-09-17 05:23:48, End Time: 2012-09-17 06:43:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (116 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (732 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.37% (11.4031 => 11.2466, std.dev.: 0.0270) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.44% (56.5652 => 54.6176, std.dev.: 0.5426) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5670 => 0.5673, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 0.05% (15.7981 => 15.8061, std.dev.: 0.0392) MultiSource/Applications/kimwitu++/kc: -0.02% (14.6655 => 14.6626, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: 0.93% (81.8770 => 82.6357, std.dev.: 0.0988) MultiSource/Benchmarks/MallocBench/gs/gs: 0.07% (4.2941 => 4.2971, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2177 => 1.2175, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.3638 => 7.3609, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.14% (3.6592 => 3.6542, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.25% (0.6347 => 0.6331, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.53% (0.0687 => 0.0649, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.66% (63.2438 => 82.6357, std.dev.: 0.0988) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14241.67% (0.0720 => 10.3260, std.dev.: 0.0129) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.37% (10.3673 => 15.2788, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 26.39% (0.1622 => 0.2050, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.77% (2.2022 => 2.5054, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.33% (7.0540 => 7.9940, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.11% (1.1194 => 1.2550, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.74% (1.7609 => 1.9500, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 9.07% (0.3473 => 0.3788, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.92% (0.3543 => 0.3859, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.90% (0.3516 => 0.3829, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3543 => 0.3857, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3561 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3828 => 0.4157, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3694 => 0.4010, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.45% (0.3927 => 0.4259, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.23% (0.3886 => 0.4206, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.77% (10.4361 => 11.2466, std.dev.: 0.0270) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.15% (9.4845 => 10.1622, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.3177 => 0.3404, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.4615 => 0.4911, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 6.34% (0.3109 => 0.3306, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.7433 => 0.7893, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2554 => 0.2710, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.04% (0.2700 => 0.2863, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 5.95% (0.7115 => 0.7538, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.89% (0.6675 => 0.7068, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (4.2646 => 4.5119, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.78% (0.5860 => 0.6199, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.71% (8.1363 => 8.6007, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.5105 => 0.5395, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.67% (5.7591 => 6.0854, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.3050 => 1.3785, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.8172 => 0.8621, std.dev.: 0.0091) MultiSource/Applications/d/make_dparser: 5.49% (3.3354 => 3.5186, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.44% (1.5415 => 1.6254, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.5569 => 0.5872, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8067 => 0.8500, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2107 => 0.2220, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3121 => 0.3287, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 5.27% (0.3092 => 0.3255, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (5.0018 => 5.2648, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.25% (4.9449 => 5.2045, std.dev.: 0.0118) SingleSource/UnitTests/ObjC++/Hello: 5.25% (0.5925 => 0.6236, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.22% (0.2758 => 0.2902, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 5.21% (0.7835 => 0.8243, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference-object: 5.16% (0.6030 => 0.6341, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9765 => 1.0256, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 4.81% (1.1642 => 1.2202, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.75% (7.9617 => 8.3402, std.dev.: 0.0164) MultiSource/Benchmarks/sim/sim: 4.69% (0.3387 => 0.3546, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.68% (0.5020 => 0.5255, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3441 => 0.3599, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.57% (21.9371 => 22.9391, std.dev.: 0.0388) MultiSource/Applications/lua/lua: 4.50% (3.8723 => 4.0464, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.49% (1.1861 => 1.2394, std.dev.: 0.0076) MultiSource/Applications/hbd/hbd: 4.49% (1.5603 => 1.6303, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: 4.45% (1.0722 => 1.1199, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.35% (0.7326 => 0.7645, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 4.10% (2.0273 => 2.1104, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.05% (0.6450 => 0.6711, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3422 => 0.3558, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.97% (2.2969 => 2.3881, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6456 => 0.6712, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (1.4186 => 1.4746, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8921 => 0.9265, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5981 => 0.6210, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (1.5859 => 1.6430, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.33% (0.4203 => 0.4343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8345, std.dev.: 0.0222) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4636 => 0.4785, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.18% (2.2024 => 2.2725, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.02% (0.3935 => 0.4054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1840 => 1.2185, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (2.0665 => 2.1237, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.95% (0.8101 => 0.8259, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.61% (1.2842 => 1.3049, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3834, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.02% (4.2280 => 4.3555, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.33% (0.9540 => 0.9667, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2247, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5823, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.55% (5.2763 => 3.2423, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.27% (5.3855 => 3.8631, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.86% (5.3526 => 3.8614, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0600, std.dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.04% (2.9384 => 2.5847, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.79% (22.1758 => 20.2262, std.dev.: 0.0537) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.20% (1.6925 => 1.4183, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2843, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7166, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8046, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1507, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4238, std.dev.: 0.0297) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0093, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0030, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5788, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2251, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.49% (0.5229 => 0.5673, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 5.45% (14.9895 => 15.8061, std.dev.: 0.0392) MultiSource/Applications/kimwitu++/kc: 3.58% (14.1553 => 14.6626, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (4.1105 => 4.2971, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.20% (1.1048 => 1.2175, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.83% (7.1582 => 7.3609, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.52% (3.4629 => 3.6542, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.6222 => 0.6331, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 02:15:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 04:15:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917091512.757092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3908?compare_to=3904&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3908, Order: 164017, Start Time: 2012-09-17 08:06:07, End Time: 2012-09-17 09:16:35 To: 3904, Order: 164013, Start Time: 2012-09-17 06:38:38, End Time: 2012-09-17 07:50:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 17 (63 on baseline) Performance Improvements: 1 (34 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 883 (794 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.50% (0.0518 => 0.0619, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.62% (0.7492 => 0.7988, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.61% (0.2943 => 0.3108, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.81% (0.4490 => 0.4706, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5661 => 0.5884, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.8890 => 0.9163, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1796 => 1.2104, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.23% (4.2407 => 4.3354, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 1.99% (3.8601 => 3.9369, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (12.8166 => 13.0681, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1614 => 8.2783, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (4.0510 => 4.1043, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.49% (20.3184 => 22.6529, std.dev.: 0.5966) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (15.2973 => 16.5167, std.dev.: 0.2824) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (2.5754 => 2.6402, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/whetstone: 2.03% (2.3528 => 2.4005, std.dev.: 0.0082) MultiSource/Benchmarks/llubenchmark/llu: 1.10% (2.0234 => 2.0457, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.13% (0.9508 => 0.9401, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.89% (0.9928 => 1.0016, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 0.58% (0.5985 => 0.6020, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/08-main/main: 1.46% (0.1642 => 0.1666, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.17% (0.1507 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3086 => 0.3088, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.97% (0.2369 => 0.2346, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.24% (0.3135 => 0.3174, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.78% (0.2313 => 0.2295, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 5.52% (0.0435 => 0.0459, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 1.14% (0.0088 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.70% (0.0215 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.38% (0.0116 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0384 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.53% (0.0266 => 0.0238, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0280 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 24.14% (0.0261 => 0.0324, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 30.43% (0.0138 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 55.74% (0.0122 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0248 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 8.75% (0.0297 => 0.0323, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1431 => 0.1433, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 5.44% (1.4522 => 1.5312, std.dev.: 0.0180) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.61% (0.1494 => 0.1470, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.65% (0.4000 => 0.4106, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.17% (0.1370 => 0.1386, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0613 => 0.0613, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0244 => 0.0183, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.85% (0.0642 => 0.0598, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1524 => 1.1506, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 145.45% (0.0011 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 340.00% (0.0005 => 0.0022, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.82% (0.0567 => 0.0551, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.29% (0.0175 => 0.0228, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7824 => 0.7817, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: - (1.5992 => 1.5992, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.45% (4.1772 => 3.0722, std.dev.: 0.0652) SingleSource/Benchmarks/Shootout-C++/except: 82583.33% (0.0006 => 0.4961, std.dev.: 0.0085) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.88% (0.0745 => 0.0908, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 6.31% (0.5309 => 0.5644, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.68% (0.6410 => 0.6774, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.21% (0.2552 => 0.2685, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.11% (0.3582 => 0.3765, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.75% (15.3105 => 16.0373, std.dev.: 0.0739) MultiSource/Applications/minisat/minisat: 4.28% (0.6173 => 0.6437, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (0.6915 => 0.7209, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 3.75% (1.0046 => 1.0423, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (1.1672 => 1.2104, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 3.61% (1.1653 => 1.2074, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.44% (0.7722 => 0.7988, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.5150 => 1.5667, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (12.6413 => 13.0681, std.dev.: 0.0323) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.32% (0.3008 => 0.3108, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3901 => 0.4016, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 2.84% (29.3170 => 30.1493, std.dev.: 0.1952) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.7639 => 0.7832, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.5740 => 0.5884, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.39% (0.4596 => 0.4706, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.1827 => 1.2067, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (4.0318 => 4.1043, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (3.8796 => 3.9369, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (0.8569 => 0.8693, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.41% (1.2021 => 1.2191, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.26% (4.2815 => 4.3354, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (8.2186 => 8.3145, std.dev.: 0.0349) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.0689 => 1.0801, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.87% (1.6538 => 2.3297, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Bubblesort: 38.40% (0.0263 => 0.0364, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std.dev.: 0.0412) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3746 => 0.4276, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.64% (4.0101 => 4.5572, std.dev.: 0.0260) SingleSource/Benchmarks/Stanford/Puzzle: 12.84% (0.1433 => 0.1617, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.98% (7.0025 => 7.6314, std.dev.: 0.0192) SingleSource/Benchmarks/McGill/chomp: 7.35% (1.0194 => 1.0943, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.02% (1.0063 => 1.0769, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.90% (0.2857 => 0.3054, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.03% (27.1724 => 28.8105, std.dev.: 0.0654) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.60% (40.4792 => 42.7449, std.dev.: 0.2104) SingleSource/Benchmarks/Misc/dt: 4.60% (0.9851 => 1.0304, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.49% (4.2129 => 4.4020, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8540, std.dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.87% (8.5113 => 8.8407, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8735, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.67% (0.5876 => 0.6033, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 2.62% (5.1938 => 5.3299, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.6308 => 0.6467, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 2.35% (2.3453 => 2.4005, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.33% (2.6656 => 2.7276, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 1.69% (14.4877 => 14.7327, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.66% (4.6127 => 4.6892, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4853, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (2.5984 => 2.6402, std.dev.: 0.0161) MultiSource/Applications/siod/siod: 1.45% (3.5520 => 3.6036, std.dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5326, std.dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 1.31% (2.0192 => 2.0457, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.5166 => 2.5473, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.11% (4.0659 => 4.1110, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.69% (0.3497 => 0.2074, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.02% (5.2665 => 4.1070, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary3: -20.55% (1.7473 => 1.3883, std.dev.: 0.0461) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.39% (1.1647 => 0.9389, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.34% (62.4126 => 56.5855, std.dev.: 0.0313) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9406, std.dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.94% (2.4457 => 2.2516, std.dev.: 0.0635) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3636, std.dev.: 0.0268) MultiSource/Applications/SIBsim4/SIBsim4: -6.91% (3.4230 => 3.1864, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3558, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: -4.72% (1.4117 => 1.3450, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.71% (1.7361 => 1.6544, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -3.35% (9.2503 => 8.9400, std.dev.: 0.0553) MultiSource/Applications/lambda-0_1_3/lambda: -3.23% (7.6833 => 7.4349, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.18% (45.4683 => 44.0236, std.dev.: 0.2056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.80% (3.9413 => 3.8311, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -2.76% (3.4286 => 3.3341, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.74% (1.1683 => 1.1363, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.74% (1.2722 => 1.2374, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.71% (0.4140 => 0.4028, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.23% (3.7496 => 3.6660, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash2: -1.77% (3.4876 => 3.4259, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2273, std.dev.: 0.0598) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3079, std.dev.: 0.0441) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.36% (0.9980 => 1.0016, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -0.03% (0.6022 => 0.6020, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/08-main/main: - (0.1666 => 0.1666, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.96% (0.1554 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (0.3083 => 0.3088, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.01% (0.2394 => 0.2346, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2302 => 0.2295, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 2.23% (0.0449 => 0.0459, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.93% (0.0301 => 0.0238, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1429 => 0.1433, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.95% (1.5019 => 1.5312, std.dev.: 0.0180) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.07% (0.1501 => 0.1470, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.71% (0.4264 => 0.4106, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.13% (0.1344 => 0.1386, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.12% (0.0232 => 0.0183, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.42% (0.0639 => 0.0598, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.37% (1.1350 => 1.1506, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -8.33% (0.0024 => 0.0022, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.50% (0.0637 => 0.0551, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.32% (0.0246 => 0.0228, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.66% (0.7541 => 0.7817, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.09% (1.5363 => 1.5992, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 03:09:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 05:09:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917100908.BB8872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3909?compare_to=3906&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3909, Order: 164017, Start Time: 2012-09-17 08:54:47, End Time: 2012-09-17 10:09:55 To: 3906, Order: 164013, Start Time: 2012-09-17 07:11:05, End Time: 2012-09-17 08:26:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.06% (54.4599 => 56.6686, std.dev.: 0.0451) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.64% (2.0176 => 2.3936, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (0.7710 => 0.8442, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 9.40% (0.7061 => 0.7725, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.31% (0.5265 => 0.5755, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 9.28% (0.5818 => 0.6358, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.25% (3.9660 => 4.3329, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.06% (1.3693 => 1.4933, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.7038 => 0.7663, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.59% (1.2193 => 1.3240, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.42% (0.6959 => 0.7545, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.36% (1.4563 => 1.5780, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.23% (0.5577 => 0.6036, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.02% (1.1364 => 1.2275, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.92% (13.8202 => 14.9152, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.77% (0.4390 => 0.4731, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.62% (0.6283 => 0.6762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.32% (1.9828 => 2.1279, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4379 => 0.4698, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.22% (1.1061 => 1.1860, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.3756 => 0.4026, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.18% (1.0313 => 1.1053, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.10% (0.4791 => 0.5131, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 7.06% (0.2988 => 0.3199, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.97% (0.7506 => 0.8029, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.96% (3.8646 => 4.1336, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.5637 => 0.6029, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (7.2180 => 7.7186, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.86% (0.3453 => 0.3690, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8310 => 0.8874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.7460 => 0.7964, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.67% (0.6744 => 0.7194, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.65% (3.6692 => 3.9132, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1865 => 0.1988, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.51% (2.1791 => 2.3210, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.34% (0.6576 => 0.6993, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 6.09% (0.3578 => 0.3796, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.09% (0.3646 => 0.3868) MultiSource/Benchmarks/nbench/nbench: 6.08% (1.0594 => 1.1238, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.08% (3.1889 => 3.3827, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.06% (1.3245 => 1.4048, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 6.05% (16.6129 => 17.6181, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/parameter-passing: 6.05% (0.4003 => 0.4245, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3914 => 0.4150, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3789 => 0.4015, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.96% (1.9270 => 2.0418, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.89% (0.3650 => 0.3865, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.88% (0.6135 => 0.6496, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.81% (0.3940 => 0.4169, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3623 => 0.3833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.68% (1.2749 => 1.3473, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.62% (1.3819 => 1.4596, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.60% (14.8535 => 15.6850, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 5.52% (8.4961 => 8.9649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.49% (1.3813 => 1.4572, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.44% (0.8818 => 0.9298, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.35% (4.3801 => 4.6146, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.29% (4.4433 => 4.6784, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9759, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.08% (0.3131 => 0.3290, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.97% (1.1333 => 1.1896, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.2504 => 0.2628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.86% (14.5298 => 15.2356, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 4.82% (4.6629 => 4.8878, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (6.5754 => 6.8845, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.52% (3.2742 => 3.4221, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2292 => 1.2839, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.28% (4.9865 => 5.1998, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.12% (0.9108 => 0.9483, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4805 => 0.5000, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.93% (3.7467 => 3.8940, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.88% (1.5188 => 1.5777, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2785 => 6.4980, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.1007 => 2.1715, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.03% (33.2944 => 34.3019, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5006, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.03% (3.1736 => 3.4285, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.2093 => 0.2247, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6986, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0753, std.dev.: 0.0299) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5962, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6008, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.92% (0.4657 => 0.3869, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.97% (22.5627 => 21.6665, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2887, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5092, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1496, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9218, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (8.8259 => 8.6088, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.26% (26.5159 => 25.9159, std.dev.: 0.0299) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2290, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2268, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0604, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4343, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 03:22:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 05:22:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917102233.332F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3910?compare_to=3907&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3910, Order: 164017, Start Time: 2012-09-17 09:04:04, End Time: 2012-09-17 10:23:56 To: 3907, Order: 164014, Start Time: 2012-09-17 07:15:32, End Time: 2012-09-17 08:35:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.2963 => 1.3110, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.16% (0.5673 => 0.5682, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 0.14% (15.8061 => 15.8275, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 0.13% (14.6626 => 14.6811, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 0.01% (82.6357 => 82.6423, std.dev.: 0.0489) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.2971 => 4.3014, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2175 => 1.2179, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.3609 => 7.3592, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (3.6542 => 3.6530, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.16% (0.6331 => 0.6341, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.67% (63.2438 => 82.6423, std.dev.: 0.0489) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.56% (0.0720 => 10.3288, std.dev.: 0.0083) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.32% (10.3673 => 15.2733, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 26.45% (0.1622 => 0.2051, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.83% (2.2022 => 2.5068, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.33% (7.0540 => 7.9944, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2548, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.71% (1.7609 => 1.9495, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.04% (0.3473 => 0.3787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.87% (0.3516 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.83% (0.3543 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.81% (0.3543 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3561 => 0.3874) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.70% (0.3828 => 0.4161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.53% (0.3694 => 0.4009, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.48% (0.3927 => 0.4260, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.34% (0.3886 => 0.4210, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.87% (10.4361 => 11.2571, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.32% (9.4845 => 10.1785, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4615 => 0.4908, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.5860 => 0.6224, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7433 => 0.7892, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2554 => 0.2711, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.95% (0.6675 => 0.7072, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.93% (0.3307 => 0.3503, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.87% (4.2646 => 4.5150, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.83% (0.7115 => 0.7530, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.72% (0.2271 => 0.2401, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.69% (8.1363 => 8.5993, std.dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: 5.67% (5.7591 => 6.0859, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.64% (0.5105 => 0.5393, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.3050 => 1.3780, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.45% (3.3354 => 3.5171, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.43% (0.8172 => 0.8616, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.40% (1.5415 => 1.6247, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.8067 => 0.8502, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.39% (0.5569 => 0.5869, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.38% (0.3121 => 0.3289, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.27% (0.5925 => 0.6237, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.23% (4.9449 => 5.2035, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.21% (5.0018 => 5.2623, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference-object: 5.21% (0.6030 => 0.6344, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.15% (0.2758 => 0.2900, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 5.08% (0.7835 => 0.8233, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9765 => 1.0258, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 4.83% (1.1642 => 1.2204, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 4.82% (0.4299 => 0.4506, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.75% (7.9617 => 8.3399, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.3180 => 0.3331, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.61% (0.3387 => 0.3543, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 4.57% (21.9371 => 22.9394, std.dev.: 0.0287) MultiSource/Applications/lua/lua: 4.53% (3.8723 => 4.0477, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.48% (0.3441 => 0.3595, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.46% (1.1861 => 1.2390, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 4.44% (1.0722 => 1.1198, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 4.40% (1.5603 => 1.6289, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 4.40% (0.7326 => 0.7648, std.dev.: 0.0082) MultiSource/Applications/treecc/treecc: 4.11% (2.0273 => 2.1106, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.08% (0.6450 => 0.6713, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6456 => 0.6719, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.06% (2.2969 => 2.3901, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 3.98% (0.8921 => 0.9276, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.4064 => 0.4223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3422 => 0.3554, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.68% (0.5981 => 0.6201, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.55% (1.5859 => 1.6422, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4289 => 0.4436, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.38% (1.4186 => 1.4666, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2731, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4636 => 0.4784, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (14.3668 => 14.8177, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4203 => 0.4334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.04% (0.4048 => 0.4171, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4620 => 0.4760, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.1840 => 1.2186, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0665 => 2.1233, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.56% (1.2842 => 1.3042, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7490, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3515, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7896, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2267, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.09% (26.0924 => 26.3771, std.dev.: 0.0240) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.53% (5.2763 => 3.2436, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.31% (5.3855 => 3.8611, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.85% (5.3526 => 3.8620, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1052, std.dev.: 0.0721) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.08% (2.9384 => 2.5835, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -8.76% (22.1758 => 20.2338, std.dev.: 0.0212) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2498, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7152, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5060, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4321, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9904, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.44% (1.2373 => 1.2071, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0101, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5134, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5801, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2220, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: -1.12% (4.9088 => 4.8537, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.06% (1.0313 => 1.0204, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.66% (0.5229 => 0.5682, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.59% (14.9895 => 15.8275, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 3.71% (14.1553 => 14.6811, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (4.1105 => 4.3014, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.24% (1.1048 => 1.2179, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.81% (7.1582 => 7.3592, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.49% (3.4629 => 3.6530, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.6222 => 0.6341, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 04:20:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 06:20:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120917112050.4611F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3911?compare_to=3905&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3911, Order: 164017, Start Time: 2012-09-17 08:38:33, End Time: 2012-09-17 11:22:13 To: 3905, Order: 164012, Start Time: 2012-09-17 05:23:48, End Time: 2012-09-17 08:10:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.27% (0.2120 => 0.2253, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3465 => 0.3779, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.06% (0.3488 => 0.3804, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.04% (0.3442 => 0.3753, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.02% (0.3469 => 0.3782, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3446 => 0.3756, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.98% (0.3496 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.93% (0.3460 => 0.3769, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.79% (0.3650 => 0.3971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.67% (0.3643 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.51% (0.3724 => 0.4041, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.95% (1.5932 => 1.7040, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (1.6211 => 1.7185, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 5.90% (0.5826 => 0.6170, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.5889 => 0.6233, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.80% (0.4361 => 0.4614, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7640, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (1.3152 => 1.3870, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.42% (2.7292 => 2.8770, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.01% (5.5417 => 5.8193, std.dev.: 0.0223) MultiSource/Applications/d/make_dparser: 4.86% (1.0781 => 1.1305, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.83% (0.4994 => 0.5235, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (0.5000 => 0.5240, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.70% (0.2875 => 0.3010, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 4.63% (0.3004 => 0.3143, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.57% (0.3195 => 0.3341, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.56% (0.7171 => 0.7498, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 4.53% (0.2823 => 0.2951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.51% (0.2813 => 0.2940, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2750 => 0.2874, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 4.51% (23.5202 => 24.5800, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.49% (0.2738 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.5900 => 0.6165, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.48% (0.3060 => 0.3197, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (2.1013 => 2.1952, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.2736 => 0.2857, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.42% (0.9909 => 1.0347, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.41% (4.2109 => 4.3964, std.dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3267 => 0.3410, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.37% (2.0673 => 2.1577, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary: 4.36% (0.3258 => 0.3400, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.35% (0.2803 => 0.2925, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.34% (0.2811 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (4.4195 => 4.6113, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.3625 => 0.3782, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.33% (0.2911 => 0.3037, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.3096 => 0.3228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.22% (0.4029 => 0.4199, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (0.3890 => 0.4052, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 4.15% (4.6177 => 4.8094, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.14% (0.5026 => 0.5234, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.07% (0.3362 => 0.3499, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 4.06% (0.3348 => 0.3484, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3317 => 0.3451, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3124 => 0.3250, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (1.8794 => 1.9552, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (2.1653 => 2.2522, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.4139 => 0.4304, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3726 => 0.3874, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.3903 => 0.4058, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.97% (0.3477 => 0.3615, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.83% (0.4251 => 0.4414, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 3.83% (1.4269 => 1.4815, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.82% (0.5546 => 0.5758, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3282 => 0.3407, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.79% (0.3690 => 0.3830, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.77% (0.6634 => 0.6884, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.6435 => 0.6668, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.57% (1.9966 => 2.0679, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (0.4658 => 0.4823, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 3.54% (0.3336 => 0.3454, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.52% (0.3981 => 0.4121, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.3271 => 0.3384, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (1.9694 => 2.0374, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: 3.40% (0.9697 => 1.0027, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.39% (0.5012 => 0.5182, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.2969 => 0.3069, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.25% (0.3845 => 0.3970, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 3.11% (0.7875 => 0.8120, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.04% (2.0346 => 2.0964, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.70% (0.4847 => 0.4978, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.63% (0.7426 => 0.7621, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (0.5361 => 0.5496, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (11.6398 => 11.8838, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.94% (4.6926 => 4.7838, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6680, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1692, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6374, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2109, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5058, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4640, std.dev.: 0.0172) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2897, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5881, std.dev.: 0.0264) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5501, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7908, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8004, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (17.2379 => 16.7251, std.dev.: 0.0853) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.42% (0.6293 => 0.6141, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.47% (16.2163 => 15.9777, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 04:56:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 06:56:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917115623.6D4C0352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3912?compare_to=3908&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3912, Order: 164024, Start Time: 2012-09-17 10:47:18, End Time: 2012-09-17 11:57:47 To: 3908, Order: 164017, Start Time: 2012-09-17 08:06:07, End Time: 2012-09-17 09:16:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (51 on baseline) Performance Improvements: 16 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 879 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.43% (0.0619 => 0.0795, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.48% (0.2959 => 0.3062, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.51% (0.7486 => 0.7599, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (0.3345 => 0.3490, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.28% (59.0511 => 60.3958, std.dev.: 0.0955) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.52% (1.6544 => 1.6796, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.77% (0.5884 => 0.5662, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.13% (0.9163 => 0.8876, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.89% (1.4474 => 1.4056, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.73% (4.3354 => 4.2172, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.43% (1.2104 => 1.1810, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.43% (13.0681 => 12.7507, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.10% (4.1043 => 4.0180, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.02% (1.4357 => 1.4067, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.89% (4.3677 => 4.2852, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.63% (1.5667 => 1.5412, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: -1.38% (1.0970 => 1.0819, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (6.3758 => 6.2921, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.39% (2.4605 => 2.4017, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.24% (2.6402 => 2.5811, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -1.81% (8.5054 => 8.3514, std.dev.: 0.0215) MultiSource/Benchmarks/llubenchmark/llu: -1.39% (2.0457 => 2.0172, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.96% (1.0016 => 0.9920, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.21% (0.6020 => 0.5947, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -5.94% (0.1666 => 0.1567, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.62% (0.1600 => 0.1542, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.65% (0.3088 => 0.3037, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.81% (0.2346 => 0.2280, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.05% (0.3174 => 0.3109, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.48% (0.2295 => 0.2284, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -16.56% (0.0459 => 0.0383, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0238 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.55% (0.0193 => 0.0190, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0386 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.79% (0.0238 => 0.0297, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0281 => 0.0280, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -1.67% (0.0180 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0190 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.21% (0.0247 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -26.63% (0.0323 => 0.0237, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1433 => 0.1432, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.81% (1.5312 => 1.5035, std.dev.: 0.0186) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.22% (0.1470 => 0.1452, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.55% (0.4106 => 0.4293, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.40% (0.1386 => 0.1447, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.0613 => 0.0594, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.32% (0.0183 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.18% (0.0598 => 0.0579, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1506 => 1.1521, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0022 => 0.0011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.73% (0.0551 => 0.0547, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.51% (0.0228 => 0.0220, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.22% (0.7817 => 0.7800, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.73% (1.5992 => 1.6108, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.58% (4.1772 => 3.0251, std.dev.: 0.0668) SingleSource/Benchmarks/Shootout-C++/except: 82333.33% (0.0006 => 0.4946, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.48% (0.0745 => 0.0905, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.07% (0.5309 => 0.5631, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 5.30% (2.1763 => 2.2917, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.2552 => 0.2680, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.87% (0.6410 => 0.6722, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (0.6915 => 0.7207, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.90% (0.6173 => 0.6414, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 3.76% (15.3105 => 15.8864, std.dev.: 0.0791) MultiSource/Applications/lemon/lemon: 3.74% (1.0046 => 1.0422, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2073, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.21% (0.3582 => 0.3697, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.77% (0.3901 => 0.4009, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.7639 => 0.7836, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 1.88% (2.0972 => 2.1367, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.5150 => 1.5412, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.54% (1.1827 => 1.2009, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.18% (1.1672 => 1.1810, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.18% (13.3238 => 13.4805, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 14.52% (1.7426 => 1.9957, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 14.52% (0.3746 => 0.4290, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 13.58% (21.1721 => 24.0463, std.dev.: 0.8072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.49% (4.0101 => 4.5512, std.dev.: 0.0267) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.91% (0.1433 => 0.1575, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 8.54% (7.0025 => 7.6006, std.dev.: 0.0381) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.88% (0.2857 => 0.3082, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 7.56% (1.0194 => 1.0965, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.04% (1.0063 => 1.0771, std.dev.: 0.0189) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7946, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.3301 => 0.3490, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.11% (40.4792 => 42.5497, std.dev.: 0.2393) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 4.31% (15.2242 => 15.8800, std.dev.: 0.0289) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 3.21% (1.4184 => 1.4640, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.79% (0.5587 => 0.5743, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 2.69% (8.5113 => 8.7405, std.dev.: 0.0449) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.61% (2.6656 => 2.7353, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.50% (0.5876 => 0.6023, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 2.07% (5.1938 => 5.3015, std.dev.: 0.0396) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.06% (4.6127 => 4.7078, std.dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: 1.63% (14.4877 => 14.7233, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 1.58% (3.5520 => 3.6081, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (2.4455 => 2.4825, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 1.26% (2.5166 => 2.5482, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.80% (0.7738 => 0.7599, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.50% (4.2815 => 4.2172, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.22% (4.3380 => 4.2852, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.42% (5.2665 => 4.0859, std.dev.: 0.1451) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.46% (1.1647 => 0.9380, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.38% (62.4126 => 56.5588, std.dev.: 0.1125) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9452, std.dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.55% (2.4457 => 2.2611, std.dev.: 0.0440) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.22% (3.6254 => 3.3637, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: -6.80% (3.4230 => 3.1903, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7928, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/fibo: -5.00% (4.6355 => 4.4035, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.44% (0.4140 => 0.3956, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -3.36% (9.2503 => 8.9392, std.dev.: 0.0527) SingleSource/Benchmarks/Misc/ffbench: -3.36% (1.4117 => 1.3643, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -3.33% (7.6833 => 7.4271, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.25% (1.7361 => 1.6796, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.12% (1.2722 => 1.2325, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -2.84% (0.4296 => 0.4174, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.83% (1.1683 => 1.1352, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2881, std.dev.: 0.0099) MultiSource/Applications/aha/aha: -2.71% (3.4286 => 3.3357, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.46% (3.7496 => 3.6572, std.dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: -2.12% (8.5323 => 8.3514, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2337, std.dev.: 0.0289) MultiSource/Benchmarks/PAQ8p/paq8p: -1.54% (92.7467 => 91.3138, std.dev.: 0.3114) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std.dev.: 0.1359) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.3569 => 2.3246, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.35% (2.8964 => 2.8572, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: -1.32% (3.8907 => 3.8393, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.27% (61.1734 => 60.3958, std.dev.: 0.0955) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.60% (0.9980 => 0.9920, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.25% (0.6022 => 0.5947, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -5.94% (0.1666 => 0.1567, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.77% (0.1554 => 0.1542, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.49% (0.3083 => 0.3037, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.2394 => 0.2280, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.08% (0.3175 => 0.3109, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.78% (0.2302 => 0.2284, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -14.70% (0.0449 => 0.0383, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.08% (0.0325 => 0.0237, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 0.11% (1.5019 => 1.5035, std.dev.: 0.0186) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.26% (0.1501 => 0.1452, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.68% (0.4264 => 0.4293, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.66% (0.1344 => 0.1447, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.85% (0.0589 => 0.0594, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.43% (0.0232 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.39% (0.0639 => 0.0579, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.51% (1.1350 => 1.1521, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.17% (0.0024 => 0.0011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.13% (0.0637 => 0.0547, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.57% (0.0246 => 0.0220, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.43% (0.7541 => 0.7800, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.85% (1.5363 => 1.6108, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 05:13:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 07:13:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917121310.7962F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3913?compare_to=3909&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3913, Order: 164024, Start Time: 2012-09-17 10:59:45, End Time: 2012-09-17 12:14:33 To: 3909, Order: 164017, Start Time: 2012-09-17 08:54:47, End Time: 2012-09-17 10:09:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.67% (2.0176 => 2.3943, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.66% (0.7710 => 0.8455, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 9.32% (0.7061 => 0.7719, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.28% (0.5818 => 0.6358, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3326, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 9.14% (1.3693 => 1.4945, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 9.09% (0.7038 => 0.7678, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5265 => 0.5738, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.85% (0.9199 => 1.0013, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 8.71% (0.4062 => 0.4416, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.64% (0.6959 => 0.7560, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.54% (1.2193 => 1.3234, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.23% (0.3899 => 0.4220, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.14% (0.5577 => 0.6031, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.12% (1.4563 => 1.5745, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.10% (1.1364 => 1.2284, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.00% (13.8202 => 14.9253, std.dev.: 0.0076) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.81% (0.3022 => 0.3258, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.72% (0.4390 => 0.4729, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.2966 => 0.3192, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2127 => 0.2288, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.50% (0.6283 => 0.6754, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (1.9828 => 2.1289, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.37% (1.1061 => 1.1876, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4016 => 0.4311, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.32% (0.3756 => 0.4031, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4379 => 0.4698, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 7.18% (1.0313 => 1.1053, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.14% (0.3868 => 0.4144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.10% (0.4791 => 0.5131, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (3.8646 => 4.1378, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.94% (0.7506 => 0.8027, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5637 => 0.6028, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (7.2180 => 7.7161, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 6.86% (0.3453 => 0.3690, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.2925 => 0.3125, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8310 => 0.8874, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2243 => 0.2394, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.73% (0.7460 => 0.7962, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.72% (3.6692 => 3.9156, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.63% (2.1791 => 2.3235, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 6.61% (0.3220 => 0.3433, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.39% (0.6576 => 0.6996, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4113 => 0.4372, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 6.16% (0.3914 => 0.4155, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.15% (16.6129 => 17.6339, std.dev.: 0.0182) SingleSource/UnitTests/ObjC/parameter-passing: 6.15% (0.4003 => 0.4249, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.08% (0.3650 => 0.3872, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.08% (0.6744 => 0.7154, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 6.06% (1.9270 => 2.0438, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.05% (3.1889 => 3.3817, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 6.04% (0.3578 => 0.3794, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.00% (1.3245 => 1.4040, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 5.99% (1.0594 => 1.1229, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.6135 => 0.6500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.92% (0.3646 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.91% (0.3789 => 0.4013, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3663 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.86% (0.3940 => 0.4171, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.85% (0.3623 => 0.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (1.3819 => 1.4597, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.58% (14.8535 => 15.6830, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 5.55% (8.4961 => 8.9679, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 5.51% (1.2749 => 1.3451, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.49% (0.2859 => 0.3016, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.48% (4.3801 => 4.6200, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.3813 => 1.4563, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (4.4433 => 4.6840, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9757, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.19% (0.8818 => 0.9276, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (1.1333 => 1.1899, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.95% (0.3131 => 0.3286, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.86% (4.6629 => 4.8894, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.2504 => 0.2625, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 4.74% (14.5298 => 15.2178, std.dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (6.5754 => 6.8832, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2857, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.50% (3.2742 => 3.4216, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.6250 => 0.6517, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.22% (4.9865 => 5.1970, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.17% (0.9108 => 0.9488, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.04% (0.4805 => 0.4999, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.90% (3.7467 => 3.8928, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.67% (1.5188 => 1.5745, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.2785 => 6.5030, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.1007 => 2.1701, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 2.97% (33.2944 => 34.2817, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 1.38% (16.2614 => 16.4861, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std.dev.: 0.0466) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.60% (0.2093 => 0.2252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0781, std.dev.: 0.0341) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1830, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5865, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.90% (22.5627 => 21.6836, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2525, std.dev.: 0.0569) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9239, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5778, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.16% (26.5159 => 25.9440, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2421, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std.dev.: 0.0177) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.19% (4.1080 => 4.0591, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2284, std.dev.: 0.0185) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2632, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.00% (7.3305 => 7.2571, std.dev.: 0.0186) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 05:18:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 07:18:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917121800.38514352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3914?compare_to=3910&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3914, Order: 164024, Start Time: 2012-09-17 10:59:46, End Time: 2012-09-17 12:19:22 To: 3910, Order: 164017, Start Time: 2012-09-17 09:04:04, End Time: 2012-09-17 10:23:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (731 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5682 => 0.5685, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.18% (15.8275 => 15.7997, std.dev.: 0.0254) MultiSource/Applications/kimwitu++/kc: -0.24% (14.6811 => 14.6458, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -0.01% (82.6423 => 82.6325, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.3014 => 4.2938, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.15% (1.2179 => 1.2197, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.3592 => 7.3629, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (3.6530 => 3.6530, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.6341 => 0.6334, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1429 => 0.1429, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0649 => 0.0650, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.66% (63.2438 => 82.6325, std.dev.: 0.0129) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.83% (0.0720 => 10.3290, std.dev.: 0.0133) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.37% (10.3673 => 15.2781, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 26.45% (0.1622 => 0.2051, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.77% (2.2022 => 2.5054, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.29% (7.0540 => 7.9916, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.16% (1.1194 => 1.2555, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.72% (1.7609 => 1.9496, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: 8.85% (0.3516 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.81% (0.3543 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3561 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3543 => 0.3854, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.62% (0.3828 => 0.4158) SingleSource/UnitTests/ObjC/parameter-passing: 8.51% (0.3927 => 0.4261, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3694 => 0.4008, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.29% (0.3886 => 0.4208, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.75% (10.4361 => 11.2444, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 7.14% (9.4845 => 10.1618, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 6.19% (0.2554 => 0.2712, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (0.4615 => 0.4900, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.15% (0.7433 => 0.7890, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.01% (0.6675 => 0.7076, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.00% (0.2700 => 0.2862, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.85% (0.7115 => 0.7531, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (4.2646 => 4.5123, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.72% (0.5860 => 0.6195, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (8.1363 => 8.5960, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 5.64% (0.3423 => 0.3616, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2271 => 0.2399, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.3050 => 1.3785, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 5.63% (5.7591 => 6.0831, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.58% (0.5105 => 0.5390, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.50% (1.5415 => 1.6263, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.44% (3.3354 => 3.5168, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.42% (0.5569 => 0.5871, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.38% (0.8172 => 0.8612, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.30% (0.7835 => 0.8250, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.28% (0.8067 => 0.8493, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.27% (0.3092 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.26% (4.9449 => 5.2052, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 5.25% (0.5925 => 0.6236, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2107 => 0.2217, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (5.0018 => 5.2611, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 5.16% (0.6030 => 0.6341, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.04% (0.2758 => 0.2897, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.01% (0.9765 => 1.0254, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.80% (1.1642 => 1.2201, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (7.9617 => 8.3385, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 4.68% (0.4299 => 0.4500, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.61% (0.3387 => 0.3543, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.57% (21.9371 => 22.9390, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3441 => 0.3598, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.49% (1.1861 => 1.2393, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.48% (0.5020 => 0.5245, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.46% (3.8723 => 4.0450, std.dev.: 0.0076) MultiSource/Applications/hbd/hbd: 4.42% (1.5603 => 1.6293, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.40% (1.0722 => 1.1194, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.31% (0.7326 => 0.7642, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.6456 => 0.6715, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6450 => 0.6707, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.98% (2.2969 => 2.3883, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.89% (2.0273 => 2.1061, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3422 => 0.3554, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8921 => 0.9265, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.70% (0.4103 => 0.4255, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.69% (0.4064 => 0.4214, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (1.5859 => 1.6426, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4289 => 0.4432, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.4186 => 1.4648, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4636 => 0.4785, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.16% (2.2024 => 2.2720, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (14.3668 => 14.8179, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.4203 => 0.4333, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (0.4620 => 0.4758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.4048 => 0.4167, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.1840 => 1.2187, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (2.0665 => 2.1224, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.8101 => 0.8250, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.2842 => 1.3030, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.82% (1.1145 => 1.3688, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3546, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.29% (11.6436 => 11.7934, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2306, std.dev.: 0.0105) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.02% (26.0924 => 26.3592, std.dev.: 0.0202) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.57% (5.2763 => 3.2412, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.30% (5.3855 => 3.8615, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.86% (5.3526 => 3.8612, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1046, std.dev.: 0.0471) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.05% (2.9384 => 2.5844, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.79% (22.1758 => 20.2276, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.16% (1.6925 => 1.4190, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.07% (19.9488 => 18.3398, std.dev.: 0.0497) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5024, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5112, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4306, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9885, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0218, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -1.65% (1.2373 => 1.2169, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5144, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.6441 => 4.5813, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2352, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.72% (0.5229 => 0.5685, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.41% (14.9895 => 15.7997, std.dev.: 0.0254) MultiSource/Applications/kimwitu++/kc: 3.47% (14.1553 => 14.6458, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (4.1105 => 4.2938, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.40% (1.1048 => 1.2197, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.86% (7.1582 => 7.3629, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.49% (3.4629 => 3.6530, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.6222 => 0.6334, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 07:01:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 09:01:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917140147.EA6F9352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3915?compare_to=3912&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3915, Order: 164026, Start Time: 2012-09-17 12:51:55, End Time: 2012-09-17 14:03:11 To: 3912, Order: 164024, Start Time: 2012-09-17 10:47:18, End Time: 2012-09-17 11:57:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (51 on baseline) Performance Improvements: 0 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.31% (0.4392 => 0.4625, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.57% (0.7633 => 0.7982, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.67% (1.4056 => 1.4291, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.53% (1.5412 => 1.5648, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.2172 => 4.2692, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 2.27% (1.7412 => 1.7807, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.67% (1.8170 => 1.8473, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.2611 => 2.2944, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.54% (0.9920 => 0.9866, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: -0.64% (0.5947 => 0.5909, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 6.13% (0.1567 => 0.1663, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.01% (0.1542 => 0.1573, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (0.3037 => 0.3045, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (0.2280 => 0.2312, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.58% (0.3109 => 0.3158, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.79% (0.2284 => 0.2266, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 15.93% (0.0383 => 0.0444, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.14% (0.0088 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.14% (0.0237 => 0.0194, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0190 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0387 => 0.0389, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0297 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.07% (0.0280 => 0.0283, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.57% (0.0318 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -24.29% (0.0177 => 0.0134, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -17.89% (0.0190 => 0.0156, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0244 => 0.0245, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 35.44% (0.0237 => 0.0321, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1432 => 0.1437, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.28% (1.5035 => 1.4993, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.58% (0.1452 => 0.1475, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.54% (0.4293 => 0.4055, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.60% (0.1447 => 0.1366, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.0594 => 0.0566, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.17% (0.0233 => 0.0193, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.55% (0.0579 => 0.0588, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1521 => 1.1528, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -58.33% (0.0012 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.55% (0.0011 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.37% (0.0547 => 0.0545, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.0220 => 0.0231, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7800 => 0.7808, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.22% (1.6108 => 1.6072, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.44% (4.1772 => 3.0311, std.dev.: 0.0845) SingleSource/Benchmarks/Shootout-C++/except: 82016.67% (0.0006 => 0.4927, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.82% (0.5309 => 0.5618, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 5.16% (2.1763 => 2.2887, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.13% (0.6410 => 0.6739, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.2552 => 0.2664, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.97% (0.6173 => 0.6418, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 3.79% (0.6915 => 0.7177, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 3.77% (15.3105 => 15.8884, std.dev.: 0.0341) MultiSource/Applications/lemon/lemon: 3.57% (1.0046 => 1.0405, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.1653 => 1.2053, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.7722 => 0.7982, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (1.5150 => 1.5648, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: 2.24% (29.3170 => 29.9725, std.dev.: 0.1102) MultiSource/Applications/siod/siod: 2.05% (2.0972 => 2.1402, std.dev.: 0.0078) MultiSource/Applications/hbd/hbd: 1.99% (1.3268 => 1.3532, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 1.88% (3.0225 => 3.0792, std.dev.: 0.0169) MultiSource/Applications/lua/lua: 1.50% (3.5980 => 3.6520, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.39% (6.2546 => 6.3415, std.dev.: 0.0214) MultiSource/Applications/SPASS/SPASS: 1.30% (13.3238 => 13.4975, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.4113 => 1.4291, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.18% (1.1827 => 1.1966, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 15.00% (1.7426 => 2.0040, std.dev.: 0.0210) MultiSource/Applications/sgefa/sgefa: 13.35% (0.3746 => 0.4246, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.31% (4.0101 => 4.5437, std.dev.: 0.0378) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.20% (0.0917 => 0.1038, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.70% (7.0025 => 7.6119, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.99% (1.0063 => 1.0766, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7936, std.dev.: 0.1360) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.50% (0.2857 => 0.3014, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (0.3301 => 0.3468, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (15.8312 => 16.5746, std.dev.: 0.2421) SingleSource/Benchmarks/Misc/fp-convert: 4.53% (15.2242 => 15.9138, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 4.30% (0.6308 => 0.6579, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.90% (0.8498 => 0.8829, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/dt: 3.80% (0.9851 => 1.0225, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3508 => 0.3612, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 2.75% (1.7330 => 1.7807, std.dev.: 0.0132) MultiSource/Benchmarks/BitBench/five11/five11: 2.35% (5.1938 => 5.3157, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.71% (4.6127 => 4.6918, std.dev.: 0.0260) MultiSource/Applications/siod/siod: 1.64% (3.5520 => 3.6103, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 1.60% (14.4877 => 14.7190, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (2.4971 => 2.5301, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.5166 => 2.5435, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.94% (0.7738 => 0.7588, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.47% (5.2665 => 4.1357, std.dev.: 0.0657) SingleSource/Benchmarks/Shootout-C++/ary3: -20.06% (1.7473 => 1.3968, std.dev.: 0.0970) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.28% (1.1647 => 0.9401, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (62.4126 => 56.5475, std.dev.: 0.2284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.55% (3.2007 => 2.9272, std.dev.: 0.0375) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.06% (3.6254 => 3.3693, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.19% (2.4457 => 2.2944, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -6.09% (3.4230 => 3.2145, std.dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.01% (1.4441 => 1.3573, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ffbench: -5.19% (1.4117 => 1.3385, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.27% (0.4564 => 0.4369, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.61% (1.7361 => 1.6735, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.37% (1.2722 => 1.2293, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: -2.98% (9.2503 => 8.9746, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.83% (1.1683 => 1.1352, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.72% (3.7496 => 3.6476, std.dev.: 0.0250) MultiSource/Applications/aha/aha: -2.69% (3.4286 => 3.3365, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: -2.56% (0.4296 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -2.04% (3.4876 => 3.4165, std.dev.: 0.0172) MultiSource/Benchmarks/PAQ8p/paq8p: -1.71% (92.7467 => 91.1634, std.dev.: 0.1272) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2283, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8473, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7668, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3136, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.14% (0.9980 => 0.9866, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: -1.88% (0.6022 => 0.5909, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -0.18% (0.1666 => 0.1663, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.22% (0.1554 => 0.1573, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.23% (0.3083 => 0.3045, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.43% (0.2394 => 0.2312, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3175 => 0.3158, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (0.2302 => 0.2266, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -1.11% (0.0449 => 0.0444, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.17% (0.0240 => 0.0194, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -24.29% (0.0177 => 0.0134, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -17.46% (0.0189 => 0.0156, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.17% (1.5019 => 1.4993, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.73% (0.1501 => 0.1475, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.90% (0.4264 => 0.4055, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.64% (0.1344 => 0.1366, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0589 => 0.0566, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.81% (0.0232 => 0.0193, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.98% (0.0639 => 0.0588, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.57% (1.1350 => 1.1528, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.10% (0.0246 => 0.0231, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.54% (0.7541 => 0.7808, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.61% (1.5363 => 1.6072, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 07:17:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 09:17:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917141740.C0A2D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3916?compare_to=3913&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3916, Order: 164026, Start Time: 2012-09-17 13:04:06, End Time: 2012-09-17 14:19:03 To: 3913, Order: 164024, Start Time: 2012-09-17 10:59:45, End Time: 2012-09-17 12:14:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.72% (2.0176 => 2.3953, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.53% (0.7710 => 0.8445, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 9.51% (0.7038 => 0.7707, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3326, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.17% (0.5265 => 0.5748, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.97% (0.6959 => 0.7583, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.96% (1.3693 => 1.4920, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9199 => 0.9989, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.43% (1.2193 => 1.3221, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.3899 => 0.4219, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.18% (1.4563 => 1.5754, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.07% (0.3022 => 0.3266, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.97% (13.8202 => 14.9213, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.95% (1.1364 => 1.2268, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5577 => 0.6016, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.58% (0.6283 => 0.6759, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.58% (0.3485 => 0.3749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.55% (0.2966 => 0.3190, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.50% (0.2655 => 0.2854, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4016 => 0.4313, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.29% (0.3756 => 0.4030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.26% (0.4379 => 0.4697, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.25% (1.9828 => 2.1266, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 7.23% (1.0313 => 1.1059, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.22% (0.4791 => 0.5137, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815) MultiSource/Applications/sgefa/sgefa: 7.11% (0.2995 => 0.3208, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.3868 => 0.4143, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3293 => 0.3527, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.04% (3.8646 => 4.1368, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: 7.04% (1.1061 => 1.1840, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.03% (0.2988 => 0.3198, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5637 => 0.6032, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (7.2180 => 7.7207, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.92% (0.8310 => 0.8885, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.87% (0.7506 => 0.8022, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4390 => 0.4687, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6.72% (2.1791 => 2.3255, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.60% (3.6692 => 3.9113, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.37% (0.6576 => 0.6995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.26% (1.9270 => 2.0476, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.22% (3.1889 => 3.3874, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 6.15% (16.6129 => 17.6341, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/parameter-passing: 6.12% (0.4003 => 0.4248, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.95% (0.3646 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.94% (0.3601 => 0.3815, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 5.92% (0.6744 => 0.7143, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 5.91% (0.3789 => 0.4013, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3663 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.86% (0.3650 => 0.3864, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 5.86% (0.3940 => 0.4171, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.83% (1.0594 => 1.1212, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3623 => 0.3832, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.71% (14.8535 => 15.7022, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.70% (0.8698 => 0.9194, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.56% (1.3819 => 1.4587, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.55% (8.4961 => 8.9674, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 5.53% (1.2749 => 1.3454, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.48% (0.6135 => 0.6471, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.46% (0.2859 => 0.3015, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.45% (4.3801 => 4.6187, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.39% (1.3813 => 1.4558, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6794, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (13.2842 => 13.9863, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.14% (0.8818 => 0.9271, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.95% (0.3131 => 0.3286, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.90% (1.1333 => 1.1888, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.2504 => 0.2625, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.81% (4.6629 => 4.8871, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2260, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (6.5754 => 6.8799, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2292 => 1.2853, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.53% (3.2742 => 3.4225, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.23% (4.9865 => 5.1974, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.15% (0.9108 => 0.9486, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4805 => 0.5000, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 3.92% (3.7467 => 3.8936, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.79% (1.5188 => 1.5763, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (6.2785 => 6.4961, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.1007 => 2.1715, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 2.98% (33.2944 => 34.2857, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4963, std.dev.: 0.0190) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5209, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std.dev.: 0.0394) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (3.1736 => 3.4184, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.2093 => 0.2247, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5472, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.16% (10.7476 => 11.0870, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5956, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4457, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.08% (7.9275 => 8.0130, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.86% (0.4657 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.99% (22.5627 => 21.6627, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2827, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.60% (1.3780 => 1.3009, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.37% (3.0263 => 2.9243, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5880, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -2.11% (26.5159 => 25.9558, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2456, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.1080 => 4.0569, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2229, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2421, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2630, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 07:22:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 09:22:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917142211.A31DD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3917?compare_to=3914&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3917, Order: 164026, Start Time: 2012-09-17 13:03:54, End Time: 2012-09-17 14:23:34 To: 3914, Order: 164024, Start Time: 2012-09-17 10:59:46, End Time: 2012-09-17 12:19:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (731 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.16% (0.5685 => 0.5676, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 0.02% (15.7997 => 15.8029, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 0.13% (14.6458 => 14.6649, std.dev.: 0.0209) MultiSource/Benchmarks/Bullet/bullet: 0.04% (82.6325 => 82.6693, std.dev.: 0.0218) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.2938 => 4.2980, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2197 => 1.2180, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (7.3629 => 7.3685, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.6530 => 3.6550, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.17% (0.6334 => 0.6345, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (0.0650 => 0.0671, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.72% (63.2438 => 82.6693, std.dev.: 0.0218) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14246.94% (0.0720 => 10.3298, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.38% (10.3673 => 15.2795, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.83% (2.2022 => 2.5068, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.29% (7.0540 => 7.9917, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops: 12.64% (0.1432 => 0.1613, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.15% (1.1194 => 1.2554, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.73% (1.7609 => 1.9498, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.16% (0.3473 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.98% (0.3543 => 0.3861, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 8.95% (0.3543 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.3561 => 0.3877, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3497 => 0.3807, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.79% (0.3516 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3694 => 0.4017, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 8.54% (0.3828 => 0.4155, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.53% (0.3927 => 0.4262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.26% (0.3886 => 0.4207, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 7.75% (10.4361 => 11.2451, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.40% (0.4879 => 0.5240, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.20% (9.4845 => 10.1672, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.23% (0.5860 => 0.6225, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2554 => 0.2711, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.8172 => 0.8664, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.95% (0.6675 => 0.7072, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (8.1363 => 8.6117, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 5.80% (0.7115 => 0.7528, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (4.2646 => 4.5113, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 5.70% (0.3423 => 0.3618, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.67% (0.7835 => 0.8279, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 5.66% (5.7591 => 6.0853, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.65% (1.3050 => 1.3787, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.60% (0.5105 => 0.5391, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.50% (1.5415 => 1.6263, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 5.45% (3.3354 => 3.5173, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.35% (0.5569 => 0.5867, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.8067 => 0.8496, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.28% (0.5925 => 0.6238, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.3121 => 0.3285, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.9449 => 5.2042, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.24% (5.0018 => 5.2639, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.6030 => 0.6343, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.3092 => 0.3251, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7326 => 0.7696, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.9765 => 1.0255, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.92% (1.1642 => 1.2215, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 4.86% (0.4299 => 0.4508, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.80% (7.9617 => 8.3440, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (0.3180 => 0.3329, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.66% (0.3387 => 0.3545, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.61% (21.9371 => 22.9479, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.49% (1.0722 => 1.1203, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.46% (0.5020 => 0.5244, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 4.45% (1.5603 => 1.6298, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2387, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.40% (3.8723 => 4.0428, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.09% (0.6456 => 0.6720, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.97% (0.6450 => 0.6706, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.96% (2.0273 => 2.1075, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 3.91% (2.2969 => 2.3868, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 3.89% (0.8921 => 0.9268, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.4103 => 0.4258, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.76% (0.4064 => 0.4217, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.73% (0.3650 => 0.3786, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5981 => 0.6203, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.4186 => 1.4680, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.48% (0.3826 => 0.3959, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.46% (1.5859 => 1.6408, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4289 => 0.4437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.20% (0.3935 => 0.4061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4203 => 0.4337, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (14.3668 => 14.8228, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.13% (2.2024 => 2.2714, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4048 => 0.4174, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (2.0665 => 2.1290, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1840 => 1.2185, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (4.2280 => 4.3542, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7464, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2432, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7893, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.53% (5.2763 => 3.2435, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.28% (5.3855 => 3.8625, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.79% (5.3526 => 3.8652, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0923, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.04% (2.9384 => 2.5847, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: -8.81% (22.1758 => 20.2229, std.dev.: 0.0201) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2642, std.dev.: 0.0751) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1504, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.18% (8.6802 => 8.4046, std.dev.: 0.0142) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4993, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0055, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (8.1563 => 8.0173, std.dev.: 0.0086) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5773, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 5.43% (14.9895 => 15.8029, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 3.60% (14.1553 => 14.6649, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (4.1105 => 4.2980, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.25% (1.1048 => 1.2180, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.94% (7.1582 => 7.3685, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.55% (3.4629 => 3.6550, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.98% (0.6222 => 0.6345, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 07:32:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 09:32:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120917143230.CA56F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3918?compare_to=3911&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3918, Order: 164024, Start Time: 2012-09-17 11:50:26, End Time: 2012-09-17 14:33:53 To: 3911, Order: 164017, Start Time: 2012-09-17 08:38:33, End Time: 2012-09-17 11:22:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.04% (54.2859 => 54.8483, std.dev.: 0.1115) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.18% (0.3465 => 0.3783, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3446 => 0.3761, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3496 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.08% (0.3469 => 0.3784, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3442 => 0.3751, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.97% (0.3488 => 0.3801, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.90% (0.3460 => 0.3768, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.74% (0.3650 => 0.3969, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.65% (0.3643 => 0.3958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.51% (0.3724 => 0.4041, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.97% (1.5932 => 1.7042, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 5.89% (0.5826 => 0.6169, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 5.82% (0.5889 => 0.6232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7649, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.53% (1.3152 => 1.3879, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (0.4361 => 0.4602, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.43% (2.7292 => 2.8774, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.04% (5.5417 => 5.8209, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (0.4994 => 0.5234, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2875 => 0.3012, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 4.76% (1.0781 => 1.1294, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.61% (23.5202 => 24.6043, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 4.57% (0.7171 => 0.7499, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.3004 => 0.3140, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.47% (0.2750 => 0.2873) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.40% (0.9909 => 1.0345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.37% (0.2813 => 0.2936, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.37% (4.2109 => 4.3949, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.35% (0.2803 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2738 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.33% (0.2792 => 0.2913, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.33% (2.1013 => 2.1923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.33% (0.3258 => 0.3399, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.5900 => 0.6155, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.31% (0.3060 => 0.3192, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.30% (2.0673 => 2.1562, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.29% (0.2911 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (4.4195 => 4.6077, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.2866 => 0.2988, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.14% (0.4029 => 0.4196, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3096 => 0.3224, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.12% (4.6177 => 4.8080, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (2.1653 => 2.2525, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.3362 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3317 => 0.3450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.97% (0.3477 => 0.3615, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.95% (0.6634 => 0.6896, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.3903 => 0.4056, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.92% (0.3726 => 0.3872, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.91% (1.8794 => 1.9529, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.4139 => 0.4300, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.86% (0.4251 => 0.4415, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3282 => 0.3407, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.79% (1.4269 => 1.4810, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (1.9694 => 2.0426, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.71% (0.3690 => 0.3827, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.64% (0.5546 => 0.5748, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.3981 => 0.4120, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.3271 => 0.3385, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.47% (0.2969 => 0.3072, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (0.4658 => 0.4818, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.39% (0.9697 => 1.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (1.9966 => 2.0637, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.33% (0.5012 => 0.5179, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.19% (2.0346 => 2.0995, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.14% (0.7875 => 0.8122, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 2.70% (0.4847 => 0.4978, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (0.5361 => 0.5496, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (0.5584 => 0.5700, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.07% (11.6398 => 11.8804, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (4.6926 => 4.7860, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8957, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1724, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6495, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std.dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5089, std.dev.: 0.0198) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4377, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5825, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5636, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7898, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8073, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.24% (17.2379 => 16.8525, std.dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9602, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 08:28:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 10:28:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917152820.1459F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3919?compare_to=3915&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3919, Order: 164028, Start Time: 2012-09-17 14:19:01, End Time: 2012-09-17 15:29:44 To: 3915, Order: 164026, Start Time: 2012-09-17 12:51:55, End Time: 2012-09-17 14:03:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (54 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 896 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.07% (0.2751 => 0.2918, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.19% (0.7250 => 0.7409, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.16% (4.2576 => 4.3070, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.40% (2.6913 => 2.7291, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.64% (1.1067 => 1.0886, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.76% (0.9866 => 0.9941, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.30% (0.5909 => 0.5986, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: -2.71% (0.1663 => 0.1618, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.18% (0.1573 => 0.1523, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.3045 => 0.3112, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.2312 => 0.2381, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.51% (0.3158 => 0.3142, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2266 => 0.2263, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 1.58% (0.0444 => 0.0451, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -39.77% (0.0088 => 0.0053, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: -3.37% (0.0089 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 24.74% (0.0194 => 0.0242, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.21% (0.0192 => 0.0182, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0389 => 0.0389, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.67% (0.0299 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.18% (0.0283 => 0.0274, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0323 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 32.84% (0.0134 => 0.0178, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: 21.15% (0.0156 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.45% (0.0245 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.31% (0.0321 => 0.0320, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1437 => 0.1435, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: -6.49% (1.4993 => 1.4020, std.dev.: 0.0745) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.15% (0.1475 => 0.1492, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.81% (0.4055 => 0.4022, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.37% (0.1366 => 0.1412, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.30% (0.0566 => 0.0613, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.21% (0.0193 => 0.0232, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.76% (0.0588 => 0.0616, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1528 => 1.1520, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0005 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.48% (0.0545 => 0.0613, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.65% (0.0231 => 0.0181, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7808 => 0.7811, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.07% (1.6072 => 1.6084, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.35% (4.1772 => 3.0765, std.dev.: 0.0870) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0120) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 5.76% (0.5309 => 0.5615, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: 5.66% (2.1763 => 2.2994, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.59% (0.6410 => 0.6768, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.17% (0.2552 => 0.2684, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.94% (0.3582 => 0.3759, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.84% (0.6915 => 0.7250, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 4.33% (1.0046 => 1.0481, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 4.15% (0.6173 => 0.6429, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: 2.65% (1.1440 => 1.1743, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.5150 => 1.5547, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.7226 => 0.7409, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.37% (1.3268 => 1.3583, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 2.32% (29.3170 => 29.9961, std.dev.: 0.1487) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7722 => 0.7887, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.77% (1.1672 => 1.1879, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 1.76% (3.5980 => 3.6612, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 1.66% (2.0972 => 2.1321, std.dev.: 0.0131) MultiSource/Applications/d/make_dparser: 1.47% (3.0225 => 3.0669, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (12.6413 => 12.7909, std.dev.: 0.0445) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.07% (4.2616 => 4.3070, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3396, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9963, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3746 => 0.4285, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.73% (4.0101 => 4.5607, std.dev.: 0.0130) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.54% (0.2694 => 0.2978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 9.38% (7.0025 => 7.6593, std.dev.: 0.0115) SingleSource/Benchmarks/Stanford/Puzzle: 7.68% (0.1433 => 0.1543, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 6.79% (1.0194 => 1.0886, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.62% (0.2857 => 0.3046, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.47% (4.2129 => 4.4853, std.dev.: 0.1013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8123, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.65% (40.4792 => 42.7681, std.dev.: 0.5702) SingleSource/Benchmarks/Misc/dt: 4.46% (0.9851 => 1.0290, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 4.25% (15.2242 => 15.8710, std.dev.: 0.0359) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8386, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8714, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4644, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.74% (0.5876 => 0.6037, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 2.63% (5.1938 => 5.3302, std.dev.: 0.0465) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.38% (2.6656 => 2.7291, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 2.13% (3.5520 => 3.6275, std.dev.: 0.0162) MultiSource/Applications/hexxagon/hexxagon: 1.97% (14.4877 => 14.7733, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4853, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5326, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.12% (4.0659 => 4.1115, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: 1.09% (2.5166 => 2.5441, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 1.02% (2.8599 => 2.8892, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.09% (0.3497 => 0.2060, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.64% (5.2665 => 4.0743, std.dev.: 0.0578) SingleSource/Benchmarks/Shootout-C++/ary3: -20.41% (1.7473 => 1.3907, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.28% (1.1647 => 0.9402, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -10.68% (0.1114 => 0.0995, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.47% (62.4126 => 56.5022, std.dev.: 0.0416) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.75% (3.2007 => 2.9206, std.dev.: 0.0648) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.23% (3.6254 => 3.3632, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.61% (2.4457 => 2.2840, std.dev.: 0.0286) MultiSource/Applications/SIBsim4/SIBsim4: -6.49% (3.4230 => 3.2009, std.dev.: 0.0663) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -5.75% (1.4441 => 1.3610, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4063, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.44% (0.4140 => 0.3956, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/distray/distray: -4.13% (0.2664 => 0.2554, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: -3.80% (1.4117 => 1.3581, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.77% (1.7361 => 1.6707, std.dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: -3.36% (7.6833 => 7.4255, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (9.2503 => 8.9416, std.dev.: 0.0176) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.31% (1.2722 => 1.2301, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.11% (3.7496 => 3.6328, std.dev.: 0.0348) MultiSource/Applications/aha/aha: -2.93% (3.4286 => 3.3283, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.82% (1.1683 => 1.1353, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4206, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: -1.88% (3.8907 => 3.8176, std.dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1551, std.dev.: 0.4588) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3068, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7685, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.33% (9.3855 => 9.2608, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.25% (1.8739 => 1.8504, std.dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.39% (0.9980 => 0.9941, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -0.60% (0.6022 => 0.5986, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: -2.88% (0.1666 => 0.1618, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.99% (0.1554 => 0.1523, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.94% (0.3083 => 0.3112, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.54% (0.2394 => 0.2381, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (0.3175 => 0.3142, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (0.2302 => 0.2263, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -40.45% (0.0089 => 0.0053, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: -4.44% (0.0090 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.21% (0.0192 => 0.0182, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.52% (0.0284 => 0.0274, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.54% (0.0325 => 0.0320, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1429 => 0.1435, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: -6.65% (1.5019 => 1.4020, std.dev.: 0.0745) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.60% (0.1501 => 0.1492, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.68% (0.4264 => 0.4022, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.06% (0.1344 => 0.1412, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.60% (0.0639 => 0.0616, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.50% (1.1350 => 1.1520, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.77% (0.0637 => 0.0613, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.42% (0.0246 => 0.0181, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.58% (0.7541 => 0.7811, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.69% (1.5363 => 1.6084, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 09:03:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 11:03:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917160346.E6FC0352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3920?compare_to=3916&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3920, Order: 164030, Start Time: 2012-09-17 14:50:02, End Time: 2012-09-17 16:05:08 To: 3916, Order: 164026, Start Time: 2012-09-17 13:04:06, End Time: 2012-09-17 14:19:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.93% (2.2650 => 2.3314, std.dev.: 0.0197) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.94% (2.0176 => 2.3998, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.53% (0.1072 => 0.1217, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.32% (3.9660 => 4.3357, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 9.24% (0.7038 => 0.7688, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.21% (0.7710 => 0.8420, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.13% (0.1588 => 0.1733, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.09% (1.3693 => 1.4938, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.04% (0.5265 => 0.5741, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.01% (0.2596 => 0.2830, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.58% (0.9199 => 0.9988, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.56% (0.6959 => 0.7555, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.56% (1.2193 => 1.3237, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.5818 => 0.6315, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5748 => 0.6229, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.23% (1.4563 => 1.5762, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 7.99% (13.8202 => 14.9243, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.96% (1.1364 => 1.2269, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.72% (0.6283 => 0.6768, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.5577 => 0.6006, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.56% (1.0313 => 1.1093, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1865 => 0.2006, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.45% (0.4390 => 0.4717, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.35% (0.3756 => 0.4032, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.31% (1.1061 => 1.1870, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.18% (0.2995 => 0.3210, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (3.8646 => 4.1408, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.11% (0.2925 => 0.3133, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.9828 => 2.1231, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.07% (0.2914 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 6.99% (0.8310 => 0.8891, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (7.2180 => 7.7218, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.5637 => 0.6029, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.83% (0.7506 => 0.8019, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.75% (2.1791 => 2.3261, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 6.68% (0.3220 => 0.3435, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.66% (3.6692 => 3.9135, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.50% (16.6129 => 17.6929, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.43% (0.7460 => 0.7940, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.40% (0.6576 => 0.6997, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.33% (0.6744 => 0.7171, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.31% (1.3245 => 1.4081, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.26% (1.9270 => 2.0477, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.25% (1.0594 => 1.1256, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.17% (3.1889 => 3.3858, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 5.70% (14.8535 => 15.7005, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9784, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 5.66% (0.4113 => 0.4346, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 5.66% (1.2749 => 1.3470, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (1.3819 => 1.4600, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.4003 => 0.4229, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (1.3813 => 1.4592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.60% (0.3914 => 0.4133, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.57% (0.3789 => 0.4000, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.54% (0.3755 => 0.3963, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.53% (0.3578 => 0.3776, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.48% (0.3940 => 0.4156, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.43% (0.3646 => 0.3844, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 5.41% (0.3663 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.39% (4.4433 => 4.6827, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 5.39% (0.3601 => 0.3795, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (4.3801 => 4.6151, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.32% (0.3650 => 0.3844, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (13.2842 => 13.9883, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/exceptions-3: 5.30% (0.3623 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1333 => 1.1923, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.21% (0.8818 => 0.9277, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.05% (0.3245 => 0.3409) MultiSource/Applications/JM/ldecod/ldecod: 5.02% (6.5754 => 6.9053, std.dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 5.00% (14.5298 => 15.2567, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.63% (4.9865 => 5.2175, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.55% (3.2742 => 3.4231, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.2292 => 1.2851, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.50% (4.6629 => 4.8728, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.18% (0.9108 => 0.9489, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.14% (3.7467 => 3.9020, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6250 => 0.6504, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.5188 => 1.5785, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5064, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.55% (2.1007 => 2.1753, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.45% (0.3511 => 0.3632, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.19% (33.2944 => 34.3557, std.dev.: 0.0198) MultiSource/Applications/sqlite3/sqlite3: 1.64% (16.2614 => 16.5287, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 28.28% (1.8175 => 2.3314, std.dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.98% (0.2093 => 0.2239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6975, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5480, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0701, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6082, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5160, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.13% (1.4298 => 1.4459, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5941, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.29% (0.4657 => 0.3852, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.62% (22.5627 => 21.7470, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2526, std.dev.: 0.0376) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std.dev.: 0.0109) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.33% (3.0263 => 2.9256, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5853, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.14% (26.5159 => 25.9480, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2407, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2443, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (4.1080 => 4.0615, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 09:10:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 11:10:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917161036.189B7352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3921?compare_to=3917&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3921, Order: 164030, Start Time: 2012-09-17 14:52:17, End Time: 2012-09-17 16:11:57 To: 3917, Order: 164026, Start Time: 2012-09-17 13:03:54, End Time: 2012-09-17 14:23:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (125 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (721 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (15.2795 => 15.6400, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.38% (55.1595 => 56.4707, std.dev.: 0.1786) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.00% (1.3269 => 1.3003, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5676 => 0.5668, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: -0.08% (15.8029 => 15.7909, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -0.12% (14.6649 => 14.6475, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: -0.32% (82.6693 => 82.4015, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.2980 => 4.2987, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.12% (1.2180 => 1.2165, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.27% (7.3685 => 7.3487, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.18% (3.6550 => 3.6484, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.6345 => 0.6332, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0671 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.29% (63.2438 => 82.4015, std.dev.: 0.0186) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14255.28% (0.0720 => 10.3358, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.86% (10.3673 => 15.6400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 25.09% (0.1622 => 0.2029, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.28% (2.2022 => 2.4946, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.17% (7.0540 => 7.9828, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.23% (1.1194 => 1.2563, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.80% (1.7609 => 1.9510, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.90% (0.1584 => 0.1725, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3473 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3543 => 0.3833, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 8.18% (0.3497 => 0.3783, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.13% (0.3543 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.09% (0.3561 => 0.3849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.08% (0.3516 => 0.3800, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3828 => 0.4137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 8.01% (0.3282 => 0.3545, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.3927 => 0.4238, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.90% (0.3694 => 0.3986, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.82% (10.4361 => 11.2524, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.85% (9.4845 => 10.1340, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.60% (0.4879 => 0.5201, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.41% (0.2700 => 0.2873, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (0.7433 => 0.7901, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.16% (0.5860 => 0.6221, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.08% (0.1695 => 0.1798, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4615 => 0.4891, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.6675 => 0.7073, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.2554 => 0.2706, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.3307 => 0.3502, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (4.2646 => 4.5098, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 5.72% (0.7115 => 0.7522, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 5.72% (5.7591 => 6.0885, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 5.70% (0.3423 => 0.3618, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.3050 => 1.3778, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (1.5415 => 1.6274, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (8.1363 => 8.5837, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.41% (0.5105 => 0.5381, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.33% (3.3354 => 3.5132, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.32% (0.8172 => 0.8607, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.26% (0.2758 => 0.2903, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.8067 => 0.8488, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (5.0018 => 5.2611, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 5.12% (0.7835 => 0.8236, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (4.9449 => 5.1967, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.06% (0.9765 => 1.0259, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.95% (0.3092 => 0.3245, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.95% (1.1642 => 1.2218, std.dev.: 0.0077) SingleSource/UnitTests/ObjC++/Hello: 4.73% (0.5925 => 0.6205, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.72% (1.5603 => 1.6339, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 4.68% (0.4299 => 0.4500, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.61% (0.6030 => 0.6308, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.55% (0.3387 => 0.3541, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.53% (0.7326 => 0.7658, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.44% (1.1861 => 1.2388, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.44% (7.9617 => 8.3151, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 4.42% (1.0722 => 1.1196, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.41% (3.8723 => 4.0432, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.38% (0.5020 => 0.5240, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.4103 => 0.4274, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3921, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 4.12% (0.6456 => 0.6722, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4636 => 0.4826, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1086, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 3.99% (21.9371 => 22.8114, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.4064 => 0.4224, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3422 => 0.3556, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 3.87% (0.8921 => 0.9266, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.85% (0.5981 => 0.6211, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5859 => 1.6444, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4289 => 0.4442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.50% (0.4203 => 0.4350, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.44% (0.3136 => 0.3244, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.40% (0.3826 => 0.3956, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3603 => 0.3723, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.4186 => 1.4654, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0665 => 2.1338, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.03% (2.2024 => 2.2691, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8005, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3684 => 0.3792, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.1840 => 1.2171, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.8101 => 0.8266, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.66% (1.2842 => 1.3055, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3811, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (4.2280 => 4.3559, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7467, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7893, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2242, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5806, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.47% (5.2763 => 3.2466, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.27% (5.3855 => 3.8629, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.90% (5.3526 => 3.8590, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0684, std.dev.: 0.0838) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.00% (2.9384 => 2.5857, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -8.74% (22.1758 => 20.2367, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2889, std.dev.: 0.1127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (1.8329 => 1.7167, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.73% (1.6805 => 1.5842, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4333, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0081, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -2.35% (1.2373 => 1.2082, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (8.1563 => 8.0209, std.dev.: 0.0110) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5767, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2308, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.40% (0.5229 => 0.5668, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 5.35% (14.9895 => 15.7909, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 3.48% (14.1553 => 14.6475, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (4.1105 => 4.2987, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.11% (1.1048 => 1.2165, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.66% (7.1582 => 7.3487, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.36% (3.4629 => 3.6484, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6222 => 0.6332, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 09:55:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 11:55:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917165548.96C0F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3922?compare_to=3919&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3922, Order: 164033, Start Time: 2012-09-17 15:45:22, End Time: 2012-09-17 16:57:11 To: 3919, Order: 164028, Start Time: 2012-09-17 14:19:01, End Time: 2012-09-17 15:29:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (55 on baseline) Performance Improvements: 4 (33 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.52% (0.2024 => 0.2156, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (3.0153 => 3.3130, std.dev.: 0.1053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.37% (0.3046 => 0.3179, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.62% (2.4121 => 2.4752, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.54% (1.2716 => 1.2912, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.47% (4.5021 => 4.5685, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.82% (0.7409 => 0.7274, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: -1.57% (3.9171 => 3.8557, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (1.4320 => 1.4100, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.31% (4.3070 => 4.2507, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.26% (0.9941 => 0.9915, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -0.07% (0.5986 => 0.5982, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: 2.72% (0.1618 => 0.1662, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.76% (0.1523 => 0.1565, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (0.3112 => 0.3105, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.13% (0.2381 => 0.2354, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (0.3142 => 0.3144, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.90% (0.2263 => 0.2306, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 0.44% (0.0451 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 66.04% (0.0053 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 4.65% (0.0086 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.74% (0.0242 => 0.0216, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.85% (0.0182 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0389 => 0.0385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0297 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.19% (0.0274 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0321 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0178 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -15.87% (0.0189 => 0.0159, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -2.39% (0.0251 => 0.0245, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 2.81% (0.0320 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1435 => 0.1434, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.82% (1.4020 => 1.5257, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.81% (0.1492 => 0.1519, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.32% (0.4022 => 0.4236, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.03% (0.1412 => 0.1341, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.97% (0.0613 => 0.0558, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (0.0232 => 0.0222, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.71% (0.0616 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1520 => 1.1475, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.33% (0.0015 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 360.00% (0.0005 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.73% (0.0613 => 0.0584, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.47% (0.0181 => 0.0209, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.7811 => 0.7816, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.16% (1.6084 => 1.6110, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.06% (4.1772 => 3.0886, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/except: 82983.33% (0.0006 => 0.4985, std.dev.: 0.0073) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.5309 => 0.5640, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 5.90% (2.1763 => 2.3048, std.dev.: 0.0428) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.6410 => 0.6772, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.25% (0.3582 => 0.3770, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.98% (0.2552 => 0.2679, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.11% (0.6915 => 0.7199, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 3.84% (0.6173 => 0.6410, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 3.80% (1.0046 => 1.0428, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 3.17% (15.3105 => 15.7960, std.dev.: 0.1119) MultiSource/Applications/hbd/hbd: 2.56% (1.3268 => 1.3607, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5150 => 1.5504, std.dev.: 0.0081) MultiSource/Applications/d/make_dparser: 2.26% (3.0225 => 3.0908, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.7639 => 0.7780, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.36% (3.5980 => 3.6470, std.dev.: 0.0167) MultiSource/Applications/siod/siod: 1.27% (2.0972 => 2.1239, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.24% (1.1672 => 1.1817, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.23% (13.3238 => 13.4875, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.06% (1.2021 => 1.2149, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.98% (0.0766 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.34% (0.0917 => 0.1076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 15.09% (1.7426 => 2.0055, std.dev.: 0.0343) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5549, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 13.53% (0.3746 => 0.4253, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.27% (0.2857 => 0.3179, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.50% (3.0256 => 3.3130, std.dev.: 0.1053) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.16% (1.0063 => 1.0985, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 8.38% (7.0025 => 7.5890, std.dev.: 0.0300) SingleSource/Benchmarks/McGill/chomp: 8.34% (1.0194 => 1.1044, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3301 => 0.3503, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8016, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 3.86% (8.5113 => 8.8395, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4650, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.18% (0.7609 => 0.7851, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.02% (0.3508 => 0.3614, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (2.4042 => 2.4752, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.72% (2.6656 => 2.7381, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash: 2.50% (0.6308 => 0.6466, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: 2.19% (5.1938 => 5.3077, std.dev.: 0.0266) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.17% (4.6127 => 4.7127, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.70% (14.4877 => 14.7342, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.70% (1.6110 => 1.6384, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.46% (1.2726 => 1.2912, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4455 => 2.4807, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.41% (6.9722 => 7.0706, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (4.5056 => 4.5685, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 1.21% (2.5166 => 2.5470, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.49% (5.2665 => 4.1876, std.dev.: 0.0517) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.26% (1.1647 => 0.9404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.19% (62.4126 => 56.6779, std.dev.: 0.0880) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.57% (2.4457 => 2.2362, std.dev.: 0.0447) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.56% (1.4034 => 1.2833, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2007 => 2.9418, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.19% (3.6254 => 3.3646, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -6.78% (3.4230 => 3.1910, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3509, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4068, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: -4.70% (1.4117 => 1.3454, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9422, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.15% (1.7361 => 1.6814, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -3.13% (7.6833 => 7.4429, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.00% (3.7496 => 3.6372, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4140 => 0.4017, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.71% (1.1683 => 1.1366, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2884, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4186, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2292, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.53% (3.8907 => 3.8312, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -1.48% (92.7467 => 91.3706, std.dev.: 0.4165) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7669, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3176, std.dev.: 0.0480) MultiSource/Benchmarks/llubenchmark/llu: -1.31% (2.0192 => 1.9927, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.65% (0.9980 => 0.9915, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -0.66% (0.6022 => 0.5982, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: -0.24% (0.1666 => 0.1662, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.71% (0.1554 => 0.1565, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.71% (0.3083 => 0.3105, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.67% (0.2394 => 0.2354, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.98% (0.3175 => 0.3144, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2302 => 0.2306, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.00% (0.0240 => 0.0216, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -15.87% (0.0189 => 0.0159, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1429 => 0.1434, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.58% (1.5019 => 1.5257, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.20% (0.1501 => 0.1519, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.66% (0.4264 => 0.4236, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.22% (0.1344 => 0.1341, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.26% (0.0589 => 0.0558, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (0.0232 => 0.0222, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.10% (1.1350 => 1.1475, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.32% (0.0637 => 0.0584, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.04% (0.0246 => 0.0209, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.65% (0.7541 => 0.7816, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.86% (1.5363 => 1.6110, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 10:44:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 12:44:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120917174434.087F0352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3923?compare_to=3918&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3923, Order: 164033, Start Time: 2012-09-17 15:02:05, End Time: 2012-09-17 17:45:55 To: 3918, Order: 164024, Start Time: 2012-09-17 11:50:26, End Time: 2012-09-17 14:33:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.38% (115.8966 => 129.0864, std.dev.: 1.1898) SingleSource/Benchmarks/Shootout-C++/ary: 4.81% (0.2142 => 0.2245, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.75% (0.3465 => 0.3803, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3446 => 0.3776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3496 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.52% (0.3488 => 0.3820, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.45% (0.3460 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.41% (0.3442 => 0.3766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.18% (0.3650 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.14% (0.3643 => 0.3976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.3724 => 0.4056, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.67% (1.5932 => 1.7154, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (1.6211 => 1.7170, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 5.87% (0.5826 => 0.6168, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (0.4361 => 0.4612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.72% (0.5889 => 0.6226, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.59% (3.5627 => 3.7619, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.56% (0.2014 => 0.2126, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.52% (1.3152 => 1.3878, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.38% (2.7292 => 2.8759, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.37% (5.5417 => 5.8394, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (0.4994 => 0.5252, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (0.5000 => 0.5252, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 4.97% (1.0781 => 1.1317, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 4.70% (0.6634 => 0.6946, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.5900 => 0.6170, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7171 => 0.7494, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 4.48% (4.2109 => 4.3996, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2875 => 0.3002, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.38% (0.5026 => 0.5246, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 4.33% (23.5202 => 24.5391, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3195 => 0.3333, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.30% (4.6177 => 4.8164, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (1.8794 => 1.9598, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.24% (0.4029 => 0.4200, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (0.3890 => 0.4055, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.23% (0.3336 => 0.3477, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 4.19% (0.3004 => 0.3130, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (2.1013 => 2.1894, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.4139 => 0.4312, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (4.4195 => 4.6039, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 4.13% (2.1653 => 2.2547, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.3903 => 0.4063, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.07% (1.4269 => 1.4850, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2750 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (2.0673 => 2.1503, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.97% (0.9909 => 1.0302, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.93% (0.5546 => 0.5764, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3060 => 0.3178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.85% (0.2911 => 0.3023, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.84% (0.4146 => 0.4305, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2792 => 0.2899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (1.9694 => 2.0421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3477 => 0.3605, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.3084 => 0.3197, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.64% (0.3348 => 0.3470, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3726 => 0.3861, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (1.9966 => 2.0676, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4251 => 0.4401, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3690 => 0.3820, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.51% (0.3678 => 0.3807, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.43% (0.7875 => 0.8145, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.22% (2.0346 => 2.1002, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.5012 => 0.5173, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.18% (0.9697 => 1.0005, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.98% (0.7426 => 0.7647, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (0.4847 => 0.4989, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.85% (0.5361 => 0.5514, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (0.5584 => 0.5717, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.27% (11.6398 => 11.9038, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.14% (4.6926 => 4.7928, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6745, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1652, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/flops-2: 4.34% (1.8057 => 1.8840, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6420, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2016, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4353, std.dev.: 0.0170) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5891, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5763, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7879, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0063) SingleSource/UnitTests/Vector/build2: -3.76% (11.2080 => 10.7869, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7972, std.dev.: 0.0444) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5722, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9621, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 10:47:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 12:47:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917174703.BA24E352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3924?compare_to=3920&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3924, Order: 164033, Start Time: 2012-09-17 16:33:48, End Time: 2012-09-17 17:48:24 To: 3920, Order: 164030, Start Time: 2012-09-17 14:50:02, End Time: 2012-09-17 16:05:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.37% (0.5349 => 0.5476, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.95% (78.5874 => 80.1193, std.dev.: 0.2242) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.01% (2.3314 => 2.2612, std.dev.: 0.0143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.39% (2.0176 => 2.3887, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.87% (0.1072 => 0.1210, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.29% (3.9660 => 4.3344, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.26% (0.7710 => 0.8424, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.07% (0.1588 => 0.1732, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 8.73% (1.3693 => 1.4889, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.47% (0.9199 => 0.9978, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.45% (0.6959 => 0.7547, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.43% (0.5265 => 0.5709, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.41% (1.2193 => 1.3219, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7061 => 0.7649, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5818 => 0.6298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.22% (1.4563 => 1.5760, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.20% (0.4328 => 0.4683, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4062 => 0.4390, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5748 => 0.6206, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.92% (1.1364 => 1.2264, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.90% (13.8202 => 14.9126, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.84% (0.5577 => 0.6014, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6283 => 0.6753, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 7.39% (1.0313 => 1.1075, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.19% (0.7506 => 0.8046, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 7.19% (1.1061 => 1.1856, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.01% (3.8646 => 4.1356, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (7.2180 => 7.7219, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 6.94% (0.2995 => 0.3203, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3485 => 0.3726, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.88% (0.4390 => 0.4692, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5637 => 0.6024, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.86% (0.8310 => 0.8880, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.3756 => 0.4011, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 6.78% (0.2243 => 0.2395, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.77% (0.2925 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3489 => 0.3725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.73% (3.6692 => 3.9160, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.58% (2.1791 => 2.3225, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.56% (0.3293 => 0.3509, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (1.9828 => 2.1112, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4016 => 0.4276, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.33% (0.2765 => 0.2940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.3868 => 0.4109, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.21% (3.1889 => 3.3868, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.17% (1.3245 => 1.4062, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.16% (16.6129 => 17.6367, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.3107 => 0.3298, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.14% (0.6744 => 0.7158, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.13% (1.3813 => 1.4660, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.11% (1.9270 => 2.0447, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.10% (0.3149 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.96% (0.6576 => 0.6968, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.95% (1.3819 => 1.4641, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 5.87% (1.0594 => 1.1216, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3534 => 0.3741, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.85% (0.4003 => 0.4237, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3914 => 0.4141, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.68% (1.2749 => 1.3473, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 5.67% (0.3789 => 0.4004, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 5.67% (0.3578 => 0.3781, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3646 => 0.3851, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 5.62% (14.8535 => 15.6876, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 5.61% (0.3601 => 0.3803, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.58% (8.4961 => 8.9705, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4113 => 0.4341, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.53% (0.3650 => 0.3852, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.6135 => 0.6472, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 5.49% (0.3623 => 0.3822, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.43% (0.8698 => 0.9170, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6165, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (4.4433 => 4.6818, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.21% (0.8818 => 0.9277, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (13.2842 => 13.9716, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (1.1333 => 1.1912, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.91% (14.5298 => 15.2433, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3755 => 0.3939, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (6.5754 => 6.8923, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.75% (0.3245 => 0.3399, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.54% (4.6629 => 4.8748, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (3.2742 => 3.4185, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1948, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.12% (0.9108 => 0.9483, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2788, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4805 => 0.4996, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.84% (1.5188 => 1.5771, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8905, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.82% (0.6250 => 0.6489, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (6.2785 => 6.5019, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1703, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.03% (33.2944 => 34.3016, std.dev.: 0.0196) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5000, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.98% (0.2093 => 0.2260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6982, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5463, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.92% (10.7476 => 11.0612, std.dev.: 0.0435) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6005, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6013, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4456, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.09% (0.4657 => 0.3861, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.19% (0.2670 => 0.2558, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.69% (22.5627 => 21.7312, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2644, std.dev.: 0.0319) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9219, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -2.99% (1.9762 => 1.9171, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6083, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.31% (26.5159 => 25.9036, std.dev.: 0.0289) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2333, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2333, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8707, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (4.1080 => 4.0615, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2309, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4332, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 10:58:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 12:58:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917175847.573EC352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3925?compare_to=3921&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3925, Order: 164033, Start Time: 2012-09-17 16:40:31, End Time: 2012-09-17 18:00:07 To: 3921, Order: 164030, Start Time: 2012-09-17 14:52:17, End Time: 2012-09-17 16:11:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.36% (77.9804 => 79.8216, std.dev.: 0.0602) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5668 => 0.5676, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: -0.07% (15.7909 => 15.7805, std.dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: -0.29% (14.6475 => 14.6050, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: -0.05% (82.4015 => 82.3626, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: -0.23% (4.2987 => 4.2890, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.16% (1.2165 => 1.2146, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.14% (7.3487 => 7.3383, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.18% (3.6484 => 3.6417, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.21% (0.6332 => 0.6319, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.23% (63.2438 => 82.3626, std.dev.: 0.0067) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14251.39% (0.0720 => 10.3330, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 51.66% (10.3673 => 15.7234, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 24.60% (0.1622 => 0.2021, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.78% (7.0540 => 7.9557, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.77% (2.2022 => 2.4835, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 12.29% (0.1432 => 0.1608, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.61% (1.1194 => 1.2494, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.49% (0.1566 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.06% (1.7609 => 1.9381, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.29% (0.3543 => 0.3872, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 8.93% (0.3473 => 0.3783) SingleSource/UnitTests/ObjC/exceptions-3: 8.76% (0.3516 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3561 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3543 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.65% (0.1584 => 0.1721, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.58% (0.3694 => 0.4011, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 8.44% (0.3828 => 0.4151, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.15% (0.3927 => 0.4247, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.05% (0.3886 => 0.4199, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.71% (0.3282 => 0.3535, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.54% (10.4361 => 11.2228, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.74% (0.3177 => 0.3391, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.68% (9.4845 => 10.1178, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.37% (0.4879 => 0.5190, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.16% (0.7433 => 0.7891, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.93% (0.2700 => 0.2860, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 5.92% (0.3109 => 0.3293, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.4615 => 0.4883, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.67% (0.3423 => 0.3617, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.62% (1.5415 => 1.6282, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5860 => 0.6189, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (4.2646 => 4.5025, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.57% (0.6675 => 0.7047, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.56% (0.2554 => 0.2696, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 5.54% (0.7115 => 0.7509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.48% (0.8172 => 0.8620, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.48% (8.1363 => 8.5822, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.3050 => 1.3762, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.44% (5.7591 => 6.0722, std.dev.: 0.0183) MultiSource/Applications/d/make_dparser: 5.28% (3.3354 => 3.5115, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.11% (0.7835 => 0.8235, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2758 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.5105 => 0.5362, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.00% (0.3121 => 0.3277, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.99% (5.0018 => 5.2516, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.96% (0.8067 => 0.8467, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.96% (0.9765 => 1.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.95% (4.9449 => 5.1897, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 4.95% (0.3092 => 0.3245, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 4.82% (1.1642 => 1.2203, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3441 => 0.3598, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.49% (1.5603 => 1.6304, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.46% (0.2603 => 0.2719, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.44% (0.4299 => 0.4490, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.44% (0.5925 => 0.6188, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2387, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.43% (0.3387 => 0.3537, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.43% (0.6030 => 0.6297, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.40% (3.8723 => 4.0425, std.dev.: 0.0145) MultiSource/Applications/lemon/lemon: 4.36% (1.0722 => 1.1189, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.3180 => 0.3317, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.16% (21.9371 => 22.8495, std.dev.: 0.0156) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.14% (7.9617 => 8.2916, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.5020 => 0.5227, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 4.05% (2.2969 => 2.3899, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6456 => 0.6716, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.97% (2.0273 => 2.1077, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.4636 => 0.4819, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3422 => 0.3553, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5981 => 0.6209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.79% (0.7326 => 0.7604, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6450 => 0.6694, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.76% (0.4064 => 0.4217, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.73% (0.4103 => 0.4256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.71% (0.8921 => 0.9252, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.42% (0.3650 => 0.3775, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (1.5859 => 1.6398, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.38% (0.4203 => 0.4345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.29% (1.4186 => 1.4653, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.02% (0.3935 => 0.4054, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7958, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.97% (2.0665 => 2.1278, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 2.89% (0.4048 => 0.4165, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.76% (2.2024 => 2.2632, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 2.74% (0.3684 => 0.3785, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.55% (1.1840 => 1.2142, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.8101 => 0.8250, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3809, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (4.2280 => 4.3637, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7546, std.dev.: 0.0055) SingleSource/Regression/C/uint64_to_float: 1.87% (0.5413 => 0.5514, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (0.9540 => 0.9683, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2234, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.11% (26.0924 => 26.3817, std.dev.: 0.0316) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.60% (5.2763 => 3.2394, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.56% (5.3855 => 3.8474, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.29% (5.3526 => 3.8382, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0728, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.17% (2.9384 => 2.5809, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -8.92% (22.1758 => 20.1988, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2590, std.dev.: 0.1938) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (1.8329 => 1.7144, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.72% (1.6805 => 1.5844, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: -5.11% (1.5835 => 1.5026, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5023, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4122, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9975, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9995, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: -1.79% (1.2373 => 1.2152, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5090, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5774, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2333, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0161) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 5.28% (14.9895 => 15.7805, std.dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 3.18% (14.1553 => 14.6050, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (4.1105 => 4.2890, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.94% (1.1048 => 1.2146, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.52% (7.1582 => 7.3383, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.16% (3.4629 => 3.6417, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (0.6222 => 0.6319, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 11:23:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 13:23:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917182336.B3966352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3926?compare_to=3922&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3926, Order: 164036, Start Time: 2012-09-17 17:13:38, End Time: 2012-09-17 18:24:58 To: 3922, Order: 164033, Start Time: 2012-09-17 15:45:22, End Time: 2012-09-17 16:57:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (48 on baseline) Performance Improvements: 1 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3024 => 0.3135, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5468 => 0.5577, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.1574 => 8.2638, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 4.27% (0.2484 => 0.2590, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.18% (21.8139 => 22.2899, std.dev.: 0.1129) SingleSource/Benchmarks/Misc/fp-convert: 2.00% (15.5918 => 15.9030, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.89% (1.8303 => 1.8649, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.22% (0.3179 => 0.3045, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.44% (0.9915 => 0.9871, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 0.25% (0.5982 => 0.5997, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -7.28% (0.1662 => 0.1541, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.66% (0.1565 => 0.1539, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3105 => 0.3107, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.2354 => 0.2412, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.40% (0.3144 => 0.3188, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.22% (0.2306 => 0.2301, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -0.88% (0.0453 => 0.0449, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -65.56% (0.0090 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.56% (0.0216 => 0.0204, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.59% (0.0189 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.90% (0.0385 => 0.0370, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.76% (0.0296 => 0.0276, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.57% (0.0280 => 0.0270, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0319 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -20.13% (0.0159 => 0.0127, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 1.22% (0.0245 => 0.0248, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -9.12% (0.0329 => 0.0299, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1434 => 0.1446, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: -0.31% (1.5257 => 1.5210, std.dev.: 0.0194) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.65% (0.1519 => 0.1494, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -66.67% (0.0003 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.34% (0.4236 => 0.4010, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1341 => 0.1389, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.09% (0.0558 => 0.0592, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.07% (0.0222 => 0.0173, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.47% (0.0645 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1475 => 1.1502, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.26% (0.0023 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.13% (0.0584 => 0.0519, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.96% (0.0209 => 0.0211, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7816 => 0.7819, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.03% (1.6110 => 1.6105, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.39% (4.1772 => 3.0331, std.dev.: 0.0535) SingleSource/Benchmarks/Shootout-C++/except: 82233.33% (0.0006 => 0.4940, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.07% (0.1414 => 0.1514, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.42% (0.5309 => 0.5650, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 5.54% (2.1763 => 2.2969, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.54% (0.6410 => 0.6765, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.50% (0.3582 => 0.3779, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.09% (0.2552 => 0.2682, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.6915 => 0.7224, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 4.26% (0.6173 => 0.6436, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3.91% (1.1653 => 1.2109, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 3.56% (15.3105 => 15.8551, std.dev.: 0.0531) MultiSource/Applications/lemon/lemon: 3.35% (1.0046 => 1.0383, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.92% (29.3170 => 30.1723, std.dev.: 0.3299) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.5150 => 1.5589, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.84% (0.7226 => 0.7359, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.69% (1.3935 => 1.4170, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.61% (1.1827 => 1.2018, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.56% (1.1672 => 1.1854, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.0766 => 0.0906, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.88% (0.0917 => 0.1081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 13.69% (0.3746 => 0.4259, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.67% (4.0101 => 4.5583, std.dev.: 0.0334) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6104, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.31% (0.2694 => 0.2918, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.62% (1.0063 => 1.0830, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 7.51% (1.0194 => 1.0960, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.2857 => 0.3045, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (27.1724 => 28.7989, std.dev.: 0.1264) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.24% (40.4792 => 42.5999, std.dev.: 0.3958) SingleSource/Benchmarks/Misc/fp-convert: 4.46% (15.2242 => 15.9030, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.87% (8.5113 => 8.8404, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5381, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.83% (0.5587 => 0.5745, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.67% (0.5876 => 0.6033, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: 2.62% (5.1938 => 5.3298, std.dev.: 0.0444) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (2.4455 => 2.4965, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.93% (2.8599 => 2.9152, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 1.59% (14.4877 => 14.7177, std.dev.: 0.0441) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (2.4971 => 2.5333, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: 1.39% (2.5166 => 2.5515, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -4.48% (0.7738 => 0.7391, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.44% (5.2665 => 4.1372, std.dev.: 0.0656) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.36% (1.1647 => 0.9392, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1565, std.dev.: 0.0307) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -9.44% (62.4126 => 56.5186, std.dev.: 0.1153) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.33% (3.2007 => 2.9342, std.dev.: 0.0579) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.21% (2.4457 => 2.2448, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.17% (3.6254 => 3.3654, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -6.95% (1.4441 => 1.3437, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -6.85% (3.4230 => 3.1885, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7919, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/fibo: -5.01% (4.6355 => 4.4031, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: -4.04% (1.4117 => 1.3547, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.60% (1.7361 => 1.6736, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.44% (3.7496 => 3.6207, std.dev.: 0.0474) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (9.2503 => 8.9354, std.dev.: 0.0534) MultiSource/Applications/lambda-0_1_3/lambda: -3.31% (7.6833 => 7.4293, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.17% (1.1683 => 1.1313, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.06% (1.2722 => 1.2333, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/misr: -2.86% (0.4296 => 0.4173, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -2.57% (3.4286 => 3.3405, std.dev.: 0.0112) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.52% (1.2959 => 1.2632, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.74% (2.8964 => 2.8459, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2314, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3055, std.dev.: 0.0472) MultiSource/Benchmarks/sim/sim: -1.37% (3.8907 => 3.8374, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: -1.26% (16.5617 => 16.3529, std.dev.: 0.0725) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.09% (0.9980 => 0.9871, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: -0.42% (0.6022 => 0.5997, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -7.50% (0.1666 => 0.1541, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.97% (0.1554 => 0.1539, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.78% (0.3083 => 0.3107, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.75% (0.2394 => 0.2412, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.41% (0.3175 => 0.3188, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2302 => 0.2301, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -65.56% (0.0090 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.00% (0.0240 => 0.0204, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.13% (0.0390 => 0.0370, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.31% (0.0301 => 0.0276, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.93% (0.0284 => 0.0270, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -32.80% (0.0189 => 0.0127, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -8.00% (0.0325 => 0.0299, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1429 => 0.1446, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: 1.27% (1.5019 => 1.5210, std.dev.: 0.0194) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.96% (0.4264 => 0.4010, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.35% (0.1344 => 0.1389, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0589 => 0.0592, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.43% (0.0232 => 0.0173, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0639 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.34% (1.1350 => 1.1502, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -18.52% (0.0637 => 0.0519, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.23% (0.0246 => 0.0211, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.69% (0.7541 => 0.7819, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.83% (1.5363 => 1.6105, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 12:29:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 14:29:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917192953.A52A4352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3927?compare_to=3924&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3927, Order: 164036, Start Time: 2012-09-17 18:16:47, End Time: 2012-09-17 19:31:15 To: 3924, Order: 164033, Start Time: 2012-09-17 16:33:48, End Time: 2012-09-17 17:48:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.77% (54.7434 => 55.7112, std.dev.: 0.3704) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.26% (2.0176 => 2.3860, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.21% (3.9660 => 4.3314, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.13% (0.7710 => 0.8414, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.97% (0.7038 => 0.7669, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 8.73% (1.3693 => 1.4889, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.55% (0.5265 => 0.5715, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.46% (0.6959 => 0.7548, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.40% (1.2193 => 1.3217, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.39% (0.9199 => 0.9971, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5818 => 0.6298, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.09% (0.4328 => 0.4678, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.99% (0.5748 => 0.6207, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.95% (1.4563 => 1.5721, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.87% (0.7061 => 0.7617, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.87% (1.1364 => 1.2258, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 7.82% (13.8202 => 14.9012, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.54% (0.3899 => 0.4193, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6283 => 0.6753, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.44% (0.5577 => 0.5992, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.39% (1.0313 => 1.1075, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.12% (0.4791 => 0.5132, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.96% (1.1061 => 1.1831, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.95% (7.2180 => 7.7193, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 6.91% (0.2995 => 0.3202, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2781 => 0.2973, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.5637 => 0.6026, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.89% (0.3485 => 0.3725, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 6.87% (3.8646 => 4.1300, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.82% (0.8310 => 0.8877, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.77% (0.2925 => 0.3123, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2243 => 0.2394, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.71% (0.7506 => 0.8010, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.71% (0.3756 => 0.4008, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3489 => 0.3723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.61% (3.6692 => 3.9118, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1865 => 0.1988, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.58% (0.7460 => 0.7951, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.43% (2.1791 => 2.3193, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.42% (0.4016 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (1.9828 => 2.1093, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.32% (0.3293 => 0.3501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.31% (0.3868 => 0.4112, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2690 => 0.2859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.14% (0.6744 => 0.7158, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (1.3813 => 1.4655, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.09% (16.6129 => 17.6238, std.dev.: 0.0262) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.02% (1.9270 => 2.0431, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.02% (3.1889 => 3.3809, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.01% (0.4390 => 0.4654, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.00% (1.3245 => 1.4040, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4639, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.86% (1.0594 => 1.1215, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.83% (0.3534 => 0.3740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.77% (0.4003 => 0.4234, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3578 => 0.3783, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.70% (0.6576 => 0.6951, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 5.68% (1.2749 => 1.3473, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.67% (0.3192 => 0.3373, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.62% (0.3789 => 0.4002, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.60% (14.8535 => 15.6855, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.2859 => 0.3019, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 5.60% (0.3646 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.58% (0.3601 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.56% (8.4961 => 8.9685, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/property: 5.56% (0.3940 => 0.4159, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4113 => 0.4341, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.53% (0.3650 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.51% (0.3663 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.41% (0.3623 => 0.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.40% (0.8698 => 0.9168, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.36% (4.4433 => 4.6815, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.32% (4.3801 => 4.6133, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6135 => 0.6460, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (13.2842 => 13.9609, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.91% (0.8818 => 0.9251, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (1.1333 => 1.1889, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (6.5754 => 6.8896, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 4.75% (14.5298 => 15.2201, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.56% (0.3245 => 0.3393, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.56% (4.6629 => 4.8753, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.43% (3.2742 => 3.4192, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.20% (4.9865 => 5.1960, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.07% (0.9108 => 0.9479, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.91% (1.5188 => 1.5782, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.2292 => 1.2772, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (0.4805 => 0.4991, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6250 => 0.6488, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.79% (3.7467 => 3.8886, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.60% (6.2785 => 6.5045, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.1007 => 2.1691, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.00% (33.2944 => 34.2931, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3511 => 0.3612, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5047, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (0.2093 => 0.2214, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0878, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6001, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9704, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.19% (1.4298 => 1.4468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5863, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.18% (0.4657 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.69% (22.5627 => 21.7297, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2733, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -5.22% (2.6470 => 2.5087, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7054, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9208, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5902, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.38% (26.5159 => 25.8855, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2365, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2328, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0599, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8729, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4307, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2379, std.dev.: 0.0328) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 12:47:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 14:47:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917194702.74A37352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3928?compare_to=3925&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3928, Order: 164036, Start Time: 2012-09-17 18:28:43, End Time: 2012-09-17 19:48:23 To: 3925, Order: 164033, Start Time: 2012-09-17 16:40:31, End Time: 2012-09-17 18:00:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (116 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (731 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.61% (56.5368 => 54.4943, std.dev.: 0.1095) SingleSource/Benchmarks/McGill/chomp: -1.28% (1.2152 => 1.1996, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.19% (0.5676 => 0.5665, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -0.01% (15.7805 => 15.7797, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: 0.11% (14.6050 => 14.6214, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -0.02% (82.3626 => 82.3461, std.dev.: 0.0240) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.2890 => 4.2931, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.2146 => 1.2152, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.3383 => 7.3377, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.08% (3.6417 => 3.6447, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.6319 => 0.6316, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.20% (63.2438 => 82.3461, std.dev.: 0.0240) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14257.64% (0.0720 => 10.3375, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 51.53% (10.3673 => 15.7098, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/richards_benchmark: 24.66% (0.1622 => 0.2022, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.78% (7.0540 => 7.9555, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.70% (2.2022 => 2.4819, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 12.22% (0.1432 => 0.1607, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2492, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.05% (1.7609 => 1.9378, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.14% (0.3543 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3473 => 0.3778, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.65% (0.1584 => 0.1721, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.59% (0.3516 => 0.3818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3694 => 0.4002, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3828 => 0.4143, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.3927 => 0.4246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.00% (0.3886 => 0.4197, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 7.71% (0.3282 => 0.3535, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.66% (10.4361 => 11.2356, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.70% (0.3177 => 0.3390, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.66% (9.4845 => 10.1163, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.4879 => 0.5191, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.26% (0.7433 => 0.7898, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 6.19% (0.2554 => 0.2712, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 5.98% (0.3109 => 0.3295, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.85% (0.2700 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.74% (0.4615 => 0.4880, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 5.67% (0.3423 => 0.3617, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 5.66% (0.7115 => 0.7518, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.64% (4.2646 => 4.5050, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.8172 => 0.8629, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.56% (0.3307 => 0.3491, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5860 => 0.6186, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.54% (0.6675 => 0.7045, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.48% (5.7591 => 6.0747, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.48% (0.7835 => 0.8264, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.3050 => 1.3763, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.46% (1.5415 => 1.6257, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.42% (8.1363 => 8.5774, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 5.38% (3.3354 => 3.5148, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.5105 => 0.5377, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.19% (0.5569 => 0.5858, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.8067 => 0.8484, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3121 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.04% (0.2758 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (5.0018 => 5.2535, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.9765 => 1.0255, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (4.9449 => 5.1915, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.88% (0.3441 => 0.3609, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 4.83% (1.1642 => 1.2204, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 4.82% (0.3092 => 0.3241, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 4.53% (3.8723 => 4.0477, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 4.52% (0.3387 => 0.3540, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.50% (1.0722 => 1.1204, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.49% (1.5603 => 1.6303, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.46% (0.2603 => 0.2719, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.44% (0.4299 => 0.4490, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.44% (0.5925 => 0.6188, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.43% (0.3180 => 0.3321, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2386, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 4.23% (0.6030 => 0.6285, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (7.9617 => 8.2931, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.16% (21.9371 => 22.8500, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3919, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.5020 => 0.5226, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 4.03% (2.0273 => 2.1091, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6456 => 0.6712, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 3.87% (0.8921 => 0.9266, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.86% (0.5981 => 0.6212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.4103 => 0.4258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.76% (0.4064 => 0.4217, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3422 => 0.3550, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.73% (0.4636 => 0.4809, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 3.70% (0.7326 => 0.7597, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.40% (0.3650 => 0.3774, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (1.5859 => 1.6397, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4289 => 0.4432, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.4186 => 1.4655, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.29% (0.3826 => 0.3952, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.04% (0.4048 => 0.4171, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8007, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (2.0665 => 2.1276, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (0.4620 => 0.4754, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.74% (2.2024 => 2.2628, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.1840 => 1.2149, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.8101 => 0.8261, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3043, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (4.2280 => 4.3538, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 2.65% (2.2771 => 2.3375, std.dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2360, std.dev.: 0.0138) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7894, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.64% (5.2763 => 3.2374, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.60% (5.3855 => 3.8450, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.27% (5.3526 => 3.8394, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0833, std.dev.: 0.0271) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.11% (2.9384 => 2.5825, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -8.85% (22.1758 => 20.2122, std.dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2808, std.dev.: 0.0668) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7166, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5072, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4141, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/chomp: -3.05% (1.2373 => 1.1996, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9843, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0063, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5769, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2339, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.34% (0.5229 => 0.5665, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 5.27% (14.9895 => 15.7797, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: 3.29% (14.1553 => 14.6214, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 4.44% (4.1105 => 4.2931, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.99% (1.1048 => 1.2152, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.51% (7.1582 => 7.3377, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.25% (3.4629 => 3.6447, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.51% (0.6222 => 0.6316, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 12:50:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 14:50:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917195049.2C535352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3929?compare_to=3926&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3929, Order: 164042, Start Time: 2012-09-17 18:41:33, End Time: 2012-09-17 19:52:11 To: 3926, Order: 164036, Start Time: 2012-09-17 17:13:38, End Time: 2012-09-17 18:24:58 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (45 on baseline) Performance Improvements: 2 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 17.10% (0.1409 => 0.1650, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5539 => 0.5695, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4114 => 0.4214, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 11.07% (3.0465 => 3.3838, std.dev.: 0.1287) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.73% (4.1372 => 4.2501, std.dev.: 0.0338) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.75% (59.9773 => 61.0291, std.dev.: 0.2377) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.71% (2.2448 => 2.2831, std.dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.30% (1.4170 => 1.3986, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.06% (1.8649 => 1.8451, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.53% (0.9871 => 0.9923, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: -0.92% (0.5997 => 0.5942, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.1541 => 0.1643, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.10% (0.1539 => 0.1556, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.90% (0.3107 => 0.3079, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.94% (0.2412 => 0.2341, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (0.3188 => 0.3175, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2301 => 0.2311, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -9.35% (0.0449 => 0.0407, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: -14.94% (0.0087 => 0.0074, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: 135.48% (0.0031 => 0.0073, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.86% (0.0204 => 0.0190, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.24% (0.0370 => 0.0382, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.09% (0.0276 => 0.0279, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.70% (0.0270 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0322 => 0.0320, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 49.61% (0.0127 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0248 => 0.0249, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -10.37% (0.0299 => 0.0268, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.11% (0.1446 => 0.1430, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.20% (1.5210 => 1.5028, std.dev.: 0.0279) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1494 => 0.1494, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.07% (0.4010 => 0.4053, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.36% (0.1389 => 0.1384, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.0592 => 0.0562, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.70% (0.0173 => 0.0214, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.15% (0.0648 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1502 => 1.1424, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.54% (0.0519 => 0.0527, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.64% (0.0211 => 0.0159, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.18% (0.7819 => 0.7805, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.02% (1.6105 => 1.6109, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.50% (0.0121 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.77% (4.1772 => 3.1007, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.5309 => 0.5642, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.07% (0.6410 => 0.6735, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 4.86% (2.1763 => 2.2821, std.dev.: 0.0338) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.23% (0.2552 => 0.2660, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 4.05% (0.6173 => 0.6423, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.69% (0.3582 => 0.3714, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 3.51% (1.0046 => 1.0399, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 3.30% (0.6915 => 0.7143, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 3.26% (1.1653 => 1.2033, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 2.93% (15.3105 => 15.7597, std.dev.: 0.1126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.7639 => 0.7833, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.15% (29.3170 => 29.9483, std.dev.: 0.1530) MultiSource/Applications/SPASS/SPASS: 1.05% (13.3238 => 13.4638, std.dev.: 0.0414) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2300, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.62% (0.0766 => 0.0901, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std.dev.: 0.0276) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3746 => 0.4285, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5496, std.dev.: 0.0171) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6255, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.78% (1.0063 => 1.0846, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.25% (0.2857 => 0.3064, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 6.98% (1.0194 => 1.0906, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.55% (40.4792 => 43.1316, std.dev.: 0.2074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (0.3301 => 0.3501, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (27.1724 => 28.7943, std.dev.: 0.0399) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.84% (4.2129 => 4.4588, std.dev.: 0.0657) SingleSource/Benchmarks/Misc/fp-convert: 4.18% (15.2242 => 15.8604, std.dev.: 0.0439) SingleSource/Benchmarks/Misc/ReedSolomon: 4.00% (8.5113 => 8.8515, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: 3.87% (0.9851 => 1.0232, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.43% (0.5876 => 0.6019, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.42% (2.6656 => 2.7301, std.dev.: 0.0133) MultiSource/Benchmarks/BitBench/five11/five11: 2.03% (5.1938 => 5.2990, std.dev.: 0.0399) MultiSource/Applications/hexxagon/hexxagon: 1.64% (14.4877 => 14.7257, std.dev.: 0.0354) MultiSource/Applications/siod/siod: 1.64% (3.5520 => 3.6102, std.dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (2.4971 => 2.5355, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4455 => 2.4793, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: 1.26% (2.5166 => 2.5484, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.12% (0.3497 => 0.2059, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -20.05% (1.7473 => 1.3969, std.dev.: 0.0322) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.53% (1.1647 => 0.9372, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.30% (5.2665 => 4.2501, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1613, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: -9.52% (0.1114 => 0.1008, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -9.49% (62.4126 => 56.4882, std.dev.: 0.0604) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.41% (3.2007 => 2.9316, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.20% (3.6254 => 3.3644, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: -6.94% (3.4230 => 3.1853, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.65% (2.4457 => 2.2831, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/richards_benchmark: -6.49% (1.4441 => 1.3504, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.27% (4.6355 => 4.3912, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: -4.07% (1.4117 => 1.3542, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.52% (1.7361 => 1.6750, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -3.34% (8.5323 => 8.2472, std.dev.: 0.0705) MultiSource/Applications/lambda-0_1_3/lambda: -3.22% (7.6833 => 7.4358, std.dev.: 0.0188) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.21% (1.2722 => 1.2313, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1333, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -2.93% (9.2503 => 8.9790, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std.dev.: 0.0125) MultiSource/Applications/aha/aha: -2.68% (3.4286 => 3.3367, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/misr: -2.68% (0.4296 => 0.4181, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.51% (3.7496 => 3.6554, std.dev.: 0.0220) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (9.3855 => 9.1666, std.dev.: 0.0658) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4190, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.92% (1.0686 => 1.0481, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -1.92% (3.8907 => 3.8161, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (92.7467 => 90.9740, std.dev.: 0.5141) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.54% (1.8739 => 1.8451, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7658, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3129, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: -1.18% (16.5617 => 16.3668, std.dev.: 0.0556) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.57% (0.9980 => 0.9923, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: -1.33% (0.6022 => 0.5942, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -1.38% (0.1666 => 0.1643, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.13% (0.1554 => 0.1556, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (0.3083 => 0.3079, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.21% (0.2394 => 0.2341, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3175 => 0.3175, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.39% (0.2302 => 0.2311, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -9.35% (0.0449 => 0.0407, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: -16.85% (0.0089 => 0.0074, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -18.89% (0.0090 => 0.0073, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.83% (0.0240 => 0.0190, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.31% (0.0301 => 0.0279, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -17.54% (0.0325 => 0.0268, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 0.06% (1.5019 => 1.5028, std.dev.: 0.0279) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.95% (0.4264 => 0.4053, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.98% (0.1344 => 0.1384, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.58% (0.0589 => 0.0562, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.76% (0.0232 => 0.0214, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0639 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.65% (1.1350 => 1.1424, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.27% (0.0637 => 0.0527, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.37% (0.0246 => 0.0159, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.50% (0.7541 => 0.7805, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.86% (1.5363 => 1.6109, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.00% (0.0070 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 13:56:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 15:56:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120917205633.0ECDF352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3930?compare_to=3923&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3930, Order: 164036, Start Time: 2012-09-17 18:14:14, End Time: 2012-09-17 20:57:55 To: 3923, Order: 164033, Start Time: 2012-09-17 15:02:05, End Time: 2012-09-17 17:45:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3465 => 0.3794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3488 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.46% (0.3446 => 0.3772, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.42% (0.3460 => 0.3786, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.41% (0.3442 => 0.3766, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3469 => 0.3793, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.23% (0.3650 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3643 => 0.3973, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.3724 => 0.4055, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.64% (1.5932 => 1.7149, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.09% (1.6211 => 1.7199, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 5.80% (0.5826 => 0.6164, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.73% (1.3152 => 1.3905, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 5.69% (0.5889 => 0.6224, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7640, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (0.4361 => 0.4606, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8786, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.36% (5.5417 => 5.8385, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.2866 => 0.3016, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.05% (0.4994 => 0.5246, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.02% (1.0781 => 1.1322, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.5000 => 0.5250, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (0.5026 => 0.5266, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.74% (0.4139 => 0.4335, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.3930 => 0.4116, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.64% (0.2566 => 0.2685, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (1.8794 => 1.9659, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.5900 => 0.6170, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (2.1653 => 2.2633, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 4.49% (0.7171 => 0.7493, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.46% (4.2109 => 4.3989, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (4.4195 => 4.6138, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.35% (0.9909 => 1.0340, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 4.34% (23.5202 => 24.5411, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.29% (0.3890 => 0.4057, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (0.3625 => 0.3778, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.21% (4.6177 => 4.8123, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.10% (0.3195 => 0.3326, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (2.1013 => 2.1869, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 4.04% (1.4269 => 1.4846, std.dev.: 0.0084) MultiSource/Applications/Burg/burg: 4.04% (0.5546 => 0.5770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.97% (2.0673 => 2.1494, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.2823 => 0.2934, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.93% (0.3336 => 0.3467, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2750 => 0.2857, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.82% (0.3060 => 0.3177, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (0.4658 => 0.4836, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.81% (0.3124 => 0.3243, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.77% (0.3477 => 0.3608, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.76% (0.3267 => 0.3390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.76% (0.4146 => 0.4302, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2803 => 0.2907, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.70% (0.2729 => 0.2830, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3348 => 0.3471, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (1.9694 => 2.0410, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.59% (0.7875 => 0.8158, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3726 => 0.3859, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4251 => 0.4401, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (1.9966 => 2.0667, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.6435 => 0.6659, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.3981 => 0.4117, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.38% (2.0346 => 2.1034, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3690 => 0.3814, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3282 => 0.3391, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.23% (0.9697 => 1.0010, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.5012 => 0.5173, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.3845 => 0.3967, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.03% (0.7426 => 0.7651, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (0.4847 => 0.4982, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (0.5361 => 0.5508, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (0.5584 => 0.5717, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.29% (11.6398 => 11.9069, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (4.6926 => 4.7920, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6741, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1661, std.dev.: 0.0471) SingleSource/Benchmarks/Dhrystone/dry: 4.33% (14.0481 => 14.6568, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1972, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5041, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4336, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2799, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4367, std.dev.: 0.0281) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5723, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9733, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7981, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -2.87% (17.2379 => 16.7431, std.dev.: 0.0722) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.22% (0.6293 => 0.6153, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5760, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9654, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 14:18:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 16:18:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917211808.B0312352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3931?compare_to=3929&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3931, Order: 164047, Start Time: 2012-09-17 20:08:57, End Time: 2012-09-17 21:19:32 To: 3929, Order: 164042, Start Time: 2012-09-17 18:41:33, End Time: 2012-09-17 19:52:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (47 on baseline) Performance Improvements: 1 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.92% (1.1450 => 1.1670, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (3.8237 => 3.8795, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 1.36% (15.7597 => 15.9742, std.dev.: 0.0564) MultiSource/Applications/lua/lua: 1.35% (3.6012 => 3.6499, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.47% (2.7301 => 2.7701, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.28% (1.4260 => 1.4443, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (3.1853 => 3.2209, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.29% (1.3986 => 1.3805, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.21% (0.9923 => 0.9902, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 1.13% (0.5942 => 0.6009, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: -1.77% (0.1643 => 0.1614, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1556 => 0.1555, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.99% (0.3079 => 0.2987, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.56% (0.2341 => 0.2354, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.94% (0.3175 => 0.3145, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.81% (0.2311 => 0.2246, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -0.74% (0.0407 => 0.0404, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: 18.92% (0.0074 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 19.18% (0.0073 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 25.26% (0.0190 => 0.0238, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0382 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.45% (0.0279 => 0.0297) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0280 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0320 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.14% (0.0176 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -31.05% (0.0190 => 0.0131, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 19.40% (0.0268 => 0.0320, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.10% (0.1430 => 0.1400, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: -0.86% (1.5028 => 1.4899, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.40% (0.1494 => 0.1488, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.39% (0.4053 => 0.4069, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.47% (0.1384 => 0.1432, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.07% (0.0562 => 0.0613, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.47% (0.0214 => 0.0213, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.55% (0.0649 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.62% (1.1424 => 1.1495, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0016 => 0.0010, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.51% (0.0527 => 0.0614, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.13% (0.0159 => 0.0191, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.7805 => 0.7809, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.14% (1.6109 => 1.6087, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 146.94% (0.0049 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.48% (4.1772 => 3.1129, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/except: 82366.67% (0.0006 => 0.4948, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.48% (0.0745 => 0.0905, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.28% (0.1414 => 0.1517, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 5.98% (2.1763 => 2.3065, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: 5.46% (0.5309 => 0.5599, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.05% (0.6410 => 0.6734, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: 4.52% (0.6173 => 0.6452, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 4.33% (15.3105 => 15.9742, std.dev.: 0.0564) MultiSource/Applications/SIBsim4/SIBsim4: 3.93% (1.1653 => 1.2111, std.dev.: 0.0108) MultiSource/Applications/lemon/lemon: 3.63% (1.0046 => 1.0411, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.90% (0.3582 => 0.3686, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.50% (0.6915 => 0.7088, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 2.28% (1.3268 => 1.3571, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.21% (1.5150 => 1.5485, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 2.18% (29.3170 => 29.9556, std.dev.: 0.1932) MultiSource/Applications/Burg/burg: 2.01% (1.1440 => 1.1670, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 1.62% (2.0972 => 2.1312, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 1.44% (3.5980 => 3.6499, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.41% (1.1672 => 1.1836, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std.dev.: 0.0523) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.0766 => 0.0904, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 16.30% (1.7426 => 2.0267, std.dev.: 0.0301) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3746 => 0.4275, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.42% (4.0101 => 4.5482, std.dev.: 0.1396) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.21% (0.0917 => 0.1029, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 12.07% (0.1433 => 0.1606, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.02% (1.0063 => 1.0971, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6182, std.dev.: 0.0267) SingleSource/Benchmarks/McGill/chomp: 7.25% (1.0194 => 1.0933, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.91% (0.3301 => 0.3529, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (27.1724 => 28.8188, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.57% (40.4792 => 42.7347, std.dev.: 0.4202) SingleSource/Benchmarks/Misc/fp-convert: 4.22% (15.2242 => 15.8674, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.92% (2.6656 => 2.7701, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: 3.73% (0.9851 => 1.0218, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.40% (0.5587 => 0.5777, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 3.30% (1.4184 => 1.4652, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 3.04% (8.5113 => 8.7700, std.dev.: 0.0486) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.62% (0.6308 => 0.6473, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.01% (3.5520 => 3.6235, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 1.76% (14.4877 => 14.7429, std.dev.: 0.0586) MultiSource/Benchmarks/Olden/bh/bh: 1.55% (2.5166 => 2.5555, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (2.4455 => 2.4825, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.06% (4.2815 => 4.2363, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.12% (0.3497 => 0.2094, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.41% (5.2665 => 4.1391, std.dev.: 0.0788) SingleSource/Benchmarks/Shootout-C++/ary3: -19.75% (1.7473 => 1.4022, std.dev.: 0.0444) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.35% (1.1647 => 0.9393, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1594, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -9.38% (62.4126 => 56.5579, std.dev.: 0.1236) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.51% (1.4034 => 1.2840, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.32% (3.2007 => 2.9345, std.dev.: 0.0409) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.21% (2.4457 => 2.2449, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.15% (3.6254 => 3.3663, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3513, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: -5.90% (3.4230 => 3.2209, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ffbench: -5.53% (1.4117 => 1.3337, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4073, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.06% (1.7361 => 1.6657, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -3.42% (7.6833 => 7.4205, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (9.2503 => 8.9415, std.dev.: 0.0188) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.12% (0.4140 => 0.4011, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.88% (3.7496 => 3.6417, std.dev.: 0.0247) MultiSource/Applications/aha/aha: -2.85% (3.4286 => 3.3309, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/misr: -2.63% (0.4296 => 0.4183, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.58% (9.5474 => 9.3012, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.26% (1.2722 => 1.2435, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -2.06% (3.4876 => 3.4158, std.dev.: 0.0260) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9872, std.dev.: 0.4636) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2244, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.56% (1.8739 => 1.8446, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3193, std.dev.: 0.0705) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7700, std.dev.: 0.0171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.78% (0.9980 => 0.9902, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -0.22% (0.6022 => 0.6009, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: -3.12% (0.1666 => 0.1614, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.11% (0.3083 => 0.2987, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.67% (0.2394 => 0.2354, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.94% (0.3175 => 0.3145, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.43% (0.2302 => 0.2246, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -10.02% (0.0449 => 0.0404, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -30.69% (0.0189 => 0.0131, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -1.54% (0.0325 => 0.0320, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.03% (0.1429 => 0.1400, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: -0.80% (1.5019 => 1.4899, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.87% (0.1501 => 0.1488, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.57% (0.4264 => 0.4069, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1344 => 0.1432, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.19% (0.0232 => 0.0213, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0639 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.1350 => 1.1495, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.61% (0.0637 => 0.0614, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.36% (0.0246 => 0.0191, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.55% (0.7541 => 0.7809, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.71% (1.5363 => 1.6087, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 14:35:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 16:35:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917213530.AB198352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3932?compare_to=3928&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3932, Order: 164047, Start Time: 2012-09-17 20:17:13, End Time: 2012-09-17 21:36:53 To: 3928, Order: 164036, Start Time: 2012-09-17 18:28:43, End Time: 2012-09-17 19:48:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (118 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.38% (15.7098 => 15.1794, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.47% (2.3375 => 2.3031, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.30% (0.5665 => 0.5682, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.23% (15.7797 => 15.8155, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: 0.13% (14.6214 => 14.6403, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 0.19% (82.3461 => 82.5051, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 0.25% (4.2931 => 4.3037, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.44% (1.2152 => 1.2206, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.35% (7.3377 => 7.3636, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.37% (3.6447 => 3.6583, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.17% (0.6316 => 0.6327, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (0.0649 => 0.0684) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.46% (63.2438 => 82.5051, std.dev.: 0.0133) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.83% (0.0720 => 10.3290, std.dev.: 0.0120) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.42% (10.3673 => 15.1794, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 25.96% (0.1622 => 0.2043, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.72% (2.2022 => 2.5043, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.37% (7.0540 => 7.9968, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2587, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.87% (1.7609 => 1.9523, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.56% (0.3282 => 0.3563, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.04% (0.3543 => 0.3828, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.81% (10.4361 => 11.2513, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 7.80% (0.3694 => 0.3982, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.78% (0.3828 => 0.4126, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.66% (0.3927 => 0.4228, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.46% (0.3886 => 0.4176, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.21% (0.4879 => 0.5231, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.15% (0.1440 => 0.1543, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.13% (9.4845 => 10.1611, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.08% (0.3177 => 0.3402, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3121 => 0.3338, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 6.63% (0.3109 => 0.3315, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.7433 => 0.7906, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.5105 => 0.5426, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.26% (0.8067 => 0.8572, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4615 => 0.4895, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.06% (0.7115 => 0.7546, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.00% (0.2700 => 0.2862, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.92% (0.6675 => 0.7070, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.3050 => 1.3819, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 5.87% (5.7591 => 6.0971, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.5415 => 1.6315, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.81% (0.8172 => 0.8647, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.81% (0.2271 => 0.2403, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (4.2646 => 4.5095, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.69% (0.5569 => 0.5886, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.68% (0.3307 => 0.3495, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5860 => 0.6192, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 5.64% (0.2554 => 0.2698, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.57% (3.3354 => 3.5213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (8.1363 => 8.5857, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.42% (0.2065 => 0.2177, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (5.0018 => 5.2729, std.dev.: 0.0356) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2107 => 0.2220, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.35% (0.5925 => 0.6242, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.26% (4.9449 => 5.2051, std.dev.: 0.0099) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.9765 => 1.0265, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.08% (0.3092 => 0.3249, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.05% (0.7835 => 0.8231, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.96% (1.1642 => 1.2220, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.73% (1.0722 => 1.1229, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.72% (0.4299 => 0.4502, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.63% (3.8723 => 4.0517, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (1.1861 => 1.2408, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.56% (0.5020 => 0.5249, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (7.9617 => 8.3226, std.dev.: 0.1097) SingleSource/UnitTests/ObjC++/property-reference: 4.44% (0.7326 => 0.7651, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 4.36% (21.9371 => 22.8938, std.dev.: 0.0188) MultiSource/Applications/hbd/hbd: 4.34% (1.5603 => 1.6280, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.22% (2.2969 => 2.3939, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8921 => 0.9294, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 4.15% (2.0273 => 2.1114, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6456 => 0.6716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.86% (0.5981 => 0.6212, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.5859 => 1.6470, std.dev.: 0.0159) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4636 => 0.4807, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (1.4186 => 1.4688, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.52% (0.4064 => 0.4207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.42% (0.3865 => 0.3997, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.39% (0.3422 => 0.3538, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.2024 => 2.2759, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8353, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4289 => 0.4422, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.1840 => 1.2206, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.02% (0.4203 => 0.4330, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0665 => 2.1231, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.72% (0.4048 => 0.4158, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.91% (0.8101 => 0.8256, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2842 => 1.3014, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.00% (3.8922 => 3.9312, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3823, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (4.2280 => 4.3531, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2324, std.dev.: 0.0255) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7894, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/fbench: 1.14% (2.2771 => 2.3031, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.10% (26.0924 => 26.3807, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.65% (5.2763 => 3.2368, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.99% (5.3855 => 3.8783, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.65% (5.3526 => 3.8726, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1114, std.dev.: 0.0330) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.81% (2.9384 => 2.5913, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -8.56% (22.1758 => 20.2770, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2598, std.dev.: 0.0448) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7162, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.99% (3.2827 => 3.1516, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5081, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4316, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.78% (1.3677 => 1.3297, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0056, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: -2.18% (1.2373 => 1.2103, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9915, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5788, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2367, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.66% (0.5229 => 0.5682, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.51% (14.9895 => 15.8155, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: 3.43% (14.1553 => 14.6403, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (4.1105 => 4.3037, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.48% (1.1048 => 1.2206, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.87% (7.1582 => 7.3636, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.64% (3.4629 => 3.6583, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.6222 => 0.6327, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 15:45:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 17:45:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120917224503.E91E3352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3933?compare_to=3931&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3933, Order: 164053, Start Time: 2012-09-17 21:35:24, End Time: 2012-09-17 22:46:27 To: 3931, Order: 164047, Start Time: 2012-09-17 20:08:57, End Time: 2012-09-17 21:19:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (46 on baseline) Performance Improvements: 3 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (806 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5536 => 0.5808, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.55% (0.7414 => 0.7677, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.94% (0.4492 => 0.4624, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.8803 => 0.9016, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (1.3805 => 1.4013, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (4.2841 => 4.3316, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 1.07% (2.1312 => 2.1539, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 2.49% (2.3403 => 2.3986, std.dev.: 0.0121) MultiSource/Benchmarks/llubenchmark/llu: 2.04% (2.0035 => 2.0443, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/ffbench: 1.91% (1.3337 => 1.3592, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.6742 => 4.7376, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.57% (16.4050 => 15.3269, std.dev.: 0.2476) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.67% (2.7701 => 2.7238, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/ary3: -1.42% (2.0267 => 1.9980, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.76% (0.9902 => 0.9827, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 0.30% (0.6009 => 0.6027, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -0.87% (0.1614 => 0.1600, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1555 => 0.1569, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.05% (0.2987 => 0.3078, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2354 => 0.2358, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.79% (0.3145 => 0.3120, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.62% (0.2246 => 0.2260, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 11.63% (0.0404 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -13.64% (0.0088 => 0.0076, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 1.15% (0.0087 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.07% (0.0238 => 0.0195, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0190 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0297 => 0.0299, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.88% (0.0320 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0178 => 0.0177, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 18.32% (0.0131 => 0.0155, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -7.82% (0.0243 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -9.69% (0.0320 => 0.0289, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.00% (0.1400 => 0.1428, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -4.67% (1.4899 => 1.4203, std.dev.: 0.0569) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.43% (0.1488 => 0.1539, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.39% (0.4069 => 0.4085, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.66% (0.1432 => 0.1351, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.46% (0.0613 => 0.0555, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.63% (0.0213 => 0.0201, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.83% (0.0600 => 0.0559, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1495 => 1.1483, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0010 => 0.0010, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.93% (0.0614 => 0.0596, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (0.0191 => 0.0203, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7809 => 0.7797, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.06% (1.6087 => 1.6096, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.27% (0.0121 => 0.0088, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.07% (4.1772 => 3.0463, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -25.00% (0.0004 => 0.0003, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.5309 => 0.5634, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 5.48% (2.1763 => 2.2956, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.87% (0.6410 => 0.6722, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 4.84% (0.6173 => 0.6472, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 4.68% (1.1653 => 1.2198, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.2552 => 0.2666, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 3.93% (1.0046 => 1.0441, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 2.70% (2.0972 => 2.1539, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 2.37% (1.3268 => 1.3583, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.85% (3.0225 => 3.0785, std.dev.: 0.0207) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.71% (1.1672 => 1.1872, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6069 => 0.6170, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.47% (1.1827 => 1.2001, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 1.44% (13.3238 => 13.5150, std.dev.: 0.0379) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 13.99% (0.3746 => 0.4270, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.72% (4.0101 => 4.5603, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6038, std.dev.: 0.1228) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.87% (1.0063 => 1.0855, std.dev.: 0.0166) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7931, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 4.49% (15.2242 => 15.9082, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5367, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8716, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.05% (0.5876 => 0.6055, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 2.98% (5.1938 => 5.3488, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 2.80% (1.4184 => 1.4581, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.71% (4.6127 => 4.7376, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7149, std.dev.: 0.0697) SingleSource/Benchmarks/Misc/whetstone: 2.27% (2.3453 => 2.3986, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.18% (2.6656 => 2.7238, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 1.63% (14.4877 => 14.7232, std.dev.: 0.0169) MultiSource/Applications/siod/siod: 1.60% (3.5520 => 3.6088, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (2.4455 => 2.4827, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5303, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.5166 => 2.5450, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.35% (0.4253 => 0.4153, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.52% (0.3497 => 0.2080, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.14% (5.2665 => 4.1003, std.dev.: 0.0612) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.44% (1.1647 => 0.9383, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.1363) SingleSource/Benchmarks/Shootout-C++/moments: -10.86% (0.1114 => 0.0993, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5360, std.dev.: 0.0904) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.88% (3.2007 => 2.9485, std.dev.: 0.0434) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.30% (2.4457 => 2.2671, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3658, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: -7.00% (3.4230 => 3.1834, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3515, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: -4.54% (0.4296 => 0.4101, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.34% (1.7361 => 1.6607, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: -3.72% (1.4117 => 1.3592, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.50% (0.4140 => 0.3995, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (9.2503 => 8.9266, std.dev.: 0.0288) MultiSource/Applications/lambda-0_1_3/lambda: -3.34% (7.6833 => 7.4266, std.dev.: 0.0424) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.21% (1.1683 => 1.1308, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8284, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -2.74% (3.4286 => 3.3346, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.58% (1.2722 => 1.2394, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.44% (3.7496 => 3.6582, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -2.13% (8.5323 => 8.3503, std.dev.: 0.0581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.00% (61.1734 => 59.9514, std.dev.: 0.2618) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.94% (2.8964 => 2.8402, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.91% (1.0686 => 1.0482, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4226, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: -1.82% (92.7467 => 91.0577, std.dev.: 0.4804) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2238, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: -1.71% (3.8907 => 3.8242, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3107, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.53% (0.9980 => 0.9827, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 0.08% (0.6022 => 0.6027, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -3.96% (0.1666 => 0.1600, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1554 => 0.1569, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (0.3083 => 0.3078, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.50% (0.2394 => 0.2358, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.73% (0.3175 => 0.3120, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.82% (0.2302 => 0.2260, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -14.61% (0.0089 => 0.0076, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.75% (0.0240 => 0.0195, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.09% (0.0324 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -17.99% (0.0189 => 0.0155, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -10.04% (0.0249 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -11.08% (0.0325 => 0.0289, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.43% (1.5019 => 1.4203, std.dev.: 0.0569) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1501 => 0.1539, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.20% (0.4264 => 0.4085, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.52% (0.1344 => 0.1351, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.0589 => 0.0555, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.52% (0.0639 => 0.0559, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.17% (1.1350 => 1.1483, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.44% (0.0637 => 0.0596, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (0.0246 => 0.0203, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.39% (0.7541 => 0.7797, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.77% (1.5363 => 1.6096, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.71% (0.0070 => 0.0088, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 16:00:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 18:00:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120917230049.738A43524013@llvm.org> http://llvm.org/perf/db_default/v4/nts/3934?compare_to=3927&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3934, Order: 164053, Start Time: 2012-09-17 21:47:45, End Time: 2012-09-17 23:02:11 To: 3927, Order: 164036, Start Time: 2012-09-17 18:16:47, End Time: 2012-09-17 19:31:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.08% (55.7112 => 56.3132, std.dev.: 0.1290) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.99% (2.0176 => 2.4008, std.dev.: 0.0154) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.26% (0.1588 => 0.1735, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3325, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 9.09% (0.7038 => 0.7678, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.07% (1.3693 => 1.4935, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5818 => 0.6340, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.90% (0.2596 => 0.2827, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.81% (0.7710 => 0.8389, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5748 => 0.6251, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.68% (0.7061 => 0.7674, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.62% (0.9199 => 0.9992, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.60% (1.2193 => 1.3241, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.58% (0.5265 => 0.5717, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.54% (0.6959 => 0.7553, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.45% (0.2721 => 0.2951, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.32% (0.4328 => 0.4688, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.02% (1.1364 => 1.2275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.90% (1.4563 => 1.5714, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.87% (13.8202 => 14.9074, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6283 => 0.6765, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.64% (0.3899 => 0.4197, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.5577 => 0.6001, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.50% (1.0313 => 1.1086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.18% (0.3580 => 0.3837, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3022 => 0.3238, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.08% (1.1061 => 1.1844, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.98% (0.8310 => 0.8890, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.97% (3.8646 => 4.1338, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.9828 => 2.1185, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.76% (7.2180 => 7.7056, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.68% (0.3293 => 0.3513, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.65% (0.7506 => 0.8005, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.63% (3.6692 => 3.9125, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2726 => 0.2905, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.56% (2.1791 => 2.3221, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3220 => 0.3429, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.48% (0.2761 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.41% (0.3868 => 0.4116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.24% (0.4390 => 0.4664, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.20% (0.6744 => 0.7162, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.15% (16.6129 => 17.6340, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.14% (1.3245 => 1.4058, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.08% (3.1889 => 3.3829, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 6.08% (1.9270 => 2.0441, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6576 => 0.6972, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.01% (1.0594 => 1.1231, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 5.85% (1.2749 => 1.3495, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 5.73% (14.8535 => 15.7040, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: 5.72% (0.4003 => 0.4232, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.70% (0.6135 => 0.6485, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.67% (8.4961 => 8.9779, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.66% (0.8818 => 0.9317, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.65% (0.3914 => 0.4135, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.65% (0.3578 => 0.3780, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.57% (0.3646 => 0.3849, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.56% (0.8698 => 0.9182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.53% (0.3940 => 0.4158, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (4.4433 => 4.6869, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.45% (0.3650 => 0.3849) SingleSource/UnitTests/ObjC/exceptions-2: 5.44% (0.3601 => 0.3797, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.44% (4.3801 => 4.6184, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.3813 => 1.4564, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 5.41% (0.3623 => 0.3819, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.40% (1.3819 => 1.4565, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.22% (13.2842 => 13.9774, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.10% (1.1333 => 1.1911, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.89% (14.5298 => 15.2405, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (3.2742 => 3.4336, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (6.5754 => 6.8898, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.56% (0.3245 => 0.3393, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.46% (4.6629 => 4.8707, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2292 => 1.2817, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.23% (0.9108 => 0.9493, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.9865 => 5.1918, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.07% (1.5188 => 1.5806, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.00% (0.4805 => 0.4997, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 3.81% (3.7467 => 3.8894, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6250 => 0.6485, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (6.2785 => 6.5051, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.41% (2.1007 => 2.1724, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 2.82% (33.2944 => 34.2346, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5339, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6970, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5467, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0926, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4271 => 7.6103, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5921, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4453, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.26% (0.4657 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.86% (22.5627 => 21.6923, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2724, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.27% (1.3780 => 1.2916, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.7688 => 1.7053, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.34% (3.0263 => 2.9252, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.8259 => 8.5637, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.27% (26.5159 => 25.9135, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2293, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0600, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4307, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2345, std.dev.: 0.0216) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 16:24:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 18:24:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120917232404.E7F70352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3935?compare_to=3932&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3935, Order: 164053, Start Time: 2012-09-17 22:05:34, End Time: 2012-09-17 23:25:28 To: 3932, Order: 164047, Start Time: 2012-09-17 20:17:13, End Time: 2012-09-17 21:36:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (117 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (730 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.85% (54.4441 => 56.5416, std.dev.: 0.0770) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.51% (78.5518 => 80.5220, std.dev.: 0.7444) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7907 => 3.8667, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5682 => 0.5683, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 0.03% (15.8155 => 15.8206, std.dev.: 0.0239) MultiSource/Applications/kimwitu++/kc: 0.01% (14.6403 => 14.6415, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: -0.04% (82.5051 => 82.4694, std.dev.: 0.0283) MultiSource/Benchmarks/MallocBench/gs/gs: 0.23% (4.3037 => 4.3136, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2206 => 1.2221, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (7.3636 => 7.3654, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.04% (3.6583 => 3.6569, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.16% (0.6327 => 0.6317, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1429 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.05% (0.0684 => 0.0670, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.40% (63.2438 => 82.4694, std.dev.: 0.0283) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14242.64% (0.0720 => 10.3267, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.48% (10.3673 => 15.1861, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 25.89% (0.1622 => 0.2042, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.77% (2.2022 => 2.5054, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.36% (7.0540 => 7.9965, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 12.57% (0.1432 => 0.1612, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2586, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.01% (1.7609 => 1.9547, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.21% (0.3473 => 0.3758, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.04% (0.3543 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.04% (0.3497 => 0.3778, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/synchronized: 7.95% (0.3561 => 0.3844, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.85% (10.4361 => 11.2552, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions: 7.76% (0.3828 => 0.4125, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.74% (0.3694 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.3927 => 0.4230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.51% (0.3886 => 0.4178, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.15% (0.4879 => 0.5228, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 7.09% (9.4845 => 10.1572, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (0.7433 => 0.7909, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.09% (0.7115 => 0.7548, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2700 => 0.2864, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4615 => 0.4895, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.01% (1.3050 => 1.3834, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.6675 => 0.7073, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.92% (5.7591 => 6.0999, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.88% (0.5105 => 0.5405, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.81% (0.3423 => 0.3622, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (4.2646 => 4.5100, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.73% (0.5860 => 0.6196, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.72% (0.2554 => 0.2700, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (1.5415 => 1.6274, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.55% (3.3354 => 3.5205, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (8.1363 => 8.5864, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.40% (0.5569 => 0.5870, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.37% (0.5925 => 0.6243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.8172 => 0.8608, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (5.0018 => 5.2659, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.3121 => 0.3285, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.9449 => 5.2042, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.19% (0.8067 => 0.8486, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9765 => 1.0272, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 5.14% (0.3387 => 0.3561, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 5.13% (0.7835 => 0.8237, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 5.05% (0.3092 => 0.3248, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.94% (1.1642 => 1.2217, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1249, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3441 => 0.3602, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.68% (0.4299 => 0.4500, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.65% (3.8723 => 4.0523, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.65% (1.1861 => 1.2412, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.60% (0.5020 => 0.5251, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.48% (7.9617 => 8.3182, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference: 4.45% (0.7326 => 0.7652, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 4.44% (21.9371 => 22.9109, std.dev.: 0.0118) MultiSource/Applications/hbd/hbd: 4.36% (1.5603 => 1.6284, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.31% (0.6450 => 0.6728, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 4.22% (2.2969 => 2.3939, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.19% (2.0273 => 2.1123, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8921 => 0.9295, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.97% (1.5859 => 1.6489, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.5981 => 0.6215, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.6456 => 0.6706, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.84% (0.4636 => 0.4814, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.55% (1.4186 => 1.4689, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.51% (0.3422 => 0.3542, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (0.4064 => 0.4205, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.42% (2.2024 => 2.2777, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (14.3668 => 14.8309, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.4203 => 0.4332, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4289 => 0.4420, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1840 => 1.2197, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.98% (0.3826 => 0.3940, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (0.4620 => 0.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0665 => 2.1196, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.8101 => 0.8255, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.8922 => 3.9358, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7513, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (4.2280 => 4.3526, std.dev.: 0.0069) MultiSource/Benchmarks/llubenchmark/llu: 2.35% (3.7781 => 3.8667, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: 2.12% (0.5413 => 0.5528, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2194, std.dev.: 0.0315) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.69% (5.2763 => 3.2349, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.00% (5.3855 => 3.8775, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.62% (5.3526 => 3.8740, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1356, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.85% (2.9384 => 2.5901, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -8.53% (22.1758 => 20.2853, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2954, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5084, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4230, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9852, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/chomp: -2.68% (1.2373 => 1.2041, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0087, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6783, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5791, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (1.7254 => 1.7047, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2339, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.68% (0.5229 => 0.5683, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 5.54% (14.9895 => 15.8206, std.dev.: 0.0239) MultiSource/Applications/kimwitu++/kc: 3.43% (14.1553 => 14.6415, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 4.94% (4.1105 => 4.3136, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.62% (1.1048 => 1.2221, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (7.1582 => 7.3654, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.60% (3.4629 => 3.6569, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.6222 => 0.6317, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 17:08:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 19:08:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918000845.D8B55352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3936?compare_to=3930&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3936, Order: 164051, Start Time: 2012-09-17 21:26:19, End Time: 2012-09-18 00:10:02 To: 3930, Order: 164036, Start Time: 2012-09-17 18:14:14, End Time: 2012-09-17 20:57:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.51% (0.2090 => 0.2226, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3446 => 0.3796, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.09% (0.3488 => 0.3840, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3442 => 0.3789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3496 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3469 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.03% (0.3460 => 0.3807, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.01% (0.3465 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.73% (0.3650 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3643 => 0.3996, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 9.53% (0.3724 => 0.4079, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 6.97% (1.5932 => 1.7042, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (1.6211 => 1.7232, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (0.4361 => 0.4634, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5826 => 0.6183, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.09% (2.7292 => 2.8955, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 6.08% (0.5889 => 0.6247, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.80% (1.3152 => 1.3915, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.79% (3.5627 => 3.7689, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 5.78% (5.5417 => 5.8618, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2738 => 0.2893, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.46% (0.5000 => 0.5273, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.3004 => 0.3165, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (0.4994 => 0.5260, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.29% (0.2875 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.21% (0.3625 => 0.3814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.19% (0.2813 => 0.2959, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (0.3930 => 0.4132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.05% (0.2911 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3060 => 0.3214, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.01% (1.0781 => 1.1321, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (2.0673 => 2.1706, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.99% (0.2725 => 0.2861, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 4.98% (0.2750 => 0.2887, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.94% (0.9909 => 1.0399, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 4.94% (0.2811 => 0.2950, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.94% (0.2714 => 0.2848, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.2803 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.84% (0.2729 => 0.2861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.84% (0.3267 => 0.3425, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3124 => 0.3275, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.82% (0.7171 => 0.7517, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.81% (23.5202 => 24.6510, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary: 4.79% (0.3258 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.78% (0.4139 => 0.4337, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.2866 => 0.3003, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.70% (0.3726 => 0.3901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.66% (0.3348 => 0.3504, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4146 => 0.4339, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.63% (4.2109 => 4.4059, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3317 => 0.3470, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (0.5026 => 0.5257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.57% (0.3477 => 0.3636, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (2.1013 => 2.1968, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 4.54% (0.3678 => 0.3845, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (1.8794 => 1.9644, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 4.52% (0.4251 => 0.4443, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.51% (0.6634 => 0.6933, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (0.3890 => 0.4064, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.47% (0.4029 => 0.4209, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.3903 => 0.4077, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.38% (0.6435 => 0.6717, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.37% (1.4269 => 1.4893, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.5900 => 0.6158, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.36% (0.4658 => 0.4861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3282 => 0.3424, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.24% (4.6177 => 4.8135, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (4.4195 => 4.6057, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.21% (0.9697 => 1.0105, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.18% (0.3084 => 0.3213, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.14% (0.3981 => 0.4146, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.14% (0.3336 => 0.3474, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 4.12% (2.1653 => 2.2545, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (1.9966 => 2.0763, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.5012 => 0.5211, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.3845 => 0.3997, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (1.9694 => 2.0446, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.80% (0.2737 => 0.2841, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.53% (0.7875 => 0.8153, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (0.7426 => 0.7685, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.21% (2.0346 => 2.1000, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.12% (0.5361 => 0.5528, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.97% (0.4847 => 0.4991, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.69% (11.6398 => 11.9532, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (0.5584 => 0.5732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (4.6926 => 4.8158, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1690, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2052, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5064, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4377, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.11% (50.0626 => 50.6181, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5657, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8071, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7998, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.66% (17.2379 => 16.7790, std.dev.: 0.0632) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9590, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 18:12:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 20:12:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918011215.4CE99352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3937?compare_to=3935&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3937, Order: 164078, Start Time: 2012-09-17 23:53:58, End Time: 2012-09-18 01:13:37 To: 3935, Order: 164053, Start Time: 2012-09-17 22:05:34, End Time: 2012-09-17 23:25:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (129 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (719 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.07% (15.1861 => 14.5682, std.dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.30% (0.5683 => 0.5700, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: -0.01% (15.8206 => 15.8192, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 0.31% (14.6415 => 14.6864, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: -0.16% (82.4694 => 82.3349, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: -0.31% (4.3136 => 4.3002, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.12% (1.2221 => 1.2206, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (7.3654 => 7.3787, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.02% (3.6569 => 3.6576, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.62% (0.6317 => 0.6356, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1429 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0670 => 0.0648, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.19% (63.2438 => 82.3349, std.dev.: 0.0076) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14248.75% (0.0720 => 10.3311, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.52% (10.3673 => 14.5682, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/richards_benchmark: 24.72% (0.1622 => 0.2023, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.28% (2.2022 => 2.4947, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.98% (7.0540 => 7.9696, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.44% (1.7609 => 1.9448, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.68% (0.3282 => 0.3567, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.18% (0.1625 => 0.1758, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.06% (0.3497 => 0.3779, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.04% (0.3543 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.02% (0.3516 => 0.3798, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3561 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.3927 => 0.4230, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.71% (0.3828 => 0.4123, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.68% (10.4361 => 11.2376, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.49% (0.3886 => 0.4177, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.22% (9.4845 => 10.1693, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.86% (0.3177 => 0.3395, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7433 => 0.7939, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.48% (0.4879 => 0.5195, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.30% (0.7115 => 0.7563, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (0.4615 => 0.4900, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.14% (0.3109 => 0.3300, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.03% (0.8172 => 0.8665, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.00% (0.2700 => 0.2862, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.98% (0.6675 => 0.7074, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.95% (0.7835 => 0.8301, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 5.93% (5.7591 => 6.1007, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 5.90% (0.3423 => 0.3625, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.90% (0.2271 => 0.2405, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.80% (1.3050 => 1.3807, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.76% (4.2646 => 4.5103, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.75% (1.5415 => 1.6302, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.75% (3.3354 => 3.5272, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5860 => 0.6192, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (8.1363 => 8.5872, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.44% (0.2758 => 0.2908, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2107 => 0.2220, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.33% (0.5569 => 0.5866, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 5.32% (0.5925 => 0.6240, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.28% (0.8067 => 0.8493, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.9449 => 5.2042, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.24% (0.4103 => 0.4318, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (5.0018 => 5.2611, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.16% (0.3121 => 0.3282, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 5.14% (1.5603 => 1.6405, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.10% (0.9765 => 1.0263, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 5.08% (0.3092 => 0.3249, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.05% (1.1642 => 1.2230, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.78% (1.0722 => 1.1234, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.3180 => 0.3330, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.70% (0.4299 => 0.4501, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.68% (3.8723 => 4.0535, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (7.9617 => 8.3312, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.60% (1.1861 => 1.2407, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 4.57% (0.7326 => 0.7661, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.46% (0.3136 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.43% (0.6456 => 0.6742, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.34% (0.3826 => 0.3992, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.4636 => 0.4834, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (0.6450 => 0.6725, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3162 => 0.3296, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.23% (2.0273 => 2.1130, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 4.14% (2.2969 => 2.3919, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.09% (0.8921 => 0.9286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3650 => 0.3799, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.97% (21.9371 => 22.8085, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.92% (1.5859 => 1.6481, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5981 => 0.6214, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4203 => 0.4361, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3603 => 0.3737, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.68% (0.4048 => 0.4197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.3098 => 0.3209, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (1.4186 => 1.4686, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0665 => 2.1390, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.3052 => 0.3158, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.41% (2.2024 => 2.2775, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (14.3668 => 14.8300, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.1840 => 1.2194, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3102, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.8101 => 0.8264, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.82% (1.1145 => 1.3688, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (1.1396 => 1.2162, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2391, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7895, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5833, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3722, std.dev.: 0.0225) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2303, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.66% (5.3855 => 3.8420, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.22% (5.3526 => 3.8421, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1289, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.32% (2.9384 => 2.5764, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -8.75% (22.1758 => 20.2356, std.dev.: 0.0348) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2614, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4978, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4283, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.80% (10.2830 => 9.9948, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -2.52% (1.2373 => 1.2061, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.23% (8.1563 => 7.9748, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5759, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.01% (0.5229 => 0.5700, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 5.54% (14.9895 => 15.8192, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 3.75% (14.1553 => 14.6864, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 4.62% (4.1105 => 4.3002, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.48% (1.1048 => 1.2206, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.08% (7.1582 => 7.3787, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.62% (3.4629 => 3.6576, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.15% (0.6222 => 0.6356, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 18:56:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 20:56:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918015645.DEAB4352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3938?compare_to=3933&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3938, Order: 164080, Start Time: 2012-09-18 00:46:02, End Time: 2012-09-18 01:58:10 To: 3933, Order: 164053, Start Time: 2012-09-17 21:35:24, End Time: 2012-09-17 22:46:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 16 (56 on baseline) Performance Improvements: 2 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 883 (799 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 3.28% (0.3231 => 0.3337, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7069 => 0.7251, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 2.57% (1.0441 => 1.0709, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.87% (0.7541 => 0.7682, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.23% (1.2152 => 1.2301, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.3039 => 6.3723, std.dev.: 0.0219) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8210 => 14.9798, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (4.2324 => 4.2773, std.dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.6984 => 14.8481, std.dev.: 0.0327) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 18.22% (20.6778 => 24.4461, std.dev.: 0.5331) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.26% (3.0208 => 3.4515, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout/heapsort: 7.33% (3.0730 => 3.2984, std.dev.: 0.0811) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.84% (2.4106 => 2.4550, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.51% (4.0642 => 4.1256, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (3.1834 => 3.2308, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: 1.43% (8.7149 => 8.8393, std.dev.: 0.0366) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.88% (1.3583 => 1.3328, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6299 => 1.6117, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.62% (0.9827 => 0.9986, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 0.18% (0.6027 => 0.6038, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 4.88% (0.1600 => 0.1678, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.08% (0.1569 => 0.1552, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.50% (0.3078 => 0.3001, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.88% (0.2358 => 0.2290, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (0.3120 => 0.3159, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.58% (0.2260 => 0.2273, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel: - (0.0451 => 0.0451, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 15.79% (0.0076 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -38.64% (0.0088 => 0.0054, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.90% (0.0195 => 0.0164, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.37% (0.0191 => 0.0133, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0385 => 0.0383) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.67% (0.0299 => 0.0297, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.07% (0.0281 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.27% (0.0314 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.94% (0.0155 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 9.82% (0.0224 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 10.73% (0.0289 => 0.0320, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1428 => 0.1431, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -3.86% (1.4203 => 1.3655, std.dev.: 0.0718) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.94% (0.1539 => 0.1463, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.26% (0.4085 => 0.4259, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.74% (0.1351 => 0.1442, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 500.00% (0.0001 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.67% (0.0555 => 0.0592, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.37% (0.0201 => 0.0254, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.85% (0.0559 => 0.0642, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1483 => 1.1541, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.00% (0.0010 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.90% (0.0596 => 0.0537, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0203 => 0.0134, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7797 => 0.7829, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.12% (1.6096 => 1.6077, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -50.00% (0.0004 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.50% (0.0088 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.72% (4.1772 => 3.0609, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/except: 83016.67% (0.0006 => 0.4987, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.89% (0.5309 => 0.5675, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 6.60% (1.0046 => 1.0709, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 6.33% (2.1763 => 2.3140, std.dev.: 0.0311) MultiSource/Applications/SIBsim4/SIBsim4: 5.53% (1.1653 => 1.2297, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.13% (0.6410 => 0.6739, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.6915 => 0.7251, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.64% (15.3105 => 16.0213, std.dev.: 0.1673) MultiSource/Applications/minisat/minisat: 4.34% (0.6173 => 0.6441, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.2552 => 0.2657, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3217 => 0.3337, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.5150 => 1.5645, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 3.17% (29.3170 => 30.2466, std.dev.: 0.1299) MultiSource/Applications/siod/siod: 3.01% (2.0972 => 2.1604, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.7639 => 0.7848, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.33% (1.2021 => 1.2301, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 2.32% (13.3238 => 13.6327, std.dev.: 0.0543) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6069 => 0.6206, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 2.02% (3.0225 => 3.0835, std.dev.: 0.0233) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (6.2546 => 6.3723, std.dev.: 0.0219) MultiSource/Applications/JM/lencod/lencod: 1.73% (14.7256 => 14.9798, std.dev.: 0.0224) MultiSource/Applications/ClamAV/clamscan: 1.64% (14.6079 => 14.8481, std.dev.: 0.0327) MultiSource/Applications/lua/lua: 1.49% (3.5980 => 3.6515, std.dev.: 0.0162) MultiSource/Applications/treecc/treecc: 1.39% (1.8798 => 1.9059, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.4908 => 6.5644, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2299, std.dev.: 0.0215) MultiSource/Benchmarks/nbench/nbench: 15.46% (21.1721 => 24.4461, std.dev.: 0.5331) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0035, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.08% (3.0256 => 3.4515, std.dev.: 0.0381) MultiSource/Applications/sgefa/sgefa: 13.91% (0.3746 => 0.4267, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.73% (4.0101 => 4.5606, std.dev.: 0.0068) SingleSource/Benchmarks/Stanford/Puzzle: 11.24% (0.1433 => 0.1594, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 9.01% (7.0025 => 7.6331, std.dev.: 0.0389) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.53% (1.0063 => 1.0921, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.88% (0.2857 => 0.3082, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 7.74% (1.0194 => 1.0983, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.66% (0.3301 => 0.3554, std.dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.13% (27.1724 => 28.8368, std.dev.: 0.0930) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.36% (4.2129 => 4.3967, std.dev.: 0.0536) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.25% (40.4792 => 42.1995, std.dev.: 0.3378) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8491, std.dev.: 0.0465) SingleSource/Benchmarks/Misc/dt: 3.96% (0.9851 => 1.0241, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8393, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.84% (0.5876 => 0.6043, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/five11/five11: 2.38% (5.1938 => 5.3175, std.dev.: 0.0435) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.11% (2.4042 => 2.4550, std.dev.: 0.0165) MultiSource/Applications/siod/siod: 1.75% (3.5520 => 3.6141, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.60% (14.4877 => 14.7200, std.dev.: 0.0335) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.47% (4.0659 => 4.1256, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (2.4971 => 2.5306, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.55% (5.2665 => 4.1316, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/ary3: -19.68% (1.7473 => 1.4034, std.dev.: 0.0262) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.16% (1.1647 => 0.9416, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: -12.05% (8.1594 => 7.1765, std.dev.: 0.0689) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -9.33% (62.4126 => 56.5905, std.dev.: 0.0684) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.21% (2.4457 => 2.2450, std.dev.: 0.0324) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2007 => 2.9417, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.15% (3.6254 => 3.3662, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3509, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -5.61% (3.4230 => 3.2308, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/fibo: -4.82% (4.6355 => 4.4119, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.66% (1.2722 => 1.2256, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.61% (1.7361 => 1.6735, std.dev.: 0.0211) MultiSource/Applications/lambda-0_1_3/lambda: -3.16% (7.6833 => 7.4402, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/methcall: -2.99% (9.2503 => 8.9739, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/misr: -2.93% (0.4296 => 0.4170, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.85% (1.1683 => 1.1350, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -2.61% (9.5474 => 9.2986, std.dev.: 0.0100) MultiSource/Applications/aha/aha: -2.58% (3.4286 => 3.3400, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.10% (3.7496 => 3.6707, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4172, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.96% (2.8964 => 2.8396, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.73% (1.0686 => 1.0501, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -1.67% (92.7467 => 91.1963, std.dev.: 0.5120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2343, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0926 => 1.0763, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7656, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3090, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: -1.16% (16.5617 => 16.3688, std.dev.: 0.0637) MultiSource/Benchmarks/NPB-serial/is/is: -1.01% (13.4743 => 13.3385, std.dev.: 0.0178) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.06% (0.9980 => 0.9986, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.6022 => 0.6038, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 0.72% (0.1666 => 0.1678, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.13% (0.1554 => 0.1552, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.66% (0.3083 => 0.3001, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.34% (0.2394 => 0.2290, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.50% (0.3175 => 0.3159, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (0.2302 => 0.2273, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -40.00% (0.0090 => 0.0054, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.67% (0.0240 => 0.0164, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.73% (0.0192 => 0.0133, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -1.54% (0.0325 => 0.0320, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -9.08% (1.5019 => 1.3655, std.dev.: 0.0718) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.53% (0.1501 => 0.1463, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4264 => 0.4259, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.29% (0.1344 => 0.1442, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0589 => 0.0592, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.48% (0.0232 => 0.0254, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.47% (0.0639 => 0.0642, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.68% (1.1350 => 1.1541, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.70% (0.0637 => 0.0537, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.53% (0.0246 => 0.0134, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.82% (0.7541 => 0.7829, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.65% (1.5363 => 1.6077, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 19:31:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 21:31:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918023127.D385C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3939?compare_to=3934&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3939, Order: 164083, Start Time: 2012-09-18 01:18:21, End Time: 2012-09-18 02:32:51 To: 3934, Order: 164053, Start Time: 2012-09-17 21:47:45, End Time: 2012-09-17 23:02:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.1185 => 2.1423, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.2916 => 1.3068, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.70% (2.0176 => 2.4151, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.83% (3.9660 => 4.3559, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.7710 => 0.8466, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 9.40% (0.4328 => 0.4735, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.30% (1.3693 => 1.4966, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 9.29% (0.7038 => 0.7692, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.06% (0.5265 => 0.5742, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.04% (0.9199 => 1.0031, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.2193 => 1.3274, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.81% (0.4062 => 0.4420, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2781 => 0.3025, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.70% (0.5818 => 0.6324, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.67% (0.3899 => 0.4237, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7061 => 0.7673, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.4563 => 1.5799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3022 => 0.3277, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.43% (1.1364 => 1.2322, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2782 => 0.3016, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.35% (13.8202 => 14.9736, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (0.3485 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.16% (0.2966 => 0.3208, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.12% (0.3756 => 0.4061, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2760 => 0.2983, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.04% (1.9828 => 2.1423, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.02% (0.2607 => 0.2816, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3580 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.97% (0.3489 => 0.3767, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.96% (0.2765 => 0.2985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (0.2655 => 0.2866, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.94% (0.5577 => 0.6020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.2937 => 0.3170, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2690 => 0.2903, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2726 => 0.2941, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.88% (0.4390 => 0.4736, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6283 => 0.6778, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.3246 => 0.3500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.77% (0.4016 => 0.4328, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.76% (0.2628 => 0.2832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2761 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.70% (0.4791 => 0.5160, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.67% (1.0313 => 1.1104, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.64% (0.2696 => 0.2902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.62% (0.3149 => 0.3389, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.4379 => 0.4712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.60% (0.2988 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.60% (0.3107 => 0.3343, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.52% (0.3868 => 0.4159, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3453 => 0.3711, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (7.2180 => 7.7522, std.dev.: 0.0091) MultiSource/Applications/Burg/burg: 7.40% (1.1061 => 1.1879, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.26% (0.7506 => 0.8051, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 7.26% (3.8646 => 4.1452, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 7.26% (0.8310 => 0.8913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.16% (0.3534 => 0.3787, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.15% (0.3914 => 0.4194, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.11% (3.6692 => 3.9302, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 7.11% (0.2925 => 0.3133, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3646 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 7.04% (0.2243 => 0.2401, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.99% (0.3220 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.7460 => 0.7975, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.86% (2.1791 => 2.3285, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.53% (3.1889 => 3.3971, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.3245 => 1.4107, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.44% (16.6129 => 17.6834, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 6.42% (1.9270 => 2.0508, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 6.40% (0.1657 => 0.1763, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.38% (0.6744 => 0.7174, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.36% (1.0594 => 1.1268, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.21% (0.8698 => 0.9238, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.13% (0.3755 => 0.3985, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.08% (0.4113 => 0.4363, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.06% (1.2749 => 1.3522, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 6.03% (14.8535 => 15.7485, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.96% (0.6576 => 0.6968, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.2859 => 0.3029, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4639, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.88% (8.4961 => 8.9954, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4619, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.83% (4.4433 => 4.7025, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.6135 => 0.6491, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.78% (4.3801 => 4.6333, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.68% (13.2842 => 14.0385, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.65% (0.2140 => 0.2261, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.56% (0.3131 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.47% (1.1333 => 1.1953, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.23% (14.5298 => 15.2902, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 5.23% (4.6629 => 4.9067, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.18% (1.2292 => 1.2929, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.03% (3.2742 => 3.4389, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (6.5754 => 6.9044, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.98% (0.8818 => 0.9257, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.4805 => 0.5029, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.62% (0.6250 => 0.6539, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.49% (4.9865 => 5.2103, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (0.9108 => 0.9506, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (1.5188 => 1.5827, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 4.14% (3.7467 => 3.9017, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (2.1007 => 2.1797, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2785 => 6.5106, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.24% (33.2944 => 34.3736, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.86% (16.2614 => 16.5639, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4134, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5472, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.11% (10.7476 => 11.0816, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5996, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5869, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.83% (0.4657 => 0.3920, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.73% (22.5627 => 21.7200, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2819, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0113) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9238, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6147, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -2.35% (26.5159 => 25.8923, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2509, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0588, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4963, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2632, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 20:00:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 22:00:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918030030.DE21F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3940?compare_to=3937&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3940, Order: 164085, Start Time: 2012-09-18 01:42:04, End Time: 2012-09-18 03:01:52 To: 3937, Order: 164078, Start Time: 2012-09-17 23:53:58, End Time: 2012-09-18 01:13:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (730 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (14.5682 => 15.1416, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.21% (0.5700 => 0.5688, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 0.17% (15.8192 => 15.8455, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -0.21% (14.6864 => 14.6559, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: -0.12% (82.3349 => 82.2394, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.3002 => 4.2996, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2206 => 1.2194, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.41% (7.3787 => 7.3488, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.11% (3.6576 => 3.6534, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.53% (0.6356 => 0.6322, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (0.0648 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.04% (63.2438 => 82.2394, std.dev.: 0.0108) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14256.67% (0.0720 => 10.3368, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.05% (10.3673 => 15.1416, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.30% (2.2022 => 2.5171, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.92% (7.0540 => 8.0360, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 13.48% (0.1432 => 0.1625) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.33% (1.7609 => 1.9428, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 9.17% (0.3282 => 0.3583, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.87% (0.3473 => 0.3781, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3543 => 0.3852, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.61% (0.3543 => 0.3848, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.59% (0.3516 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3694 => 0.4007, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.31% (0.3828 => 0.4146, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 8.15% (0.3927 => 0.4247, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.08% (0.3886 => 0.4200, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.94% (0.1625 => 0.1754, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.75% (10.4361 => 11.2452, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (9.4845 => 10.1708, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3121 => 0.3337, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.74% (0.4879 => 0.5208, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.74% (0.3177 => 0.3391, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7433 => 0.7895, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.20% (5.7591 => 6.1162, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2700 => 0.2867, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4615 => 0.4895, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.98% (0.6675 => 0.7074, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.96% (0.7115 => 0.7539, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.91% (0.2554 => 0.2705, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.87% (0.3423 => 0.3624, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.82% (0.5860 => 0.6201, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (4.2646 => 4.5118, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.77% (0.2271 => 0.2402, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.72% (1.5415 => 1.6297, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 5.72% (3.3354 => 3.5262, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.3050 => 1.3796, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.8067 => 0.8525, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (8.1363 => 8.5923, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.54% (0.5105 => 0.5388, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.43% (0.8172 => 0.8616, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.39% (0.5569 => 0.5869, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 5.39% (0.7835 => 0.8257, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.23% (5.0018 => 5.2636, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2107 => 0.2217, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9765 => 1.0273, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.9449 => 5.2017, std.dev.: 0.0098) MultiSource/Applications/Burg/burg: 5.03% (1.1642 => 1.2228, std.dev.: 0.0136) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1250, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 4.81% (0.6030 => 0.6320, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 4.78% (0.5925 => 0.6208, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.77% (3.8723 => 4.0569, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.72% (0.7326 => 0.7672, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (1.1861 => 1.2420, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.5020 => 0.5253, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.4103 => 0.4286, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.44% (7.9617 => 8.3155, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 4.24% (1.5603 => 1.6264, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9371 => 22.8553, std.dev.: 0.0215) MultiSource/Applications/treecc/treecc: 4.17% (2.0273 => 2.1119, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.08% (0.8921 => 0.9285, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4636 => 0.4823, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.00% (0.6450 => 0.6708, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.5981 => 0.6218, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.92% (2.2969 => 2.3870, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.6456 => 0.6709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3826 => 0.3974, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3422 => 0.3552, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.4064 => 0.4213, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.54% (1.5859 => 1.6420, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.47% (1.4186 => 1.4678, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (14.3668 => 14.8395, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3650 => 0.3770, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2732, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4203 => 0.4338, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.1840 => 1.2194, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4620 => 0.4755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.92% (0.4048 => 0.4166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.73% (2.0665 => 2.1230, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.8101 => 0.8280, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3062, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3829, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 6.71% (1.1396 => 1.2161, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7571, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3489, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.02% (2.2771 => 2.3004, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5749, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.71% (5.2763 => 3.2336, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.09% (5.3855 => 3.8726, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.64% (5.3526 => 3.8733, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1388, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.89% (2.9384 => 2.5891, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -8.68% (22.1758 => 20.2508, std.dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.61% (1.5373 => 1.3742, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2981, std.dev.: 0.0617) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4834, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (1.8329 => 1.7176, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -3.17% (1.2373 => 1.1981, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5019, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4234, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0064, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9984, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5797, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8555, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.78% (0.5229 => 0.5688, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 5.71% (14.9895 => 15.8455, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 3.54% (14.1553 => 14.6559, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (4.1105 => 4.2996, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.37% (1.1048 => 1.2194, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.66% (7.1582 => 7.3488, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.50% (3.4629 => 3.6534, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.6222 => 0.6322, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.19% (0.2116 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 20:20:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 22:20:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918032045.D6899352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3941?compare_to=3936&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3941, Order: 164080, Start Time: 2012-09-18 00:38:25, End Time: 2012-09-18 03:22:09 To: 3936, Order: 164051, Start Time: 2012-09-17 21:26:19, End Time: 2012-09-18 00:10:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.79% (1.7042 => 1.7347, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.05% (2.1040 => 2.0609, std.dev.: 0.0139) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.72% (0.3488 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.67% (0.3465 => 0.3800, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3496 => 0.3833, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3446 => 0.3776, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.57% (0.3460 => 0.3791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3442 => 0.3771, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.51% (0.3469 => 0.3799, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.40% (0.3650 => 0.3993, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 9.39% (0.3643 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.21% (0.3724 => 0.4067, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.88% (1.5932 => 1.7347, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (1.6211 => 1.7243, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (1.3152 => 1.3967, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.16% (3.5627 => 3.7820, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.06% (2.7292 => 2.8946, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.88% (5.5417 => 5.8677, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.2014 => 0.2131, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.72% (0.5000 => 0.5286, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (0.4994 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 5.49% (23.5202 => 24.8106, std.dev.: 0.0085) MultiSource/Applications/d/make_dparser: 5.44% (1.0781 => 1.1368, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.3004 => 0.3167, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.37% (0.5026 => 0.5296, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.3271 => 0.3446, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.2736 => 0.2880, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (0.3930 => 0.4136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.24% (0.5826 => 0.6131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.22% (0.2875 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.20% (0.3195 => 0.3361, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.08% (0.5889 => 0.6188, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.01% (0.9909 => 1.0405, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.98% (4.2109 => 4.4204, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 4.97% (0.2714 => 0.2849, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2738 => 0.2874, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2823 => 0.2963, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.96% (2.1013 => 2.2055, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2725 => 0.2860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.94% (0.2811 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.90% (0.3267 => 0.3427, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.2866 => 0.3006, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.88% (2.0673 => 2.1681, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.85% (4.6177 => 4.8415, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2911 => 0.3052, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.82% (0.3258 => 0.3415, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2803 => 0.2937, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3060 => 0.3206, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (2.1653 => 2.2675, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.70% (0.3726 => 0.3901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.69% (0.3348 => 0.3505, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.67% (0.3124 => 0.3270, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3317 => 0.3472, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.3903 => 0.4085, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3625 => 0.3793, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (1.8794 => 1.9660, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 4.58% (0.6634 => 0.6938, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 4.58% (1.4269 => 1.4922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.54% (0.3477 => 0.3635, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (4.4195 => 4.6188, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.50% (0.9697 => 1.0133, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: 4.49% (0.3678 => 0.3843, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.5900 => 0.6164, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 4.47% (0.4251 => 0.4441, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (0.4658 => 0.4864, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4146 => 0.4329, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.35% (0.6435 => 0.6715, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.35% (0.3336 => 0.3481) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.4139 => 0.4316, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.3084 => 0.3215, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.24% (0.5546 => 0.5781, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.17% (0.5012 => 0.5221, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (1.9966 => 2.0774, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 4.04% (0.7171 => 0.7461, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (1.9694 => 2.0488, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.3981 => 0.4141, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.97% (0.7875 => 0.8188, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.3845 => 0.3997, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.2969 => 0.3086, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.73% (2.0346 => 2.1105, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.68% (0.7426 => 0.7699, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.32% (0.4847 => 0.5008, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (0.5361 => 0.5535, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.19% (0.5584 => 0.5762, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.6926 => 4.8330, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (11.6398 => 11.9830, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6475, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2126, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5042, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4500, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5862, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5752, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7943, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7942, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.26% (17.2379 => 16.8490, std.dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9673, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 20:23:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 22:23:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918032342.59E94352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3942?compare_to=3938&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3942, Order: 164089, Start Time: 2012-09-18 02:14:04, End Time: 2012-09-18 03:25:07 To: 3938, Order: 164080, Start Time: 2012-09-18 00:46:02, End Time: 2012-09-18 01:58:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (45 on baseline) Performance Improvements: 6 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 886 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.2870 => 0.3072, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.7085 => 0.7288, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.38% (0.7619 => 0.7800, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.11% (0.5833 => 0.5956, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.09% (0.8855 => 0.9040, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.92% (21.6716 => 22.5204, std.dev.: 0.2019) SingleSource/Benchmarks/McGill/chomp: 1.66% (1.0983 => 1.1165, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.6117 => 1.6349, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.19% (1.6036 => 1.6227, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.77% (0.8794 => 0.8550, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.83% (6.3723 => 6.2554, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.51% (1.2301 => 1.2115, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: -1.50% (1.0990 => 1.0825, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -13.22% (0.1619 => 0.1405, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: -5.04% (0.6871 => 0.6525, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.41% (0.9986 => 0.9845, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: -0.61% (0.6038 => 0.6001, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: -2.98% (0.1678 => 0.1628, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.13% (0.1552 => 0.1550, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.87% (0.3001 => 0.3027, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.2290 => 0.2383, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (0.3159 => 0.3123, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.70% (0.2273 => 0.2289, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 0.44% (0.0451 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -44.32% (0.0088 => 0.0049, std.dev.: 0.0019) SingleSource/UnitTests/2003-08-11-VaListArg: 64.81% (0.0054 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 39.02% (0.0164 => 0.0228, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.26% (0.0133 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.35% (0.0383 => 0.0374, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.05% (0.0297 => 0.0282, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0278 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.03% (0.0318 => 0.0302, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -20.63% (0.0189 => 0.0150, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: - (0.0246 => 0.0246, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -7.50% (0.0320 => 0.0296, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1431 => 0.1437, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 5.46% (1.3655 => 1.4400, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.43% (0.1463 => 0.1557, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.52% (0.4259 => 0.4237, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.89% (0.1442 => 0.1357, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.22% (0.0592 => 0.0617, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.39% (0.0254 => 0.0220, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.10% (0.0642 => 0.0590, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1541 => 1.1504, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0012 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.59% (0.0537 => 0.0567, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.88% (0.0134 => 0.0166, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.7829 => 0.7806, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.49% (1.6077 => 1.5999, std.dev.: 0.0051) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.88% (0.0121 => 0.0080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.91% (4.1772 => 3.0533, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0010) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.14% (0.1414 => 0.1515, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 5.77% (2.1763 => 2.3018, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/bigfib: 5.76% (0.5309 => 0.5615, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.52% (0.6410 => 0.6764, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.66% (0.3582 => 0.3749, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 4.18% (0.6173 => 0.6431, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.6915 => 0.7198, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 3.53% (1.1653 => 1.2064, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.5150 => 1.5524, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 2.43% (29.3170 => 30.0293, std.dev.: 0.1226) MultiSource/Applications/hbd/hbd: 1.93% (1.3268 => 1.3524, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.06% (12.6413 => 12.7752, std.dev.: 0.0397) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.45% (0.0499 => 0.0616, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/ary3: 14.54% (1.7426 => 1.9959, std.dev.: 0.0270) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3746 => 0.4277, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5515, std.dev.: 0.0225) SingleSource/Benchmarks/Stanford/Puzzle: 12.00% (0.1433 => 0.1605, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.58% (0.2694 => 0.2979, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 9.53% (1.0194 => 1.1165, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6257, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.74% (0.2857 => 0.3078, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (27.1724 => 28.8062, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.56% (4.2129 => 4.4049, std.dev.: 0.0567) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 4.34% (15.2242 => 15.8852, std.dev.: 0.0301) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.97% (0.8498 => 0.8835, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/power/power: 3.23% (1.4184 => 1.4642, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 2.88% (5.1938 => 5.3433, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.09% (0.5876 => 0.5999, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.77% (14.4877 => 14.7437, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 1.61% (3.5520 => 3.6093, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.59% (4.6127 => 4.6860, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.48% (1.6110 => 1.6349, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.5166 => 2.5505, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.03% (1.6061 => 1.6227, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.35% (4.3380 => 4.2795, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (4.2815 => 4.2376, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.66% (0.3497 => 0.2040, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0778, std.dev.: 0.1035) SingleSource/Benchmarks/Shootout-C++/ary3: -20.47% (1.7473 => 1.3896, std.dev.: 0.0421) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.33% (1.1647 => 0.9396, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1607, std.dev.: 0.2198) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -9.46% (62.4126 => 56.5066, std.dev.: 0.1450) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.96% (2.4457 => 2.2509, std.dev.: 0.0751) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.51% (3.2007 => 2.9604, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.27% (3.6254 => 3.3618, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3523, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (3.4230 => 3.2159, std.dev.: 0.0307) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4103, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.23% (0.4140 => 0.3965, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: -4.04% (1.4117 => 1.3546, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.71% (1.7361 => 1.6717, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: -3.34% (7.6833 => 7.4270, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2308, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.06% (3.7496 => 3.6347, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/methcall: -2.82% (9.2503 => 8.9893, std.dev.: 0.0603) MultiSource/Applications/aha/aha: -2.77% (3.4286 => 3.3337, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0247) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -1.80% (3.4876 => 3.4249, std.dev.: 0.0211) MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (92.7467 => 91.1070, std.dev.: 0.2373) MultiSource/Benchmarks/FreeBench/neural/neural: -1.74% (1.0926 => 1.0736, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2293, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.56% (3.8907 => 3.8299, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.3569 => 2.3218, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7680, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.35% (0.9980 => 0.9845, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: -0.35% (0.6022 => 0.6001, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: -2.28% (0.1666 => 0.1628, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.26% (0.1554 => 0.1550, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.82% (0.3083 => 0.3027, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.46% (0.2394 => 0.2383, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.64% (0.3175 => 0.3123, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.56% (0.2302 => 0.2289, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -44.94% (0.0089 => 0.0049, std.dev.: 0.0019) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.00% (0.0240 => 0.0228, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.37% (0.0192 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.10% (0.0390 => 0.0374, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.31% (0.0301 => 0.0282, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.79% (0.0324 => 0.0302, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -20.63% (0.0189 => 0.0150, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -8.92% (0.0325 => 0.0296, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -4.12% (1.5019 => 1.4400, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.73% (0.1501 => 0.1557, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.63% (0.4264 => 0.4237, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.97% (0.1344 => 0.1357, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.75% (0.0589 => 0.0617, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.17% (0.0232 => 0.0220, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.67% (0.0639 => 0.0590, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.36% (1.1350 => 1.1504, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 266.67% (0.0006 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.99% (0.0637 => 0.0567, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.52% (0.0246 => 0.0166, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.51% (0.7541 => 0.7806, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.14% (1.5363 => 1.5999, std.dev.: 0.0051) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.29% (0.0070 => 0.0080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 21:14:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 23:14:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918041413.2D3E8352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3943?compare_to=3939&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3943, Order: 164091, Start Time: 2012-09-18 03:01:20, End Time: 2012-09-18 04:15:36 To: 3939, Order: 164083, Start Time: 2012-09-18 01:18:21, End Time: 2012-09-18 02:32:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 3 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.78% (2.1423 => 2.1041, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -1.50% (1.2929 => 1.2735, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.10% (2.4151 => 2.3885, std.dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.38% (2.0176 => 2.3885, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.82% (0.1410 => 0.1619, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.77% (0.1413 => 0.1551, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.10% (3.9660 => 4.3271, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.74% (0.2596 => 0.2823, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.65% (0.7710 => 0.8377, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 8.51% (0.7038 => 0.7637, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.45% (0.9199 => 0.9976, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.35% (1.3693 => 1.4836, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.32% (1.2193 => 1.3208, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.27% (0.2721 => 0.2946, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.24% (0.5265 => 0.5699, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.12% (0.6959 => 0.7524, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.99% (0.1327 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.81% (1.1364 => 1.2252, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.79% (13.8202 => 14.8968, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7061 => 0.7608, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.71% (1.4563 => 1.5686, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 7.70% (0.5818 => 0.6266, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.55% (0.5748 => 0.6182, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.35% (0.6283 => 0.6745, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.28% (0.5577 => 0.5983, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.11% (1.0313 => 1.1046, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.10% (0.3899 => 0.4176, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.4791 => 0.5127, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 7.01% (0.2995 => 0.3205, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.99% (0.3246 => 0.3473, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.90% (0.2914 => 0.3115, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.80% (1.1061 => 1.1813, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8310 => 0.8874, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.78% (7.2180 => 7.7076, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.71% (0.5637 => 0.6015, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.66% (0.7506 => 0.8006, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 6.62% (3.8646 => 4.1206, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.55% (0.3756 => 0.4002, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9090, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3485 => 0.3712, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.43% (0.2925 => 0.3113, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.42% (0.3489 => 0.3713, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.40% (0.4390 => 0.4671, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.39% (0.7460 => 0.7937, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.35% (0.4016 => 0.4271, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3580 => 0.3807, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.34% (0.2966 => 0.3154, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3220 => 0.3424, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.18% (2.1791 => 2.3138, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.15% (0.3868 => 0.4106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.15% (0.3578 => 0.3798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.13% (0.3914 => 0.4154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.12% (1.9828 => 2.1041, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.11% (0.1865 => 0.1979, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.07% (0.4003 => 0.4246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2655 => 0.2816, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.06% (0.3646 => 0.3867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 6.04% (0.3789 => 0.4018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.00% (0.3601 => 0.3817, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.96% (0.3623 => 0.3839, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.95% (3.1889 => 3.3787, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (1.3245 => 1.4030, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.92% (0.3650 => 0.3866, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.92% (1.9270 => 2.0410, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 5.89% (0.3940 => 0.4172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.87% (0.3149 => 0.3334, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.82% (1.0594 => 1.1211, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 5.78% (0.6744 => 0.7134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (1.3819 => 1.4603, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 5.62% (16.6129 => 17.5462, std.dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.2749 => 1.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.60% (0.3534 => 0.3732, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.59% (0.4113 => 0.4343, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.59% (1.3813 => 1.4585, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.47% (8.4961 => 8.9609, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 5.45% (14.8535 => 15.6634, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 5.32% (0.2859 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.6135 => 0.6456, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.18% (4.3801 => 4.6070, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (4.4433 => 4.6732, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.13% (13.2842 => 13.9657, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.12% (0.8698 => 0.9143, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.09% (0.8818 => 0.9267, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.6576 => 0.6910, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.91% (0.2504 => 0.2627, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.90% (4.6629 => 4.8913, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.90% (1.1333 => 1.1888, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.62% (14.5298 => 15.2008, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2321 => 0.2428, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.57% (6.5754 => 6.8761, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.54% (3.2742 => 3.4228, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.53% (0.3755 => 0.3925, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.47% (0.3245 => 0.3390, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.05% (0.9108 => 0.9477, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1755, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (0.4805 => 0.4985, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5188 => 1.5749, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2735, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.56% (3.7467 => 3.8801, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6250 => 0.6467, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (6.2785 => 6.4850, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.1007 => 2.1687, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.43% (33.2944 => 34.1032, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.38% (16.2614 => 16.4858, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std.dev.: 0.0191) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.52% (1.1560 => 1.2545, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (3.1736 => 3.4183, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6975, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5478, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0754, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5152, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.79% (0.4657 => 0.3875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.17% (22.5627 => 21.6222, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2637, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.59% (1.3780 => 1.3010, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1504, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9226, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.23% (26.5159 => 25.9253, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2241, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8716, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2455, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0606, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2629, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 21:48:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 23:48:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918044834.BC721352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3944?compare_to=3940&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3944, Order: 164091, Start Time: 2012-09-18 03:30:21, End Time: 2012-09-18 04:49:58 To: 3940, Order: 164085, Start Time: 2012-09-18 01:42:04, End Time: 2012-09-18 03:01:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (730 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5688 => 0.5681, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.11% (15.8455 => 15.8273, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: -0.03% (14.6559 => 14.6511, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 0.00% (82.2394 => 82.2395, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 0.01% (4.2996 => 4.3002, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2194 => 1.2196, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.3488 => 7.3539, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.11% (3.6534 => 3.6494, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.6322 => 0.6319, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.45% (0.0673 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.04% (63.2438 => 82.2395, std.dev.: 0.0095) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14250.28% (0.0720 => 10.3322, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.06% (10.3673 => 15.1428, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 25.34% (0.1622 => 0.2033, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.19% (2.2022 => 2.5147, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.50% (7.0540 => 8.0065, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.99% (1.1194 => 1.2536, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.39% (1.7609 => 1.9439, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 8.52% (0.3473 => 0.3769, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.31% (0.3561 => 0.3857, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3543 => 0.3837, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3516 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.27% (0.3543 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3694 => 0.3991, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3828 => 0.4133, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.3927 => 0.4235, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.82% (0.3886 => 0.4190, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 7.63% (10.4361 => 11.2323, std.dev.: 0.0176) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.23% (9.4845 => 10.1704, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.78% (0.4879 => 0.5210, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.44% (0.2700 => 0.2874, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.4615 => 0.4906, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.26% (0.7433 => 0.7898, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 6.02% (0.7115 => 0.7543, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 5.96% (5.7591 => 6.1025, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 5.87% (0.3423 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3806, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.78% (0.5860 => 0.6199, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.78% (0.6675 => 0.7061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (4.2646 => 4.5109, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 5.73% (3.3354 => 3.5264, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5415 => 1.6275, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (8.1363 => 8.5892, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.50% (0.5105 => 0.5386, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.8172 => 0.8619, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.38% (5.0018 => 5.2708, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8067 => 0.8500, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.32% (0.5569 => 0.5865, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.9449 => 5.2041, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 5.22% (0.7835 => 0.8244, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.18% (0.2758 => 0.2901, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 5.17% (0.3092 => 0.3252, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9765 => 1.0258, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.02% (1.1642 => 1.2226, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.89% (1.0722 => 1.1246, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.79% (3.8723 => 4.0578, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 4.78% (0.3387 => 0.3549, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.78% (0.3180 => 0.3332, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.77% (0.4299 => 0.4504, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (1.1861 => 1.2414, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.56% (1.5603 => 1.6315, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (7.9617 => 8.3194, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 4.47% (0.5925 => 0.6190, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.39% (0.6030 => 0.6295, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.38% (0.5020 => 0.5240, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 4.23% (2.0273 => 2.1130, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 4.17% (0.8921 => 0.9293, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 4.13% (21.9371 => 22.8428, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.12% (0.6450 => 0.6716, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.11% (2.2969 => 2.3913, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.5981 => 0.6215, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.75% (0.4636 => 0.4810, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6456 => 0.6697, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 3.71% (0.7326 => 0.7598, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.68% (1.5859 => 1.6442, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.63% (0.3826 => 0.3965, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.4064 => 0.4209, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.57% (0.3422 => 0.3544, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (1.4186 => 1.4688, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.2024 => 2.2742, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (14.3668 => 14.8243, std.dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 3.13% (1.1840 => 1.2211, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3650 => 0.3763, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.08% (0.3865 => 0.3984, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.05% (0.3935 => 0.4055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.4203 => 0.4321, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 2.64% (0.4048 => 0.4155, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.64% (2.0665 => 2.1210, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.8101 => 0.8253, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.2842 => 1.3030, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.02% (17.1811 => 17.3562, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (3.1578 => 3.3854, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3448, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2316, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7892, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5850, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.66% (5.2763 => 3.2364, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.25% (5.3855 => 3.8643, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.88% (5.3526 => 3.8603, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0924, std.dev.: 0.0368) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.90% (2.9384 => 2.5888, std.dev.: 0.0163) MultiSource/Applications/ClamAV/clamscan: -8.71% (22.1758 => 20.2447, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3108, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7158, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1515, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4953, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4257, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0047, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/chomp: -2.04% (1.2373 => 1.2120, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9907, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5784, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7048, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2305, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8562, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.64% (0.5229 => 0.5681, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 5.59% (14.9895 => 15.8273, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 3.50% (14.1553 => 14.6511, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 4.62% (4.1105 => 4.3002, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.39% (1.1048 => 1.2196, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.73% (7.1582 => 7.3539, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.39% (3.4629 => 3.6494, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (0.6222 => 0.6319, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 21:51:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Sep 2012 23:51:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918045138.6ABDC352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3945?compare_to=3942&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3945, Order: 164091, Start Time: 2012-09-18 03:41:17, End Time: 2012-09-18 04:53:03 To: 3942, Order: 164089, Start Time: 2012-09-18 02:14:04, End Time: 2012-09-18 03:25:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 17 (58 on baseline) Performance Improvements: 4 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 880 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (1.4439 => 1.4974, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.36% (3.0807 => 3.1843, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 2.83% (15.7805 => 16.2275, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.99% (1.3992 => 1.4271, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.84% (1.0383 => 1.0574, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.64% (0.9321 => 0.9474, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 37.65% (0.1405 => 0.1934, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.79% (3.0622 => 3.7600, std.dev.: 0.0561) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.50% (40.7011 => 43.3485, std.dev.: 0.1494) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.36% (4.0778 => 4.2556, std.dev.: 0.0547) MultiSource/Benchmarks/Olden/bisort/bisort: 4.31% (0.6525 => 0.6806, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.29% (1.0606 => 1.1061, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.23% (2.6779 => 2.7377, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.69% (1.8351 => 1.8661, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.61% (1.4254 => 1.4484, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 1.30% (29.2530 => 29.6342, std.dev.: 0.1238) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.17% (4.0647 => 4.1122, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.07% (0.5956 => 0.5773, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.82% (0.7800 => 0.7658, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -17.69% (0.0616 => 0.0507, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.25% (22.5204 => 22.0131, std.dev.: 0.1916) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.48% (0.9845 => 0.9991, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 0.68% (0.6001 => 0.6042, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -1.78% (0.1628 => 0.1599, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.03% (0.1550 => 0.1441, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (0.3027 => 0.3024, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.27% (0.2383 => 0.2329, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.24% (0.3123 => 0.3193, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.66% (0.2289 => 0.2327, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -5.52% (0.0453 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -38.78% (0.0049 => 0.0030, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -59.55% (0.0089 => 0.0036, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.33% (0.0228 => 0.0152, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.79% (0.0126 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.14% (0.0374 => 0.0382, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.90% (0.0282 => 0.0293, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0279 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.63% (0.0302 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.67% (0.0180 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 26.67% (0.0150 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.81% (0.0246 => 0.0244, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 10.14% (0.0296 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 20.00% (0.0005 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.99% (0.1437 => 0.1394, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -2.85% (1.4400 => 1.3989, std.dev.: 0.0659) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.28% (0.1557 => 0.1506, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.98% (0.4237 => 0.4026, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.82% (0.1357 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.99% (0.0617 => 0.0543, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.73% (0.0220 => 0.0170, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.66% (0.0590 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.27% (1.1504 => 1.1535, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -4.55% (0.0022 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.88% (0.0567 => 0.0545, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.55% (0.0166 => 0.0230, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (0.7806 => 0.7828, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.53% (1.5999 => 1.6084, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.75% (0.0080 => 0.0073, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.78% (4.1772 => 3.1002, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/except: 82233.33% (0.0006 => 0.4940, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.10% (0.5309 => 0.5686, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 5.99% (15.3105 => 16.2275, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 5.35% (2.1763 => 2.2928, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 5.26% (1.0046 => 1.0574, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.02% (0.6410 => 0.6732, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.2552 => 0.2666, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 4.34% (1.1653 => 1.2159, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.4408 => 1.4974, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 3.84% (0.6173 => 0.6410, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.53% (3.0758 => 3.1843, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.7639 => 0.7860, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5150 => 1.5552, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.38% (29.3170 => 30.0146, std.dev.: 0.1191) MultiSource/Applications/siod/siod: 2.20% (2.0972 => 2.1434, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 1.13% (3.5980 => 3.6386, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.12% (1.4113 => 1.4271, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 1.06% (14.6079 => 14.7630, std.dev.: 0.0315) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.57% (1.6538 => 2.3413, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/mst/mst: 36.49% (0.1417 => 0.1934, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/heapsort: 24.27% (3.0256 => 3.7600, std.dev.: 0.0561) SingleSource/Benchmarks/Shootout-C++/matrix: 22.31% (3.4629 => 4.2354, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/ary3: 16.45% (1.7426 => 2.0292, std.dev.: 0.0239) SingleSource/Benchmarks/Stanford/Puzzle: 15.49% (0.1433 => 0.1655, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3746 => 0.4276, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5501, std.dev.: 0.0236) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.92% (1.0063 => 1.1061, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 9.37% (7.0025 => 7.6586, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 7.85% (1.0194 => 1.0994, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.63% (0.2857 => 0.3075, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.45% (0.3301 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.09% (40.4792 => 43.3485, std.dev.: 0.1494) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.08% (4.2129 => 4.4692, std.dev.: 0.0776) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8071, std.dev.: 0.0606) MultiSource/Benchmarks/Olden/bisort/bisort: 5.37% (0.6459 => 0.6806, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash: 5.15% (0.6308 => 0.6633, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/dt: 4.55% (0.9851 => 1.0299, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.28% (15.2242 => 15.8752, std.dev.: 0.0369) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.73% (6.6312 => 6.8784, std.dev.: 0.0319) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.28% (8.5113 => 8.7902, std.dev.: 0.0418) MultiSource/Benchmarks/Olden/power/power: 3.24% (1.4184 => 1.4643, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.91% (0.5876 => 0.6047, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.70% (2.6656 => 2.7377, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.32% (4.6127 => 4.7199, std.dev.: 0.0161) MultiSource/Benchmarks/BitBench/five11/five11: 2.21% (5.1938 => 5.3087, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: 1.92% (2.5166 => 2.5649, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.91% (14.4877 => 14.7637, std.dev.: 0.0110) MultiSource/Applications/siod/siod: 1.84% (3.5520 => 3.6174, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (2.4971 => 2.5355, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9152 => 2.9589, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4455 => 2.4821, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 1.15% (2.4013 => 2.4289, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (4.6414 => 4.6944, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.14% (4.0659 => 4.1122, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.58% (0.2080 => 0.1860, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: -4.60% (0.7738 => 0.7382, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.76% (0.5937 => 0.5773, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.75% (0.5740 => 0.5582, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.72% (8.2559 => 8.1139, std.dev.: 0.0497) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.35% (0.3497 => 0.2121, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -20.22% (1.1647 => 0.9292, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.19% (5.2665 => 4.2556, std.dev.: 0.0547) SingleSource/Benchmarks/Shootout/sieve: -12.12% (8.1594 => 7.1701, std.dev.: 0.0305) MultiSource/Benchmarks/mafft/pairlocalalign: -9.41% (62.4126 => 56.5417, std.dev.: 0.0895) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.86% (2.4457 => 2.2534, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.08% (3.6023 => 3.3473, std.dev.: 0.0933) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3740, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -6.15% (1.4441 => 1.3553, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.85% (2.9728 => 2.7990, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: -5.61% (3.4230 => 3.2309, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4060, std.dev.: 0.0463) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -4.43% (9.5474 => 9.1241, std.dev.: 0.0902) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.43% (1.7361 => 1.6765, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: -3.42% (9.2503 => 8.9342, std.dev.: 0.0288) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.12% (0.4140 => 0.4011, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: -2.98% (1.4117 => 1.3696, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.80% (3.9413 => 3.8308, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -2.77% (7.6833 => 7.4706, std.dev.: 0.0463) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.63% (1.2722 => 1.2387, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -2.37% (3.4286 => 3.3473, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.19% (1.0686 => 1.0452, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4221, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2291, std.dev.: 0.0309) MultiSource/Benchmarks/PAQ8p/paq8p: -1.66% (92.7467 => 91.2075, std.dev.: 0.2483) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.54% (3.8907 => 3.8308, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (25.6658 => 25.3266, std.dev.: 0.0298) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.11% (0.9980 => 0.9991, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 0.33% (0.6022 => 0.6042, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -4.02% (0.1666 => 0.1599, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.27% (0.1554 => 0.1441, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.91% (0.3083 => 0.3024, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.72% (0.2394 => 0.2329, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3175 => 0.3193, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2302 => 0.2327, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -4.68% (0.0449 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -60.00% (0.0090 => 0.0036, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -36.67% (0.0240 => 0.0152, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.66% (0.0301 => 0.0293, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.45% (0.1429 => 0.1394, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -6.86% (1.5019 => 1.3989, std.dev.: 0.0659) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.33% (0.1501 => 0.1506, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.58% (0.4264 => 0.4026, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1344 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.81% (0.0589 => 0.0543, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.72% (0.0232 => 0.0170, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.63% (1.1350 => 1.1535, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 250.00% (0.0006 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.50% (0.0246 => 0.0230, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.81% (0.7541 => 0.7828, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.69% (1.5363 => 1.6084, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.29% (0.0070 => 0.0073, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 22:57:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 00:57:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918055709.8B309352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3946?compare_to=3943&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3946, Order: 164098, Start Time: 2012-09-18 04:44:01, End Time: 2012-09-18 05:58:32 To: 3943, Order: 164091, Start Time: 2012-09-18 03:01:20, End Time: 2012-09-18 04:15:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (54.9196 => 56.3860, std.dev.: 0.1092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.14% (2.0176 => 2.4038, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (3.9660 => 4.3325, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.89% (0.7038 => 0.7664, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.81% (0.7710 => 0.8389, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 8.67% (1.3693 => 1.4880, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.58% (0.5265 => 0.5717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.54% (0.9199 => 0.9985, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.6959 => 0.7543, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (1.2193 => 1.3203, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.5818 => 0.6284, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.99% (1.4563 => 1.5726, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.97% (1.1364 => 1.2270, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.84% (13.8202 => 14.9043, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.76% (0.7061 => 0.7609, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.64% (0.5748 => 0.6187, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.58% (0.5577 => 0.6000, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.46% (0.6283 => 0.6752, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.44% (1.0313 => 1.1080, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.29% (0.4062 => 0.4358, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.24% (0.3246 => 0.3481, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.14% (1.1061 => 1.1851, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.14% (0.4791 => 0.5133, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 7.01% (3.8646 => 4.1354, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.97% (0.7506 => 0.8029, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3580 => 0.3828, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.92% (0.8310 => 0.8885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.89% (0.3485 => 0.3725, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3489 => 0.3729, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.80% (0.2925 => 0.3124, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.76% (7.2180 => 7.7058, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.4390 => 0.4686, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3756 => 0.4007, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 6.68% (2.1791 => 2.3246, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 6.64% (0.2243 => 0.2392, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.61% (3.6692 => 3.9118, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.54% (1.9828 => 2.1124, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.50% (0.3293 => 0.3507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.46% (0.3868 => 0.4118, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.43% (0.7460 => 0.7940, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.42% (0.4016 => 0.4274, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.17% (1.3245 => 1.4062, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.08% (16.6129 => 17.6235, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 6.05% (3.1889 => 3.3819, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 6.05% (0.6744 => 0.7152, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.00% (1.9270 => 2.0427, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.95% (0.6576 => 0.6967, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.89% (1.0594 => 1.1218, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4620, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.76% (0.4113 => 0.4350, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 5.76% (0.3578 => 0.3784, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.75% (0.4003 => 0.4233, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.70% (0.3914 => 0.4137, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.68% (14.8535 => 15.6975, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions-4: 5.65% (0.3646 => 0.3852, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.62% (1.2749 => 1.3466, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4591, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 5.58% (0.3601 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.58% (8.4961 => 8.9701, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.52% (0.3623 => 0.3823, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.52% (0.8698 => 0.9178, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.52% (0.3789 => 0.3998, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.51% (0.3650 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.49% (0.2859 => 0.3016, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.48% (0.3940 => 0.4156, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6135 => 0.6463, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.32% (4.4433 => 4.6797, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.27% (4.3801 => 4.6111, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.19% (13.2842 => 13.9737, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.13% (0.8818 => 0.9270, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.03% (0.3755 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (1.1333 => 1.1895, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.83% (6.5754 => 6.8930, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 4.78% (4.6629 => 4.8859, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.78% (14.5298 => 15.2243, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.64% (3.2742 => 3.4261, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.56% (0.3245 => 0.3393, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.9108 => 0.9491, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.16% (1.2292 => 1.2803, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1871, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4805 => 0.4996, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (1.5188 => 1.5787, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.79% (0.6250 => 0.6487, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.78% (3.7467 => 3.8884, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1733, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.3511 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (6.2785 => 6.4833, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.79% (33.2944 => 34.2229, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5049, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std.dev.: 0.0394) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.72% (3.1736 => 3.4186, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.49% (0.2093 => 0.2208, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6967, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5476, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0740, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6007, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5165, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.16% (1.4298 => 1.4464, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5946, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.20% (0.4657 => 0.3856, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.93% (22.5627 => 21.6751, std.dev.: 0.0309) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2769, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.50% (3.0263 => 2.9203, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5845, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.06% (26.5159 => 25.9707, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2539, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2430, std.dev.: 0.0191) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2251, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.12% (4.1080 => 4.0620, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.06% (1.0310 => 1.0201, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 23:21:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 01:21:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918062114.950FD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3947?compare_to=3945&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3947, Order: 164101, Start Time: 2012-09-18 05:12:02, End Time: 2012-09-18 06:22:39 To: 3945, Order: 164091, Start Time: 2012-09-18 03:41:17, End Time: 2012-09-18 04:53:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (48 on baseline) Performance Improvements: 13 (34 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 880 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.85% (0.1860 => 0.2006, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 4.42% (0.7382 => 0.7708, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8215 => 3.9107, std.dev.: 0.0187) MultiSource/Applications/hbd/hbd: 1.91% (1.3334 => 1.3589, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 2.06% (2.3493 => 2.3977, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: 1.76% (9.1241 => 9.2846, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.49% (2.8499 => 2.8924, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.20% (4.5220 => 4.5763, std.dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.44% (16.2275 => 15.8313, std.dev.: 0.0810) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -18.81% (3.7600 => 3.0529, std.dev.: 0.0526) SingleSource/Benchmarks/Shootout/heapsort: -10.20% (3.3789 => 3.0344, std.dev.: 0.1148) SingleSource/Benchmarks/Shootout-C++/ary3: -7.12% (1.4932 => 1.3869, std.dev.: 0.0348) MultiSource/Benchmarks/nbench/nbench: -4.98% (22.4227 => 21.3050, std.dev.: 0.1548) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.52% (1.3240 => 1.2641, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bisort/bisort: -4.50% (0.6806 => 0.6500, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.16% (2.3911 => 2.2917, std.dev.: 0.0346) SingleSource/Benchmarks/CoyoteBench/lpbench: -3.98% (4.2556 => 4.0862, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout/hash: -1.94% (4.3720 => 4.2874, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout/ary3: -1.57% (2.0292 => 1.9973, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.42% (1.4484 => 1.4278, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-3: -1.01% (2.0867 => 2.0657, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.16% (0.9991 => 0.9775, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: -1.19% (0.6042 => 0.5970, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: -1.00% (0.1599 => 0.1583, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.23% (0.1441 => 0.1574, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (0.3024 => 0.3030, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.47% (0.2329 => 0.2318, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.81% (0.3193 => 0.3167, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.32% (0.2327 => 0.2273, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 6.54% (0.0428 => 0.0456, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: 186.67% (0.0030 => 0.0086, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 133.33% (0.0036 => 0.0084, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.08% (0.0152 => 0.0181, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0190 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.31% (0.0382 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.12% (0.0293 => 0.0278, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0280 => 0.0281, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.57% (0.0319 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -7.34% (0.0177 => 0.0164, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -18.95% (0.0190 => 0.0154, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 0.82% (0.0244 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -23.31% (0.0326 => 0.0250, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -16.67% (0.0006 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.02% (0.1394 => 0.1450, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 4.04% (1.3989 => 1.4554, std.dev.: 0.0345) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.66% (0.1506 => 0.1496, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.54% (0.4026 => 0.4249, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.20% (0.1436 => 0.1390, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.13% (0.0543 => 0.0598, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.35% (0.0170 => 0.0174, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.42% (0.0647 => 0.0599, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1535 => 1.1475, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -42.86% (0.0021 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.83% (0.0545 => 0.0604, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.87% (0.0230 => 0.0136, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7828 => 0.7804, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.04% (1.6084 => 1.6078, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 65.75% (0.0073 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.83% (4.1772 => 3.0564, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/except: 82216.67% (0.0006 => 0.4939, std.dev.: 0.0170) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.07% (0.0745 => 0.0902, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.5309 => 0.5613, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 5.59% (2.1763 => 2.2980, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.6410 => 0.6748, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.97% (0.3582 => 0.3760, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.2552 => 0.2668, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 4.07% (1.1653 => 1.2127, std.dev.: 0.0174) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.6915 => 0.7174, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 3.68% (1.0046 => 1.0416, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 3.40% (15.3105 => 15.8313, std.dev.: 0.0810) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3217 => 0.3323, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.5150 => 1.5530, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 2.50% (29.3170 => 30.0496, std.dev.: 0.1545) MultiSource/Applications/hbd/hbd: 2.42% (1.3268 => 1.3589, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.7639 => 0.7781, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (12.6413 => 12.8315, std.dev.: 0.0386) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.27% (6.2546 => 6.3339, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.20% (4.0101 => 4.5795, std.dev.: 0.1211) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3746 => 0.4276, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 11.30% (0.1433 => 0.1595, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.44% (1.0063 => 1.1013, std.dev.: 0.0275) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.62% (7.0025 => 7.6058, std.dev.: 0.0518) SingleSource/Benchmarks/McGill/chomp: 7.12% (1.0194 => 1.0920, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.11% (0.7609 => 0.7998, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/fp-convert: 4.38% (15.2242 => 15.8913, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/dt: 3.90% (0.9851 => 1.0235, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5369, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.14% (0.8498 => 0.8765, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.02% (0.3508 => 0.3614, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 2.98% (1.4184 => 1.4606, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 2.83% (8.5113 => 8.7524, std.dev.: 0.0356) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.65% (0.5587 => 0.5735, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 2.64% (5.1938 => 5.3309, std.dev.: 0.0493) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.38% (0.5876 => 0.6016, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.24% (4.6127 => 4.7158, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/whetstone: 2.23% (2.3453 => 2.3977, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: 2.18% (14.4877 => 14.8031, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 1.86% (3.5520 => 3.6179, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.4455 => 2.4763, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 1.11% (2.8599 => 2.8916, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 1.01% (2.5166 => 2.5420, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.12% (0.3497 => 0.2059, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0862, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout-C++/ary3: -20.63% (1.7473 => 1.3869, std.dev.: 0.0348) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.48% (1.1647 => 0.9378, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.01% (1.4034 => 1.2770, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -8.99% (62.4126 => 56.8019, std.dev.: 0.0929) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9442, std.dev.: 0.0884) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.18% (3.6254 => 3.3650, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -5.91% (1.4441 => 1.3587, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.4230 => 3.2260, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4097, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -3.56% (9.2503 => 8.9209, std.dev.: 0.0726) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.40% (1.7361 => 1.6771, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.31% (0.4140 => 0.4003, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: -3.15% (1.4117 => 1.3673, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (7.6833 => 7.4511, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -2.80% (3.4286 => 3.3326, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.80% (1.1683 => 1.1356, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.68% (3.7496 => 3.6492, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4235, std.dev.: 0.0143) MultiSource/Benchmarks/PAQ8p/paq8p: -1.83% (92.7467 => 91.0465, std.dev.: 0.1224) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.41% (9.3855 => 9.2533, std.dev.: 0.0461) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.36% (1.8739 => 1.8485, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists: -1.34% (16.5617 => 16.3391, std.dev.: 0.0465) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.05% (0.9980 => 0.9775, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: -0.86% (0.6022 => 0.5970, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: -4.98% (0.1666 => 0.1583, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.29% (0.1554 => 0.1574, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.72% (0.3083 => 0.3030, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.17% (0.2394 => 0.2318, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.25% (0.3175 => 0.3167, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (0.2302 => 0.2273, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -6.67% (0.0090 => 0.0084, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.58% (0.0240 => 0.0181, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.64% (0.0301 => 0.0278, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -7.34% (0.0177 => 0.0164, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -18.52% (0.0189 => 0.0154, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -23.08% (0.0325 => 0.0250, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -3.10% (1.5019 => 1.4554, std.dev.: 0.0345) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.35% (0.4264 => 0.4249, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.42% (0.1344 => 0.1390, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0589 => 0.0598, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0232 => 0.0174, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.26% (0.0639 => 0.0599, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.10% (1.1350 => 1.1475, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.18% (0.0637 => 0.0604, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.72% (0.0246 => 0.0136, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.49% (0.7541 => 0.7804, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.65% (1.5363 => 1.6078, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 17 23:32:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 01:32:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918063255.B2914352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3948?compare_to=3941&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3948, Order: 164091, Start Time: 2012-09-18 03:50:29, End Time: 2012-09-18 06:34:20 To: 3941, Order: 164080, Start Time: 2012-09-18 00:38:25, End Time: 2012-09-18 03:22:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (116 on baseline) Performance Improvements: 6 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 962 (778 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (125.8075 => 129.8757, std.dev.: 0.9467) MultiSource/Benchmarks/Olden/perimeter/perimeter: 2.05% (0.6097 => 0.6222, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.47% (1.0133 => 0.9984, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.41% (2.8946 => 2.8537, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -1.41% (1.7347 => 1.7102, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.20% (2.2055 => 2.1790, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.09% (3.7820 => 3.7409, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.05% (1.3967 => 1.3820, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.49% (0.3488 => 0.3819, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.47% (0.3465 => 0.3793, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.40% (0.3446 => 0.3770, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3469 => 0.3792, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.30% (0.3442 => 0.3762, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.28% (0.3460 => 0.3781, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.15% (0.3650 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3643 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.3724 => 0.4055, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.34% (1.5932 => 1.7102, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (0.4361 => 0.4601, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.42% (1.6211 => 1.7089, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.21% (5.5417 => 5.8305, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (1.3152 => 1.3820, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5826 => 0.6121, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.00% (3.5627 => 3.7409, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 4.98% (0.5889 => 0.6182, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.85% (0.4994 => 0.5236, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1299, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.69% (23.5202 => 24.6225, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (0.5000 => 0.5234, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.56% (2.7292 => 2.8537, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.50% (0.5026 => 0.5252, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.40% (0.3930 => 0.4103, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (4.4195 => 4.6128, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 4.28% (4.2109 => 4.3911, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.25% (0.3625 => 0.3779, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.11% (4.6177 => 4.8076, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2875 => 0.2993, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.09% (0.6634 => 0.6905, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3195 => 0.3324, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.02% (1.8794 => 1.9550, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.93% (0.9909 => 1.0298, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (2.0673 => 2.1481, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.90% (2.1653 => 2.2498, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2823 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2813 => 0.2921, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2911 => 0.3022, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2811 => 0.2917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.77% (0.7171 => 0.7441, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.76% (0.3267 => 0.3390, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.5900 => 0.6122, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 3.76% (1.4269 => 1.4805, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 3.75% (0.4029 => 0.4180, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.73% (0.5546 => 0.5753, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.71% (0.3124 => 0.3240, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.71% (0.3317 => 0.3440, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (2.1013 => 2.1790, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.3096 => 0.3210, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3348 => 0.3471, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.66% (0.2729 => 0.2829, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.60% (0.3477 => 0.3602, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4146 => 0.4294, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.54% (0.6435 => 0.6663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.3678 => 0.3808, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 3.51% (0.4251 => 0.4400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.47% (0.3282 => 0.3396, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (0.4658 => 0.4816, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3690 => 0.3814, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.5012 => 0.5180, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.3271 => 0.3380, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (1.9694 => 2.0349, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 3.17% (0.7875 => 0.8125, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (1.9966 => 2.0599, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 3.17% (2.0346 => 2.0991, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (0.7426 => 0.7660, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.07% (0.3845 => 0.3963, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.96% (0.9697 => 0.9984, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (0.4847 => 0.4985, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (0.5361 => 0.5512, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (0.5584 => 0.5723, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.24% (4.6926 => 4.7975, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (11.6398 => 11.8974, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 8.53% (0.2122 => 0.2303, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6733, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6357, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0464) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5000, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4421, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5993, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5689, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7942, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7947, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7750, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8045, std.dev.: 0.0582) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (16.2163 => 15.9811, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 00:43:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 02:43:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918074334.1492D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3949?compare_to=3946&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3949, Order: 164106, Start Time: 2012-09-18 06:27:16, End Time: 2012-09-18 07:44:57 To: 3946, Order: 164098, Start Time: 2012-09-18 04:44:01, End Time: 2012-09-18 05:58:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (163 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.11% (7.9490 => 8.0376, std.dev.: 0.0179) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.10% (2.0176 => 2.4029, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.55% (0.7710 => 0.8446, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.49% (3.9660 => 4.3422, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 9.19% (1.3693 => 1.4952, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7038 => 0.7683, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9199 => 1.0019, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.89% (0.5265 => 0.5733, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.81% (1.2193 => 1.3267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.79% (0.6959 => 0.7571, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.77% (0.7061 => 0.7680, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5818 => 0.6322, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.59% (0.3899 => 0.4234, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.42% (1.4563 => 1.5789, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.23% (1.1364 => 1.2299, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 8.09% (13.8202 => 14.9377, std.dev.: 0.3408) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.85% (0.6283 => 0.6776, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.76% (0.5577 => 0.6010, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.70% (1.0313 => 1.1107, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.4379 => 0.4712, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.53% (0.4791 => 0.5152, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 7.35% (3.8646 => 4.1485, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.3489 => 0.3744, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.25% (1.9828 => 2.1265, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.23% (7.2180 => 7.7397, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.3756 => 0.4026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8310 => 0.8906, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.17% (0.7506 => 0.8044, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.07% (0.2914 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.97% (0.2726 => 0.2916, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3868 => 0.4136, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.92% (0.7460 => 0.7976, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.2925 => 0.3127, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.85% (3.6692 => 3.9205, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 6.83% (0.2988 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.60% (0.6744 => 0.7189, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.40% (1.3245 => 1.4093, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.36% (3.1889 => 3.3918, std.dev.: 0.0605) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1789 => 0.1901, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.26% (0.3578 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.25% (0.3646 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.21% (0.6135 => 0.6516, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.4003 => 0.4251, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 6.18% (0.3914 => 0.4156, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.17% (16.6129 => 17.6379, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 6.12% (0.3789 => 0.4021, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.08% (0.3601 => 0.3820, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.06% (0.3663 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.04% (0.3940 => 0.4178, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.04% (1.2749 => 1.3519, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.00% (0.3650 => 0.3869, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 5.96% (0.3623 => 0.3839, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.85% (0.6576 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.8698 => 0.9205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.77% (14.8535 => 15.7102, std.dev.: 0.2354) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (1.3819 => 1.4614, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.71% (8.4961 => 8.9811, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4601, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.3801 => 4.6263, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.58% (4.4433 => 4.6913, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.53% (0.8818 => 0.9306, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.2842 => 14.0159, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.42% (1.1333 => 1.1947, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2321 => 0.2438, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.04% (14.5298 => 15.2614, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.72% (3.2742 => 3.4287, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2292 => 1.2864, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.4805 => 0.5023, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.30% (0.9108 => 0.9500, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.13% (4.9865 => 5.1924, std.dev.: 0.0136) MultiSource/Applications/lua/lua: 4.11% (3.7467 => 3.9008, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 4.05% (0.6250 => 0.6503, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.99% (1.5188 => 1.5794, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.68% (6.2785 => 6.5095, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1733, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.08% (33.2944 => 34.3205, std.dev.: 0.0143) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5342, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std.dev.: 0.0389) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.36% (1.2998 => 1.3825, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5989, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.20% (1.4298 => 1.4470, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.16% (7.9275 => 8.0198, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5870, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.89% (22.5627 => 21.6851, std.dev.: 0.0571) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2923, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.91% (1.3780 => 1.2966, std.dev.: 0.0212) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0418) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7058, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -3.48% (3.0263 => 2.9209, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5896, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9070, std.dev.: 0.0319) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2447, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2394, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0606, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2327, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2600, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 00:48:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 02:48:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918074831.A2FB6352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3950?compare_to=3947&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3950, Order: 164108, Start Time: 2012-09-18 06:38:52, End Time: 2012-09-18 07:49:56 To: 3947, Order: 164101, Start Time: 2012-09-18 05:12:02, End Time: 2012-09-18 06:22:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (54 on baseline) Performance Improvements: 0 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.67% (16.1166 => 18.6424, std.dev.: 0.0624) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.36% (3.2945 => 3.7345, std.dev.: 0.0455) MultiSource/Benchmarks/nbench/nbench: 9.92% (21.3050 => 23.4188, std.dev.: 0.4210) SingleSource/Benchmarks/Shootout/heapsort: 7.74% (3.0344 => 3.2692, std.dev.: 0.0548) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (27.0938 => 28.8123, std.dev.: 0.0230) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (2.5282 => 2.5698, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 1.08% (8.3147 => 8.4041, std.dev.: 0.0307) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.63% (0.9775 => 0.9934, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 0.42% (0.5970 => 0.5995, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 2.78% (0.1583 => 0.1627, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.00% (0.1574 => 0.1511, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (0.3030 => 0.3092, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.2318 => 0.2402, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (0.3167 => 0.3199, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.06% (0.2273 => 0.2297, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -0.66% (0.0456 => 0.0453, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-07-VarArgs: 1.16% (0.0086 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 5.95% (0.0084 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 32.60% (0.0181 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.10% (0.0387 => 0.0375, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.83% (0.0278 => 0.0297, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 8.54% (0.0164 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 23.38% (0.0154 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.63% (0.0246 => 0.0242, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 29.20% (0.0250 => 0.0323, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.38% (0.1450 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -7.16% (1.4554 => 1.3512, std.dev.: 0.0601) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.34% (0.1496 => 0.1476, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.62% (0.4249 => 0.4010, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.01% (0.1390 => 0.1404, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.36% (0.0598 => 0.0548, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.29% (0.0174 => 0.0218, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.01% (0.0599 => 0.0617, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1475 => 1.1530, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.75% (0.0604 => 0.0527, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.94% (0.0136 => 0.0174, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7804 => 0.7805, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.10% (1.6078 => 1.6094, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.80% (0.0121 => 0.0068, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.31% (4.1772 => 3.0782, std.dev.: 0.0455) SingleSource/Benchmarks/Shootout-C++/except: 82400.00% (0.0006 => 0.4950, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.95% (0.5309 => 0.5678, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.12% (0.6410 => 0.6802, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 5.78% (2.1763 => 2.3021, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.49% (0.3582 => 0.3743, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.01% (0.6915 => 0.7192, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 3.82% (15.3105 => 15.8947, std.dev.: 0.2028) MultiSource/Applications/minisat/minisat: 3.74% (0.6173 => 0.6404, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 3.58% (1.0046 => 1.0406, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 3.58% (1.1653 => 1.2070, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.7639 => 0.7848, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5150 => 1.5561, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.38% (29.3170 => 30.0153, std.dev.: 0.0546) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6069 => 0.6209, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.25% (1.3268 => 1.3567, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 1.50% (3.0225 => 3.0679, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.19% (12.6413 => 12.7915, std.dev.: 0.0485) MultiSource/Applications/SPASS/SPASS: 1.10% (13.3238 => 13.4701, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.06% (1.2021 => 1.2148, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/Bubblesort: 38.78% (0.0263 => 0.0365, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std.dev.: 0.0207) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.76% (15.8312 => 18.6424, std.dev.: 0.0624) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9962, std.dev.: 0.0228) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3746 => 0.4282, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.52% (0.0917 => 0.1041, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5444, std.dev.: 0.0170) MultiSource/Benchmarks/nbench/nbench: 10.61% (21.1721 => 23.4188, std.dev.: 0.4210) SingleSource/Benchmarks/Stanford/Puzzle: 9.35% (0.1433 => 0.1567, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.98% (0.2694 => 0.2936, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6097, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/chomp: 8.54% (1.0194 => 1.1065, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.41% (0.2857 => 0.3040, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3301 => 0.3505, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (27.1724 => 28.8123, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.15% (0.8498 => 0.8851, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8507, std.dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.67% (3.6023 => 3.7345, std.dev.: 0.0455) SingleSource/Benchmarks/Misc/dt: 3.66% (0.9851 => 1.0212, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.4184 => 1.4651, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.91% (0.5876 => 0.6047, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 2.84% (0.6308 => 0.6487, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 2.44% (8.5113 => 8.7192, std.dev.: 0.0686) MultiSource/Benchmarks/BitBench/five11/five11: 1.73% (5.1938 => 5.2839, std.dev.: 0.0234) MultiSource/Applications/siod/siod: 1.68% (3.5520 => 3.6117, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.68% (4.6127 => 4.6901, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 1.66% (14.4877 => 14.7285, std.dev.: 0.0312) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (2.4455 => 2.4832, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 1.39% (6.9722 => 7.0690, std.dev.: 0.0338) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.15% (4.2815 => 4.2321, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.58% (0.3497 => 0.2043, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.53% (5.2665 => 4.0801, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ary3: -20.62% (1.7473 => 1.3870, std.dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.49% (1.1647 => 0.9377, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -9.15% (62.4126 => 56.7021, std.dev.: 0.0752) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.38% (3.2007 => 2.9324, std.dev.: 0.0279) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.25% (3.6254 => 3.3626, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: -6.91% (3.4230 => 3.1865, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/richards_benchmark: -6.70% (1.4441 => 1.3474, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7919, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: -5.79% (1.4117 => 1.3299, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4074, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.79% (0.4140 => 0.3983, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.19% (1.7361 => 1.6807, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -3.14% (7.6833 => 7.4420, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.99% (1.1683 => 1.1334, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6386, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9787, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8283, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: -2.79% (0.4296 => 0.4176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0097) MultiSource/Applications/aha/aha: -2.63% (3.4286 => 3.3384, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -1.85% (3.4876 => 3.4231, std.dev.: 0.0229) MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (92.7467 => 91.0693, std.dev.: 0.1777) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2254, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -1.50% (8.5323 => 8.4041, std.dev.: 0.0307) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3061, std.dev.: 0.0552) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.10% (2.5984 => 2.5698, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.02% (1.8739 => 1.8548, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.46% (0.9980 => 0.9934, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -0.45% (0.6022 => 0.5995, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -2.34% (0.1666 => 0.1627, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.77% (0.1554 => 0.1511, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3083 => 0.3092, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.33% (0.2394 => 0.2402, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.76% (0.3175 => 0.3199, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.22% (0.2302 => 0.2297, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.85% (0.0390 => 0.0375, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -2.81% (0.0249 => 0.0242, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -10.03% (1.5019 => 1.3512, std.dev.: 0.0601) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.67% (0.1501 => 0.1476, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.96% (0.4264 => 0.4010, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1344 => 0.1404, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.96% (0.0589 => 0.0548, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.03% (0.0232 => 0.0218, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.44% (0.0639 => 0.0617, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.59% (1.1350 => 1.1530, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.27% (0.0637 => 0.0527, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.27% (0.0246 => 0.0174, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.50% (0.7541 => 0.7805, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.76% (1.5363 => 1.6094, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.86% (0.0070 => 0.0068, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 01:39:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 03:39:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918083946.E48B0352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3951?compare_to=3944&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3951, Order: 164108, Start Time: 2012-09-18 07:21:08, End Time: 2012-09-18 08:41:09 To: 3944, Order: 164091, Start Time: 2012-09-18 03:30:21, End Time: 2012-09-18 04:49:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (126 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (723 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.6389 => 56.4453, std.dev.: 0.0906) SingleSource/Regression/C/uint64_to_float: 2.83% (0.5329 => 0.5480, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.01% (1.2120 => 1.1997, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.26% (0.5681 => 0.5696, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 0.03% (15.8273 => 15.8320, std.dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 0.21% (14.6511 => 14.6824, std.dev.: 0.0354) MultiSource/Benchmarks/Bullet/bullet: 0.46% (82.2395 => 82.6183, std.dev.: 0.1015) MultiSource/Benchmarks/MallocBench/gs/gs: 0.18% (4.3002 => 4.3079, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2196 => 1.2189, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.3539 => 7.3642, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.12% (3.6494 => 3.6536, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.46% (0.6319 => 0.6348, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0670 => 0.0648, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.63% (63.2438 => 82.6183, std.dev.: 0.1015) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14248.89% (0.0720 => 10.3312, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.95% (10.3673 => 15.0271, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 25.83% (0.1622 => 0.2041, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.72% (2.2022 => 2.5043, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.99% (7.0540 => 7.9705, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.03% (1.7609 => 1.9552, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3473 => 0.3799, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3516 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.14% (0.3543 => 0.3867, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 9.09% (0.3497 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.07% (0.3561 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3543 => 0.3864, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 8.80% (0.3828 => 0.4165, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.80% (0.3694 => 0.4019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.66% (0.3927 => 0.4267, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.62% (0.3886 => 0.4221, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.56% (0.3282 => 0.3563, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 8.40% (10.4361 => 11.3125, std.dev.: 0.0379) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 7.07% (9.4845 => 10.1547, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.05% (0.4879 => 0.5223, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.34% (5.7591 => 6.1243, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.4615 => 0.4906, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7433 => 0.7897, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2554 => 0.2710, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 6.06% (0.7115 => 0.7546, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.00% (0.2700 => 0.2862, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.98% (0.6675 => 0.7074, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5860 => 0.6207, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (4.2646 => 4.5147, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 5.81% (3.3354 => 3.5292, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.80% (1.3050 => 1.3807, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (8.1363 => 8.6018, std.dev.: 0.0121) SingleSource/UnitTests/ObjC++/Hello: 5.69% (0.5925 => 0.6262, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.5105 => 0.5394, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 5.62% (0.6030 => 0.6369, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.60% (1.5415 => 1.6279, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (0.8172 => 0.8630, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5569 => 0.5875, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.8067 => 0.8510, std.dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 5.39% (0.7835 => 0.8257, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.38% (4.9449 => 5.2107, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (5.0018 => 5.2706, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 5.34% (0.3092 => 0.3257, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.31% (0.1940 => 0.2043, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9765 => 1.0269, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 5.11% (1.1642 => 1.2237, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.93% (0.4299 => 0.4511, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: 4.83% (0.7326 => 0.7680, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.80% (7.9617 => 8.3436, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.77% (1.1861 => 1.2427, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.67% (1.0722 => 1.1223, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.5020 => 0.5253, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 4.64% (3.8723 => 4.0518, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3441 => 0.3599, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 4.38% (1.5603 => 1.6287, std.dev.: 0.0114) MultiSource/Applications/siod/siod: 4.32% (2.2969 => 2.3961, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.27% (0.4103 => 0.4278, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.23% (0.6450 => 0.6723, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.21% (2.0273 => 2.1126, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 4.17% (0.8921 => 0.9293, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.15% (0.5981 => 0.6229, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 4.09% (21.9371 => 22.8351, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.6456 => 0.6715, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.4064 => 0.4224, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3650 => 0.3788, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.66% (1.5859 => 1.6440, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3826 => 0.3962, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.49% (0.2891 => 0.2992, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.4186 => 1.4676, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4636 => 0.4793, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.32% (0.3162 => 0.3267, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4203 => 0.4342, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.26% (0.3098 => 0.3199, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8350, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.4048 => 0.4178, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.2024 => 2.2731, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0665 => 2.1318, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.08% (0.3603 => 0.3714, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.1840 => 1.2189, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.8101 => 0.8288, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3835, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 6.71% (1.1396 => 1.2161, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3617, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 1.29% (2.2771 => 2.3065, std.dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2599, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.28% (5.3855 => 3.8623, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.91% (5.3526 => 3.8587, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0747, std.dev.: 0.0315) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.83% (2.9384 => 2.5909, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.65% (22.1758 => 20.2585, std.dev.: 0.0627) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3098, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.47% (1.5835 => 1.5127, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4127, std.dev.: 0.0162) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (32.5116 => 31.5161, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -3.04% (1.2373 => 1.1997, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -2.88% (10.2830 => 9.9872, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0089, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5114, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5779, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.93% (0.5229 => 0.5696, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 5.62% (14.9895 => 15.8320, std.dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 3.72% (14.1553 => 14.6824, std.dev.: 0.0354) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.1105 => 4.3079, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.33% (1.1048 => 1.2189, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.88% (7.1582 => 7.3642, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.51% (3.4629 => 3.6536, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.6222 => 0.6348, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 02:15:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 04:15:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918091541.D8DC6352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3952?compare_to=3950&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3952, Order: 164109, Start Time: 2012-09-18 08:06:07, End Time: 2012-09-18 09:17:07 To: 3950, Order: 164108, Start Time: 2012-09-18 06:38:52, End Time: 2012-09-18 07:49:56 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 16 (59 on baseline) Performance Improvements: 2 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 883 (794 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5504 => 0.5826, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.74% (0.3046 => 0.3160, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.13% (0.5865 => 0.5990, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.92% (1.3987 => 1.4255, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (4.2769 => 4.3468, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.51% (1.1751 => 1.1929, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.42% (1.8779 => 1.9046, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.0900 => 3.1332, std.dev.: 0.0109) MultiSource/Applications/Burg/burg: 1.03% (1.1579 => 1.1698, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 5.82% (1.7264 => 1.8268, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.36% (21.1250 => 22.0457, std.dev.: 0.1803) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.88% (0.7701 => 0.7923, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.36% (2.2533 => 2.3065, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.24% (59.0002 => 60.3240, std.dev.: 0.2232) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.51% (4.0801 => 4.1417, std.dev.: 0.0096) MultiSource/Applications/lua/lua: 1.01% (29.2203 => 29.5145, std.dev.: 0.0477) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.37% (8.9591 => 8.4776, std.dev.: 0.1164) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.56% (18.6424 => 16.3000, std.dev.: 0.5903) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.56% (0.9934 => 0.9878, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 0.33% (0.5995 => 0.6015, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1627 => 0.1625, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.78% (0.1511 => 0.1553, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.26% (0.3092 => 0.3084, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.50% (0.2402 => 0.2342, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.53% (0.3199 => 0.3182, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2297 => 0.2312, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -10.82% (0.0453 => 0.0404, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.33% (0.0192 => 0.0176, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.60% (0.0375 => 0.0381, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.34% (0.0297 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.07% (0.0281 => 0.0278, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0320 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.12% (0.0178 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0190 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.83% (0.0242 => 0.0244, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -0.31% (0.0323 => 0.0322, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1430 => 0.1434, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 5.99% (1.3512 => 1.4322, std.dev.: 0.0472) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.34% (0.1476 => 0.1540, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.56% (0.4010 => 0.4273, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.42% (0.1404 => 0.1370, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.68% (0.0548 => 0.0612, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.63% (0.0218 => 0.0197, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.76% (0.0617 => 0.0600, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1530 => 1.1536, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.74% (0.0527 => 0.0552, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.34% (0.0174 => 0.0192, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7805 => 0.7807, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.27% (1.6094 => 1.6051, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 76.47% (0.0068 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.66% (4.1772 => 3.1052, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/except: 81850.00% (0.0006 => 0.4917, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.35% (0.1414 => 0.1532, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 6.22% (0.5309 => 0.5639, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 6.16% (2.1763 => 2.3104, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.66% (0.6410 => 0.6773, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.2552 => 0.2673, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.67% (15.3105 => 16.0257, std.dev.: 0.1217) MultiSource/Applications/minisat/minisat: 4.16% (0.6173 => 0.6430, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.6915 => 0.7198, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3582 => 0.3720, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (1.1653 => 1.2090, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 3.52% (1.0046 => 1.0400, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.10% (0.3901 => 0.4022, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.96% (0.7639 => 0.7865, std.dev.: 0.0073) MultiSource/Applications/Burg/burg: 2.26% (1.1440 => 1.1698, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1672 => 1.1929, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.06% (0.6069 => 0.6194, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 2.01% (2.0972 => 2.1394, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.87% (3.0758 => 3.1332, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 1.80% (13.3238 => 13.5637, std.dev.: 0.0859) MultiSource/Applications/d/make_dparser: 1.80% (3.0225 => 3.0769, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.4408 => 1.4601, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.32% (1.8798 => 1.9046, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (2.0317 => 2.0530, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 1.04% (1.0821 => 1.0934, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2298, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 14.34% (0.3746 => 0.4283, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.38% (4.0101 => 4.5465, std.dev.: 0.0275) SingleSource/Benchmarks/Stanford/Puzzle: 13.05% (0.1433 => 0.1620, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.76% (0.2694 => 0.2984, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 8.43% (7.0025 => 7.5925, std.dev.: 0.0489) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.41% (1.0063 => 1.0909, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 7.63% (1.0194 => 1.0972, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.39% (0.3301 => 0.3512, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (27.1724 => 28.8163, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.82% (40.4792 => 42.8341, std.dev.: 0.0377) MultiSource/Benchmarks/Olden/tsp/tsp: 5.41% (1.7330 => 1.8268, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.13% (0.7609 => 0.7923, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 4.06% (15.2242 => 15.8428, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: 3.85% (0.9851 => 1.0230, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8737, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/power/power: 3.36% (1.4184 => 1.4661, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.33% (2.6656 => 2.7544, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 2.99% (8.5113 => 8.7658, std.dev.: 0.0456) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.43% (4.5056 => 4.6153, std.dev.: 0.0373) MultiSource/Benchmarks/BitBench/five11/five11: 2.27% (5.1938 => 5.3117, std.dev.: 0.0326) MultiSource/Benchmarks/Olden/bh/bh: 1.76% (2.5166 => 2.5608, std.dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: 1.66% (14.4877 => 14.7276, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4854, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 1.57% (3.5520 => 3.6077, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.49% (4.0659 => 4.1265, std.dev.: 0.0193) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5341, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.30% (1.2726 => 1.2892, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.08% (2.4013 => 2.4272, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -27.05% (0.0414 => 0.0302, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -5.78% (8.9977 => 8.4776, std.dev.: 0.1164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.63% (0.3497 => 0.2076, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.36% (5.2665 => 4.1417, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: -19.98% (1.7473 => 1.3982, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.42% (1.1647 => 0.9385, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.15% (8.1594 => 7.1679, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.33% (62.4126 => 56.5917, std.dev.: 0.0676) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.31% (3.2007 => 2.9346, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.22% (1.4034 => 1.2881, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3672, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -6.72% (3.4230 => 3.1930, std.dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.69% (2.4457 => 2.3065, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: -5.35% (1.4441 => 1.3668, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: -4.29% (1.4117 => 1.3512, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -3.13% (7.6833 => 7.4428, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: -3.08% (9.2503 => 8.9656, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.00% (1.7361 => 1.6841, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.7496 => 3.6391, std.dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.88% (1.1683 => 1.1347, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2898, std.dev.: 0.0153) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -2.65% (3.4286 => 3.3377, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.25% (2.8964 => 2.8312, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2223, std.dev.: 0.0242) MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (92.7467 => 91.1743, std.dev.: 0.4965) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0926 => 1.0770, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8473, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.39% (61.1734 => 60.3240, std.dev.: 0.2232) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3138, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/lists: -1.25% (16.5617 => 16.3542, std.dev.: 0.0440) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.02% (0.9980 => 0.9878, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: -0.12% (0.6022 => 0.6015, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -2.46% (0.1666 => 0.1625, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1554 => 0.1553, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (0.3083 => 0.3084, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.17% (0.2394 => 0.2342, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.22% (0.3175 => 0.3182, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2302 => 0.2312, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -10.02% (0.0449 => 0.0404, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.33% (0.0192 => 0.0176, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.31% (0.0390 => 0.0381, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1429 => 0.1434, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: -4.64% (1.5019 => 1.4322, std.dev.: 0.0472) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.60% (0.1501 => 0.1540, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.21% (0.4264 => 0.4273, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.93% (0.1344 => 0.1370, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.09% (0.0232 => 0.0197, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0639 => 0.0600, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.64% (1.1350 => 1.1536, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.34% (0.0637 => 0.0552, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.95% (0.0246 => 0.0192, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.53% (0.7541 => 0.7807, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.48% (1.5363 => 1.6051, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 02:26:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 04:26:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918092657.9F1A9352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3953?compare_to=3949&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3953, Order: 164109, Start Time: 2012-09-18 08:13:38, End Time: 2012-09-18 09:28:20 To: 3949, Order: 164106, Start Time: 2012-09-18 06:27:16, End Time: 2012-09-18 07:44:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.80% (2.0176 => 2.3970, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.59% (0.1072 => 0.1207, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.62% (0.7710 => 0.8452, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.56% (3.9660 => 4.3453, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.45% (0.7038 => 0.7703, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.40% (1.3693 => 1.4980, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.04% (0.6959 => 0.7588, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.95% (0.5265 => 0.5736, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.86% (0.9199 => 1.0014, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.5818 => 0.6325, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.69% (1.2193 => 1.3252, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.46% (0.4328 => 0.4694, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.43% (1.4563 => 1.5790, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.40% (0.5748 => 0.6231, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2309, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 8.20% (13.8202 => 14.9528, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.95% (0.7061 => 0.7622, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.89% (0.5577 => 0.6017, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 7.66% (1.0313 => 1.1103, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.60% (1.1061 => 1.1902, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.54% (3.8646 => 4.1559, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.18% (0.5637 => 0.6042, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.18% (0.4791 => 0.5135, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.16% (0.8310 => 0.8905, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2966 => 0.3177, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.09% (0.7460 => 0.7989, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2023 => 0.2165, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.01% (7.2180 => 7.7237, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.00% (1.9828 => 2.1215, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.99% (0.7506 => 0.8031, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.93% (2.1791 => 2.3302, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.93% (3.6692 => 3.9233, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.83% (0.2607 => 0.2785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.82% (0.4016 => 0.4290, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3220 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3107 => 0.3315, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.49% (16.6129 => 17.6914, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.48% (3.1889 => 3.3954, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 6.40% (0.4003 => 0.4259, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.36% (1.9270 => 2.0496, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.30% (1.3819 => 1.4689, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.3245 => 1.4078, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1789 => 0.1901, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 6.23% (0.6744 => 0.7164, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 6.20% (0.3578 => 0.3800, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.17% (0.3940 => 0.4183, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.14% (0.3650 => 0.3874, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.13% (1.3813 => 1.4660, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 6.13% (0.3914 => 0.4154, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.05% (0.3601 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3646 => 0.3866, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (1.2749 => 1.3518, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 6.02% (1.0594 => 1.1232, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.00% (0.8818 => 0.9347, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.93% (0.3623 => 0.3838, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.87% (0.6135 => 0.6495, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.82% (8.4961 => 8.9908, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.3801 => 4.6319, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 5.68% (14.8535 => 15.6978, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.8698 => 0.9192, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.66% (4.4433 => 4.6950, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 5.57% (4.6629 => 4.9226, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.57% (0.6576 => 0.6942, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0083, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (1.1333 => 1.1946, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.22% (0.3755 => 0.3951, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2702, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2321 => 0.2438, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.89% (6.5754 => 6.8967, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.88% (3.2742 => 3.4339, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.41% (0.9108 => 0.9510, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.17% (4.9865 => 5.1943, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.16% (1.5188 => 1.5820, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.05% (3.7467 => 3.8985, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.6250 => 0.6497, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2785 => 6.5106, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.60% (2.1007 => 2.1764, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.03% (33.2944 => 34.3025, std.dev.: 0.0229) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5360, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std.dev.: 0.0464) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.76% (1.1560 => 1.2573, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.98% (0.2093 => 0.2239, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5483, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1074, std.dev.: 0.0392) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6018, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.82% (22.5627 => 21.6998, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2915, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5099, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7058, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: -3.50% (3.0263 => 2.9205, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5999, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.31% (26.5159 => 25.9021, std.dev.: 0.0382) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2381, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2114, std.dev.: 0.0257) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2403, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (4.1080 => 4.0635, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2605, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5631, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4360, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 02:50:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 04:50:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918095017.565513524013@llvm.org> http://llvm.org/perf/db_default/v4/nts/3954?compare_to=3948&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3954, Order: 164108, Start Time: 2012-09-18 07:04:36, End Time: 2012-09-18 09:51:41 To: 3948, Order: 164091, Start Time: 2012-09-18 03:50:29, End Time: 2012-09-18 06:34:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (782 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3488 => 0.3859, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-3: 10.09% (0.3460 => 0.3809, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 10.01% (0.3446 => 0.3791, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3465 => 0.3811, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3469 => 0.3815, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 9.93% (0.3496 => 0.3843, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 9.91% (0.3442 => 0.3783, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/property: 9.78% (0.3650 => 0.4007, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3643 => 0.3996, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 9.37% (0.3724 => 0.4073, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 7.79% (1.5932 => 1.7173, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (1.6211 => 1.7164, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 5.86% (0.5889 => 0.6234, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.82% (1.3152 => 1.3918, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.62% (5.5417 => 5.8533, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7630, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (0.4361 => 0.4605, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (0.4994 => 0.5272, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.32% (2.7292 => 2.8745, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.15% (1.0781 => 1.1336, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 4.87% (0.9909 => 1.0392, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (0.5026 => 0.5268, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.5900 => 0.6173, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 4.50% (4.2109 => 4.4003, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.2736 => 0.2859, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 4.42% (0.3258 => 0.3402, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2750 => 0.2871, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.39% (0.4146 => 0.4328, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (1.8794 => 1.9616, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 4.35% (23.5202 => 24.5437, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.31% (0.3060 => 0.3192, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (0.3890 => 0.4055, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (2.1013 => 2.1903, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 4.23% (2.1653 => 2.2570, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.23% (0.2911 => 0.3034, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.22% (4.6177 => 4.8126, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.2823 => 0.2942, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.20% (1.4269 => 1.4869, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.19% (0.2813 => 0.2931, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3267 => 0.3403, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (4.4195 => 4.6032, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 4.14% (0.4029 => 0.4196, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 4.02% (0.6634 => 0.6901, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0673 => 2.1499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 3.92% (0.2803 => 0.2913, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.4139 => 0.4300, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3625 => 0.3765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (0.4658 => 0.4836, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.80% (0.5546 => 0.5757, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 3.75% (0.3096 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.3271 => 0.3393, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.69% (0.3336 => 0.3459, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3477 => 0.3605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.68% (0.3317 => 0.3439, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.3678 => 0.3812, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.6435 => 0.6665, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3282 => 0.3399, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4251 => 0.4401, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (1.9694 => 2.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3981 => 0.4114, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 3.32% (0.9697 => 1.0019, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (1.9966 => 2.0626, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.5012 => 0.5173, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.17% (0.7875 => 0.8125, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.00% (2.0346 => 2.0957, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (0.7426 => 0.7641, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.72% (0.4847 => 0.4979, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (0.5361 => 0.5497, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (11.6398 => 11.9136, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.34% (4.6926 => 4.8023, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (0.5584 => 0.5713, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.2122 => 0.2270, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8982, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6662, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std.dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5107, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4540, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5909, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5761, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8044, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5784, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9582, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 03:28:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 05:28:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918102824.02316352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3955?compare_to=3951&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3955, Order: 164114, Start Time: 2012-09-18 09:09:49, End Time: 2012-09-18 10:29:47 To: 3951, Order: 164108, Start Time: 2012-09-18 07:21:08, End Time: 2012-09-18 08:41:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (120 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (727 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.8630 => 0.8770, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (78.8490 => 79.8416, std.dev.: 0.3253) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.03% (3.2599 => 3.2262, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5696 => 0.5691, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.02% (15.8320 => 15.8356, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 0.14% (14.6824 => 14.7034, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -0.32% (82.6183 => 82.3561, std.dev.: 0.0310) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.3079 => 4.3074, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2189 => 1.2191, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (7.3642 => 7.3822, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.34% (3.6536 => 3.6661, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.32% (0.6348 => 0.6368, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.22% (63.2438 => 82.3561, std.dev.: 0.0310) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.78% (0.0720 => 10.3304, std.dev.: 0.0120) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.11% (10.3673 => 15.0443, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 24.85% (0.1622 => 0.2025, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.11% (2.2022 => 2.4909, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.05% (7.0540 => 7.9748, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.31% (1.7609 => 1.9425, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.53% (0.3516 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.52% (0.3561 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.49% (0.3497 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3828 => 0.4181, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/parameter-passing: 9.14% (0.3927 => 0.4286, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.08% (0.3886 => 0.4239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.17% (0.3282 => 0.3550, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.48% (10.4361 => 11.2170, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.8172 => 0.8770, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 7.01% (0.1440 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.89% (9.4845 => 10.1384, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7433 => 0.7912, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.42% (0.4879 => 0.5192, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.21% (0.5105 => 0.5422, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (0.4615 => 0.4900, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.16% (0.2271 => 0.2411, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.6675 => 0.7086, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.11% (0.7115 => 0.7550, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.04% (0.2700 => 0.2863, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 6.03% (0.2554 => 0.2708, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (1.5415 => 1.6329, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.89% (0.5860 => 0.6205, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (4.2646 => 4.5127, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 5.77% (5.7591 => 6.0916, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.3050 => 1.3796, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 5.71% (3.3354 => 3.5259, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.64% (8.1363 => 8.5955, std.dev.: 0.0171) SingleSource/UnitTests/ObjC++/Hello: 5.57% (0.5925 => 0.6255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.56% (0.6030 => 0.6365, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5569 => 0.5876, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3121 => 0.3292, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8067 => 0.8500, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (5.0018 => 5.2694, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (0.9765 => 1.0281, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 5.28% (0.7835 => 0.8249, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.27% (4.9449 => 5.2053, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.26% (0.2758 => 0.2903, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 5.21% (0.3092 => 0.3253, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.10% (1.1642 => 1.2236, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.10% (0.5020 => 0.5276, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 4.79% (0.4299 => 0.4505, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7326 => 0.7676, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 4.71% (1.0722 => 1.1227, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.68% (3.8723 => 4.0534, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.65% (1.1861 => 1.2413, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (7.9617 => 8.3162, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.4103 => 0.4282, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.33% (1.5603 => 1.6278, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 4.31% (0.6456 => 0.6734, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (0.6450 => 0.6725, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 4.24% (2.0273 => 2.1133, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 4.23% (2.2969 => 2.3941, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3422 => 0.3564, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4636 => 0.4827, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.11% (0.4064 => 0.4231, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.04% (0.8921 => 0.9281, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.95% (0.5981 => 0.6217, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 3.85% (0.4289 => 0.4454, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 3.84% (21.9371 => 22.7787, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5859 => 1.6464, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.80% (0.3865 => 0.4012, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.4203 => 0.4355, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.59% (0.3650 => 0.3781, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (1.4186 => 1.4685, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3826 => 0.3955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.4048 => 0.4182, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4620 => 0.4772, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.2024 => 2.2747, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8261, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (2.0665 => 2.1322, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1840 => 1.2200, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.8101 => 0.8283, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.43% (2.6778 => 2.9572, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7597, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3525, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (5.2763 => 3.2262, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.35% (5.3855 => 3.8586, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.96% (5.3526 => 3.8561, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1072, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.04% (2.9384 => 2.5847, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -8.67% (22.1758 => 20.2526, std.dev.: 0.0417) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2861, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.45% (1.8329 => 1.7147, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1511, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5060, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4144, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/chomp: -2.95% (1.2373 => 1.2008, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9894, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0133, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4229, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5779, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2286, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.84% (0.5229 => 0.5691, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.64% (14.9895 => 15.8356, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 3.87% (14.1553 => 14.7034, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 4.79% (4.1105 => 4.3074, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.35% (1.1048 => 1.2191, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.13% (7.1582 => 7.3822, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.87% (3.4629 => 3.6661, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.6222 => 0.6368, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 03:42:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 05:42:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918104249.9EE85352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3956?compare_to=3952&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3956, Order: 164114, Start Time: 2012-09-18 09:32:48, End Time: 2012-09-18 10:44:15 To: 3952, Order: 164109, Start Time: 2012-09-18 08:06:07, End Time: 2012-09-18 09:17:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (41 on baseline) Performance Improvements: 4 (33 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (817 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.52% (0.0498 => 0.0645, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: 5.35% (8.4776 => 8.9310, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.45% (0.5426 => 0.5559, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -4.24% (1.8268 => 1.7494, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.20% (0.7923 => 0.7590, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/ffbench: -1.48% (1.3512 => 1.3312, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -1.15% (1.3668 => 1.3511, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.96% (0.9878 => 0.9783, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 0.40% (0.6015 => 0.6039, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 1.54% (0.1625 => 0.1650, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1553 => 0.1554, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.68% (0.3084 => 0.3063, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.85% (0.2342 => 0.2362, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.60% (0.3182 => 0.3163, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.25% (0.2312 => 0.2260, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 10.64% (0.0404 => 0.0447, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -46.59% (0.0088 => 0.0047, std.dev.: 0.0019) SingleSource/UnitTests/2003-08-11-VaListArg: -67.05% (0.0088 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.77% (0.0239 => 0.0230, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.66% (0.0176 => 0.0115, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.05% (0.0381 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.50% (0.0298 => 0.0222, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.44% (0.0278 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0320 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -11.93% (0.0176 => 0.0155, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0244 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.31% (0.0322 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1434 => 0.1440, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.34% (1.4322 => 1.4801, std.dev.: 0.0351) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.44% (0.1540 => 0.1487, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.32% (0.4273 => 0.4003, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.39% (0.1370 => 0.1485, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.49% (0.0612 => 0.0609, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.18% (0.0197 => 0.0221, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.67% (0.0600 => 0.0634, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1536 => 1.1491, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.67% (0.0015 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.36% (0.0552 => 0.0550, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.38% (0.0192 => 0.0210, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7807 => 0.7807, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.03% (1.6051 => 1.6056, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.45% (4.1772 => 3.0724, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/except: 82733.33% (0.0006 => 0.4970, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.14% (0.1414 => 0.1515, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 6.54% (0.5309 => 0.5656, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.37% (0.6410 => 0.6818, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 6.04% (2.1763 => 2.3078, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.28% (0.3582 => 0.3771, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.84% (1.1653 => 1.2101, std.dev.: 0.0123) MultiSource/Applications/minisat/minisat: 3.81% (0.6173 => 0.6408, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.7639 => 0.7856, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.5150 => 1.5580, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6069 => 0.6172, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.30% (1.6538 => 2.3369, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout/ary3: 15.63% (1.7426 => 2.0149, std.dev.: 0.0326) MultiSource/Applications/sgefa/sgefa: 14.44% (0.3746 => 0.4287, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.17% (4.0101 => 4.5384, std.dev.: 0.1219) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.56% (0.0917 => 0.1023, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 9.45% (7.0025 => 7.6639, std.dev.: 0.0274) SingleSource/Benchmarks/McGill/chomp: 8.32% (1.0194 => 1.1042, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.66% (1.0063 => 1.0834, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.56% (0.2857 => 0.3073, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8032, std.dev.: 0.1389) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.49% (15.2242 => 15.9083, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/dt: 3.99% (0.9851 => 1.0244, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (6.6312 => 6.8743, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.47% (0.5587 => 0.5781, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.4184 => 1.4645, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.20% (0.6308 => 0.6510, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 2.89% (5.1938 => 5.3437, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/ReedSolomon: 2.58% (8.5113 => 8.7311, std.dev.: 0.0447) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.09% (2.6656 => 2.7214, std.dev.: 0.0180) MultiSource/Applications/hexxagon/hexxagon: 1.70% (14.4877 => 14.7341, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.69% (4.6127 => 4.6908, std.dev.: 0.0234) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4455 => 2.4847, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 1.53% (3.5520 => 3.6062, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (2.4971 => 2.5327, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.5166 => 2.5473, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.35% (5.2665 => 4.0892, std.dev.: 0.0556) SingleSource/Benchmarks/Shootout-C++/ary3: -20.19% (1.7473 => 1.3945, std.dev.: 0.0460) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.35% (1.1647 => 0.9393, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1635, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/moments: -10.68% (0.1114 => 0.0995, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.46% (62.4126 => 56.5100, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.52% (1.4034 => 1.2839, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.21% (3.6254 => 3.3640, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.54% (2.4457 => 2.2858, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: -6.44% (1.4441 => 1.3511, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: -6.19% (3.4230 => 3.2110, std.dev.: 0.0342) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: -5.70% (1.4117 => 1.3312, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -4.83% (4.6355 => 4.4117, std.dev.: 0.0321) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.44% (1.1683 => 1.1281, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.27% (1.7361 => 1.6794, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -3.19% (7.6833 => 7.4384, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/methcall: -3.16% (9.2503 => 8.9578, std.dev.: 0.0400) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4140 => 0.4017, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -2.81% (3.4286 => 3.3323, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (3.9413 => 3.8319, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/misr: -2.77% (0.4296 => 0.4177, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2869, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.50% (22.3381 => 21.7802, std.dev.: 0.1084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.16% (3.7496 => 3.6685, std.dev.: 0.0165) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.99% (1.2722 => 1.2469, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4184, std.dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2237, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3156, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/neural/neural: -1.36% (1.0926 => 1.0777, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.97% (0.9980 => 0.9783, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 0.28% (0.6022 => 0.6039, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -0.96% (0.1666 => 0.1650, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1554 => 0.1554, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.65% (0.3083 => 0.3063, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.34% (0.2394 => 0.2362, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.38% (0.3175 => 0.3163, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.82% (0.2302 => 0.2260, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -0.45% (0.0449 => 0.0447, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -47.19% (0.0089 => 0.0047, std.dev.: 0.0019) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.17% (0.0240 => 0.0230, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -40.10% (0.0192 => 0.0115, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.25% (0.0301 => 0.0222, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -12.43% (0.0177 => 0.0155, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1429 => 0.1440, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.45% (1.5019 => 1.4801, std.dev.: 0.0351) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.93% (0.1501 => 0.1487, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.12% (0.4264 => 0.4003, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.49% (0.1344 => 0.1485, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.40% (0.0589 => 0.0609, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.74% (0.0232 => 0.0221, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.78% (0.0639 => 0.0634, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.24% (1.1350 => 1.1491, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.63% (0.0246 => 0.0210, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.53% (0.7541 => 0.7807, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.51% (1.5363 => 1.6056, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 04:10:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 06:10:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918111020.5A983352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3957?compare_to=3953&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3957, Order: 164114, Start Time: 2012-09-18 09:56:54, End Time: 2012-09-18 11:11:44 To: 3953, Order: 164109, Start Time: 2012-09-18 08:13:38, End Time: 2012-09-18 09:28:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.52% (7.9438 => 8.0649, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.50% (2.0176 => 2.3909, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.43% (0.7710 => 0.8437, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.38% (1.3693 => 1.4977, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.27% (3.9660 => 4.3338, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 9.26% (0.7038 => 0.7690, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.05% (0.6959 => 0.7589, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5818 => 0.6343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.96% (0.5265 => 0.5737, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7061 => 0.7690, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.90% (0.4328 => 0.4713, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5748 => 0.6253, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.66% (0.9199 => 0.9996, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.51% (1.2193 => 1.3231, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.44% (0.3899 => 0.4228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2655 => 0.2874, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.23% (0.2781 => 0.3010, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.17% (1.4563 => 1.5753, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.01% (0.3022 => 0.3264, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.2914 => 0.3147, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.96% (13.8202 => 14.9198, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.93% (1.1364 => 1.2265, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.79% (0.2760 => 0.2975, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.2966 => 0.3196, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.75% (0.3485 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3580 => 0.3855, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.68% (1.9828 => 2.1351, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2607 => 0.2805, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2726 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.58% (0.2690 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.55% (0.5577 => 0.5998, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.2937 => 0.3156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2765 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.43% (0.6283 => 0.6750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.3756 => 0.4035, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3293 => 0.3537, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2761 => 0.2965, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 7.36% (0.1589 => 0.1706, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4016 => 0.4311, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.31% (1.0313 => 1.1067, std.dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4379 => 0.4698, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.27% (0.3149 => 0.3378, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.26% (1.1061 => 1.1864, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 7.25% (3.8646 => 4.1449, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.15% (0.7506 => 0.8043, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.2127 => 0.2279, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.10% (0.3453 => 0.3698, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.08% (0.8310 => 0.8898, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.03% (0.4791 => 0.5128, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.00% (7.2180 => 7.7230, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5637 => 0.6030, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.94% (0.2995 => 0.3203, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.2925 => 0.3127, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 6.83% (0.3192 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4390 => 0.4688, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 6.78% (0.2243 => 0.2395, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.7460 => 0.7964, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.71% (0.3534 => 0.3771, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.66% (3.6692 => 3.9136, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 6.55% (0.3220 => 0.3431, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 6.54% (2.1791 => 2.3216, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.47% (0.6744 => 0.7180, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 6.29% (1.9270 => 2.0482, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 6.27% (16.6129 => 17.6549, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4075, std.dev.: 0.0072) MultiSource/Applications/d/make_dparser: 6.19% (3.1889 => 3.3862, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.3813 => 1.4658, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.11% (1.3819 => 1.4663, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.00% (0.4003 => 0.4243, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3789 => 0.4015, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.95% (0.3578 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.93% (0.3914 => 0.4146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.92% (0.3663 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.87% (0.6576 => 0.6962, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.81% (1.0594 => 1.1209, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.79% (0.8698 => 0.9202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.70% (0.3755 => 0.3969, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 5.69% (0.4113 => 0.4347, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3623 => 0.3829, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.2749 => 1.3464, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.56% (4.4433 => 4.6903, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 5.54% (14.8535 => 15.6758, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (4.3801 => 4.6215, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.50% (8.4961 => 8.9633, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6135 => 0.6460, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.22% (13.2842 => 13.9771, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.15% (1.1333 => 1.1917, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.10% (0.8818 => 0.9268, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.08% (0.3131 => 0.3290, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.07% (4.6629 => 4.8992, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3245 => 0.3405, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.89% (14.5298 => 15.2396, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2292 => 1.2877, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.69% (6.5754 => 6.8838, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.34% (3.2742 => 3.4164, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6250 => 0.6518, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.17% (4.9865 => 5.1942, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4805 => 0.5001, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.94% (0.9108 => 0.9467, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.85% (3.7467 => 3.8908, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5188 => 1.5770, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (6.2785 => 6.5088, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.1007 => 2.1704, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.12% (33.2944 => 34.3316, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 1.55% (16.2614 => 16.5141, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2627, std.dev.: 0.0191) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.96% (1.0895 => 1.3505, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.02% (0.2093 => 0.2240, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6982, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.29% (1.9199 => 1.9831, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.16% (10.7476 => 11.0867, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5928, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5858, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.99% (0.4657 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.00% (22.5627 => 21.6611, std.dev.: 0.0245) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2601, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.39% (1.3780 => 1.2899, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5125, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9219, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9208, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5988, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.36% (26.5159 => 25.8905, std.dev.: 0.0253) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2446, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2416, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0629, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2374, std.dev.: 0.0193) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 05:08:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 07:08:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918120845.73C3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3958?compare_to=3956&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3958, Order: 164117, Start Time: 2012-09-18 11:00:04, End Time: 2012-09-18 12:10:11 To: 3956, Order: 164114, Start Time: 2012-09-18 09:32:48, End Time: 2012-09-18 10:44:15 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (66 on baseline) Performance Improvements: 1 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (786 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.55% (0.7712 => 0.8140, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.1936 => 0.2043, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.42% (0.4502 => 0.4701, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5712 => 0.5869, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (3.8891 => 3.9545, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.4039 => 1.4272, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (6.2801 => 6.3589, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.1967 => 1.2109, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.2260 => 8.3112, std.dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.80% (21.3180 => 22.3418, std.dev.: 0.1852) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -6.26% (3.2999 => 3.0932, std.dev.: 0.0791) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.93% (0.9783 => 0.9972, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: -0.36% (0.6039 => 0.6017, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 1.45% (0.1650 => 0.1674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.56% (0.3063 => 0.3046, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2362 => 0.2361, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (0.3163 => 0.3174, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (0.2260 => 0.2235, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 1.79% (0.0447 => 0.0455, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 87.23% (0.0047 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 3.45% (0.0029 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.91% (0.0230 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.96% (0.0115 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0385 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.52% (0.0222 => 0.0272, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0282 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0321 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 14.19% (0.0155 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0191 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 1.87% (0.0321 => 0.0327, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1440 => 0.1431, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -0.24% (1.4801 => 1.4765, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.10% (0.1487 => 0.1548, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.02% (0.4003 => 0.4244, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.65% (0.1485 => 0.1416, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.94% (0.0609 => 0.0633, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.19% (0.0221 => 0.0183, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.16% (0.0634 => 0.0635, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1491 => 1.1497, std.dev.: 0.0449) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.75% (0.0016 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0021 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.18% (0.0550 => 0.0595, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.90% (0.0210 => 0.0256, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.7807 => 0.7802, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.09% (1.6056 => 1.6071, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.36% (0.0121 => 0.0077, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.32% (4.1772 => 3.0359, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/except: 82183.33% (0.0006 => 0.4937, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.27% (0.1414 => 0.1531, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.82% (0.6410 => 0.6847, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 6.09% (2.1763 => 2.3089, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.5309 => 0.5622, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.7722 => 0.8140, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.16% (0.3582 => 0.3767, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 4.78% (1.0046 => 1.0526, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.44% (0.6173 => 0.6447, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.2552 => 0.2656, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3.97% (1.1653 => 1.2116, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 3.54% (15.3105 => 15.8531, std.dev.: 0.1038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.5150 => 1.5681, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.74% (1.3268 => 1.3631, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 2.61% (29.3170 => 30.0808, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.1827 => 1.2109, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.7639 => 0.7821, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.28% (0.4596 => 0.4701, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5740 => 0.5869, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.15% (0.7226 => 0.7381, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.14% (0.5937 => 0.6064, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.00% (0.5636 => 0.5749, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (3.8796 => 3.9545, std.dev.: 0.0106) MultiSource/Applications/Burg/burg: 1.90% (1.1440 => 1.1657, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6069 => 0.6182, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 1.68% (3.0225 => 3.0733, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 1.67% (2.0972 => 2.1322, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (6.2546 => 6.3589, std.dev.: 0.0270) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (1.0689 => 1.0856, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (4.0318 => 4.0836, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (8.2186 => 8.3228, std.dev.: 0.0349) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (4.2616 => 4.3080, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.15% (0.0263 => 0.0387, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.75% (0.0766 => 0.0902, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.70% (4.0101 => 4.5595, std.dev.: 0.0717) MultiSource/Applications/sgefa/sgefa: 13.16% (0.3746 => 0.4239, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.22% (1.0063 => 1.1091, std.dev.: 0.0337) SingleSource/Benchmarks/McGill/chomp: 9.62% (1.0194 => 1.1175, std.dev.: 0.0138) SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1433 => 0.1563, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6123, std.dev.: 0.0962) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.98% (0.2857 => 0.3085, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8085, std.dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 5.52% (21.1721 => 22.3418, std.dev.: 0.1852) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.46% (40.4792 => 42.6884, std.dev.: 0.2454) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (0.3301 => 0.3471, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.89% (4.2129 => 4.4189, std.dev.: 0.0311) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8552, std.dev.: 0.0573) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5113 => 8.7555, std.dev.: 0.0388) MultiSource/Benchmarks/BitBench/five11/five11: 2.61% (5.1938 => 5.3294, std.dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/hash: 2.19% (0.6308 => 0.6446, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.13% (0.5876 => 0.6001, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.73% (14.4877 => 14.7387, std.dev.: 0.0430) MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6084, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5308, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.32% (6.9722 => 7.0643, std.dev.: 0.0245) SingleSource/Benchmarks/Dhrystone/dry: 1.05% (2.4013 => 2.4266, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.5166 => 2.5424, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.46% (0.7738 => 0.7548, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.06% (0.3497 => 0.2096, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.43% (5.2665 => 4.0852, std.dev.: 0.0845) SingleSource/Benchmarks/Shootout-C++/ary3: -20.61% (1.7473 => 1.3872, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.34% (1.1647 => 0.9394, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.45% (62.4126 => 56.5135, std.dev.: 0.0783) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9404, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.99% (2.4457 => 2.2504, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.25% (3.6254 => 3.3624, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -6.39% (1.4441 => 1.3518, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -6.32% (3.4230 => 3.2068, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4073, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: -4.36% (1.4117 => 1.3502, std.dev.: 0.0191) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.89% (1.2959 => 1.2455, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6727, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/methcall: -3.24% (9.2503 => 8.9508, std.dev.: 0.0273) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4499, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.81% (1.1683 => 1.1355, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.80% (3.7496 => 3.6445, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/misr: -2.72% (0.4296 => 0.4179, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -2.27% (3.4286 => 3.3507, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.08% (1.0686 => 1.0464, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.00% (61.1734 => 59.9476, std.dev.: 0.2321) SingleSource/Benchmarks/Shootout-C++/hash2: -1.91% (3.4876 => 3.4211, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1508, std.dev.: 0.1870) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2286, std.dev.: 0.0575) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.3569 => 2.3223, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (16.5617 => 16.3298, std.dev.: 0.0260) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3112, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7698, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.30% (1.8739 => 1.8495, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.08% (0.9980 => 0.9972, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: -0.08% (0.6022 => 0.6017, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 0.48% (0.1666 => 0.1674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.20% (0.3083 => 0.3046, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.38% (0.2394 => 0.2361, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.91% (0.2302 => 0.2235, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.63% (0.0301 => 0.0272, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -1.69% (1.5019 => 1.4765, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.13% (0.1501 => 0.1548, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.47% (0.4264 => 0.4244, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.36% (0.1344 => 0.1416, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.47% (0.0589 => 0.0633, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.12% (0.0232 => 0.0183, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.63% (0.0639 => 0.0635, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.1350 => 1.1497, std.dev.: 0.0449) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.0637 => 0.0595, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (0.0246 => 0.0256, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.46% (0.7541 => 0.7802, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.61% (1.5363 => 1.6071, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.00% (0.0070 => 0.0077, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 05:16:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 07:16:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918121633.E6EB62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3959?compare_to=3955&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3959, Order: 164117, Start Time: 2012-09-18 10:58:26, End Time: 2012-09-18 12:17:58 To: 3955, Order: 164114, Start Time: 2012-09-18 09:09:49, End Time: 2012-09-18 10:29:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (119 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (15.0443 => 15.4101, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.09% (1.3090 => 1.2947, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5691 => 0.5699, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 0.03% (15.8356 => 15.8407, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 0.06% (14.7034 => 14.7116, std.dev.: 0.0180) MultiSource/Benchmarks/Bullet/bullet: 0.11% (82.3561 => 82.4502, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/gs/gs: 0.22% (4.3074 => 4.3168, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2191 => 1.2207, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.3822 => 7.3818, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.6661 => 3.6658, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6368 => 0.6372, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.37% (63.2438 => 82.4502, std.dev.: 0.0180) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.36% (0.0720 => 10.3301, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.64% (10.3673 => 15.4101, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 25.15% (0.1622 => 0.2030, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.31% (2.2022 => 2.4954, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.06% (7.0540 => 7.9753, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 12.01% (0.1432 => 0.1604, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.47% (1.7609 => 1.9452, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3497 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.60% (0.3543 => 0.3883, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3561 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.53% (0.3516 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.33% (0.3828 => 0.4185, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.29% (0.3927 => 0.4292, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.08% (0.3886 => 0.4239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.23% (0.3282 => 0.3552, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.77% (10.4361 => 11.2472, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.08% (9.4845 => 10.1559, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.63% (0.3109 => 0.3315, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.43% (0.7433 => 0.7911, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.8172 => 0.8693, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4615 => 0.4908, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 6.30% (0.7115 => 0.7563, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.23% (0.2554 => 0.2713, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.17% (0.6675 => 0.7087, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.15% (0.2700 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (4.2646 => 4.5239, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.5860 => 0.6214, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 5.99% (0.3423 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.92% (1.3050 => 1.3822, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.88% (0.5105 => 0.5405, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (8.1363 => 8.6092, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 5.79% (0.7835 => 0.8289, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.79% (3.3354 => 3.5285, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.79% (5.7591 => 6.0924, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.70% (1.5415 => 1.6294, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5569 => 0.5882, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.57% (0.1940 => 0.2048, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (5.0018 => 5.2773, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.3092 => 0.3262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.8067 => 0.8510, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.44% (0.6030 => 0.6358, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.9449 => 5.2118, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9765 => 1.0290, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.21% (1.1642 => 1.2249, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4299 => 0.4517, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.99% (3.8723 => 4.0654, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.86% (1.0722 => 1.1243, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.82% (1.1861 => 1.2433, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7326 => 0.7675, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (7.9617 => 8.3405, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.74% (0.5020 => 0.5258, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.55% (2.2969 => 2.4013, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 4.40% (1.5603 => 1.6290, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.38% (2.0273 => 2.1161, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.29% (0.4103 => 0.4279, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.4636 => 0.4834, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (0.6450 => 0.6725, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6456 => 0.6729, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8921 => 0.9291, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.15% (0.5981 => 0.6229, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (0.4064 => 0.4228, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.98% (21.9371 => 22.8108, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3422 => 0.3558, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.97% (1.5859 => 1.6488, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.78% (0.4289 => 0.4451, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.4186 => 1.4705, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.53% (0.3650 => 0.3779, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.52% (2.2024 => 2.2800, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.52% (0.4203 => 0.4351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (14.3668 => 14.8453, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4620 => 0.4772, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.18% (0.3935 => 0.4060, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.1840 => 1.2215, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3603 => 0.3716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.99% (2.0665 => 2.1282, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.22% (0.8101 => 0.8281, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.72% (1.2842 => 1.3063, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (4.2280 => 4.3572, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.51% (0.9540 => 0.9684, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7893, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2257, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.86% (5.2763 => 3.2258, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.24% (5.3855 => 3.8648, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.83% (5.3526 => 3.8628, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1144, std.dev.: 0.0270) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.92% (2.9384 => 2.5880, std.dev.: 0.0167) MultiSource/Applications/ClamAV/clamscan: -8.54% (22.1758 => 20.2816, std.dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3003, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7172, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5044, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4256, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9933, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.68% (1.2373 => 1.2042, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.19% (8.1563 => 7.9775, std.dev.: 0.0098) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5777, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.35% (6.2999 => 6.2148, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (0.5229 => 0.5699, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 5.68% (14.9895 => 15.8407, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 3.93% (14.1553 => 14.7116, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/gs/gs: 5.02% (4.1105 => 4.3168, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.49% (1.1048 => 1.2207, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.12% (7.1582 => 7.3818, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.86% (3.4629 => 3.6658, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6222 => 0.6372, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 05:53:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 07:53:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918125322.AE78A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3960?compare_to=3957&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3960, Order: 164117, Start Time: 2012-09-18 11:40:13, End Time: 2012-09-18 12:54:45 To: 3957, Order: 164114, Start Time: 2012-09-18 09:56:54, End Time: 2012-09-18 11:11:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.83% (2.0176 => 2.3975, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 13.56% (0.0826 => 0.0938) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.28% (3.9660 => 4.3341, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 9.26% (0.7038 => 0.7690, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 9.25% (0.7061 => 0.7714, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.11% (1.3693 => 1.4940, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.01% (0.1588 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.98% (0.7710 => 0.8402, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5265 => 0.5725, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5748 => 0.6248, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.67% (0.1327 => 0.1442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.54% (0.9199 => 0.9985, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.44% (0.6959 => 0.7546, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.32% (1.2193 => 1.3208, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.01% (1.1364 => 1.2274, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.88% (13.8202 => 14.9091, std.dev.: 0.0155) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.4563 => 1.5707, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.64% (0.5577 => 0.6003, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.3756 => 0.4035, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.6283 => 0.6749, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.39% (1.0313 => 1.1075, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (0.4379 => 0.4699, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.23% (1.9828 => 2.1261, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.21% (3.8646 => 4.1433, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.19% (1.1061 => 1.1856, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.12% (0.2937 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.08% (0.5637 => 0.6036, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.04% (0.1435 => 0.1536, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (7.2180 => 7.7216, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.94% (0.2925 => 0.3128, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.93% (0.4791 => 0.5123, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.88% (0.2995 => 0.3201, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.87% (0.7506 => 0.8022, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3149 => 0.3363, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 6.75% (0.8310 => 0.8871, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3868 => 0.4128, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.71% (2.1791 => 2.3254, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3453 => 0.3684, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1865 => 0.1988, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.58% (0.3192 => 0.3402, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.57% (3.6692 => 3.9102, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.42% (0.3534 => 0.3761, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.28% (3.1889 => 3.3892, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 6.21% (1.9270 => 2.0467, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.15% (1.0594 => 1.1246, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.04% (1.3245 => 1.4045, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 6.03% (0.6744 => 0.7151, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.03% (16.6129 => 17.6151, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 6.00% (0.4003 => 0.4243, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.91% (0.3940 => 0.4173, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 5.90% (0.3914 => 0.4145, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3578 => 0.3789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 5.81% (0.3789 => 0.4009, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.73% (0.3650 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.71% (0.3623 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.71% (0.3663 => 0.3872, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 5.66% (0.4113 => 0.4346, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.66% (1.3819 => 1.4601, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.61% (1.3813 => 1.4588, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.57% (1.2749 => 1.3459, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 5.51% (8.4961 => 8.9641, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.49% (14.8535 => 15.6690, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6167, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.37% (0.6576 => 0.6929, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.33% (4.4433 => 4.6801, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.6135 => 0.6456, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (13.2842 => 13.9725, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (1.1333 => 1.1916, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.08% (0.3131 => 0.3290, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.04% (4.6629 => 4.8978, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.99% (0.8818 => 0.9258, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.89% (14.5298 => 15.2405, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.87% (0.2504 => 0.2626, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.81% (0.3245 => 0.3401, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (6.5754 => 6.8805, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.2292 => 1.2856, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.42% (3.2742 => 3.4190, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.05% (4.9865 => 5.1883, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4805 => 0.4994, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.90% (0.6250 => 0.6494, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.87% (1.5188 => 1.5776, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (0.9108 => 0.9459, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 3.73% (3.7467 => 3.8865, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2785 => 6.5007, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.38% (2.1007 => 2.1716, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.02% (33.2944 => 34.3005, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.55% (16.2614 => 16.5128, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5115, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6987, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0737, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6028, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.11% (7.9275 => 8.0151, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5933, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.94% (0.4657 => 0.3868, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.06% (22.5627 => 21.6456, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2893, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.71% (1.3780 => 1.2856, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9229, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5860, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9059, std.dev.: 0.0308) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2474, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2448, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0623, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 06:02:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 08:02:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918130245.D39A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3961?compare_to=3954&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3961, Order: 164117, Start Time: 2012-09-18 10:20:15, End Time: 2012-09-18 13:04:10 To: 3954, Order: 164108, Start Time: 2012-09-18 07:04:36, End Time: 2012-09-18 09:51:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.72% (1.7173 => 1.7469, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 2.30% (14.3051 => 14.6341, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.17% (2.0587 => 2.1034, std.dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.87% (0.3465 => 0.3807, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3446 => 0.3781, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.72% (0.3488 => 0.3827, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 9.70% (0.3496 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3469 => 0.3804, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.65% (1.5932 => 1.7469, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3442 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.62% (0.3460 => 0.3793, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 9.40% (0.3650 => 0.3993, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.33% (0.3643 => 0.3983, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 9.21% (0.3724 => 0.4067, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.53% (0.4994 => 0.5320, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.92% (0.4361 => 0.4619, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (1.6211 => 1.7166, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.82% (1.3152 => 1.3917, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (0.5000 => 0.5288, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.75% (0.5826 => 0.6161, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.72% (0.5889 => 0.6226, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (3.5627 => 3.7658, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 5.67% (5.5417 => 5.8560, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.39% (1.0781 => 1.1362, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (2.7292 => 2.8730, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3362 => 0.3538, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 5.02% (23.5202 => 24.7008, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.98% (0.4139 => 0.4345, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.98% (0.3195 => 0.3354, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.90% (0.2875 => 0.3016, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.89% (0.2738 => 0.2872, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.86% (0.3004 => 0.3150, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7171 => 0.7515, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2823 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.70% (4.2109 => 4.4089, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.64% (0.2911 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2750 => 0.2877, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.5900 => 0.6172, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (2.0673 => 2.1621, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.57% (0.2780 => 0.2907, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.56% (4.4195 => 4.6210, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 4.55% (0.2811 => 0.2939, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2714 => 0.2837, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.52% (0.9909 => 1.0357, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 4.51% (0.2725 => 0.2848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.51% (0.3060 => 0.3198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3267 => 0.3414, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (0.3890 => 0.4064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.43% (0.2729 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.42% (0.3258 => 0.3402, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (0.5026 => 0.5248, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3124 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (1.8794 => 1.9615, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.35% (0.5546 => 0.5787, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.3903 => 0.4072, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.33% (0.6634 => 0.6921, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.29% (0.4029 => 0.4202, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 4.28% (0.3317 => 0.3459, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (2.1013 => 2.1911, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 4.27% (2.1653 => 2.2578, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3348 => 0.3491, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3726 => 0.3885, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 4.26% (4.6177 => 4.8146, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (0.3625 => 0.3778, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.3477 => 0.3621, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.10% (0.4146 => 0.4316, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 4.10% (1.4269 => 1.4854, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4251 => 0.4425, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3282 => 0.3416, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.3678 => 0.3827, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.6435 => 0.6692, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.3084 => 0.3205, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.90% (0.9697 => 1.0075, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.87% (0.3981 => 0.4135, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.5012 => 0.5204, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.81% (0.3336 => 0.3463, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.67% (0.3271 => 0.3391, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.65% (1.9966 => 2.0695, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.2969 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.59% (0.3845 => 0.3983, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (1.9694 => 2.0400, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 3.36% (2.0346 => 2.1029, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 3.30% (0.7875 => 0.8135, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.23% (0.7426 => 0.7666, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 3.12% (0.4847 => 0.4998, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (0.5361 => 0.5511, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (0.5584 => 0.5725, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.52% (11.6398 => 11.9326, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.6926 => 4.8100, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.55% (2.5769 => 3.0292, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6766, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1630, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.54% (1.8057 => 1.8876, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6341, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2025, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5056, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4626, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5941, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5400, std.dev.: 0.0248) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7915, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.2402 => 0.2282, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8054, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7581, std.dev.: 0.0633) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5702, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (16.2163 => 15.9542, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 07:31:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 09:31:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918143140.4077B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3962?compare_to=3958&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3962, Order: 164119, Start Time: 2012-09-18 13:21:46, End Time: 2012-09-18 14:33:05 To: 3958, Order: 164117, Start Time: 2012-09-18 11:00:04, End Time: 2012-09-18 12:10:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 5 (5 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (55 on baseline) Performance Improvements: 24 (43 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 861 (788 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vector/build: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -66.67% (0.0009 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/Vector/simple: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/Vector/sumarray: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0005 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.52% (8.5996 => 9.0740, std.dev.: 0.0587) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.85% (0.9394 => 1.1165, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.07% (2.4161 => 2.6836, std.dev.: 0.0287) MultiSource/Benchmarks/Olden/tsp/tsp: 5.66% (1.7388 => 1.8372, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.61% (21.5370 => 22.7442, std.dev.: 0.0614) MultiSource/Benchmarks/FreeBench/distray/distray: 4.95% (0.2487 => 0.2610, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 3.26% (29.3196 => 30.2753, std.dev.: 0.0842) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (56.5135 => 57.6340, std.dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/lists: 1.42% (16.3298 => 16.5617, std.dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.33% (2.2504 => 2.2804, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.03% (1.5919 => 1.6083, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.38% (0.3025 => 0.1622, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.69% (0.0591 => 0.0321, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -22.08% (1.4297 => 1.1140, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.23% (1.4272 => 1.1242, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.27% (0.4701 => 0.4265, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/09-vor/vor: -5.91% (0.3094 => 0.2911, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.15% (0.5869 => 0.5567, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -3.60% (14.7057 => 14.1768, std.dev.: 0.1011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.65% (0.7859 => 0.7651, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: -2.63% (3.9545 => 3.8504, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.90% (0.6064 => 0.5949, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.81% (1.0856 => 1.0660, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.49% (1.2109 => 1.1928, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.46% (8.3112 => 8.1895, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.35% (1.2811 => 1.2638, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.10% (4.3080 => 4.2608, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -17.47% (0.5015 => 0.4139, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.34% (15.7728 => 13.1955, std.dev.: 0.0675) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -11.92% (1.6727 => 1.4733, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/flops: -5.82% (9.2856 => 8.7451, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.78% (1.1210 => 1.1010, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: -1.60% (3.8529 => 3.7912, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: -1.42% (1.1175 => 1.1016, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.31% (2.5424 => 2.5090, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.04% (0.9972 => 0.9769, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.6017 => 0.6014, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 6.03% (0.1674 => 0.1775, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.96% (0.1564 => 0.1549, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.07% (0.3046 => 0.3109, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.80% (0.2361 => 0.2295, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.95% (0.3174 => 0.3144, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (0.2235 => 0.2280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -14.73% (0.0455 => 0.0388, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0008) SingleSource/UnitTests/2003-08-11-VaListArg: 146.67% (0.0030 => 0.0074, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.53% (0.0239 => 0.0221, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.36% (0.0384 => 0.0325, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.03% (0.0272 => 0.0242, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.28% (0.0281 => 0.0224, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.59% (0.0322 => 0.0304, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -21.47% (0.0177 => 0.0139, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -1.05% (0.0191 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 8.94% (0.0246 => 0.0268, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -1.22% (0.0327 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1431 => 0.1439, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -0.56% (1.4765 => 1.4683, std.dev.: 0.0277) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.72% (0.1548 => 0.1621, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.58% (0.4244 => 0.4007, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.55% (0.1416 => 0.1394, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.85% (0.0633 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.37% (0.0183 => 0.0175, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.42% (0.0635 => 0.0626, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1497 => 1.1539, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.59% (0.0595 => 0.0532, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.98% (0.0256 => 0.0169, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (0.7802 => 0.7824, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 66.67% (0.0003 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 6.56% (1.6071 => 1.7126, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.47% (0.0077 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vector/build: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -70.00% (0.0010 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/Vector/simple: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/Vector/sumarray: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0005 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.25% (4.1772 => 3.0807, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0017) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.5309 => 0.5659, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.47% (0.6410 => 0.6825, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 5.86% (2.1763 => 2.3039, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.2552 => 0.2677, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3582 => 0.3738, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 3.85% (0.6915 => 0.7181, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 3.82% (15.3105 => 15.8957, std.dev.: 0.0744) MultiSource/Applications/SIBsim4/SIBsim4: 3.70% (1.1653 => 1.2084, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.42% (1.5150 => 1.5668, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.7639 => 0.7882, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.78% (29.3170 => 30.1311, std.dev.: 0.0805) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.27% (0.6069 => 0.6207, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (6.2546 => 6.3643, std.dev.: 0.0168) MultiSource/Applications/d/make_dparser: 1.68% (3.0225 => 3.0733, std.dev.: 0.0118) MultiSource/Applications/hbd/hbd: 1.55% (1.3268 => 1.3473, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (1.3935 => 1.4086, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0241) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.94% (0.0917 => 0.1054, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.75% (0.0766 => 0.0879, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0583) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.83% (4.0101 => 4.5648, std.dev.: 0.1055) MultiSource/Applications/sgefa/sgefa: 13.32% (0.3746 => 0.4245, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.62% (2.4042 => 2.6836, std.dev.: 0.0287) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.78% (1.0063 => 1.0947, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: 8.41% (7.0025 => 7.5915, std.dev.: 0.0323) SingleSource/Benchmarks/McGill/chomp: 8.06% (1.0194 => 1.1016, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.87% (0.2694 => 0.2906, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.91% (0.3301 => 0.3529, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.37% (0.2857 => 0.3039, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.11% (27.1724 => 28.8321, std.dev.: 0.1483) MultiSource/Benchmarks/Olden/tsp/tsp: 6.01% (1.7330 => 1.8372, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.66% (40.4792 => 42.7686, std.dev.: 0.4137) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.98% (0.8498 => 0.8836, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: 3.84% (0.9851 => 1.0229, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.99% (0.3508 => 0.3613, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.84% (2.6656 => 2.7414, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.83% (0.5876 => 0.6042, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 2.56% (15.2242 => 15.6147, std.dev.: 0.1119) MultiSource/Applications/lua/lua: 2.55% (29.5232 => 30.2753, std.dev.: 0.0842) SingleSource/Benchmarks/Misc/ReedSolomon: 2.44% (8.5113 => 8.7186, std.dev.: 0.0595) MultiSource/Benchmarks/BitBench/five11/five11: 2.43% (5.1938 => 5.3200, std.dev.: 0.0258) MultiSource/Applications/siod/siod: 2.28% (3.5520 => 3.6331, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 1.96% (14.4877 => 14.7711, std.dev.: 0.0631) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.82% (22.3381 => 22.7442, std.dev.: 0.0614) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4856, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.26% (1.2726 => 1.2886, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (2.4971 => 2.5279, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.11% (4.0659 => 4.1112, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.86% (0.2996 => 0.1622, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.69% (0.0591 => 0.0321, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -21.07% (1.4113 => 1.1140, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.77% (1.4189 => 1.1242, std.dev.: 0.0165) MultiSource/Benchmarks/McCat/09-vor/vor: -3.80% (0.3026 => 0.2911, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -2.95% (14.6079 => 14.1768, std.dev.: 0.1011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.54% (5.2665 => 4.0793, std.dev.: 0.0859) MultiSource/Benchmarks/FreeBench/mason/mason: -17.29% (0.5004 => 0.4139, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.65% (15.8312 => 13.1955, std.dev.: 0.0675) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.14% (1.7361 => 1.4733, std.dev.: 0.0312) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1604, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.55% (1.4034 => 1.2834, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -8.40% (9.5474 => 8.7451, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -7.66% (62.4126 => 57.6340, std.dev.: 0.0447) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.14% (3.6254 => 3.3666, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: -6.99% (3.4230 => 3.1839, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.76% (2.4457 => 2.2804, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: -6.61% (1.4441 => 1.3486, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -5.28% (4.6355 => 4.3907, std.dev.: 0.0401) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.14% (1.1647 => 1.1165, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -4.10% (1.4117 => 1.3538, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: -3.69% (7.6833 => 7.3999, std.dev.: 0.0220) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.61% (1.2959 => 1.2491, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.17% (1.2722 => 1.2319, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9786, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8294, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -2.73% (3.4286 => 3.3350, std.dev.: 0.0192) SingleSource/Benchmarks/McGill/misr: -2.63% (0.4296 => 0.4183, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -2.56% (3.8907 => 3.7912, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.06% (1.0686 => 1.0466, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.93% (1.8739 => 1.8377, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.78% (3.7496 => 3.6830, std.dev.: 0.0227) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1489, std.dev.: 0.3825) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2333, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -1.47% (3.8200 => 3.7637, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3073, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.09% (2.3569 => 2.3312, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.11% (0.9980 => 0.9769, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -0.13% (0.6022 => 0.6014, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.1666 => 0.1775, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1554 => 0.1549, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.84% (0.3083 => 0.3109, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.14% (0.2394 => 0.2295, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.98% (0.3175 => 0.3144, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.96% (0.2302 => 0.2280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -13.59% (0.0449 => 0.0388, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0008) SingleSource/UnitTests/2003-08-11-VaListArg: -17.78% (0.0090 => 0.0074, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.92% (0.0240 => 0.0221, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.67% (0.0390 => 0.0325, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.60% (0.0301 => 0.0242, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.13% (0.0284 => 0.0224, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.17% (0.0324 => 0.0304, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -21.47% (0.0177 => 0.0139, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 7.63% (0.0249 => 0.0268, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1429 => 0.1439, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -2.24% (1.5019 => 1.4683, std.dev.: 0.0277) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.99% (0.1501 => 0.1621, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.03% (0.4264 => 0.4007, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.72% (0.1344 => 0.1394, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.19% (0.0589 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.57% (0.0232 => 0.0175, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0639 => 0.0626, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.67% (1.1350 => 1.1539, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.48% (0.0637 => 0.0532, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (0.0246 => 0.0169, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.75% (0.7541 => 0.7824, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.48% (1.5363 => 1.7126, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.71% (0.0070 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 07:46:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 09:46:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918144648.29C212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3963?compare_to=3960&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3963, Order: 164119, Start Time: 2012-09-18 13:33:38, End Time: 2012-09-18 14:48:11 To: 3960, Order: 164117, Start Time: 2012-09-18 11:40:13, End Time: 2012-09-18 12:54:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 8 (164 on baseline) Performance Improvements: 16 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 946 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 5.30% (0.2398 => 0.2525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.94% (5.1883 => 5.2887, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.20% (1.5707 => 1.5895, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_expandfft: 33.61% (0.3645 => 0.4870, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.58% (0.4698 => 0.5853, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 7.38% (2.0881 => 2.2421, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.55% (0.5431 => 0.5624, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.43% (54.5787 => 56.4529, std.dev.: 0.3818) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.29% (0.2517 => 0.1377, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.08% (0.0617 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.96% (1.4601 => 1.1686, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.93% (1.4588 => 1.1680, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -19.59% (0.0730 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -4.64% (0.3014 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.86% (34.3005 => 32.9749, std.dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: -2.98% (15.2405 => 14.7870, std.dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.68% (21.6456 => 21.2816, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.05% (13.9725 => 13.8257, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.37% (0.0995 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -8.94% (0.2182 => 0.1987, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.39% (0.9963 => 0.9526, std.dev.: 0.0034) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.1006 => 27.7419, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3176 => 2.2916, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.68% (2.0176 => 2.4147, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 12.57% (0.2243 => 0.2525, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.78% (1.3693 => 1.5032, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.73% (3.9660 => 4.3517, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.69% (0.7710 => 0.8457, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.22% (0.9199 => 1.0047, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.18% (0.7038 => 0.7684, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.15% (1.4563 => 1.5895, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.04% (1.2193 => 1.3295, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1327 => 0.1446, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.94% (0.6959 => 0.7581, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.92% (0.4328 => 0.4714, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.82% (0.7061 => 0.7684, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.76% (0.5265 => 0.5726, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.57% (1.1364 => 1.2338, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.5818 => 0.6306, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.34% (0.2781 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 8.27% (0.2925 => 0.3167, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.26% (0.3899 => 0.4221, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.24% (0.6283 => 0.6801, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.21% (0.5748 => 0.6220, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.19% (13.8202 => 14.9517, std.dev.: 0.0187) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.11% (0.3022 => 0.3267, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.09% (0.3485 => 0.3767, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.92% (0.2966 => 0.3201, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.88% (0.3756 => 0.4052, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5577 => 0.6016, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.77% (0.3580 => 0.3858, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.75% (0.2995 => 0.3227, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.74% (0.3489 => 0.3759, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.68% (1.9828 => 2.1350, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.66% (1.0313 => 1.1103, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.65% (0.4390 => 0.4726, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.63% (0.2765 => 0.2976, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.59% (0.4016 => 0.4321, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.55% (0.2690 => 0.2893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.53% (0.2988 => 0.3213, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.52% (1.1061 => 1.1893, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3246 => 0.3490, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.49% (0.4379 => 0.4707, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.47% (0.3293 => 0.3539, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2726 => 0.2929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.45% (0.3868 => 0.4156, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.42% (0.2628 => 0.2823, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2761 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.31% (0.3107 => 0.3334, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.31% (0.4791 => 0.5141, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.26% (0.7506 => 0.8051, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8310 => 0.8908, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.18% (0.5637 => 0.6042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.18% (0.3149 => 0.3375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.15% (0.3453 => 0.3700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.05% (0.3534 => 0.3783, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (7.2180 => 7.7202, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.92% (0.3192 => 0.3413, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.7460 => 0.7975, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.87% (3.8646 => 4.1302, std.dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 6.75% (1.0594 => 1.1309, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.65% (2.1791 => 2.3241, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.61% (0.6744 => 0.7190, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.61% (3.1889 => 3.3996, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.55% (0.3220 => 0.3431, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.52% (0.8698 => 0.9265, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 6.48% (16.6129 => 17.6900, std.dev.: 0.0309) MultiSource/Applications/treecc/treecc: 6.40% (1.9270 => 2.0503, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.25% (0.4003 => 0.4253, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.19% (1.3245 => 1.4065, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (1.2749 => 1.3528, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 6.10% (0.3131 => 0.3322, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.07% (3.6692 => 3.8920, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.06% (4.9865 => 5.2887, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 6.00% (14.8535 => 15.7447, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.99% (0.6576 => 0.6970, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (8.4961 => 9.0022, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.95% (0.8818 => 0.9343, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.90% (0.3914 => 0.4145, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.89% (0.3940 => 0.4172, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 5.87% (0.3578 => 0.3788, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.86% (0.3755 => 0.3975, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.78% (0.3789 => 0.4008, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.75% (0.3601 => 0.3808, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.73% (0.3650 => 0.3859, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.70% (0.6135 => 0.6485, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.66% (4.3801 => 4.6279, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (4.4433 => 4.6944, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.36% (4.6629 => 4.9129, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1333 => 1.1900, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.91% (0.4805 => 0.5041, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.91% (3.2742 => 3.4349, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 4.69% (1.2292 => 1.2869, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.64% (0.6250 => 0.6540, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (6.5754 => 6.8640, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.9108 => 0.9507, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.37% (1.5188 => 1.5851, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (13.2842 => 13.8257, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.97% (2.1007 => 2.1841, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 3.87% (3.7467 => 3.8917, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2785 => 6.5075, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.48% (0.3245 => 0.3358, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.32% (16.2614 => 16.6393, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 1.77% (14.5298 => 14.7870, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 33.17% (0.3657 => 0.4870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 23.82% (1.8175 => 2.2505, std.dev.: 0.0545) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.26% (0.4867 => 0.5853, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.63% (12.0921 => 12.6525, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6858, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1038, std.dev.: 0.0241) SingleSource/Regression/C/uint64_to_float: 3.21% (0.5449 => 0.5624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6082, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5994, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.04% (7.9275 => 8.0096, std.dev.: 0.0146) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -48.43% (0.2670 => 0.1377, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -17.03% (0.4657 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -16.97% (0.0707 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.44% (1.3813 => 1.1680, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.44% (1.3819 => 1.1686, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.68% (22.5627 => 21.2816, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.22% (0.2238 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2531, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.81% (1.3780 => 1.2979, std.dev.: 0.0222) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.29% (2.6470 => 2.5071, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7057, std.dev.: 0.0171) MultiSource/Applications/spiff/spiff: -2.91% (3.0263 => 2.9381, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9224, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5908, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7419, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2486, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.61% (26.5159 => 26.0895, std.dev.: 0.0301) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2108, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: -1.18% (4.4810 => 4.4282, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (4.1080 => 4.0638, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2625, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 07:50:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 09:50:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918145037.6D76B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3964?compare_to=3959&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3964, Order: 164119, Start Time: 2012-09-18 13:33:43, End Time: 2012-09-18 14:52:00 To: 3959, Order: 164117, Start Time: 2012-09-18 10:58:26, End Time: 2012-09-18 12:17:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (4 on baseline) New Passes: 1 (2 on baseline) Performance Regressions: 5 (130 on baseline) Performance Improvements: 14 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 19 (17 on baseline) Unchanged Tests: 929 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.3572 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2622 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.68% (3.6658 => 5.7803, std.dev.: 0.0146) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 37.71% (0.2713 => 0.3736, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.32% (0.1182 => 0.1304, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.16% (0.3670 => 0.4630, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 21.18% (0.4713 => 0.5711, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.08% (0.5455 => 0.5623, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -18.92% (0.0851 => 0.0690, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.11% (1.2530 => 1.1389, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.31% (3.8628 => 3.5806, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.06% (3.8648 => 3.5918, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -6.40% (15.4101 => 14.4239, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -4.97% (0.3262 => 0.3100, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.98% (0.4060 => 0.3939, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -2.94% (20.2816 => 19.6857, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.56% (14.8453 => 14.6133, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -21.49% (2.0774 => 1.6310, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.38% (0.0994 => 0.0861, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.56% (0.2196 => 0.1964, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9959 => 0.9620, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: -2.15% (1.3862 => 1.3564) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.40% (0.5699 => 0.5676, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -0.13% (15.8407 => 15.8201, std.dev.: 0.0274) MultiSource/Applications/kimwitu++/kc: -0.12% (14.7116 => 14.6935, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: -29.72% (82.4502 => 57.9500, std.dev.: 0.0244) MultiSource/Benchmarks/MallocBench/gs/gs: -0.60% (4.3168 => 4.2911, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.25% (1.2207 => 1.2177, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (7.3818 => 7.3756, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.21% (0.6372 => 0.6449, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1432 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0649 => 0.0650, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -8.37% (63.2438 => 57.9500, std.dev.: 0.0244) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.92% (3.4629 => 5.7803, std.dev.: 0.0146) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14268.75% (0.0720 => 10.3455, std.dev.: 0.0123) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.28% (0.2554 => 0.3736, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 39.13% (10.3673 => 14.4239, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.91% (0.1125 => 0.1304, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.40% (2.2022 => 2.4974, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.79% (7.0540 => 7.9563, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.29% (1.7609 => 1.9597, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.78% (0.1625 => 0.1784, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.10% (0.3473 => 0.3789, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.3927 => 0.4283, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.95% (0.3543 => 0.3860, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.89% (0.3497 => 0.3808, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 8.53% (0.3694 => 0.4009, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 8.41% (0.3886 => 0.4213, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.39% (0.3828 => 0.4149, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.10% (0.3282 => 0.3548, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.55% (10.4361 => 11.2242, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 7.32% (9.4845 => 10.1785, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: 7.25% (0.1655 => 0.1775, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.3177 => 0.3404, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.14% (0.3180 => 0.3407, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3121 => 0.3339, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8172 => 0.8717, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.25% (0.5860 => 0.6226, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 6.24% (0.3109 => 0.3303, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.23% (5.7591 => 6.1178, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.22% (1.5415 => 1.6374, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.20% (0.4615 => 0.4901, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 6.16% (0.7433 => 0.7891, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 6.14% (0.7115 => 0.7552, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.09% (0.5569 => 0.5908, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.01% (0.5925 => 0.6281, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.92% (0.6030 => 0.6387, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.87% (0.6675 => 0.7067, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.85% (0.7835 => 0.8293, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.67% (1.3050 => 1.3790, std.dev.: 0.0053) MultiSource/Applications/d/make_dparser: 5.64% (3.3354 => 3.5234, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.8067 => 0.8519, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.57% (0.1940 => 0.2048, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.56% (8.1363 => 8.5887, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2700 => 0.2850, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (4.2646 => 4.5010, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.47% (0.9765 => 1.0299, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (5.0018 => 5.2657, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.21% (4.9449 => 5.2025, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.11% (0.7326 => 0.7700, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.5105 => 0.5362, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (7.9617 => 8.3495, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4299 => 0.4507, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.80% (1.1642 => 1.2201, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.79% (1.5603 => 1.6351, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 4.79% (3.8723 => 4.0576, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.68% (0.5020 => 0.5255, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.57% (0.2603 => 0.2722, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.54% (0.2905 => 0.3037, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4636 => 0.4844, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.42% (1.0722 => 1.1196, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.39% (0.3441 => 0.3592, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.24% (0.4103 => 0.4277, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6456 => 0.6729, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1861 => 1.2362, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 4.18% (21.9371 => 22.8546, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.11% (0.3865 => 0.4024, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 4.09% (2.2969 => 2.3909, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3422 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.07% (0.8921 => 0.9284, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1085, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.99% (0.3307 => 0.3439, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.95% (0.5981 => 0.6217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.74% (0.6450 => 0.6691, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.73% (0.3650 => 0.3786, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4203 => 0.4356, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.4048 => 0.4192) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.54% (2.0665 => 2.1397, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.53% (1.5859 => 1.6419, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.4186 => 1.4667, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.35% (0.3162 => 0.3268, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3603 => 0.3722, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.20% (0.3283 => 0.3388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.15% (0.3684 => 0.3800, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.10% (2.2024 => 2.2706, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.4064 => 0.4178, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.75% (1.1840 => 1.2166, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.8101 => 0.8273, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3098, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.74% (1.1194 => 1.1389, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.72% (14.3668 => 14.6133, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.20% (17.1811 => 17.3878, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.71% (0.3683 => 0.4630, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.78% (0.4808 => 0.5711, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3813, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.88% (0.5413 => 0.5623, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2227, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5798, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.63% (5.2763 => 3.2379, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.31% (5.3855 => 3.5918, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.11% (5.3526 => 3.5806, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -14.92% (0.0811 => 0.0690, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1476, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.00% (2.9384 => 2.5858, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -11.23% (22.1758 => 19.6857, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.12% (0.2161 => 0.1964, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2642, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7171, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.87% (5.0483 => 4.8022, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.38% (0.9957 => 0.9620, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5017, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4208, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9993, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0184, std.dev.: 0.0079) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -1.46% (4.6441 => 4.5765, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.06% (2.9346 => 2.9036, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (0.5229 => 0.5676, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.54% (14.9895 => 15.8201, std.dev.: 0.0274) MultiSource/Applications/kimwitu++/kc: 3.80% (14.1553 => 14.6935, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.1105 => 4.2911, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.22% (1.1048 => 1.2177, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.04% (7.1582 => 7.3756, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.65% (0.6222 => 0.6449, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 09:01:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 11:01:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918160117.906B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3965?compare_to=3962&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3965, Order: 164128, Start Time: 2012-09-18 14:52:11, End Time: 2012-09-18 16:02:42 To: 3962, Order: 164119, Start Time: 2012-09-18 13:21:46, End Time: 2012-09-18 14:33:05 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 5 (10 on baseline) Performance Regressions: 20 (44 on baseline) Performance Improvements: 12 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 864 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vector/build: - (0.0005 => 0.0005) SingleSource/UnitTests/Vector/constpool: 233.33% (0.0003 => 0.0010) SingleSource/UnitTests/Vector/simple: - (0.0005 => 0.0005) SingleSource/UnitTests/Vector/sumarray: - (0.0005 => 0.0005) SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0005 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 85.14% (0.1622 => 0.3003, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 84.42% (0.0321 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.95% (1.1140 => 1.4142, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.13% (1.1242 => 1.3955, std.dev.: 0.0190) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1384 => 0.1488, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.90% (0.4265 => 0.4474, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 3.70% (14.1768 => 14.7007, std.dev.: 0.0354) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5567 => 0.5701, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.23% (13.1955 => 15.9973, std.dev.: 0.9872) MultiSource/Benchmarks/FreeBench/mason/mason: 19.55% (0.4139 => 0.4948, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 14.17% (1.4733 => 1.6820, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 6.17% (8.7451 => 9.2844, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.64% (1.3866 => 1.4371, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary3: 3.10% (1.3888 => 1.4319, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.5090 => 2.5499, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1010 => 1.1183, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 1.41% (8.7186 => 8.8415, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/fp-convert: 1.30% (15.6147 => 15.8171, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.28% (1.8377 => 1.8612, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 1.03% (3.7912 => 3.8302, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.17% (0.2032 => 0.1927, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.27% (0.3067 => 0.2936, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.58% (1.5668 => 1.5421, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.54% (4.3060 => 4.2395, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.21% (6.3643 => 6.2876, std.dev.: 0.0277) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -16.02% (1.1165 => 0.9376, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.49% (2.6836 => 2.4022, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.44% (46.5248 => 43.5290, std.dev.: 0.9597) MultiSource/Benchmarks/Olden/tsp/tsp: -5.37% (1.8372 => 1.7385, std.dev.: 0.0323) MultiSource/Applications/lua/lua: -3.59% (30.2753 => 29.1888, std.dev.: 0.2525) MultiSource/Benchmarks/Bullet/bullet: -1.85% (7.1985 => 7.0651, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (57.6340 => 56.5706, std.dev.: 0.1014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.13% (0.9769 => 0.9879, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -0.33% (0.6014 => 0.5994, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -7.66% (0.1775 => 0.1639, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.52% (0.1549 => 0.1557, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.61% (0.3109 => 0.3028, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.14% (0.2295 => 0.2367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.67% (0.3144 => 0.3123, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.44% (0.2280 => 0.2270, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 16.24% (0.0388 => 0.0451, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -59.46% (0.0074 => 0.0030, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.98% (0.0221 => 0.0210, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.92% (0.0325 => 0.0380, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.49% (0.0242 => 0.0294, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 23.21% (0.0224 => 0.0276, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.28% (0.0304 => 0.0317, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 25.90% (0.0139 => 0.0175, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -8.21% (0.0268 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.32% (0.0323 => 0.0238, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.97% (0.1439 => 0.1425, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.61% (1.4683 => 1.5213, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -8.39% (0.1621 => 0.1485, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.57% (0.4007 => 0.4030, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.43% (0.1394 => 0.1388, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.54% (0.0596 => 0.0563, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.43% (0.0175 => 0.0169, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.35% (0.0626 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1539 => 1.1536, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.25% (0.0016 => 0.0011, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0532 => 0.0543, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.83% (0.0169 => 0.0149, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.7824 => 0.7813, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -6.29% (1.7126 => 1.6048, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 132.69% (0.0052 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.55% (4.1772 => 3.0680, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/except: 82700.00% (0.0006 => 0.4968, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.28% (0.0745 => 0.0911, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.5309 => 0.5646, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.05% (0.6410 => 0.6798, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 5.76% (2.1763 => 2.3016, std.dev.: 0.0324) MultiSource/Applications/minisat/minisat: 5.12% (0.6173 => 0.6489, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.2552 => 0.2673, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.6915 => 0.7200, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 3.77% (1.0046 => 1.0425, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 3.66% (15.3105 => 15.8701, std.dev.: 0.2159) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.1653 => 1.2038, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 2.80% (29.3170 => 30.1393, std.dev.: 0.1845) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.5150 => 1.5421, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 1.37% (1.3268 => 1.3450, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.33% (1.6538 => 2.3373, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9963, std.dev.: 0.0335) MultiSource/Applications/sgefa/sgefa: 13.56% (0.3746 => 0.4254, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.24% (4.0101 => 4.5412, std.dev.: 0.0112) SingleSource/Benchmarks/Stanford/Puzzle: 12.35% (0.1433 => 0.1610, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.78% (1.0063 => 1.0947, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.5998, std.dev.: 0.0248) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.43% (0.2694 => 0.2921, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (0.3301 => 0.3528, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 6.87% (1.0194 => 1.0894, std.dev.: 0.0146) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.00% (27.1724 => 28.8034, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/dt: 4.63% (0.9851 => 1.0307, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5421, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 3.89% (15.2242 => 15.8171, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/ReedSolomon: 3.88% (8.5113 => 8.8415, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.47% (21.1721 => 21.9070, std.dev.: 0.2086) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.41% (4.2129 => 4.3565, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 2.92% (5.1938 => 5.3455, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.91% (0.5876 => 0.5988, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.77% (14.4877 => 14.7439, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4857, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 1.46% (3.5520 => 3.6040, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5330, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.33% (6.9722 => 7.0651, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 1.32% (2.5166 => 2.5499, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.36% (0.2080 => 0.1927, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -4.16% (0.7738 => 0.7416, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.65% (0.4596 => 0.4474, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.02% (1.2742 => 1.2612, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.95% (0.3497 => 0.2135, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.37% (5.2665 => 4.0886, std.dev.: 0.2272) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.50% (1.1647 => 0.9376, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -18.05% (1.7473 => 1.4319, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -9.36% (62.4126 => 56.5706, std.dev.: 0.1014) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.78% (3.2007 => 2.9518, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -7.68% (2.4457 => 2.2578, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.12% (3.6254 => 3.3674, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -6.84% (3.4230 => 3.1889, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3507, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: -5.36% (1.4117 => 1.3361, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/fibo: -5.23% (4.6355 => 4.3932, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.62% (0.4140 => 0.3990, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -3.35% (7.6833 => 7.4259, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.12% (1.7361 => 1.6820, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.87% (1.1683 => 1.1348, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8297, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/methcall: -2.78% (9.2503 => 8.9927, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0065) MultiSource/Applications/aha/aha: -2.72% (3.4286 => 3.3354, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.64% (1.2722 => 1.2386, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.63% (3.7496 => 3.6508, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2266, std.dev.: 0.0483) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.55% (3.8907 => 3.8302, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4876 => 3.4342, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3075, std.dev.: 0.0860) MultiSource/Benchmarks/PAQ8p/paq8p: -1.37% (92.7467 => 91.4784, std.dev.: 0.1771) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.01% (0.9980 => 0.9879, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -0.46% (0.6022 => 0.5994, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -1.62% (0.1666 => 0.1639, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1554 => 0.1557, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.78% (0.3083 => 0.3028, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.13% (0.2394 => 0.2367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.64% (0.3175 => 0.3123, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (0.2302 => 0.2270, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0240 => 0.0210, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.56% (0.0390 => 0.0380, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.82% (0.0284 => 0.0276, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.16% (0.0324 => 0.0317, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.77% (0.0325 => 0.0238, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1429 => 0.1425, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.29% (1.5019 => 1.5213, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.07% (0.1501 => 0.1485, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.49% (0.4264 => 0.4030, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.27% (0.1344 => 0.1388, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.41% (0.0589 => 0.0563, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.16% (0.0232 => 0.0169, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.64% (1.1350 => 1.1536, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.43% (0.0246 => 0.0149, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.61% (0.7541 => 0.7813, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.46% (1.5363 => 1.6048, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 09:16:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 11:16:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918161606.2A8EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3966?compare_to=3961&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3966, Order: 164119, Start Time: 2012-09-18 13:33:45, End Time: 2012-09-18 16:17:30 To: 3961, Order: 164117, Start Time: 2012-09-18 10:20:15, End Time: 2012-09-18 13:04:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.01% (16.7581 => 16.9281, std.dev.: 0.0431) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.75% (1.7469 => 1.7164, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.88% (128.7091 => 123.7091, std.dev.: 0.5733) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.72% (0.3488 => 0.3862, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.65% (0.3446 => 0.3813, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3460 => 0.3825, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3465 => 0.3830, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3469 => 0.3832) SingleSource/UnitTests/ObjC/for-in: 10.44% (0.3496 => 0.3861, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.43% (0.3442 => 0.3801, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3643 => 0.4017, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.14% (0.3650 => 0.4020, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.99% (0.3724 => 0.4096, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.73% (1.5932 => 1.7164, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.12% (0.4361 => 0.4628, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (3.5627 => 3.7798, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (1.6211 => 1.7186, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.98% (1.3152 => 1.3938, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (0.4994 => 0.5286, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (0.5000 => 0.5292, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (2.7292 => 2.8869, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.44% (5.5417 => 5.8432, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7171 => 0.7557, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.3004 => 0.3163, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.27% (0.3930 => 0.4137, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (0.5026 => 0.5290, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 5.11% (1.0781 => 1.1332, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.10% (0.3195 => 0.3358, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.2736 => 0.2871, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.88% (0.3362 => 0.3526, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.82% (0.2738 => 0.2870, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2813 => 0.2947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.75% (0.2714 => 0.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.74% (0.2803 => 0.2936, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (2.0673 => 2.1652, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 4.71% (0.2823 => 0.2956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.69% (0.2792 => 0.2923, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3625 => 0.3795, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.3903 => 0.4086, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.69% (4.2109 => 4.4083, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 4.69% (2.1013 => 2.1998, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.67% (0.2911 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.65% (0.2729 => 0.2856, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.64% (23.5202 => 24.6115, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.61% (0.3060 => 0.3201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.59% (0.3096 => 0.3238, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.57% (0.9909 => 1.0362, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3258 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3267 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (4.4195 => 4.6126, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (1.8794 => 1.9614, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.32% (0.3124 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.31% (0.3317 => 0.3460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.3348 => 0.3492, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.24% (4.6177 => 4.8137, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (0.4658 => 0.4854, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.21% (2.1653 => 2.2564, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.4139 => 0.4313, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.17% (0.3477 => 0.3622, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.3845 => 0.4005, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.14% (0.2969 => 0.3092, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3678 => 0.3829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3726 => 0.3878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4251 => 0.4424, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.05% (0.6634 => 0.6903, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3282 => 0.3415, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.92% (1.4269 => 1.4828, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.86% (0.3084 => 0.3203, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (1.9694 => 2.0445, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.79% (0.3981 => 0.4132, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.78% (0.6435 => 0.6678, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.3271 => 0.3393, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (1.9966 => 2.0702, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.62% (0.7875 => 0.8160, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.52% (0.9697 => 1.0038, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.5012 => 0.5186, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.09% (0.4847 => 0.4997, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.04% (2.0346 => 2.0964, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (0.7426 => 0.7628, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (0.5361 => 0.5487, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (0.5584 => 0.5708, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.10% (4.6926 => 4.7912, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (11.6398 => 11.8784, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6786, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std.dev.: 0.1329) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6481, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4595, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5837, std.dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5711, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7974, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8018, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.88% (0.6293 => 0.6175, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -1.80% (17.2379 => 16.9281, std.dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9652, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 09:29:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 11:29:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918162951.1EB8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3967?compare_to=3963&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3967, Order: 164128, Start Time: 2012-09-18 15:16:41, End Time: 2012-09-18 16:31:14 To: 3963, Order: 164119, Start Time: 2012-09-18 13:33:38, End Time: 2012-09-18 14:48:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 16 (166 on baseline) Performance Improvements: 6 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 948 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 83.51% (0.1377 => 0.2527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 78.55% (0.0345 => 0.0616, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.15% (1.1686 => 1.4625, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.06% (1.1680 => 1.4607, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: 24.36% (0.0587 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.15% (0.2874 => 0.3022, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.17% (32.9749 => 34.3511, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 3.39% (14.7870 => 15.2879, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.29% (21.2816 => 21.7698, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.38% (13.8257 => 14.0168, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.43% (0.0862 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 9.91% (0.1987 => 0.2184, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.53% (0.9526 => 0.9958, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: 2.20% (1.3564 => 1.3862, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (27.7419 => 28.1029, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.2916 => 2.3178, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2525 => 0.2393, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.37% (5.2887 => 5.2161, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_expandfft: -24.83% (0.4870 => 0.3661, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -19.80% (0.5853 => 0.4694, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -6.54% (2.2421 => 2.0955, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: -4.09% (0.5624 => 0.5394, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.56% (2.0176 => 2.4122, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.32% (0.1410 => 0.1626, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.76% (0.1588 => 0.1743, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.67% (1.3693 => 1.5017, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.57% (3.9660 => 4.3455, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (0.7710 => 0.8442, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 9.28% (0.7038 => 0.7691, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.94% (0.4328 => 0.4715, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.87% (0.9199 => 1.0015, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.86% (1.2193 => 1.3273, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.81% (0.5265 => 0.5729, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.6959 => 0.7563, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 8.67% (0.4062 => 0.4414, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.58% (0.7061 => 0.7667, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.44% (0.3899 => 0.4228, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.40% (0.5818 => 0.6307, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.35% (1.1364 => 1.2313, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.35% (0.2995 => 0.3245, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.4563 => 1.5777, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.24% (0.6283 => 0.6801, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.21% (0.5748 => 0.6220, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.19% (13.8202 => 14.9522, std.dev.: 0.0161) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.07% (0.3022 => 0.3266, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.94% (0.2782 => 0.3003, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.94% (0.5577 => 0.6020, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.88% (0.3756 => 0.4052, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3580 => 0.3859, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 7.78% (1.0313 => 1.1115, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.75% (0.2760 => 0.2974, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.4791 => 0.5161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.2966 => 0.3195, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.71% (0.3489 => 0.3758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.69% (0.3485 => 0.3753, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.68% (0.4390 => 0.4727, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.61% (1.9828 => 2.1336, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.56% (0.3293 => 0.3542, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2765 => 0.2973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.50% (0.2628 => 0.2825, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4016 => 0.4316, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.46% (0.3246 => 0.3488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2726 => 0.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.38% (3.8646 => 4.1499, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.2988 => 0.3207, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.30% (1.1061 => 1.1869, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 7.24% (0.8310 => 0.8912, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.24% (0.2127 => 0.2281, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.3868 => 0.4146, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.12% (0.3453 => 0.3699, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.11% (0.3149 => 0.3373, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.10% (0.7506 => 0.8039, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.09% (3.6692 => 3.9294, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (7.2180 => 7.7250, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 6.90% (0.3534 => 0.3778, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.80% (0.2925 => 0.3124, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.3220 => 0.3439, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.80% (0.7460 => 0.7967, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 6.72% (2.1791 => 2.3256, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.49% (0.6744 => 0.7182, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 6.48% (3.1889 => 3.3955, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (1.3245 => 1.4100, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.37% (1.0594 => 1.1269, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 6.34% (1.9270 => 2.0491, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 6.33% (16.6129 => 17.6641, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 6.32% (0.4113 => 0.4373, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.14% (0.8698 => 0.9232, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.08% (1.2749 => 1.3524, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.07% (0.6576 => 0.6975, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 5.96% (14.8535 => 15.7386, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.92% (0.8818 => 0.9340, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 5.87% (8.4961 => 8.9944, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3914 => 0.4143, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.3819 => 1.4625, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.83% (0.3755 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.82% (0.4003 => 0.4236, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.81% (0.3663 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.79% (0.3646 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3578 => 0.3785, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.78% (0.3789 => 0.4008, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.75% (1.3813 => 1.4607, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.6135 => 0.6487, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.67% (0.3650 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.67% (0.2504 => 0.2646, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 5.66% (0.3940 => 0.4163, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (4.4433 => 4.6945, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.3801 => 4.6262, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.2842 => 14.0168, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 5.45% (4.6629 => 4.9170, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (1.1333 => 1.1946, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.22% (14.5298 => 15.2879, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.11% (6.5754 => 6.9111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.05% (0.3245 => 0.3409, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.90% (3.2742 => 3.4345, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 4.83% (1.2292 => 1.2886, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.72% (0.6250 => 0.6545, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (4.9865 => 5.2161, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.41% (0.9108 => 0.9510, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.26% (1.5188 => 1.5835, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.02% (3.7467 => 3.8973, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (2.1007 => 2.1816, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.2785 => 6.5032, std.dev.: 0.0151) MultiSource/Benchmarks/Bullet/bullet: 3.17% (33.2944 => 34.3511, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5562, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5195, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.82% (1.8175 => 2.2686, std.dev.: 0.0411) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4161, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0717, std.dev.: 0.0768) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5984, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.17% (1.4298 => 1.4465, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5894, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.01% (7.9275 => 8.0076, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.99% (0.4657 => 0.3866, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.51% (22.5627 => 21.7698, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2883, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.53% (1.3780 => 1.2880, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0170) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9224, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.8259 => 8.5654, std.dev.: 0.0256) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9179, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.26% (26.5159 => 25.9175, std.dev.: 0.0255) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2441, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2352, std.dev.: 0.0342) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2287, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.09% (3.9173 => 3.8745, std.dev.: 0.0137) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4324, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2623, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 10:30:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 12:30:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918173030.8FA492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3968?compare_to=3965&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3968, Order: 164131, Start Time: 2012-09-18 16:19:35, End Time: 2012-09-18 17:31:55 To: 3965, Order: 164128, Start Time: 2012-09-18 14:52:11, End Time: 2012-09-18 16:02:42 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 19 (64 on baseline) Performance Improvements: 1 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 881 (788 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.51% (0.7212 => 0.7465, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.92% (15.8701 => 16.3340, std.dev.: 0.1538) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8369 => 0.8566, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.21% (0.5915 => 0.6046, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.04% (1.0705 => 1.0923, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.7800 => 0.7939, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.2612 => 1.2806, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 23.32% (3.0492 => 3.7603, std.dev.: 0.0739) MultiSource/Benchmarks/Olden/mst/mst: 18.94% (0.1399 => 0.1664, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 9.98% (6.2226 => 6.8437, std.dev.: 0.1765) MultiSource/Benchmarks/Olden/bisort/bisort: 9.24% (0.6566 => 0.7173, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.70% (43.5290 => 46.0118, std.dev.: 0.1644) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.45% (4.5308 => 4.7779, std.dev.: 0.0433) MultiSource/Benchmarks/Olden/tsp/tsp: 5.18% (1.7385 => 1.8285, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (2.4022 => 2.4618, std.dev.: 0.0190) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.23% (39.2185 => 39.6997, std.dev.: 0.1735) MultiSource/Applications/lua/lua: 1.22% (29.1888 => 29.5447, std.dev.: 0.0813) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.09% (2.8220 => 2.8529, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.0894 => 1.1007, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.22% (1.4371 => 1.3477, std.dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.66% (0.9879 => 0.9944, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 0.47% (0.5994 => 0.6022, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: -0.92% (0.1639 => 0.1624, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.53% (0.1557 => 0.1502, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (0.3028 => 0.3088, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2367 => 0.2357, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (0.3123 => 0.3155, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.93% (0.2270 => 0.2249, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -7.32% (0.0451 => 0.0418, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 193.33% (0.0030 => 0.0088, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 13.81% (0.0210 => 0.0239, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.58% (0.0190 => 0.0111, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.11% (0.0380 => 0.0353, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.34% (0.0294 => 0.0295, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.72% (0.0276 => 0.0278, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.89% (0.0317 => 0.0292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 0.57% (0.0175 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -28.57% (0.0189 => 0.0135, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -22.76% (0.0246 => 0.0190, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 14.71% (0.0238 => 0.0273, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1425 => 0.1441, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -5.15% (1.5213 => 1.4429, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1485 => 0.1484, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.07% (0.4030 => 0.4033, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.16% (0.1388 => 0.1418, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.26% (0.0563 => 0.0539, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 50.89% (0.0169 => 0.0255, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.72% (0.0647 => 0.0610, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.62% (1.1536 => 1.1608, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.09% (0.0011 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0543 => 0.0543, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.99% (0.0149 => 0.0222, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.55% (0.7813 => 0.7856, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.25% (1.6048 => 1.6008, std.dev.: 0.0074) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.80% (4.1772 => 3.0996, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/except: 83116.67% (0.0006 => 0.4993, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.5309 => 0.5693, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 6.68% (15.3105 => 16.3340, std.dev.: 0.1538) MultiSource/Applications/minisat/minisat: 6.24% (0.6173 => 0.6558, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 5.86% (2.1763 => 2.3039, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.42% (0.3582 => 0.3776, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.24% (0.6410 => 0.6746, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 4.87% (1.1653 => 1.2220, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (0.6915 => 0.7207, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3217 => 0.3345, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.93% (0.7639 => 0.7939, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.7226 => 0.7465, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.97% (0.3901 => 0.4017, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6069 => 0.6245, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 2.37% (29.3170 => 30.0109, std.dev.: 0.2148) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.0689 => 1.0923, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.11% (0.8569 => 0.8750, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.90% (1.2021 => 1.2249, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 1.83% (3.0225 => 3.0778, std.dev.: 0.0186) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (8.2186 => 8.3361, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.57% (1.6538 => 2.3413, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Bubblesort: 41.44% (0.0263 => 0.0372, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 24.28% (3.0256 => 3.7603, std.dev.: 0.0739) SingleSource/Benchmarks/Shootout-C++/matrix: 22.22% (3.4629 => 4.2323, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/mst/mst: 17.43% (0.1417 => 0.1664, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/ary3: 15.47% (1.7426 => 2.0121, std.dev.: 0.0547) MultiSource/Applications/sgefa/sgefa: 13.85% (0.3746 => 0.4265, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.16% (4.0101 => 4.5380, std.dev.: 0.0413) SingleSource/Benchmarks/Stanford/Puzzle: 12.35% (0.1433 => 0.1610, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.32% (0.0917 => 0.1030, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 11.05% (0.6459 => 0.7173, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 9.95% (6.2244 => 6.8437, std.dev.: 0.1765) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6338, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.23% (1.0063 => 1.0891, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.02% (0.2857 => 0.3086, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.98% (0.2694 => 0.2909, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 7.98% (1.0194 => 1.1007, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.69% (0.3301 => 0.3555, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.13% (27.1724 => 28.8374, std.dev.: 0.1268) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.04% (4.5056 => 4.7779, std.dev.: 0.0433) MultiSource/Benchmarks/Olden/tsp/tsp: 5.51% (1.7330 => 1.8285, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.32% (40.4792 => 42.2281, std.dev.: 0.5766) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 4.15% (8.5113 => 8.8644, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8531, std.dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5386, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.81% (4.2129 => 4.3736, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (6.6312 => 6.8750, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/five11/five11: 3.54% (5.1938 => 5.3778, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash: 3.41% (0.6308 => 0.6523, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 3.34% (1.4184 => 1.4658, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.93% (0.5876 => 0.6048, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.40% (2.4042 => 2.4618, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.17% (2.6656 => 2.7234, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bh/bh: 2.08% (2.5166 => 2.5689, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.99% (38.9255 => 39.6997, std.dev.: 0.1735) MultiSource/Applications/hexxagon/hexxagon: 1.91% (14.4877 => 14.7650, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (2.4455 => 2.4876, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/fldry: 1.64% (2.4971 => 2.5380, std.dev.: 0.0131) MultiSource/Applications/siod/siod: 1.52% (3.5520 => 3.6060, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/em3d/em3d: 1.20% (4.6414 => 4.6972, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (45.4683 => 46.0118, std.dev.: 0.1644) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -5.85% (0.7738 => 0.7285, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.87% (5.2665 => 4.2203, std.dev.: 0.1197) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.35% (1.1647 => 0.9393, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -14.64% (1.7473 => 1.4915, std.dev.: 0.0537) SingleSource/Benchmarks/Shootout/sieve: -12.09% (8.1594 => 7.1726, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -9.25% (62.4126 => 56.6413, std.dev.: 0.0441) SingleSource/Benchmarks/BenchmarkGame/recursive: -8.44% (2.4457 => 2.2393, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.24% (3.2007 => 2.9371, std.dev.: 0.0316) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.22% (1.4034 => 1.2881, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.75% (3.6254 => 3.3806, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3522, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (3.4230 => 3.2160, std.dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -5.13% (4.6355 => 4.3975, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: -4.94% (1.4117 => 1.3420, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.73% (0.4140 => 0.3944, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.88% (1.4021 => 1.3477, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.87% (1.7361 => 1.6689, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9498, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: -2.88% (7.6833 => 7.4620, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.84% (3.7496 => 3.6430, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.80% (1.1683 => 1.1356, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.77% (3.9413 => 3.8323, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -2.73% (3.4286 => 3.3349, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2931, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/misr: -2.40% (0.4296 => 0.4193, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4224, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -1.85% (92.7467 => 91.0284, std.dev.: 0.2375) MultiSource/Benchmarks/FreeBench/neural/neural: -1.83% (1.0926 => 1.0726, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.50% (2.8964 => 2.8529, std.dev.: 0.0075) MultiSource/Benchmarks/sim/sim: -1.45% (3.8907 => 3.8342, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.42% (9.3855 => 9.2518, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: -1.24% (3.8200 => 3.7726, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (25.6658 => 25.3836, std.dev.: 0.0221) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.01% (2.3569 => 2.3331, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.36% (0.9980 => 0.9944, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: - (0.6022 => 0.6022, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: -2.52% (0.1666 => 0.1624, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.35% (0.1554 => 0.1502, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (0.3083 => 0.3088, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.55% (0.2394 => 0.2357, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.63% (0.3175 => 0.3155, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.30% (0.2302 => 0.2249, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -6.90% (0.0449 => 0.0418, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -42.19% (0.0192 => 0.0111, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.49% (0.0390 => 0.0353, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.88% (0.0324 => 0.0292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -28.57% (0.0189 => 0.0135, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -23.69% (0.0249 => 0.0190, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: -16.00% (0.0325 => 0.0273, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1429 => 0.1441, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -3.93% (1.5019 => 1.4429, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.13% (0.1501 => 0.1484, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.42% (0.4264 => 0.4033, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.51% (0.1344 => 0.1418, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.49% (0.0589 => 0.0539, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.91% (0.0232 => 0.0255, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.54% (0.0639 => 0.0610, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.27% (1.1350 => 1.1608, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.76% (0.0246 => 0.0222, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.18% (0.7541 => 0.7856, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.20% (1.5363 => 1.6008, std.dev.: 0.0074) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 11:13:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 13:13:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918181323.7C0D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3969?compare_to=3967&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3969, Order: 164135, Start Time: 2012-09-18 17:00:18, End Time: 2012-09-18 18:14:45 To: 3967, Order: 164128, Start Time: 2012-09-18 15:16:41, End Time: 2012-09-18 16:31:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.29% (2.0176 => 2.4067, std.dev.: 0.0128) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.08% (0.1062 => 0.1169, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.67% (3.9660 => 4.3495, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 9.46% (0.7061 => 0.7729, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.27% (0.7710 => 0.8425, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 9.26% (0.7038 => 0.7690, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.26% (0.1588 => 0.1735, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.04% (1.3693 => 1.4931, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.83% (0.9199 => 1.0011, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.79% (0.5265 => 0.5728, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.78% (0.6959 => 0.7570, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.69% (1.2193 => 1.3253, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4328 => 0.4703, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.42% (1.1364 => 1.2321, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 8.23% (13.8202 => 14.9576, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.4563 => 1.5758, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5577 => 0.6016, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.70% (0.6283 => 0.6767, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.68% (1.0313 => 1.1105, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3246 => 0.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.60% (0.3580 => 0.3852, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.56% (0.4379 => 0.4710, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 7.49% (1.1061 => 1.1889, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.43% (0.7506 => 0.8064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.42% (0.8310 => 0.8927, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2760 => 0.2963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.33% (1.9828 => 2.1281, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.27% (0.3756 => 0.4029, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.24% (7.2180 => 7.7406, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/trivial-interface: 7.24% (0.3578 => 0.3837, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.20% (3.8646 => 4.1430, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/exceptions: 7.18% (0.3914 => 0.4195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.17% (0.4016 => 0.4304, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.12% (0.3650 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.08% (0.3601 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3663 => 0.3920, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.98% (2.1791 => 2.3313, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.81% (0.3453 => 0.3688, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.3220 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.76% (3.6692 => 3.9173, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.65% (0.4390 => 0.4682, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.65% (0.7460 => 0.7956, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.61% (0.6744 => 0.7190, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.49% (3.1889 => 3.3959, std.dev.: 0.0160) MultiSource/Applications/treecc/treecc: 6.45% (1.9270 => 2.0513, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 6.43% (16.6129 => 17.6815, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.34% (1.3245 => 1.4085, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.28% (0.6576 => 0.6989, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1789 => 0.1901, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.15% (1.0594 => 1.1246, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 6.13% (0.4113 => 0.4365, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 6.02% (14.8535 => 15.7480, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (1.2749 => 1.3509, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.91% (0.2945 => 0.3119, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.90% (1.3813 => 1.4628, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.84% (1.3819 => 1.4626, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.81% (4.4433 => 4.7016, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.3801 => 4.6323, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.75% (8.4961 => 8.9849, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.61% (0.6135 => 0.6479, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (13.2842 => 14.0238, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.38% (1.1333 => 1.1943, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.15% (14.5298 => 15.2785, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (6.5754 => 6.9123, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.10% (0.8818 => 0.9268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.74% (3.2742 => 3.4295, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 4.71% (4.6629 => 4.8824, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.2292 => 1.2856, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (4.9865 => 5.2097, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.27% (0.4805 => 0.5010, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.25% (0.9108 => 0.9495, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.18% (1.5188 => 1.5823, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.10% (0.6250 => 0.6506, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.08% (3.7467 => 3.8996, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.79% (2.1007 => 2.1803, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2785 => 6.5107, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 3.31% (33.2944 => 34.3950, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3511 => 0.3615, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.87% (16.2614 => 16.5659, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/fbench: 25.45% (1.8175 => 2.2800, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.83% (1.2998 => 1.3756, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6975, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5466, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.91% (10.7476 => 11.0605, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5941, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.18% (7.9275 => 8.0213, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6002, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.12% (1.4298 => 1.4458, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6874, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.85% (0.4657 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.66% (22.5627 => 21.7361, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2820, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5098, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1499, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5770, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9062, std.dev.: 0.0275) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2450, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2415, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2271, std.dev.: 0.0394) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0624, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2594, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4342, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 11:57:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 13:57:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918185759.3DDFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3970?compare_to=3968&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3970, Order: 164142, Start Time: 2012-09-18 17:47:47, End Time: 2012-09-18 18:59:24 To: 3968, Order: 164131, Start Time: 2012-09-18 16:19:35, End Time: 2012-09-18 17:31:55 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 16 (16 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 13 (53 on baseline) Performance Improvements: 20 (36 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 852 (786 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/spiff/spiff MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Regression/C++/ofstream_ctor MultiSource/Applications/spiff/spiff: 4.19% (0.7285 => 0.7590, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: -0.96% (4.2799 => 4.2389, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: -0.76% (3.9063 => 3.8766, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -0.59% (1.1970 => 1.1899, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (1.0923 => 1.0699, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: -0.60% (0.5693 => 0.5659, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: -1.27% (0.3473 => 0.3429, std.dev.: 0.0105) SingleSource/Regression/C++/ofstream_ctor: -1.28% (0.1952 => 0.1927, std.dev.: 0.0042) New Failures - Execution Time ----------------------------- MultiSource/Applications/spiff/spiff MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Regression/C++/ofstream_ctor MultiSource/Applications/spiff/spiff: -100.00% (2.8830 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -99.98% (0.6099 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -99.87% (0.0766 => 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -100.00% (0.0054 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.99% (1.1203 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -99.97% (0.3640 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -100.00% (0.0006 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -100.00% (0.0006 => 0.0000, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (3.1067 => 3.1986, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5495 => 0.5609, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/queens: 10.33% (1.6373 => 1.8064, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.10% (2.2393 => 2.4206, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/ffbench: 6.71% (1.3420 => 1.4321, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (3.4224 => 3.6449, std.dev.: 0.0207) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (56.6413 => 58.9871, std.dev.: 0.1002) MultiSource/Benchmarks/sim/sim: 4.05% (3.8342 => 3.9895, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (42.2281 => 43.8200, std.dev.: 0.2195) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.14% (1.6689 => 1.7213, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/mason/mason: 2.92% (0.4970 => 0.5115, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.9393 => 0.9587, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.22% (3.6430 => 3.6874, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/minisat/minisat: -2.09% (0.6558 => 0.6421, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -1.01% (1.2220 => 1.2097, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.23% (0.4265 => 0.3317, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -20.17% (0.0575 => 0.0459, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.57% (0.0923 => 0.0807, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.94% (15.3441 => 13.5115, std.dev.: 0.0195) MultiSource/Applications/minisat/minisat: -10.11% (6.8437 => 6.1520, std.dev.: 0.0578) SingleSource/Benchmarks/McGill/chomp: -7.56% (1.1007 => 1.0175, std.dev.: 0.0309) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.30% (1.9983 => 1.8725, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/fib2: -5.51% (4.4291 => 4.1849, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.89% (28.8374 => 27.4277, std.dev.: 0.0830) MultiSource/Benchmarks/FreeBench/distray/distray: -4.85% (0.2640 => 0.2512, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: -3.24% (5.3778 => 5.2035, std.dev.: 0.0381) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (2.5380 => 2.4654, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/bh/bh: -2.46% (2.5689 => 2.5058, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: -2.39% (1.4658 => 1.4308, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: -2.03% (0.5924 => 0.5804, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: -1.53% (4.3975 => 4.3301, std.dev.: 0.0125) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.51% (1.2464 => 1.2276, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.39% (7.4620 => 7.3586, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.37% (0.9944 => 0.9981, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -0.07% (0.6022 => 0.6018, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -1.11% (0.1624 => 0.1606, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.00% (0.1502 => 0.1532, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.91% (0.3088 => 0.3116, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2357 => 0.2354, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.81% (0.3155 => 0.3212, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.84% (0.2249 => 0.2268, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: -7.42% (0.0418 => 0.0387, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: -7.95% (0.0088 => 0.0081, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: -67.05% (0.0088 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -29.71% (0.0239 => 0.0168, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 64.86% (0.0111 => 0.0183, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.78% (0.0353 => 0.0322, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.75% (0.0295 => 0.0222, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.08% (0.0278 => 0.0281, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.93% (0.0292 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0176 => 0.0176, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 41.48% (0.0135 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 32.11% (0.0190 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -3.30% (0.0273 => 0.0264, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1441 => 0.1424, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.53% (1.4429 => 1.4650, std.dev.: 0.0168) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.96% (0.1484 => 0.1440, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.51% (0.4033 => 0.4215, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1418 => 0.1450, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.80% (0.0539 => 0.0608, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.78% (0.0255 => 0.0257, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.66% (0.0610 => 0.0606, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.92% (1.1608 => 1.1269, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 20.00% (0.0005 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.84% (0.0543 => 0.0553, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.58% (0.0222 => 0.0163, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.15% (0.7856 => 0.7687, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.04% (1.6008 => 1.6002, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.40% (0.0121 => 0.0106, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/spiff/spiff MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Regression/C++/ofstream_ctor MultiSource/Applications/spiff/spiff: -1.91% (0.7738 => 0.7590, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: -0.53% (4.2616 => 4.2389, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (3.8796 => 3.8766, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 0.61% (1.1827 => 1.1899, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 0.09% (1.0689 => 1.0699, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.5309 => 0.5659, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 0.32% (0.3418 => 0.3429, std.dev.: 0.0105) SingleSource/Regression/C++/ofstream_ctor: -0.98% (0.1946 => 0.1927, std.dev.: 0.0042) New Failures - Execution Time ----------------------------- MultiSource/Applications/spiff/spiff MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Regression/C++/ofstream_ctor MultiSource/Applications/spiff/spiff: -100.00% (2.8599 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -99.98% (0.6119 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -99.87% (0.0743 => 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -100.00% (0.0065 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.99% (1.1116 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -99.97% (0.3591 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -100.00% (0.0006 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -100.00% (0.0006 => 0.0000, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.45% (4.1772 => 3.1141, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/except: 82916.67% (0.0006 => 0.4981, std.dev.: 0.0048) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.72% (0.0745 => 0.0877, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 6.94% (2.1763 => 2.3274, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.85% (0.6410 => 0.6785, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.25% (0.4248 => 0.4471, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.2552 => 0.2678, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.55% (0.3582 => 0.3745, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 4.02% (0.6173 => 0.6421, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (3.0758 => 3.1986, std.dev.: 0.0299) MultiSource/Applications/lambda-0_1_3/lambda: 3.99% (0.6915 => 0.7191, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 3.97% (15.3105 => 15.9180, std.dev.: 0.2022) MultiSource/Applications/lemon/lemon: 3.92% (1.0046 => 1.0440, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.1653 => 1.2097, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.7639 => 0.7893, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.14% (0.3217 => 0.3318, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (1.5150 => 1.5566, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.60% (0.6069 => 0.6227, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.43% (29.3170 => 30.0290, std.dev.: 0.2004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.7226 => 0.7389, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.00% (1.2021 => 1.2262, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.57% (6.2546 => 6.3530, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 1.25% (3.5980 => 3.6429, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.30% (1.6538 => 2.3369, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 21.85% (3.4629 => 4.2197, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/ary3: 15.18% (1.7426 => 2.0072, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.10% (4.0101 => 4.5755, std.dev.: 0.1412) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.52% (0.0917 => 0.1041, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 11.58% (0.1433 => 0.1599, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.84% (0.2694 => 0.2986, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.49% (0.2857 => 0.3128, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.60% (7.0025 => 7.6049, std.dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.38% (1.0063 => 1.0906, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.25% (40.4792 => 43.8200, std.dev.: 0.2195) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.76% (0.3301 => 0.3557, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 4.51% (3.4876 => 3.6449, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/fp-convert: 4.36% (15.2242 => 15.8885, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 4.14% (8.5113 => 8.8640, std.dev.: 0.0846) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (6.6312 => 6.8713, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.40% (2.4042 => 2.4860, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.30% (0.5876 => 0.6070, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.14% (2.6656 => 2.7493, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8887, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: 2.54% (3.8907 => 3.9895, std.dev.: 0.0156) MultiSource/Applications/siod/siod: 2.48% (3.5520 => 3.6401, std.dev.: 0.0264) MultiSource/Benchmarks/FreeBench/mason/mason: 2.22% (0.5004 => 0.5115, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.89% (4.6127 => 4.7001, std.dev.: 0.0229) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.73% (38.9255 => 39.5984, std.dev.: 0.0691) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.47% (4.0659 => 4.1257, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/ffbench: 1.45% (1.4117 => 1.4321, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4455 => 2.4785, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.28% (0.5740 => 0.5609, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.01% (0.3497 => 0.2063, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.18% (5.2665 => 4.0982, std.dev.: 0.1404) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.69% (1.1647 => 0.9587, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.65% (15.8312 => 13.5115, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.00% (0.0917 => 0.0807, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -11.45% (0.3746 => 0.3317, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.85% (1.4034 => 1.2792, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3763, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: -6.75% (3.4230 => 3.1919, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3301, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -5.92% (1.4441 => 1.3586, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7969, std.dev.: 0.0191) MultiSource/Benchmarks/FreeBench/distray/distray: -5.71% (0.2664 => 0.2512, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.49% (62.4126 => 58.9871, std.dev.: 0.1002) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1849, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.23% (7.6833 => 7.3586, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -3.86% (9.2503 => 8.8934, std.dev.: 0.0616) SingleSource/Benchmarks/McGill/misr: -3.75% (0.4296 => 0.4135, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.51% (1.2722 => 1.2276, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.68% (3.9413 => 3.8355, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2920, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.29% (1.1683 => 1.1415, std.dev.: 0.0089) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3630, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3147, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.66% (3.7496 => 3.6874, std.dev.: 0.0140) MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (92.7467 => 91.2119, std.dev.: 0.1356) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2357, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.8964 => 2.8542, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0505) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.01% (0.9980 => 0.9981, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -0.07% (0.6022 => 0.6018, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -3.60% (0.1666 => 0.1606, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.42% (0.1554 => 0.1532, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (0.3083 => 0.3116, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.67% (0.2394 => 0.2354, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (0.3175 => 0.3212, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (0.2302 => 0.2268, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: -13.81% (0.0449 => 0.0387, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: -8.99% (0.0089 => 0.0081, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -30.00% (0.0240 => 0.0168, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.69% (0.0192 => 0.0183, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.44% (0.0390 => 0.0322, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.25% (0.0301 => 0.0222, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -18.77% (0.0325 => 0.0264, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.46% (1.5019 => 1.4650, std.dev.: 0.0168) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.06% (0.1501 => 0.1440, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.15% (0.4264 => 0.4215, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.1344 => 0.1450, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.23% (0.0589 => 0.0608, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.78% (0.0232 => 0.0257, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.16% (0.0639 => 0.0606, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1350 => 1.1269, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0024 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.19% (0.0637 => 0.0553, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.74% (0.0246 => 0.0163, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.94% (0.7541 => 0.7687, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.16% (1.5363 => 1.6002, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.43% (0.0070 => 0.0106, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 12:29:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 14:29:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918192908.606112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3971?compare_to=3966&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3971, Order: 164131, Start Time: 2012-09-18 16:46:15, End Time: 2012-09-18 19:30:32 To: 3966, Order: 164119, Start Time: 2012-09-18 13:33:45, End Time: 2012-09-18 16:17:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (2.0806 => 2.1094, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.20% (0.3446 => 0.3832, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 11.14% (0.3465 => 0.3851, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 11.07% (0.3460 => 0.3843, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.07% (0.3488 => 0.3874, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3496 => 0.3882, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.01% (0.3442 => 0.3821, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3469 => 0.3849, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.71% (0.3650 => 0.4041, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.62% (0.3643 => 0.4030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3724 => 0.4111, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.99% (1.5932 => 1.7046, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5826 => 0.6206, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.35% (0.5889 => 0.6263, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.27% (1.6211 => 1.7228, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (3.5627 => 3.7850, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.12% (0.4361 => 0.4628, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.05% (1.3152 => 1.3948, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.92% (2.7292 => 2.8907, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.2014 => 0.2129, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.63% (0.3004 => 0.3173, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 5.60% (1.0781 => 1.1385, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2738 => 0.2888, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.45% (5.5417 => 5.8439, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2875 => 0.3030, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.5900 => 0.6215, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (0.3930 => 0.4138, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (0.5026 => 0.5289, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.18% (0.5000 => 0.5259, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 5.08% (0.7171 => 0.7535, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 4.96% (0.2803 => 0.2942, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.95% (4.2109 => 4.4194, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3195 => 0.3352, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.87% (0.2566 => 0.2691, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.2736 => 0.2869, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 4.84% (0.2811 => 0.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2823 => 0.2959, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.78% (23.5202 => 24.6451, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/fibo: 4.77% (0.2725 => 0.2855, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.75% (0.2714 => 0.2843, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.72% (2.1013 => 2.2005, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.69% (0.2792 => 0.2923, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.69% (0.2729 => 0.2857, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.68% (0.9909 => 1.0373, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3060 => 0.3203, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.64% (0.2911 => 0.3046, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.63% (4.6177 => 4.8313, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.60% (2.0673 => 2.1623, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (1.8794 => 1.9656, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 4.59% (0.3096 => 0.3238, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (0.3890 => 0.4068, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (4.4195 => 4.6217, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 4.56% (0.3267 => 0.3416, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.4139 => 0.4326, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3258 => 0.3405, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.3903 => 0.4077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3124 => 0.3262, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (2.1653 => 2.2602, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 4.37% (0.3317 => 0.3462, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.33% (0.3348 => 0.3493, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3625 => 0.3781, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 4.26% (0.3477 => 0.3625, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 4.25% (0.6634 => 0.6916, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (1.9694 => 2.0530, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 4.24% (0.3726 => 0.3884, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.20% (1.4269 => 1.4869, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.20% (0.5546 => 0.5779, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 4.20% (0.4146 => 0.4320, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.13% (0.3678 => 0.3830, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3282 => 0.3416, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (0.4658 => 0.4845, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4251 => 0.4419, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.2969 => 0.3084, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.86% (0.7875 => 0.8179, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (1.9966 => 2.0734, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.79% (0.3981 => 0.4132, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.70% (0.3271 => 0.3392, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.61% (0.6435 => 0.6667, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.3084 => 0.3194, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.43% (0.5012 => 0.5184, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.38% (0.9697 => 1.0025, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 3.15% (2.0346 => 2.0986, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 2.72% (0.4847 => 0.4979, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (0.7426 => 0.7623, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (0.5361 => 0.5483, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (11.6398 => 11.8758, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (0.5584 => 0.5695, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.95% (4.6926 => 4.7843, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.15% (0.2162 => 0.3549, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6664, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6350, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2021, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5033, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4399, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.43% (1.0142 => 1.0287, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2859, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (2.0820 => 2.1094, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5958, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5523, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/ary2: -9.12% (0.2402 => 0.2183, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7946, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7931, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (17.2379 => 16.8386, std.dev.: 0.0235) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.26% (0.6293 => 0.6151, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5687, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9551, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 12:56:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 14:56:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918195656.D06EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3972?compare_to=3969&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3972, Order: 164150, Start Time: 2012-09-18 18:43:44, End Time: 2012-09-18 19:58:18 To: 3969, Order: 164135, Start Time: 2012-09-18 17:00:18, End Time: 2012-09-18 18:14:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.46% (54.5688 => 56.4584, std.dev.: 0.0826) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.21% (2.2800 => 2.2525, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.60% (2.0176 => 2.4131, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.66% (0.1072 => 0.1197, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.70% (3.9660 => 4.3509, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.70% (0.7710 => 0.8458, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 9.60% (0.7061 => 0.7739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.41% (0.7038 => 0.7700, std.dev.: 0.0162) SingleSource/UnitTests/ObjC++/property-reference-object: 9.26% (0.5818 => 0.6357, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.19% (1.3693 => 1.4951, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.06% (0.4328 => 0.4720, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.88% (0.9199 => 1.0016, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.87% (0.6959 => 0.7576, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.79% (0.5265 => 0.5728, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.78% (1.2193 => 1.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.69% (0.4062 => 0.4415, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.4563 => 1.5777, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.33% (1.1364 => 1.2311, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.23% (13.8202 => 14.9573, std.dev.: 0.0126) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.13% (0.6283 => 0.6794, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.08% (0.3899 => 0.4214, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.91% (0.5577 => 0.6018, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.79% (0.4390 => 0.4732, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.77% (0.3489 => 0.3760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3580 => 0.3855, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.4791 => 0.5159, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.65% (1.0313 => 1.1102, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.52% (1.9828 => 2.1320, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 7.48% (0.2726 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.47% (0.2690 => 0.2891, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3756 => 0.4036, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2966 => 0.3187, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.44% (0.3293 => 0.3538, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.42% (0.2937 => 0.3155, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 7.40% (1.1061 => 1.1880, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4016 => 0.4311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.22% (0.5637 => 0.6044, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.18% (0.7506 => 0.8045, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.15% (7.2180 => 7.7342, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 7.14% (3.8646 => 4.1404, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 7.14% (0.3868 => 0.4144, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.00% (3.6692 => 3.9260, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 6.96% (0.8310 => 0.8888, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.2925 => 0.3127, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.87% (0.2243 => 0.2397, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (0.7460 => 0.7970, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3534 => 0.3774, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.73% (0.6744 => 0.7198, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 6.62% (2.1791 => 2.3234, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.57% (16.6129 => 17.7046, std.dev.: 0.0259) SingleSource/UnitTests/ObjC/exceptions-4: 6.50% (0.3646 => 0.3883, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.49% (0.3789 => 0.4035, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.46% (0.6576 => 0.7001, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 6.46% (1.9270 => 2.0514, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 6.45% (0.4003 => 0.4261, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.43% (3.1889 => 3.3941, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 6.43% (0.3578 => 0.3808, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.4113 => 0.4377, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.39% (0.3914 => 0.4164, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.33% (0.3601 => 0.3829, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.32% (0.1789 => 0.1902, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.28% (0.3663 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.23% (1.3245 => 1.4070, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 6.19% (0.3940 => 0.4184, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.18% (0.3623 => 0.3847, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.17% (1.0594 => 1.1248, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.13% (0.8698 => 0.9231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.11% (0.2945 => 0.3125, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (1.2749 => 1.3517, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 5.92% (14.8535 => 15.7332, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (0.2859 => 0.3028, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (8.4961 => 8.9876, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.77% (0.6135 => 0.6489, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.71% (4.3801 => 4.6300, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.71% (4.4433 => 4.6968, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (1.3819 => 1.4586, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.2842 => 14.0171, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.3813 => 1.4565, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.42% (0.8818 => 0.9296, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.30% (0.3245 => 0.3417, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.25% (1.1333 => 1.1928, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635) MultiSource/Applications/ClamAV/clamscan: 5.00% (14.5298 => 15.2568, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (6.5754 => 6.9020, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 4.97% (4.6629 => 4.8945, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (3.2742 => 3.4313, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 4.70% (1.2292 => 1.2870, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.63% (4.9865 => 5.2175, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4805 => 0.5022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.50% (0.6250 => 0.6531, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (1.5188 => 1.5818, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.14% (0.9108 => 0.9485, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.06% (3.7467 => 3.8987, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (2.1007 => 2.1812, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.71% (6.2785 => 6.5113, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 3.31% (33.2944 => 34.3957, std.dev.: 0.0190) MultiSource/Applications/sqlite3/sqlite3: 1.65% (16.2614 => 16.5304, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2525, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.13% (10.7476 => 11.0845, std.dev.: 0.0593) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5990, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.03% (1.4298 => 1.4445, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5827, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.64% (0.4657 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.52% (22.5627 => 21.7695, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2554, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std.dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.50% (3.0263 => 2.9203, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9180, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5748, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.28% (26.5159 => 25.9103, std.dev.: 0.0297) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2376, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2413, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2299, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.12% (4.1080 => 4.0621, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 13:24:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 15:24:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918202426.3C0242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3973?compare_to=3970&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3973, Order: 164158, Start Time: 2012-09-18 19:15:35, End Time: 2012-09-18 20:25:51 To: 3970, Order: 164142, Start Time: 2012-09-18 17:47:47, End Time: 2012-09-18 18:59:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 16 (10 on baseline) Performance Regressions: 6 (49 on baseline) Performance Improvements: 10 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 869 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/spiff/spiff MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Regression/C++/ofstream_ctor MultiSource/Applications/spiff/spiff: -0.76% (0.7590 => 0.7532, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/espresso/espresso: 0.70% (4.2389 => 4.2685, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: -0.29% (3.8766 => 3.8653, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -0.30% (1.1899 => 1.1863, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 0.93% (1.0699 => 1.0799, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: -1.11% (0.5659 => 0.5596, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/spellcheck: -0.70% (0.3429 => 0.3405, std.dev.: 0.0063) SingleSource/Regression/C++/ofstream_ctor: -1.19% (0.1927 => 0.1904, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/spiff/spiff MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Regression/C++/ofstream_ctor MultiSource/Applications/spiff/spiff: - (0.0000 => 2.8351, std.dev.: 0.0351) MultiSource/Benchmarks/MallocBench/espresso/espresso: 604800.00% (0.0001 => 0.6049, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 74200.00% (0.0001 => 0.0743, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: - (0.0000 => 0.0036, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1109600.00% (0.0001 => 1.1097, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/bigfib: 356600.00% (0.0001 => 0.3567, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0000 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: - (0.0000 => 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.86% (0.4443 => 0.4570, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.84% (0.7529 => 0.7969, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/lists1: 3.58% (0.5804 => 0.6012, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (1.3565 => 1.3824, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 1.78% (0.6364 => 0.6477, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 1.72% (1.7637 => 1.7941, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.42% (0.4471 => 0.4318, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.33% (2.0950 => 2.0462, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.71% (1.4030 => 1.3790, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (2.3274 => 2.2985, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -10.08% (23.9567 => 21.5423, std.dev.: 0.7499) SingleSource/Benchmarks/Shootout-C++/hash2: -6.02% (3.6449 => 3.4255, std.dev.: 0.0167) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.18% (2.6678 => 2.5829, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.24% (13.5115 => 13.2084, std.dev.: 0.1147) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.0798 => 6.9871, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.06% (4.2383 => 4.1932, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.40% (0.9981 => 0.9941, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -0.56% (0.6018 => 0.5984, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 2.93% (0.1606 => 0.1653, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.65% (0.1532 => 0.1542, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.70% (0.3116 => 0.3032, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.51% (0.2354 => 0.2342, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.73% (0.3212 => 0.3060, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.75% (0.2268 => 0.2251, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 16.02% (0.0387 => 0.0449, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 7.41% (0.0081 => 0.0087, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 200.00% (0.0029 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 41.67% (0.0168 => 0.0238, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.77% (0.0183 => 0.0145, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.94% (0.0322 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.88% (0.0222 => 0.0295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.42% (0.0281 => 0.0277, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0321 => 0.0318, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 0.57% (0.0176 => 0.0177, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.05% (0.0191 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.19% (0.0251 => 0.0243, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 21.59% (0.0264 => 0.0321, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: - (0.1424 => 0.1424, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.75% (1.4650 => 1.4906, std.dev.: 0.0191) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.39% (0.1440 => 0.1420, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.46% (0.4215 => 0.4027, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.21% (0.1450 => 0.1418, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0608 => 0.0613, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.51% (0.0257 => 0.0212, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.43% (0.0606 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1269 => 1.1260, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.05% (0.0553 => 0.0592, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.56% (0.0163 => 0.0136, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.30% (0.7687 => 0.7664, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.06% (1.6002 => 1.5993, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -57.55% (0.0106 => 0.0045, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.18% (4.1772 => 3.1252, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0122) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.00% (0.0745 => 0.0894, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.68% (0.6410 => 0.6838, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 5.62% (2.1763 => 2.2985, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.52% (0.3582 => 0.3744, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.69% (0.6173 => 0.6401, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 3.55% (1.0046 => 1.0403, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 3.55% (1.1653 => 1.2067, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 3.17% (15.3105 => 15.7951, std.dev.: 0.0735) MultiSource/Applications/lambda-0_1_3/lambda: 2.85% (0.6915 => 0.7112, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.43% (0.7639 => 0.7825, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.5150 => 1.5511, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.20% (0.7226 => 0.7385, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.78% (29.3170 => 29.8397, std.dev.: 0.1077) MultiSource/Applications/d/make_dparser: 1.71% (3.0225 => 3.0743, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.19% (1.2021 => 1.2164, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (12.6413 => 12.7880, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.14% (1.1672 => 1.1805, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.2546 => 6.3196, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std.dev.: 0.0364) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.69% (4.0101 => 4.5589, std.dev.: 0.0626) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.02% (0.2694 => 0.2937, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.81% (7.0025 => 7.6197, std.dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.97% (1.0063 => 1.0865, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.85% (0.3301 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.28% (40.4792 => 43.0203, std.dev.: 0.4728) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.73% (0.7609 => 0.7969, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8574, std.dev.: 0.0537) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 3.53% (1.7330 => 1.7941, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5113 => 8.7632, std.dev.: 0.0510) MultiSource/Applications/hexxagon/hexxagon: 2.92% (14.4877 => 14.9114, std.dev.: 0.0169) MultiSource/Benchmarks/sim/sim: 2.89% (3.8907 => 4.0032, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 2.87% (0.5844 => 0.6012, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.86% (0.5587 => 0.5747, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.6308 => 0.6477, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.50% (0.5876 => 0.6023, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.37% (2.6656 => 2.7289, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/mason/mason: 2.36% (0.5004 => 0.5122, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 1.77% (2.4013 => 2.4437, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 1.62% (2.3453 => 2.3833, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.28% (4.6127 => 4.6717, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (4.6414 => 4.6894, std.dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.16% (0.9425 => 0.9316, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (1.3935 => 1.3790, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.81% (0.3497 => 0.2105, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.53% (5.2665 => 4.0801, std.dev.: 0.1206) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9600, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -17.27% (1.7473 => 1.4456, std.dev.: 0.0366) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.57% (15.8312 => 13.2084, std.dev.: 0.1147) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1594, std.dev.: 0.0306) MultiSource/Applications/sgefa/sgefa: -10.65% (0.3746 => 0.3347, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.67% (1.4034 => 1.2817, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9445, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3779, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: -6.78% (3.4230 => 3.1908, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3311, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8732, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.33% (1.4441 => 1.3527, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -5.48% (62.4126 => 58.9948, std.dev.: 0.1217) SingleSource/Benchmarks/Shootout/fib2: -5.15% (4.4195 => 4.1921, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.20% (7.6833 => 7.3608, std.dev.: 0.0147) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.85% (1.2722 => 1.2232, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/methcall: -3.20% (9.2503 => 8.9541, std.dev.: 0.0210) SingleSource/Benchmarks/McGill/misr: -3.05% (0.4296 => 0.4165, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2855, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.47% (3.7496 => 3.6568, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.24% (1.8739 => 1.8320, std.dev.: 0.0145) MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (92.7467 => 90.8159, std.dev.: 0.1000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.99% (1.1683 => 1.1450, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0046) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3650, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2166, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/hash2: -1.78% (3.4876 => 3.4255, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.54% (2.8964 => 2.8519, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.41% (1.4021 => 1.3824, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3077, std.dev.: 0.1142) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.39% (0.9980 => 0.9941, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6022 => 0.5984, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -0.78% (0.1666 => 0.1653, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.77% (0.1554 => 0.1542, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.65% (0.3083 => 0.3032, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.17% (0.2394 => 0.2342, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.62% (0.3175 => 0.3060, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.22% (0.2302 => 0.2251, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.48% (0.0192 => 0.0145, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.46% (0.0284 => 0.0277, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.41% (0.0249 => 0.0243, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.75% (1.5019 => 1.4906, std.dev.: 0.0191) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.40% (0.1501 => 0.1420, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.56% (0.4264 => 0.4027, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.51% (0.1344 => 0.1418, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.62% (0.0232 => 0.0212, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.88% (0.0639 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.79% (1.1350 => 1.1260, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.06% (0.0637 => 0.0592, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.72% (0.0246 => 0.0136, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7541 => 0.7664, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.10% (1.5363 => 1.5993, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.71% (0.0070 => 0.0045, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 13:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 15:25:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918202544.AC4D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3974?compare_to=3964&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3974, Order: 164155, Start Time: 2012-09-18 19:07:21, End Time: 2012-09-18 20:27:07 To: 3964, Order: 164119, Start Time: 2012-09-18 13:33:43, End Time: 2012-09-18 14:52:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (2 on baseline) New Passes: 2 (1 on baseline) Performance Regressions: 12 (119 on baseline) Performance Improvements: 5 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 19 (18 on baseline) Unchanged Tests: 931 (727 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: -36.91% (5.7803 => 3.6468, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: 483000.00% (0.0009 => 4.3479, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1087366.67% (0.0003 => 3.2624, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 22.75% (0.0690 => 0.0847, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.90% (1.1389 => 1.2517, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.82% (3.5806 => 3.8965, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.49% (3.5918 => 3.8969, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 4.58% (0.3100 => 0.3242, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.71% (19.6857 => 20.2192, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (14.6133 => 14.8175, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 27.11% (1.6310 => 2.0732, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.45% (0.0861 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 11.91% (0.1964 => 0.2198, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.57% (0.9620 => 0.9963, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 2.19% (1.3564 => 1.3861, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -27.44% (0.3736 => 0.2711, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -9.59% (0.1304 => 0.1179, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_expandfft: -20.52% (0.4630 => 0.3680, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -17.62% (0.5711 => 0.4705, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -2.67% (0.5623 => 0.5473, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.32% (0.5676 => 0.5658, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: -0.36% (15.8201 => 15.7627, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -0.12% (14.6935 => 14.6754, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 42.62% (57.9500 => 82.6507, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: 0.14% (4.2911 => 4.2970, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2177 => 1.2179, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (7.3756 => 7.3606, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.69% (0.6449 => 0.6340, std.dev.: 0.0088) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1430 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.0650 => 0.0686, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -80.00% (0.0005 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.69% (63.2438 => 82.6507, std.dev.: 0.0197) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14243.61% (0.0720 => 10.3274, std.dev.: 0.0050) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.27% (10.3673 => 14.3348, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.41% (2.2022 => 2.5195, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.87% (7.0540 => 8.0323, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.07% (0.0834 => 0.0943, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.82% (1.1194 => 1.2517, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.56% (0.1566 => 0.1747, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.68% (1.7609 => 1.9490, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 8.71% (0.3282 => 0.3568, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.13% (0.3543 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 7.86% (0.3828 => 0.4129, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.85% (0.3694 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.3927 => 0.4232, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.57% (0.3886 => 0.4180, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.15% (0.1440 => 0.1543, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.85% (10.4361 => 11.1513, std.dev.: 0.0142) MultiSource/Benchmarks/mafft/pairlocalalign: 6.81% (9.4845 => 10.1306, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7433 => 0.7908, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2700 => 0.2871, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 6.29% (5.7591 => 6.1215, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.8172 => 0.8679, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2554 => 0.2711, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 5.89% (0.3109 => 0.3292, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4615 => 0.4886, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.81% (0.3307 => 0.3499, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.73% (0.3423 => 0.3619, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.68% (0.7115 => 0.7519, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5860 => 0.6189, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.56% (0.7835 => 0.8271, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.55% (0.8067 => 0.8515, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.53% (0.6675 => 0.7044, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.47% (3.3354 => 3.5179, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (4.2646 => 4.4970, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.45% (8.1363 => 8.5794, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (1.3050 => 1.3759, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.42% (1.5415 => 1.6250, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.42% (0.2271 => 0.2394, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.5105 => 0.5377, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5569 => 0.5863, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.25% (4.9449 => 5.2045, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.14% (5.0018 => 5.2591, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.08% (0.9765 => 1.0261, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2758 => 0.2898, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.91% (1.1642 => 1.2214, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.85% (0.3092 => 0.3242, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.73% (0.2603 => 0.2726, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (7.9617 => 8.3350, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (0.3180 => 0.3329, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 4.62% (0.5925 => 0.6199, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.55% (0.3387 => 0.3541, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.48% (3.8723 => 4.0459, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 4.48% (0.6030 => 0.6300, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.41% (1.1861 => 1.2384, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 4.40% (0.4299 => 0.4488, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.39% (1.0722 => 1.1193, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.39% (0.3441 => 0.3592, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.31% (1.5603 => 1.6276, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.30% (0.5020 => 0.5236, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.03% (21.9371 => 22.8207, std.dev.: 0.0091) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1085, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.4103 => 0.4266, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.6456 => 0.6710, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.90% (2.2969 => 2.3864, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 3.88% (0.7326 => 0.7610, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.86% (0.4636 => 0.4815, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.84% (0.4064 => 0.4220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3422 => 0.3553, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.8921 => 0.9257, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.75% (0.6450 => 0.6692, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.75% (0.5981 => 0.6205, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3650 => 0.3780, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.53% (1.5859 => 1.6419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3865 => 0.4000, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4289 => 0.4436, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.4203 => 0.4341, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.14% (1.4186 => 1.4632, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 3.14% (0.4620 => 0.4765, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (14.3668 => 14.8175, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 3.08% (0.3603 => 0.3714) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (2.2024 => 2.2693, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.99% (2.0665 => 2.1282, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.1840 => 1.2158, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.8101 => 0.8273, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3065, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3847, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3479, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2370, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.00% (26.0924 => 26.3537, std.dev.: 0.0264) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2296, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (5.3855 => 3.8969, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.20% (5.3526 => 3.8965, std.dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1159, std.dev.: 0.0393) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.25% (2.9384 => 2.5783, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -8.82% (22.1758 => 20.2192, std.dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2918, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.39% (1.8329 => 1.7157, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5833, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5055, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9854, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.6802 => 8.4479, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.25% (1.2373 => 1.2094, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0073, std.dev.: 0.0107) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5067, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Applications/sqlite3/sqlite3: -1.49% (4.6441 => 4.5749, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2233, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.20% (0.5229 => 0.5658, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 5.16% (14.9895 => 15.7627, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 3.67% (14.1553 => 14.6754, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (4.1105 => 4.2970, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.24% (1.1048 => 1.2179, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.83% (7.1582 => 7.3606, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.31% (3.4629 => 3.6468, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.6222 => 0.6340, std.dev.: 0.0088) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 14:40:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 16:40:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918214019.0331B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3975?compare_to=3972&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3975, Order: 164158, Start Time: 2012-09-18 20:26:49, End Time: 2012-09-18 21:41:37 To: 3972, Order: 164150, Start Time: 2012-09-18 18:43:44, End Time: 2012-09-18 19:58:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 19.57% (0.3889 => 0.4650, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.05% (2.0176 => 2.4221, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.17% (3.9660 => 4.3695, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.83% (0.7710 => 0.8468, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.56% (0.7038 => 0.7711, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.28% (0.7061 => 0.7716, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.12% (0.9199 => 1.0038, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 9.10% (1.3693 => 1.4939, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.10% (0.5265 => 0.5744, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.07% (0.6959 => 0.7590, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: 9.06% (0.4328 => 0.4720, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.2721 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.97% (1.2193 => 1.3287, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.74% (1.1364 => 1.2357, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.66% (1.4563 => 1.5824, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.62% (0.1589 => 0.1726, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 8.54% (13.8202 => 15.0007, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.28% (0.5577 => 0.6039, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.3899 => 0.4219, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.13% (0.2781 => 0.3007, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.02% (0.4379 => 0.4730, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 8.01% (1.0313 => 1.1139, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3022 => 0.3263, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.86% (1.1061 => 1.1930, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2127 => 0.2293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.73% (0.3246 => 0.3497, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.68% (0.2995 => 0.3225, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.63% (0.3580 => 0.3853, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.61% (0.3756 => 0.4042, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2966 => 0.3191, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 7.56% (0.3293 => 0.3542, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2726 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.54% (0.4390 => 0.4721, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2760 => 0.2968, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.53% (0.4791 => 0.5152, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 7.52% (3.8646 => 4.1551, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.45% (1.9828 => 2.1305, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.45% (0.2914 => 0.3131, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (7.2180 => 7.7551, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4016 => 0.4314, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.36% (0.8310 => 0.8922, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.35% (0.7460 => 0.8008, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.34% (3.6692 => 3.9387, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3149 => 0.3380, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.31% (0.3107 => 0.3334, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.27% (0.7506 => 0.8052, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.27% (0.5637 => 0.6047, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.22% (0.2243 => 0.2405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2988 => 0.3202, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.16% (0.3868 => 0.4145, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.07% (2.1791 => 2.3331, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3192 => 0.3416, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.00% (1.9270 => 2.0618, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/18-imp/imp: 6.96% (0.3220 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3453 => 0.3693, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.88% (0.3534 => 0.3777, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.87% (0.2023 => 0.2162, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.81% (0.6576 => 0.7024, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.75% (3.1889 => 3.4043, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.66% (16.6129 => 17.7197, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 6.61% (1.2749 => 1.3592, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.60% (0.6744 => 0.7189, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.55% (1.3245 => 1.4112, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 6.50% (0.4003 => 0.4263, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.48% (1.0594 => 1.1280, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.41% (0.3914 => 0.4165, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.37% (0.3578 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.37% (0.4113 => 0.4375, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 6.36% (0.3646 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.31% (0.3789 => 0.4028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.30% (0.3601 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.25% (0.3663 => 0.3892, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.22% (0.3940 => 0.4185, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.19% (1.3819 => 1.4674, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.18% (14.8535 => 15.7711, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: 6.16% (0.3623 => 0.3846, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.8698 => 0.9230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.06% (1.3813 => 1.4650, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.2859 => 0.3032, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (8.4961 => 9.0048, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.91% (4.3801 => 4.6389, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.90% (0.6135 => 0.6497, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.89% (4.4433 => 4.7049, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.83% (0.8818 => 0.9332, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.2140 => 0.2264, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (13.2842 => 14.0534, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.78% (0.3755 => 0.3972, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.71% (0.2504 => 0.2647, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.69% (0.3131 => 0.3309, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1333 => 1.1964, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.47% (4.6629 => 4.9178, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 5.42% (14.5298 => 15.3174, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (6.5754 => 6.9274, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.07% (3.2742 => 3.4402, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.4805 => 0.5025, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (4.9865 => 5.2099, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 4.45% (3.7467 => 3.9135, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.40% (0.9108 => 0.9509, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.31% (1.5188 => 1.5842, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.22% (0.6250 => 0.6514, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (6.2785 => 6.5344, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.77% (2.1007 => 2.1798, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.67% (33.2944 => 34.5169, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3511 => 0.3615, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5869, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std.dev.: 0.0470) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6982, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5460, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1027, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9833, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4271 => 7.6183, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5900, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6857, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.58% (22.5627 => 21.7542, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2559, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3002, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9207, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.26% (26.5159 => 25.9176, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2497, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: -1.21% (4.4810 => 4.4270, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2441, std.dev.: 0.0299) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0625, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2383, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 14:51:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 16:51:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918215146.1DBDE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3976?compare_to=3973&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3976, Order: 164162, Start Time: 2012-09-18 20:41:45, End Time: 2012-09-18 21:53:10 To: 3973, Order: 164158, Start Time: 2012-09-18 19:15:35, End Time: 2012-09-18 20:25:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (36 on baseline) Performance Improvements: 5 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 886 (815 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 4.76% (0.2878 => 0.3015, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.05% (0.5405 => 0.5516, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 5.08% (4.0801 => 4.2872, std.dev.: 0.0537) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.68% (43.3254 => 45.3547, std.dev.: 0.3590) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.09% (21.4640 => 22.3413, std.dev.: 0.0650) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.97% (58.8086 => 60.5563, std.dev.: 0.3623) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.78% (13.2084 => 13.5762, std.dev.: 0.0638) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.52% (1.7019 => 1.7278, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.35% (1.8320 => 1.8568, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.01% (1.4311 => 1.4455, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.08% (0.4546 => 0.4315, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.05% (0.5760 => 0.5469, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (1.0799 => 1.0664, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -3.09% (1.7941 => 1.7387, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/lists1: -2.99% (0.6012 => 0.5832, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.28% (0.9941 => 0.9913, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -1.09% (0.5984 => 0.5919, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1653 => 0.1646, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1542 => 0.1548, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.73% (0.3032 => 0.3054, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.68% (0.2342 => 0.2358, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.72% (0.3060 => 0.3082, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.36% (0.2251 => 0.2243, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 2.30% (0.0087 => 0.0089, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.50% (0.0238 => 0.0213, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 31.72% (0.0145 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0383 => 0.0385, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0295 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.08% (0.0277 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.32% (0.0318 => 0.0282, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -29.38% (0.0177 => 0.0125, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.06% (0.0243 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -1.56% (0.0321 => 0.0316, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1424 => 0.1422, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -1.58% (1.4906 => 1.4670, std.dev.: 0.0318) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1420 => 0.1417, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.74% (0.4027 => 0.4057, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.09% (0.1418 => 0.1360, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.91% (0.0613 => 0.0540, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.32% (0.0212 => 0.0188, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.75% (0.0651 => 0.0555, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1260 => 1.1289, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.78% (0.0592 => 0.0540, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.94% (0.0136 => 0.0140, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7664 => 0.7658, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.41% (1.5993 => 1.5928, std.dev.: 0.0091) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 168.89% (0.0045 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.74% (4.1772 => 3.1436, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/except: 82733.33% (0.0006 => 0.4970, std.dev.: 0.0134) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.30% (0.6410 => 0.6878, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 6.03% (2.1763 => 2.3075, std.dev.: 0.0331) SingleSource/Benchmarks/Misc-C++/bigfib: 4.99% (0.5309 => 0.5574, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3582 => 0.3736, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.94% (0.6173 => 0.6416, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 3.33% (0.6915 => 0.7145, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.6069 => 0.6181, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.34% (1.2021 => 1.2182, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0280) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.93% (0.0766 => 0.0888, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 15.13% (1.7426 => 2.0062, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.09% (4.0101 => 4.5752, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 12.21% (0.1433 => 0.1608, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.2857 => 0.3120, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.92% (7.0025 => 7.6268, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.12% (0.3301 => 0.3569, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.81% (0.7609 => 0.8203, std.dev.: 0.0129) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.68% (0.2694 => 0.2901, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.94% (1.0063 => 1.0761, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.68% (0.8498 => 0.8981, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.32% (40.4792 => 42.6324, std.dev.: 0.5133) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.91% (15.2242 => 15.8198, std.dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (6.6312 => 6.8751, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8925, std.dev.: 0.0299) MultiSource/Benchmarks/sim/sim: 2.72% (3.8907 => 3.9965, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.43% (2.6656 => 2.7304, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: 2.43% (8.5113 => 8.7180, std.dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4013 => 2.4483, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (4.2129 => 4.2845, std.dev.: 0.0266) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.4184 => 1.4394, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.04% (27.1724 => 27.4544, std.dev.: 0.0410) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.11% (0.4596 => 0.4315, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.49% (0.1841 => 0.1740, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.72% (0.5740 => 0.5469, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: -4.56% (0.7738 => 0.7385, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.35% (4.2815 => 4.2237, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.59% (5.2665 => 4.2872, std.dev.: 0.0537) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.48% (1.1647 => 0.9611, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -16.96% (1.7473 => 1.4509, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.24% (15.8312 => 13.5762, std.dev.: 0.0638) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -10.84% (0.3746 => 0.3340, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9426, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.97% (3.6023 => 3.3512, std.dev.: 0.0949) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3788, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3301, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: -6.53% (3.4230 => 3.1996, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3513, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9635, std.dev.: 0.0760) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1864, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -4.84% (0.4296 => 0.4088, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -4.25% (7.6833 => 7.3571, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (9.2503 => 8.8735, std.dev.: 0.0589) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.4140 => 0.3987, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.65% (1.2722 => 1.2258, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.99% (3.9413 => 3.8235, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.87% (3.7496 => 3.6421, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/neural/neural: -2.09% (1.0926 => 1.0698, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3139, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -1.82% (92.7467 => 91.0553, std.dev.: 0.4310) SingleSource/Benchmarks/Shootout-C++/hash2: -1.79% (3.4876 => 3.4252, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (9.3855 => 9.2484, std.dev.: 0.0455) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3356, std.dev.: 0.0242) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.67% (0.9980 => 0.9913, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -1.71% (0.6022 => 0.5919, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: -1.20% (0.1666 => 0.1646, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.39% (0.1554 => 0.1548, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.94% (0.3083 => 0.3054, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.50% (0.2394 => 0.2358, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.93% (0.3175 => 0.3082, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.56% (0.2302 => 0.2243, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.25% (0.0240 => 0.0213, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.96% (0.0324 => 0.0282, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -29.38% (0.0177 => 0.0125, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -2.77% (0.0325 => 0.0316, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -2.32% (1.5019 => 1.4670, std.dev.: 0.0318) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.60% (0.1501 => 0.1417, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.19% (0.1344 => 0.1360, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.32% (0.0589 => 0.0540, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.97% (0.0232 => 0.0188, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.15% (0.0639 => 0.0555, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1350 => 1.1289, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.23% (0.0637 => 0.0540, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.09% (0.0246 => 0.0140, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.68% (1.5363 => 1.5928, std.dev.: 0.0091) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 15:14:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 17:14:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120918221431.206D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3977?compare_to=3974&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3977, Order: 164162, Start Time: 2012-09-18 20:55:52, End Time: 2012-09-18 22:15:54 To: 3974, Order: 164155, Start Time: 2012-09-18 19:07:21, End Time: 2012-09-18 20:27:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.11% (54.5040 => 56.1980, std.dev.: 0.2127) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5658 => 0.5666, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 0.10% (15.7627 => 15.7777, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: -0.02% (14.6754 => 14.6719, std.dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 0.04% (82.6507 => 82.6852, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 0.01% (4.2970 => 4.2974, std.dev.: 0.0222) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2179 => 1.2176, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (7.3606 => 7.3619, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (3.6468 => 3.6479, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.09% (0.6340 => 0.6334, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (0.0686 => 0.0707, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.74% (63.2438 => 82.6852, std.dev.: 0.0111) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14239.86% (0.0720 => 10.3247, std.dev.: 0.0080) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.11% (10.3673 => 14.3179, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: 26.33% (0.1622 => 0.2049, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.43% (2.2022 => 2.5199, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.90% (7.0540 => 8.0348, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.62% (0.1566 => 0.1748, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.82% (1.7609 => 1.9515, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.84% (0.1584 => 0.1724, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 8.78% (0.3282 => 0.3570, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.07% (0.3543 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.05% (0.3516 => 0.3799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 8.01% (0.3497 => 0.3777, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3561 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.90% (0.3694 => 0.3986, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3828 => 0.4130, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.3927 => 0.4230, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.59% (0.3886 => 0.4181, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 6.89% (10.4361 => 11.1549, std.dev.: 0.0186) MultiSource/Benchmarks/mafft/pairlocalalign: 6.88% (9.4845 => 10.1375, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.41% (0.2700 => 0.2873, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7433 => 0.7905, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 6.32% (5.7591 => 6.1229, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (0.4615 => 0.4893, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 5.92% (0.3109 => 0.3293, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.8172 => 0.8646, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 5.79% (0.7115 => 0.7527, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5860 => 0.6194, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.64% (0.3423 => 0.3616, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.60% (0.6675 => 0.7049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.8067 => 0.8517, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.3050 => 1.3773, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1940 => 0.2047, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.51% (3.3354 => 3.5192, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.47% (8.1363 => 8.5812, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.44% (1.5415 => 1.6253, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.39% (4.2646 => 4.4944, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.11% (0.2758 => 0.2899, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.10% (0.9765 => 1.0263, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.5105 => 0.5365, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.07% (0.7835 => 0.8232, std.dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.06% (0.3121 => 0.3279, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (4.9449 => 5.1946, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: 5.01% (0.3092 => 0.3247, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (5.0018 => 5.2518, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 4.90% (1.1642 => 1.2212, std.dev.: 0.0124) MultiSource/Benchmarks/sim/sim: 4.64% (0.3387 => 0.3544, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.61% (0.2603 => 0.2723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.57% (0.5925 => 0.6196, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.56% (0.4299 => 0.4495, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.53% (0.6030 => 0.6303, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.52% (3.8723 => 4.0473, std.dev.: 0.0156) MultiSource/Applications/hbd/hbd: 4.51% (1.5603 => 1.6307, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (7.9617 => 8.3206, std.dev.: 0.0127) MultiSource/Applications/lemon/lemon: 4.46% (1.0722 => 1.1200, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.36% (1.1861 => 1.2378, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.28% (0.5020 => 0.5235, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3422 => 0.3564, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.99% (21.9371 => 22.8133, std.dev.: 0.0431) MultiSource/Applications/treecc/treecc: 3.98% (2.0273 => 2.1079, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.4103 => 0.4266, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 3.92% (2.2969 => 2.3869, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.86% (0.4636 => 0.4815, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 3.85% (0.7326 => 0.7608, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8921 => 0.9264, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.6456 => 0.6703, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5981 => 0.6209, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (0.4064 => 0.4216, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (1.5859 => 1.6416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.51% (0.3650 => 0.3778, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4289 => 0.4435, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3826 => 0.3955, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.35% (0.4203 => 0.4344, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.32% (0.3098 => 0.3201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.4186 => 1.4639, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (14.3668 => 14.8241, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.10% (2.2024 => 2.2706, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.03% (2.0665 => 2.1292, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.1840 => 1.2150, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.8101 => 0.8277, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.67% (1.2842 => 1.3057, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3834, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (4.2280 => 4.3508, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7892, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2273, std.dev.: 0.0343) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (26.0924 => 26.3600, std.dev.: 0.0264) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2305, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (5.3855 => 3.8971, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.15% (5.3526 => 3.8994, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1373, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.11% (2.9384 => 2.5827, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.83% (22.1758 => 20.2173, std.dev.: 0.0334) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4198, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2901, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.40% (1.8329 => 1.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4116, std.dev.: 0.0226) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5098, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0033, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.11% (1.2373 => 1.2112, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5067, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0184, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4228, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5789, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.36% (0.5229 => 0.5666, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 5.26% (14.9895 => 15.7777, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 3.65% (14.1553 => 14.6719, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (4.1105 => 4.2974, std.dev.: 0.0222) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.21% (1.1048 => 1.2176, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (7.1582 => 7.3619, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.34% (3.4629 => 3.6479, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.6222 => 0.6334, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.59% (0.2116 => 0.0707, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 15:41:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 17:41:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120918224133.A80C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3978?compare_to=3971&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3978, Order: 164158, Start Time: 2012-09-18 19:59:06, End Time: 2012-09-18 22:42:58 To: 3971, Order: 164131, Start Time: 2012-09-18 16:46:15, End Time: 2012-09-18 19:30:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.68% (0.4057 => 0.4612, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.20% (0.3446 => 0.3763, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.18% (0.3465 => 0.3783) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3488 => 0.3807, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.12% (0.3496 => 0.3815, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.10% (0.3460 => 0.3775, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.09% (0.3442 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.02% (0.3469 => 0.3782, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 8.82% (0.3650 => 0.3972, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.78% (0.3643 => 0.3963, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.73% (0.3724 => 0.4049, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.63% (1.5932 => 1.7147, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/05-eks/eks: 6.67% (0.1619 => 0.1727, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.20% (1.6211 => 1.7216, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (0.4361 => 0.4621, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (1.3152 => 1.3930, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 5.89% (0.5826 => 0.6169, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.73% (5.5417 => 5.8592, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.73% (3.5627 => 3.7668, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.69% (0.5889 => 0.6224, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.64% (2.7292 => 2.8830, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (0.5000 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.35% (0.4994 => 0.5261, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2738 => 0.2884, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.15% (0.5026 => 0.5285, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 5.15% (1.0781 => 1.1336, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (0.3930 => 0.4132, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 5.12% (23.5202 => 24.7250, std.dev.: 0.0211) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7171 => 0.7538, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.04% (0.3195 => 0.3356, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.97% (4.2109 => 4.4200, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.91% (0.2811 => 0.2949, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.90% (0.2875 => 0.3016, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.88% (0.3625 => 0.3802, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.87% (0.2566 => 0.2691, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 4.87% (0.6634 => 0.6957, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.2736 => 0.2869, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.83% (0.9909 => 1.0388, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3258 => 0.3411, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.68% (0.2823 => 0.2955, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.67% (0.3124 => 0.3270, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.67% (2.0673 => 2.1638, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.66% (0.2792 => 0.2922, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.2780 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.62% (1.4269 => 1.4928, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.60% (0.3890 => 0.4069, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (4.4195 => 4.6224, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.58% (0.3060 => 0.3200, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.2911 => 0.3043, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.52% (0.3362 => 0.3514, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.50% (1.8794 => 1.9640, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3267 => 0.3414, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.4139 => 0.4325, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.3903 => 0.4078, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.48% (0.3348 => 0.3498, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (2.1653 => 2.2621, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 4.46% (4.6177 => 4.8237, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2803 => 0.2928, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.44% (0.5546 => 0.5792, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.43% (0.2729 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.3096 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.3845 => 0.4015, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.41% (2.1013 => 2.1940, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3726 => 0.3890, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.35% (0.2691 => 0.2808, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.31% (0.3317 => 0.3460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3678 => 0.3835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.26% (0.3477 => 0.3625, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.19% (0.4251 => 0.4429, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.15% (0.3084 => 0.3212, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (0.5900 => 0.6143, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 4.11% (0.3336 => 0.3473, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.3981 => 0.4143, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3690 => 0.3840, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (0.4658 => 0.4847, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3282 => 0.3415, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.02% (0.6435 => 0.6694, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.3271 => 0.3400, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 3.91% (0.5012 => 0.5208, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.85% (0.7875 => 0.8178, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.80% (0.2737 => 0.2841, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (1.9694 => 2.0434, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.2969 => 0.3080, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.66% (2.0346 => 2.1091, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (1.9966 => 2.0692, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: 3.57% (0.9697 => 1.0043, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (0.7426 => 0.7688, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.30% (0.5361 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.24% (0.4847 => 0.5004, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.22% (0.5584 => 0.5764, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.3498 => 0.3601, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.74% (11.6398 => 11.9584, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.71% (4.6926 => 4.8200, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.49% (0.2162 => 0.3578, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-2: 5.13% (1.8057 => 1.8983, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std.dev.: 0.0217) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6455, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2053, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5060, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4444, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5628, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9786, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7884, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7954, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9628, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: -1.11% (1.3650 => 1.3499, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 16:19:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 18:19:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120918231909.AC72F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3979?compare_to=3976&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3979, Order: 164169, Start Time: 2012-09-18 22:09:09, End Time: 2012-09-18 23:20:35 To: 3976, Order: 164162, Start Time: 2012-09-18 20:41:45, End Time: 2012-09-18 21:53:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (43 on baseline) Performance Improvements: 2 (44 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 44.06% (0.0320 => 0.0461, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.48% (0.7385 => 0.7494, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/misr: 2.86% (0.4088 => 0.4205, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 2.85% (1.7387 => 1.7883, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.65% (1.0761 => 1.1046, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/ReedSolomon: 1.58% (8.7180 => 8.8555, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.97% (13.5762 => 13.1734, std.dev.: 0.1529) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.89% (0.8203 => 0.7966, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.19% (0.9913 => 0.9894, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: -0.08% (0.5919 => 0.5914, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 0.43% (0.1646 => 0.1653, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.71% (0.1548 => 0.1537, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.93% (0.3054 => 0.2995, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.50% (0.2358 => 0.2299, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.97% (0.3082 => 0.3112, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.85% (0.2243 => 0.2262, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -1.54% (0.0454 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -3.45% (0.0087 => 0.0084, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.69% (0.0213 => 0.0203, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.49% (0.0385 => 0.0360, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -28.91% (0.0294 => 0.0209, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0280 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.77% (0.0282 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 41.60% (0.0125 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -31.05% (0.0190 => 0.0131, std.dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -0.81% (0.0248 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 1.58% (0.0316 => 0.0321, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1422 => 0.1419, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -2.96% (1.4670 => 1.4236, std.dev.: 0.0391) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1417 => 0.1419, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.71% (0.4057 => 0.4028, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.01% (0.1360 => 0.1401, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.33% (0.0540 => 0.0612, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.30% (0.0188 => 0.0213, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0555 => 0.0556, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1289 => 1.1229, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 58.33% (0.0012 => 0.0019, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.00% (0.0540 => 0.0594, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.0140 => 0.0172, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.24% (0.7658 => 0.7676, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.39% (1.5928 => 1.5990, std.dev.: 0.0053) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.52% (4.1772 => 3.1531, std.dev.: 0.0853) SingleSource/Benchmarks/Shootout-C++/except: 83016.67% (0.0006 => 0.4987, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.27% (0.0745 => 0.0896, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.41% (0.6410 => 0.6821, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 5.41% (2.1763 => 2.2940, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/bigfib: 5.16% (0.5309 => 0.5583, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.77% (0.3582 => 0.3753, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 3.69% (0.6173 => 0.6401, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3.38% (1.1653 => 1.2047, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.46% (1.5150 => 1.5522, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 1.63% (29.3170 => 29.7960, std.dev.: 0.1063) MultiSource/Applications/d/make_dparser: 1.41% (3.0225 => 3.0651, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std.dev.: 0.0379) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.96% (0.0917 => 0.1045, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.77% (4.0101 => 4.5621, std.dev.: 0.0287) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 11.19% (1.6261 => 1.8081, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.77% (1.0063 => 1.1046, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 8.43% (7.0025 => 7.5931, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.45% (0.3301 => 0.3547, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.84% (40.4792 => 42.4403, std.dev.: 0.2872) SingleSource/Benchmarks/Misc/fp-convert: 4.72% (15.2242 => 15.9425, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.69% (0.7609 => 0.7966, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/dt: 4.52% (0.9851 => 1.0296, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 4.04% (8.5113 => 8.8555, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 3.58% (0.6308 => 0.6534, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.50% (3.4080 => 3.5274, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: 3.19% (1.7330 => 1.7883, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 2.99% (3.8907 => 4.0070, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.91% (0.5876 => 0.6047, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.90% (14.4877 => 14.9078, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: 2.58% (0.5004 => 0.5133, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.46% (2.6656 => 2.7312, std.dev.: 0.0250) MultiSource/Applications/siod/siod: 2.25% (3.5520 => 3.6319, std.dev.: 0.0253) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (2.4455 => 2.4946, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4396, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 1.27% (1.0194 => 1.0323, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.03% (27.1724 => 27.4530, std.dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.36% (0.2080 => 0.1927, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.08% (0.1841 => 0.1729, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: -3.76% (0.4253 => 0.4093, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: -3.15% (0.7738 => 0.7494, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.33% (4.3380 => 4.2801, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.11% (4.2815 => 4.2338, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.01% (1.4189 => 1.4046, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.15% (0.3497 => 0.2058, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -20.40% (1.7473 => 1.3909, std.dev.: 0.0277) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.35% (5.2665 => 4.2476, std.dev.: 0.0580) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.23% (1.1647 => 0.9640, std.dev.: 0.0214) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.79% (15.8312 => 13.1734, std.dev.: 0.1529) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std.dev.: 0.0181) MultiSource/Applications/sgefa/sgefa: -11.03% (0.3746 => 0.3333, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.83% (1.4034 => 1.2795, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.75% (3.2007 => 2.9527, std.dev.: 0.0339) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.89% (2.0027 => 1.8647, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.6254 => 3.3791, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: -6.77% (3.4230 => 3.1912, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/richards_benchmark: -6.46% (1.4441 => 1.3508, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: -6.44% (4.6355 => 4.3372, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -5.43% (62.4126 => 59.0223, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1863, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.83% (0.4140 => 0.3940, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.28% (7.6833 => 7.3541, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/distray/distray: -3.83% (0.2664 => 0.2562, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (9.2503 => 8.9014, std.dev.: 0.0509) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.65% (1.2722 => 1.2258, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.9413 => 3.8261, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2934, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.49% (2.4457 => 2.3849, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.36% (3.7496 => 3.6612, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: -2.27% (1.0926 => 1.0678, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: -2.25% (92.7467 => 90.6576, std.dev.: 0.3233) MultiSource/Applications/aha/aha: -1.97% (3.4286 => 3.3610, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -1.85% (3.4876 => 3.4231, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.81% (2.3569 => 2.3143, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.72% (1.0686 => 1.0502, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (9.3855 => 9.2379, std.dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3098, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4638, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.86% (0.9980 => 0.9894, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: -1.79% (0.6022 => 0.5914, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: -0.78% (0.1666 => 0.1653, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.09% (0.1554 => 0.1537, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.85% (0.3083 => 0.2995, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.97% (0.2394 => 0.2299, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.98% (0.3175 => 0.3112, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.74% (0.2302 => 0.2262, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -0.45% (0.0449 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -5.62% (0.0089 => 0.0084, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.42% (0.0240 => 0.0203, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.69% (0.0390 => 0.0360, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -30.56% (0.0301 => 0.0209, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -30.69% (0.0189 => 0.0131, std.dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.70% (0.1429 => 0.1419, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.21% (1.5019 => 1.4236, std.dev.: 0.0391) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.46% (0.1501 => 0.1419, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.53% (0.4264 => 0.4028, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.24% (0.1344 => 0.1401, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.19% (0.0232 => 0.0213, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.99% (0.0639 => 0.0556, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.07% (1.1350 => 1.1229, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 216.67% (0.0006 => 0.0019, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.0637 => 0.0594, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.08% (0.0246 => 0.0172, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.79% (0.7541 => 0.7676, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.08% (1.5363 => 1.5990, std.dev.: 0.0053) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 16:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 18:23:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120918232324.1AE592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3980?compare_to=3975&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3980, Order: 164169, Start Time: 2012-09-18 22:10:14, End Time: 2012-09-18 23:24:48 To: 3975, Order: 164158, Start Time: 2012-09-18 20:26:49, End Time: 2012-09-18 21:41:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.90% (2.0176 => 2.4191, std.dev.: 0.0164) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.70% (3.9660 => 4.3507, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.36% (0.7038 => 0.7697, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.29% (0.7710 => 0.8426, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.95% (1.3693 => 1.4918, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.93% (0.2721 => 0.2964, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9199 => 1.0019, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.89% (0.5265 => 0.5733, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.80% (1.2193 => 1.3266, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.77% (0.6959 => 0.7569, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.47% (1.1364 => 1.2327, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.31% (13.8202 => 14.9680, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.24% (1.4563 => 1.5763, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.5818 => 0.6297, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 8.17% (0.7061 => 0.7638, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5748 => 0.6211, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.96% (0.5577 => 0.6021, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.87% (1.0313 => 1.1125, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4062 => 0.4373, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.4791 => 0.5151, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 7.51% (0.2995 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.46% (0.3246 => 0.3488, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.36% (1.1061 => 1.1875, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.26% (0.5637 => 0.6046, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8310 => 0.8906, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3485 => 0.3734, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.13% (7.2180 => 7.7325, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1394, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.05% (0.3489 => 0.3735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 6.99% (0.7506 => 0.8031, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.99% (0.4390 => 0.4697, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.89% (3.6692 => 3.9221, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.85% (0.4016 => 0.4291, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.2925 => 0.3125, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 6.83% (0.3220 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.83% (0.6576 => 0.7025, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.81% (2.1791 => 2.3274, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.70% (1.9828 => 2.1157, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.61% (1.3245 => 1.4120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.56% (0.2988 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.52% (3.1889 => 3.3969, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.41% (0.3868 => 0.4116, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.36% (1.9270 => 2.0496, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 6.33% (1.0594 => 1.1265, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 6.33% (0.6744 => 0.7171, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.4003 => 0.4256, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.31% (0.3914 => 0.4161, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.31% (0.2696 => 0.2866, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (1.2749 => 1.3547, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.23% (0.3534 => 0.3754, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.20% (0.3578 => 0.3800, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.14% (0.3646 => 0.3870) MultiSource/Applications/kimwitu++/kc: 6.11% (16.6129 => 17.6278, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 6.10% (0.3789 => 0.4020, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.07% (0.3623 => 0.3843, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.07% (0.3940 => 0.4179, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3601 => 0.3818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.97% (0.3650 => 0.3868, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.97% (14.8535 => 15.7403, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/05-eks/eks: 5.96% (0.4113 => 0.4358, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.77% (0.6135 => 0.6489, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (8.4961 => 8.9828, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (4.4433 => 4.6960, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (13.2842 => 14.0362, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4591, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.3801 => 4.6264, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.56% (1.3819 => 1.4588, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.50% (0.8818 => 0.9303, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.33% (4.6629 => 4.9113, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.32% (1.1333 => 1.1936, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.18% (14.5298 => 15.2822, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3755 => 0.3946, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (6.5754 => 6.9098, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.93% (3.2742 => 3.4356, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.81% (0.3245 => 0.3401, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.24% (4.9865 => 5.1977, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.23% (0.9108 => 0.9493, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5188 => 1.5822, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.09% (3.7467 => 3.9000, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6250 => 0.6488, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.65% (2.1007 => 2.1774, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (6.2785 => 6.5000, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 3.16% (33.2944 => 34.3464, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.89% (16.2614 => 16.5689, std.dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std.dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6979, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.89% (10.7476 => 11.0586, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5959, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5949, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6860, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.05% (7.9275 => 8.0110, std.dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.83% (22.5627 => 21.6993, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2811, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3038, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8047, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5887, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.32% (26.5159 => 25.9002, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2394, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0605, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2349, std.dev.: 0.0234) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 17:02:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 19:02:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919000235.35F212A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3981?compare_to=3977&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3981, Order: 164173, Start Time: 2012-09-18 22:44:24, End Time: 2012-09-19 00:03:58 To: 3977, Order: 164162, Start Time: 2012-09-18 20:55:52, End Time: 2012-09-18 22:15:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (14.3179 => 14.5534, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5666 => 0.5679, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 0.13% (15.7777 => 15.7980, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 0.16% (14.6719 => 14.6956, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: 0.27% (82.6852 => 82.9051, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 0.22% (4.2974 => 4.3068, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.26% (1.2176 => 1.2208, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.3619 => 7.3720, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.29% (3.6479 => 3.6583, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.47% (0.6334 => 0.6364, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.20% (0.0707 => 0.0649) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.09% (63.2438 => 82.9051, std.dev.: 0.0144) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14243.75% (0.0720 => 10.3275, std.dev.: 0.0050) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.38% (10.3673 => 14.5534, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 26.26% (0.1622 => 0.2048, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.77% (2.2022 => 2.5274, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.46% (7.0540 => 8.0737, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.96% (1.1194 => 1.2533, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.82% (1.7609 => 1.9515, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 9.17% (0.3282 => 0.3583, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.95% (0.3473 => 0.3784, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.89% (0.3543 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3497 => 0.3802, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.65% (0.3516 => 0.3820, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.52% (0.3828 => 0.4154, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.45% (0.3927 => 0.4259, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3694 => 0.4006, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.26% (0.3886 => 0.4207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.18% (0.1625 => 0.1758, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.29% (10.4361 => 11.1966, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/chomp: 7.19% (0.1655 => 0.1774, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 6.99% (9.4845 => 10.1471, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.78% (0.4879 => 0.5210, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 6.50% (0.7433 => 0.7916, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4615 => 0.4904, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.23% (0.2554 => 0.2713, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.09% (0.7115 => 0.7548, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 6.06% (5.7591 => 6.1080, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.94% (0.2271 => 0.2406, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5860 => 0.6207, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (8.1363 => 8.6100, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.81% (0.6675 => 0.7063, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (4.2646 => 4.5122, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.3050 => 1.3791, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.63% (0.8172 => 0.8632, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 5.59% (3.3354 => 3.5217, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5569 => 0.5876, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.48% (1.5415 => 1.6260, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.47% (0.5105 => 0.5384, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.38% (0.3121 => 0.3289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8067 => 0.8500, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (4.9449 => 5.2103, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (5.0018 => 5.2702, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (0.3092 => 0.3256, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.30% (0.7835 => 0.8250, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.24% (0.9765 => 1.0277, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2241, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 5.00% (0.3180 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.97% (0.3136 => 0.3292, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (7.9617 => 8.3513, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2603 => 0.2729, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.78% (1.5603 => 1.6349, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 4.77% (0.4299 => 0.4504, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.75% (0.3387 => 0.3548, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.73% (0.6030 => 0.6315, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.73% (0.5925 => 0.6205, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 4.64% (3.8723 => 4.0520, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.57% (1.1861 => 1.2403, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.55% (1.0722 => 1.1210, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4636 => 0.4840, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.4103 => 0.4283, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.3422 => 0.3572, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.4064 => 0.4240, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.30% (21.9371 => 22.8813, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3650 => 0.3806, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6456 => 0.6729, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.3826 => 0.3987, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.20% (2.0273 => 2.1125, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.08% (0.2891 => 0.3009, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5981 => 0.6225, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.06% (0.6450 => 0.6712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.01% (0.7326 => 0.7620, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.99% (0.4289 => 0.4460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3865 => 0.4019, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.97% (2.2969 => 2.3880, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8921 => 0.9265, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.2905 => 0.3017, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4203 => 0.4364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4620 => 0.4792, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.69% (0.3603 => 0.3736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.3098 => 0.3212, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.66% (0.2756 => 0.2857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276) SingleSource/Benchmarks/Shootout-C++/wc: 3.60% (0.3052 => 0.3162, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0665 => 2.1409, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.57% (1.5859 => 1.6425, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.55% (0.2871 => 0.2973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.4186 => 1.4687, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3684 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (14.3668 => 14.8433, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.2024 => 2.2717, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.1840 => 1.2174, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.8101 => 0.8289, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.22% (1.2842 => 1.3127, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3822, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3514, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2333, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7885, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2304, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.59% (5.3855 => 3.8997, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.18% (5.3526 => 3.8980, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1484, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.04% (2.9384 => 2.5846, std.dev.: 0.0174) MultiSource/Applications/ClamAV/clamscan: -8.65% (22.1758 => 20.2575, std.dev.: 0.0354) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2838, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7153, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -5.24% (1.5835 => 1.5005, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4987, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4372, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0038, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.33% (1.2373 => 1.2085, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0154, std.dev.: 0.0142) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5758, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.21% (6.2999 => 6.2234, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.61% (0.5229 => 0.5679, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 5.39% (14.9895 => 15.7980, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 3.82% (14.1553 => 14.6956, std.dev.: 0.0204) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (4.1105 => 4.3068, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.50% (1.1048 => 1.2208, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.99% (7.1582 => 7.3720, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.64% (3.4629 => 3.6583, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6222 => 0.6364, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 17:45:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 19:45:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919004535.72DBF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3982?compare_to=3979&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3982, Order: 164182, Start Time: 2012-09-18 23:36:29, End Time: 2012-09-19 00:47:01 To: 3979, Order: 164169, Start Time: 2012-09-18 22:09:09, End Time: 2012-09-18 23:20:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 21 (57 on baseline) Performance Improvements: 2 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 878 (792 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0286 => 0.0390, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.15% (0.2590 => 0.2801, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: 5.38% (8.3798 => 8.8303, std.dev.: 0.0800) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.1927 => 0.2030, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.82% (0.7554 => 0.7767, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.74% (0.4421 => 0.4542, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.5790 => 0.5912, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.05% (0.7127 => 0.7273, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7713 => 0.7868, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1652 => 1.1883, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.97% (0.7064 => 0.7203, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.64% (3.0777 => 3.1283, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 1.64% (1.3354 => 1.3573, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (1.4437 => 1.4641, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (6.2427 => 6.3226, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.0290 => 2.0532, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 2.84% (4.3280 => 4.4509, std.dev.: 0.0396) MultiSource/Applications/SPASS/SPASS: 1.46% (8.2872 => 8.4084, std.dev.: 0.0416) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.6589 => 4.7224, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 1.13% (6.9227 => 7.0010, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.12% (42.4403 => 42.9137, std.dev.: 0.0838) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.71% (22.5916 => 21.7540, std.dev.: 0.2467) SingleSource/Benchmarks/Misc/mandel-2: -3.23% (3.1531 => 3.0512, std.dev.: 0.0310) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.23% (0.9894 => 0.9871, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.37% (0.5914 => 0.5995, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1653 => 0.1646, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.17% (0.1537 => 0.1555, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (0.2995 => 0.3042, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.91% (0.2299 => 0.2343, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (0.3112 => 0.3152, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.66% (0.2262 => 0.2247, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0447 => 0.0449, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.38% (0.0084 => 0.0082, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 2.30% (0.0087 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.48% (0.0203 => 0.0200, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.53% (0.0190 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.11% (0.0360 => 0.0320, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 42.58% (0.0209 => 0.0298, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.72% (0.0279 => 0.0281) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.63% (0.0318 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 31.30% (0.0131 => 0.0172, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: 0.81% (0.0246 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 1.56% (0.0321 => 0.0326, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1419 => 0.1422, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.42% (1.4236 => 1.5293, std.dev.: 0.0100) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.29% (0.1419 => 0.1494, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.59% (0.4028 => 0.4213, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.00% (0.1401 => 0.1443, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0612 => 0.0613, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.39% (0.0213 => 0.0193, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.60% (0.0556 => 0.0576, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.74% (1.1229 => 1.1312, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.32% (0.0019 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.26% (0.0594 => 0.0539, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.05% (0.0172 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.7676 => 0.7656, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.05% (1.5990 => 1.5982, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.96% (4.1772 => 3.0512, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.54% (0.0745 => 0.0898, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.88% (0.6410 => 0.6851, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 6.10% (2.1763 => 2.3091, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/bigfib: 5.22% (0.5309 => 0.5586, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.66% (0.3582 => 0.3749, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 4.34% (1.1653 => 1.2159, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.31% (0.6173 => 0.6439, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.6915 => 0.7203, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.04% (0.2552 => 0.2655, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 3.89% (1.0046 => 1.0437, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 3.85% (15.3105 => 15.9003, std.dev.: 0.1281) MultiSource/Benchmarks/Bullet/bullet: 2.67% (29.3170 => 30.0986, std.dev.: 0.1351) MultiSource/Applications/hbd/hbd: 2.30% (1.3268 => 1.3573, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7722 => 0.7868, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 1.84% (13.3238 => 13.5692, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.81% (1.1672 => 1.1883, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.0758 => 3.1283, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.4408 => 1.4641, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.57% (1.1827 => 1.2013, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 1.44% (2.0972 => 2.1275, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (12.6413 => 12.8238, std.dev.: 0.0161) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.6079 => 14.7771, std.dev.: 0.0309) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2546 => 6.3226, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.0317 => 2.0532, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.39% (0.0263 => 0.0385, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.20% (4.0101 => 4.5795, std.dev.: 0.0454) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.79% (0.2857 => 0.3108, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6028, std.dev.: 0.0394) SingleSource/Benchmarks/Stanford/Puzzle: 8.09% (0.1433 => 0.1549, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.10% (0.7609 => 0.8073, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.01% (40.4792 => 42.9137, std.dev.: 0.0838) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (4.2129 => 4.4509, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8205, std.dev.: 0.0555) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.69% (3.4080 => 3.5337, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8734, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.93% (0.6308 => 0.6493, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.91% (0.5876 => 0.6047, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8957, std.dev.: 0.0430) MultiSource/Benchmarks/sim/sim: 2.78% (3.8907 => 3.9989, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.54% (2.6656 => 2.7334, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.38% (4.6127 => 4.7224, std.dev.: 0.0137) MultiSource/Applications/siod/siod: 2.29% (3.5520 => 3.6332, std.dev.: 0.0295) SingleSource/Benchmarks/Dhrystone/dry: 2.22% (2.4013 => 2.4546, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.55% (1.4184 => 1.4404, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.13% (2.4455 => 2.4731, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.04% (27.1724 => 27.4559, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.03% (2.9152 => 2.9452, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.58% (0.7738 => 0.7538, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.83% (0.3497 => 0.2104, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.19% (5.2665 => 4.0979, std.dev.: 0.0889) SingleSource/Benchmarks/Shootout-C++/ary3: -20.57% (1.7473 => 1.3878, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.42% (1.1647 => 0.9618, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.57% (15.8312 => 13.2085, std.dev.: 0.1553) MultiSource/Applications/sgefa/sgefa: -13.35% (0.3746 => 0.3246, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.96% (3.2007 => 2.9139, std.dev.: 0.0319) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.21% (1.4034 => 1.2882, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3748, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: -6.76% (3.4230 => 3.1917, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3288, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -6.48% (1.4441 => 1.3505, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8734, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9300, std.dev.: 0.0788) SingleSource/Benchmarks/Shootout/fib2: -5.17% (4.4195 => 4.1909, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: -4.62% (0.2664 => 0.2541, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.16% (7.6833 => 7.3635, std.dev.: 0.0125) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.65% (1.2722 => 1.2258, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.2959 => 1.2514, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/misr: -3.38% (0.4296 => 0.4151, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (1.4021 => 1.3553, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/methcall: -2.95% (9.2503 => 8.9770, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8294, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.73% (0.4140 => 0.4027, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2874, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.53% (3.7496 => 3.6547, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4179, std.dev.: 0.0014) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3639, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1520, std.dev.: 0.3082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2330, std.dev.: 0.0237) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -1.45% (8.5323 => 8.4084, std.dev.: 0.0416) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3150, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -1.26% (2.4971 => 2.4657, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.17% (1.8739 => 1.8520, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.09% (0.9980 => 0.9871, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -0.45% (0.6022 => 0.5995, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -1.20% (0.1666 => 0.1646, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.33% (0.3083 => 0.3042, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.13% (0.2394 => 0.2343, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.72% (0.3175 => 0.3152, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.39% (0.2302 => 0.2247, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -7.87% (0.0089 => 0.0082, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.67% (0.0240 => 0.0200, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.95% (0.0390 => 0.0320, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -8.99% (0.0189 => 0.0172, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.82% (1.5019 => 1.5293, std.dev.: 0.0100) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.20% (0.4264 => 0.4213, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.1344 => 0.1443, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.81% (0.0232 => 0.0193, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.86% (0.0639 => 0.0576, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1350 => 1.1312, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0006 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.38% (0.0637 => 0.0539, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.36% (0.0246 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.52% (0.7541 => 0.7656, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.03% (1.5363 => 1.5982, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 18:06:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 20:06:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919010620.EAF352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3983?compare_to=3980&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3983, Order: 164182, Start Time: 2012-09-18 23:53:13, End Time: 2012-09-19 01:07:43 To: 3980, Order: 164169, Start Time: 2012-09-18 22:10:14, End Time: 2012-09-18 23:24:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.51% (27.5621 => 29.6312, std.dev.: 0.0580) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.48% (2.0176 => 2.4106, std.dev.: 0.0151) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.50% (3.9660 => 4.3426, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.32% (0.7038 => 0.7694, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.90% (0.2596 => 0.2827, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.72% (0.9199 => 1.0001, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 8.71% (1.3693 => 1.4886, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.64% (0.6959 => 0.7560, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.7710 => 0.8372, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.53% (0.5265 => 0.5714, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.52% (1.2193 => 1.3232, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.32% (0.4328 => 0.4688, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.17% (1.1364 => 1.2293, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.15% (0.5818 => 0.6292, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9340, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.05% (1.4563 => 1.5736, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7061 => 0.7616, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.5577 => 0.6013, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5748 => 0.6194, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.57% (1.0313 => 1.1094, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.46% (0.4062 => 0.4365, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.34% (0.3899 => 0.4185, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.32% (1.1061 => 1.1871, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2127 => 0.2277, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.05% (0.7506 => 0.8035, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.02% (3.8646 => 4.1358, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.99% (0.8310 => 0.8891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.97% (0.3485 => 0.3728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.82% (0.3022 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.82% (7.2180 => 7.7100, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 6.80% (0.3293 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3580 => 0.3823, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.76% (0.3756 => 0.4010, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.72% (3.6692 => 3.9158, std.dev.: 0.0104) MultiSource/Applications/siod/siod: 6.70% (2.1791 => 2.3252, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.70% (0.2925 => 0.3121, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.55% (0.3220 => 0.3431, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4016 => 0.4277, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (1.9828 => 2.1112, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.40% (3.1889 => 3.3931, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.38% (0.4390 => 0.4670, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 6.36% (0.3868 => 0.4114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.21% (1.9270 => 2.0467, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.19% (0.2988 => 0.3173, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.15% (1.3245 => 1.4060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.08% (16.6129 => 17.6224, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 6.04% (1.0594 => 1.1234, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.01% (0.6576 => 0.6971, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4113 => 0.4353, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.2749 => 1.3487, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.79% (14.8535 => 15.7130, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.64% (0.8818 => 0.9315, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.59% (1.3813 => 1.4585, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4591, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.58% (0.8698 => 0.9183, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.2842 => 14.0162, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 5.50% (8.4961 => 8.9633, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6135 => 0.6469, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.35% (0.2859 => 0.3012, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6136, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.33% (4.4433 => 4.6800, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.14% (4.6629 => 4.9025, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: 5.12% (0.4003 => 0.4208, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.05% (1.1333 => 1.1905, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.01% (0.3789 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.01% (0.3914 => 0.4110, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.95% (0.3578 => 0.3755, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.94% (0.3663 => 0.3844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3755 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.90% (0.3940 => 0.4133, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.88% (0.3646 => 0.3824, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.87% (14.5298 => 15.2372, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 4.86% (6.5754 => 6.8949, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 4.86% (0.3623 => 0.3799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.83% (0.3601 => 0.3775, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.77% (0.3650 => 0.3824, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.70% (3.2742 => 3.4280, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.68% (0.3245 => 0.3397, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.41% (4.9865 => 5.2065, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.30% (0.9108 => 0.9500, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2794, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.01% (1.5188 => 1.5797, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.4805 => 0.4993, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 3.90% (3.7467 => 3.8927, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6250 => 0.6483, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.1007 => 2.1733, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 3.31% (33.2944 => 34.3967, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (6.2785 => 6.4844, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5121, std.dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5197, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std.dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4125, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.18% (10.7476 => 11.0889, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5990, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.41% (3.7731 => 3.8264, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (3.6469 => 3.6883, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5881, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.72% (0.4657 => 0.3832) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.56% (22.5627 => 21.7589, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2678, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std.dev.: 0.0065) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5104, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9216, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6078, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.25% (26.5159 => 25.9191, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2404, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2385, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2249, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0625, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4350, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2632, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 18:50:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 20:50:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919015046.4EB062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3984?compare_to=3981&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3984, Order: 164182, Start Time: 2012-09-19 00:32:22, End Time: 2012-09-19 01:52:10 To: 3981, Order: 164173, Start Time: 2012-09-18 22:44:24, End Time: 2012-09-19 00:03:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (118 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.83% (0.3888 => 0.4270, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: 3.47% (14.5534 => 15.0578, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.7625 => 56.5112, std.dev.: 0.1225) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.5679 => 0.5689, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 0.28% (15.7980 => 15.8425, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: -0.11% (14.6956 => 14.6796, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 0.01% (82.9051 => 82.9154, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.3068 => 4.3050, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2208 => 1.2222, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.3720 => 7.3794, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.14% (3.6583 => 3.6530, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.6364 => 0.6351, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.10% (63.2438 => 82.9154, std.dev.: 0.0205) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14255.14% (0.0720 => 10.3357, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.24% (10.3673 => 15.0578, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 26.82% (0.1622 => 0.2057, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.20% (2.2022 => 2.5149, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.91% (7.0540 => 8.0352, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.23% (1.1194 => 1.2563, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.98% (1.7609 => 1.9542, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 9.05% (0.3282 => 0.3579, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.09% (0.3473 => 0.3754, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.90% (0.3543 => 0.3823, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.85% (0.3543 => 0.3821, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.83% (0.3561 => 0.3840, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.81% (0.3828 => 0.4127, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.81% (0.3497 => 0.3770, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.76% (10.4361 => 11.2457, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/for-in: 7.72% (0.3694 => 0.3979, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.61% (0.3927 => 0.4226, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 7.59% (0.3886 => 0.4181, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.99% (9.4845 => 10.1470, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7433 => 0.7930, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 6.30% (0.7115 => 0.7563, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.11% (0.3423 => 0.3632, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.00% (0.4615 => 0.4892, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5860 => 0.6210, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.2554 => 0.2706, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.94% (0.2271 => 0.2406, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.92% (0.6675 => 0.7070, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.87% (5.7591 => 6.0973, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (4.2646 => 4.5143, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (1.5415 => 1.6313, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.81% (3.3354 => 3.5293, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.5105 => 0.5401, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (1.3050 => 1.3802, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.64% (0.9765 => 1.0316, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5569 => 0.5883, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.61% (8.1363 => 8.5925, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.8067 => 0.8517, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 5.53% (0.7835 => 0.8268, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.52% (0.8172 => 0.8623, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.4103 => 0.4327, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.32% (5.0018 => 5.2679, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (4.9449 => 5.2065, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 5.27% (0.3092 => 0.3255, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 5.11% (1.1642 => 1.2237, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.94% (0.3441 => 0.3611, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.87% (0.3180 => 0.3335, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.80% (1.0722 => 1.1237, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.78% (3.8723 => 4.0575, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (7.9617 => 8.3354, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.5020 => 0.5253, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.59% (1.1861 => 1.2405, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 4.47% (0.4299 => 0.4491, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 4.43% (2.2969 => 2.3986, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 4.38% (1.5603 => 1.6286, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 4.35% (21.9371 => 22.8914, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.29% (0.6450 => 0.6727, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.25% (2.0273 => 2.1134, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 4.20% (0.5925 => 0.6174, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5981 => 0.6232, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8921 => 0.9291, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6456 => 0.6723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.11% (0.6030 => 0.6278, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.01% (1.5859 => 1.6495, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.4064 => 0.4222, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3422 => 0.3555, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4636 => 0.4812, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.70% (0.3162 => 0.3279, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.63% (0.7326 => 0.7592, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.4186 => 1.4700, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.2024 => 2.2795, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3865 => 0.4000, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (14.3668 => 14.8627, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4620 => 0.4772, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.4203 => 0.4341, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.1840 => 1.2215, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 3.14% (0.3283 => 0.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4048 => 0.4174, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.02% (0.3935 => 0.4054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.90% (2.0665 => 2.1265, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.8101 => 0.8282, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.2842 => 1.3051, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.88% (1.1145 => 1.3695, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0042) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3813, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3452, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2277, std.dev.: 0.0359) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.62% (5.2763 => 3.2386, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.76% (5.3855 => 3.8906, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8885, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1919, std.dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.81% (2.9384 => 2.5915, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -8.45% (22.1758 => 20.3009, std.dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2862, std.dev.: 0.0741) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7163, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4067, std.dev.: 0.0200) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5056, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9845, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.20% (1.2373 => 1.2101, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9932, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -1.46% (4.6441 => 4.5764, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2291, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.80% (0.5229 => 0.5689, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 5.69% (14.9895 => 15.8425, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 3.70% (14.1553 => 14.6796, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 4.73% (4.1105 => 4.3050, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.63% (1.1048 => 1.2222, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.09% (7.1582 => 7.3794, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.49% (3.4629 => 3.6530, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.6222 => 0.6351, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 18:56:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 20:56:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919015636.9A88C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3985?compare_to=3978&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3985, Order: 164178, Start Time: 2012-09-18 23:13:49, End Time: 2012-09-19 01:57:57 To: 3978, Order: 164158, Start Time: 2012-09-18 19:59:06, End Time: 2012-09-18 22:42:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.48% (0.2144 => 0.2283, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.2147 => 0.2248, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -14.33% (0.4612 => 0.3951, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: -1.53% (0.7538 => 0.7423, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3465 => 0.3773, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3442 => 0.3747, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.82% (0.3446 => 0.3750, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3488 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.72% (0.3496 => 0.3801, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3469 => 0.3770, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3460 => 0.3760, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.44% (0.3650 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.37% (0.3643 => 0.3948, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.30% (1.5932 => 1.7255, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.3724 => 0.4032, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (0.4361 => 0.4630, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (1.6211 => 1.7192, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.84% (1.3152 => 1.3920, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (0.4994 => 0.5270, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 5.43% (5.5417 => 5.8424, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 5.42% (0.2566 => 0.2705, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.40% (3.5627 => 3.7552, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.38% (2.7292 => 2.8761, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 5.31% (1.0781 => 1.1354, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (0.5000 => 0.5261, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.2866 => 0.3012, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.07% (23.5202 => 24.7116, std.dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.00% (0.2738 => 0.2875, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.81% (4.2109 => 4.4133, std.dev.: 0.0046) MultiSource/Applications/siod/siod: 4.78% (0.6634 => 0.6951, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.76% (0.3004 => 0.3147, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 4.71% (0.2780 => 0.2911, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 4.70% (0.5826 => 0.6100, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.66% (0.3195 => 0.3344, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.65% (0.5546 => 0.5804, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (4.4195 => 4.6241, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.63% (0.2875 => 0.3008, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.60% (0.9909 => 1.0365, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 4.59% (0.2811 => 0.2940, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.57% (0.5889 => 0.6158, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.4139 => 0.4328, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (1.8794 => 1.9643, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2813 => 0.2939, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.46% (4.6177 => 4.8237, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (2.1013 => 2.1949, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (2.0673 => 2.1589, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (0.3890 => 0.4062, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2792 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.40% (0.3271 => 0.3415, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2750 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.34% (1.4269 => 1.4888, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 4.33% (0.3258 => 0.3399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.32% (0.3124 => 0.3259, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.31% (2.1653 => 2.2586, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (0.3625 => 0.3780, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3348 => 0.3491, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.3096 => 0.3228, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.3903 => 0.4069, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.24% (0.3726 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.3362 => 0.3504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.17% (0.4029 => 0.4197, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 4.08% (0.3336 => 0.3472, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4146 => 0.4315, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.03% (0.3477 => 0.3617, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.02% (0.4251 => 0.4422, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.02% (0.3084 => 0.3208, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.02% (0.5900 => 0.6137, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 3.99% (0.5012 => 0.5212, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.95% (0.6435 => 0.6689, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3282 => 0.3411, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (0.4658 => 0.4840, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.85% (0.9697 => 1.0070, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.2969 => 0.3083, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.79% (0.3690 => 0.3830, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.3845 => 0.3990, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.69% (2.0346 => 2.1096, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.3981 => 0.4124, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.51% (0.7171 => 0.7423, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.45% (0.7875 => 0.8147, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.42% (0.7426 => 0.7680, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (1.9694 => 2.0363, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.40% (1.9966 => 2.0644, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.17% (0.5361 => 0.5531, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (0.5584 => 0.5755, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.68% (11.6398 => 11.9515, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (4.6926 => 4.8160, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6763, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std.dev.: 0.0411) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6321, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1914, std.dev.: 0.0078) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5033, std.dev.: 0.0262) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4403, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6042, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5803, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7819, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8009, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.7992, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5777, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9745, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 19:31:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 21:31:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919023116.B463A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3986?compare_to=3982&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3986, Order: 164185, Start Time: 2012-09-19 01:21:23, End Time: 2012-09-19 02:32:41 To: 3982, Order: 164182, Start Time: 2012-09-18 23:36:29, End Time: 2012-09-19 00:47:01 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (43 on baseline) Performance Improvements: 3 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 7.51% (3.0265 => 3.2538, std.dev.: 0.0833) SingleSource/Benchmarks/Misc/mandel-2: 2.51% (3.0512 => 3.1279, std.dev.: 0.0248) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.16% (13.2085 => 13.4942, std.dev.: 0.0662) SingleSource/Benchmarks/Misc/ReedSolomon: 1.77% (8.7130 => 8.8669, std.dev.: 0.0261) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -3.47% (0.3082 => 0.2975, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.97% (0.7767 => 0.7614, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.93% (42.9137 => 40.3709, std.dev.: 0.9569) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.32% (0.9871 => 0.9839, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -0.18% (0.5995 => 0.5984, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -2.37% (0.1646 => 0.1607, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.67% (0.1555 => 0.1498, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.43% (0.3042 => 0.3055, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.30% (0.2343 => 0.2289, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.67% (0.3152 => 0.3173, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.69% (0.2247 => 0.2285, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -16.70% (0.0449 => 0.0374, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: 6.10% (0.0082 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 21.00% (0.0200 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0189 => 0.0190, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.06% (0.0320 => 0.0381, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0298 => 0.0300, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.07% (0.0281 => 0.0284, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0320 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -12.99% (0.0177 => 0.0154, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -22.09% (0.0172 => 0.0134, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: 2.02% (0.0248 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -1.23% (0.0326 => 0.0322, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1422 => 0.1422, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -8.89% (1.5293 => 1.3934, std.dev.: 0.0423) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.61% (0.1494 => 0.1440, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.20% (0.4213 => 0.4078, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.32% (0.1443 => 0.1424, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.0613 => 0.0576, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.58% (0.0193 => 0.0225, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.26% (0.0576 => 0.0563, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1312 => 1.1293, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0024 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.13% (0.0539 => 0.0599, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.04% (0.0191 => 0.0168, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.7656 => 0.7660, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.12% (1.5982 => 1.6001, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.12% (4.1772 => 3.1279, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/except: 82766.67% (0.0006 => 0.4972, std.dev.: 0.0017) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.64% (0.6410 => 0.6900, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.5309 => 0.5649, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: 6.02% (2.1763 => 2.3074, std.dev.: 0.0328) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3582 => 0.3747, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.2552 => 0.2661, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.07% (0.6173 => 0.6424, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (1.1653 => 1.2099, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 3.54% (1.0046 => 1.0402, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5150 => 1.5560, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (12.6413 => 12.9427, std.dev.: 0.0504) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.72% (1.2021 => 1.2228, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.59% (3.0225 => 3.0706, std.dev.: 0.0146) MultiSource/Applications/hbd/hbd: 1.48% (1.3268 => 1.3464, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.05% (0.0263 => 0.0392, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/pi: 41.12% (1.6538 => 2.3339, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.32% (0.0766 => 0.0891, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 15.44% (21.1721 => 24.4420, std.dev.: 0.9340) SingleSource/Benchmarks/Shootout/ary3: 15.19% (1.7426 => 2.0073, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.73% (4.0101 => 4.5605, std.dev.: 0.0539) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.73% (7.0025 => 7.6137, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.12% (0.3301 => 0.3569, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.57% (0.2694 => 0.2898, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.54% (3.0256 => 3.2538, std.dev.: 0.0833) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.16% (0.7609 => 0.8078, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 4.18% (8.5113 => 8.8669, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/dt: 4.08% (0.9851 => 1.0253, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8232, std.dev.: 0.0598) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.01% (0.5876 => 0.6053, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8921, std.dev.: 0.0292) MultiSource/Benchmarks/sim/sim: 2.66% (3.8907 => 3.9941, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.52% (2.4042 => 2.4647, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/whetstone: 2.45% (2.3453 => 2.4028, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.4013 => 2.4528, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 2.02% (3.5520 => 3.6237, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.18% (0.7784 => 0.7614, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.95% (0.7738 => 0.7587, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.89% (0.3497 => 0.2102, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.02% (5.2665 => 4.1070, std.dev.: 0.0785) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9599, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.76% (15.8312 => 13.4942, std.dev.: 0.0662) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.89% (1.4034 => 1.2786, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.93% (3.2007 => 2.9468, std.dev.: 0.0846) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3750, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: -6.83% (3.4230 => 3.1893, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (4.6355 => 4.3249, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3519, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7921, std.dev.: 0.0395) MultiSource/Benchmarks/mafft/pairlocalalign: -5.39% (62.4126 => 59.0514, std.dev.: 0.0913) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1882, std.dev.: 0.0293) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.17% (7.6833 => 7.3627, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/distray/distray: -4.13% (0.2664 => 0.2554, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.92% (1.2722 => 1.2223, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.71% (1.4021 => 1.3501, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.2959 => 1.2521, std.dev.: 0.0162) SingleSource/Benchmarks/McGill/misr: -3.07% (0.4296 => 0.4164, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -3.03% (9.2503 => 8.9702, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.00% (0.4140 => 0.4016, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8297, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std.dev.: 0.0271) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.55% (3.7496 => 3.6538, std.dev.: 0.0243) MultiSource/Benchmarks/FreeBench/neural/neural: -2.54% (1.0926 => 1.0648, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.50% (45.4683 => 44.3314, std.dev.: 0.3657) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.27% (1.1683 => 1.1418, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -1.93% (3.4286 => 3.3623, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4214, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3141, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (9.3855 => 9.2185, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -1.63% (2.4971 => 2.4565, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3106, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.24% (2.8964 => 2.8604, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.41% (0.9980 => 0.9839, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6022 => 0.5984, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -3.54% (0.1666 => 0.1607, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.60% (0.1554 => 0.1498, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.91% (0.3083 => 0.3055, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.39% (0.2394 => 0.2289, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3175 => 0.3173, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.74% (0.2302 => 0.2285, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -16.70% (0.0449 => 0.0374, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.31% (0.0390 => 0.0381, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -12.99% (0.0177 => 0.0154, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -29.10% (0.0189 => 0.0134, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -7.22% (1.5019 => 1.3934, std.dev.: 0.0423) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.06% (0.1501 => 0.1440, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.36% (0.4264 => 0.4078, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.95% (0.1344 => 0.1424, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.21% (0.0589 => 0.0576, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.02% (0.0232 => 0.0225, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.89% (0.0639 => 0.0563, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1350 => 1.1293, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.0637 => 0.0599, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (0.0246 => 0.0168, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.15% (1.5363 => 1.6001, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 19:49:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 21:49:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919024913.BC29C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3987?compare_to=3983&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3987, Order: 164185, Start Time: 2012-09-19 01:36:10, End Time: 2012-09-19 02:50:37 To: 3983, Order: 164182, Start Time: 2012-09-18 23:53:13, End Time: 2012-09-19 01:07:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (165 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.79% (78.2380 => 80.4200, std.dev.: 0.4055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.55% (55.0999 => 56.5047, std.dev.: 0.0901) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.45% (2.0176 => 2.4101, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.40% (3.9660 => 4.3388, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.26% (0.1588 => 0.1735, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.19% (0.7038 => 0.7685, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.89% (0.2721 => 0.2963) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.73% (1.3693 => 1.4889, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.63% (0.9199 => 0.9993, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.60% (0.7710 => 0.8373, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.58% (0.6959 => 0.7556, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.57% (0.5265 => 0.5716, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.47% (1.2193 => 1.3226, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.36% (0.4328 => 0.4690, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.16% (1.1364 => 1.2291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.13% (1.4563 => 1.5747, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.5818 => 0.6287, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.03% (13.8202 => 14.9304, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.76% (0.7061 => 0.7609, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5577 => 0.6007, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.70% (0.6283 => 0.6767, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.67% (0.5748 => 0.6189, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.54% (1.0313 => 1.1091, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1435 => 0.1541, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.31% (0.4791 => 0.5141, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3899 => 0.4182, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1848, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.10% (0.5637 => 0.6037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.01% (0.4379 => 0.4686, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.97% (0.8310 => 0.8889, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2127 => 0.2274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.91% (0.3489 => 0.3730, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.88% (3.6692 => 3.9216, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 6.85% (3.8646 => 4.1293, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.77% (0.3485 => 0.3721, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.71% (0.3756 => 0.4008, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.70% (7.2180 => 7.7015, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.66% (0.7460 => 0.7957, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.57% (0.7506 => 0.7999, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 6.50% (2.1791 => 2.3208, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/lists: 6.50% (0.3293 => 0.3507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4016 => 0.4276, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3220 => 0.3428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.44% (1.9828 => 2.1104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3107 => 0.3306, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.35% (0.3149 => 0.3349, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.33% (0.2765 => 0.2940, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.30% (0.6744 => 0.7169, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.28% (0.3868 => 0.4111, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4390 => 0.4665, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.23% (3.1889 => 3.3875, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.22% (1.9270 => 2.0469, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.07% (1.0594 => 1.1237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.3245 => 1.4042, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.98% (0.6576 => 0.6969, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.96% (16.6129 => 17.6030, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (1.2749 => 1.3499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.3534 => 0.3739, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.76% (0.4113 => 0.4350, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.75% (14.8535 => 15.7069, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.8698 => 0.9176, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.47% (0.8818 => 0.9300, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.45% (8.4961 => 8.9593, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (1.3819 => 1.4570, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.3813 => 1.4563, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.40% (13.2842 => 14.0017, std.dev.: 0.0276) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6135 => 0.6464, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.33% (4.4433 => 4.6801, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6134, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 5.30% (0.3131 => 0.3297, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.19% (0.2504 => 0.2634, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (1.1333 => 1.1916, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.12% (4.6629 => 4.9015, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.92% (0.4003 => 0.4200, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 4.88% (0.3789 => 0.3974, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.88% (14.5298 => 15.2388, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 4.86% (0.3578 => 0.3752, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.85% (0.3646 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.83% (0.3601 => 0.3775, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.83% (6.5754 => 6.8927, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.80% (0.3663 => 0.3839, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.79% (3.2742 => 3.4309, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 4.77% (0.3940 => 0.4128, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.68% (0.3650 => 0.3821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.66% (0.3623 => 0.3792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.59% (0.3245 => 0.3394, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.22% (4.9865 => 5.1969, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.22% (0.9108 => 0.9492, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.2292 => 1.2785, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.5188 => 1.5785, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.4805 => 0.4993, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 3.87% (3.7467 => 3.8916, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6250 => 0.6483, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.1007 => 2.1697, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.2785 => 6.4836, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 3.24% (33.2944 => 34.3719, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.55% (16.2614 => 16.5133, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std.dev.: 0.0485) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 8.00% (3.1736 => 3.4274, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0726, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5985, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (7.9275 => 8.0189, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5935, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.82% (0.4657 => 0.3827, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.66% (22.5627 => 21.7375, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2588, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.70% (1.3780 => 1.2994, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.58% (1.7688 => 1.7055, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9208, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5811, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8953, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2495, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.23% (4.1080 => 4.0576, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2422, std.dev.: 0.0291) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2365, std.dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 20:38:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 22:38:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919033856.2E76C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3988?compare_to=3984&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3988, Order: 164187, Start Time: 2012-09-19 02:20:47, End Time: 2012-09-19 03:40:20 To: 3984, Order: 164182, Start Time: 2012-09-19 00:32:22, End Time: 2012-09-19 01:52:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (126 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (722 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (15.0578 => 14.7122, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5689 => 0.5682, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: -0.12% (15.8425 => 15.8239, std.dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 0.23% (14.6796 => 14.7129, std.dev.: 0.0188) MultiSource/Benchmarks/Bullet/bullet: -0.26% (82.9154 => 82.6963, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.3050 => 4.3068, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2222 => 1.2220, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.25% (7.3794 => 7.3977, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.41% (3.6530 => 3.6681, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.6351 => 0.6360, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.76% (63.2438 => 82.6963, std.dev.: 0.0100) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14257.50% (0.0720 => 10.3374, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.91% (10.3673 => 14.7122, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 25.89% (0.1622 => 0.2042, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.71% (2.2022 => 2.5042, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.56% (7.0540 => 8.0102, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.34% (0.1432 => 0.1623, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.49% (1.7609 => 1.9457, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.90% (0.3473 => 0.3782, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3543 => 0.3850, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.62% (0.3282 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3561 => 0.3866, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3516 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3694 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.39% (0.3828 => 0.4149, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.35% (0.3927 => 0.4255, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.31% (0.1625 => 0.1760, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 8.26% (0.3886 => 0.4207, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.42% (10.4361 => 11.2106, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.01% (9.4845 => 10.1490, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7433 => 0.7919, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.30% (0.3109 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.16% (0.7115 => 0.7553, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.4615 => 0.4898, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.09% (5.7591 => 6.1100, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.6675 => 0.7073, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5860 => 0.6208, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.91% (0.8172 => 0.8655, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (4.2646 => 4.5113, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3423 => 0.3621, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.75% (0.5569 => 0.5889, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 5.72% (3.3354 => 3.5263, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.8067 => 0.8523, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.64% (0.5105 => 0.5393, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (8.1363 => 8.5918, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5415 => 1.6275, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9765 => 1.0288, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.28% (0.7835 => 0.8249, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (5.0018 => 5.2658, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.26% (4.9449 => 5.2048, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 5.11% (0.3092 => 0.3250, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.09% (1.1642 => 1.2235, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.5925 => 0.6223, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.89% (0.6030 => 0.6325, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.85% (0.3441 => 0.3608, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 4.84% (0.3180 => 0.3334, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.78% (1.0722 => 1.1234, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (7.9617 => 8.3367, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.70% (1.1861 => 1.2418, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.64% (3.8723 => 4.0519, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.54% (1.5603 => 1.6311, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6456 => 0.6735, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.29% (0.4103 => 0.4279, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.27% (0.3136 => 0.3270, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 4.26% (2.0273 => 2.1136, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.23% (0.4636 => 0.4832, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3422 => 0.3566, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.20% (0.7326 => 0.7634, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.19% (2.2969 => 2.3932, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.13% (0.8921 => 0.9289, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.11% (0.4064 => 0.4231, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.09% (21.9371 => 22.8343, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5859 => 1.6478, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.85% (0.5981 => 0.6211, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3650 => 0.3789, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.78% (0.4289 => 0.4451, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.64% (0.4620 => 0.4788, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.58% (0.2905 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.55% (0.3603 => 0.3731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.52% (2.2024 => 2.2799, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.4186 => 1.4684, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (14.3668 => 14.8688, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.4048 => 0.4186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.28% (0.3935 => 0.4064, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.26% (0.3162 => 0.3265, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (2.0665 => 2.1337, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.15% (0.3684 => 0.3800, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.02% (0.3379 => 0.3481, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.1840 => 1.2192, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.8101 => 0.8295, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.95% (1.2842 => 1.3093, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3810, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3442, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7902, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2278, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.67% (5.2763 => 3.2359, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.16% (5.3855 => 3.8690, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.72% (5.3526 => 3.8688, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1397, std.dev.: 0.0543) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.18% (2.9384 => 2.5804, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: -8.68% (22.1758 => 20.2506, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3055, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7174, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5840, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5059, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -2.94% (1.2373 => 1.2009, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4308, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0042, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0196, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4232, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5783, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.66% (0.5229 => 0.5682, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 5.57% (14.9895 => 15.8239, std.dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 3.94% (14.1553 => 14.7129, std.dev.: 0.0188) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (4.1105 => 4.3068, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.61% (1.1048 => 1.2220, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.35% (7.1582 => 7.3977, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.93% (3.4629 => 3.6681, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.6222 => 0.6360, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 20:58:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 22:58:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919035828.3B3C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3989?compare_to=3986&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3989, Order: 164196, Start Time: 2012-09-19 02:49:32, End Time: 2012-09-19 03:59:54 To: 3986, Order: 164185, Start Time: 2012-09-19 01:21:23, End Time: 2012-09-19 02:32:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (51 on baseline) Performance Improvements: 5 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.7598 => 0.7893, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.18% (0.5863 => 0.5991, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (0.7056 => 0.7183, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.57% (1.4107 => 1.4329, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.0616 => 1.0757, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 6.96% (3.2237 => 3.4481, std.dev.: 0.0349) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.26% (40.3709 => 42.0894, std.dev.: 0.3397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.09% (21.6252 => 22.2934, std.dev.: 0.2237) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.89% (59.0894 => 60.7968, std.dev.: 0.3948) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.15% (24.4420 => 22.9386, std.dev.: 0.5401) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.31% (13.4942 => 13.1831, std.dev.: 0.1037) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.63% (2.4322 => 2.3926, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (1.1418 => 1.1239, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -1.17% (3.1279 => 3.0913, std.dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.12% (0.9839 => 0.9949, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -0.10% (0.5984 => 0.5978, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 3.24% (0.1607 => 0.1659, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.20% (0.1498 => 0.1531, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (0.3055 => 0.2988, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.2289 => 0.2366, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (0.3173 => 0.3140, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.61% (0.2285 => 0.2271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 19.52% (0.0374 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.25% (0.0242 => 0.0193, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0190 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0381 => 0.0383, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.00% (0.0300 => 0.0294, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0320 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.60% (0.0154 => 0.0150, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 41.04% (0.0134 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.37% (0.0253 => 0.0259, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -11.49% (0.0322 => 0.0285, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1422 => 0.1425, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 7.91% (1.3934 => 1.5036, std.dev.: 0.0285) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.18% (0.1440 => 0.1457, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.89% (0.4078 => 0.4196, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.83% (0.1424 => 0.1398, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.03% (0.0576 => 0.0605, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.78% (0.0225 => 0.0212, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.37% (0.0563 => 0.0582, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1293 => 1.1235, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 8.33% (0.0012 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.18% (0.0599 => 0.0550, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.79% (0.0168 => 0.0165, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7660 => 0.7662, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.12% (1.6001 => 1.5981, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.00% (4.1772 => 3.0913, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -20.00% (0.0005 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.54% (0.0745 => 0.0898, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.39% (0.6410 => 0.6884, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 5.85% (2.1763 => 2.3037, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 5.39% (0.5309 => 0.5595, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.36% (0.3582 => 0.3774, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 4.03% (0.6173 => 0.6422, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.2552 => 0.2652, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.88% (0.6915 => 0.7183, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.67% (1.1653 => 1.2081, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.5150 => 1.5690, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 3.55% (1.0046 => 1.0403, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 3.00% (15.3105 => 15.7696, std.dev.: 0.1153) MultiSource/Benchmarks/Bullet/bullet: 2.39% (29.3170 => 30.0182, std.dev.: 0.0552) MultiSource/Applications/d/make_dparser: 1.92% (3.0225 => 3.0806, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.73% (0.7639 => 0.7771, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.61% (1.1827 => 1.2017, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.4113 => 1.4329, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (8.2186 => 8.3065, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 1.03% (2.0972 => 2.1188, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.28% (0.0766 => 0.0929, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.57% (1.7426 => 1.9965, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.07% (4.0101 => 4.5341, std.dev.: 0.0186) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.10% (0.0917 => 0.1028, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1433 => 0.1598, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.13% (0.2694 => 0.2940, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6109, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 8.34% (21.1721 => 22.9386, std.dev.: 0.5401) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.27% (1.0063 => 1.0895, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/heapsort: 7.22% (3.2159 => 3.4481, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (0.3301 => 0.3539, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8485, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/ReedSolomon: 4.00% (8.5113 => 8.8515, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.98% (40.4792 => 42.0894, std.dev.: 0.3397) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.71% (0.8498 => 0.8813, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8716, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: 3.56% (0.9851 => 1.0202, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.66% (14.4877 => 14.8724, std.dev.: 0.0631) MultiSource/Benchmarks/sim/sim: 2.62% (3.8907 => 3.9925, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: 2.52% (0.5004 => 0.5130, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.16% (3.5520 => 3.6286, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (2.4013 => 2.4506, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.68% (2.4042 => 2.4445, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.41% (4.6127 => 4.6779, std.dev.: 0.0226) SingleSource/Benchmarks/McGill/chomp: 1.22% (1.0194 => 1.0318, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.99% (0.7738 => 0.7507, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0918, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/ary3: -20.51% (1.7473 => 1.3890, std.dev.: 0.0291) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.1647 => 0.9604, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.73% (15.8312 => 13.1831, std.dev.: 0.1037) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1606, std.dev.: 0.0491) MultiSource/Applications/sgefa/sgefa: -11.19% (0.3746 => 0.3327, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: -8.41% (0.2664 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.91% (3.2007 => 2.9475, std.dev.: 0.0158) MultiSource/Applications/SIBsim4/SIBsim4: -6.91% (3.4230 => 3.1864, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3773, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3310, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9299, std.dev.: 0.0436) SingleSource/Benchmarks/Shootout/fib2: -5.41% (4.4195 => 4.1805, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -4.10% (0.4296 => 0.4120, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -4.00% (7.6833 => 7.3756, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.80% (1.1683 => 1.1239, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.72% (0.4140 => 0.3986, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.60% (1.2722 => 1.2264, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.24% (3.7496 => 3.6283, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8293, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/methcall: -2.69% (9.2503 => 9.0016, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.30% (1.8739 => 1.8308, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.17% (2.4457 => 2.3926, std.dev.: 0.0138) MultiSource/Applications/aha/aha: -1.99% (3.4286 => 3.3602, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4186, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: -1.97% (92.7467 => 90.9196, std.dev.: 0.1929) MultiSource/Benchmarks/NPB-serial/is/is: -1.94% (13.4743 => 13.2124, std.dev.: 0.0721) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2339, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/fldry: -1.47% (2.4971 => 2.4604, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3063, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: -1.22% (2.8599 => 2.8250, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: -1.02% (3.8200 => 3.7811, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.31% (0.9980 => 0.9949, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -0.73% (0.6022 => 0.5978, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1666 => 0.1659, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.48% (0.1554 => 0.1531, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.08% (0.3083 => 0.2988, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.17% (0.2394 => 0.2366, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (0.3175 => 0.3140, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.35% (0.2302 => 0.2271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -0.45% (0.0449 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.58% (0.0240 => 0.0193, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -15.25% (0.0177 => 0.0150, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 4.02% (0.0249 => 0.0259, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -12.31% (0.0325 => 0.0285, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1429 => 0.1425, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 0.11% (1.5019 => 1.5036, std.dev.: 0.0285) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.93% (0.1501 => 0.1457, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4264 => 0.4196, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1344 => 0.1398, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.72% (0.0589 => 0.0605, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.62% (0.0232 => 0.0212, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.01% (1.1350 => 1.1235, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (0.0246 => 0.0165, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.02% (1.5363 => 1.5981, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 21:31:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Sep 2012 23:31:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919043158.890932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3990?compare_to=3987&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3990, Order: 164196, Start Time: 2012-09-19 03:19:01, End Time: 2012-09-19 04:33:22 To: 3987, Order: 164185, Start Time: 2012-09-19 01:36:10, End Time: 2012-09-19 02:50:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.63% (2.0176 => 2.4137, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.55% (3.9660 => 4.3449, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.29% (0.7038 => 0.7692, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.95% (0.7710 => 0.8400, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.95% (0.5265 => 0.5736, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.89% (1.3693 => 1.4910, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.83% (0.9199 => 1.0011, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.72% (0.6959 => 0.7566, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5818 => 0.6322, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.65% (1.2193 => 1.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4328 => 0.4702, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7061 => 0.7664, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.32% (1.1364 => 1.2310, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.10% (1.4563 => 1.5743, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9336, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.91% (0.5577 => 0.6018, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.72% (0.6283 => 0.6768, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.65% (0.3580 => 0.3854, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.63% (1.0313 => 1.1100, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.2966 => 0.3192, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.47% (0.4390 => 0.4718, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.36% (0.3246 => 0.3485, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.32% (0.3756 => 0.4031, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4016 => 0.4308, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.25% (1.1061 => 1.1863, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.24% (0.2127 => 0.2281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.24% (1.9828 => 2.1263, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3293 => 0.3531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.17% (0.5637 => 0.6041, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.12% (0.8310 => 0.8902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.12% (0.2937 => 0.3146, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.11% (0.3149 => 0.3373, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.01% (7.2180 => 7.7242, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 6.93% (0.7506 => 0.8026, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.90% (0.3868 => 0.4135, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.88% (3.6692 => 3.9216, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3453 => 0.3689, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.83% (0.3192 => 0.3410, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.77% (0.2925 => 0.3123, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 6.75% (2.1791 => 2.3262, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.7460 => 0.7959, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.58% (0.3220 => 0.3432, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.46% (16.6129 => 17.6864, std.dev.: 0.0075) MultiSource/Applications/d/make_dparser: 6.33% (3.1889 => 3.3909, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.3245 => 1.4076, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 6.23% (1.9270 => 2.0470, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.20% (0.6576 => 0.6984, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.13% (1.0594 => 1.1243, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4113 => 0.4359, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (1.2749 => 1.3509, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.95% (0.4003 => 0.4241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.2945 => 0.3120, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3578 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3914 => 0.4143, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.84% (0.3646 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.81% (0.3789 => 0.4009, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.80% (14.8535 => 15.7154, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8698 => 0.9201, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 5.75% (0.3601 => 0.3808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.71% (0.3663 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3650 => 0.3858, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.63% (8.4961 => 8.9742, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.62% (0.8818 => 0.9314, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.62% (4.4433 => 4.6931, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.61% (0.6135 => 0.6479, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.58% (4.3801 => 4.6244, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.50% (1.3813 => 1.4573, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.47% (1.3819 => 1.4575, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.46% (0.2859 => 0.3015, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.45% (4.6629 => 4.9168, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (13.2842 => 14.0060, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (1.1333 => 1.1925, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.94% (6.5754 => 6.9005, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 4.87% (14.5298 => 15.2376, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.85% (3.2742 => 3.4331, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3245 => 0.3402, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.2292 => 1.2859, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.30% (0.9108 => 0.9500, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.30% (4.9865 => 5.2008, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.08% (0.6250 => 0.6505, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.5188 => 1.5785, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 3.91% (3.7467 => 3.8933, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (6.2785 => 6.4974, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.29% (2.1007 => 2.1699, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.07% (33.2944 => 34.3153, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5205, std.dev.: 0.0291) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5208, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4126, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0734, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5979, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5904, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.00% (1.4298 => 1.4441, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.64% (22.5627 => 21.7410, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2797, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1506, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9215, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5997, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.13% (26.5159 => 25.9518, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2533, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2422, std.dev.: 0.0281) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0598, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2280, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4359, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 22:08:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 00:08:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919050859.F1E752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3991?compare_to=3985&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3991, Order: 164191, Start Time: 2012-09-19 02:26:30, End Time: 2012-09-19 05:10:21 To: 3985, Order: 164178, Start Time: 2012-09-18 23:13:49, End Time: 2012-09-19 01:57:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.50% (2.4458 => 2.4825, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3446 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.55% (0.3488 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3465 => 0.3794, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3469 => 0.3797, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.44% (0.3442 => 0.3767, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3460 => 0.3785, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.21% (0.3650 => 0.3986, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3643 => 0.3977, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/parameter-passing: 9.10% (0.3724 => 0.4063, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.75% (1.5932 => 1.7326, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.30% (1.3152 => 1.3980, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (1.6211 => 1.7201, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (0.5000 => 0.5296, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.92% (3.5627 => 3.7736, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (0.4994 => 0.5286, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (0.4361 => 0.4615, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.67% (1.0781 => 1.1392, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2738 => 0.2890, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.54% (2.7292 => 2.8803, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/Hello: 5.49% (0.5826 => 0.6146, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2875 => 0.3029, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.33% (5.5417 => 5.8371, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 5.32% (0.9909 => 1.0436, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.31% (0.5889 => 0.6202, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (0.3195 => 0.3359, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (0.2823 => 0.2966, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.06% (0.3004 => 0.3156, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (0.3930 => 0.4127, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.99% (0.2566 => 0.2694, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.94% (4.2109 => 4.4191, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.91% (0.2750 => 0.2885, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.91% (0.2813 => 0.2951, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.2736 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.86% (0.2780 => 0.2915, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (2.0673 => 2.1675, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.84% (0.2811 => 0.2947, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3362 => 0.3524, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3060 => 0.3207, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.78% (23.5202 => 24.6452, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.76% (0.2729 => 0.2859, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3258 => 0.3413, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7171 => 0.7512, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3625 => 0.3797, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (4.4195 => 4.6282, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2803 => 0.2935, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.71% (0.2911 => 0.3048, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.71% (4.6177 => 4.8350, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3317 => 0.3473, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (0.5026 => 0.5262, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 4.68% (0.3096 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.66% (0.3348 => 0.3504, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 4.62% (0.3726 => 0.3898, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.61% (0.3124 => 0.3268, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.60% (0.3890 => 0.4069, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.4139 => 0.4328, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (1.8794 => 1.9647, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 4.52% (1.4269 => 1.4914, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 4.52% (0.3477 => 0.3634, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3690 => 0.3855, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 4.46% (0.6634 => 0.6930, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (2.1013 => 2.1948, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.43% (0.3903 => 0.4076, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (2.1653 => 2.2610, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 4.40% (0.3678 => 0.3840, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.40% (0.4251 => 0.4438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.39% (0.4146 => 0.4328, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.30% (0.6435 => 0.6712, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.29% (0.4029 => 0.4202, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.5900 => 0.6151, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.3084 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.25% (0.3981 => 0.4150, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.5012 => 0.5223, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.15% (0.5546 => 0.5776, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (0.4658 => 0.4848, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.02% (0.3336 => 0.3470, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (1.9694 => 2.0431, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.2737 => 0.2838, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.68% (2.0346 => 2.1094, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.2969 => 0.3077, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (1.9966 => 2.0685, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 3.54% (0.7875 => 0.8154, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.51% (0.7426 => 0.7687, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.37% (0.9697 => 1.0024, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 3.24% (0.4847 => 0.5004, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (0.5584 => 0.5760, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.13% (0.5361 => 0.5529, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (4.6926 => 4.8239, std.dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.79% (11.6398 => 11.9648, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.2122 => 0.2250, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6627, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1658, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6339, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1912, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2256, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4646, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.29% (7.1849 => 7.2778, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5787, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5148, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7857, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9600, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8537, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.80% (0.6293 => 0.6180, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9547, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 22:27:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 00:27:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919052703.B505D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3992?compare_to=3988&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3992, Order: 164196, Start Time: 2012-09-19 04:08:54, End Time: 2012-09-19 05:28:28 To: 3988, Order: 164187, Start Time: 2012-09-19 02:20:47, End Time: 2012-09-19 03:40:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (719 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.77% (79.4763 => 80.8840, std.dev.: 0.1416) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5682 => 0.5680, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: -0.02% (15.8239 => 15.8205, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: 0.11% (14.7129 => 14.7289, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: -0.02% (82.6963 => 82.6830, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3068 => 4.3092, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2220 => 1.2211, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (7.3977 => 7.3977, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.13% (3.6681 => 3.6633, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.6360 => 0.6365, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.74% (63.2438 => 82.6830, std.dev.: 0.0169) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.69% (0.0720 => 10.3289, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.91% (10.3673 => 14.7125, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 25.83% (0.1622 => 0.2041, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.72% (2.2022 => 2.5044, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.45% (7.0540 => 8.0028, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 13.34% (0.1432 => 0.1623, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.88% (0.1566 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.52% (1.7609 => 1.9462, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3473 => 0.3778, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.69% (0.3543 => 0.3851, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3543 => 0.3849, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.62% (0.3282 => 0.3565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.62% (0.3516 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3497 => 0.3798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.45% (0.3561 => 0.3862, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3694 => 0.4006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.31% (0.3828 => 0.4146, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.20% (0.3927 => 0.4249, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.08% (0.3886 => 0.4200, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.37% (10.4361 => 11.2056, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 7.17% (9.4845 => 10.1641, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.3177 => 0.3398, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.66% (0.7433 => 0.7928, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.5860 => 0.6246, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.43% (0.1695 => 0.1804, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.24% (0.7115 => 0.7559, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2554 => 0.2711, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 6.09% (5.7591 => 6.1099, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4615 => 0.4894, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (0.8172 => 0.8666, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.98% (0.6675 => 0.7074, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (4.2646 => 4.5120, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.8067 => 0.8534, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3423 => 0.3621, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.77% (0.2271 => 0.2402, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.70% (0.5105 => 0.5396, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.68% (1.5415 => 1.6291, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.65% (3.3354 => 3.5239, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5569 => 0.5883, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.59% (8.1363 => 8.5912, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.44% (0.2758 => 0.2908, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.38% (0.3121 => 0.3289, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.32% (0.7835 => 0.8252, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (5.0018 => 5.2658, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9765 => 1.0279, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.23% (4.9449 => 5.2037, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 5.15% (1.1642 => 1.2241, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.08% (0.3092 => 0.3249, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 4.95% (0.5925 => 0.6218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.89% (0.6030 => 0.6325, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.87% (1.0722 => 1.1244, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.82% (0.3441 => 0.3607, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (7.9617 => 8.3428, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 4.71% (3.8723 => 4.0548, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.69% (0.3387 => 0.3546, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (1.1861 => 1.2408, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.56% (0.4299 => 0.4495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.4103 => 0.4288, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.47% (1.5603 => 1.6300, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 4.30% (0.7326 => 0.7641, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.3422 => 0.3569, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6456 => 0.6733, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.28% (2.0273 => 2.1141, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.4636 => 0.4834, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.20% (0.6450 => 0.6721, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 4.20% (2.2969 => 2.3933, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8921 => 0.9290, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.12% (21.9371 => 22.8403, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.11% (0.4064 => 0.4231, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.5981 => 0.6218, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.95% (1.5859 => 1.6485, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3826 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3650 => 0.3790, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.80% (0.3865 => 0.4012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.78% (0.4289 => 0.4451, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4203 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.59% (0.4620 => 0.4786, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (1.4186 => 1.4688, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.52% (2.2024 => 2.2799, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (14.3668 => 14.8691, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sieve: 3.47% (0.3603 => 0.3728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.4048 => 0.4187, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.41% (0.3136 => 0.3243, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.39% (2.0665 => 2.1366, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.20% (0.3935 => 0.4061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.12% (0.3684 => 0.3799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 2.96% (0.3379 => 0.3479, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1840 => 1.2185, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.8101 => 0.8279, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3074, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4143, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7501, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3545, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2340, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3738, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.72% (5.2763 => 3.2333, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.15% (5.3855 => 3.8696, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.72% (5.3526 => 3.8688, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1227, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.08% (2.9384 => 2.5833, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: -8.66% (22.1758 => 20.2553, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2655, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5089, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4371, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.69% (1.2373 => 1.2040, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9883, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4230, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5781, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2259, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.62% (0.5229 => 0.5680, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 5.54% (14.9895 => 15.8205, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: 4.05% (14.1553 => 14.7289, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (4.1105 => 4.3092, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.53% (1.1048 => 1.2211, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.35% (7.1582 => 7.3977, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.79% (3.4629 => 3.6633, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.6222 => 0.6365, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 18 23:16:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 01:16:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919061648.D680D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3993?compare_to=3989&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3993, Order: 164199, Start Time: 2012-09-19 05:07:12, End Time: 2012-09-19 06:18:14 To: 3989, Order: 164196, Start Time: 2012-09-19 02:49:32, End Time: 2012-09-19 03:59:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (44 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 893 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.98% (0.0751 => 0.0856, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.97% (4.2932 => 4.4638, std.dev.: 0.0433) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.85% (2.7006 => 2.7505, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.46% (4.5102 => 4.5762, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.42% (1.5968 => 1.6195, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.36% (3.6283 => 3.6776, std.dev.: 0.0136) MultiSource/Benchmarks/NPB-serial/is/is: 1.04% (13.2124 => 13.3496, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -10.02% (22.9386 => 20.6412, std.dev.: 0.8082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.64% (0.9949 => 0.9885, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: 0.69% (0.5978 => 0.6019, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -0.78% (0.1659 => 0.1646, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.03% (0.1531 => 0.1454, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (0.2988 => 0.3029, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2366 => 0.2356, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (0.3140 => 0.3127, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.44% (0.2271 => 0.2281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -7.16% (0.0447 => 0.0415, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -47.19% (0.0089 => 0.0047, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.81% (0.0193 => 0.0176, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.90% (0.0191 => 0.0153, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0383 => 0.0383, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.52% (0.0294 => 0.0266, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.55% (0.0282 => 0.0272, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0321 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -36.67% (0.0150 => 0.0095, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -42.33% (0.0189 => 0.0109, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -5.41% (0.0259 => 0.0245, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -6.67% (0.0285 => 0.0266, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1425 => 0.1426, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.79% (1.5036 => 1.4165, std.dev.: 0.0604) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.69% (0.1457 => 0.1467, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.84% (0.4196 => 0.4077, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1398 => 0.1448, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.66% (0.0605 => 0.0609, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.68% (0.0212 => 0.0183, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.12% (0.0582 => 0.0558, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.61% (1.1235 => 1.1303, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0013 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 340.00% (0.0005 => 0.0022, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.45% (0.0550 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.39% (0.0165 => 0.0133, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7662 => 0.7657, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 150.00% (0.0002 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.22% (1.5981 => 1.6016, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.07% (4.1772 => 3.0881, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0079) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.33% (0.6410 => 0.6880, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.34% (0.3582 => 0.3809, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 5.84% (2.1763 => 2.3033, std.dev.: 0.0139) MultiSource/Applications/minisat/minisat: 5.49% (0.6173 => 0.6512, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 4.95% (0.5309 => 0.5572, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.70% (0.6915 => 0.7240, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 4.22% (1.1653 => 1.2145, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 3.67% (0.3217 => 0.3335, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 3.22% (29.3170 => 30.2621, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5150 => 1.5555, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1672 => 1.1958, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (0.8569 => 0.8724, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.33% (1.3268 => 1.3444, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 1.33% (13.3238 => 13.5004, std.dev.: 0.0469) MultiSource/Applications/ClamAV/clamscan: 1.09% (14.6079 => 14.7672, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.07% (1.1827 => 1.1954, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.0689 => 1.0799, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Bubblesort: 40.30% (0.0263 => 0.0369, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2293, std.dev.: 0.0403) SingleSource/Benchmarks/Shootout/ary3: 15.15% (1.7426 => 2.0066, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.39% (4.0101 => 4.5472, std.dev.: 0.0678) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.43% (0.0917 => 0.1031, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0157) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 9.10% (7.0025 => 7.6399, std.dev.: 0.1027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.74% (1.0063 => 1.0943, std.dev.: 0.0325) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.44% (0.2857 => 0.3098, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (4.2129 => 4.4638, std.dev.: 0.0433) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 4.03% (8.5113 => 8.8540, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8282, std.dev.: 0.0416) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5403, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.19% (2.6656 => 2.7505, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8947, std.dev.: 0.0567) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.43% (0.5876 => 0.6019, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 2.29% (3.5520 => 3.6334, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.02% (4.6127 => 4.7057, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.4184 => 1.4388, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6906, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.05% (5.2665 => 4.1579, std.dev.: 0.0802) SingleSource/Benchmarks/Shootout-C++/ary3: -20.63% (1.7473 => 1.3869, std.dev.: 0.0427) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.41% (1.1647 => 0.9619, std.dev.: 0.0319) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.88% (15.8312 => 13.1592, std.dev.: 0.2840) SingleSource/Benchmarks/Shootout/sieve: -12.15% (8.1594 => 7.1680, std.dev.: 0.0421) MultiSource/Applications/sgefa/sgefa: -11.13% (0.3746 => 0.3329, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9334, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.94% (3.6254 => 3.3737, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (4.6355 => 4.3351, std.dev.: 0.0298) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3506, std.dev.: 0.0203) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.43% (2.0027 => 1.8739, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.4230 => 3.2259, std.dev.: 0.0272) MultiSource/Benchmarks/FreeBench/distray/distray: -5.74% (0.2664 => 0.2511, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9222, std.dev.: 0.0809) SingleSource/Benchmarks/Shootout/fib2: -4.95% (4.4195 => 4.2006, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -4.10% (7.6833 => 7.3680, std.dev.: 0.0334) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.99% (1.2722 => 1.2214, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.84% (0.4140 => 0.3981, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -3.23% (9.2503 => 8.9513, std.dev.: 0.0215) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.92% (1.1683 => 1.1342, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -2.63% (9.5474 => 9.2964, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: -2.49% (0.4296 => 0.4189, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.44% (2.4457 => 2.3861, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4180, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.92% (3.7496 => 3.6776, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3120, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (92.7467 => 91.1155, std.dev.: 0.1229) MultiSource/Applications/SPASS/SPASS: -1.73% (8.5323 => 8.3844, std.dev.: 0.0379) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2326, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3347, std.dev.: 0.0480) MultiSource/Applications/aha/aha: -1.29% (3.4286 => 3.3844, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.13% (2.8599 => 2.8277, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.95% (0.9980 => 0.9885, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.6022 => 0.6019, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -1.20% (0.1666 => 0.1646, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.44% (0.1554 => 0.1454, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.75% (0.3083 => 0.3029, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.59% (0.2394 => 0.2356, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.51% (0.3175 => 0.3127, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.91% (0.2302 => 0.2281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -7.57% (0.0449 => 0.0415, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -47.78% (0.0090 => 0.0047, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.67% (0.0240 => 0.0176, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.31% (0.0192 => 0.0153, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.63% (0.0301 => 0.0266, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.23% (0.0284 => 0.0272, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -46.33% (0.0177 => 0.0095, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -42.33% (0.0189 => 0.0109, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -18.15% (0.0325 => 0.0266, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.69% (1.5019 => 1.4165, std.dev.: 0.0604) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.27% (0.1501 => 0.1467, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.39% (0.4264 => 0.4077, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.74% (0.1344 => 0.1448, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.40% (0.0589 => 0.0609, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.12% (0.0232 => 0.0183, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.68% (0.0639 => 0.0558, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1350 => 1.1303, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -8.33% (0.0024 => 0.0022, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.68% (0.0637 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.93% (0.0246 => 0.0133, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.25% (1.5363 => 1.6016, std.dev.: 0.0065) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 00:18:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 02:18:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919071807.6A0362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3995?compare_to=3992&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3995, Order: 164201, Start Time: 2012-09-19 05:57:00, End Time: 2012-09-19 07:19:30 To: 3992, Order: 164196, Start Time: 2012-09-19 04:08:54, End Time: 2012-09-19 05:28:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.40% (54.5203 => 55.8295, std.dev.: 0.4307) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.5680 => 0.5690, std.dev.: 0.0185) MultiSource/Applications/SPASS/SPASS: 0.29% (15.8205 => 15.8668, std.dev.: 0.3540) MultiSource/Applications/kimwitu++/kc: -0.02% (14.7289 => 14.7262, std.dev.: 0.0389) MultiSource/Benchmarks/Bullet/bullet: -0.07% (82.6830 => 82.6260, std.dev.: 0.0699) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.3092 => 4.3150, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.15% (1.2211 => 1.2229, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.3977 => 7.4012, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.08% (3.6633 => 3.6661, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.27% (0.6365 => 0.6382, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.82% (0.1432 => 0.1458, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (0.0649 => 0.0662, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.65% (63.2438 => 82.6260, std.dev.: 0.0699) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14266.67% (0.0720 => 10.3440, std.dev.: 0.1584) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.22% (10.3673 => 14.6405, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 25.96% (0.1622 => 0.2043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.45% (7.0540 => 8.0030, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.41% (2.2022 => 2.4975, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 13.13% (0.1432 => 0.1620, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.68% (1.7609 => 1.9489, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3473 => 0.3794, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.06% (0.3497 => 0.3814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3561 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3543 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3543 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.99% (0.3516 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.75% (0.3828 => 0.4163, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3694 => 0.4017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.63% (0.3927 => 0.4266, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.41% (0.3886 => 0.4213, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.38% (0.3282 => 0.3557, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.00% (0.1625 => 0.1755, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.4879 => 0.5238, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 7.32% (10.4361 => 11.1996, std.dev.: 0.1928) MultiSource/Benchmarks/mafft/pairlocalalign: 7.30% (9.4845 => 10.1771, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7433 => 0.7942, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.62% (0.8172 => 0.8713, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 6.34% (0.7115 => 0.7566, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.4615 => 0.4906, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.17% (0.6675 => 0.7087, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.16% (3.3354 => 3.5408, std.dev.: 0.0731) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.5860 => 0.6220, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 6.09% (5.7591 => 6.1100, std.dev.: 0.1170) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.07% (0.5569 => 0.5907, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 6.07% (0.2554 => 0.2709, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 6.05% (0.3423 => 0.3630, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (1.3050 => 1.3839, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.90% (4.2646 => 4.5161, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2107 => 0.2231, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.88% (0.5105 => 0.5405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (8.1363 => 8.6116, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (1.5415 => 1.6307, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.8067 => 0.8533, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.9449 => 5.2298, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2758 => 0.2911, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (5.0018 => 5.2780, std.dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9765 => 1.0287, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.3180 => 0.3344, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 5.11% (0.3387 => 0.3560, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1250, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (7.9617 => 8.3512, std.dev.: 0.0142) MultiSource/Applications/hbd/hbd: 4.87% (1.5603 => 1.6363, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 4.84% (0.5925 => 0.6212, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.81% (0.6030 => 0.6320, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.80% (3.8723 => 4.0583, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (1.1861 => 1.2428, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6450 => 0.6743, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.53% (0.4103 => 0.4289, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.4064 => 0.4242, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 4.35% (0.3422 => 0.3571, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4636 => 0.4831, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.20% (0.8921 => 0.9296, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 4.19% (0.7326 => 0.7633, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5859 => 1.6520, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4289 => 0.4462, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.4186 => 1.4717, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4203 => 0.4359, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.2024 => 2.2833, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.64% (0.4620 => 0.4788, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.55% (0.3603 => 0.3731, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.3136 => 0.3247) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0665 => 2.1390, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.4048 => 0.4189, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.48% (0.3935 => 0.4072, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (14.3668 => 14.8660, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.1840 => 1.2217, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 2.96% (0.3379 => 0.3479, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.8101 => 0.8288, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.21% (1.2842 => 1.3126, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.8922 => 3.9372, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7506, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3500, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7888, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2286, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5858, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.57% (5.2763 => 3.2410, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.21% (5.3855 => 3.8662, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.67% (5.3526 => 3.8716, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1294, std.dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.07% (2.9384 => 2.5836, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -8.60% (22.1758 => 20.2688, std.dev.: 0.4950) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.53% (1.5373 => 1.3754, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2810, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7166, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5073, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4190, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0140, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: -2.41% (1.2373 => 1.2075, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0113, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5090, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2279, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.82% (0.5229 => 0.5690, std.dev.: 0.0185) MultiSource/Applications/SPASS/SPASS: 5.85% (14.9895 => 15.8668, std.dev.: 0.3540) MultiSource/Applications/kimwitu++/kc: 4.03% (14.1553 => 14.7262, std.dev.: 0.0389) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (4.1105 => 4.3150, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.69% (1.1048 => 1.2229, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.39% (7.1582 => 7.4012, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.87% (3.4629 => 3.6661, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.57% (0.6222 => 0.6382, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.82% (0.1485 => 0.1458, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.71% (0.2116 => 0.0662, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 00:43:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 02:43:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919074359.18A092A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/3996?compare_to=3993&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3996, Order: 164202, Start Time: 2012-09-19 06:34:12, End Time: 2012-09-19 07:45:25 To: 3993, Order: 164199, Start Time: 2012-09-19 05:07:12, End Time: 2012-09-19 06:18:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (38 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 898 (813 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 7.56% (0.1389 => 0.1494, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.65% (1.1342 => 1.1529, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.17% (4.5762 => 4.5225, std.dev.: 0.0168) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.15% (0.9885 => 0.9999, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6019 => 0.5981, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 1.52% (0.1646 => 0.1671, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.25% (0.1454 => 0.1574, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.16% (0.3029 => 0.3064, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.16% (0.2356 => 0.2305, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (0.3127 => 0.3164, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.71% (0.2281 => 0.2242, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -0.24% (0.0415 => 0.0414, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: -5.75% (0.0087 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: -6.38% (0.0047 => 0.0044, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 17.05% (0.0176 => 0.0206, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.84% (0.0153 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0383 => 0.0381, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.53% (0.0266 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.21% (0.0272 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0321 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 85.26% (0.0095 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 58.72% (0.0109 => 0.0173, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 20.68% (0.0266 => 0.0321, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1426 => 0.1421, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 3.52% (1.4165 => 1.4663, std.dev.: 0.0299) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.25% (0.1467 => 0.1434, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.49% (0.4077 => 0.4057, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.10% (0.1448 => 0.1432, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.66% (0.0609 => 0.0613, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.21% (0.0183 => 0.0209, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.20% (0.0558 => 0.0587, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.31% (1.1303 => 1.1268, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 50.00% (0.0016 => 0.0024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 9.09% (0.0022 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.03% (0.0569 => 0.0529, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.75% (0.0133 => 0.0134, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7657 => 0.7660, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.55% (1.6016 => 1.5928, std.dev.: 0.0097) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.50% (0.0121 => 0.0072, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.14% (4.1772 => 3.0852, std.dev.: 0.0480) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0012) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.54% (0.1414 => 0.1563, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.19% (0.6410 => 0.6871, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 6.44% (0.5309 => 0.5651, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.44% (0.3582 => 0.3777, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 3.93% (1.1653 => 1.2111, std.dev.: 0.0165) MultiSource/Benchmarks/Bullet/bullet: 2.65% (29.3170 => 30.0942, std.dev.: 0.2314) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1672 => 1.1966, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.40% (0.4248 => 0.4350, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (0.6069 => 0.6204, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.19% (0.7639 => 0.7806, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.68% (3.0225 => 3.0732, std.dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 15.17% (1.7426 => 2.0070, std.dev.: 0.0177) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.85% (0.0917 => 0.1044, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5545, std.dev.: 0.0150) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.32% (0.2694 => 0.2972, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6213, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.91% (1.0063 => 1.0758, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.19% (40.4792 => 42.5787, std.dev.: 0.3294) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.58% (4.2129 => 4.4057, std.dev.: 0.0710) SingleSource/Benchmarks/Misc/dt: 4.42% (0.9851 => 1.0286, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.20% (15.2242 => 15.8635, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/ReedSolomon: 4.04% (8.5113 => 8.8552, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.54% (6.6312 => 6.8660, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.32% (2.6656 => 2.7542, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 3.03% (3.5520 => 3.6595, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8929, std.dev.: 0.0547) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (2.4013 => 2.4486, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.84% (0.5876 => 0.5984, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4455 => 2.4838, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.05% (0.7738 => 0.7579, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.62% (5.2665 => 4.1280, std.dev.: 0.2249) SingleSource/Benchmarks/Shootout-C++/ary3: -20.46% (1.7473 => 1.3898, std.dev.: 0.0292) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.46% (1.1647 => 0.9613, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.86% (15.8312 => 13.3198, std.dev.: 0.0871) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9436, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3743, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -6.69% (3.4230 => 3.1939, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3302, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: -5.98% (1.4441 => 1.3577, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9310, std.dev.: 0.0611) MultiSource/Benchmarks/FreeBench/distray/distray: -5.44% (0.2664 => 0.2519, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1898, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.81% (45.4683 => 43.2800, std.dev.: 0.6679) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.69% (0.4140 => 0.3946, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -4.40% (7.6833 => 7.3449, std.dev.: 0.0498) SingleSource/Benchmarks/McGill/misr: -3.58% (0.4296 => 0.4142, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -3.09% (9.2503 => 8.9646, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.97% (3.7496 => 3.6382, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.9413 => 3.8262, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -1.98% (1.0926 => 1.0710, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4206, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3646, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2324, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4616, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3079, std.dev.: 0.0247) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (1.1683 => 1.1529, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.22% (2.8964 => 2.8610, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: -1.19% (16.5617 => 16.3644, std.dev.: 0.0588) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (92.7467 => 91.7550, std.dev.: 0.2079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.19% (0.9980 => 0.9999, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: -0.68% (0.6022 => 0.5981, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 0.30% (0.1666 => 0.1671, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.29% (0.1554 => 0.1574, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.62% (0.3083 => 0.3064, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.72% (0.2394 => 0.2305, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.35% (0.3175 => 0.3164, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.61% (0.2302 => 0.2242, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -7.80% (0.0449 => 0.0414, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: -7.87% (0.0089 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: -51.11% (0.0090 => 0.0044, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.17% (0.0240 => 0.0206, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.31% (0.0390 => 0.0381, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -8.47% (0.0189 => 0.0173, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1429 => 0.1421, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -2.37% (1.5019 => 1.4663, std.dev.: 0.0299) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.46% (0.1501 => 0.1434, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1344 => 0.1432, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.91% (0.0232 => 0.0209, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1350 => 1.1268, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0006 => 0.0024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.95% (0.0637 => 0.0529, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.53% (0.0246 => 0.0134, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.68% (1.5363 => 1.5928, std.dev.: 0.0097) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.86% (0.0070 => 0.0072, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 01:21:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 03:21:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919082115.98D392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3997?compare_to=3994&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3997, Order: 164203, Start Time: 2012-09-19 07:06:24, End Time: 2012-09-19 08:22:40 To: 3994, Order: 164199, Start Time: 2012-09-19 05:19:20, End Time: 2012-09-19 06:33:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.19% (0.5350 => 0.5467, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.85% (3.8455 => 3.7743, std.dev.: 0.0174) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.73% (2.0176 => 2.4157, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.70% (3.9660 => 4.3508, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.31% (0.7710 => 0.8428, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 9.31% (0.7038 => 0.7693, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 9.17% (1.3693 => 1.4949, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2596 => 0.2834, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.02% (0.6959 => 0.7587, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.89% (0.5265 => 0.5733, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.84% (0.9199 => 1.0012, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.80% (1.2193 => 1.3266, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.5818 => 0.6319, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5748 => 0.6235, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash: 8.44% (0.4062 => 0.4405, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.4563 => 1.5778, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.14% (1.1364 => 1.2289, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 8.05% (13.8202 => 14.9324, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.95% (0.3899 => 0.4209, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7061 => 0.7618, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 7.75% (1.0313 => 1.1112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.75% (0.5577 => 0.6009, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6283 => 0.6763, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.61% (0.2995 => 0.3223, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3022 => 0.3252, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.46% (0.3246 => 0.3488, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.38% (0.4379 => 0.4702, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.32% (0.3756 => 0.4031, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.3489 => 0.3744, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3485 => 0.3739, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.25% (1.1061 => 1.1863, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.20% (0.3293 => 0.3530, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 7.15% (0.7506 => 0.8043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.11% (0.8310 => 0.8901, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1392, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5637 => 0.6035, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.2925 => 0.3131, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.01% (7.2180 => 7.7243, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3868 => 0.4139, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 6.99% (2.1791 => 2.3315, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.96% (1.9828 => 2.1208, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.95% (3.6692 => 3.9241, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 6.87% (0.2243 => 0.2397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.55% (0.3650 => 0.3889, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.44% (3.1889 => 3.3944, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.40% (1.9270 => 2.0504, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.38% (1.3245 => 1.4090, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 6.35% (0.6744 => 0.7172, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4113 => 0.4374, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.30% (16.6129 => 17.6601, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.30% (0.6576 => 0.6990, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 6.25% (1.0594 => 1.1256, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 6.25% (0.4003 => 0.4253, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: 6.22% (0.3663 => 0.3891, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 6.18% (0.3578 => 0.3799, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 6.16% (0.3914 => 0.4155, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 6.16% (1.2749 => 1.3534, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 6.12% (0.3789 => 0.4021, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3646 => 0.3869, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.07% (0.3940 => 0.4179, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3601 => 0.3818, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 6.01% (14.8535 => 15.7462, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-3: 5.99% (0.3623 => 0.3840, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.92% (0.6135 => 0.6498, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.90% (1.3819 => 1.4635, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.89% (0.8818 => 0.9337, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.81% (0.8698 => 0.9203, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.78% (1.3813 => 1.4611, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.71% (0.2504 => 0.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9791, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.66% (4.3801 => 4.6280, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6938, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.40% (13.2842 => 14.0021, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.23% (4.6629 => 4.9068, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (1.1333 => 1.1925, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.98% (14.5298 => 15.2529, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (6.5754 => 6.9025, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.94% (3.2742 => 3.4361, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2841, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.45% (4.9865 => 5.2085, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.41% (0.9108 => 0.9510, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.20% (0.4805 => 0.5007, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.08% (1.5188 => 1.5807, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 3.99% (3.7467 => 3.8961, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (6.2785 => 6.5019, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.1007 => 2.1728, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.27% (33.2944 => 34.3846, std.dev.: 0.0268) MultiSource/Applications/sqlite3/sqlite3: 1.75% (16.2614 => 16.5455, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.95% (0.4846 => 0.6976, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.66% (1.8175 => 2.2838, std.dev.: 0.0396) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4168, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.50% (0.2093 => 0.2229, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 5.59% (1.2998 => 1.3724, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6988, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.02% (10.7476 => 11.0718, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6016, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0108) MultiSource/Applications/lemon/lemon: 1.17% (1.4298 => 1.4465, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6864, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.79% (0.4657 => 0.3875, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (22.5627 => 21.7172, std.dev.: 0.0218) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.97% (20.3410 => 18.3128, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.04% (1.3780 => 1.2947, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0205) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9229, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -3.39% (6.3560 => 6.1407, std.dev.: 0.0540) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5914, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.25% (26.5159 => 25.9186, std.dev.: 0.0358) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9934, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2367, std.dev.: 0.0177) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2242, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (4.1080 => 4.0638, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2620, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 01:24:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 03:24:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919082437.2EA8D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3998?compare_to=3991&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3998, Order: 164199, Start Time: 2012-09-19 05:38:49, End Time: 2012-09-19 08:26:01 To: 3991, Order: 164191, Start Time: 2012-09-19 02:26:30, End Time: 2012-09-19 05:10:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3465 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.35% (0.3496 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3442 => 0.3763, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.32% (0.3446 => 0.3767, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3469 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3460 => 0.3780, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3488 => 0.3810, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 8.99% (0.3650 => 0.3978, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 8.95% (0.3643 => 0.3969, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.81% (0.3724 => 0.4052, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.19% (1.5932 => 1.7237, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.02% (1.6211 => 1.7187, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (0.4994 => 0.5286, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.73% (1.3152 => 1.3905, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.62% (0.5000 => 0.5281, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (0.3930 => 0.4147, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (0.4361 => 0.4601, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.48% (0.5826 => 0.6145, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7563, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.33% (0.5889 => 0.6203, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8206, std.dev.: 0.0614) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (2.7292 => 2.8662, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.84% (1.0781 => 1.1303, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 4.59% (0.3336 => 0.3489, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.56% (0.2875 => 0.3006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.5900 => 0.6165, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 4.48% (23.5202 => 24.5743, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 4.44% (4.2109 => 4.3978, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 4.39% (0.6634 => 0.6925, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.34% (0.5026 => 0.5244, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2750 => 0.2869, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.30% (1.8794 => 1.9603, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.29% (0.2823 => 0.2944, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.4139 => 0.4316, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.3362 => 0.3504, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.22% (0.9909 => 1.0327, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (2.0673 => 2.1542, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.20% (0.2738 => 0.2853, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929) SingleSource/UnitTests/ObjC++/property-reference: 4.20% (0.7171 => 0.7472, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 4.19% (0.3317 => 0.3456, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.18% (0.3060 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3267 => 0.3403, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.3477 => 0.3621, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.3903 => 0.4063, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.04% (4.6177 => 4.8042, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/moments: 4.02% (0.3678 => 0.3826, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (4.4195 => 4.5970, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (2.1653 => 2.2521, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4251 => 0.4421, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.98% (0.4146 => 0.4311, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.97% (0.3096 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (2.1013 => 2.1846, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 3.93% (1.4269 => 1.4830, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 3.91% (0.3348 => 0.3479, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3690 => 0.3833, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3625 => 0.3765, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3282 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (0.4658 => 0.4832, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.5012 => 0.5198, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.70% (0.3271 => 0.3392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.2969 => 0.3078, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.3981 => 0.4126, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.6435 => 0.6669, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.54% (0.7875 => 0.8154, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.46% (1.9966 => 2.0657, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (1.9694 => 2.0372, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.3845 => 0.3974, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 3.18% (2.0346 => 2.0994, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 3.06% (0.9697 => 0.9994, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (0.7426 => 0.7642, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 2.76% (0.4847 => 0.4981, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (0.5361 => 0.5505, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (0.5584 => 0.5727, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.40% (11.6398 => 11.9186, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 8.67% (0.2122 => 0.2306, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6737, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std.dev.: 0.1452) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6500, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1914, std.dev.: 0.0468) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5047, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.51% (41.7953 => 42.4280, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5927, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4411, std.dev.: 0.0281) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5471, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7909, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8012, std.dev.: 0.0103) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7768, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7498, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9647, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 02:06:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 04:06:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919090645.D54D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3999?compare_to=3995&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3999, Order: 164204, Start Time: 2012-09-19 07:48:10, End Time: 2012-09-19 09:08:09 To: 3995, Order: 164201, Start Time: 2012-09-19 05:57:00, End Time: 2012-09-19 07:19:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (131 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (77.9448 => 79.3529, std.dev.: 0.4661) SingleSource/Benchmarks/Misc/lowercase: 1.38% (7.9409 => 8.0507, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.43% (14.6405 => 14.4308, std.dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.19% (0.5690 => 0.5679, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -0.21% (15.8668 => 15.8337, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: -0.05% (14.7262 => 14.7183, std.dev.: 0.0365) MultiSource/Benchmarks/Bullet/bullet: -0.03% (82.6260 => 82.6033, std.dev.: 0.0934) MultiSource/Benchmarks/MallocBench/gs/gs: -0.10% (4.3150 => 4.3105, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.2229 => 1.2216, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (7.4012 => 7.4093, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.11% (3.6661 => 3.6701, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.02% (0.6382 => 0.6381, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.78% (0.1458 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.96% (0.0662 => 0.0649, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.61% (63.2438 => 82.6033, std.dev.: 0.0934) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14241.94% (0.0720 => 10.3262, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.20% (10.3673 => 14.4308, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: 25.96% (0.1622 => 0.2043, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.49% (2.2022 => 2.4993, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.42% (7.0540 => 8.0004, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/flops: 13.34% (0.1432 => 0.1623, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2521, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.84% (1.7609 => 1.9517, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.19% (0.3473 => 0.3792, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.12% (0.3543 => 0.3866, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3543 => 0.3863, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.01% (0.3497 => 0.3812, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-3: 8.93% (0.3516 => 0.3830, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3561 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.83% (0.3694 => 0.4020, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.70% (0.3828 => 0.4161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.56% (0.3927 => 0.4263, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.47% (0.3282 => 0.3560, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.39% (0.3886 => 0.4212, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.22% (10.4361 => 11.1899, std.dev.: 0.0329) MultiSource/Benchmarks/mafft/pairlocalalign: 7.10% (9.4845 => 10.1583, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.07% (0.4879 => 0.5224, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.99% (0.3177 => 0.3399, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7433 => 0.7937, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.45% (0.5860 => 0.6238, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 6.43% (0.1695 => 0.1804, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 6.37% (0.3109 => 0.3307, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 6.35% (0.7115 => 0.7567, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.2554 => 0.2715, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 6.11% (0.3423 => 0.3632, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.10% (0.6675 => 0.7082, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 6.07% (5.7591 => 6.1084, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.8172 => 0.8661, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.94% (0.2271 => 0.2406, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.92% (1.3050 => 1.3823, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.92% (1.5415 => 1.6327, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (4.2646 => 4.5159, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (0.3121 => 0.3304, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: 5.80% (3.3354 => 3.5287, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.77% (8.1363 => 8.6055, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.8067 => 0.8532, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5569 => 0.5880, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9765 => 1.0304, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1940 => 0.2047, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.38% (4.9449 => 5.2109, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (5.0018 => 5.2705, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0109) MultiSource/Applications/Burg/burg: 5.26% (1.1642 => 1.2254, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.09% (0.3441 => 0.3616, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.01% (1.5603 => 1.6385, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.99% (7.9617 => 8.3586, std.dev.: 0.0207) MultiSource/Benchmarks/McCat/09-vor/vor: 4.97% (0.3180 => 0.3338, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.93% (0.4299 => 0.4511, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2603 => 0.2731, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.90% (0.3387 => 0.3553, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.89% (3.8723 => 4.0617, std.dev.: 0.0134) SingleSource/UnitTests/ObjC++/Hello: 4.88% (0.5925 => 0.6214, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.82% (1.0722 => 1.1239, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 4.74% (0.6030 => 0.6316, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (1.1861 => 1.2422, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 4.55% (0.6456 => 0.6750, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.44% (0.3422 => 0.3574, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.41% (0.4103 => 0.4284, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.4064 => 0.4241, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.33% (2.0273 => 2.1151, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.5981 => 0.6237, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.24% (2.2969 => 2.3944, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8921 => 0.9297, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 4.19% (0.7326 => 0.7633, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9371 => 22.8463, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.05% (0.2891 => 0.3008, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.03% (0.3650 => 0.3797, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3865 => 0.4017, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.5859 => 1.6482, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4636 => 0.4812, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4203 => 0.4362, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.4620 => 0.4794, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.73% (1.4186 => 1.4715, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.70% (0.2756 => 0.2858, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0665 => 2.1400, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3603 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.51% (0.4048 => 0.4190, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (2.2024 => 2.2788, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (14.3668 => 14.8585, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.1840 => 1.2191, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.8101 => 0.8286, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.03% (1.2842 => 1.3103, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3511, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.17% (26.0924 => 26.3968, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.67% (5.2763 => 3.2360, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.22% (5.3855 => 3.8658, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.96% (5.3526 => 3.8561, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0936, std.dev.: 0.0353) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.10% (2.9384 => 2.5828, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -8.69% (22.1758 => 20.2485, std.dev.: 0.0627) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3002, std.dev.: 0.0726) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5839, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1515, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5103, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -2.84% (10.2830 => 9.9907, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -2.31% (1.2373 => 1.2087, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9865, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4238, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5788, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2294, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.61% (0.5229 => 0.5679, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 5.63% (14.9895 => 15.8337, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 3.98% (14.1553 => 14.7183, std.dev.: 0.0365) MultiSource/Benchmarks/MallocBench/gs/gs: 4.87% (4.1105 => 4.3105, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.57% (1.1048 => 1.2216, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.51% (7.1582 => 7.4093, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.98% (3.4629 => 3.6701, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.6222 => 0.6381, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 02:10:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 04:10:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919091038.C9F8B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4000?compare_to=3996&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4000, Order: 164204, Start Time: 2012-09-19 08:01:23, End Time: 2012-09-19 09:12:05 To: 3996, Order: 164202, Start Time: 2012-09-19 06:34:12, End Time: 2012-09-19 07:45:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (50 on baseline) Performance Improvements: 5 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 6.62% (0.1540 => 0.1642, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.57% (2.4521 => 2.5888, std.dev.: 0.0527) SingleSource/Benchmarks/Misc/mandel-2: 1.97% (3.0852 => 3.1459, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.78% (1.6155 => 1.6442, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 1.02% (5.1998 => 5.2530, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.62% (0.9148 => 0.8817, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.64% (0.7367 => 0.7246, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.01% (1.4619 => 1.4471, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -1.91% (1.2789 => 1.2545, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.01% (2.8610 => 2.8321, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.42% (0.9999 => 0.9857, std.dev.: 0.0205) MultiSource/Applications/sqlite3/sqlite3: 0.35% (0.5981 => 0.6002, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -0.18% (0.1671 => 0.1668, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.75% (0.1574 => 0.1452, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.78% (0.3064 => 0.3040, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.2305 => 0.2365, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.32% (0.3164 => 0.3154, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.14% (0.2242 => 0.2290, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 8.21% (0.0414 => 0.0448, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 6.10% (0.0082 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 104.55% (0.0044 => 0.0090, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 16.02% (0.0206 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0191 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.31% (0.0381 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.09% (0.0294 => 0.0232, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0278 => 0.0279, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.63% (0.0318 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.14% (0.0176 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 10.40% (0.0173 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0246 => 0.0247, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 2.49% (0.0321 => 0.0329, std.dev.: 0.0036) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1421 => 0.1414, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 3.13% (1.4663 => 1.5122, std.dev.: 0.0174) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.63% (0.1434 => 0.1443, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.71% (0.4057 => 0.4086, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.82% (0.1432 => 0.1363, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (0.0613 => 0.0557, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.39% (0.0209 => 0.0204, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.45% (0.0587 => 0.0555, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1268 => 1.1257, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -54.17% (0.0024 => 0.0011, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.95% (0.0529 => 0.0534, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.19% (0.0134 => 0.0149, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7660 => 0.7654, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.28% (1.5928 => 1.5973, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 5.56% (0.0072 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.69% (4.1772 => 3.1459, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/except: 82566.67% (0.0006 => 0.4960, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.85% (0.6410 => 0.6849, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 5.93% (2.1763 => 2.3053, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/bigfib: 5.76% (0.5309 => 0.5615, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 4.47% (0.6173 => 0.6449, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.2552 => 0.2661, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.19% (0.6915 => 0.7205, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 4.07% (1.1653 => 1.2127, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.04% (0.3582 => 0.3691, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5150 => 1.5539, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.40% (29.3170 => 30.0192, std.dev.: 0.0938) MultiSource/Applications/d/make_dparser: 1.93% (3.0225 => 3.0807, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (12.6413 => 12.8668, std.dev.: 0.0599) MultiSource/Applications/siod/siod: 1.55% (2.0972 => 2.1298, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: 1.10% (14.6079 => 14.7683, std.dev.: 0.0443) MultiSource/Applications/lua/lua: 1.09% (3.5980 => 3.6372, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.39% (0.0263 => 0.0385, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0129) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.56% (0.0917 => 0.1078, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.88% (0.0766 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9996, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.46% (4.0101 => 4.5499, std.dev.: 0.0124) SingleSource/Benchmarks/Stanford/Puzzle: 12.77% (0.1433 => 0.1616, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 11.17% (1.6261 => 1.8077, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6073, std.dev.: 0.0429) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.24% (0.2694 => 0.2916, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3301 => 0.3513, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.18% (4.2129 => 4.4311, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/fp-convert: 4.34% (15.2242 => 15.8850, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5388, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8735, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 3.25% (6.2244 => 6.4270, std.dev.: 0.0693) MultiSource/Applications/hexxagon/hexxagon: 3.11% (14.4877 => 14.9379, std.dev.: 0.0177) MultiSource/Benchmarks/sim/sim: 3.01% (3.8907 => 4.0080, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.66% (2.6656 => 2.7365, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.41% (3.5520 => 3.6376, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/mason/mason: 2.32% (0.5004 => 0.5120, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.06% (1.6110 => 1.6442, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.02% (4.6127 => 4.7060, std.dev.: 0.0301) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4490, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.33% (1.2726 => 1.2895, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.27% (2.4455 => 2.4765, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: 1.26% (4.3016 => 4.3560, std.dev.: 0.0153) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (5.1938 => 5.2530, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.87% (0.7738 => 0.7593, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.72% (0.3497 => 0.2038, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.96% (5.2665 => 4.1624, std.dev.: 0.0663) SingleSource/Benchmarks/Shootout-C++/ary3: -20.25% (1.7473 => 1.3935, std.dev.: 0.0382) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.34% (1.1647 => 0.9627, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.45% (15.8312 => 13.3854, std.dev.: 0.0561) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1613, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.87% (3.2007 => 2.9489, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3770, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3320, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: -6.54% (3.4230 => 3.1991, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3533, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9382, std.dev.: 0.0492) SingleSource/Benchmarks/Shootout/fib2: -5.11% (4.4195 => 4.1935, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.25% (0.4140 => 0.3964, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: -3.54% (7.6833 => 7.4113, std.dev.: 0.0218) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.26% (1.2722 => 1.2307, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.19% (1.2959 => 1.2545, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.16% (45.4683 => 44.0317, std.dev.: 0.4382) SingleSource/Benchmarks/McGill/misr: -3.07% (0.4296 => 0.4164, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -3.05% (9.2503 => 8.9678, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -2.62% (9.5474 => 9.2970, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.53% (3.7496 => 3.6547, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.22% (2.8964 => 2.8321, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: -1.93% (92.7467 => 90.9524, std.dev.: 0.1575) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3569 => 2.3136, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (9.3855 => 9.2195, std.dev.: 0.0205) MultiSource/Applications/aha/aha: -1.71% (3.4286 => 3.3698, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3144, std.dev.: 0.0653) SingleSource/Benchmarks/Dhrystone/fldry: -1.28% (2.4971 => 2.4652, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: -1.00% (16.5617 => 16.3953, std.dev.: 0.0497) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.23% (0.9980 => 0.9857, std.dev.: 0.0205) MultiSource/Applications/sqlite3/sqlite3: -0.33% (0.6022 => 0.6002, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 0.12% (0.1666 => 0.1668, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.56% (0.1554 => 0.1452, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.39% (0.3083 => 0.3040, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.21% (0.2394 => 0.2365, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.66% (0.3175 => 0.3154, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.52% (0.2302 => 0.2290, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.92% (0.0301 => 0.0232, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0036) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.05% (0.1429 => 0.1414, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 0.69% (1.5019 => 1.5122, std.dev.: 0.0174) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.86% (0.1501 => 0.1443, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.17% (0.4264 => 0.4086, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1344 => 0.1363, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.43% (0.0589 => 0.0557, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.07% (0.0232 => 0.0204, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.15% (0.0639 => 0.0555, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.82% (1.1350 => 1.1257, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.17% (0.0637 => 0.0534, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.43% (0.0246 => 0.0149, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.97% (1.5363 => 1.5973, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.57% (0.0070 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 03:05:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 05:05:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919100524.41AE02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4001?compare_to=3997&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4001, Order: 164207, Start Time: 2012-09-19 08:51:20, End Time: 2012-09-19 10:05:57 To: 3997, Order: 164203, Start Time: 2012-09-19 07:06:24, End Time: 2012-09-19 08:22:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.58% (6.1407 => 6.2378, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.39% (2.0176 => 2.4088, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.59% (3.9660 => 4.3463, std.dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: 9.41% (0.7038 => 0.7700, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.28% (0.2596 => 0.2837, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.18% (0.6959 => 0.7598, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5265 => 0.5746, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.09% (0.7710 => 0.8411, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.01% (0.9199 => 1.0028, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.87% (1.3693 => 1.4908, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.74% (1.2193 => 1.3259, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.45% (1.4563 => 1.5793, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.40% (1.1364 => 1.2319, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5818 => 0.6301, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.15% (13.8202 => 14.9465, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.99% (0.5748 => 0.6207, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6283 => 0.6780, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.84% (0.5577 => 0.6014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.75% (1.0313 => 1.1112, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3246 => 0.3495, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.55% (0.2995 => 0.3221, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.53% (0.1435 => 0.1543, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7061 => 0.7591, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.43% (0.4791 => 0.5147, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.36% (0.8310 => 0.8922, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 7.36% (1.1061 => 1.1875, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5637 => 0.6048, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 7.26% (3.8646 => 4.1451, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.15% (0.2925 => 0.3134, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.13% (0.7506 => 0.8041, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2966 => 0.3177, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.10% (0.7460 => 0.7990, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.10% (7.2180 => 7.7305, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.08% (0.3489 => 0.3736, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4016 => 0.4300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.00% (3.6692 => 3.9261, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.97% (1.9828 => 2.1211, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.95% (0.2243 => 0.2399, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.3756 => 0.4014, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1865 => 0.1993, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.83% (2.1791 => 2.3279, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (0.2761 => 0.2943, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.50% (3.1889 => 3.3961, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.39% (1.3245 => 1.4092, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.39% (0.6744 => 0.7175, std.dev.: 0.0068) MultiSource/Applications/treecc/treecc: 6.37% (1.9270 => 2.0498, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4390 => 0.4669, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.34% (0.6576 => 0.6993, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.33% (16.6129 => 17.6639, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4113 => 0.4372, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.0594 => 1.1252, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.6135 => 0.6509, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.06% (14.8535 => 15.7538, std.dev.: 0.0216) MultiSource/Applications/SIBsim4/SIBsim4: 6.06% (1.2749 => 1.3521, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 6.00% (0.4003 => 0.4243, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.93% (0.3914 => 0.4146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3578 => 0.3789, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.3819 => 1.4624, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.81% (0.3789 => 0.4009, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.79% (0.8818 => 0.9329, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.77% (1.3813 => 1.4610, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.76% (8.4961 => 8.9852, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 5.74% (0.3940 => 0.4166, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (13.2842 => 14.0410, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.67% (0.2859 => 0.3021, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.62% (4.4433 => 4.6928, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.59% (4.3801 => 4.6248, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.36% (4.6629 => 4.9127, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.33% (1.1333 => 1.1937, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.20% (6.5754 => 6.9174, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.99% (14.5298 => 15.2547, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.97% (3.2742 => 3.4369, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.44% (4.9865 => 5.2078, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2292 => 1.2835, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.19% (0.9108 => 0.9490, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5188 => 1.5822, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 4.13% (3.7467 => 3.9016, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4805 => 0.5000, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.05% (0.6250 => 0.6503, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.69% (6.2785 => 6.5103, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (2.1007 => 2.1748, std.dev.: 0.0187) MultiSource/Benchmarks/Bullet/bullet: 3.06% (33.2944 => 34.3145, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.88% (16.2614 => 16.5673, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5165, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2671, std.dev.: 0.0408) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6977, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5458, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0778, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6009, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (3.6469 => 3.6885, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5914, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.05% (7.9275 => 8.0110, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.99% (0.4657 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.51% (22.5627 => 21.7697, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2916, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3001, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6081, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.20% (26.5159 => 25.9338, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2378, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0596, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4356, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 03:37:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 05:37:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919103727.55B352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4002?compare_to=4000&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4002, Order: 164207, Start Time: 2012-09-19 09:27:55, End Time: 2012-09-19 10:38:54 To: 4000, Order: 164204, Start Time: 2012-09-19 08:01:23, End Time: 2012-09-19 09:12:05 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (40 on baseline) Performance Improvements: 0 (37 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 899 (814 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.86% (0.5531 => 0.5634, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (3.3946 => 3.5518, std.dev.: 0.0415) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.71% (0.9857 => 1.0026, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6002 => 0.6012, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -5.46% (0.1668 => 0.1577, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.16% (0.1452 => 0.1556, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (0.3040 => 0.3034, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.2365 => 0.2371, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.36% (0.3154 => 0.3197, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2290 => 0.2295, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -2.46% (0.0448 => 0.0437, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -66.67% (0.0087 => 0.0029, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0239 => 0.0243) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.55% (0.0193 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0386 => 0.0387, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.59% (0.0232 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0279 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.00% (0.0320 => 0.0288, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -45.51% (0.0178 => 0.0097, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: -1.05% (0.0191 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.21% (0.0247 => 0.0244, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -0.91% (0.0329 => 0.0326, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.06% (0.1414 => 0.1429, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -4.12% (1.5122 => 1.4499, std.dev.: 0.0437) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.62% (0.1443 => 0.1452, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4086 => 0.4090, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.73% (0.1363 => 0.1353, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 500.00% (0.0001 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.67% (0.0557 => 0.0531, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.90% (0.0204 => 0.0194, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.95% (0.0555 => 0.0588, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1257 => 1.1273, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 18.18% (0.0011 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.87% (0.0534 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.67% (0.0149 => 0.0148, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.78% (0.7654 => 0.7714, std.dev.: 0.0230) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.21% (1.5973 => 1.6006, std.dev.: 0.0237) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 59.21% (0.0076 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.38% (4.1772 => 3.1172, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/except: 82266.67% (0.0006 => 0.4942, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.27% (0.0745 => 0.0896, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.66% (0.6410 => 0.6837, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 5.75% (2.1763 => 2.3014, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.2552 => 0.2668, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 3.92% (0.6173 => 0.6415, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3582 => 0.3720, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.1653 => 1.2092, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 3.73% (0.6915 => 0.7173, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 3.35% (15.3105 => 15.8231, std.dev.: 0.1574) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.5150 => 1.5593, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 2.34% (29.3170 => 30.0018, std.dev.: 0.0822) MultiSource/Applications/d/make_dparser: 2.01% (3.0225 => 3.0832, std.dev.: 0.0092) MultiSource/Applications/Burg/burg: 1.90% (1.1440 => 1.1657, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.13% (6.2546 => 6.3255, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.11% (1.1672 => 1.1802, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 40.23% (0.0261 => 0.0366, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.32% (3.4629 => 4.2358, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9961, std.dev.: 0.0457) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5513, std.dev.: 0.0231) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6052, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.58% (1.0063 => 1.0926, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3301 => 0.3563, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.88% (0.2857 => 0.3082, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.06% (4.2129 => 4.4262, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5388, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 3.78% (15.2242 => 15.7990, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.32% (2.6656 => 2.7540, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.86% (14.4877 => 14.9014, std.dev.: 0.0654) MultiSource/Benchmarks/sim/sim: 2.75% (3.8907 => 3.9975, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 2.62% (3.5520 => 3.6451, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.04% (2.9152 => 2.9454, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.02% (2.4455 => 2.4704, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.73% (0.7738 => 0.7449, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.24% (0.3497 => 0.2055, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.55% (5.2665 => 4.0791, std.dev.: 0.0832) SingleSource/Benchmarks/Shootout-C++/ary3: -20.69% (1.7473 => 1.3858, std.dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.1647 => 0.9607, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.06% (15.8312 => 13.1302, std.dev.: 0.1184) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0457) MultiSource/Applications/sgefa/sgefa: -11.43% (0.3746 => 0.3318, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: -10.86% (0.1114 => 0.0993, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3778, std.dev.: 0.0216) MultiSource/Benchmarks/FreeBench/distray/distray: -6.57% (0.2664 => 0.2489, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3319, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8729, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -6.16% (1.4441 => 1.3551, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: -5.83% (3.4230 => 3.2233, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9536, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1890, std.dev.: 0.0318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -4.47% (7.6833 => 7.3395, std.dev.: 0.0651) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.35% (1.2722 => 1.2296, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9497, std.dev.: 0.0179) SingleSource/Benchmarks/McGill/misr: -3.14% (0.4296 => 0.4161, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.14% (61.1734 => 59.2527, std.dev.: 0.7363) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6387, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2860, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4140 => 0.4030, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -2.25% (92.7467 => 90.6561, std.dev.: 0.2784) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.03% (0.6119 => 0.5995, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4183, std.dev.: 0.0116) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3673, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2236, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.61% (1.0926 => 1.0750, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3093, std.dev.: 0.0828) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.46% (0.9980 => 1.0026, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -0.17% (0.6022 => 0.6012, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -5.34% (0.1666 => 0.1577, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.13% (0.1554 => 0.1556, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.59% (0.3083 => 0.3034, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.96% (0.2394 => 0.2371, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.69% (0.3175 => 0.3197, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2302 => 0.2295, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -2.67% (0.0449 => 0.0437, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -67.42% (0.0089 => 0.0029, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.11% (0.0324 => 0.0288, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -45.20% (0.0177 => 0.0097, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -3.46% (1.5019 => 1.4499, std.dev.: 0.0437) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.26% (0.1501 => 0.1452, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.08% (0.4264 => 0.4090, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.67% (0.1344 => 0.1353, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.85% (0.0589 => 0.0531, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.38% (0.0232 => 0.0194, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.98% (0.0639 => 0.0588, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1350 => 1.1273, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.09% (0.0637 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.84% (0.0246 => 0.0148, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.29% (0.7541 => 0.7714, std.dev.: 0.0230) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.19% (1.5363 => 1.6006, std.dev.: 0.0237) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 03:55:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 05:55:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919105524.BCCAE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4003?compare_to=3999&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4003, Order: 164207, Start Time: 2012-09-19 09:36:48, End Time: 2012-09-19 10:56:49 To: 3999, Order: 164204, Start Time: 2012-09-19 07:48:10, End Time: 2012-09-19 09:08:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (720 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.71% (14.4308 => 15.1111, std.dev.: 0.0254) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.41% (0.5679 => 0.5702, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.54% (15.8337 => 15.9197, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 0.18% (14.7183 => 14.7453, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 0.06% (82.6033 => 82.6500, std.dev.: 0.0310) MultiSource/Benchmarks/MallocBench/gs/gs: 0.20% (4.3105 => 4.3192, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.34% (1.2216 => 1.2257, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.15% (7.4093 => 7.4201, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.44% (3.6701 => 3.6863, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.02% (0.6381 => 0.6382, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.68% (63.2438 => 82.6500, std.dev.: 0.0310) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14254.03% (0.0720 => 10.3349, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.76% (10.3673 => 15.1111, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/richards_benchmark: 27.44% (0.1622 => 0.2067, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.46% (2.2022 => 2.5206, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.27% (7.0540 => 8.0604, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.30% (1.1194 => 1.2571, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.70% (1.7609 => 1.9669, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.08% (0.3282 => 0.3580, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.81% (0.3473 => 0.3779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3543 => 0.3850, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3543 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.48% (0.3516 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3694 => 0.4005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3828 => 0.4144, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 8.23% (0.3927 => 0.4250) SingleSource/UnitTests/ObjC/property: 8.13% (0.3886 => 0.4202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.71% (0.4879 => 0.5255, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.57% (10.4361 => 11.2265, std.dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: 7.49% (9.4845 => 10.1947, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2700 => 0.2891, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.98% (0.7433 => 0.7952, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 6.85% (0.3109 => 0.3322, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.67% (0.1695 => 0.1808, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.59% (0.6675 => 0.7115, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.53% (5.7591 => 6.1353, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.5860 => 0.6242, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.51% (0.7115 => 0.7578, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3423 => 0.3644, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4615 => 0.4908, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.27% (4.2646 => 4.5322, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.15% (0.5105 => 0.5419, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (1.5415 => 1.6360, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5390, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.03% (0.2271 => 0.2408, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.3050 => 1.3831, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (8.1363 => 8.6218, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.96% (0.8172 => 0.8659, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.83% (0.8067 => 0.8537, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.73% (0.5569 => 0.5888, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.69% (4.9449 => 5.2264, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (5.0018 => 5.2845, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 5.55% (0.7835 => 0.8270, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 5.53% (1.1642 => 1.2286, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.50% (0.9765 => 1.0302, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.44% (0.2758 => 0.2908, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.35% (1.0722 => 1.1296, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3441 => 0.3624, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (0.3092 => 0.3256, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 5.18% (0.5925 => 0.6232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.16% (0.6030 => 0.6341, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (7.9617 => 8.3712, std.dev.: 0.0151) MultiSource/Applications/lua/lua: 5.06% (3.8723 => 4.0684, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: 5.02% (0.3387 => 0.3557, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (1.1861 => 1.2438, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.83% (1.5603 => 1.6357, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 4.63% (2.0273 => 2.1211, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 4.58% (2.2969 => 2.4020, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.56% (0.6450 => 0.6744, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.56% (21.9371 => 22.9370, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/lists: 4.53% (0.3422 => 0.3577, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.52% (0.6456 => 0.6748, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.46% (0.8921 => 0.9319, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.40% (0.7326 => 0.7648, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.29% (0.4103 => 0.4279, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.27% (1.5859 => 1.6536, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.25% (0.5981 => 0.6235, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.03% (0.3650 => 0.3797, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.4186 => 1.4731, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4203 => 0.4360, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (14.3668 => 14.9004, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.2024 => 2.2839, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 3.64% (0.2831 => 0.2934, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.55% (0.4620 => 0.4784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.4048 => 0.4191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.50% (0.3283 => 0.3398, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3603 => 0.3725, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (2.0665 => 2.1345, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.1840 => 1.2227, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.8101 => 0.8302, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2842 => 1.3131, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4281, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.8922 => 3.9396, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.34% (2.8904 => 3.2181, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3833, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.15% (4.2280 => 4.3610, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7455, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2649, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.74% (5.3855 => 3.8916, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8886, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1623, std.dev.: 0.0580) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.58% (2.9384 => 2.5980, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -8.60% (22.1758 => 20.2688, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4267, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2959, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7153, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5095, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0104, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -1.69% (1.2373 => 1.2164, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2312, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (0.5229 => 0.5702, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.21% (14.9895 => 15.9197, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 4.17% (14.1553 => 14.7453, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (4.1105 => 4.3192, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.94% (1.1048 => 1.2257, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.66% (7.1582 => 7.4201, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.45% (3.4629 => 3.6863, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.57% (0.6222 => 0.6382, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 04:36:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 06:36:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919113657.45F8E352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4004?compare_to=3998&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4004, Order: 164207, Start Time: 2012-09-19 08:54:38, End Time: 2012-09-19 11:38:22 To: 3998, Order: 164199, Start Time: 2012-09-19 05:38:49, End Time: 2012-09-19 08:26:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.22% (1.7237 => 1.7448, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.97% (2.0637 => 2.1044, std.dev.: 0.0134) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.52% (1.5932 => 1.7448, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.29% (0.3488 => 0.3812, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3442 => 0.3760, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3496 => 0.3818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.21% (0.3465 => 0.3784, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.20% (0.3446 => 0.3763, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.14% (0.3469 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.10% (0.3460 => 0.3775, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.04% (0.3650 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3643 => 0.3966, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.78% (0.3724 => 0.4051, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.29% (1.3152 => 1.3979, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (0.4361 => 0.4622, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (1.6211 => 1.7164, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.62% (5.5417 => 5.8531, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 5.58% (1.0781 => 1.1383, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.56% (3.5627 => 3.7609, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (0.4994 => 0.5269, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 5.37% (0.5826 => 0.6139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.5889 => 0.6205, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.19% (0.5026 => 0.5287, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (2.7292 => 2.8694, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (0.3930 => 0.4127, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 4.93% (23.5202 => 24.6793, std.dev.: 0.0221) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (4.4195 => 4.6296, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.73% (0.3890 => 0.4074, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 4.67% (0.6634 => 0.6944, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 4.64% (4.2109 => 4.4061, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (2.1013 => 2.1962, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.4139 => 0.4323, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 4.43% (0.3004 => 0.3137, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (1.8794 => 1.9613, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 4.36% (0.2823 => 0.2946, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.3903 => 0.4073, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 4.34% (4.6177 => 4.8180, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.32% (2.0673 => 2.1567, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.29% (0.9909 => 1.0334, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2813 => 0.2933, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 4.25% (0.2750 => 0.2867, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.23% (2.1653 => 2.2570, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3267 => 0.3404, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.14% (0.7171 => 0.7468, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.13% (0.3317 => 0.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3124 => 0.3253, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.12% (0.2911 => 0.3031, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.12% (0.4029 => 0.4195, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.10% (0.6435 => 0.6699, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.09% (1.4269 => 1.4853, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.09% (0.3084 => 0.3210, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.08% (0.3336 => 0.3472, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 4.08% (0.5546 => 0.5772, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.03% (0.3348 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.2780 => 0.2892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3258 => 0.3389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3726 => 0.3875, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.00% (0.3678 => 0.3825, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.98% (0.4251 => 0.4420, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3625 => 0.3769, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.5900 => 0.6126, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (0.4658 => 0.4836, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 3.76% (2.0346 => 2.1112, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.5012 => 0.5195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.3981 => 0.4125, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.3845 => 0.3981, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (0.7426 => 0.7686, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (1.9694 => 2.0382, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 3.47% (0.4847 => 0.5015, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (1.9966 => 2.0649, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.38% (0.7875 => 0.8141, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.29% (0.9697 => 1.0016, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (0.5361 => 0.5535, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.04% (0.5584 => 0.5754, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (11.6398 => 11.9438, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.56% (4.6926 => 4.8128, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.2122 => 0.2312, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8920, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1736, std.dev.: 0.1451) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6355, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2008, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5048, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4389, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.28% (7.1849 => 7.2769, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6080, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5755, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -7.20% (0.2402 => 0.2229, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7971, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -3.32% (17.2379 => 16.6659, std.dev.: 0.1231) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5689, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9712, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 04:48:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 06:48:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919114849.5F0DD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4005?compare_to=4001&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4005, Order: 164211, Start Time: 2012-09-19 10:35:38, End Time: 2012-09-19 11:50:13 To: 4001, Order: 164207, Start Time: 2012-09-19 08:51:20, End Time: 2012-09-19 10:05:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.49% (2.0176 => 2.4109, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (3.9660 => 4.3438, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.43% (0.7038 => 0.7702, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.15% (0.6959 => 0.7596, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.00% (0.7710 => 0.8404, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5265 => 0.5738, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.89% (0.9199 => 1.0017, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.85% (1.3693 => 1.4905, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.72% (1.2193 => 1.3256, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.64% (0.2721 => 0.2956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7061 => 0.7655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.39% (1.4563 => 1.5785, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.34% (1.1364 => 1.2312, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.22% (0.5818 => 0.6296, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.15% (0.4062 => 0.4393, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.15% (13.8202 => 14.9462, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.98% (0.5577 => 0.6022, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5748 => 0.6205, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6283 => 0.6778, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.72% (1.0313 => 1.1109, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.58% (0.3246 => 0.3492, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.49% (0.4379 => 0.4707, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.43% (0.4791 => 0.5147, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.34% (1.1061 => 1.1873, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 7.30% (3.8646 => 4.1468, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 7.18% (0.8310 => 0.8907, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.15% (0.7506 => 0.8043, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.10% (0.5637 => 0.6037, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7270, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.02% (3.6692 => 3.9268, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 6.97% (0.2925 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4390 => 0.4695, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.91% (1.9828 => 2.1199, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.85% (2.1791 => 2.3283, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 6.79% (0.2726 => 0.2911, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.7460 => 0.7964, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3220 => 0.3434, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.3868 => 0.4122, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.56% (3.1889 => 3.3980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.49% (1.3245 => 1.4105, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.40% (0.6576 => 0.6997, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 6.36% (16.6129 => 17.6702, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 6.29% (1.9270 => 2.0483, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (1.2749 => 1.3551, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.16% (1.0594 => 1.1247, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 6.08% (14.8535 => 15.7571, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 6.08% (0.4113 => 0.4363, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 5.92% (0.4003 => 0.4240, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.88% (0.3914 => 0.4144, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.84% (0.8818 => 0.9333, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.82% (1.3813 => 1.4617, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.75% (0.3789 => 0.4007, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.75% (8.4961 => 8.9847, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.72% (0.3601 => 0.3807, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.70% (0.2859 => 0.3022, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.69% (0.3940 => 0.4164, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.67% (0.6135 => 0.6483, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 5.66% (0.3623 => 0.3828, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.62% (0.8698 => 0.9187, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (1.3819 => 1.4594, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (13.2842 => 14.0292, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.59% (4.4433 => 4.6919, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.57% (4.3801 => 4.6239, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.32% (4.6629 => 4.9109, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.25% (1.1333 => 1.1928, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (6.5754 => 6.9122, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2503, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.91% (3.2742 => 3.4349, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (4.9865 => 5.2099, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2292 => 1.2816, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.25% (0.9108 => 0.9495, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4805 => 0.5004, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 4.05% (3.7467 => 3.8984, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.5188 => 1.5795, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.6250 => 0.6491, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.71% (6.2785 => 6.5113, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (2.1007 => 2.1757, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: 2.94% (33.2944 => 34.2726, std.dev.: 0.0211) MultiSource/Applications/sqlite3/sqlite3: 1.87% (16.2614 => 16.5648, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5165, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.90% (1.0895 => 1.3499, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.60% (1.2998 => 1.3726, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6975, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0928, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5989, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.01% (7.9275 => 8.0079, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.03% (0.4657 => 0.3864, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.50% (22.5627 => 21.7729, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2730, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8104, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.96% (1.3780 => 1.2959, std.dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0046) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.48% (3.0263 => 2.9209, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6023, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.35% (26.5159 => 25.8924, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2439, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2410, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0587, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8707, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2255, std.dev.: 0.0377) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 05:03:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 07:03:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919120351.D218E352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4006?compare_to=4002&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4006, Order: 164211, Start Time: 2012-09-19 10:54:40, End Time: 2012-09-19 12:05:19 To: 4002, Order: 164207, Start Time: 2012-09-19 09:27:55, End Time: 2012-09-19 10:38:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (50 on baseline) Performance Improvements: 0 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 895 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.64% (0.2022 => 0.2136, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.92% (0.4429 => 0.4647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.3929 => 1.4239, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.8861 => 0.9039, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.70% (1.4029 => 1.4268, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.69% (59.2527 => 60.8467, std.dev.: 0.4599) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.27% (1.0026 => 0.9899, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -1.20% (0.6012 => 0.5940, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.1577 => 0.1662, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1556 => 0.1551, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (0.3034 => 0.3094, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.55% (0.2371 => 0.2384, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.94% (0.3197 => 0.3167, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2295 => 0.2296, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 4.12% (0.0437 => 0.0455, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 206.90% (0.0029 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.14% (0.0088 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0243 => 0.0242, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0190 => 0.0191, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.78% (0.0387 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.68% (0.0296 => 0.0298, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.08% (0.0278 => 0.0281, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0288 => 0.0318, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 83.51% (0.0097 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -13.23% (0.0189 => 0.0164, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: 2.87% (0.0244 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.61% (0.0326 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.84% (0.1429 => 0.1417, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 3.90% (1.4499 => 1.5064, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.10% (0.1452 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.08% (0.4090 => 0.4005, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.14% (0.1353 => 0.1382, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 21.85% (0.0531 => 0.0647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.55% (0.0194 => 0.0197, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.85% (0.0588 => 0.0593, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1273 => 1.1271, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 107.69% (0.0013 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.54% (0.0560 => 0.0563, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 78.38% (0.0148 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.91% (0.7714 => 0.7644, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.15% (1.6006 => 1.5982, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.69% (4.1772 => 3.0624, std.dev.: 0.0576) SingleSource/Benchmarks/Shootout-C++/except: 82250.00% (0.0006 => 0.4941, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6410 => 0.6835, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.25% (0.5309 => 0.5641, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 5.50% (2.1763 => 2.2961, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.2552 => 0.2678, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 4.14% (1.1653 => 1.2135, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.13% (0.3582 => 0.3730, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.6915 => 0.7180, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 3.74% (0.6173 => 0.6404, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 3.57% (1.0046 => 1.0405, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 3.09% (15.3105 => 15.7837, std.dev.: 0.0505) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5150 => 1.5552, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.7722 => 0.7911, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.10% (29.3170 => 29.9321, std.dev.: 0.1460) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.7639 => 0.7787, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6069 => 0.6182, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.59% (3.0225 => 3.0707, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 1.46% (1.3268 => 1.3462, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.45% (6.2546 => 6.3455, std.dev.: 0.0203) MultiSource/Applications/Burg/burg: 1.37% (1.1440 => 1.1597, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 1.05% (2.0972 => 2.1193, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.04% (13.3238 => 13.4619, std.dev.: 0.0456) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5632, std.dev.: 0.0091) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.76% (7.0025 => 7.6162, std.dev.: 0.0468) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.10% (1.0063 => 1.0878, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3301 => 0.3503, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.41% (15.2242 => 15.8962, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/dt: 4.06% (0.9851 => 1.0251, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.39% (0.8498 => 0.8786, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 3.00% (14.4877 => 14.9230, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/ReedSolomon: 3.00% (8.5113 => 8.7665, std.dev.: 0.0541) MultiSource/Benchmarks/sim/sim: 2.66% (3.8907 => 3.9942, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/mason/mason: 2.56% (0.5004 => 0.5132, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.25% (0.6308 => 0.6450, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 2.09% (2.4013 => 2.4514, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 2.08% (3.5520 => 3.6258, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: 1.61% (2.3453 => 2.3830, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.51% (4.6127 => 4.6825, std.dev.: 0.0217) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.26% (0.7738 => 0.7563, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.55% (0.3497 => 0.2114, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.47% (5.2665 => 4.0832, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/ary3: -20.56% (1.7473 => 1.3880, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.30% (1.1647 => 0.9632, std.dev.: 0.0310) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.49% (15.8312 => 13.2204, std.dev.: 0.1566) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -11.11% (0.3746 => 0.3330, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.93% (3.2007 => 2.9469, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3750, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3297, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.53% (2.0027 => 1.8719, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3499, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: -6.37% (3.4230 => 3.2048, std.dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9372, std.dev.: 0.0588) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1886, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.28% (7.6833 => 7.3547, std.dev.: 0.0339) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.08% (1.2722 => 1.2203, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/misr: -2.98% (0.4296 => 0.4168, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -2.96% (9.2503 => 8.9765, std.dev.: 0.0271) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8281, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0352) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.55% (1.1683 => 1.1385, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.06% (3.7496 => 3.6724, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.06% (45.4683 => 44.5326, std.dev.: 0.2608) MultiSource/Applications/aha/aha: -1.93% (3.4286 => 3.3625, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4212, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3124, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.79% (1.8739 => 1.8403, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2270, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (16.5617 => 16.3149, std.dev.: 0.0424) MultiSource/Benchmarks/PAQ8p/paq8p: -1.44% (92.7467 => 91.4097, std.dev.: 0.2742) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3106, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -1.13% (2.4971 => 2.4690, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/oourafft: -1.04% (3.8200 => 3.7804, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.81% (0.9980 => 0.9899, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -1.36% (0.6022 => 0.5940, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: -0.24% (0.1666 => 0.1662, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1554 => 0.1551, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.36% (0.3083 => 0.3094, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2394 => 0.2384, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.25% (0.3175 => 0.3167, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.26% (0.2302 => 0.2296, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -13.23% (0.0189 => 0.0164, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.84% (0.1429 => 0.1417, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 0.30% (1.5019 => 1.5064, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1501 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.07% (0.4264 => 0.4005, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.83% (0.1344 => 0.1382, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.85% (0.0589 => 0.0647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.09% (0.0232 => 0.0197, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.20% (0.0639 => 0.0593, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1271, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.62% (0.0637 => 0.0563, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.0246 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.37% (0.7541 => 0.7644, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.03% (1.5363 => 1.5982, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 05:43:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 07:43:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919124352.62667352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4007?compare_to=4003&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4007, Order: 164211, Start Time: 2012-09-19 11:25:25, End Time: 2012-09-19 12:45:17 To: 4003, Order: 164207, Start Time: 2012-09-19 09:36:48, End Time: 2012-09-19 10:56:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.2985 => 1.3136, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5702 => 0.5701, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: -0.07% (15.9197 => 15.9079, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: -0.04% (14.7453 => 14.7401, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 0.02% (82.6500 => 82.6658, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: -0.05% (4.3192 => 4.3171, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2257 => 1.2261, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.4201 => 7.4187, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.6863 => 3.6865, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.6382 => 0.6371, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.71% (63.2438 => 82.6658, std.dev.: 0.0166) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.28% (0.0720 => 10.3286, std.dev.: 0.0133) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.65% (10.3673 => 15.1002, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/richards_benchmark: 27.31% (0.1622 => 0.2065, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.47% (2.2022 => 2.5208, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (7.0540 => 8.0583, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.25% (1.1194 => 1.2565, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.54% (1.7609 => 1.9641, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 9.17% (0.3282 => 0.3583, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.84% (0.3473 => 0.3780, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.78% (0.3543 => 0.3854, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3543 => 0.3847, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3497 => 0.3797, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3561 => 0.3865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3516 => 0.3816, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3694 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.36% (0.3828 => 0.4148, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.35% (0.3927 => 0.4255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.05% (0.3886 => 0.4199, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.3177 => 0.3428, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.73% (0.4879 => 0.5256, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.59% (10.4361 => 11.2284, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.49% (9.4845 => 10.1946, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.98% (0.7433 => 0.7952, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 6.63% (0.3109 => 0.3315, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.59% (0.7115 => 0.7584, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 6.51% (5.7591 => 6.1338, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (0.6675 => 0.7108, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2554 => 0.2718, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4615 => 0.4908, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.25% (3.3354 => 3.5439, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 6.22% (0.3423 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.18% (1.5415 => 1.6368, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.17% (0.5105 => 0.5420, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.16% (4.2646 => 4.5272, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.5860 => 0.6220, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (8.1363 => 8.6203, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.3050 => 1.3818, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.8067 => 0.8536, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.77% (4.9449 => 5.2301, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.76% (0.8172 => 0.8643, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.68% (5.0018 => 5.2860, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 5.68% (0.7835 => 0.8280, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5569 => 0.5885, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.67% (0.3121 => 0.3298, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2758 => 0.2911, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.9765 => 1.0305, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 5.45% (1.1642 => 1.2277, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 5.34% (1.0722 => 1.1295, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 5.34% (0.3092 => 0.3257, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (7.9617 => 8.3750, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.17% (0.3441 => 0.3619, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.16% (0.6030 => 0.6341, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.3180 => 0.3344, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 5.15% (0.5925 => 0.6230, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.08% (3.8723 => 4.0690, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.00% (0.5020 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1861 => 1.2454, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732) MultiSource/Benchmarks/McCat/05-eks/eks: 4.95% (0.4299 => 0.4512, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.83% (2.0273 => 2.1252, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.74% (1.5603 => 1.6343, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 4.65% (2.2969 => 2.4037, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 4.59% (21.9371 => 22.9448, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/bigfib: 4.57% (0.6456 => 0.6751, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6450 => 0.6743, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 4.44% (0.3422 => 0.3574, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8921 => 0.9316, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference: 4.37% (0.7326 => 0.7646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.4103 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.23% (0.5981 => 0.6234, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.09% (1.5859 => 1.6507, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.3650 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.89% (0.3826 => 0.3975, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.89% (0.4289 => 0.4456, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.4186 => 1.4732, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (14.3668 => 14.9134, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4203 => 0.4360, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.69% (2.2024 => 2.2836, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.4620 => 0.4787, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.3136 => 0.3247, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.52% (0.3098 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.51% (0.4048 => 0.4190, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.47% (0.3283 => 0.3397, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3684 => 0.3811, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3603 => 0.3725, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.35% (0.3162 => 0.3268, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.30% (2.0665 => 2.1347, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.1840 => 1.2230, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.58% (0.8101 => 0.8310, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.23% (1.2842 => 1.3128, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4291, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.8922 => 3.9393, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3827, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.27% (0.4162 => 0.4298, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7497, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (4.2280 => 4.3527, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 1.44% (2.2771 => 2.3098, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2364, std.dev.: 0.0238) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3634, std.dev.: 0.0330) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.10% (5.2763 => 3.2660, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.72% (5.3855 => 3.8925, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.33% (5.3526 => 3.8897, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1621, std.dev.: 0.0435) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.54% (2.9384 => 2.5992, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.61% (22.1758 => 20.2669, std.dev.: 0.0302) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3034, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7174, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1507, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5087, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4199, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9966, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.41% (1.2373 => 1.2075, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.21% (8.1563 => 7.9761, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4239, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5789, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2225, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (0.5229 => 0.5701, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 6.13% (14.9895 => 15.9079, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 4.13% (14.1553 => 14.7401, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 5.03% (4.1105 => 4.3171, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.98% (1.1048 => 1.2261, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.64% (7.1582 => 7.4187, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.46% (3.4629 => 3.6865, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.6222 => 0.6371, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 07:49:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 09:49:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919144919.E45E2352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4008?compare_to=4006&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4008, Order: 164218, Start Time: 2012-09-19 13:39:13, End Time: 2012-09-19 14:50:45 To: 4006, Order: 164211, Start Time: 2012-09-19 10:54:40, End Time: 2012-09-19 12:05:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (40 on baseline) Performance Improvements: 3 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 896 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 2.26% (1.0405 => 1.0640, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.89% (44.5326 => 45.3724, std.dev.: 0.0603) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.13% (1.1984 => 1.1609, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.03% (0.5752 => 0.5578, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.49% (1.4268 => 1.4055, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.13% (0.9899 => 0.9886, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.11% (0.5940 => 0.6006, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -0.30% (0.1662 => 0.1657, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.48% (0.1551 => 0.1497, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.87% (0.3094 => 0.3036, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.73% (0.2384 => 0.2295, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3167 => 0.3185, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2296 => 0.2293, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -1.10% (0.0455 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -23.60% (0.0089 => 0.0068, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.07% (0.0242 => 0.0237, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.85% (0.0191 => 0.0176, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.37% (0.0298 => 0.0282, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0281 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0318 => 0.0321, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -17.98% (0.0178 => 0.0146, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 14.63% (0.0164 => 0.0188, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.59% (0.0251 => 0.0247, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -13.89% (0.0324 => 0.0279, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -28.57% (0.0007 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.80% (0.1417 => 0.1349, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -10.35% (1.5064 => 1.3505, std.dev.: 0.0690) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.21% (0.1497 => 0.1404, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.37% (0.4005 => 0.4100, std.dev.: 0.0456) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.26% (0.1382 => 0.1427, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.81% (0.0647 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.66% (0.0197 => 0.0176, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.24% (0.0593 => 0.0630, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1271 => 1.1272, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.39% (0.0563 => 0.0527, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.33% (0.0264 => 0.0176, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7644 => 0.7652, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.10% (1.5982 => 1.5998, std.dev.: 0.0058) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.94% (4.1772 => 3.0937, std.dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/except: 82816.67% (0.0006 => 0.4975, std.dev.: 0.0135) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.30% (0.6410 => 0.6878, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 6.08% (0.5309 => 0.5632, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 5.91% (1.0046 => 1.0640, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 5.87% (2.1763 => 2.3040, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.2552 => 0.2674, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.75% (0.3582 => 0.3752, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 4.58% (0.6173 => 0.6456, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 4.37% (1.1653 => 1.2162, std.dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 4.34% (0.6915 => 0.7215, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.11% (15.3105 => 15.9404, std.dev.: 0.2051) MultiSource/Benchmarks/Bullet/bullet: 2.02% (29.3170 => 29.9106, std.dev.: 0.1740) MultiSource/Applications/siod/siod: 1.76% (2.0972 => 2.1342, std.dev.: 0.0141) MultiSource/Applications/d/make_dparser: 1.71% (3.0225 => 3.0741, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.4908 => 6.5599, std.dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.7256 => 14.8800, std.dev.: 0.0262) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.93% (0.0766 => 0.0888, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9988, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.36% (4.0101 => 4.5458, std.dev.: 0.0812) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.47% (0.2694 => 0.2949, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 8.86% (7.0025 => 7.6230, std.dev.: 0.0356) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 8.09% (0.1433 => 0.1549, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.48% (0.3301 => 0.3548, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 4.15% (8.5113 => 8.8641, std.dev.: 0.0454) SingleSource/Benchmarks/Misc/fp-convert: 3.95% (15.2242 => 15.8249, std.dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.89% (40.4792 => 42.0535, std.dev.: 0.3014) SingleSource/Benchmarks/Misc/dt: 3.66% (0.9851 => 1.0212, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.03% (14.4877 => 14.9269, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: 2.68% (0.5004 => 0.5138, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 2.29% (3.5520 => 3.6334, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash: 2.22% (0.6308 => 0.6448, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.4013 => 2.4525, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.50% (1.6110 => 1.6352, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.01% (0.2080 => 0.1851, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: -3.22% (0.7738 => 0.7489, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.41% (0.3497 => 0.2049, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.35% (5.2665 => 4.1420, std.dev.: 0.0601) SingleSource/Benchmarks/Shootout-C++/ary3: -20.57% (1.7473 => 1.3878, std.dev.: 0.0438) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.15% (1.1647 => 0.9533, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.67% (15.8312 => 13.1923, std.dev.: 0.1684) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std.dev.: 0.0260) MultiSource/Applications/sgefa/sgefa: -10.81% (0.3746 => 0.3341, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.08% (3.2007 => 2.9421, std.dev.: 0.0458) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3758, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3315, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.53% (2.0027 => 1.8720, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -6.33% (1.4441 => 1.3527, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: -6.03% (3.4230 => 3.2166, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (3.6023 => 3.3877, std.dev.: 0.0743) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9510, std.dev.: 0.1406) SingleSource/Benchmarks/Shootout/fib2: -5.38% (4.4195 => 4.1817, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/distray/distray: -5.37% (0.2664 => 0.2521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.40% (0.4140 => 0.3958, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -4.16% (7.6833 => 7.3633, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.16% (0.4564 => 0.4374, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.85% (9.2503 => 8.8943, std.dev.: 0.0658) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.45% (1.2722 => 1.2283, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.08% (3.9413 => 3.8198, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.7496 => 3.6391, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (92.7467 => 90.8087, std.dev.: 0.1825) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.09% (1.1683 => 1.1439, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4206, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3124, std.dev.: 0.0046) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3673, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2242, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.41% (1.7361 => 1.7117, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3124, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/lists: -1.14% (16.5617 => 16.3729, std.dev.: 0.0628) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.09% (1.8739 => 1.8535, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.94% (0.9980 => 0.9886, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -0.27% (0.6022 => 0.6006, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -0.54% (0.1666 => 0.1657, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.67% (0.1554 => 0.1497, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.52% (0.3083 => 0.3036, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.14% (0.2394 => 0.2295, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.31% (0.3175 => 0.3185, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -24.44% (0.0090 => 0.0068, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.33% (0.0192 => 0.0176, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.31% (0.0301 => 0.0282, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -17.51% (0.0177 => 0.0146, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -14.15% (0.0325 => 0.0279, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.60% (0.1429 => 0.1349, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -10.08% (1.5019 => 1.3505, std.dev.: 0.0690) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.46% (0.1501 => 0.1404, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.85% (0.4264 => 0.4100, std.dev.: 0.0456) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.18% (0.1344 => 0.1427, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.17% (0.0589 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.14% (0.0232 => 0.0176, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.41% (0.0639 => 0.0630, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.69% (1.1350 => 1.1272, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.27% (0.0637 => 0.0527, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.46% (0.0246 => 0.0176, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.13% (1.5363 => 1.5998, std.dev.: 0.0058) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 07:49:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 09:49:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919144923.15FEF352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4009?compare_to=4004&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4009, Order: 164211, Start Time: 2012-09-19 12:06:59, End Time: 2012-09-19 14:50:44 To: 4004, Order: 164207, Start Time: 2012-09-19 08:54:38, End Time: 2012-09-19 11:38:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.30% (0.3764 => 0.3926, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: 1.18% (2.4622 => 2.4913, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.48% (1.5932 => 1.7443, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 9.35% (0.3496 => 0.3823, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.26% (0.3465 => 0.3786, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.23% (0.3446 => 0.3764, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.20% (0.3488 => 0.3809, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 9.18% (0.3442 => 0.3758, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.17% (0.3469 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.16% (0.3460 => 0.3777, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.90% (0.3650 => 0.3975, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3643 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.67% (0.3724 => 0.4047, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (1.6211 => 1.7186, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.01% (0.4361 => 0.4623, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (0.4994 => 0.5294, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.89% (1.3152 => 1.3927, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.82% (0.5000 => 0.5291, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.65% (1.0781 => 1.1390, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 5.38% (5.5417 => 5.8399, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.36% (3.5627 => 3.7535, std.dev.: 0.0086) SingleSource/UnitTests/ObjC++/Hello: 5.34% (0.5826 => 0.6137, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.30% (0.5889 => 0.6201, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (0.5026 => 0.5291, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (2.7292 => 2.8674, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.2736 => 0.2871, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 4.88% (23.5202 => 24.6685, std.dev.: 0.0159) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (0.3890 => 0.4075, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.72% (4.2109 => 4.4096, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (4.4195 => 4.6272, std.dev.: 0.0106) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.4139 => 0.4328, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (2.1013 => 2.1970, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.52% (0.2875 => 0.3005, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.52% (4.6177 => 4.8263, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 4.51% (0.6634 => 0.6933, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (1.8794 => 1.9631, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.44% (0.3195 => 0.3337, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (0.4658 => 0.4865, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.43% (0.9909 => 1.0348, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 4.43% (0.3004 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.3271 => 0.3413, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.27% (2.0673 => 2.1555, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 4.25% (0.2750 => 0.2867, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.23% (2.1653 => 2.2569, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.18% (0.3060 => 0.3188, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.3258 => 0.3394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.17% (0.2780 => 0.2896, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 4.17% (0.3336 => 0.3475, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2803 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3267 => 0.3402, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 4.13% (1.4269 => 1.4858, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.12% (0.2911 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.3084 => 0.3211, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.08% (0.3477 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.07% (0.7171 => 0.7463, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2811 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.05% (0.2738 => 0.2849, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3124 => 0.3250, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.03% (0.3348 => 0.3483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3726 => 0.3875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3317 => 0.3448, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.93% (0.5546 => 0.5764, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4251 => 0.4417, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.86% (0.4146 => 0.4306, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.85% (0.5900 => 0.6127, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.84% (0.6435 => 0.6682, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3678 => 0.3819, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.80% (2.0346 => 2.1119, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.74% (0.3690 => 0.3828, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.3981 => 0.4125, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.5012 => 0.5191, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.47% (0.2969 => 0.3072, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (1.9694 => 2.0373, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (0.5584 => 0.5776, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.40% (0.4847 => 0.5012, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.3845 => 0.3973, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.31% (0.9697 => 1.0018, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (1.9966 => 2.0626, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 3.30% (0.7875 => 0.8135, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.12% (0.5361 => 0.5528, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (11.6398 => 11.9438, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.53% (4.6926 => 4.8113, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.2122 => 0.2290, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.43% (3.3903 => 3.6084, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6705, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6384, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2020, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5063, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4547, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2888, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5417, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/ary2: -9.24% (0.2402 => 0.2180, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7857, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9597, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7938, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: -3.01% (17.2379 => 16.7190, std.dev.: 0.0951) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.81% (0.6293 => 0.6179, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5826, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9674, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 08:13:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 10:13:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919151307.35451352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4010?compare_to=4005&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4010, Order: 164219, Start Time: 2012-09-19 14:00:02, End Time: 2012-09-19 15:14:30 To: 4005, Order: 164211, Start Time: 2012-09-19 10:35:38, End Time: 2012-09-19 11:50:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.45% (2.0176 => 2.4100, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.54% (3.9660 => 4.3442, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.48% (0.7710 => 0.8441, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.35% (0.7038 => 0.7696, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.12% (0.6959 => 0.7594, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.02% (0.5265 => 0.5740, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 8.94% (1.3693 => 1.4917, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.86% (0.9199 => 1.0014, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.73% (0.4328 => 0.4706, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.68% (1.2193 => 1.3251, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.60% (1.4563 => 1.5816, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.53% (0.7061 => 0.7663, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.31% (1.1364 => 1.2308, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 8.28% (13.8202 => 14.9648, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.5818 => 0.6294, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5748 => 0.6211, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.00% (0.5577 => 0.6023, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.85% (1.0313 => 1.1123, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.3899 => 0.4203, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.51% (0.2995 => 0.3220, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.47% (0.4791 => 0.5149, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.47% (1.1061 => 1.1887, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.38% (0.4379 => 0.4702, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.33% (0.7506 => 0.8056, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2966 => 0.3183, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.27% (0.5637 => 0.6047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.24% (0.8310 => 0.8912, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1392, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.09% (7.2180 => 7.7300, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.08% (0.3489 => 0.3736, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.06% (3.6692 => 3.9283, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (1.9828 => 2.1205, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 6.94% (2.1791 => 2.3303, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.7460 => 0.7974, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.87% (0.2925 => 0.3126, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.65% (0.6576 => 0.7013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.3868 => 0.4122, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.47% (3.1889 => 3.3953, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 6.42% (0.6744 => 0.7177, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.40% (1.3245 => 1.4093, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4390 => 0.4669, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 6.31% (1.9270 => 2.0485, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 6.29% (16.6129 => 17.6576, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 6.13% (0.4113 => 0.4365, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.10% (1.2749 => 1.3527, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 6.01% (14.8535 => 15.7461, std.dev.: 0.0179) SingleSource/UnitTests/ObjC/parameter-passing: 6.00% (0.4003 => 0.4243, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 5.90% (0.3914 => 0.4145, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.87% (0.8818 => 0.9336, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.87% (8.4961 => 8.9950, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 5.87% (0.3646 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.87% (0.3578 => 0.3788, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.8698 => 0.9205, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.82% (0.6135 => 0.6492, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.81% (1.3819 => 1.4622, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.81% (0.3789 => 0.4009, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.3813 => 1.4598, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (4.4433 => 4.6952, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/property: 5.66% (0.3940 => 0.4163, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.66% (0.3623 => 0.3828, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.66% (4.3801 => 4.6279, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.62% (13.2842 => 14.0314, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.2859 => 0.3019, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.46% (0.3131 => 0.3302, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.39% (4.6629 => 4.9143, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.36% (1.1333 => 1.1940, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (6.5754 => 6.9100, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.98% (3.2742 => 3.4372, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2505, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.49% (4.9865 => 5.2102, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.30% (0.9108 => 0.9500, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.20% (1.5188 => 1.5826, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 4.09% (3.7467 => 3.8998, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (2.1007 => 2.1797, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.75% (6.2785 => 6.5142, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.33% (0.3511 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.05% (33.2944 => 34.3099, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 1.84% (16.2614 => 16.5601, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 27.54% (1.8175 => 2.3180, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.73% (1.1560 => 1.2569, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6984, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5476, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.99% (10.7476 => 11.0689, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4271 => 7.6096, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.12% (1.4298 => 1.4458, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5904, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.92% (0.4657 => 0.3869, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.36% (22.5627 => 21.8045, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2598, std.dev.: 0.0191) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.34% (1.3780 => 1.3044, std.dev.: 0.0089) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -3.51% (3.0263 => 2.9202, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5824, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.35% (26.5159 => 25.8930, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2416, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.19% (4.1080 => 4.0591, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4340, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2631, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2424, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 08:18:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 10:18:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919151823.5B923352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4011?compare_to=4007&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4011, Order: 164219, Start Time: 2012-09-19 13:59:57, End Time: 2012-09-19 15:19:48 To: 4007, Order: 164211, Start Time: 2012-09-19 11:25:25, End Time: 2012-09-19 12:45:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.88% (0.5359 => 0.5460, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.64% (55.0634 => 55.9645, std.dev.: 0.2888) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5701 => 0.5702, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 0.04% (15.9079 => 15.9149, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: -0.08% (14.7401 => 14.7283, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -0.01% (82.6658 => 82.6600, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3171 => 4.3144, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2261 => 1.2253, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.4187 => 7.4207, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.04% (3.6865 => 3.6878, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.6371 => 0.6376, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0647 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.70% (63.2438 => 82.6600, std.dev.: 0.0093) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14252.92% (0.0720 => 10.3341, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.76% (10.3673 => 15.1111, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 27.25% (0.1622 => 0.2064, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.49% (2.2022 => 2.5214, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.20% (7.0540 => 8.0554, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.26% (1.1194 => 1.2566, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.55% (1.7609 => 1.9642, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 9.20% (0.3282 => 0.3584, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3473 => 0.3778, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3543 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.64% (0.3543 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.62% (0.3516 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3497 => 0.3798, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.48% (0.3561 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3694 => 0.4004, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3828 => 0.4145, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.28% (0.3927 => 0.4252, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.11% (0.3886 => 0.4201, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.84% (0.3177 => 0.3426, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.67% (0.4879 => 0.5253, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.51% (10.4361 => 11.2198, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 7.44% (9.4845 => 10.1901, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.86% (0.7433 => 0.7943, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.61% (0.7115 => 0.7585, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.59% (0.6675 => 0.7115, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.56% (0.3109 => 0.3313, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.2554 => 0.2721, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.49% (5.7591 => 6.1327, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4615 => 0.4907, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30% (0.5860 => 0.6229, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.25% (0.5105 => 0.5424, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.25% (3.3354 => 3.5437, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/18-imp/imp: 6.13% (0.3423 => 0.3633, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (1.5415 => 1.6354, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (4.2646 => 4.5226, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.97% (0.8067 => 0.8549, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (8.1363 => 8.6191, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.93% (1.3050 => 1.3824, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (0.8172 => 0.8656, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.5569 => 0.5890, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (5.0018 => 5.2840, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.63% (4.9449 => 5.2234, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/09-vor/vor: 5.63% (0.3180 => 0.3359, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.53% (0.7835 => 0.8268, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2758 => 0.2910, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.51% (0.9765 => 1.0303, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.34% (1.1642 => 1.2264, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: 5.27% (0.3092 => 0.3255, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 5.23% (1.0722 => 1.1283, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.20% (0.3441 => 0.3620, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.20% (7.9617 => 8.3757, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: 5.20% (0.5925 => 0.6233, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.17% (0.6030 => 0.6342, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.08% (0.3387 => 0.3559, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.08% (3.8723 => 4.0689, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (1.1861 => 1.2441, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.88% (0.5020 => 0.5265, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4299 => 0.4507, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.82% (0.3422 => 0.3587, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.79% (1.5603 => 1.6351, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.68% (0.6450 => 0.6752, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.68% (0.6456 => 0.6758, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.63% (2.0273 => 2.1211, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.52% (21.9371 => 22.9293, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/football/football: 4.52% (0.8921 => 0.9324, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 4.44% (2.2969 => 2.3988, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.4064 => 0.4240, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5981 => 0.6240, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3826 => 0.3984, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.05% (1.5859 => 1.6502, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.03% (0.3650 => 0.3797, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.99% (0.4289 => 0.4460, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4203 => 0.4364, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.81% (1.4186 => 1.4726, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (14.3668 => 14.9030, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3232 => 0.3352, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.68% (2.2024 => 2.2835, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.59% (0.4620 => 0.4786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.4048 => 0.4192, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.1840 => 1.2232, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3684 => 0.3805, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.26% (0.3162 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0665 => 2.1334, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.8101 => 0.8303, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.27% (1.2842 => 1.3134, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4282, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (3.8922 => 3.9367, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4129, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3822, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.13% (4.2280 => 4.3602, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7906, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2278, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/fbench: 1.15% (2.2771 => 2.3033, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.11% (5.2763 => 3.2657, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.72% (5.3855 => 3.8926, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8888, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1854, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.49% (2.9384 => 2.6009, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -8.62% (22.1758 => 20.2650, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.51% (1.5373 => 1.3758, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2946, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7161, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5833, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -5.67% (1.5835 => 1.4937, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5014, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4172, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9962, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.63% (1.2373 => 1.2047, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0136, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5778, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (0.5229 => 0.5702, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 6.17% (14.9895 => 15.9149, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 4.05% (14.1553 => 14.7283, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 4.96% (4.1105 => 4.3144, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.91% (1.1048 => 1.2253, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.67% (7.1582 => 7.4207, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.49% (3.4629 => 3.6878, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.48% (0.6222 => 0.6376, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 09:15:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 11:15:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919161557.EC92B352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4012?compare_to=4008&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4012, Order: 164225, Start Time: 2012-09-19 15:06:34, End Time: 2012-09-19 16:17:24 To: 4008, Order: 164218, Start Time: 2012-09-19 13:39:13, End Time: 2012-09-19 14:50:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 13 (45 on baseline) Performance Improvements: 1 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.99% (0.1851 => 0.2036, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.80% (0.2591 => 0.2819, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.96% (0.4415 => 0.4590, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.80% (0.7582 => 0.7870, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5578 => 0.5760, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.8704 => 0.8979, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.99% (0.5815 => 0.5989, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.96% (1.1609 => 1.1836, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.54% (8.1338 => 8.2590, std.dev.: 0.0239) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (4.2563 => 4.3208, std.dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sgefa/sgefa: 10.24% (0.3341 => 0.3683, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/five11/five11: 1.35% (5.2206 => 5.2911, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.22% (1.7117 => 1.7326, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (8.8641 => 8.7361, std.dev.: 0.0347) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.40% (0.9886 => 0.9926, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6006 => 0.6016, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 1.69% (0.1657 => 0.1685, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.81% (0.1497 => 0.1569, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.28% (0.3036 => 0.3075, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.2295 => 0.2378, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (0.3185 => 0.3141, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.88% (0.2293 => 0.2250, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -0.44% (0.0450 => 0.0448, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 29.41% (0.0068 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.30% (0.0237 => 0.0196, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -26.14% (0.0176 => 0.0130, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0385 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.03% (0.0282 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.19% (0.0282 => 0.0273, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0321 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 23.97% (0.0146 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.06% (0.0188 => 0.0186, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0247 => 0.0248, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 16.85% (0.0279 => 0.0326, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.15% (0.1349 => 0.1432, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 6.07% (1.3505 => 1.4325, std.dev.: 0.0456) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.34% (0.1404 => 0.1493, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.51% (0.4100 => 0.3997, std.dev.: 0.0675) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.22% (0.1427 => 0.1381, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.46% (0.0590 => 0.0546, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.77% (0.0176 => 0.0202, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.24% (0.0630 => 0.0597, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.44% (1.1272 => 1.1322, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.25% (0.0016 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.27% (0.0527 => 0.0618, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.64% (0.0176 => 0.0152, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7652 => 0.7654, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.13% (1.5998 => 1.5978, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.33% (4.1772 => 3.0773, std.dev.: 0.0750) SingleSource/Benchmarks/Shootout-C++/except: 82283.33% (0.0006 => 0.4943, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.18% (0.0745 => 0.0873, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.48% (0.5309 => 0.5706, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.47% (0.6410 => 0.6825, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 5.79% (2.1763 => 2.3023, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.05% (0.3582 => 0.3763, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.2552 => 0.2673, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 3.87% (1.1653 => 1.2104, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 3.68% (0.6173 => 0.6400, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 3.28% (0.6915 => 0.7142, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.5150 => 1.5597, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.7639 => 0.7861, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.61% (0.3901 => 0.4003, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.37% (29.3170 => 30.0115, std.dev.: 0.2112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6069 => 0.6197, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7722 => 0.7870, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.51% (1.1827 => 1.2006, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.2546 => 6.3292, std.dev.: 0.0227) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.25% (0.0917 => 0.1066, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9984, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.67% (4.0101 => 4.5582, std.dev.: 0.0199) SingleSource/Benchmarks/Stanford/Puzzle: 11.86% (0.1433 => 0.1603, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 8.49% (7.0025 => 7.5970, std.dev.: 0.0689) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.39% (1.0063 => 1.0907, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.65% (0.2694 => 0.2900, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (0.3301 => 0.3501, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/dt: 4.17% (0.9851 => 1.0262, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8243, std.dev.: 0.0515) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8946, std.dev.: 0.0982) SingleSource/Benchmarks/Misc/ReedSolomon: 2.64% (8.5113 => 8.7361, std.dev.: 0.0347) MultiSource/Applications/siod/siod: 2.57% (3.5520 => 3.6433, std.dev.: 0.0197) MultiSource/Benchmarks/FreeBench/mason/mason: 2.22% (0.5004 => 0.5115, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 1.98% (2.4013 => 2.4489, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.87% (5.1938 => 5.2911, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.34% (4.6127 => 4.6747, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.4455 => 2.4721, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.72% (0.3497 => 0.2073, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.17% (5.2665 => 4.0990, std.dev.: 0.0728) SingleSource/Benchmarks/Shootout-C++/ary3: -17.87% (1.7473 => 1.4350, std.dev.: 0.0277) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.1647 => 0.9593, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.08% (15.8312 => 13.1276, std.dev.: 0.1650) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1610, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.59% (1.4034 => 1.2828, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9382, std.dev.: 0.0637) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (3.4230 => 3.1898, std.dev.: 0.0247) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.75% (2.0027 => 1.8676, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3321, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -6.35% (1.4441 => 1.3524, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9307, std.dev.: 0.0691) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1859, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/distray/distray: -5.22% (0.2664 => 0.2525, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.19% (7.6833 => 7.3616, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.80% (1.4021 => 1.3488, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/methcall: -3.49% (9.2503 => 8.9277, std.dev.: 0.0419) SingleSource/Benchmarks/McGill/misr: -3.26% (0.4296 => 0.4156, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.01% (3.7496 => 3.6368, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.65% (2.4457 => 2.3809, std.dev.: 0.0207) MultiSource/Benchmarks/PAQ8p/paq8p: -2.11% (92.7467 => 90.7926, std.dev.: 0.1637) MultiSource/Benchmarks/FreeBench/neural/neural: -1.88% (1.0926 => 1.0721, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4223, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.87% (1.0686 => 1.0486, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.85% (1.1683 => 1.1467, std.dev.: 0.0059) MultiSource/Applications/aha/aha: -1.84% (3.4286 => 3.3655, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3146, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.67% (0.6119 => 0.6017, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2426, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3069, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: -1.38% (16.5617 => 16.3339, std.dev.: 0.0393) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4637, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.27% (2.8964 => 2.8596, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.01% (1.8739 => 1.8549, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.54% (0.9980 => 0.9926, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.10% (0.6022 => 0.6016, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 1.14% (0.1666 => 0.1685, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1554 => 0.1569, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.26% (0.3083 => 0.3075, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.67% (0.2394 => 0.2378, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.07% (0.3175 => 0.3141, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.26% (0.2302 => 0.2250, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.33% (0.0240 => 0.0196, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.29% (0.0192 => 0.0130, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.87% (0.0284 => 0.0273, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.59% (0.0189 => 0.0186, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: -4.62% (1.5019 => 1.4325, std.dev.: 0.0456) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.53% (0.1501 => 0.1493, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.26% (0.4264 => 0.3997, std.dev.: 0.0675) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.75% (0.1344 => 0.1381, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.30% (0.0589 => 0.0546, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0232 => 0.0202, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0639 => 0.0597, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1350 => 1.1322, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 183.33% (0.0006 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.98% (0.0637 => 0.0618, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.21% (0.0246 => 0.0152, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.00% (1.5363 => 1.5978, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 09:56:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 11:56:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919165631.A2F5D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4013?compare_to=4010&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4013, Order: 164225, Start Time: 2012-09-19 15:43:06, End Time: 2012-09-19 16:57:56 To: 4010, Order: 164219, Start Time: 2012-09-19 14:00:02, End Time: 2012-09-19 15:14:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5244 => 56.4013, std.dev.: 0.1555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.20% (28.7203 => 29.6402, std.dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.48% (2.0176 => 2.4106, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.61% (3.9660 => 4.3472, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.35% (0.7710 => 0.8431, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 9.35% (0.7038 => 0.7696, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.22% (1.3693 => 1.4956, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2596 => 0.2835, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.08% (0.5265 => 0.5743, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.97% (0.9199 => 1.0024, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.78% (1.2193 => 1.3263, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 8.73% (0.4328 => 0.4706, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5818 => 0.6323, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.61% (0.7061 => 0.7669, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5748 => 0.6237, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.39% (1.1364 => 1.2318, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.4563 => 1.5777, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 8.25% (13.8202 => 14.9610, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.13% (0.3899 => 0.4216, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.02% (0.6283 => 0.6787, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.00% (0.5577 => 0.6023, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.94% (0.2782 => 0.3003, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.74% (1.0313 => 1.1111, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.68% (0.3022 => 0.3254, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.58% (1.1061 => 1.1899, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.52% (0.3485 => 0.3747, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2765 => 0.2972, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 7.48% (3.8646 => 4.1537, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.48% (0.2995 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.47% (0.4791 => 0.5149, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4016 => 0.4316, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.46% (0.3580 => 0.3847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.42% (0.5637 => 0.6055, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.30% (1.9828 => 2.1276, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.28% (7.2180 => 7.7436, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.27% (0.3756 => 0.4029, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.2988 => 0.3205, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 7.24% (0.8310 => 0.8912, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.19% (3.6692 => 3.9329, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 7.14% (0.7506 => 0.8042, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3293 => 0.3528, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.01% (0.7460 => 0.7983, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3868 => 0.4136, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.92% (0.6576 => 0.7031, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 6.87% (0.2243 => 0.2397, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.3220 => 0.3439, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.73% (2.1791 => 2.3258, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 6.64% (3.1889 => 3.4008, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 6.60% (0.3578 => 0.3814, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (1.3245 => 1.4101, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 6.42% (1.9270 => 2.0508, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 6.37% (0.4003 => 0.4258, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.34% (0.3646 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.31% (0.3789 => 0.4028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.30% (0.3601 => 0.3828, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.29% (0.6744 => 0.7168, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 6.29% (0.3914 => 0.4160, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.27% (16.6129 => 17.6548, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.0594 => 1.1253, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.20% (0.3663 => 0.3890, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.14% (0.3650 => 0.3874, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.12% (0.3940 => 0.4181, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.10% (0.3623 => 0.3844, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3526, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 6.09% (14.8535 => 15.7581, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.91% (0.8698 => 0.9212, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.89% (1.3813 => 1.4626, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.87% (0.6135 => 0.6495, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (8.4961 => 8.9883, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (1.3819 => 1.4613, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.3801 => 4.6306, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.71% (4.4433 => 4.6972, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 5.66% (4.6629 => 4.9269, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.65% (13.2842 => 14.0342, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.2859 => 0.3020, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.59% (0.8818 => 0.9311, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.2140 => 0.2258, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2504 => 0.2642, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.49% (0.3131 => 0.3303, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (1.1333 => 1.1944, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (6.5754 => 6.9181, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 5.06% (14.5298 => 15.2655, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3245 => 0.3407, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.83% (3.2742 => 3.4325, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2292 => 1.2852, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.49% (4.9865 => 5.2104, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.25% (3.7467 => 3.9061, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.24% (0.9108 => 0.9494, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.16% (0.4805 => 0.5005, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6250 => 0.6510, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.02% (1.5188 => 1.5799, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.86% (6.2785 => 6.5209, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1007 => 2.1743, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 3.25% (33.2944 => 34.3755, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 1.93% (16.2614 => 16.5745, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 25.50% (1.8175 => 2.2809, std.dev.: 0.0307) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.95% (1.2998 => 1.3771, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.59% (0.2093 => 0.2210, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0773, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5968, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.17% (7.9275 => 8.0202, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5953, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4456, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.64% (0.4657 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.50% (22.5627 => 21.7733, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2845, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.74% (0.3458 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1506, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.7688 => 1.7053, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.41% (3.0263 => 2.9230, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5978, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.28% (26.5159 => 25.9116, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2425, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2414, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0597, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2589, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4340, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 10:43:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 12:43:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919174336.B47243524013@llvm.org> http://llvm.org/perf/db_default/v4/nts/4014?compare_to=4012&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4014, Order: 164231, Start Time: 2012-09-19 16:33:46, End Time: 2012-09-19 17:45:02 To: 4012, Order: 164225, Start Time: 2012-09-19 15:06:34, End Time: 2012-09-19 16:17:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 1 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 7 (45 on baseline) Performance Improvements: 12 (50 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 881 (795 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -97.57% (0.0288 => 0.0007, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (13.1276 => 13.5599, std.dev.: 0.1216) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.20% (2.5088 => 2.5891, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (4.2599 => 4.3335, std.dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: 1.64% (1.9905 => 2.0232, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.38% (2.6996 => 2.7368, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ReedSolomon: 1.30% (8.7361 => 8.8498, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.15% (4.5039 => 4.5556, std.dev.: 0.0181) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.25% (0.7792 => 0.7461, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.03% (0.5760 => 0.5528, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.53% (0.3515 => 0.3391, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.27% (0.4590 => 0.4440, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.27% (0.5680 => 0.5551, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.89% (0.8979 => 0.8809, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -1.25% (0.9367 => 0.9250, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: -1.17% (3.8817 => 3.8364, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.2590 => 8.1750, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sgefa/sgefa: -9.45% (0.3683 => 0.3335, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.96% (0.4053 => 0.3933, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: -1.86% (5.2911 => 5.1926, std.dev.: 0.0350) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.55% (0.9926 => 0.9871, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6016 => 0.5993, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -4.57% (0.1685 => 0.1608, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.91% (0.1569 => 0.1492, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.52% (0.3075 => 0.3059, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.77% (0.2378 => 0.2336, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (0.3141 => 0.3143, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (0.2250 => 0.2225, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -16.52% (0.0448 => 0.0374, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: -6.82% (0.0088 => 0.0082, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -22.73% (0.0088 => 0.0068, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 21.43% (0.0196 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 46.92% (0.0130 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.78% (0.0386 => 0.0383, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.37% (0.0299 => 0.0262, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.20% (0.0273 => 0.0279, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.24% (0.0322 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -46.96% (0.0181 => 0.0096, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 2.69% (0.0186 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.21% (0.0248 => 0.0245, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -18.40% (0.0326 => 0.0266, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.70% (0.1432 => 0.1422, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: 4.72% (1.4325 => 1.5001, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.61% (0.1493 => 0.1469, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.73% (0.3997 => 0.4106, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.48% (0.1381 => 0.1429, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.03% (0.0546 => 0.0568, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.28% (0.0202 => 0.0247, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.54% (0.0597 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1322 => 1.1351, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -29.41% (0.0017 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.27% (0.0618 => 0.0536, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.95% (0.0152 => 0.0196, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7654 => 0.7657, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.10% (1.5978 => 1.5994, std.dev.: 0.0091) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -97.32% (0.0261 => 0.0007, std.dev.: 0.0018) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.53% (4.1772 => 3.0690, std.dev.: 0.0617) SingleSource/Benchmarks/Shootout-C++/except: 82566.67% (0.0006 => 0.4960, std.dev.: 0.0011) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.83% (0.6410 => 0.6848, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: 6.53% (2.1763 => 2.3184, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 5.03% (0.5309 => 0.5576, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3582 => 0.3738, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.56% (0.6173 => 0.6393, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 3.53% (1.0046 => 1.0401, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 2.90% (15.3105 => 15.7551, std.dev.: 0.1417) MultiSource/Benchmarks/Bullet/bullet: 2.54% (29.3170 => 30.0607, std.dev.: 0.2869) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.5150 => 1.5447, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 1.76% (3.0225 => 3.0756, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.56% (1.1672 => 1.1854, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.13% (1.2021 => 1.2157, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.51% (1.6538 => 2.3403, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std.dev.: 0.0199) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.79% (0.0917 => 0.1071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 15.61% (1.7426 => 2.0146, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.64% (4.0101 => 4.5570, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 12.70% (0.1433 => 0.1615, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 11.16% (1.6261 => 1.8076, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.33% (0.2857 => 0.3095, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.32% (7.0025 => 7.5853, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.73% (1.0063 => 1.0841, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.57% (0.3301 => 0.3551, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.28% (0.2694 => 0.2890, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8375, std.dev.: 0.0524) SingleSource/Benchmarks/Misc/ReedSolomon: 3.98% (8.5113 => 8.8498, std.dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.86% (4.2129 => 4.3335, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8931, std.dev.: 0.0247) MultiSource/Benchmarks/sim/sim: 2.69% (3.8907 => 3.9953, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.67% (2.6656 => 2.7368, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 2.56% (3.5520 => 3.6429, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.50% (0.6308 => 0.6466, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.24% (4.6127 => 4.7161, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (2.4013 => 2.4505, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.74% (2.4042 => 2.4461, std.dev.: 0.0153) MultiSource/Applications/minisat/minisat: 1.57% (6.2244 => 6.3221, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.33% (38.9255 => 39.4447, std.dev.: 0.1791) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4459, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/health/health: -10.36% (0.1303 => 0.1168, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.2111 => 0.1991, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.15% (0.7784 => 0.7461, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.69% (0.5740 => 0.5528, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.39% (0.4596 => 0.4440, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.88% (0.7738 => 0.7515, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.44% (0.9029 => 0.8809, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.43% (8.9977 => 8.7793, std.dev.: 0.0483) MultiSource/Applications/hexxagon/hexxagon: -1.86% (0.9425 => 0.9250, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.22% (4.2815 => 4.2292, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: -1.11% (3.8796 => 3.8364, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.01% (0.3497 => 0.2098, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.31% (5.2665 => 4.1443, std.dev.: 0.0653) SingleSource/Benchmarks/Shootout-C++/ary3: -18.41% (1.7473 => 1.4256, std.dev.: 0.0491) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.57% (1.1647 => 0.9601, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.35% (15.8312 => 13.5599, std.dev.: 0.1216) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1617, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: -10.97% (0.3746 => 0.3335, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.94% (3.2007 => 2.9465, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.69% (3.6254 => 3.3828, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8729, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: -6.41% (4.6355 => 4.3383, std.dev.: 0.0502) MultiSource/Applications/SIBsim4/SIBsim4: -6.36% (3.4230 => 3.2052, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3525, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9417, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1882, std.dev.: 0.0238) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.00% (0.4140 => 0.3933, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.19% (7.6833 => 7.3613, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/distray/distray: -4.05% (0.2664 => 0.2556, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -3.70% (8.5323 => 8.2163, std.dev.: 0.0960) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.32% (1.2722 => 1.2300, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.19% (1.1683 => 1.1310, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/misr: -3.19% (0.4296 => 0.4159, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -3.18% (9.2503 => 8.9566, std.dev.: 0.0584) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2878, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.19% (3.7496 => 3.6673, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4217, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3139, std.dev.: 0.0130) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3662, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2334, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4629, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3284, std.dev.: 0.0508) SingleSource/Benchmarks/Misc/ffbench: -1.24% (1.4117 => 1.3942, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.09% (0.9980 => 0.9871, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -0.48% (0.6022 => 0.5993, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -3.48% (0.1666 => 0.1608, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.99% (0.1554 => 0.1492, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.78% (0.3083 => 0.3059, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.42% (0.2394 => 0.2336, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (0.3175 => 0.3143, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.34% (0.2302 => 0.2225, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -16.70% (0.0449 => 0.0374, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: -7.87% (0.0089 => 0.0082, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -24.44% (0.0090 => 0.0068, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.96% (0.0301 => 0.0262, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -45.76% (0.0177 => 0.0096, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -18.15% (0.0325 => 0.0266, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: -0.12% (1.5019 => 1.5001, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.13% (0.1501 => 0.1469, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.71% (0.4264 => 0.4106, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.32% (0.1344 => 0.1429, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.57% (0.0589 => 0.0568, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.47% (0.0232 => 0.0247, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0639 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1350 => 1.1351, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.86% (0.0637 => 0.0536, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.33% (0.0246 => 0.0196, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.11% (1.5363 => 1.5994, std.dev.: 0.0091) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 11:01:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 13:01:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919180110.4106B3524013@llvm.org> http://llvm.org/perf/db_default/v4/nts/4015?compare_to=4009&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4015, Order: 164225, Start Time: 2012-09-19 15:19:13, End Time: 2012-09-19 18:02:35 To: 4009, Order: 164211, Start Time: 2012-09-19 12:06:59, End Time: 2012-09-19 14:50:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.18% (0.3488 => 0.3843, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3442 => 0.3788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3446 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.98% (0.3496 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3465 => 0.3810, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.92% (0.3469 => 0.3813, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.91% (0.3460 => 0.3803, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 9.81% (1.5932 => 1.7495, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 9.73% (0.3650 => 0.4005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3643 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.48% (0.3724 => 0.4077, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (1.6211 => 1.7212, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (0.4361 => 0.4625, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.98% (1.3152 => 1.3939, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.94% (0.5826 => 0.6172, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.90% (1.0781 => 1.1417, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 5.67% (5.5417 => 5.8557, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7630, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (0.5000 => 0.5276, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (2.7292 => 2.8766, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 5.33% (23.5202 => 24.7734, std.dev.: 0.0179) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (0.3930 => 0.4132, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (0.3195 => 0.3359, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.08% (0.2875 => 0.3021, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.3004 => 0.3155, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.3903 => 0.4099, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (4.4195 => 4.6378, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.94% (0.3890 => 0.4082, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 4.92% (4.2109 => 4.4179, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (0.5026 => 0.5271, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 4.87% (0.2750 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2813 => 0.2950, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.2823 => 0.2960, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (2.0673 => 2.1675, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.82% (0.9909 => 1.0387, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.81% (0.2725 => 0.2856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.76% (0.2792 => 0.2925, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.71% (0.2911 => 0.3048, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.70% (4.6177 => 4.8346, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 4.68% (0.3267 => 0.3420, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3060 => 0.3203, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.66% (0.6634 => 0.6943, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.65% (0.2729 => 0.2856, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.64% (0.7171 => 0.7504, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3258 => 0.3409, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.62% (0.2811 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (1.8794 => 1.9660, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.2866 => 0.2998, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (2.1013 => 2.1979, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.59% (0.4139 => 0.4329, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3124 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.55% (0.3317 => 0.3468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.54% (0.3477 => 0.3635, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (0.3625 => 0.3789, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.48% (0.3726 => 0.3893, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.48% (1.4269 => 1.4908, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.45% (0.3348 => 0.3497, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (2.1653 => 2.2610, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 4.39% (0.4146 => 0.4328, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3282 => 0.3426, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.30% (0.4251 => 0.4434, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.28% (0.3084 => 0.3216, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.26% (0.3336 => 0.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3690 => 0.3846) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.20% (0.6435 => 0.6705, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.15% (0.5546 => 0.5776, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.09% (0.9697 => 1.0094, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.5012 => 0.5214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.3981 => 0.4141, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.3271 => 0.3402, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (0.4658 => 0.4844, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.90% (2.0346 => 2.1140, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.2737 => 0.2840, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (1.9694 => 2.0432, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.75% (0.5900 => 0.6121, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.56% (0.7875 => 0.8155, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 3.45% (0.4847 => 0.5014, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (0.7426 => 0.7675, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.15% (0.5361 => 0.5530, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (0.5584 => 0.5755, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.74% (11.6398 => 11.9592, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.6926 => 4.8153, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.49% (0.4253 => 0.4359, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.60% (3.3903 => 3.6139, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6698, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.1480) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6412, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2100, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5055, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4422, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2810, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5967, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5647, std.dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8110, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7665, std.dev.: 0.0516) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9586, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 11:39:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 13:39:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919183930.755D0352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4016?compare_to=4013&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4016, Order: 164235, Start Time: 2012-09-19 17:26:24, End Time: 2012-09-19 18:40:54 To: 4013, Order: 164225, Start Time: 2012-09-19 15:43:06, End Time: 2012-09-19 16:57:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.03% (3.8069 => 3.8460, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.38% (2.0176 => 2.4287, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.69% (3.9660 => 4.3505, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.49% (0.7038 => 0.7706, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.25% (0.7710 => 0.8423, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 9.22% (1.3693 => 1.4956, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.19% (0.2721 => 0.2971, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2596 => 0.2834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.15% (0.4328 => 0.4724, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.07% (0.6959 => 0.7590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.00% (0.5265 => 0.5739, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.99% (0.9199 => 1.0026, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.88% (1.2193 => 1.3276, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.68% (1.1364 => 1.2350, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.54% (1.4563 => 1.5807, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.41% (13.8202 => 14.9819, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.3899 => 0.4224, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.21% (0.2995 => 0.3241, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4062 => 0.4395, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.18% (0.6283 => 0.6797, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.10% (0.5577 => 0.6029, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.01% (1.0313 => 1.1139, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.93% (0.1589 => 0.1715, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.79% (0.2966 => 0.3197, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.79% (0.4379 => 0.4720, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.77% (0.3580 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.64% (0.3246 => 0.3494, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.60% (0.4791 => 0.5155, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3756 => 0.4041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.57% (0.2760 => 0.2969, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.51% (1.1061 => 1.1892, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.49% (0.4390 => 0.4719, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.46% (1.9828 => 2.1307, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 7.46% (0.2628 => 0.2824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.4016 => 0.4315, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.38% (0.8310 => 0.8923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.33% (0.6576 => 0.7058, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (7.2180 => 7.7469, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.32% (3.6692 => 3.9379, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3293 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.24% (3.8646 => 4.1445, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.5637 => 0.6045, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.21% (0.7460 => 0.7998, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.3868 => 0.4146, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.18% (0.3149 => 0.3375, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.17% (0.7506 => 0.8044, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.2988 => 0.3201, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.2925 => 0.3131, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.03% (2.1791 => 2.3322, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3534 => 0.3779, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.89% (3.1889 => 3.4086, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.63% (1.9270 => 2.0548, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.54% (16.6129 => 17.6993, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 6.47% (0.6744 => 0.7180, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.46% (0.3914 => 0.4167, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (1.2749 => 1.3573, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 6.46% (0.3578 => 0.3809, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.43% (1.0594 => 1.1275, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.3245 => 1.4096, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.35% (0.4003 => 0.4257, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.33% (0.3789 => 0.4029, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.31% (0.3646 => 0.3876, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.29% (14.8535 => 15.7883, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/exceptions-2: 6.28% (0.3601 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.27% (0.3940 => 0.4187, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.17% (0.3663 => 0.3889, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1657 => 0.1759, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.13% (0.3623 => 0.3845, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.8698 => 0.9230, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.98% (13.2842 => 14.0783, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (8.4961 => 9.0026, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (1.3813 => 1.4631, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.89% (0.8818 => 0.9337, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.82% (4.3801 => 4.6349, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.81% (0.3755 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.80% (1.3819 => 1.4621, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.77% (4.4433 => 4.6996, std.dev.: 0.0075) MultiSource/Benchmarks/sim/sim: 5.75% (0.3131 => 0.3311, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.6135 => 0.6487, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.69% (4.6629 => 4.9282, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.51% (1.1333 => 1.1958, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.41% (6.5754 => 6.9312, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.30% (0.3245 => 0.3417, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.21% (14.5298 => 15.2866, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.94% (3.2742 => 3.4361, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.72% (4.9865 => 5.2220, std.dev.: 0.0196) MultiSource/Applications/hexxagon/hexxagon: 4.72% (1.2292 => 1.2872, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.59% (0.6250 => 0.6537, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.40% (3.7467 => 3.9115, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.36% (0.9108 => 0.9505, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.18% (1.5188 => 1.5823, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.86% (6.2785 => 6.5210, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.1007 => 2.1784, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.54% (33.2944 => 34.4737, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.25% (0.3511 => 0.3625, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.29% (16.2614 => 16.6344, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2676, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5475, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.01% (10.7476 => 11.0708, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5942, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.93% (3.7731 => 3.8460, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5933, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.51% (0.4657 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.29% (22.5627 => 21.8198, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.30% (20.3410 => 18.2462, std.dev.: 0.0309) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.86% (1.3780 => 1.2972, std.dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.50% (3.0263 => 2.9203, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.35% (26.5159 => 25.8936, std.dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2378, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2393, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std.dev.: 0.0122) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4309, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0629, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2607, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 12:00:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 14:00:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919190025.9B71C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4017?compare_to=4011&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4017, Order: 164237, Start Time: 2012-09-19 17:41:59, End Time: 2012-09-19 19:01:50 To: 4011, Order: 164219, Start Time: 2012-09-19 13:59:57, End Time: 2012-09-19 15:19:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.21% (0.5702 => 0.5690, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -0.60% (15.9149 => 15.8197, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: -0.13% (14.7283 => 14.7093, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 0.24% (82.6600 => 82.8593, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/gs/gs: -0.34% (4.3144 => 4.2996, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2253 => 1.2236, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (7.4207 => 7.4147, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.23% (3.6878 => 3.6792, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.22% (0.6376 => 0.6390, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (0.0650 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.02% (63.2438 => 82.8593, std.dev.: 0.0164) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.92% (0.0720 => 10.3305, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.16% (10.3673 => 15.0494, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: 27.19% (0.1622 => 0.2063, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.53% (2.2022 => 2.5221, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.20% (7.0540 => 8.0557, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/flops: 13.62% (0.1432 => 0.1627, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1566 => 0.1751, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.70% (1.1194 => 1.2504, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.59% (1.7609 => 1.9473, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3473 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.32% (0.3561 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3497 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.29% (0.3543 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.12% (0.3694 => 0.4031, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.91% (0.3828 => 0.4169, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.3927 => 0.4276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.75% (0.3886 => 0.4226, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (9.4845 => 10.1709, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.05% (10.4361 => 11.1722, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.03% (0.4879 => 0.5222, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.01% (0.1655 => 0.1771, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.63% (0.7433 => 0.7926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.28% (5.7591 => 6.1210, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 6.21% (0.7115 => 0.7557, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.19% (0.2554 => 0.2712, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.17% (0.6675 => 0.7087, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (0.4615 => 0.4896, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.99% (0.2271 => 0.2407, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.88% (0.8067 => 0.8541, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 5.87% (0.3423 => 0.3624, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.87% (0.5860 => 0.6204, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 5.86% (3.3354 => 3.5309, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (8.1363 => 8.6107, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.79% (1.3050 => 1.3805, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.74% (0.8172 => 0.8641, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.70% (4.2646 => 4.5078, std.dev.: 0.0088) SingleSource/UnitTests/ObjC++/property-reference-object: 5.69% (0.6030 => 0.6373, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.68% (1.5415 => 1.6291, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.64% (0.5105 => 0.5393, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 5.59% (0.5925 => 0.6256, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.46% (4.9449 => 5.2148, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.5569 => 0.5872, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.40% (5.0018 => 5.2718, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 5.32% (1.5603 => 1.6433, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3121 => 0.3287, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9765 => 1.0283, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2758 => 0.2904, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 5.26% (0.7835 => 0.8247, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 5.25% (1.1642 => 1.2253, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.16% (0.4636 => 0.4875, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.14% (0.3092 => 0.3251, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.3180 => 0.3342, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (7.9617 => 8.3617, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: 4.94% (0.3422 => 0.3591, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7326 => 0.7683, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 4.84% (0.3387 => 0.3551, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.80% (0.6456 => 0.6766, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.78% (0.4103 => 0.4299, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.4064 => 0.4258, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.76% (1.0722 => 1.1232, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 4.72% (3.8723 => 4.0549, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.5020 => 0.5253, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.63% (0.4299 => 0.4498, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (1.1861 => 1.2410, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.62% (21.9371 => 22.9497, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.3650 => 0.3816, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.3136 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.48% (0.4289 => 0.4481, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.48% (0.3865 => 0.4038, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3826 => 0.3996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.39% (0.2871 => 0.2997, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4203 => 0.4387, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3098 => 0.3233, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.34% (0.2905 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3603 => 0.3757, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.26% (2.0273 => 2.1136, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.25% (0.2872 => 0.2994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.24% (0.2831 => 0.2951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.23% (0.5981 => 0.6234, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.21% (0.3232 => 0.3368, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8921 => 0.9292, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (2.0665 => 2.1515, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.08% (0.3283 => 0.3417, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.07% (2.2969 => 2.3904, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wc: 4.03% (0.3052 => 0.3175, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.00% (0.4048 => 0.4210, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3935 => 0.4092, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.98% (0.3162 => 0.3288, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.94% (0.2793 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3684 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.72% (1.5859 => 1.6449, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3379 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (14.3668 => 14.8857, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.4186 => 1.4674, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.29% (2.2024 => 2.2748, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.1840 => 1.2189, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.2842 => 1.3160, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.8101 => 0.8282, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3125, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3821, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (4.2280 => 4.3571, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std.dev.: 0.0123) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7903, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5839, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.61% (5.2763 => 3.2393, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.91% (5.3855 => 3.8824, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.63% (5.3526 => 3.8736, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1664, std.dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.13% (2.9384 => 2.5821, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.89% (22.1758 => 20.2033, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2810, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.33% (1.8329 => 1.7168, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5059, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4122, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0096, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/chomp: -2.63% (1.2373 => 1.2047, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9993, std.dev.: 0.0141) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5082, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4240, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5769, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.82% (0.5229 => 0.5690, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.54% (14.9895 => 15.8197, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 3.91% (14.1553 => 14.7093, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (4.1105 => 4.2996, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.75% (1.1048 => 1.2236, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.58% (7.1582 => 7.4147, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.25% (3.4629 => 3.6792, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.6222 => 0.6390, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 12:10:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 14:10:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120919191051.99D1C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4018?compare_to=4014&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4018, Order: 164237, Start Time: 2012-09-19 18:00:55, End Time: 2012-09-19 19:12:16 To: 4014, Order: 164231, Start Time: 2012-09-19 16:33:46, End Time: 2012-09-19 17:45:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 9 (41 on baseline) Performance Improvements: 2 (41 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 889 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/health/health: 11.22% (0.1168 => 0.1299, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2653 => 0.2795, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.17% (1.3911 => 1.4213, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.13% (0.8809 => 0.8997, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.48% (1.3400 => 1.3598, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.48% (1.2529 => 1.2714, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.16% (4.3023 => 4.3523, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (3.1853 => 3.3934, std.dev.: 0.0498) MultiSource/Applications/SPASS/SPASS: 3.56% (8.2163 => 8.5088, std.dev.: 0.0671) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.4460 => 1.4300, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.08% (3.6673 => 3.6277, std.dev.: 0.0143) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.51% (0.9871 => 0.9921, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 0.80% (0.5993 => 0.6041, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 3.30% (0.1608 => 0.1661, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.09% (0.1492 => 0.1553, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (0.3059 => 0.3072, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.47% (0.2336 => 0.2325, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.85% (0.3143 => 0.3085, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.66% (0.2225 => 0.2262, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 1.87% (0.0374 => 0.0381, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: -19.51% (0.0082 => 0.0066, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: -39.71% (0.0068 => 0.0041, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0238 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0383 => 0.0382, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.60% (0.0262 => 0.0295, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.70% (0.0279 => 0.0238, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0318 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 85.42% (0.0096 => 0.0178, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -13.09% (0.0191 => 0.0166, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 21.80% (0.0266 => 0.0324, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1422 => 0.1420, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.53% (1.5001 => 1.4921, std.dev.: 0.0242) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.75% (0.1469 => 0.1480, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.63% (0.4106 => 0.4039, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.99% (0.1429 => 0.1372, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.75% (0.0568 => 0.0612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.94% (0.0247 => 0.0178, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.46% (0.0648 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 571.43% (0.0007 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1351 => 1.1367, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.93% (0.0536 => 0.0541, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (0.0196 => 0.0135, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7657 => 0.7658, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.19% (1.5994 => 1.5963, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.77% (4.1772 => 3.1008, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/except: 83616.67% (0.0006 => 0.5023, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.04% (0.6410 => 0.6861, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 6.18% (2.1763 => 2.3109, std.dev.: 0.0504) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.89% (0.3582 => 0.3757, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.82% (0.5309 => 0.5565, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.90% (0.6173 => 0.6414, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 3.68% (1.0046 => 1.0416, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 3.22% (0.6915 => 0.7138, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 2.80% (15.3105 => 15.7389, std.dev.: 0.0952) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (1.5150 => 1.5556, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 2.49% (1.3268 => 1.3598, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.7639 => 0.7804, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 2.07% (29.3170 => 29.9243, std.dev.: 0.1434) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6069 => 0.6183, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0017, std.dev.: 0.0486) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.86% (4.0101 => 4.5659, std.dev.: 0.0558) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6169, std.dev.: 0.0423) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.65% (0.2694 => 0.2927, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.03% (1.0063 => 1.0871, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.66% (0.3301 => 0.3554, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Puzzle: 7.47% (0.1433 => 0.1540, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.80% (0.7609 => 0.7974, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/fp-convert: 4.58% (15.2242 => 15.9212, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.89% (40.4792 => 42.0543, std.dev.: 0.5194) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.78% (0.8498 => 0.8819, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8938, std.dev.: 0.0343) MultiSource/Benchmarks/sim/sim: 2.54% (3.8907 => 3.9897, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ReedSolomon: 2.32% (8.5113 => 8.7088, std.dev.: 0.0608) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.31% (0.5876 => 0.6012, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 2.30% (0.6308 => 0.6453, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4467, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.13% (1.2726 => 1.2870, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.06% (0.7738 => 0.7501, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.84% (0.7784 => 0.7563, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.83% (0.4596 => 0.4466, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.78% (0.3497 => 0.2106, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.14% (5.2665 => 4.1534, std.dev.: 0.0791) SingleSource/Benchmarks/Shootout-C++/ary3: -20.96% (1.7473 => 1.3811, std.dev.: 0.0400) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.56% (1.1647 => 0.9602, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.20% (15.8312 => 13.2664, std.dev.: 0.1333) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.65% (0.0917 => 0.0801, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1594, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: -10.89% (0.3746 => 0.3338, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.91% (3.2007 => 2.9476, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3726, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: -6.58% (3.4230 => 3.1978, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3308, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3506, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.80% (3.6023 => 3.3934, std.dev.: 0.0498) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9505, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1890, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -4.16% (7.6833 => 7.3635, std.dev.: 0.0253) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.85% (1.2722 => 1.2232, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.78% (1.4021 => 1.3491, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/methcall: -3.53% (9.2503 => 8.9241, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/misr: -3.26% (0.4296 => 0.4156, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6277, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.22% (1.1683 => 1.1424, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.17% (45.4683 => 44.4822, std.dev.: 0.0840) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.13% (2.3569 => 2.3067, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -2.08% (3.4876 => 3.4149, std.dev.: 0.0223) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3667, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2292, std.dev.: 0.0324) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3115, std.dev.: 0.0929) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.59% (0.9980 => 0.9921, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 0.32% (0.6022 => 0.6041, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -0.30% (0.1666 => 0.1661, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1554 => 0.1553, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (0.3083 => 0.3072, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.88% (0.2394 => 0.2325, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.83% (0.3175 => 0.3085, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.74% (0.2302 => 0.2262, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -15.14% (0.0449 => 0.0381, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: -25.84% (0.0089 => 0.0066, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: -54.44% (0.0090 => 0.0041, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0301 => 0.0295, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.20% (0.0284 => 0.0238, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -12.17% (0.0189 => 0.0166, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1429 => 0.1420, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.65% (1.5019 => 1.4921, std.dev.: 0.0242) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.40% (0.1501 => 0.1480, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.28% (0.4264 => 0.4039, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.08% (0.1344 => 0.1372, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1350 => 1.1367, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.07% (0.0637 => 0.0541, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.12% (0.0246 => 0.0135, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.91% (1.5363 => 1.5963, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 13:22:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 15:22:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919202248.DFA88352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4019?compare_to=4016&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4019, Order: 164238, Start Time: 2012-09-19 19:09:13, End Time: 2012-09-19 20:23:42 To: 4016, Order: 164235, Start Time: 2012-09-19 17:26:24, End Time: 2012-09-19 18:40:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.52% (78.6615 => 80.6416, std.dev.: 0.5570) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.35% (2.0176 => 2.4281, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1413 => 0.1563, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.88% (3.9660 => 4.3577, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.82% (0.1588 => 0.1744, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.68% (0.7038 => 0.7719, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 9.36% (1.3693 => 1.4974, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7061 => 0.7711, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.19% (0.1327 => 0.1449, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.17% (0.5265 => 0.5748, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.15% (0.6959 => 0.7596, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.05% (0.7710 => 0.8408, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.2721 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.03% (0.4328 => 0.4719, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.01% (1.2193 => 1.3292, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.01% (0.9199 => 1.0028, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.67% (0.3899 => 0.4237, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.67% (1.1364 => 1.2349, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 8.59% (13.8202 => 15.0078, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.55% (1.4563 => 1.5808, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.22% (0.4062 => 0.4396, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.5577 => 0.6034, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 8.18% (0.1589 => 0.1719, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.18% (0.6283 => 0.6797, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.13% (0.2781 => 0.3007, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.13% (1.0313 => 1.1151, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3022 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.93% (0.3580 => 0.3864, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.86% (0.2966 => 0.3199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.3246 => 0.3500, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3485 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.76% (1.1061 => 1.1919, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.74% (0.4791 => 0.5162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.68% (0.2655 => 0.2859) MultiSource/Applications/sgefa/sgefa: 7.68% (0.2995 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4016 => 0.4323, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.63% (0.4390 => 0.4725, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3756 => 0.4041, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.58% (0.4379 => 0.4711, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 7.57% (0.2760 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.56% (3.8646 => 4.1566, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.50% (1.9828 => 2.1316, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.39% (0.8310 => 0.8924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2761 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.38% (0.5637 => 0.6053, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 7.37% (0.3868 => 0.4153, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (7.2180 => 7.7472, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3293 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.28% (0.6576 => 0.7055, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.28% (0.7460 => 0.8003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.26% (0.7506 => 0.8051, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.25% (3.6692 => 3.9352, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 7.25% (2.1791 => 2.3370, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.18% (0.3453 => 0.3701, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.06% (0.2988 => 0.3199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.97% (0.1865 => 0.1995, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 6.89% (3.1889 => 3.4087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3534 => 0.3775, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.70% (1.9270 => 2.0562, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.65% (1.0594 => 1.1299, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 6.64% (0.6744 => 0.7192, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.63% (16.6129 => 17.7146, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.61% (1.3245 => 1.4120, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (1.2749 => 1.3581, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.44% (14.8535 => 15.8096, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 6.43% (0.3578 => 0.3808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.41% (0.3914 => 0.4165, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.31% (0.3646 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.31% (0.3789 => 0.4028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.31% (0.3663 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.30% (0.3601 => 0.3828, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4113 => 0.4372, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.27% (0.3940 => 0.4187, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.24% (0.8698 => 0.9241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.16% (0.3623 => 0.3846, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.01% (0.6135 => 0.6504, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (8.4961 => 9.0054, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.93% (0.8818 => 0.9341, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.3801 => 4.6377, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (13.2842 => 14.0619, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.85% (4.4433 => 4.7032, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 5.84% (0.3131 => 0.3314, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.79% (4.6629 => 4.9327, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.73% (0.3755 => 0.3970, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4601, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.68% (1.3819 => 1.4604, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (1.1333 => 1.1968, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (6.5754 => 6.9415, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.55% (0.2504 => 0.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.22% (14.5298 => 15.2885, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.99% (3.2742 => 3.4376, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2292 => 1.2888, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.83% (4.9865 => 5.2275, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6250 => 0.6532, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.47% (3.7467 => 3.9142, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.44% (0.9108 => 0.9512, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.37% (1.5188 => 1.5852, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.35% (0.4805 => 0.5014, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.95% (6.2785 => 6.5267, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.73% (2.1007 => 2.1790, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 3.59% (33.2944 => 34.4886, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.31% (16.2614 => 16.6371, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std.dev.: 0.0431) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.91% (1.0895 => 1.3500, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6988, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5468, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0784, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5964, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6849, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5847, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.62% (0.4657 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.22% (22.5627 => 21.8373, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2657, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std.dev.: 0.0095) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1505, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9235, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5919, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9081, std.dev.: 0.0402) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2377, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2282, std.dev.: 0.0166) MultiSource/Applications/viterbi/viterbi: -1.15% (4.4810 => 4.4294, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0622, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2610, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 13:48:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 15:48:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919204851.B6960352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4020?compare_to=4017&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4020, Order: 164239, Start Time: 2012-09-19 19:30:34, End Time: 2012-09-19 20:50:13 To: 4017, Order: 164237, Start Time: 2012-09-19 17:41:59, End Time: 2012-09-19 19:01:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (709 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5690 => 0.5693, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 0.18% (15.8197 => 15.8485, std.dev.: 0.1194) MultiSource/Applications/kimwitu++/kc: 0.06% (14.7093 => 14.7178, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 0.01% (82.8593 => 82.8641, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 0.17% (4.2996 => 4.3071, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2236 => 1.2224, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.4147 => 7.4190, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.12% (3.6792 => 3.6837, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.17% (0.6390 => 0.6401, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0684 => 0.0685, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.02% (63.2438 => 82.8641, std.dev.: 0.0146) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.50% (0.0720 => 10.3302, std.dev.: 0.0067) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.23% (10.3673 => 15.0561, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/richards_benchmark: 27.25% (0.1622 => 0.2064, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.58% (2.2022 => 2.5233, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.07% (7.0540 => 8.0464, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.75% (0.1566 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.61% (1.7609 => 1.9477, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3473 => 0.3808, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3516 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.31% (0.3543 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3497 => 0.3822, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.24% (0.3561 => 0.3890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.12% (0.3694 => 0.4031, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.09% (0.1584 => 0.1728, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 9.04% (0.3828 => 0.4174, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.96% (0.3886 => 0.4234, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.91% (0.3927 => 0.4277, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.21% (9.4845 => 10.1682, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.4879 => 0.5225) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.00% (10.4361 => 11.1666, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.63% (0.7433 => 0.7926, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2554 => 0.2718, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 6.38% (0.7835 => 0.8335, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 6.29% (5.7591 => 6.1211, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 6.28% (0.7115 => 0.7562, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.24% (0.4615 => 0.4903, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.21% (0.3109 => 0.3302, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.20% (0.6675 => 0.7089, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.18% (0.5860 => 0.6222, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.99% (0.2271 => 0.2407, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.93% (3.3354 => 3.5331, std.dev.: 0.0378) MultiSource/Benchmarks/McCat/18-imp/imp: 5.90% (0.3423 => 0.3625, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (8.1363 => 8.6161, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.84% (0.8067 => 0.8538, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.3050 => 1.3809, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.8172 => 0.8646, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (4.2646 => 4.5097, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.72% (1.5415 => 1.6296, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.5105 => 0.5395, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5569 => 0.5882, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.45% (4.9449 => 5.2144, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 5.44% (1.5603 => 1.6452, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.44% (0.2758 => 0.2908, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.43% (5.0018 => 5.2733, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 5.37% (0.3092 => 0.3258, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9765 => 1.0289, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.25% (1.1642 => 1.2253, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.03% (7.9617 => 8.3620, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.4103 => 0.4306, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.91% (0.3422 => 0.3590, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7326 => 0.7684, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.6456 => 0.6770, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.80% (3.8723 => 4.0580, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5020 => 0.5259, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 4.76% (1.0722 => 1.1232, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (0.4064 => 0.4257, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (1.1861 => 1.2416, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 4.67% (21.9371 => 22.9615, std.dev.: 0.0122) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.66% (0.4636 => 0.4852, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.52% (0.3650 => 0.3815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.48% (0.4289 => 0.4481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.47% (0.4203 => 0.4391, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3865 => 0.4036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3098 => 0.3235, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.40% (0.3136 => 0.3274, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.39% (0.2871 => 0.2997, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.37% (0.2905 => 0.3032, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.3603 => 0.3760, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.32% (0.2872 => 0.2996, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.29% (0.3826 => 0.3990, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.26% (2.0273 => 2.1137, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.24% (2.2969 => 2.3943, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3162 => 0.3296, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.21% (2.0665 => 2.1536, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5981 => 0.6232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.17% (0.3283 => 0.3420, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.17% (0.2831 => 0.2949, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8921 => 0.9292, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.14% (0.6450 => 0.6717, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.13% (0.4048 => 0.4215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3052 => 0.3177, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.08% (0.3232 => 0.3364, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2793 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3935 => 0.4089, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.87% (1.5859 => 1.6473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.72% (0.3684 => 0.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (1.4186 => 1.4701, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (14.3668 => 14.8810, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.2024 => 2.2766, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1840 => 1.2198, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.58% (1.2842 => 1.3173, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.8101 => 0.8286, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.05% (17.1811 => 17.3612, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7514, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3482, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2305, std.dev.: 0.0429) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7892, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.11% (26.0924 => 26.3822, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/fbench: 1.05% (2.2771 => 2.3011, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.62% (5.2763 => 3.2387, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.94% (5.3855 => 3.8808, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.61% (5.3526 => 3.8749, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1593, std.dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.06% (2.9384 => 2.5839, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -8.92% (22.1758 => 20.1977, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3084, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7162, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.98% (3.2827 => 3.1519, std.dev.: 0.0254) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5077, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4209, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9904, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -2.45% (1.2373 => 1.2070, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0077, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5791, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2351, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.87% (0.5229 => 0.5693, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 5.73% (14.9895 => 15.8485, std.dev.: 0.1194) MultiSource/Applications/kimwitu++/kc: 3.97% (14.1553 => 14.7178, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (4.1105 => 4.3071, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.64% (1.1048 => 1.2224, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.64% (7.1582 => 7.4190, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.38% (3.4629 => 3.6837, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.88% (0.6222 => 0.6401, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 14:13:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 16:13:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120919211309.64F64352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4021?compare_to=4015&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4021, Order: 164237, Start Time: 2012-09-19 18:31:01, End Time: 2012-09-19 21:14:32 To: 4015, Order: 164225, Start Time: 2012-09-19 15:19:13, End Time: 2012-09-19 18:02:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (120 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 29.16% (58.0078 => 74.9249, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.0455 => 54.7439, std.dev.: 0.1098) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.11% (1.7495 => 1.7301, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.25% (126.1810 => 124.6098, std.dev.: 0.4997) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.89% (0.3488 => 0.3833, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 9.70% (0.3465 => 0.3801, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3446 => 0.3779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3442 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3496 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.62% (0.3460 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.54% (0.3469 => 0.3800, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.42% (0.3650 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.33% (0.3643 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.13% (0.3724 => 0.4064, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.59% (1.5932 => 1.7301, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.5889 => 0.6245, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.90% (0.5826 => 0.6170, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.90% (1.6211 => 1.7168, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (0.4361 => 0.4617, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.3004 => 0.3178, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (1.3152 => 1.3912, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.71% (3.5627 => 3.7663, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2875 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.63% (0.2736 => 0.2890, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3362 => 0.3550, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.2823 => 0.2980, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.52% (0.3060 => 0.3229, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2813 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (0.4994 => 0.5268, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 5.48% (5.5417 => 5.8456, std.dev.: 0.0192) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8786, std.dev.: 0.0100) MultiSource/Applications/d/make_dparser: 5.45% (1.0781 => 1.1369, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.42% (0.2750 => 0.2899, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.41% (0.3195 => 0.3368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.41% (0.2738 => 0.2886, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2911 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.36% (0.3267 => 0.3442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.34% (0.3317 => 0.3494, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.33% (2.0673 => 2.1775, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3258 => 0.3431, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.31% (0.9909 => 1.0435, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2780 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.26% (0.3096 => 0.3259, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.24% (0.2729 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.23% (0.2811 => 0.2958, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2803 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2792 => 0.2937, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.17% (0.3348 => 0.3521, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.03% (0.2566 => 0.2695, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.99% (0.3124 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.96% (23.5202 => 24.6857, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.3625 => 0.3804, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3726 => 0.3909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.89% (0.3477 => 0.3647, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.87% (0.3678 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (4.4195 => 4.6324, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4146 => 0.4343, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.72% (0.3690 => 0.3864, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.70% (0.4251 => 0.4451, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.66% (0.3282 => 0.3435, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (0.5026 => 0.5260, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.64% (4.2109 => 4.4063, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.60% (0.7171 => 0.7501, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (0.3890 => 0.4065, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.3981 => 0.4160, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.48% (0.9697 => 1.0131, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (2.1013 => 2.1953, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 4.44% (4.6177 => 4.8225, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (2.1653 => 2.2604, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.3903 => 0.4074, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.5012 => 0.5230, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 4.35% (0.3336 => 0.3481, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.4139 => 0.4318, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 4.30% (0.6634 => 0.6919, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.29% (0.3845 => 0.4010, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (1.8794 => 1.9592, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.22% (0.3084 => 0.3214, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.14% (0.4029 => 0.4196, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.5900 => 0.6144, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 4.10% (1.4269 => 1.4854, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.04% (0.5546 => 0.5770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.3271 => 0.3403, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (0.4658 => 0.4842, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (1.9694 => 2.0439, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (1.9966 => 2.0684, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 3.52% (2.0346 => 2.1062, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.45% (0.7875 => 0.8147, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (0.7426 => 0.7672, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.28% (0.4847 => 0.5006, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (0.5361 => 0.5535, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.95% (0.5584 => 0.5749, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (4.6926 => 4.8171, std.dev.: 0.0133) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (11.6398 => 11.9439, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.40% (0.4253 => 0.4355, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6680, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8864, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6359, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std.dev.: 0.0074) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5060, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4555, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2818, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5931, std.dev.: 0.0267) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5565, std.dev.: 0.0167) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8097, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -7.20% (0.2402 => 0.2229, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -3.81% (11.2080 => 10.7811, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8273, std.dev.: 0.0646) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5782, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9580, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 15:05:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 17:05:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919220541.2EDB3352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4022?compare_to=4019&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4022, Order: 164244, Start Time: 2012-09-19 20:52:42, End Time: 2012-09-19 22:07:05 To: 4019, Order: 164238, Start Time: 2012-09-19 19:09:13, End Time: 2012-09-19 20:23:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.10% (3.7989 => 3.8408, std.dev.: 0.0129) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.46% (2.0176 => 2.4103, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.17% (0.1013 => 0.1116, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.82% (3.9660 => 4.3553, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 9.59% (0.7038 => 0.7713, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.39% (0.7710 => 0.8434, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 9.35% (1.3693 => 1.4973, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.30% (0.2721 => 0.2974, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.19% (0.9199 => 1.0044, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5265 => 0.5746, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.99% (0.4328 => 0.4717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.97% (1.2193 => 1.3287, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5818 => 0.6340, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.91% (0.6959 => 0.7579, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5748 => 0.6255, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.72% (1.1364 => 1.2355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.69% (0.4062 => 0.4415, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 8.63% (13.8202 => 15.0125, std.dev.: 0.0130) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7061 => 0.7662, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.4563 => 1.5797, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.36% (0.6283 => 0.6808, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.28% (0.3899 => 0.4222, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.28% (0.5577 => 0.6039, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 8.08% (1.0313 => 1.1146, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.92% (0.3246 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.91% (0.2782 => 0.3002, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.85% (0.4791 => 0.5167, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 7.71% (0.2995 => 0.3226, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 7.70% (3.8646 => 4.1620, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4379 => 0.4715, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.65% (0.3580 => 0.3854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.63% (0.2765 => 0.2976, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.62% (1.1061 => 1.1904, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.62% (0.4016 => 0.4322, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2127 => 0.2288, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.54% (0.4390 => 0.4721, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 7.47% (0.2690 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.45% (7.2180 => 7.7560, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.45% (0.5637 => 0.6057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.44% (0.6576 => 0.7065, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.3756 => 0.4035, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (1.9828 => 2.1300, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2966 => 0.3186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.40% (0.8310 => 0.8925, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.21% (3.6692 => 3.9336, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.20% (0.7460 => 0.7997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.18% (0.7506 => 0.8045, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.15% (0.3453 => 0.3700, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3107 => 0.3329, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.11% (0.3149 => 0.3373, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.3868 => 0.4143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2243 => 0.2402, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.06% (2.1791 => 2.3329, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.02% (0.4003 => 0.4284, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.99% (0.3220 => 0.3445, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.97% (3.1889 => 3.4112, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3914 => 0.4183, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.83% (0.3940 => 0.4209, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.74% (0.3192 => 0.3407, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3534 => 0.3772, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.72% (0.6744 => 0.7197, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 6.68% (1.9270 => 2.0557, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 6.68% (16.6129 => 17.7223, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.63% (1.3245 => 1.4123, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (1.2749 => 1.3582, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.49% (1.0594 => 1.1282, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.46% (0.1657 => 0.1764, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.40% (14.8535 => 15.8043, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (13.2842 => 14.1050, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.17% (0.8698 => 0.9235, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.06% (1.3819 => 1.4657, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (8.4961 => 9.0089, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (1.3813 => 1.4644, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.01% (0.4113 => 0.4360, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.00% (4.3801 => 4.6431, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.00% (0.8818 => 0.9347, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.95% (4.4433 => 4.7077, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.92% (0.6135 => 0.6498, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (0.2859 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.91% (0.3131 => 0.3316, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.83% (0.3755 => 0.3974, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.67% (0.2504 => 0.2646, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.65% (0.2140 => 0.2261, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.61% (1.1333 => 1.1969, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.58% (6.5754 => 6.9424, std.dev.: 0.0160) MultiSource/Applications/oggenc/oggenc: 5.49% (4.6629 => 4.9187, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 5.47% (14.5298 => 15.3253, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.00% (4.9865 => 5.2358, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.99% (3.2742 => 3.4377, std.dev.: 0.0204) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2292 => 1.2877, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.62% (0.4805 => 0.5027, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.51% (0.9108 => 0.9519, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.51% (3.7467 => 3.9157, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6250 => 0.6521, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.27% (1.5188 => 1.5837, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.15% (6.2785 => 6.5391, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.74% (2.1007 => 2.1793, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 3.40% (33.2944 => 34.4273, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (0.3511 => 0.3624, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.33% (16.2614 => 16.6401, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4162, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6970, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0701, std.dev.: 0.0457) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5980, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.79% (3.7731 => 3.8408, std.dev.: 0.0129) MultiSource/Benchmarks/NPB-serial/is/is: 1.53% (8.3908 => 8.5191, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.07% (7.9275 => 8.0124, std.dev.: 0.0133) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.08% (0.4657 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.05% (22.5627 => 21.8737, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2926, std.dev.: 0.0235) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1500, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.46% (3.0263 => 2.9216, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.36% (26.5159 => 25.8895, std.dev.: 0.0285) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2387, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.1080 => 4.0569, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2463, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5617, std.dev.: 0.0181) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 15:37:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 17:37:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120919223739.1BCD1352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4023?compare_to=4020&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4023, Order: 164248, Start Time: 2012-09-19 21:19:01, End Time: 2012-09-19 22:38:53 To: 4020, Order: 164239, Start Time: 2012-09-19 19:30:34, End Time: 2012-09-19 20:50:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (142 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.15% (1.9477 => 1.9701, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (11.1666 => 11.2816, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.70% (78.9171 => 80.2550, std.dev.: 0.4826) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.53% (0.5693 => 0.5723, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 0.65% (15.8485 => 15.9509, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 0.23% (14.7178 => 14.7512, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 0.47% (82.8641 => 83.2547, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 0.41% (4.3071 => 4.3248, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.21% (1.2224 => 1.2250, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (7.4190 => 7.4370, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.14% (3.6837 => 3.6888, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6401 => 0.6399, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.31% (0.0685 => 0.0676, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.64% (63.2438 => 83.2547, std.dev.: 0.0058) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.78% (0.0720 => 10.3304, std.dev.: 0.0076) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.47% (10.3673 => 15.1853, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: 28.18% (0.1622 => 0.2079, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.10% (2.2022 => 2.5348, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.25% (7.0540 => 8.0593, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: 14.04% (0.1432 => 0.1633, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.47% (1.1194 => 1.2590, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.88% (1.7609 => 1.9701, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.75% (0.3282 => 0.3602, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 9.68% (0.3927 => 0.4307, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.60% (0.3886 => 0.4259, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 8.40% (0.1440 => 0.1561, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 8.10% (10.4361 => 11.2816, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.75% (0.4879 => 0.5257, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.63% (9.4845 => 10.2080, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.04% (0.7433 => 0.7956, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.84% (0.5105 => 0.5454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.68% (0.6675 => 0.7121, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.63% (0.7115 => 0.7587, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 6.63% (0.3109 => 0.3315, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 6.55% (0.1695 => 0.1806, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.45% (5.7591 => 6.1306, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5860 => 0.6230, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2271 => 0.2414, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (8.1363 => 8.6479, std.dev.: 0.0098) MultiSource/Applications/d/make_dparser: 6.24% (3.3354 => 3.5434, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.8067 => 0.8569, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 6.22% (0.3423 => 0.3636, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.21% (4.2646 => 4.5295, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.18% (1.5415 => 1.6368, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.3050 => 1.3854, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.08% (0.7835 => 0.8311, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.03% (5.0018 => 5.3035, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.8172 => 0.8662, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.00% (4.9449 => 5.2414, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.84% (0.2107 => 0.2230, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.82% (0.5569 => 0.5893, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.65% (0.9765 => 1.0317, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 5.55% (1.1642 => 1.2288, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 5.51% (1.5603 => 1.6463, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.6030 => 0.6354, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/09-vor/vor: 5.35% (0.3180 => 0.3350, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.27% (1.0722 => 1.1287, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (7.9617 => 8.3804, std.dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 5.20% (0.6456 => 0.6792, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 5.18% (3.8723 => 4.0728, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.18% (0.4636 => 0.4876, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 5.14% (0.4299 => 0.4520, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.11% (0.3422 => 0.3597, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 5.11% (0.3387 => 0.3560, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.4064 => 0.4271, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.02% (0.5020 => 0.5272, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.97% (0.4103 => 0.4307, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.95% (1.1861 => 1.2448, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.80% (21.9371 => 22.9892, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.79% (0.3865 => 0.4050, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1238, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2891 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4203 => 0.4402, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.72% (0.2905 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4289 => 0.4489, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.63% (0.3650 => 0.3819, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.3136 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.62% (0.4048 => 0.4235, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.61% (0.3603 => 0.3769, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 4.58% (2.2969 => 2.4021, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 4.55% (0.8921 => 0.9327, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6450 => 0.6743, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3826 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3283 => 0.3430, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2871 => 0.2999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.3098 => 0.3236, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.37% (2.0665 => 2.1568, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.35% (0.2872 => 0.2997, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.35% (0.4620 => 0.4821, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.28% (0.2756 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.2831 => 0.2952, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.27% (0.3162 => 0.3297, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.26% (0.5981 => 0.6236, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3232 => 0.3369, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3052 => 0.3181, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3935 => 0.4100, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.4186 => 1.4772, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2793 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.05% (1.5859 => 1.6502, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2802 => 0.2915, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (14.3668 => 14.9336, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/methcall: 3.93% (0.2877 => 0.2990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.91% (0.3379 => 0.3511, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3684 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.74% (2.2024 => 2.2848, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.1840 => 1.2248, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.69% (1.2842 => 1.3187, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.54% (0.8101 => 0.8307, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.42% (17.1811 => 17.4255, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.35% (3.8922 => 3.9446, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4141, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (3.1578 => 3.3797, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3516, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7887, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std.dev.: 0.0285) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2596, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.55% (5.3855 => 3.9016, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.30% (5.3526 => 3.8915, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1836, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.65% (2.9384 => 2.5960, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -8.42% (22.1758 => 20.3082, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2914, std.dev.: 0.0289) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (1.8329 => 1.7154, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5024, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4133, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0011, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.51% (1.2373 => 1.2062, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9974, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5086, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5785, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.45% (0.5229 => 0.5723, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 6.41% (14.9895 => 15.9509, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 4.21% (14.1553 => 14.7512, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 5.21% (4.1105 => 4.3248, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.88% (1.1048 => 1.2250, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.89% (7.1582 => 7.4370, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.52% (3.4629 => 3.6888, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.6222 => 0.6399, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 16:49:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 18:49:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120919234921.16644352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4024?compare_to=4022&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4024, Order: 164253, Start Time: 2012-09-19 22:35:33, End Time: 2012-09-19 23:50:17 To: 4022, Order: 164244, Start Time: 2012-09-19 20:52:42, End Time: 2012-09-19 22:07:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.40% (78.2250 => 80.1032, std.dev.: 0.6773) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.59% (2.0176 => 2.4129, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.69% (3.9660 => 4.3504, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 9.35% (0.7038 => 0.7696, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.09% (0.7710 => 0.8411, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.97% (0.2721 => 0.2965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.96% (0.9199 => 1.0023, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 8.90% (0.4328 => 0.4713, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4911, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.81% (0.5265 => 0.5729, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.74% (0.1327 => 0.1443) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.6959 => 0.7564, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5818 => 0.6323, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.62% (1.2193 => 1.3244, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4062 => 0.4404, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.35% (1.1364 => 1.2313, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.35% (1.4563 => 1.5779, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 8.30% (13.8202 => 14.9673, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6283 => 0.6788, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5577 => 0.6011, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.60% (1.0313 => 1.1097, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.60% (0.4791 => 0.5155, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.49% (0.4390 => 0.4719, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.49% (0.3246 => 0.3489, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.44% (1.1061 => 1.1884, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.2726 => 0.2928, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.32% (0.3756 => 0.4031, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.26% (0.3293 => 0.3532, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.22% (0.4016 => 0.4306, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.21% (3.8646 => 4.1434, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.21% (0.6576 => 0.7050, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.21% (0.7506 => 0.8047, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2127 => 0.2280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.16% (1.9828 => 2.1248, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.12% (7.2180 => 7.7322, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 7.10% (0.8310 => 0.8900, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.07% (0.3578 => 0.3831, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.03% (0.3868 => 0.4140, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.93% (3.6692 => 3.9234, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.7460 => 0.7975, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3789 => 0.4050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 6.88% (0.3646 => 0.3897, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 6.87% (0.2925 => 0.3126, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.84% (2.1791 => 2.3282, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.83% (0.2988 => 0.3192, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 6.80% (0.3940 => 0.4208, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.74% (0.3192 => 0.3407) MultiSource/Applications/d/make_dparser: 6.71% (3.1889 => 3.4030, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3453 => 0.3684, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 6.69% (0.2243 => 0.2393, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.51% (0.6744 => 0.7183, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.43% (1.9270 => 2.0509, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.31% (1.3245 => 1.4081, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 6.27% (16.6129 => 17.6546, std.dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 6.15% (1.0594 => 1.1246, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3525, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.3813 => 1.4636, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.96% (0.8698 => 0.9216, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.93% (4.3801 => 4.6397, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4638, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 5.92% (14.8535 => 15.7331, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.91% (0.2945 => 0.3119, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.72% (4.4433 => 4.6974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.70% (0.3755 => 0.3969, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.67% (13.2842 => 14.0372, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 5.66% (8.4961 => 8.9769, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.66% (0.6135 => 0.6482, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.59% (0.4113 => 0.4343, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.55% (0.8818 => 0.9307, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.2504 => 0.2640, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.40% (0.3131 => 0.3300, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.36% (1.1333 => 1.1940, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.32% (14.5298 => 15.3033, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 5.19% (4.6629 => 4.9051, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (6.5754 => 6.9158, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.75% (4.9865 => 5.2235, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2292 => 1.2864, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.52% (3.2742 => 3.4223, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.6250 => 0.6517, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.27% (0.4805 => 0.5010, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 4.19% (3.7467 => 3.9037, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.15% (0.9108 => 0.9486, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.09% (1.5188 => 1.5809, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.74% (6.2785 => 6.5135, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.56% (2.1007 => 2.1755, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.94% (33.2944 => 34.2740, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6143, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2522, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6975, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.78% (12.0921 => 12.5489, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.37% (10.7476 => 11.1102, std.dev.: 0.0538) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5854, std.dev.: 0.0093) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.49% (22.5627 => 21.7751, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2849, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.57% (1.3780 => 1.2874, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.42% (3.0263 => 2.9227, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5837, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.43% (4.5947 => 4.4831, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.22% (26.5159 => 25.9284, std.dev.: 0.0244) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std.dev.: 0.0186) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2150, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (4.1080 => 4.0561, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2436, std.dev.: 0.0234) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 17:25:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 19:25:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920002525.A1DF5352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4025?compare_to=4021&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4025, Order: 164249, Start Time: 2012-09-19 21:43:01, End Time: 2012-09-20 00:26:48 To: 4021, Order: 164237, Start Time: 2012-09-19 18:31:01, End Time: 2012-09-19 21:14:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.24% (1.0131 => 1.0005, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3465 => 0.3817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.09% (0.3488 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3442 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.06% (0.3469 => 0.3818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3446 => 0.3792, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3496 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.00% (0.3460 => 0.3806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.78% (0.3650 => 0.4007, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3643 => 0.3998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.56% (0.3724 => 0.4080, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 7.71% (1.5932 => 1.7160, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (1.6211 => 1.7239, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.21% (5.5417 => 5.8857, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 6.20% (0.2566 => 0.2725, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.12% (0.4361 => 0.4628, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.03% (3.5627 => 3.7774, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.00% (1.3152 => 1.3941, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (0.3930 => 0.4164, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (0.4994 => 0.5282, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.64% (2.7292 => 2.8830, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.62% (0.5000 => 0.5281, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.48% (1.0781 => 1.1372, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.34% (0.6634 => 0.6988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.33% (0.5889 => 0.6203, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.20% (0.5826 => 0.6129, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (4.4195 => 4.6484, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 5.15% (1.8794 => 1.9761, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 5.13% (4.2109 => 4.4269, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.12% (0.2736 => 0.2876, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.86% (4.6177 => 4.8420, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (0.5026 => 0.5270, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 4.79% (2.1653 => 2.2690, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 4.77% (1.4269 => 1.4949, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3195 => 0.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.63% (2.1013 => 2.1986, std.dev.: 0.0089) SingleSource/Regression/C++/ofstream_ctor: 4.63% (0.3004 => 0.3143, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.60% (0.9909 => 1.0365, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.60% (0.5546 => 0.5801, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.57% (0.3084 => 0.3225, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.53% (0.2823 => 0.2951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.52% (0.3362 => 0.3514, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 4.50% (23.5202 => 24.5775, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.3903 => 0.4078, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2813 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.45% (0.3348 => 0.3497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2750 => 0.2872, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.40% (0.3317 => 0.3463, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.40% (2.0673 => 2.1582, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.4139 => 0.4320, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.5900 => 0.6157, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.33% (0.2911 => 0.3037, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.31% (0.3060 => 0.3192, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3625 => 0.3781, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.29% (0.3267 => 0.3407, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3726 => 0.3885, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.25% (2.0346 => 2.1210, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (0.4658 => 0.4854, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.21% (0.3258 => 0.3395, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.17% (0.2803 => 0.2920, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 4.17% (0.3096 => 0.3225, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.17% (0.3336 => 0.3475, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.16% (0.3271 => 0.3407, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3678 => 0.3829, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3124 => 0.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.6435 => 0.6697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0493, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.05% (0.4251 => 0.4423, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.04% (0.7171 => 0.7461, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (0.7426 => 0.7720, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (1.9966 => 2.0756, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.92% (0.3981 => 0.4137, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.91% (0.7875 => 0.8183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3690 => 0.3832, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.5012 => 0.5198, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.2969 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.67% (0.5584 => 0.5789, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.51% (0.4847 => 0.5017, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.3845 => 0.3976, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.36% (0.5361 => 0.5541, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.18% (0.9697 => 1.0005, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.80% (0.4253 => 0.4372, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.68% (4.6926 => 4.8184, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.65% (11.6398 => 11.9484, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.36% (0.2162 => 0.3575, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6699, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1652, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8885, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6504, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2124, std.dev.: 0.0351) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5061, std.dev.: 0.0264) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4467, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.48% (2.0820 => 2.1128, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5149, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4385, std.dev.: 0.0311) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5479, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7884, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7906, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -3.01% (17.2379 => 16.7192, std.dev.: 0.0821) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5799, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9600, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 17:26:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 19:26:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920002616.BC0BE352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4026?compare_to=4023&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4026, Order: 164256, Start Time: 2012-09-19 23:07:55, End Time: 2012-09-20 00:27:37 To: 4023, Order: 164248, Start Time: 2012-09-19 21:19:01, End Time: 2012-09-19 22:38:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (133 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.29% (15.1853 => 15.5325, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5651 => 56.4813, std.dev.: 0.1914) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.49% (0.5723 => 0.5751, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -0.43% (15.9509 => 15.8817, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: -0.15% (14.7512 => 14.7292, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -0.61% (83.2547 => 82.7429, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: -0.30% (4.3248 => 4.3119, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2250 => 1.2238, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (7.4370 => 7.4186, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.23% (3.6888 => 3.6802, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.42% (0.6399 => 0.6372, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (0.0676 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.83% (63.2438 => 82.7429, std.dev.: 0.0061) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14247.08% (0.0720 => 10.3299, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.82% (10.3673 => 15.5325, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 25.83% (0.1622 => 0.2041, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.14% (2.2022 => 2.5356, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.12% (7.0540 => 8.0498, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.62% (1.1194 => 1.2607, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.01% (0.1566 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.19% (1.7609 => 1.9580, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.85% (0.3543 => 0.3892, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.74% (0.3561 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3694 => 0.4049, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.35% (0.3927 => 0.4294, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.21% (0.3886 => 0.4244, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.4879 => 0.5234, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.21% (10.4361 => 11.1881, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 7.14% (9.4845 => 10.1619, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.07% (0.1655 => 0.1772, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.82% (0.7433 => 0.7940, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.64% (0.5860 => 0.6249, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.40% (0.8067 => 0.8583, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.2554 => 0.2716, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.32% (0.7115 => 0.7565, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.28% (0.6675 => 0.7094, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.27% (0.3109 => 0.3304, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.21% (5.7591 => 6.1168, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.4615 => 0.4898, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (8.1363 => 8.6316, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.03% (0.2271 => 0.2408, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (4.2646 => 4.5211, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.91% (3.3354 => 3.5326, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.90% (0.5105 => 0.5406, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.3050 => 1.3817, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.86% (0.8172 => 0.8651, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.85% (0.9765 => 1.0336, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (1.5415 => 1.6309, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5569 => 0.5885, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (5.0018 => 5.2781, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.50% (4.9449 => 5.2170, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 5.45% (0.7835 => 0.8262, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 5.43% (0.3092 => 0.3260, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 5.37% (1.1642 => 1.2267, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.37% (0.2758 => 0.2906, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.18% (0.5925 => 0.6232, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.12% (0.6030 => 0.6339, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.03% (0.3441 => 0.3614, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 5.00% (1.0722 => 1.1258, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.90% (3.8723 => 4.0622, std.dev.: 0.0085) MultiSource/Applications/hbd/hbd: 4.85% (1.5603 => 1.6359, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.82% (7.9617 => 8.3451, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.79% (1.1861 => 1.2429, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.5020 => 0.5256, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 4.65% (21.9371 => 22.9580, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 4.55% (0.6456 => 0.6750, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.53% (0.4103 => 0.4289, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7326 => 0.7656, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 4.49% (0.4299 => 0.4492, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.46% (2.0273 => 2.1177, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 4.43% (2.2969 => 2.3987, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.41% (0.3422 => 0.3573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.4064 => 0.4239, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.29% (0.6450 => 0.6727, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8921 => 0.9299, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.06% (0.5981 => 0.6224, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.4203 => 0.4372, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3865 => 0.4019, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4289 => 0.4459, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.91% (1.5859 => 1.6479, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.4048 => 0.4206, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.87% (0.4620 => 0.4799, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3826 => 0.3974, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (14.3668 => 14.9162, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2871 => 0.2978, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.4186 => 1.4710, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.2024 => 2.2824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3232 => 0.3346, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.52% (2.0665 => 2.1392, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3684 => 0.3810, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.1840 => 1.2205, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.8101 => 0.8283, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.21% (1.2842 => 1.3126, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.17% (17.1811 => 17.3814, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.8922 => 3.9317, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3816, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.97% (4.2280 => 4.3534, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.29% (0.9540 => 0.9663, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2291, std.dev.: 0.0372) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5756, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.37% (5.2763 => 3.2518, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.47% (5.3855 => 3.9060, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.21% (5.3526 => 3.8959, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1847, std.dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.73% (2.9384 => 2.5938, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.59% (22.1758 => 20.2706, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2966, std.dev.: 0.0458) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5046, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4244, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0108, std.dev.: 0.0170) SingleSource/Benchmarks/McGill/chomp: -2.04% (1.2373 => 1.2120, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0133, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4240, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2358, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.98% (0.5229 => 0.5751, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.95% (14.9895 => 15.8817, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 4.05% (14.1553 => 14.7292, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.90% (4.1105 => 4.3119, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.77% (1.1048 => 1.2238, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.64% (7.1582 => 7.4186, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.28% (3.4629 => 3.6802, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6222 => 0.6372, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 18:31:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 20:31:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920013120.11BDC352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4027?compare_to=4018&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4027, Order: 164268, Start Time: 2012-09-20 00:22:29, End Time: 2012-09-20 01:32:46 To: 4018, Order: 164237, Start Time: 2012-09-19 18:00:55, End Time: 2012-09-19 19:12:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (46 on baseline) Performance Improvements: 3 (41 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 889 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.29% (0.1302 => 0.1410, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.7574 => 0.7909, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.7563 => 0.7822, std.dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 2.01% (4.7743 => 4.8702, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 7.63% (3.0822 => 3.3173, std.dev.: 0.0502) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.11% (1.3491 => 1.3911, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.44% (2.3946 => 2.4292, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/hash: 1.10% (4.3077 => 4.3552, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.78% (1.4756 => 1.4493, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.42% (2.0660 => 2.0367, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.76% (8.5088 => 8.3587, std.dev.: 0.0173) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.30% (0.9921 => 0.9891, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -0.07% (0.6041 => 0.6037, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: -8.49% (0.1661 => 0.1520, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1553 => 0.1567, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.94% (0.3072 => 0.3043, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.47% (0.2325 => 0.2336, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (0.3085 => 0.3152, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.35% (0.2262 => 0.2270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 18.64% (0.0381 => 0.0452, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 31.82% (0.0066 => 0.0087, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 9.76% (0.0041 => 0.0045, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0239 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.79% (0.0190 => 0.0179, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0382 => 0.0383, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0295 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 16.81% (0.0238 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0321 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.69% (0.0178 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -22.29% (0.0166 => 0.0129, std.dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -0.41% (0.0246 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -25.31% (0.0324 => 0.0242, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1420 => 0.1427, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: -0.82% (1.4921 => 1.4798, std.dev.: 0.0320) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.09% (0.1480 => 0.1449, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -60.00% (0.0005 => 0.0002, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.58% (0.4039 => 0.4103, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.33% (0.1372 => 0.1404, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.50% (0.0612 => 0.0560, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.11% (0.0178 => 0.0196, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.47% (0.0645 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.87% (0.0047 => 0.0001, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1367 => 1.1308, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0011 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.79% (0.0541 => 0.0621, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 57.78% (0.0135 => 0.0213, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7658 => 0.7657, std.dev.: 0.0159) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.21% (1.5963 => 1.5997, std.dev.: 0.0126) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0019) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.43% (4.1772 => 3.1151, std.dev.: 0.0426) SingleSource/Benchmarks/Shootout-C++/except: 82650.00% (0.0006 => 0.4965, std.dev.: 0.0130) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.15% (0.6410 => 0.6868, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 6.17% (2.1763 => 2.3105, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.09% (0.3582 => 0.3800, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 6.07% (0.5309 => 0.5631, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.39% (1.1653 => 1.2165, std.dev.: 0.0094) MultiSource/Applications/lemon/lemon: 4.21% (1.0046 => 1.0469, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.2552 => 0.2659, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 3.71% (0.6173 => 0.6402, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 3.39% (15.3105 => 15.8296, std.dev.: 0.0555) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.5150 => 1.5622, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 2.63% (4.7455 => 4.8702, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 2.39% (29.3170 => 30.0190, std.dev.: 0.2680) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.7639 => 0.7811, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 2.14% (1.3268 => 1.3552, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6069 => 0.6172, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.7256 => 14.9056, std.dev.: 0.0225) MultiSource/Applications/ClamAV/clamscan: 1.22% (14.6079 => 14.7856, std.dev.: 0.0688) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9997, std.dev.: 0.0139) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5539, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 10.71% (1.6261 => 1.8003, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6245, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.11% (1.0063 => 1.0778, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (0.3301 => 0.3516, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.01% (40.4792 => 42.5052, std.dev.: 0.6010) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5396, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 3.71% (15.2242 => 15.7890, std.dev.: 0.0524) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.45% (0.5587 => 0.5780, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 2.83% (3.8907 => 4.0008, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8943, std.dev.: 0.1101) MultiSource/Applications/siod/siod: 2.78% (3.5520 => 3.6509, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.71% (0.8498 => 0.8728, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.67% (2.6656 => 2.7369, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/mason/mason: 2.64% (0.5004 => 0.5136, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 2.41% (8.5113 => 8.7165, std.dev.: 0.0787) SingleSource/Benchmarks/Dhrystone/dry: 2.07% (2.4013 => 2.4509, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.96% (4.6127 => 4.7033, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: 1.25% (4.3016 => 4.3552, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.32% (0.3497 => 0.2087, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: -20.25% (1.7473 => 1.3934, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.13% (5.2665 => 4.2063, std.dev.: 0.0262) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.48% (1.1647 => 0.9611, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.54% (15.8312 => 13.3716, std.dev.: 0.0949) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1645, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -11.19% (0.3746 => 0.3327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.19% (3.2007 => 2.9386, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.94% (3.6254 => 3.3737, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: -6.62% (3.4230 => 3.1965, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3322, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8726, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.39% (1.4441 => 1.3518, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/distray/distray: -6.08% (0.2664 => 0.2502, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -5.62% (4.4195 => 4.1713, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -5.42% (62.4126 => 59.0312, std.dev.: 0.1244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -3.92% (7.6833 => 7.3818, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.89% (1.2959 => 1.2455, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.84% (1.2722 => 1.2234, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.60% (0.4140 => 0.3991, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -3.58% (9.2503 => 8.9187, std.dev.: 0.0367) SingleSource/Benchmarks/McGill/misr: -3.56% (0.4296 => 0.4143, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.17% (3.7496 => 3.6309, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2865, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.48% (1.1683 => 1.1393, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -2.03% (8.5323 => 8.3587, std.dev.: 0.0173) MultiSource/Benchmarks/PAQ8p/paq8p: -2.00% (92.7467 => 90.8878, std.dev.: 0.1937) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0135) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3121, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2340, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.40% (1.8739 => 1.8476, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3136, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/lists: -1.27% (16.5617 => 16.3509, std.dev.: 0.0552) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.89% (0.9980 => 0.9891, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 0.25% (0.6022 => 0.6037, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: -8.76% (0.1666 => 0.1520, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.84% (0.1554 => 0.1567, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.30% (0.3083 => 0.3043, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.42% (0.2394 => 0.2336, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.72% (0.3175 => 0.3152, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (0.2302 => 0.2270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0449 => 0.0452, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -50.00% (0.0090 => 0.0045, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.77% (0.0192 => 0.0179, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -31.75% (0.0189 => 0.0129, std.dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -25.54% (0.0325 => 0.0242, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1429 => 0.1427, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: -1.47% (1.5019 => 1.4798, std.dev.: 0.0320) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.46% (0.1501 => 0.1449, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -60.00% (0.0005 => 0.0002, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.78% (0.4264 => 0.4103, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1344 => 0.1404, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.92% (0.0589 => 0.0560, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.52% (0.0232 => 0.0196, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0639 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1350 => 1.1308, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.51% (0.0637 => 0.0621, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.41% (0.0246 => 0.0213, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0159) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.13% (1.5363 => 1.5997, std.dev.: 0.0126) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 18:32:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 20:32:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920013256.E929D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4028?compare_to=4024&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4028, Order: 164265, Start Time: 2012-09-20 00:19:54, End Time: 2012-09-20 01:34:20 To: 4024, Order: 164253, Start Time: 2012-09-19 22:35:33, End Time: 2012-09-19 23:50:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.86% (3.8524 => 3.7806, std.dev.: 0.0196) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.59% (2.0176 => 2.4128, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.12% (0.1413 => 0.1556, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.43% (3.9660 => 4.3399, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 9.17% (1.3693 => 1.4949, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.16% (0.7710 => 0.8416, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 9.04% (0.7038 => 0.7674, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.94% (0.2596 => 0.2828, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.74% (0.9199 => 1.0003, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4328 => 0.4703, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.63% (1.2193 => 1.3245, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.49% (0.6959 => 0.7550, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.40% (0.5818 => 0.6307, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5748 => 0.6215, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.09% (1.4563 => 1.5741, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 8.08% (13.8202 => 14.9365, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.04% (1.1364 => 1.2278, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.93% (0.3899 => 0.4208, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6283 => 0.6778, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1589 => 0.1712, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.66% (0.5577 => 0.6004, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 7.61% (0.2995 => 0.3223, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.50% (1.0313 => 1.1086, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.38% (0.4390 => 0.4714, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.35% (0.4791 => 0.5143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (0.4379 => 0.4699, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.30% (0.3246 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.29% (0.3756 => 0.4030, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.17% (0.3293 => 0.3529, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.13% (0.5637 => 0.6039, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (1.9828 => 2.1240, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2966 => 0.3177, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.02% (1.1061 => 1.1838, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.99% (0.2988 => 0.3197, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.91% (0.8310 => 0.8884, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 6.90% (3.8646 => 4.1313, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (7.2180 => 7.7111, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 6.82% (0.7506 => 0.8018, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.79% (3.6692 => 3.9184, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6576 => 0.7012, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.46% (0.3220 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 6.30% (2.1791 => 2.3164, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.27% (3.1889 => 3.3890, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 6.25% (1.0594 => 1.1256, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.14% (1.9270 => 2.0454, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (1.2749 => 1.3508, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.92% (1.3245 => 1.4029, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4113 => 0.4356, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.89% (16.6129 => 17.5918, std.dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.77% (14.8535 => 15.7112, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/trivial-interface: 5.76% (0.3578 => 0.3784, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.75% (0.4003 => 0.4233) MultiSource/Benchmarks/Olden/bh/bh: 5.74% (0.2859 => 0.3023, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.73% (1.3819 => 1.4611, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 5.72% (0.3914 => 0.4138, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.70% (0.3789 => 0.4005, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.66% (0.8698 => 0.9190, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 5.65% (0.3663 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4590, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3646 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.61% (0.3601 => 0.3803, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.56% (0.3650 => 0.3853, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.53% (8.4961 => 8.9663, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/property: 5.53% (0.3940 => 0.4158, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.52% (0.8818 => 0.9305, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.52% (4.3801 => 4.6219, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 5.47% (0.3623 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.44% (4.4433 => 4.6850, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.40% (13.2842 => 14.0013, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6135 => 0.6463, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2504 => 0.2633, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (1.1333 => 1.1906, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.97% (14.5298 => 15.2520, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 4.92% (6.5754 => 6.8992, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.69% (3.2742 => 3.4277, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 4.56% (4.6629 => 4.8753, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2842, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.25% (0.9108 => 0.9495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.20% (0.4805 => 0.5007, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1949, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.98% (1.5188 => 1.5792, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 3.77% (3.7467 => 3.8879, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.42% (6.2785 => 6.4935, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.1007 => 2.1704, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.00% (33.2944 => 34.2932, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5431, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std.dev.: 0.0427) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.95% (1.0895 => 1.3504, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6974, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0809, std.dev.: 0.0608) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.10% (7.9275 => 8.0146, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5876, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.03% (1.4298 => 1.4445, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.14% (0.4657 => 0.3859, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.52% (22.5627 => 21.7681, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2527, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2925, std.dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.17% (2.6470 => 2.5102, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9236, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6103, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.21% (26.5159 => 25.9294, std.dev.: 0.0368) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2516, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.22% (4.1080 => 4.0580, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2262, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2445, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: -1.14% (4.4810 => 4.4300, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 19:14:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 21:14:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920021434.D52B3352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4029?compare_to=4026&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4029, Order: 164268, Start Time: 2012-09-20 00:56:16, End Time: 2012-09-20 02:15:59 To: 4026, Order: 164256, Start Time: 2012-09-19 23:07:55, End Time: 2012-09-20 00:27:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (125 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (722 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.61% (11.1881 => 11.4796, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.53% (80.4937 => 78.4564, std.dev.: 0.6679) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -1.17% (0.5751 => 0.5684, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -0.23% (15.8817 => 15.8456, std.dev.: 0.0192) MultiSource/Applications/kimwitu++/kc: 0.00% (14.7292 => 14.7295, std.dev.: 0.0108) MultiSource/Benchmarks/Bullet/bullet: -0.02% (82.7429 => 82.7234, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: -0.23% (4.3119 => 4.3019, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.36% (1.2238 => 1.2194, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.49% (7.4186 => 7.3822, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (3.6802 => 3.6652, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.31% (0.6372 => 0.6352, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0684 => 0.0685, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.80% (63.2438 => 82.7234, std.dev.: 0.0087) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14243.47% (0.0720 => 10.3273, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.58% (10.3673 => 15.5070, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 25.89% (0.1622 => 0.2042, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.49% (2.2022 => 2.5212, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.80% (7.0540 => 8.0276, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.39% (1.1194 => 1.2581, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.59% (1.7609 => 1.9650, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 10.00% (10.4361 => 11.4796, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3473 => 0.3785, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.98% (0.3543 => 0.3861, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3497 => 0.3803, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.70% (0.3516 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3543 => 0.3851, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3561 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.53% (0.3694 => 0.4009, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.52% (0.3828 => 0.4154, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.48% (0.3927 => 0.4260, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.26% (0.3886 => 0.4207, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 7.22% (0.1440 => 0.1544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.08% (0.3177 => 0.3402, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.07% (9.4845 => 10.1552, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.97% (0.4879 => 0.5219, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.57% (0.7433 => 0.7921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.15% (0.2700 => 0.2866, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.09% (0.7115 => 0.7548, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.08% (0.1695 => 0.1798, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.6675 => 0.7080, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.03% (0.2554 => 0.2708, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.00% (0.4615 => 0.4892, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.89% (0.5860 => 0.6205, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (4.2646 => 4.5094, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.74% (0.5105 => 0.5398, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.71% (5.7591 => 6.0881, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.3050 => 1.3791, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.64% (0.3423 => 0.3616, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (8.1363 => 8.5919, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.54% (1.5415 => 1.6269, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.51% (3.3354 => 3.5192, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.8172 => 0.8622, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (5.0018 => 5.2706, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 5.37% (0.5925 => 0.6243, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.8067 => 0.8496, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.31% (4.9449 => 5.2076, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (0.3092 => 0.3256, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9765 => 1.0279, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.24% (0.6030 => 0.6346, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.22% (0.2758 => 0.2902, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.5569 => 0.5859, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.14% (0.7835 => 0.8238, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 5.08% (1.1642 => 1.2233, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7326 => 0.7678, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.66% (3.8723 => 4.0526, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (7.9617 => 8.3313, std.dev.: 0.0181) MultiSource/Applications/lemon/lemon: 4.64% (1.0722 => 1.1219, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.62% (1.5603 => 1.6324, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 4.61% (0.4299 => 0.4497, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.58% (0.3387 => 0.3542, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.57% (1.1861 => 1.2403, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.42% (0.5020 => 0.5242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.3422 => 0.3569, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.25% (0.4636 => 0.4833, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6456 => 0.6729, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9371 => 22.8558, std.dev.: 0.0091) MultiSource/Applications/treecc/treecc: 4.12% (2.0273 => 2.1109, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 4.12% (2.2969 => 2.3915, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (0.4064 => 0.4230, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.07% (0.4103 => 0.4270, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.03% (0.6450 => 0.6710, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 3.99% (0.8921 => 0.9277, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.88% (0.5981 => 0.6213, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3826 => 0.3970, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (1.5859 => 1.6444, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3232 => 0.3346, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.4203 => 0.4349, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (14.3668 => 14.8503, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.4186 => 1.4663, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.4620 => 0.4775, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.32% (0.3136 => 0.3240, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.2024 => 2.2738, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 3.23% (0.3283 => 0.3389, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.4048 => 0.4178, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.16% (0.3603 => 0.3717, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.15% (0.3684 => 0.3800, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.08% (2.0665 => 2.1301, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.1840 => 1.2194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 2.96% (0.3379 => 0.3479, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.8101 => 0.8264, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.85% (1.1145 => 1.3692, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3809, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.30% (0.9540 => 0.9664, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2325, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3635, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.52% (5.2763 => 3.2437, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.92% (5.3855 => 3.8817, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.62% (5.3526 => 3.8740, std.dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1886, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.70% (2.9384 => 2.5945, std.dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: -8.65% (22.1758 => 20.2585, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2518, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (1.8329 => 1.7154, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5081, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9884, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.6802 => 8.4348, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9999, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -1.72% (1.2373 => 1.2160, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5767, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2354, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (0.5229 => 0.5684, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 5.71% (14.9895 => 15.8456, std.dev.: 0.0192) MultiSource/Applications/kimwitu++/kc: 4.06% (14.1553 => 14.7295, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (4.1105 => 4.3019, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.37% (1.1048 => 1.2194, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.13% (7.1582 => 7.3822, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.84% (3.4629 => 3.6652, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.6222 => 0.6352, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 19:57:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 21:57:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920025755.0248B352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4030?compare_to=4027&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4030, Order: 164272, Start Time: 2012-09-20 01:48:31, End Time: 2012-09-20 02:59:21 To: 4027, Order: 164268, Start Time: 2012-09-20 00:22:29, End Time: 2012-09-20 01:32:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (50 on baseline) Performance Improvements: 2 (39 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 888 (801 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.45% (0.4240 => 0.4556, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2832 => 0.2955, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.27% (0.5585 => 0.5712, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.2489 => 1.2718, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 1.74% (1.8636 => 1.8961, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.71% (0.5863 => 0.5963, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.23% (1.1746 => 1.1891, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (1.4087 => 1.4237, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.56% (21.0607 => 22.2322, std.dev.: 0.1843) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.80% (1.3911 => 1.4439, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -2.05% (2.4292 => 2.3794, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.50% (4.5635 => 4.4951, std.dev.: 0.0174) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.33% (0.9891 => 1.0023, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -0.40% (0.6037 => 0.6013, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 8.42% (0.1520 => 0.1648, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.25% (0.1567 => 0.1422, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (0.3043 => 0.3080, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.86% (0.2336 => 0.2356, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.63% (0.3152 => 0.3172, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.01% (0.2270 => 0.2293, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -0.44% (0.0452 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 95.56% (0.0045 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0238 => 0.0237, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.03% (0.0179 => 0.0188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0383 => 0.0383, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0294 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0278 => 0.0279, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.35% (0.0318 => 0.0301, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0175 => 0.0175, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 45.74% (0.0129 => 0.0188, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -0.41% (0.0245 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 33.06% (0.0242 => 0.0322, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1427 => 0.1435, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -1.42% (1.4798 => 1.4588, std.dev.: 0.0400) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.38% (0.1449 => 0.1429, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.07% (0.4103 => 0.4311, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.42% (0.1404 => 0.1438, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.07% (0.0560 => 0.0622, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.76% (0.0196 => 0.0221, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.71% (0.0648 => 0.0611, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.22% (1.1308 => 1.1333, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 300.00% (0.0005 => 0.0020, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.34% (0.0621 => 0.0563, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.98% (0.0213 => 0.0230, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7657 => 0.7653, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.08% (1.5997 => 1.5984, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -64.46% (0.0121 => 0.0043, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.82% (4.1772 => 3.0985, std.dev.: 0.0715) SingleSource/Benchmarks/Shootout-C++/except: 81900.00% (0.0006 => 0.4920, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.58% (0.6410 => 0.6832, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 6.11% (2.1763 => 2.3093, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.5309 => 0.5629, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.92% (0.3582 => 0.3794, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.23% (0.2552 => 0.2660, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.92% (0.6173 => 0.6415, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (1.1653 => 1.2099, std.dev.: 0.0156) MultiSource/Applications/lemon/lemon: 3.80% (1.0046 => 1.0428, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.7722 => 0.7999, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.5150 => 1.5652, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.20% (0.3901 => 0.4026, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.14% (15.3105 => 15.7910, std.dev.: 0.0309) MultiSource/Benchmarks/Bullet/bullet: 2.25% (29.3170 => 29.9758, std.dev.: 0.0804) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.09% (0.6069 => 0.6196, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.92% (3.0225 => 3.0806, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.88% (1.1672 => 1.1891, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (12.6413 => 12.8668, std.dev.: 0.0837) MultiSource/Applications/Burg/burg: 1.73% (1.1440 => 1.1638, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 1.57% (2.0972 => 2.1302, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.4113 => 1.4329, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.46% (13.3238 => 13.5183, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (4.0318 => 4.0776, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2270, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout/ary3: 15.14% (1.7426 => 2.0065, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5576, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0105) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6245, std.dev.: 0.0244) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.83% (0.2694 => 0.2932, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 7.96% (0.1433 => 0.1547, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.19% (1.0063 => 1.0787, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (0.3301 => 0.3507, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8466, std.dev.: 0.0546) SingleSource/Benchmarks/Misc/dt: 3.92% (0.9851 => 1.0237, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5384, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8733, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 2.99% (8.5113 => 8.7654, std.dev.: 0.0968) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.98% (1.4021 => 1.4439, std.dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8979, std.dev.: 0.0759) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.12% (3.5520 => 3.6272, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.82% (4.6127 => 4.6965, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.08% (38.9255 => 39.3456, std.dev.: 0.0178) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4473, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.77% (0.7738 => 0.7601, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.89% (0.3497 => 0.2067, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.04% (5.2665 => 4.1060, std.dev.: 0.1112) SingleSource/Benchmarks/Shootout-C++/ary3: -20.72% (1.7473 => 1.3853, std.dev.: 0.0588) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.38% (1.1647 => 0.9623, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.60% (15.8312 => 13.3612, std.dev.: 0.0670) MultiSource/Applications/sgefa/sgefa: -13.32% (0.3746 => 0.3247, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: -12.31% (8.1594 => 7.1552, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.67% (0.0917 => 0.0810, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.21% (3.2007 => 2.9379, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3761, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: -6.68% (3.4230 => 3.1943, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3307, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/distray/distray: -6.53% (0.2664 => 0.2490, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8726, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3549, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -5.50% (62.4126 => 58.9784, std.dev.: 0.3416) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1852, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: -4.28% (0.4296 => 0.4112, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.12% (1.2959 => 1.2425, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: -4.12% (7.6833 => 7.3667, std.dev.: 0.0445) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.08% (0.4140 => 0.3971, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -4.02% (9.2503 => 8.8782, std.dev.: 0.0659) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6277, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2852, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.71% (2.4457 => 2.3794, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.28% (1.1683 => 1.1417, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4224, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3663, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2230, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.69% (1.8739 => 1.8422, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0660) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.43% (0.9980 => 1.0023, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -0.15% (0.6022 => 0.6013, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: -1.08% (0.1666 => 0.1648, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.49% (0.1554 => 0.1422, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (0.3083 => 0.3080, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.59% (0.2394 => 0.2356, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3175 => 0.3172, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.08% (0.0192 => 0.0188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.10% (0.0324 => 0.0301, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1429 => 0.1435, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -2.87% (1.5019 => 1.4588, std.dev.: 0.0400) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.80% (0.1501 => 0.1429, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.10% (0.4264 => 0.4311, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.60% (0.0589 => 0.0622, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.74% (0.0232 => 0.0221, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.38% (0.0639 => 0.0611, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1350 => 1.1333, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -16.67% (0.0024 => 0.0020, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.62% (0.0637 => 0.0563, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.50% (0.0246 => 0.0230, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.04% (1.5363 => 1.5984, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.57% (0.0070 => 0.0043, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 20:15:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 22:15:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920031542.70454352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4031?compare_to=4028&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4031, Order: 164272, Start Time: 2012-09-20 02:02:43, End Time: 2012-09-20 03:17:08 To: 4028, Order: 164265, Start Time: 2012-09-20 00:19:54, End Time: 2012-09-20 01:34:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (165 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.6604 => 56.3836, std.dev.: 0.0701) SingleSource/Regression/C/uint64_to_float: 2.15% (0.5346 => 0.5461, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.59% (2.0176 => 2.4129, std.dev.: 0.0155) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.08% (0.1588 => 0.1748, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.44% (3.9660 => 4.3405, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.34% (1.3693 => 1.4972, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.12% (0.7038 => 0.7680, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.85% (0.4328 => 0.4711, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.83% (0.5818 => 0.6332, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7061 => 0.7682, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.77% (0.7710 => 0.8386, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.71% (0.9199 => 1.0000, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5748 => 0.6243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.60% (0.5265 => 0.5718, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.59% (1.2193 => 1.3240, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.44% (0.6959 => 0.7546, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.14% (1.1364 => 1.2289, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.06% (13.8202 => 14.9341, std.dev.: 0.0155) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.03% (1.4563 => 1.5732, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3580 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3899 => 0.4211, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3485 => 0.3759, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.76% (0.2782 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.64% (0.2760 => 0.2971, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.54% (1.0313 => 1.1091, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5577 => 0.5997, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.52% (0.2937 => 0.3158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3489 => 0.3750, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.42% (0.3246 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.2726 => 0.2928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.36% (0.4390 => 0.4713, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.34% (1.9828 => 2.1283, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.32% (0.3756 => 0.4031, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.4791 => 0.5139, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.21% (0.2995 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.21% (0.3149 => 0.3376, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.17% (0.4016 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.17% (0.3293 => 0.3529, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.15% (0.2628 => 0.2816, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.04% (1.1061 => 1.1840, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.99% (0.8310 => 0.8891, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.5637 => 0.6029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3868 => 0.4136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (7.2180 => 7.7120, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.2925 => 0.3125, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.82% (3.8646 => 4.1282, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/sieve: 6.78% (0.3453 => 0.3687, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.73% (3.6692 => 3.9161, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: 6.71% (0.7506 => 0.8010, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.64% (0.2243 => 0.2392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 6.49% (2.1791 => 2.3205, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.48% (0.2023 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.43% (0.1865 => 0.1985, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3220 => 0.3427, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.30% (0.6744 => 0.7169, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.30% (0.6576 => 0.6990, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.21% (1.9270 => 2.0466, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.20% (3.1889 => 3.3867, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.19% (1.0594 => 1.1250, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.3245 => 1.4052, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.05% (16.6129 => 17.6188, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (1.2749 => 1.3509, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.96% (0.4113 => 0.4358, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 5.87% (0.4003 => 0.4238, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3914 => 0.4141, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.79% (14.8535 => 15.7130, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3578 => 0.3785, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.75% (0.3789 => 0.4007, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.72% (0.3601 => 0.3807, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.8698 => 0.9193, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.69% (1.3819 => 1.4605, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 5.69% (0.3940 => 0.4164, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (1.3813 => 1.4587, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 5.56% (8.4961 => 8.9686, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.6135 => 0.6475, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.53% (0.8818 => 0.9306, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 5.49% (0.2859 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.45% (4.4433 => 4.6854, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0077, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.43% (4.3801 => 4.6181, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2504 => 0.2632, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.03% (1.1333 => 1.1903, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2510, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.95% (6.5754 => 6.9010, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.69% (3.2742 => 3.4278, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2292 => 1.2861, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 4.59% (4.6629 => 4.8770, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/bigfib: 4.30% (0.6250 => 0.6519, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.28% (4.9865 => 5.2001, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.28% (0.9108 => 0.9498, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.4805 => 0.5002, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.05% (1.5188 => 1.5803, std.dev.: 0.0138) MultiSource/Applications/lua/lua: 3.83% (3.7467 => 3.8902, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2785 => 6.5009, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1702, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 3.14% (33.2944 => 34.3394, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5350, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5191, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2665, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.54% (3.1736 => 3.4129, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0781, std.dev.: 0.0474) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5898, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5963, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.11% (1.4298 => 1.4456, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.01% (0.4657 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.47% (22.5627 => 21.7791, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2878, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3028, std.dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.60% (1.7688 => 1.7052, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9219, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5903, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.24% (26.5159 => 25.9226, std.dev.: 0.0218) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2401, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0604, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8723, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4359, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 20:37:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 22:37:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920033731.8E736352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4032?compare_to=4025&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4032, Order: 164268, Start Time: 2012-09-20 00:55:14, End Time: 2012-09-20 03:38:57 To: 4025, Order: 164249, Start Time: 2012-09-19 21:43:01, End Time: 2012-09-20 00:26:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (125 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.38% (1.0005 => 1.0143, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.09% (24.5775 => 24.8449, std.dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3446 => 0.3786, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3469 => 0.3809, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.78% (0.3488 => 0.3829, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.75% (0.3465 => 0.3803, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.70% (0.3496 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.65% (0.3460 => 0.3794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3442 => 0.3773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.40% (0.3650 => 0.3993, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.36% (0.3643 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.16% (0.3724 => 0.4065, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.50% (1.5932 => 1.7286, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (1.6211 => 1.7275, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.49% (0.4361 => 0.4644, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.43% (5.5417 => 5.8982, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.21% (1.3152 => 1.3969, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.16% (3.5627 => 3.7820, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.5000 => 0.5305, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 6.01% (0.5889 => 0.6243, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.94% (1.0781 => 1.1421, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.7292 => 2.8884, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (0.4994 => 0.5285, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2875 => 0.3042, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (0.5026 => 0.5313, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.67% (0.3930 => 0.4153, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 5.63% (23.5202 => 24.8449, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 5.60% (0.2750 => 0.2904, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.57% (0.2566 => 0.2709, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std.dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.3004 => 0.3171, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.2736 => 0.2888, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.54% (0.9909 => 1.0458, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.53% (4.4195 => 4.6640, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.51% (4.2109 => 4.4430, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (0.3890 => 0.4101, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.42% (0.3267 => 0.3444, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 5.39% (0.2725 => 0.2872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2911 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.38% (0.2823 => 0.2975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3258 => 0.3433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.37% (0.2813 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.36% (0.2780 => 0.2929, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.35% (0.6634 => 0.6989, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2803 => 0.2952, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.31% (4.6177 => 4.8628, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.27% (0.2792 => 0.2939, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3060 => 0.3221, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2738 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (2.0673 => 2.1757, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.24% (0.2729 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.20% (0.3348 => 0.3522, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2811 => 0.2957, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.15% (0.3362 => 0.3535, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3096 => 0.3255, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.10% (1.8794 => 1.9752, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 5.08% (2.1653 => 2.2753, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 5.05% (2.1013 => 2.2074, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (0.3625 => 0.3808, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3124 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.99% (0.3726 => 0.3912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.97% (0.3317 => 0.3482, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.3903 => 0.4097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4146 => 0.4352, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3477 => 0.3649, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.93% (1.4269 => 1.4972, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.2103 => 0.2205, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3690 => 0.3868, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.82% (0.4251 => 0.4456, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.81% (0.3282 => 0.3440, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.81% (0.4139 => 0.4338, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.80% (0.3084 => 0.3232, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 4.80% (0.3336 => 0.3496, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.76% (0.5546 => 0.5810, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3678 => 0.3852, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.70% (0.3981 => 0.4168, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.65% (0.6435 => 0.6734, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4.64% (2.0346 => 2.1290, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.60% (0.9697 => 1.0143, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (0.4658 => 0.4870, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 4.47% (0.5012 => 0.5236, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.5900 => 0.6161, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.39% (0.7875 => 0.8221, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (1.9966 => 2.0835, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.29% (1.9694 => 2.0538, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.3271 => 0.3410, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.3845 => 0.4008, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 4.15% (0.4847 => 0.5048, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.04% (0.7426 => 0.7726, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (0.2691 => 0.2799, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.92% (0.5361 => 0.5571, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (0.5584 => 0.5793, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.26% (11.6398 => 12.0197, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: 3.26% (0.3498 => 0.3612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.25% (4.6926 => 4.8452, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 1.43% (11.9555 => 12.1259, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 66.23% (0.2162 => 0.3594, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1724, std.dev.: 0.0504) SingleSource/Benchmarks/Misc/flops-2: 4.62% (1.8057 => 1.8892, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6346, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2102, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5079, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4458, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2851, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.10% (50.0626 => 50.6122, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5630, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7957, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -3.05% (17.2379 => 16.7123, std.dev.: 0.0778) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9700, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.30% (5.7935 => 5.7180, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 21:02:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 23:02:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920040255.3DFC2352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4033?compare_to=4029&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4033, Order: 164278, Start Time: 2012-09-20 02:44:38, End Time: 2012-09-20 04:04:19 To: 4029, Order: 164268, Start Time: 2012-09-20 00:56:16, End Time: 2012-09-20 02:15:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5684 => 0.5697, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 0.38% (15.8456 => 15.9064, std.dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 0.11% (14.7295 => 14.7457, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: -0.25% (82.7234 => 82.5153, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 0.26% (4.3019 => 4.3129, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.18% (1.2194 => 1.2216, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.44% (7.3822 => 7.4148, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (3.6652 => 3.6780, std.dev.: 0.0272) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.65% (0.6352 => 0.6393, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.96% (0.0685 => 0.0651, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.47% (63.2438 => 82.5153, std.dev.: 0.0045) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14257.22% (0.0720 => 10.3372, std.dev.: 0.0069) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.35% (10.3673 => 15.3797, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 25.89% (0.1622 => 0.2042, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.34% (2.2022 => 2.5180, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.89% (7.0540 => 8.0338, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.39% (1.1194 => 1.2581, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.97% (1.7609 => 1.9716, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 10.03% (10.4361 => 11.4828, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3282 => 0.3573, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.67% (0.3473 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.52% (0.3497 => 0.3795, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3543 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3516 => 0.3811) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3543 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.31% (0.3561 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.3927 => 0.4246, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3694 => 0.3993, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3828 => 0.4136, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.90% (0.3886 => 0.4193, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.67% (0.4879 => 0.5253, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1655 => 0.1780, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 7.45% (9.4845 => 10.1910, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.21% (0.7433 => 0.7969, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.77% (0.3307 => 0.3531, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 6.53% (0.3109 => 0.3312, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (0.6675 => 0.7109, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.49% (0.7115 => 0.7577, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.2554 => 0.2715, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4615 => 0.4905, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.13% (0.3423 => 0.3633, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.07% (4.2646 => 4.5233, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.06% (0.5860 => 0.6215, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.05% (0.5105 => 0.5414, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.97% (3.3354 => 3.5346, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 5.97% (5.7591 => 6.1030, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (1.5415 => 1.6329, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.3050 => 1.3815, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (8.1363 => 8.6032, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.64% (0.7835 => 0.8277, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8172 => 0.8631, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.59% (5.0018 => 5.2815, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.58% (4.9449 => 5.2207, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3121 => 0.3295, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.55% (0.8067 => 0.8515, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5569 => 0.5878, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.3092 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9765 => 1.0300, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.43% (1.5603 => 1.6451, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.35% (0.3441 => 0.3625, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 5.28% (1.1642 => 1.2257, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 5.10% (1.0722 => 1.1269, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.05% (3.8723 => 4.0679, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.5925 => 0.6223, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.00% (0.4636 => 0.4868, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.00% (0.3180 => 0.3339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.00% (0.3422 => 0.3593, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.98% (1.1861 => 1.2452, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (7.9617 => 8.3539, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 4.89% (0.6030 => 0.6325, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.88% (0.5020 => 0.5265, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.6456 => 0.6770, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.4103 => 0.4296, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4289 => 0.4489, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 4.61% (2.2969 => 2.4028, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4064 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.56% (0.7326 => 0.7660, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.53% (2.0273 => 2.1192, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3650 => 0.3812, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.39% (21.9371 => 22.8998, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8921 => 0.9311, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.35% (0.3865 => 0.4033, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5981 => 0.6240, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.2831 => 0.2952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.24% (0.4203 => 0.4381, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.22% (0.2891 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.3826 => 0.3987, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2905 => 0.3026, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.09% (0.3935 => 0.4096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.08% (0.3232 => 0.3364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.08% (0.3283 => 0.3417, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.04% (1.5859 => 1.6500, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4620 => 0.4806, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.4048 => 0.4209, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3603 => 0.3746, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2872 => 0.2984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (2.0665 => 2.1466, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4730, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.76% (0.3379 => 0.3506, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.2024 => 2.2832, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 3.65% (0.2877 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.62% (14.3668 => 14.8867, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.58% (0.3684 => 0.3816, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.1840 => 1.2232, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 2.45% (1.2842 => 1.3157, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.30% (0.8101 => 0.8287, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.8922 => 3.9394, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.19% (17.1811 => 17.3850, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (3.1578 => 3.3859, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7506, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (4.2280 => 4.3538, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7896, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2200, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.35% (5.2763 => 3.2526, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.92% (5.3855 => 3.8819, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.65% (5.3526 => 3.8726, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1658, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.65% (2.9384 => 2.5962, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.55% (22.1758 => 20.2806, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.20% (1.6925 => 1.4183, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3046, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1511, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4115, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5103, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0043, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.26% (1.2373 => 1.2093, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9993, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5801, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2360, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0554 => 1.0447, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.95% (0.5229 => 0.5697, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 6.12% (14.9895 => 15.9064, std.dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 4.17% (14.1553 => 14.7457, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 4.92% (4.1105 => 4.3129, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.57% (1.1048 => 1.2216, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.58% (7.1582 => 7.4148, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.21% (3.4629 => 3.6780, std.dev.: 0.0272) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.75% (0.6222 => 0.6393, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 21:24:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 23:24:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920042449.5377C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4034?compare_to=4030&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4034, Order: 164279, Start Time: 2012-09-20 03:15:06, End Time: 2012-09-20 04:26:14 To: 4030, Order: 164272, Start Time: 2012-09-20 01:48:31, End Time: 2012-09-20 02:59:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 2 (36 on baseline) Performance Improvements: 9 (52 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 889 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.03% (41.9576 => 43.6486, std.dev.: 0.2168) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.35% (0.8605 => 0.8807, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.57% (8.9669 => 8.4675, std.dev.: 0.1647) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.69% (0.3794 => 0.3692, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.65% (1.4329 => 1.4093, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.40% (4.0776 => 4.0207, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.35% (1.1891 => 1.1731, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.10% (1.4237 => 1.4080, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -1.01% (1.3516 => 1.3380, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.20% (1.4439 => 1.3111, std.dev.: 0.0353) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.51% (1.4537 => 1.4317, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.65% (1.0023 => 0.9958, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.60% (0.6013 => 0.5917, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: -5.16% (0.1648 => 0.1563, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.67% (0.1422 => 0.1531, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.39% (0.3080 => 0.3092, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.15% (0.2356 => 0.2329, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.73% (0.3172 => 0.3149, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.40% (0.2293 => 0.2238, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -16.22% (0.0450 => 0.0377, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -15.91% (0.0088 => 0.0074, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0237 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.83% (0.0188 => 0.0162, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.04% (0.0383 => 0.0379, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.70% (0.0294 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.72% (0.0279 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.64% (0.0301 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -33.14% (0.0175 => 0.0117, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -1.60% (0.0188 => 0.0185, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: - (0.0244 => 0.0244, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -5.90% (0.0322 => 0.0303, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1435 => 0.1426, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.36% (1.4588 => 1.4932, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.84% (0.1429 => 0.1417, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.18% (0.4311 => 0.4217, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.14% (0.1438 => 0.1440, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.02% (0.0622 => 0.0597, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.84% (0.0221 => 0.0186, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.73% (0.0611 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1333 => 1.1287, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0020 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.04% (0.0563 => 0.0529, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.00% (0.0230 => 0.0138, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7653 => 0.7673, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.16% (1.5984 => 1.6009, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 181.40% (0.0043 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.94% (4.1772 => 3.0938, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/except: 83233.33% (0.0006 => 0.5000, std.dev.: 0.0169) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.18% (0.6410 => 0.6806, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.84% (0.5309 => 0.5619, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 5.42% (2.1763 => 2.2942, std.dev.: 0.0182) MultiSource/Applications/SIBsim4/SIBsim4: 3.76% (1.1653 => 1.2091, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 3.40% (0.6173 => 0.6383, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.07% (0.3582 => 0.3692, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.63% (15.3105 => 15.7132, std.dev.: 0.0564) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.7639 => 0.7812, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.11% (29.3170 => 29.9366, std.dev.: 0.2011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3375, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/ary3: 15.05% (1.7426 => 2.0049, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.25% (4.0101 => 4.5817, std.dev.: 0.0655) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6342, std.dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.38% (1.0063 => 1.0906, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.30% (0.2857 => 0.3094, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.83% (40.4792 => 43.6486, std.dev.: 0.2168) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.66% (0.3301 => 0.3554, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8457, std.dev.: 0.0393) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8740, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.64% (0.8498 => 0.8807, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.93% (14.4877 => 14.9126, std.dev.: 0.0435) MultiSource/Benchmarks/sim/sim: 2.78% (3.8907 => 3.9989, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7151, std.dev.: 0.0632) MultiSource/Applications/siod/siod: 2.38% (3.5520 => 3.6367, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.6127 => 4.7120, std.dev.: 0.0174) SingleSource/Benchmarks/Dhrystone/dry: 1.77% (2.4013 => 2.4438, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (2.4042 => 2.4405, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: 1.51% (1.4184 => 1.4398, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.10% (2.9152 => 2.9473, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.02% (0.2080 => 0.1934, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -5.89% (8.9977 => 8.4675, std.dev.: 0.1647) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.92% (0.4596 => 0.4462, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.60% (0.5740 => 0.5591, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.15% (4.3380 => 4.2449, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.29% (8.2559 => 8.1496, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.24% (4.2815 => 4.2286, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.44% (5.2665 => 4.0848, std.dev.: 0.1243) SingleSource/Benchmarks/Shootout-C++/ary3: -20.63% (1.7473 => 1.3868, std.dev.: 0.0506) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.1647 => 0.9594, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.63% (15.8312 => 13.3563, std.dev.: 0.0523) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -11.53% (0.3746 => 0.3314, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9363, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.6254 => 3.3784, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3288, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: -6.59% (3.4230 => 3.1973, std.dev.: 0.0192) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8714, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.49% (1.4021 => 1.3111, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/richards_benchmark: -6.27% (1.4441 => 1.3535, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: -6.16% (0.2664 => 0.2500, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -5.46% (62.4126 => 59.0026, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1878, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4140 => 0.3936, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.43% (1.2959 => 1.2385, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.15% (45.4683 => 43.5811, std.dev.: 0.6563) MultiSource/Applications/lambda-0_1_3/lambda: -3.98% (7.6833 => 7.3773, std.dev.: 0.0507) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.89% (1.2722 => 1.2227, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: -3.59% (9.2503 => 8.9180, std.dev.: 0.0506) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.84% (3.7496 => 3.6430, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.76% (2.4457 => 2.3782, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2849, std.dev.: 0.0429) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.25% (1.1683 => 1.1420, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.93% (2.3569 => 2.3115, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3630, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4876 => 3.4244, std.dev.: 0.0118) MultiSource/Benchmarks/PAQ8p/paq8p: -1.78% (92.7467 => 91.0936, std.dev.: 0.4409) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (9.3855 => 9.2213, std.dev.: 0.0492) SingleSource/Benchmarks/Dhrystone/fldry: -1.69% (2.4971 => 2.4548, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std.dev.: 0.0140) MultiSource/Benchmarks/llubenchmark/llu: -1.19% (2.0192 => 1.9951, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.18% (2.8599 => 2.8262, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/oourafft: -1.04% (3.8200 => 3.7802, std.dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.22% (0.9980 => 0.9958, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.74% (0.6022 => 0.5917, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: -6.18% (0.1666 => 0.1563, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.48% (0.1554 => 0.1531, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3083 => 0.3092, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.72% (0.2394 => 0.2329, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.82% (0.3175 => 0.3149, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.78% (0.2302 => 0.2238, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -16.04% (0.0449 => 0.0377, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -17.78% (0.0090 => 0.0074, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.67% (0.0240 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.62% (0.0192 => 0.0162, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.82% (0.0390 => 0.0379, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -33.90% (0.0177 => 0.0117, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -2.12% (0.0189 => 0.0185, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -6.77% (0.0325 => 0.0303, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.58% (1.5019 => 1.4932, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.60% (0.1501 => 0.1417, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.10% (0.4264 => 0.4217, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.36% (0.0589 => 0.0597, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.83% (0.0232 => 0.0186, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.10% (0.0639 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.95% (0.0637 => 0.0529, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.90% (0.0246 => 0.0138, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.75% (0.7541 => 0.7673, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.20% (1.5363 => 1.6009, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 21:58:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Sep 2012 23:58:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920045834.5ACA8352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4035?compare_to=4031&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4035, Order: 164281, Start Time: 2012-09-20 03:45:34, End Time: 2012-09-20 04:59:59 To: 4031, Order: 164272, Start Time: 2012-09-20 02:02:43, End Time: 2012-09-20 03:17:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.08% (2.0176 => 2.4026, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.54% (0.1072 => 0.1185) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 9.20% (1.3693 => 1.4953, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.20% (3.9660 => 4.3308, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 8.98% (0.7038 => 0.7670, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.7710 => 0.8378, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.48% (0.9199 => 0.9979, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.46% (1.2193 => 1.3224, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.41% (0.5265 => 0.5708, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.35% (0.6959 => 0.7540, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.5818 => 0.6287, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.01% (1.1364 => 1.2274, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.96% (13.8202 => 14.9197, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.94% (1.4563 => 1.5720, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.3899 => 0.4202, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5748 => 0.6194, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7061 => 0.7608, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6283 => 0.6765, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.56% (0.4062 => 0.4369, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.55% (0.5577 => 0.5998, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 7.39% (1.0313 => 1.1075, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.20% (0.4791 => 0.5136, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.18% (0.3580 => 0.3837, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.16% (0.3756 => 0.4025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.11% (0.4390 => 0.4702, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.03% (0.4379 => 0.4687, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.01% (1.1061 => 1.1836, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (7.2180 => 7.7173, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.90% (1.9828 => 2.1197, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.5637 => 0.6026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.82% (0.4016 => 0.4290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.2914 => 0.3112, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.79% (3.8646 => 4.1269, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 6.74% (0.8310 => 0.8870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.66% (0.7506 => 0.8006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.64% (0.2243 => 0.2392, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.57% (0.7460 => 0.7950, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 6.56% (0.2925 => 0.3117, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.56% (3.6692 => 3.9099, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3220 => 0.3427, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 6.22% (2.1791 => 2.3147, std.dev.: 0.0082) MultiSource/Applications/d/make_dparser: 6.19% (3.1889 => 3.3864, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 6.09% (1.0594 => 1.1239, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.03% (1.9270 => 2.0432, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (1.3245 => 1.4038, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 5.95% (0.6744 => 0.7145, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894) SingleSource/UnitTests/ObjC/parameter-passing: 5.82% (0.4003 => 0.4236, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.80% (16.6129 => 17.5771, std.dev.: 0.0298) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3646 => 0.3856, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 5.76% (0.3578 => 0.3784, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.74% (0.3623 => 0.3831, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.72% (0.6576 => 0.6952, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.2749 => 1.3477, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.70% (0.3789 => 0.4005, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.70% (0.3914 => 0.4137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.67% (0.3601 => 0.3805, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.66% (14.8535 => 15.6943, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.66% (1.3819 => 1.4601, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.61% (0.3940 => 0.4161, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (1.3813 => 1.4587, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.58% (0.8698 => 0.9183, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 5.54% (0.3663 => 0.3866, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.48% (8.4961 => 8.9619, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.34% (0.8818 => 0.9289, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.32% (4.4433 => 4.6796, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.6135 => 0.6461, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (13.2842 => 13.9869, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (4.3801 => 4.6114, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3755 => 0.3949, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (1.1333 => 1.1904, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.96% (6.5754 => 6.9016, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 4.85% (4.6629 => 4.8889, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 4.83% (14.5298 => 15.2319, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.2742 => 3.4212, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1951, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.07% (0.9108 => 0.9479, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.89% (0.4805 => 0.4992, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6250 => 0.6490, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.82% (1.5188 => 1.5768, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 3.67% (3.7467 => 3.8843, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.45% (6.2785 => 6.4954, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.1007 => 2.1709, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 2.74% (33.2944 => 34.2072, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5335, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std.dev.: 0.0447) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3781, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0732, std.dev.: 0.0563) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5987, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5965, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.07% (0.4657 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.51% (22.5627 => 21.7715, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2837, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.98% (1.3780 => 1.2956, std.dev.: 0.0166) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7057, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: -3.45% (3.0263 => 2.9220, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5716, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.25% (26.5159 => 25.9185, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2386, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2414, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0630, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4320, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 22:51:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 00:51:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920055105.2C354352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4036?compare_to=4034&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4036, Order: 164283, Start Time: 2012-09-20 04:41:55, End Time: 2012-09-20 05:52:31 To: 4034, Order: 164279, Start Time: 2012-09-20 03:15:06, End Time: 2012-09-20 04:26:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 14 (47 on baseline) Performance Improvements: 2 (39 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 884 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 53.03% (0.0264 => 0.0404, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.24% (0.0712 => 0.0849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.08% (0.3065 => 0.3190, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.39% (0.7553 => 0.7809, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.95% (0.5591 => 0.5756, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.94% (0.4458 => 0.4589, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.7743 => 0.7956, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.07% (6.4620 => 6.5312, std.dev.: 0.0217) MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (2.2942 => 2.3185, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.77% (1.3111 => 1.3736, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.81% (1.7893 => 1.8574, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.87% (0.3936 => 0.4049, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.46% (21.7827 => 22.3192, std.dev.: 0.0479) MultiSource/Benchmarks/BitBench/five11/five11: 1.05% (5.1911 => 5.2458, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.82% (43.6486 => 41.5465, std.dev.: 0.4981) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.23% (1.2842 => 1.2684, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.74% (0.9958 => 1.0032, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.45% (0.5917 => 0.6003, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 6.01% (0.1563 => 0.1657, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.63% (0.1531 => 0.1556, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3092 => 0.3095, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (0.2329 => 0.2362, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (0.3149 => 0.3165, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.06% (0.2238 => 0.2284, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 18.30% (0.0377 => 0.0446, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: 3.45% (0.0087 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -24.32% (0.0074 => 0.0056, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.54% (0.0236 => 0.0242, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.90% (0.0162 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.11% (0.0379 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0299 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0321 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 52.99% (0.0117 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.54% (0.0185 => 0.0186, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 2.46% (0.0244 => 0.0250, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 6.60% (0.0303 => 0.0323, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 40.00% (0.0005 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1426 => 0.1425, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.92% (1.4932 => 1.5219, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.65% (0.1417 => 0.1497, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.49% (0.4217 => 0.4070, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.42% (0.1440 => 0.1446, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.55% (0.0597 => 0.0540, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.74% (0.0186 => 0.0219, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.01% (0.0646 => 0.0633, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4700.00% (0.0001 => 0.0048, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1287 => 1.1289, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 50.00% (0.0012 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.99% (0.0529 => 0.0566, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.64% (0.0138 => 0.0172, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7673 => 0.7660, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.10% (1.6009 => 1.6025, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.99% (4.1772 => 3.1335, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/except: 81783.33% (0.0006 => 0.4913, std.dev.: 0.0067) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.07% (0.0745 => 0.0902, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.50% (0.1414 => 0.1520, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 6.53% (2.1763 => 2.3185, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.5309 => 0.5622, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.62% (0.6410 => 0.6770, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2073, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.7722 => 0.7956, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 2.96% (15.3105 => 15.7640, std.dev.: 0.1485) MultiSource/Benchmarks/Bullet/bullet: 2.96% (29.3170 => 30.1853, std.dev.: 0.0535) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3582 => 0.3685, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.47% (3.0225 => 3.0972, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.5150 => 1.5490, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 1.95% (2.0972 => 2.1380, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.64% (1.1672 => 1.1864, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (8.2186 => 8.3497, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.7639 => 0.7744, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.37% (4.7455 => 4.8104, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 1.35% (13.3238 => 13.5034, std.dev.: 0.0618) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 15.13% (1.7426 => 2.0062, std.dev.: 0.0138) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.03% (4.0101 => 4.5328, std.dev.: 0.0337) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.65% (0.2694 => 0.2981, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.49% (0.2857 => 0.3128, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6108, std.dev.: 0.0325) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.89% (1.0063 => 1.0857, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8517, std.dev.: 0.0388) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/mason/mason: 2.96% (0.5004 => 0.5152, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8864, std.dev.: 0.0573) MultiSource/Benchmarks/sim/sim: 2.75% (3.8907 => 3.9976, std.dev.: 0.0141) MultiSource/Applications/siod/siod: 2.56% (3.5520 => 3.6429, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.51% (2.6656 => 2.7325, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: 2.44% (8.5113 => 8.7191, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.20% (0.6308 => 0.6447, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 2.18% (2.4013 => 2.4536, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4455 => 2.4707, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.00% (27.1724 => 27.4450, std.dev.: 0.0250) MultiSource/Benchmarks/BitBench/five11/five11: 1.00% (5.1938 => 5.2458, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.39% (0.7738 => 0.7553, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -1.28% (0.9425 => 0.9304, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.65% (5.2665 => 4.1264, std.dev.: 0.0549) SingleSource/Benchmarks/Shootout-C++/ary3: -20.01% (1.7473 => 1.3977, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.38% (1.1647 => 0.9623, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.92% (15.8312 => 13.4686, std.dev.: 0.0399) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -11.51% (0.3746 => 0.3315, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.25% (3.2007 => 2.9367, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.23% (1.4034 => 1.2879, std.dev.: 0.0290) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3771, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3328, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8721, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3520, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: -6.06% (3.4230 => 3.2154, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9622, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1885, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.27% (7.6833 => 7.3551, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.12% (61.1734 => 58.6507, std.dev.: 0.7251) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9422, std.dev.: 0.0426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.25% (45.4683 => 43.9916, std.dev.: 0.3092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.79% (1.2722 => 1.2367, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2861, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.66% (1.0686 => 1.0402, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.64% (1.1683 => 1.1375, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/misr: -2.51% (0.4296 => 0.4188, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.38% (3.7496 => 3.6605, std.dev.: 0.0244) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3638, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.37% (9.3855 => 9.2568, std.dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3147, std.dev.: 0.0203) SingleSource/Benchmarks/Dhrystone/fldry: -1.13% (2.4971 => 2.4688, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (92.7467 => 91.7925, std.dev.: 0.2707) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.52% (0.9980 => 1.0032, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -0.32% (0.6022 => 0.6003, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -0.54% (0.1666 => 0.1657, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.13% (0.1554 => 0.1556, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.39% (0.3083 => 0.3095, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.34% (0.2394 => 0.2362, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.31% (0.3175 => 0.3165, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.78% (0.2302 => 0.2284, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.67% (0.0449 => 0.0446, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -37.78% (0.0090 => 0.0056, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.59% (0.0189 => 0.0186, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1429 => 0.1425, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.33% (1.5019 => 1.5219, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1501 => 0.1497, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.55% (0.4264 => 0.4070, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1344 => 0.1446, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.32% (0.0589 => 0.0540, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.60% (0.0232 => 0.0219, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.94% (0.0639 => 0.0633, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1350 => 1.1289, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0006 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.15% (0.0637 => 0.0566, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.08% (0.0246 => 0.0172, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.31% (1.5363 => 1.6025, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 22:51:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 00:51:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920055117.78527352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4037?compare_to=4033&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4037, Order: 164283, Start Time: 2012-09-20 04:32:59, End Time: 2012-09-20 05:52:42 To: 4033, Order: 164278, Start Time: 2012-09-20 02:44:38, End Time: 2012-09-20 04:04:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (722 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5697 => 0.5693, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -0.27% (15.9064 => 15.8637, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -0.46% (14.7457 => 14.6786, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: -0.46% (82.5153 => 82.1381, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: -0.21% (4.3129 => 4.3037, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.22% (1.2216 => 1.2189, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (7.4148 => 7.3881, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.35% (3.6780 => 3.6652, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.39% (0.6393 => 0.6368, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (0.0651 => 0.0686, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.88% (63.2438 => 82.1381, std.dev.: 0.0172) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.44% (0.0720 => 10.3316, std.dev.: 0.0036) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.22% (10.3673 => 15.3664, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 26.14% (0.1622 => 0.2046, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.53% (2.2022 => 2.5222, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.49% (7.0540 => 8.0763, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 13.62% (0.1432 => 0.1627, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.98% (1.7609 => 1.9542, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.98% (10.4361 => 11.4774, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/oourafft: 9.20% (0.3282 => 0.3584, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.93% (0.3473 => 0.3783, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.81% (0.3497 => 0.3805, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.81% (0.3543 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3543 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.62% (0.3561 => 0.3868, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.48% (0.3927 => 0.4260, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 8.36% (0.3694 => 0.4003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.31% (0.3828 => 0.4146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.21% (0.3886 => 0.4205, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.27% (9.4845 => 10.1742, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 7.22% (0.1440 => 0.1544, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7433 => 0.7939, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.48% (0.2700 => 0.2875, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.6675 => 0.7086, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.4615 => 0.4898, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2554 => 0.2710, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.04% (0.7115 => 0.7545, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5860 => 0.6207, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.90% (5.7591 => 6.0989, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3423 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.81% (0.2271 => 0.2403, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.79% (4.2646 => 4.5117, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.3050 => 1.3797, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.70% (0.5105 => 0.5396, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (1.5415 => 1.6283, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.62% (3.3354 => 3.5228, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (8.1363 => 8.5845, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.8067 => 0.8510, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.8172 => 0.8614, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.9449 => 5.2119, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.39% (5.0018 => 5.2712, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.38% (0.3121 => 0.3289, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.34% (0.3092 => 0.3257, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.22% (0.9765 => 1.0275, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.22% (0.2758 => 0.2902, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.16% (0.7835 => 0.8239, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.11% (1.5603 => 1.6400, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 5.01% (1.1642 => 1.2225, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.97% (0.3441 => 0.3612, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2603 => 0.2732, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (7.9617 => 8.3526, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: 4.84% (1.0722 => 1.1241, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.82% (3.8723 => 4.0589, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.3180 => 0.3331, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 4.69% (0.5925 => 0.6203, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (1.1861 => 1.2414, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 4.64% (0.6030 => 0.6310, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 4.64% (0.3387 => 0.3544, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.62% (0.5020 => 0.5252, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.61% (0.4299 => 0.4497, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.44% (21.9371 => 22.9111, std.dev.: 0.0274) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.34% (0.4636 => 0.4837, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 4.33% (2.0273 => 2.1151, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 4.20% (2.2969 => 2.3933, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8921 => 0.9291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (0.4064 => 0.4228, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3826 => 0.3980, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.4289 => 0.4461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.98% (0.5981 => 0.6219, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (1.5859 => 1.6471, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 3.85% (0.7326 => 0.7608, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4203 => 0.4362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3865 => 0.4008, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.70% (0.3136 => 0.3252, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.60% (1.4186 => 1.4696, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.55% (0.4620 => 0.4784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3232 => 0.3346, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.47% (0.3283 => 0.3397, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.45% (0.3162 => 0.3271, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.44% (2.2024 => 2.2781, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.4048 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (14.3668 => 14.8479, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.27% (2.0665 => 2.1340, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.18% (0.3684 => 0.3801, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.1840 => 1.2206, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (0.8101 => 0.8269, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.97% (1.2842 => 1.3095, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.03% (17.1811 => 17.3581, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3831, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3487, std.dev.: 0.0080) MultiSource/Benchmarks/llubenchmark/llu: 1.54% (3.7781 => 3.8364, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std.dev.: 0.0276) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7885, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.74% (5.2763 => 3.2320, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.16% (5.3855 => 3.8690, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.76% (5.3526 => 3.8666, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1330, std.dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.11% (2.9384 => 2.5825, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: -8.66% (22.1758 => 20.2546, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3790, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2991, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (1.8329 => 1.7166, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5841, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5057, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4261, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9923, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.54% (1.2373 => 1.2059, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0029, std.dev.: 0.0132) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5795, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8548, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2309, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.87% (0.5229 => 0.5693, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.83% (14.9895 => 15.8637, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.70% (14.1553 => 14.6786, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (4.1105 => 4.3037, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.33% (1.1048 => 1.2189, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.21% (7.1582 => 7.3881, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.84% (3.4629 => 3.6652, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.6222 => 0.6368, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 23:41:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 01:41:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920064137.D269B352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4038?compare_to=4035&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4038, Order: 164283, Start Time: 2012-09-20 05:28:25, End Time: 2012-09-20 06:43:02 To: 4035, Order: 164281, Start Time: 2012-09-20 03:45:34, End Time: 2012-09-20 04:59:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.01% (2.0176 => 2.4011, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.54% (0.1072 => 0.1185, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.23% (3.9660 => 4.3320, std.dev.: 0.0064) MultiSource/Applications/hbd/hbd: 9.22% (1.3693 => 1.4955, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7038 => 0.7662, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.74% (0.2596 => 0.2823, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.69% (0.7710 => 0.8380, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.65% (0.9199 => 0.9995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.49% (0.5265 => 0.5712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.37% (1.2193 => 1.3213, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.23% (0.6959 => 0.7532, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.11% (1.1364 => 1.2286, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.5818 => 0.6284, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.99% (1.4563 => 1.5726, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 7.92% (13.8202 => 14.9148, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7061 => 0.7618, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.72% (0.5748 => 0.6192, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.62% (0.3899 => 0.4196, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.57% (0.5577 => 0.5999, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4062 => 0.4368, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 7.35% (1.0313 => 1.1071, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.24% (0.3246 => 0.3481, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.20% (0.4791 => 0.5136, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.14% (0.3489 => 0.3738, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.10% (0.2760 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3580 => 0.3833, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.02% (0.7506 => 0.8033, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.01% (1.1061 => 1.1836, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.92% (0.3756 => 0.4016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.89% (1.9828 => 2.1195, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5637 => 0.6024, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.86% (0.3293 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.86% (7.2180 => 7.7132, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.80% (3.8646 => 4.1272, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.77% (0.4016 => 0.4288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.74% (0.8310 => 0.8870, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.7460 => 0.7959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9093, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.49% (0.4390 => 0.4675, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2243 => 0.2388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.43% (0.3220 => 0.3427, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.40% (0.3453 => 0.3674, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.30% (2.1791 => 2.3163, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.22% (3.1889 => 3.3874, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.03% (1.0594 => 1.1233, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 5.96% (0.6744 => 0.7146, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.93% (1.9270 => 2.0413, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.92% (1.3245 => 1.4029, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.81% (0.3578 => 0.3786, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (1.2749 => 1.3490, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3914 => 0.4141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.80% (0.4003 => 0.4235, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.76% (16.6129 => 17.5706, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.75% (0.6576 => 0.6954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (1.3819 => 1.4608, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 5.70% (0.3789 => 0.4005, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.67% (14.8535 => 15.6957, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-2: 5.67% (0.3601 => 0.3805, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.65% (0.3663 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.64% (0.4113 => 0.4345, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4591, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.58% (0.3940 => 0.4160, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.55% (0.8698 => 0.9181, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: 5.52% (0.3623 => 0.3823, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.45% (8.4961 => 8.9589, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.38% (0.8818 => 0.9292, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (4.4433 => 4.6810, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.32% (4.3801 => 4.6133, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6135 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (13.2842 => 13.9879, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 5.17% (0.3131 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3755 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (1.1333 => 1.1907, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.2504 => 0.2628, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.91% (6.5754 => 6.8985, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.81% (14.5298 => 15.2291, std.dev.: 0.0162) MultiSource/Applications/oggenc/oggenc: 4.79% (4.6629 => 4.8863, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.56% (0.3245 => 0.3393, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.56% (3.2742 => 3.4234, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.36% (1.2292 => 1.2828, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.17% (4.9865 => 5.1944, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.07% (0.9108 => 0.9479, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.89% (0.4805 => 0.4992, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.5188 => 1.5773, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6250 => 0.6490, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.71% (3.7467 => 3.8856, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.40% (6.2785 => 6.4917, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.1007 => 2.1695, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.80% (33.2944 => 34.2273, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 1.76% (16.2614 => 16.5480, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.82% (1.8175 => 2.2686, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.97% (1.0895 => 1.3506, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.20% (10.7476 => 11.0918, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5934, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5883, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.07% (0.4657 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.55% (22.5627 => 21.7612, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2875, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.26% (1.3780 => 1.2918, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1497, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.49% (3.0263 => 2.9206, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5995, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9055, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2409, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2352, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2284, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0608, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4315, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2627, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5652, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 19 23:49:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 01:49:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920064953.6FC5E352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4039?compare_to=4032&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4039, Order: 164282, Start Time: 2012-09-20 04:07:22, End Time: 2012-09-20 06:51:17 To: 4032, Order: 164268, Start Time: 2012-09-20 00:55:14, End Time: 2012-09-20 03:38:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.20% (0.2146 => 0.2279, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.47% (0.3465 => 0.3793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3488 => 0.3817, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.43% (0.3446 => 0.3771, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.43% (0.3469 => 0.3796, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3460 => 0.3785, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3442 => 0.3763, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3496 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.18% (0.3650 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.3724 => 0.4055, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.88% (1.5932 => 1.7187, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.24% (0.4361 => 0.4633, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.13% (0.5889 => 0.6250, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (1.6211 => 1.7197, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.82% (1.3152 => 1.3918, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 5.73% (5.5417 => 5.8595, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (3.5627 => 3.7612, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.37% (0.5026 => 0.5296, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.28% (2.7292 => 2.8733, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.20% (4.2109 => 4.4300, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 5.19% (1.0781 => 1.1341, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 5.13% (0.6634 => 0.6974, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.08% (0.2875 => 0.3021, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.06% (0.3004 => 0.3156, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.00% (0.2738 => 0.2875, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.94% (0.9909 => 1.0399, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.93% (0.5900 => 0.6191, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (0.3890 => 0.4081, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.89% (23.5202 => 24.6697, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3195 => 0.3351, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.84% (0.7171 => 0.7518, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.80% (0.2813 => 0.2948, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (4.4195 => 4.6312, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2780 => 0.2913, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.78% (0.2823 => 0.2958, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.78% (4.6177 => 4.8384, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 4.75% (1.8794 => 1.9686, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.71% (0.2911 => 0.3048, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3060 => 0.3204, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.70% (0.3084 => 0.3229, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.69% (2.1653 => 2.2669, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/strcat: 4.69% (0.2750 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.68% (0.3267 => 0.3420, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3258 => 0.3410, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.65% (0.2729 => 0.2856, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.64% (2.0673 => 2.1633, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.3317 => 0.3469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.3348 => 0.3500, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (0.3625 => 0.3789, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.3903 => 0.4078, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.46% (0.6435 => 0.6722, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.4139 => 0.4323, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.44% (0.4146 => 0.4330, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.44% (1.4269 => 1.4902, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.43% (0.3362 => 0.3511, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3726 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.42% (0.4251 => 0.4439, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3124 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3282 => 0.3425, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.34% (0.4029 => 0.4204, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 4.29% (0.3336 => 0.3479, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.27% (0.5546 => 0.5783, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.25% (0.3690 => 0.3847, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 4.21% (2.0346 => 2.1202, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 4.16% (0.9697 => 1.0100, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.09% (0.2737 => 0.2849, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.01% (0.5012 => 0.5213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.3271 => 0.3400, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.92% (0.3981 => 0.4137, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (1.9694 => 2.0451, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.83% (0.7875 => 0.8177, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: 3.82% (0.4847 => 0.5032, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.81% (0.5584 => 0.5797, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (1.9966 => 2.0721, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.74% (0.7426 => 0.7704, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.3845 => 0.3984, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.49% (0.5361 => 0.5548, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.01% (4.6926 => 4.8339, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.97% (11.6398 => 11.9853, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6647, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1665, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6308, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2117, std.dev.: 0.0392) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5035, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.77% (3.1722 => 3.2284, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4516, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5153, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5992, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.06% (105.3826 => 106.4976, std.dev.: 0.0713) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5351, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/ary2: -10.37% (0.2402 => 0.2153, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8019, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (17.2379 => 16.7253, std.dev.: 0.0698) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9595, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 00:50:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 02:50:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920075015.AC52E352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4040?compare_to=4036&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4040, Order: 164285, Start Time: 2012-09-20 06:41:32, End Time: 2012-09-20 07:51:42 To: 4036, Order: 164283, Start Time: 2012-09-20 04:41:55, End Time: 2012-09-20 05:52:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (43 on baseline) Performance Improvements: 1 (43 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 894 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.37% (8.6328 => 9.1831, std.dev.: 0.1315) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.92% (21.3735 => 24.3486, std.dev.: 0.6528) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.67% (58.6507 => 60.2186, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.80% (1.2684 => 1.2912, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.04% (1.0402 => 1.0510, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (91.7925 => 90.6889, std.dev.: 0.2644) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.11% (1.0032 => 0.9921, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.6003 => 0.6000, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -2.41% (0.1657 => 0.1617, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1556 => 0.1570, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.13% (0.3095 => 0.3029, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.62% (0.2362 => 0.2300, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (0.3165 => 0.3126, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2284 => 0.2284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -10.54% (0.0446 => 0.0399, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -43.33% (0.0090 => 0.0051, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-11-VaListArg: 53.57% (0.0056 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -34.30% (0.0242 => 0.0159, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.05% (0.0191 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0387 => 0.0385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0300 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.07% (0.0281 => 0.0278, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0323 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.68% (0.0179 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.08% (0.0186 => 0.0188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0250 => 0.0250, std.dev.: 0.0025) SingleSource/UnitTests/byval-alignment: -10.22% (0.0323 => 0.0290, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -28.57% (0.0007 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1425 => 0.1425, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -4.19% (1.5219 => 1.4581, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1497 => 0.1490, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.87% (0.4070 => 0.4187, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.60% (0.1446 => 0.1394, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.33% (0.0540 => 0.0612, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.24% (0.0219 => 0.0248, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.64% (0.0633 => 0.0572, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.08% (0.0048 => 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1289 => 1.1263, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0018 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 80.00% (0.0005 => 0.0009, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.83% (0.0566 => 0.0582, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.88% (0.0172 => 0.0155, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7660 => 0.7650, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.34% (1.6025 => 1.5971, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.24% (0.0121 => 0.0059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.34% (4.1772 => 3.0771, std.dev.: 0.0565) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.57% (0.5309 => 0.5658, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 5.93% (2.1763 => 2.3053, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.54% (0.6410 => 0.6765, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3582 => 0.3736, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 3.89% (1.1653 => 1.2106, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 3.77% (0.6915 => 0.7176, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3217 => 0.3330, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.5150 => 1.5582, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.7639 => 0.7796, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 2.04% (29.3170 => 29.9159, std.dev.: 0.1777) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6069 => 0.6172, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.1827 => 1.1978, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.26% (1.6538 => 2.3362, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.58% (0.0766 => 0.0916, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 15.00% (21.1721 => 24.3486, std.dev.: 0.6528) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9996, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (4.0101 => 4.5524, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 10.73% (1.6261 => 1.8005, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.82% (7.0025 => 7.6203, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 7.96% (0.1433 => 0.1547, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.08% (1.0063 => 1.0775, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 4.34% (15.2242 => 15.8845, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/dt: 3.94% (0.9851 => 1.0239, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8910, std.dev.: 0.0424) MultiSource/Benchmarks/sim/sim: 2.69% (3.8907 => 3.9952, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.47% (0.5876 => 0.6021, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 2.35% (8.5113 => 8.7117, std.dev.: 0.0307) MultiSource/Applications/siod/siod: 2.16% (3.5520 => 3.6288, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/mason/mason: 2.16% (0.5004 => 0.5112, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.82% (2.4013 => 2.4449, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.56% (2.6656 => 2.7071, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.25% (4.6127 => 4.6704, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.05% (4.0659 => 4.1086, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.02% (2.4455 => 2.4704, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.16% (0.7738 => 0.7571, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.89% (0.3497 => 0.2067, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.68% (5.2665 => 4.0723, std.dev.: 0.2591) SingleSource/Benchmarks/Shootout-C++/ary3: -20.75% (1.7473 => 1.3848, std.dev.: 0.0293) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9599, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.92% (15.8312 => 13.3109, std.dev.: 0.0793) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -11.80% (0.3746 => 0.3304, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.44% (1.4034 => 1.2849, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.89% (3.2007 => 2.9483, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3736, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -6.65% (4.6355 => 4.3271, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3506, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: -6.47% (3.4230 => 3.2015, std.dev.: 0.0602) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7921, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9440, std.dev.: 0.0591) SingleSource/Benchmarks/Shootout/fib2: -5.41% (4.4195 => 4.1806, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.69% (0.4140 => 0.3946, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.64% (45.4683 => 43.3583, std.dev.: 0.7323) MultiSource/Benchmarks/FreeBench/distray/distray: -4.62% (0.2664 => 0.2541, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -4.19% (7.6833 => 7.3614, std.dev.: 0.0162) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.10% (1.2722 => 1.2201, std.dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.71% (1.4021 => 1.3501, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/methcall: -2.95% (9.2503 => 8.9774, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.73% (2.4457 => 2.3789, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.60% (1.1683 => 1.1379, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: -2.42% (1.0926 => 1.0662, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6889, std.dev.: 0.2644) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.20% (3.7496 => 3.6671, std.dev.: 0.0309) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3119, std.dev.: 0.0156) MultiSource/Applications/aha/aha: -1.88% (3.4286 => 3.3640, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2269, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.56% (61.1734 => 60.2186, std.dev.: 0.0504) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4876 => 3.4334, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4616, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3053, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.31% (1.8739 => 1.8494, std.dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.59% (0.9980 => 0.9921, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: -0.37% (0.6022 => 0.6000, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -2.94% (0.1666 => 0.1617, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.03% (0.1554 => 0.1570, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.75% (0.3083 => 0.3029, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.93% (0.2394 => 0.2300, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.54% (0.3175 => 0.3126, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.78% (0.2302 => 0.2284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -11.14% (0.0449 => 0.0399, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -42.70% (0.0089 => 0.0051, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-11-VaListArg: -4.44% (0.0090 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.75% (0.0240 => 0.0159, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0025) SingleSource/UnitTests/byval-alignment: -10.77% (0.0325 => 0.0290, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1429 => 0.1425, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -2.92% (1.5019 => 1.4581, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.73% (0.1501 => 0.1490, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.81% (0.4264 => 0.4187, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.72% (0.1344 => 0.1394, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.90% (0.0232 => 0.0248, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.49% (0.0639 => 0.0572, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.77% (1.1350 => 1.1263, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -62.50% (0.0024 => 0.0009, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.63% (0.0637 => 0.0582, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.99% (0.0246 => 0.0155, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.96% (1.5363 => 1.5971, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.71% (0.0070 => 0.0059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 01:14:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 03:14:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920081455.5A789352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4041?compare_to=4037&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4041, Order: 164285, Start Time: 2012-09-20 06:53:48, End Time: 2012-09-20 08:16:21 To: 4037, Order: 164283, Start Time: 2012-09-20 04:32:59, End Time: 2012-09-20 05:52:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (720 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.12% (0.5131 => 0.5240, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.5693 => 0.5703, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 0.44% (15.8637 => 15.9339, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 0.39% (14.6786 => 14.7364, std.dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: 0.49% (82.1381 => 82.5436, std.dev.: 0.0740) MultiSource/Benchmarks/MallocBench/gs/gs: 0.82% (4.3037 => 4.3391, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.25% (1.2189 => 1.2220, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (7.3881 => 7.4075, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.49% (3.6652 => 3.6832, std.dev.: 0.0713) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6368 => 0.6364, std.dev.: 0.0157) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1432 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.33% (0.0686 => 0.0670, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.52% (63.2438 => 82.5436, std.dev.: 0.0740) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14240.69% (0.0720 => 10.3253, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.06% (10.3673 => 15.3495, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 27.13% (0.1622 => 0.2062, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.52% (2.2022 => 2.5220, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.46% (7.0540 => 8.0739, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 13.97% (0.1432 => 0.1632, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.81% (1.1194 => 1.2516, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.66% (1.7609 => 1.9663, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 10.48% (10.4361 => 11.5296, std.dev.: 0.0213) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 9.35% (0.3282 => 0.3589, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3543 => 0.3864, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.01% (0.3497 => 0.3812, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.00% (0.3543 => 0.3862, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 8.96% (0.3516 => 0.3831, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3561 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.80% (0.3694 => 0.4019, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.71% (0.3927 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.68% (0.1625 => 0.1766, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3828 => 0.4157, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.47% (0.3886 => 0.4215, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.3177 => 0.3428, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 7.66% (9.4845 => 10.2112, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.38% (0.4879 => 0.5239, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.98% (0.2107 => 0.2254, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.89% (0.3121 => 0.3336, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 6.74% (0.7433 => 0.7934, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 6.72% (0.3109 => 0.3318, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.68% (0.3307 => 0.3528, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.2700 => 0.2880, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.42% (0.7115 => 0.7572, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.5569 => 0.5925, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4615 => 0.4907, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.22% (4.2646 => 4.5300, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.8172 => 0.8679, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (1.5415 => 1.6369, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 6.15% (5.7591 => 6.1133, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 6.08% (0.1695 => 0.1798, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.07% (0.8067 => 0.8557, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.06% (0.5860 => 0.6215, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 6.05% (0.7835 => 0.8309, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 6.05% (0.3423 => 0.3630, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.03% (0.5105 => 0.5413, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 5.86% (3.3354 => 3.5308, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.77% (8.1363 => 8.6058, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.70% (0.4103 => 0.4337, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (5.0018 => 5.2855, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (4.9449 => 5.2193, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.3092 => 0.3263, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4299 => 0.4534, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9765 => 1.0298, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.40% (1.1642 => 1.2271, std.dev.: 0.0099) MultiSource/Applications/hbd/hbd: 5.37% (1.5603 => 1.6441, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.31% (0.1940 => 0.2043, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.20% (7.9617 => 8.3755, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 5.17% (3.8723 => 4.0725, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 5.00% (2.0273 => 2.1286, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 4.97% (0.3180 => 0.3338, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 4.96% (0.3387 => 0.3555, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1250, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.88% (0.3422 => 0.3589, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 4.88% (0.5925 => 0.6214, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 4.76% (0.6030 => 0.6317, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.70% (1.1861 => 1.2418, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 4.64% (21.9371 => 22.9547, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C/football/football: 4.62% (0.8921 => 0.9333, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3826 => 0.4002, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.56% (2.2969 => 2.4017, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 4.56% (0.7326 => 0.7660, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.40% (0.6450 => 0.6734, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.39% (1.1840 => 1.2360, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.4064 => 0.4234, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.03% (0.5981 => 0.6222, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.03% (0.3650 => 0.3797, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.4203 => 0.4372, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.4186 => 1.4754, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash: 3.89% (0.4289 => 0.4456, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4636 => 0.4807, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 3.61% (0.4048 => 0.4194, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.55% (14.3668 => 14.8762, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.52% (0.3379 => 0.3498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.49% (0.3098 => 0.3206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.45% (0.3162 => 0.3271, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.30% (2.0665 => 2.1347, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 3.20% (0.3684 => 0.3802, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.8101 => 0.8296, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2842 => 1.3115, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.24% (17.1811 => 17.3940, std.dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.99% (1.1145 => 1.3707, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3834, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (4.2280 => 4.3658, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7481, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7889, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2268, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (26.0924 => 26.3668, std.dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.51% (5.2763 => 3.2446, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.02% (5.3855 => 3.8765, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.61% (5.3526 => 3.8748, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1373, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.82% (2.9384 => 2.5911, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -8.57% (22.1758 => 20.2757, std.dev.: 0.0403) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4194, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2874, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.3463 => 0.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.72% (1.6805 => 1.5843, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5104, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -3.04% (1.2373 => 1.1997, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4295, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9963, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0192, std.dev.: 0.0079) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2305, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.06% (0.5229 => 0.5703, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 6.30% (14.9895 => 15.9339, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 4.11% (14.1553 => 14.7364, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/gs/gs: 5.56% (4.1105 => 4.3391, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.61% (1.1048 => 1.2220, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.48% (7.1582 => 7.4075, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.36% (3.4629 => 3.6832, std.dev.: 0.0713) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6222 => 0.6364, std.dev.: 0.0157) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 01:28:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 03:28:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920082846.C9113352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4042?compare_to=4038&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4042, Order: 164285, Start Time: 2012-09-20 07:15:30, End Time: 2012-09-20 08:30:12 To: 4038, Order: 164283, Start Time: 2012-09-20 05:28:25, End Time: 2012-09-20 06:43:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (164 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.4639 => 56.5671, std.dev.: 0.0578) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.27% (1.2918 => 1.3082, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.54% (2.0176 => 2.4118, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.63% (0.1588 => 0.1741, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.51% (3.9660 => 4.3431, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.05% (0.7710 => 0.8408, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 9.05% (0.7038 => 0.7675, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.84% (0.9199 => 1.0012, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 8.81% (1.3693 => 1.4900, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2721 => 0.2957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.66% (1.2193 => 1.3249, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.5818 => 0.6319, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.61% (0.6959 => 0.7558, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5748 => 0.6228, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.30% (1.1364 => 1.2307, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.12% (1.4563 => 1.5746, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.01% (13.8202 => 14.9269, std.dev.: 0.0189) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7061 => 0.7621, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.6283 => 0.6779, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5577 => 0.6011, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 7.62% (1.0313 => 1.1099, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.55% (0.3246 => 0.3491, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.51% (0.3899 => 0.4192, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (0.1435 => 0.1542, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.41% (0.4791 => 0.5146, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (0.4379 => 0.4700, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.18% (1.1061 => 1.1855, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.14% (0.3489 => 0.3738, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3293 => 0.3527, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.08% (0.8310 => 0.8898, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.93% (3.8646 => 4.1323, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.93% (3.6692 => 3.9233, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.92% (0.3756 => 0.4016, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.90% (0.4016 => 0.4293, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.89% (7.2180 => 7.7153, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.88% (1.9828 => 2.1193, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.80% (0.7460 => 0.7967, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.78% (0.7506 => 0.8015, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2243 => 0.2394, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4390 => 0.4678, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.54% (0.3868 => 0.4121, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.42% (2.1791 => 2.3189, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.34% (1.0594 => 1.1266, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.31% (0.2696 => 0.2866, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.29% (3.1889 => 3.3894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.26% (1.3245 => 1.4074, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 6.25% (1.9270 => 2.0475, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 6.24% (0.6744 => 0.7165, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 6.13% (16.6129 => 17.6312, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6576 => 0.6972, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 6.00% (1.2749 => 1.3514, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 5.93% (14.8535 => 15.7337, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3578 => 0.3789, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.86% (0.8818 => 0.9335, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.84% (0.8698 => 0.9206, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: 5.83% (0.3914 => 0.4142, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.82% (0.4003 => 0.4236, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.76% (0.3940 => 0.4167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.68% (0.3663 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.3801 => 4.6264, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.62% (1.3819 => 1.4596, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.59% (8.4961 => 8.9707, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions-3: 5.58% (0.3623 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.57% (0.6135 => 0.6477, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.55% (1.3813 => 1.4580, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (4.4433 => 4.6887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.41% (13.2842 => 14.0024, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 5.27% (0.3131 => 0.3296, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3755 => 0.3949, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (1.1333 => 1.1916, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.09% (14.5298 => 15.2687, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.98% (3.2742 => 3.4374, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (6.5754 => 6.9021, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 4.77% (4.6629 => 4.8853, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.50% (0.9108 => 0.9518, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.4805 => 0.5015, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2292 => 1.2829, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.31% (4.9865 => 5.2014, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.22% (1.5188 => 1.5829, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.78% (3.7467 => 3.8885, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.58% (2.1007 => 2.1760, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.43% (6.2785 => 6.4941, std.dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 2.90% (33.2944 => 34.2605, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: 1.89% (16.2614 => 16.5695, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5191, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.89% (1.0895 => 1.3498, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4162, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5467, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0743, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5984, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1833, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.18% (12.4560 => 12.6028, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.10% (1.4298 => 1.4455, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.96% (0.4657 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.45% (22.5627 => 21.7846, std.dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2543, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.74% (3.2729 => 3.1504, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.44% (3.0263 => 2.9222, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5844, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.37% (26.5159 => 25.8869, std.dev.: 0.0269) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.12% (0.6615 => 0.6475, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2430, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2201, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std.dev.: 0.0167) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std.dev.: 0.0283) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0606, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4347, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 03:09:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 05:09:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920100907.53883352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4043?compare_to=4039&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4043, Order: 164285, Start Time: 2012-09-20 07:26:34, End Time: 2012-09-20 10:10:32 To: 4039, Order: 164282, Start Time: 2012-09-20 04:07:22, End Time: 2012-09-20 06:51:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (124 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.40% (1.7187 => 1.7428, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.74% (125.2908 => 129.9755, std.dev.: 0.5923) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.43% (0.3446 => 0.3771, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.39% (1.5932 => 1.7428, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/synchronized: 9.37% (0.3469 => 0.3794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.35% (0.3488 => 0.3814, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 9.32% (0.3465 => 0.3788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.30% (0.3442 => 0.3762, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 9.27% (0.3496 => 0.3820, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3460 => 0.3780, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.04% (0.3650 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.3724 => 0.4058, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.60% (0.4361 => 0.4649, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (1.6211 => 1.7223, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (1.3152 => 1.3967, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.09% (5.5417 => 5.8791, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (0.4994 => 0.5288, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (3.5627 => 3.7720, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.73% (0.2566 => 0.2713, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.71% (1.0781 => 1.1397, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (0.5000 => 0.5284, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.61% (0.6634 => 0.7006, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.54% (2.7292 => 2.8803, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.49% (0.2040 => 0.2152, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.47% (0.3930 => 0.4145, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.39% (0.5826 => 0.6140, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.38% (4.2109 => 4.4373, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.2736 => 0.2882, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2875 => 0.3028, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.31% (0.5889 => 0.6202, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (4.4195 => 4.6535, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 5.26% (4.6177 => 4.8606, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.2823 => 0.2971, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (2.1653 => 2.2788, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.3004 => 0.3161, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.20% (0.3195 => 0.3361, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.19% (0.3890 => 0.4092, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.17% (23.5202 => 24.7354, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/strcat: 5.16% (0.2750 => 0.2892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.15% (0.2813 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3060 => 0.3217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3267 => 0.3434, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.10% (0.3258 => 0.3424, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.09% (0.5026 => 0.5282, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 5.09% (2.1013 => 2.2082, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.02% (0.9909 => 1.0406, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.99% (0.3084 => 0.3238, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.99% (0.2725 => 0.2861, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.98% (0.2911 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2738 => 0.2874, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.97% (0.3726 => 0.3911, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.96% (0.2780 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.96% (1.8794 => 1.9726, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 4.95% (2.0346 => 2.1353, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 4.94% (0.2811 => 0.2950, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.91% (1.4269 => 1.4970, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.91% (0.3362 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (2.0673 => 2.1686, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.88% (0.4139 => 0.4341, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 4.88% (0.3096 => 0.3247, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.87% (0.4146 => 0.4348, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.85% (0.3317 => 0.3478, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (0.3625 => 0.3800, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3124 => 0.3274, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.3903 => 0.4090, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2803 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.76% (0.6435 => 0.6741, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3678 => 0.3852, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.3348 => 0.3506, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 4.71% (0.3336 => 0.3493, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.68% (0.4251 => 0.4450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.66% (0.3477 => 0.3639, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.61% (0.9697 => 1.0144, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 4.56% (0.5546 => 0.5799, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3690 => 0.3858, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.3981 => 0.4162, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.52% (0.4029 => 0.4211, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (0.4658 => 0.4867, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 4.42% (0.4847 => 0.5061, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.39% (0.7426 => 0.7752, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.3271 => 0.3413, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.31% (0.2737 => 0.2855, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.31% (0.5012 => 0.5228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.24% (0.7171 => 0.7475, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.24% (0.5900 => 0.6150, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (0.5361 => 0.5588, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.22% (0.7875 => 0.8207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (1.9694 => 2.0518, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (1.9966 => 2.0796, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.15% (0.5584 => 0.5816, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.2969 => 0.3082, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.52% (0.3498 => 0.3621, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.34% (11.6398 => 12.0282, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.6926 => 4.8401, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.29% (11.9555 => 12.1103, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6744, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1638, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6455, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2003, std.dev.: 0.0575) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5049, std.dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2263, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4536, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5885, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5553, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -7.54% (0.2402 => 0.2221, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8055, std.dev.: 0.0097) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7731, std.dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9726, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 03:20:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 05:20:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920102048.9385D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4044?compare_to=4040&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4044, Order: 164296, Start Time: 2012-09-20 09:11:50, End Time: 2012-09-20 10:22:15 To: 4040, Order: 164285, Start Time: 2012-09-20 06:41:32, End Time: 2012-09-20 07:51:42 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (47 on baseline) Performance Improvements: 1 (39 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 893 (804 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7616 => 0.7790, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (12.7642 => 12.9097, std.dev.: 0.0297) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.88% (2.4639 => 2.6089, std.dev.: 0.0269) SingleSource/Benchmarks/McGill/chomp: 4.42% (1.0300 => 1.0755, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.28% (22.0275 => 22.3095, std.dev.: 0.0627) MultiSource/Benchmarks/Olden/tsp/tsp: 1.24% (1.7362 => 1.7578, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -17.56% (24.3486 => 20.0723, std.dev.: 1.0353) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.05% (0.9921 => 0.9926, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.6000 => 0.6003, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 2.04% (0.1617 => 0.1650, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1570 => 0.1569, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (0.3029 => 0.3063, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.83% (0.2300 => 0.2258, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.15% (0.3126 => 0.3162, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.71% (0.2284 => 0.2222, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: 12.53% (0.0399 => 0.0449, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -41.18% (0.0051 => 0.0030, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: -9.30% (0.0086 => 0.0078, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 48.43% (0.0159 => 0.0236, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.59% (0.0189 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0385 => 0.0387, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.01% (0.0296 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.44% (0.0278 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0320 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.57% (0.0176 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0188 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0250 => 0.0247, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 12.41% (0.0290 => 0.0326, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 40.00% (0.0005 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1425 => 0.1429, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.62% (1.4581 => 1.4817, std.dev.: 0.0304) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.40% (0.1490 => 0.1496, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.37% (0.4187 => 0.4046, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.87% (0.1394 => 0.1354, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.05% (0.0612 => 0.0526, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.21% (0.0248 => 0.0245, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.80% (0.0572 => 0.0556, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1263 => 1.1263, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 16.67% (0.0012 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0009 => 0.0003, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.78% (0.0582 => 0.0560, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.68% (0.0155 => 0.0140, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.7650 => 0.7655, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.18% (1.5971 => 1.5942, std.dev.: 0.0049) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 105.08% (0.0059 => 0.0121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.15% (4.1772 => 3.0848, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/except: 82766.67% (0.0006 => 0.4972, std.dev.: 0.0005) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 6.37% (2.1763 => 2.3149, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.85% (0.6410 => 0.6785, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 5.29% (0.5309 => 0.5590, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3582 => 0.3738, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.28% (0.6173 => 0.6437, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (1.1653 => 1.2107, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 3.79% (0.6915 => 0.7177, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3217 => 0.3321, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.5150 => 1.5591, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.86% (15.3105 => 15.7490, std.dev.: 0.1323) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (12.6413 => 12.9097, std.dev.: 0.0297) MultiSource/Applications/hbd/hbd: 2.00% (1.3268 => 1.3533, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.96% (0.7639 => 0.7789, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.70% (3.0225 => 3.0739, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.63% (1.1827 => 1.2020, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.36% (6.2546 => 6.3397, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.36% (1.2021 => 1.2184, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 1.17% (13.3238 => 13.4797, std.dev.: 0.0572) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.20% (3.4629 => 4.2316, std.dev.: 0.0341) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.54% (0.0766 => 0.0885, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 14.95% (1.7426 => 2.0031, std.dev.: 0.0451) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (4.0101 => 4.5400, std.dev.: 0.0812) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.92% (1.0063 => 1.1061, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout/lists: 9.11% (7.0025 => 7.6405, std.dev.: 0.0382) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.10% (0.2857 => 0.3117, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Puzzle: 8.30% (0.1433 => 0.1552, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 5.50% (1.0194 => 1.0755, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.86% (4.2129 => 4.4175, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.70% (0.8498 => 0.8897, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.33% (40.4792 => 42.2339, std.dev.: 0.5438) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 4.05% (15.2242 => 15.8408, std.dev.: 0.0456) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5381, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.38% (0.5587 => 0.5776, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.33% (8.5113 => 8.7949, std.dev.: 0.0303) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8967, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.54% (2.6656 => 2.7332, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.6308 => 0.6467, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.42% (0.5876 => 0.6018, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 2.38% (3.5520 => 3.6365, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: 1.95% (2.4013 => 2.4481, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.7330 => 1.7578, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 1.25% (2.3453 => 2.3746, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.08% (5.2665 => 4.1563, std.dev.: 0.1473) SingleSource/Benchmarks/Shootout-C++/ary3: -20.00% (1.7473 => 1.3978, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.34% (1.1647 => 0.9627, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.49% (15.8312 => 13.2199, std.dev.: 0.1223) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.68% (3.2007 => 2.9229, std.dev.: 0.0369) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.6254 => 3.3792, std.dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: -6.67% (3.4230 => 3.1948, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3327, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.41% (2.0027 => 1.8743, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3525, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7918, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9453, std.dev.: 0.1569) SingleSource/Benchmarks/Shootout/fib2: -4.99% (4.4195 => 4.1989, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.27% (0.4564 => 0.4369, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.23% (7.6833 => 7.3585, std.dev.: 0.0231) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.09% (1.2722 => 1.2202, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.89% (45.4683 => 43.7017, std.dev.: 0.5315) SingleSource/Benchmarks/McGill/misr: -2.98% (0.4296 => 0.4168, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.89% (61.1734 => 59.4036, std.dev.: 0.4685) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/methcall: -2.84% (9.2503 => 8.9879, std.dev.: 0.0244) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.83% (2.4457 => 2.3764, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.61% (1.1683 => 1.1378, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.52% (3.7496 => 3.6550, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: -2.50% (9.5474 => 9.3087, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: -2.18% (8.5323 => 8.3466, std.dev.: 0.0455) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.02% (2.8964 => 2.8380, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: -1.91% (3.4876 => 3.4210, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -1.74% (3.4286 => 3.3690, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/neural/neural: -1.72% (1.0926 => 1.0738, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2331, std.dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3209, std.dev.: 0.0792) SingleSource/Benchmarks/Dhrystone/fldry: -1.13% (2.4971 => 2.4689, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.54% (0.9980 => 0.9926, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: -0.32% (0.6022 => 0.6003, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -0.96% (0.1666 => 0.1650, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1554 => 0.1569, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.65% (0.3083 => 0.3063, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.68% (0.2394 => 0.2258, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (0.3175 => 0.3162, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.48% (0.2302 => 0.2222, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: -13.33% (0.0090 => 0.0078, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.67% (0.0240 => 0.0236, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.34% (1.5019 => 1.4817, std.dev.: 0.0304) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.11% (0.4264 => 0.4046, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.74% (0.1344 => 0.1354, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.70% (0.0589 => 0.0526, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.60% (0.0232 => 0.0245, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.99% (0.0639 => 0.0556, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.77% (1.1350 => 1.1263, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 133.33% (0.0006 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0024 => 0.0003, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.09% (0.0637 => 0.0560, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.09% (0.0246 => 0.0140, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.77% (1.5363 => 1.5942, std.dev.: 0.0049) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 03:37:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 05:37:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920103710.A082C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4045?compare_to=4042&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4045, Order: 164296, Start Time: 2012-09-20 09:23:55, End Time: 2012-09-20 10:38:27 To: 4042, Order: 164285, Start Time: 2012-09-20 07:15:30, End Time: 2012-09-20 08:30:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.42% (2.0176 => 2.4094, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.63% (0.1072 => 0.1186) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.05% (0.1413 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.46% (3.9660 => 4.3410, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.16% (0.7710 => 0.8416, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7038 => 0.7679, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.05% (0.2596 => 0.2831, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.84% (1.3693 => 1.4904, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.80% (1.2193 => 1.3266, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5265 => 0.5725, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.70% (0.9199 => 0.9999, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.61% (0.6959 => 0.7558, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.60% (0.2721 => 0.2955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.5818 => 0.6318, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.59% (0.1327 => 0.1441, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0119) SingleSource/UnitTests/ObjC++/property-reference: 8.43% (0.7061 => 0.7656, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5748 => 0.6232, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.37% (1.4563 => 1.5782, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.28% (1.1364 => 1.2305, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 8.02% (13.8202 => 14.9282, std.dev.: 0.0160) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.3899 => 0.4203, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.77% (0.6283 => 0.6771, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.75% (0.2995 => 0.3227, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5577 => 0.6007, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 7.63% (0.4062 => 0.4372, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 7.62% (1.0313 => 1.1099, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3246 => 0.3490, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.45% (0.4791 => 0.5148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4379 => 0.4698, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.17% (0.5637 => 0.6041, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.15% (1.1061 => 1.1852, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 7.04% (0.8310 => 0.8895, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.01% (3.8646 => 4.1356, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.00% (0.2914 => 0.3118, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.95% (1.9828 => 2.1207, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3756 => 0.4017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.89% (7.2180 => 7.7150, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.80% (0.2690 => 0.2873, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.80% (0.7460 => 0.7967, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.78% (3.6692 => 3.9180, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.77% (0.7506 => 0.8014, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.58% (0.3220 => 0.3432, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 6.54% (2.1791 => 2.3216, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.35% (1.0594 => 1.1267, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 6.29% (3.1889 => 3.3896, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 6.26% (0.6744 => 0.7166, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.17% (1.9270 => 2.0459, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 6.13% (0.4113 => 0.4365, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.10% (16.6129 => 17.6265, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.08% (1.3245 => 1.4050, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.01% (0.8818 => 0.9348, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 5.97% (0.4003 => 0.4242, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.97% (1.2749 => 1.3510, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.93% (0.6576 => 0.6966, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3914 => 0.4143, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.83% (14.8535 => 15.7198, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.79% (0.8698 => 0.9202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.73% (1.3813 => 1.4605, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.66% (0.3940 => 0.4163, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.65% (0.3663 => 0.3870, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.64% (1.3819 => 1.4598, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.62% (8.4961 => 8.9733, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.53% (4.3801 => 4.6223, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.53% (0.6135 => 0.6474, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.47% (4.4433 => 4.6865, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (13.2842 => 14.0004, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: 5.33% (0.3131 => 0.3298, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.25% (0.3755 => 0.3952, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.12% (1.1333 => 1.1913, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2504 => 0.2632, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.01% (14.5298 => 15.2584, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 4.99% (6.5754 => 6.9032, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.90% (3.2742 => 3.4346, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.68% (4.6629 => 4.8811, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2292 => 1.2830, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (4.9865 => 5.2043, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (0.9108 => 0.9502, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.13% (0.6250 => 0.6508, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4805 => 0.5003, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.02% (1.5188 => 1.5799, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 3.84% (3.7467 => 3.8904, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4994, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (2.1007 => 2.1741, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.95% (33.2944 => 34.2767, std.dev.: 0.0285) MultiSource/Applications/sqlite3/sqlite3: 1.91% (16.2614 => 16.5727, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0558) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4162, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.2093 => 0.2212, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6970, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5452, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0928, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5979, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4449, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.94% (0.4657 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.39% (22.5627 => 21.7989, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2746, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1503, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7062, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9225, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5880, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.23% (26.5159 => 25.9247, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2416, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2302, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (4.1080 => 4.0629, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 03:42:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 05:42:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920104232.20951352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4046?compare_to=4041&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4046, Order: 164296, Start Time: 2012-09-20 09:24:00, End Time: 2012-09-20 10:43:55 To: 4041, Order: 164285, Start Time: 2012-09-20 06:53:48, End Time: 2012-09-20 08:16:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.98% (0.5330 => 0.5489, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.09% (1.2360 => 1.2225, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.22% (2.7517 => 2.7180, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5703 => 0.5698, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -0.14% (15.9339 => 15.9111, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: -0.11% (14.7364 => 14.7203, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: -0.05% (82.5436 => 82.5018, std.dev.: 0.0468) MultiSource/Benchmarks/MallocBench/gs/gs: -0.55% (4.3391 => 4.3154, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.23% (1.2220 => 1.2248, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.4075 => 7.4057, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.19% (3.6832 => 3.6762, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6364 => 0.6362, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0670 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.45% (63.2438 => 82.5018, std.dev.: 0.0468) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14246.39% (0.0720 => 10.3294, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.06% (10.3673 => 15.3495, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 27.13% (0.1622 => 0.2062, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.46% (2.2022 => 2.5207, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.26% (7.0540 => 8.0597, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.59% (1.7609 => 1.9650, std.dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 10.40% (10.4361 => 11.5212, std.dev.: 0.0111) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.3282 => 0.3585, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.14% (0.3543 => 0.3867, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.98% (0.3543 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.95% (0.3497 => 0.3810, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.93% (0.3516 => 0.3830, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3561 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.72% (0.3694 => 0.4016, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.68% (0.3927 => 0.4268, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3828 => 0.4157, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.41% (0.3886 => 0.4213, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 7.70% (9.4845 => 10.2146, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.67% (0.4879 => 0.5253, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 7.22% (0.1440 => 0.1544, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7433 => 0.7937, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.5860 => 0.6248, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.52% (0.7115 => 0.7579, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (0.6675 => 0.7110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.44% (0.3307 => 0.3520, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.44% (0.4615 => 0.4912, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.20% (5.7591 => 6.1164, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.19% (0.5105 => 0.5421, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.13% (0.2758 => 0.2927, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (4.2646 => 4.5230, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 6.02% (0.3423 => 0.3629, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.01% (1.5415 => 1.6341, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.99% (0.2271 => 0.2407, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.3050 => 1.3815, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 5.81% (3.3354 => 3.5293, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.75% (8.1363 => 8.6040, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.67% (0.8067 => 0.8524, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.8172 => 0.8629, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.3092 => 0.3264, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (5.0018 => 5.2794, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5569 => 0.5878, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.54% (4.9449 => 5.2187, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9765 => 1.0297, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.34% (0.7835 => 0.8253, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.29% (0.3441 => 0.3623, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.22% (1.1642 => 1.2250, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (7.9617 => 8.3729, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 5.12% (1.5603 => 1.6402, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/Hello: 5.05% (0.5925 => 0.6224, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 4.95% (0.4299 => 0.4512, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 4.94% (1.0722 => 1.1252, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.94% (3.8723 => 4.0636, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/09-vor/vor: 4.87% (0.3180 => 0.3335, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.84% (0.5020 => 0.5263, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 4.83% (0.6030 => 0.6321, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (1.1861 => 1.2426, std.dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 4.57% (21.9371 => 22.9391, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6450 => 0.6743, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 4.54% (0.6456 => 0.6749, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.53% (0.3422 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.4103 => 0.4286, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.40% (2.0273 => 2.1164, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8921 => 0.9308, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 4.33% (2.2969 => 2.3963, std.dev.: 0.0185) SingleSource/UnitTests/ObjC++/property-reference: 4.16% (0.7326 => 0.7631, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5981 => 0.6228, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.02% (1.5859 => 1.6497, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3865 => 0.4019, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.89% (0.4289 => 0.4456, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.86% (0.3935 => 0.4087, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4636 => 0.4808, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.70% (1.4186 => 1.4711, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.63% (0.4048 => 0.4195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.61% (0.3603 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.58% (2.2024 => 2.2813, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3162 => 0.3275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.57% (0.4620 => 0.4785, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.55% (14.3668 => 14.8762, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 3.50% (0.3283 => 0.3398, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (2.0665 => 2.1360, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.1840 => 1.2225, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.22% (0.8101 => 0.8281, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.04% (1.2842 => 1.3104, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.17% (17.1811 => 17.3822, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.8922 => 3.9326, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.84% (1.1145 => 1.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3524, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2282, std.dev.: 0.0243) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5838, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.53% (5.2763 => 3.2433, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.01% (5.3855 => 3.8772, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.61% (5.3526 => 3.8748, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1072, std.dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.81% (2.9384 => 2.5915, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: -8.59% (22.1758 => 20.2699, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2740, std.dev.: 0.0989) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5840, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5089, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std.dev.: 0.0300) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0064, std.dev.: 0.0125) SingleSource/Benchmarks/McGill/chomp: -2.04% (1.2373 => 1.2120, std.dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -1.88% (2.5528 => 2.5047, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (8.1563 => 8.0170, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5801, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0096) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (0.5229 => 0.5698, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 6.15% (14.9895 => 15.9111, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 3.99% (14.1553 => 14.7203, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (4.1105 => 4.3154, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.86% (1.1048 => 1.2248, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.46% (7.1582 => 7.4057, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.16% (3.4629 => 3.6762, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.6222 => 0.6362, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 04:47:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 06:47:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920114751.0326E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4047?compare_to=4044&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4047, Order: 164299, Start Time: 2012-09-20 10:38:33, End Time: 2012-09-20 11:49:18 To: 4044, Order: 164296, Start Time: 2012-09-20 09:11:50, End Time: 2012-09-20 10:22:15 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 17 (57 on baseline) Performance Improvements: 0 (35 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 883 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.64% (0.7430 => 0.7998, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.91% (0.4415 => 0.4720, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 5.79% (0.1883 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.33% (0.2928 => 0.3084, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.24% (0.2826 => 0.2974, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.13% (0.5715 => 0.5894, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1771 => 1.2031, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.07% (0.7300 => 0.7451, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.06% (3.8785 => 3.9584, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.79% (0.5644 => 0.5745, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (4.2538 => 4.3060, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.4178 => 1.4350, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (8.2163 => 8.3150, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.52% (0.3185 => 0.3520, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.27% (1.7910 => 1.8317, std.dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.06% (4.1563 => 4.2419, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/mandel-2: 1.76% (3.0848 => 3.1390, std.dev.: 0.0167) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.71% (0.9926 => 0.9996, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 0.12% (0.6003 => 0.6010, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 1.21% (0.1650 => 0.1670, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.32% (0.1569 => 0.1574, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (0.3063 => 0.3098, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.2258 => 0.2361, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.13% (0.3162 => 0.3158, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.68% (0.2222 => 0.2237, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 193.33% (0.0030 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 16.67% (0.0078 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.97% (0.0236 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0387 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.07% (0.0299 => 0.0233, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0282 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0323 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0190 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0247 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 0.31% (0.0326 => 0.0327, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.63% (1.4817 => 1.5059, std.dev.: 0.0108) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.40% (0.1496 => 0.1517, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.89% (0.4046 => 0.4082, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.77% (0.1354 => 0.1378, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.76% (0.0526 => 0.0651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.76% (0.0245 => 0.0226, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.34% (0.0556 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1263 => 1.1270, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0003 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.93% (0.0560 => 0.0538, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 88.57% (0.0140 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7655 => 0.7650, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.28% (1.5942 => 1.5986, std.dev.: 0.0067) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -33.33% (0.0003 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.45% (0.0121 => 0.0066, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.85% (4.1772 => 3.1390, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/except: 81133.33% (0.0006 => 0.4874, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.04% (0.1414 => 0.1556, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.61% (0.6410 => 0.6834, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 6.24% (2.1763 => 2.3121, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++/bigfib: 5.54% (0.5309 => 0.5603, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.75% (0.3582 => 0.3752, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.6915 => 0.7224, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 4.42% (0.6173 => 0.6446, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.2552 => 0.2657, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (1.1653 => 1.2130, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.23% (0.3901 => 0.4027, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.11% (0.7226 => 0.7451, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 3.10% (15.3105 => 15.7848, std.dev.: 0.0361) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1672 => 1.2031, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 2.80% (29.3170 => 30.1365, std.dev.: 0.0240) MultiSource/Applications/Burg/burg: 2.75% (1.1440 => 1.1755, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7784 => 0.7998, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.70% (0.4596 => 0.4720, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5740 => 0.5894, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 2.64% (1.3268 => 1.3618, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.32% (0.5937 => 0.6075, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (3.8796 => 3.9584, std.dev.: 0.0171) MultiSource/Applications/d/make_dparser: 1.96% (3.0225 => 3.0818, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.93% (0.5636 => 0.5745, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 1.85% (2.0972 => 2.1361, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.72% (1.2021 => 1.2228, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 1.48% (3.5980 => 3.6513, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (8.2186 => 8.3302, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.13% (1.4189 => 1.4350, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.04% (4.2616 => 4.3060, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.15% (0.0766 => 0.0951, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 15.93% (1.7426 => 2.0202, std.dev.: 0.0105) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.72% (0.0917 => 0.1052, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.43% (4.0101 => 4.5487, std.dev.: 0.0594) SingleSource/Benchmarks/Stanford/Puzzle: 12.35% (0.1433 => 0.1610, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6154, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (0.3301 => 0.3520, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.39% (0.8498 => 0.8871, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8333, std.dev.: 0.0470) SingleSource/Benchmarks/Misc/dt: 4.00% (0.9851 => 1.0245, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 3.94% (8.5113 => 8.8470, std.dev.: 0.0250) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.75% (3.4080 => 3.5357, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 2.84% (3.8907 => 4.0012, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: 2.84% (0.5004 => 0.5146, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8950, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.33% (3.5520 => 3.6349, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 2.03% (2.3453 => 2.3928, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4455 => 2.4768, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.07% (2.9152 => 2.9463, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.49% (0.3497 => 0.2046, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: -19.48% (1.7473 => 1.4070, std.dev.: 0.0594) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.46% (5.2665 => 4.2419, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.40% (1.1647 => 0.9620, std.dev.: 0.0311) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.62% (15.8312 => 13.3577, std.dev.: 0.0766) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0327) MultiSource/Applications/sgefa/sgefa: -11.08% (0.3746 => 0.3331, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (1.4034 => 1.2852, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.75% (3.2007 => 2.9528, std.dev.: 0.0255) MultiSource/Applications/SIBsim4/SIBsim4: -6.90% (3.4230 => 3.1869, std.dev.: 0.0591) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3774, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3314, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7921, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3568, std.dev.: 0.0278) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9268, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1896, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.19% (7.6833 => 7.3617, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.98% (1.2722 => 1.2216, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (9.2503 => 8.9489, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8284, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6464, std.dev.: 0.0208) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.25% (1.8739 => 1.8317, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.25% (1.1683 => 1.1420, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -1.98% (1.0926 => 1.0710, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4195, std.dev.: 0.0102) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3141, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2359, std.dev.: 0.0254) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3121, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/lists: -1.26% (16.5617 => 16.3530, std.dev.: 0.0240) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.16% (0.9980 => 0.9996, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -0.20% (0.6022 => 0.6010, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 0.24% (0.1666 => 0.1670, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.29% (0.1554 => 0.1574, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.49% (0.3083 => 0.3098, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.38% (0.2394 => 0.2361, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3175 => 0.3158, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.82% (0.2302 => 0.2237, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.59% (0.0301 => 0.0233, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.27% (1.5019 => 1.5059, std.dev.: 0.0108) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.07% (0.1501 => 0.1517, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.27% (0.4264 => 0.4082, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.53% (0.1344 => 0.1378, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.53% (0.0589 => 0.0651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.59% (0.0232 => 0.0226, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.95% (0.0639 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.54% (0.0637 => 0.0538, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.0246 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.06% (1.5363 => 1.5986, std.dev.: 0.0067) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -5.71% (0.0070 => 0.0066, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 05:20:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 07:20:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920122006.B8E062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4048?compare_to=4045&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4048, Order: 164299, Start Time: 2012-09-20 11:07:03, End Time: 2012-09-20 12:21:32 To: 4045, Order: 164296, Start Time: 2012-09-20 09:23:55, End Time: 2012-09-20 10:38:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.30% (54.3110 => 56.6458, std.dev.: 0.0705) MultiSource/Benchmarks/llubenchmark/llu: 1.51% (3.7976 => 3.8548, std.dev.: 0.0222) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.60% (2.0176 => 2.4130, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.96% (0.1410 => 0.1621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.92% (0.0826 => 0.0941, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.26% (3.9660 => 4.3331, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 9.07% (0.7038 => 0.7676, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 8.98% (1.3693 => 1.4923, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.74% (0.2596 => 0.2823, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.7710 => 0.8372, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.53% (0.9199 => 0.9984, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.52% (0.1327 => 0.1440, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.42% (1.2193 => 1.3220, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.41% (0.5265 => 0.5708, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.27% (0.5818 => 0.6299, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.23% (0.6959 => 0.7532, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.06% (1.1364 => 1.2280, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5748 => 0.6211, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.99% (13.8202 => 14.9245, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7061 => 0.7625, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.88% (1.4563 => 1.5710, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.3899 => 0.4203, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.72% (0.6283 => 0.6768, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.48% (0.5577 => 0.5994, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 7.44% (1.0313 => 1.1080, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.33% (0.4791 => 0.5142, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3246 => 0.3482, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3489 => 0.3742, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.18% (0.3580 => 0.3837, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.18% (0.4390 => 0.4705, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.10% (1.9828 => 2.1235, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.08% (0.4379 => 0.4689, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3756 => 0.4020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.94% (1.1061 => 1.1829, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.2937 => 0.3140, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.90% (0.3868 => 0.4135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.88% (3.8646 => 4.1303, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5637 => 0.6024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.2914 => 0.3112, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.75% (0.8310 => 0.8871, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3453 => 0.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (7.2180 => 7.7011, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.61% (3.6692 => 3.9119, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 6.57% (0.7506 => 0.7999, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.50% (0.7460 => 0.7945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.42% (0.3534 => 0.3761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.39% (0.2925 => 0.3112, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2243 => 0.2386, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3220 => 0.3425, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.32% (2.1791 => 2.3169, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.14% (1.0594 => 1.1244, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.12% (3.1889 => 3.3842, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.03% (0.6744 => 0.7151, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.98% (1.9270 => 2.0423, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (1.3245 => 1.4033, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.95% (0.6576 => 0.6967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.95% (0.4003 => 0.4241, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.90% (16.6129 => 17.5936, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 5.88% (0.3914 => 0.4144, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.84% (0.3578 => 0.3787, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 5.79% (0.3940 => 0.4168, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.76% (0.8698 => 0.9199, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (1.2749 => 1.3483, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.75% (14.8535 => 15.7072, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 5.70% (0.3646 => 0.3854, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.70% (0.3789 => 0.4005, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.66% (0.8818 => 0.9317, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.61% (0.3601 => 0.3803, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.3813 => 1.4583, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.55% (0.3623 => 0.3824, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.3819 => 1.4585, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 5.43% (0.3131 => 0.3301, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.42% (4.3801 => 4.6177, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.40% (0.6135 => 0.6466, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.39% (8.4961 => 8.9542, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.33% (4.4433 => 4.6800, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (13.2842 => 13.9794, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1333 => 1.1900, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.85% (14.5298 => 15.2343, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.83% (3.2742 => 3.4325, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 4.77% (4.6629 => 4.8855, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (6.5754 => 6.8886, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2292 => 1.2839, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.31% (4.9865 => 5.2013, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.26% (0.9108 => 0.9496, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.99% (1.5188 => 1.5794, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.85% (0.4805 => 0.4990, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 3.69% (3.7467 => 3.8849, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (6.2785 => 6.4905, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (2.1007 => 2.1713, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.09% (33.2944 => 34.3239, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.74% (16.2614 => 16.5436, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 23.71% (1.8175 => 2.2484, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (3.1736 => 3.4182, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1027, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5934, std.dev.: 0.0145) MultiSource/Benchmarks/llubenchmark/llu: 2.17% (3.7731 => 3.8548, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.17% (1.4298 => 1.4465, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6860, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.94% (0.4657 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.41% (22.5627 => 21.7944, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2797, std.dev.: 0.0363) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1501, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.38% (3.0263 => 2.9239, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5998, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836) MultiSource/Applications/lua/lua: -2.29% (26.5159 => 25.9085, std.dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2276, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0608, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4964, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.08% (6.6320 => 6.5606, std.dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 05:30:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 07:30:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920123035.107732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4049?compare_to=4046&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4049, Order: 164299, Start Time: 2012-09-20 11:12:31, End Time: 2012-09-20 12:32:01 To: 4046, Order: 164296, Start Time: 2012-09-20 09:24:00, End Time: 2012-09-20 10:43:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (132 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.09% (1.9650 => 1.9864, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.06% (3.8222 => 3.7817, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5698 => 0.5699, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.04% (15.9111 => 15.9050, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: -0.03% (14.7203 => 14.7156, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 0.07% (82.5018 => 82.5594, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.3154 => 4.3118, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.24% (1.2248 => 1.2218, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.4057 => 7.4130, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (3.6762 => 3.6784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6362 => 0.6366, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.54% (63.2438 => 82.5594, std.dev.: 0.0127) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.83% (0.0720 => 10.3290, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.29% (10.3673 => 15.3734, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/richards_benchmark: 26.88% (0.1622 => 0.2058, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.67% (2.2022 => 2.5253, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.53% (7.0540 => 8.0791, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 14.04% (0.1432 => 0.1633, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.81% (1.7609 => 1.9864, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.67% (1.1194 => 1.2612, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.41% (10.4361 => 11.5228, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.30% (0.3473 => 0.3796, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.29% (0.3543 => 0.3872, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3543 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.02% (0.3516 => 0.3833, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.01% (0.3497 => 0.3812, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3561 => 0.3879, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.3927 => 0.4276, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 8.88% (0.3828 => 0.4168, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.80% (0.3694 => 0.4019, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.57% (0.3886 => 0.4219, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.71% (0.4879 => 0.5255, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.52% (9.4845 => 10.1982, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.00% (0.7433 => 0.7953, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.44% (0.3307 => 0.3520, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.44% (0.7115 => 0.7573, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.43% (0.6675 => 0.7104, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2554 => 0.2718, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 6.40% (0.3109 => 0.3308, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.37% (0.4615 => 0.4909, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2271 => 0.2412, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.16% (5.7591 => 6.1141, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.07% (0.5105 => 0.5415, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.05% (0.3423 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.5860 => 0.6214, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.03% (4.2646 => 4.5219, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.95% (1.5415 => 1.6332, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.3050 => 1.3818, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.85% (8.1363 => 8.6126, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 5.83% (3.3354 => 3.5297, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.8067 => 0.8523, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.9449 => 5.2230, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (5.0018 => 5.2823, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.58% (0.8172 => 0.8628, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.3092 => 0.3263, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1940 => 0.2047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.42% (0.5569 => 0.5871, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.37% (0.2758 => 0.2906) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9765 => 1.0285, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.20% (1.1642 => 1.2247, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.12% (7.9617 => 8.3695, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 5.12% (1.5603 => 1.6402, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5925 => 0.6225, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.05% (1.0722 => 1.1263, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.00% (0.3180 => 0.3339, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.98% (3.8723 => 4.0651, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.97% (0.3441 => 0.3612, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 4.95% (0.4299 => 0.4512, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 4.89% (0.6030 => 0.6325, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.2603 => 0.2730, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.82% (0.5020 => 0.5262, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.1861 => 1.2430, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.66% (21.9371 => 22.9602, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.48% (0.4103 => 0.4287, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.45% (0.6456 => 0.6743, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.38% (2.0273 => 2.1161, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.36% (0.4636 => 0.4838, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.34% (0.6450 => 0.6730, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.30% (0.8921 => 0.9305, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.28% (2.2969 => 2.3951, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 4.22% (0.7326 => 0.7635, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.4064 => 0.4235, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.06% (0.5981 => 0.6224, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.00% (0.4203 => 0.4371, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.4289 => 0.4458, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.93% (1.5859 => 1.6483, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3935 => 0.4084, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3162 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.72% (1.4186 => 1.4714, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.4620 => 0.4787, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.55% (0.3603 => 0.3731, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (14.3668 => 14.8719, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (2.2024 => 2.2788, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.1840 => 1.2239, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (2.0665 => 2.1359, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.31% (0.3379 => 0.3491, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.18% (0.3684 => 0.3801, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.8101 => 0.8276, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.03% (1.2842 => 1.3103, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.24% (17.1811 => 17.3934, std.dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (3.8922 => 3.9385, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3830, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7453, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (4.2280 => 4.3492, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7890, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2246, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2605, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.69% (5.3855 => 3.8943, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.34% (5.3526 => 3.8891, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1703, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.34% (2.9384 => 2.6052, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.50% (22.1758 => 20.2911, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2756, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5057, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4199, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.38% (1.2373 => 1.2078, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9920, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (0.5229 => 0.5699, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.11% (14.9895 => 15.9050, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: 3.96% (14.1553 => 14.7156, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 4.90% (4.1105 => 4.3118, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.59% (1.1048 => 1.2218, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.56% (7.1582 => 7.4130, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.22% (3.4629 => 3.6784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (0.6222 => 0.6366, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 06:13:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 08:13:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920131325.C894B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4050?compare_to=4047&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4050, Order: 164300, Start Time: 2012-09-20 12:04:41, End Time: 2012-09-20 13:14:52 To: 4047, Order: 164299, Start Time: 2012-09-20 10:38:33, End Time: 2012-09-20 11:49:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 1 (56 on baseline) Performance Improvements: 11 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 888 (796 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.34% (1.8317 => 1.8562, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.78% (0.4720 => 0.4589, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.36% (0.5894 => 0.5755, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.24% (0.7998 => 0.7819, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.07% (0.9147 => 0.8958, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.95% (0.7451 => 0.7306, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.76% (0.6075 => 0.5968, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -1.37% (3.9584 => 3.9041, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.23% (1.2031 => 1.1883, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.04% (4.3064 => 4.2616, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.01% (4.3709 => 4.3268, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.03% (22.7879 => 22.3255, std.dev.: 0.0283) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.58% (0.9996 => 0.9938, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 0.42% (0.6010 => 0.6035, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 0.54% (0.1670 => 0.1679, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1574 => 0.1575, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (0.3098 => 0.3103, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2361 => 0.2351, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.76% (0.3158 => 0.3134, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.39% (0.2237 => 0.2268, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 0.44% (0.0454 => 0.0456, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.10% (0.0091 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0243 => 0.0242, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0190 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0385 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.90% (0.0233 => 0.0298, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.38% (0.0321 => 0.0262, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0178 => 0.0178, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -0.52% (0.0191 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.64% (0.0247 => 0.0256, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -5.81% (0.0327 => 0.0308, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1430 => 0.1427, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.14% (1.5059 => 1.4888, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.09% (0.1517 => 0.1455, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.29% (0.4082 => 0.4070, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.69% (0.1378 => 0.1341, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.69% (0.0651 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.62% (0.0226 => 0.0202, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.70% (0.0569 => 0.0573, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.08% (0.0048 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1270 => 1.1252, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -66.67% (0.0015 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0021 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.65% (0.0538 => 0.0563, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0264 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7650 => 0.7670, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.06% (1.5986 => 1.5996, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -50.00% (0.0002 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.73% (0.0066 => 0.0114, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.64% (4.1772 => 3.1062, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.65% (0.5309 => 0.5662, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (2.1763 => 2.3196, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.30% (0.6410 => 0.6814, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.25% (0.3582 => 0.3770, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.58% (0.2552 => 0.2669, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.32% (1.0046 => 1.0480, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 4.02% (0.6173 => 0.6421, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 3.96% (1.1653 => 1.2114, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 3.85% (0.6915 => 0.7181, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 3.56% (15.3105 => 15.8561, std.dev.: 0.0924) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.38% (0.6069 => 0.6274, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 3.14% (0.3217 => 0.3318, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5150 => 1.5618, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 3.00% (29.3170 => 30.1955, std.dev.: 0.2690) MultiSource/Applications/Burg/burg: 2.61% (1.1440 => 1.1739, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 2.32% (3.0225 => 3.0926, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 2.16% (1.3268 => 1.3554, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (0.7722 => 0.7874, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 1.93% (2.0972 => 2.1377, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.81% (1.1672 => 1.1883, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.72% (13.3238 => 13.5529, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (12.6413 => 12.8479, std.dev.: 0.0510) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.48% (6.2546 => 6.3471, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.38% (1.1827 => 1.1990, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.27% (0.8569 => 0.8678, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.26% (0.8405 => 0.8511, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.23% (4.7455 => 4.8038, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.53% (0.0263 => 0.0388, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.32% (0.0766 => 0.0914, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.43% (4.0101 => 4.5486, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 8.43% (7.0025 => 7.5929, std.dev.: 0.0211) SingleSource/Benchmarks/Stanford/Puzzle: 7.96% (0.1433 => 0.1547, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.22% (1.0063 => 1.0790, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.97% (4.2129 => 4.4224, std.dev.: 0.0370) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.52% (40.4792 => 42.3075, std.dev.: 0.3642) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: 3.87% (0.9851 => 1.0232, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: 3.76% (15.2242 => 15.7972, std.dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.93% (0.5876 => 0.6048, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8987, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 2.66% (3.8907 => 3.9942, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 2.52% (3.5520 => 3.6415, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.26% (2.6656 => 2.7258, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/mason/mason: 2.06% (0.5004 => 0.5107, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (2.4013 => 2.4434, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4455 => 2.4785, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.84% (0.7738 => 0.7596, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.98% (5.2665 => 4.1087, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/ary3: -20.62% (1.7473 => 1.3870, std.dev.: 0.0282) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.1647 => 0.9609, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.57% (15.8312 => 13.2079, std.dev.: 0.1869) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0219) MultiSource/Applications/sgefa/sgefa: -10.70% (0.3746 => 0.3345, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.81% (1.4034 => 1.2797, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9384, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3730, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3305, std.dev.: 0.0272) MultiSource/Applications/SIBsim4/SIBsim4: -6.53% (3.4230 => 3.1996, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -6.14% (1.4441 => 1.3555, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -5.45% (62.4126 => 59.0134, std.dev.: 0.1729) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1851, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.22% (7.6833 => 7.3590, std.dev.: 0.0218) MultiSource/Applications/SPASS/SPASS: -3.98% (8.5323 => 8.1925, std.dev.: 0.0842) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (9.2503 => 8.9015, std.dev.: 0.0480) SingleSource/Benchmarks/McGill/misr: -3.75% (0.4296 => 0.4135, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.45% (0.4140 => 0.3997, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.07% (1.2722 => 1.2331, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6472, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.44% (1.1683 => 1.1398, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -2.23% (92.7467 => 90.6772, std.dev.: 0.4920) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4205, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.3569 => 2.3189, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.47% (61.1734 => 60.2760, std.dev.: 0.0482) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std.dev.: 0.0674) MultiSource/Benchmarks/llubenchmark/llu: -1.10% (2.0192 => 1.9970, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.42% (0.9980 => 0.9938, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.6022 => 0.6035, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 0.78% (0.1666 => 0.1679, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.35% (0.1554 => 0.1575, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.65% (0.3083 => 0.3103, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.80% (0.2394 => 0.2351, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (0.3175 => 0.3134, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (0.2302 => 0.2268, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.14% (0.0324 => 0.0262, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.81% (0.0249 => 0.0256, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -5.23% (0.0325 => 0.0308, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1429 => 0.1427, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -0.87% (1.5019 => 1.4888, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.06% (0.1501 => 0.1455, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.55% (0.4264 => 0.4070, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.22% (0.1344 => 0.1341, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.66% (0.0589 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0232 => 0.0202, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.33% (0.0639 => 0.0573, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.86% (1.1350 => 1.1252, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.62% (0.0637 => 0.0563, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.0246 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.71% (0.7541 => 0.7670, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.12% (1.5363 => 1.5996, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.86% (0.0070 => 0.0114, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 06:21:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 08:21:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920132127.AAD732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4051?compare_to=4043&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4051, Order: 164298, Start Time: 2012-09-20 10:39:08, End Time: 2012-09-20 13:22:54 To: 4043, Order: 164285, Start Time: 2012-09-20 07:26:34, End Time: 2012-09-20 10:10:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (767 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/fibo: 1.17% (12.1870 => 12.3291, std.dev.: 0.0195) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.43% (0.3446 => 0.3771, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.40% (1.5932 => 1.7430, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3465 => 0.3790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.37% (0.3469 => 0.3794, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.30% (0.3496 => 0.3821, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3488 => 0.3811, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3442 => 0.3760, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3460 => 0.3779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3643 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.01% (0.3650 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.81% (0.3724 => 0.4052, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (1.6211 => 1.7280, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.49% (0.4994 => 0.5318, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.25% (1.3152 => 1.3974, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.21% (5.5417 => 5.8859, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.81% (0.2738 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (3.5627 => 3.7692, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 5.69% (0.2566 => 0.2712, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 5.62% (0.6634 => 0.7007, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 5.61% (1.0781 => 1.1386, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.59% (0.5026 => 0.5307, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.56% (0.2014 => 0.2126, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.3004 => 0.3171, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.50% (0.3930 => 0.4146, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (2.7292 => 2.8787, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.44% (0.2040 => 0.2151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.41% (0.5826 => 0.6141, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.5889 => 0.6205, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.35% (4.2109 => 4.4361, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/strcat: 5.31% (0.2750 => 0.2896, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3625 => 0.3816, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.2736 => 0.2880, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2875 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (4.4195 => 4.6514, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 5.23% (4.6177 => 4.8593, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.22% (0.3890 => 0.4093, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.3084 => 0.3244, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.17% (2.1013 => 2.2099, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3195 => 0.3360, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.2075 => 0.2182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 5.15% (23.5202 => 24.7318, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3267 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.06% (0.3258 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2725 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (2.1653 => 2.2743, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2823 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.00% (0.2780 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (1.8794 => 1.9733, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.98% (0.2911 => 0.3056, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 4.98% (0.2813 => 0.2953, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.98% (0.9909 => 1.0402, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.97% (0.3060 => 0.3212, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.94% (0.2811 => 0.2950, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.94% (0.5546 => 0.5820, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3726 => 0.3910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.94% (0.2714 => 0.2848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.91% (2.0673 => 2.1689, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 4.91% (0.4029 => 0.4227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.91% (0.2729 => 0.2863, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.89% (0.3903 => 0.4094, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.89% (2.0346 => 2.1340, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3362 => 0.3524, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 4.81% (1.4269 => 1.4956, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 4.81% (0.3096 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2803 => 0.2937, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.77% (0.3336 => 0.3495, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3317 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4146 => 0.4343, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.3348 => 0.3506, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.71% (0.4139 => 0.4334, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.71% (0.3124 => 0.3271, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3678 => 0.3850, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.66% (0.3477 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.63% (0.6435 => 0.6733, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 4.59% (0.9697 => 1.0142, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 4.59% (0.4251 => 0.4446, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 4.43% (0.2391 => 0.2497, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.5900 => 0.6160, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (0.4658 => 0.4863, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.3981 => 0.4156, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3690 => 0.3852, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 4.37% (0.4847 => 0.5059, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.5012 => 0.5227, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.28% (0.7171 => 0.7478, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.3271 => 0.3411, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.27% (0.2737 => 0.2854, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.26% (0.7426 => 0.7742, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.24% (0.7875 => 0.8209, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.18% (1.9966 => 2.0801, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (1.9694 => 2.0504, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (0.5584 => 0.5805, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3.86% (0.2691 => 0.2795, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.3845 => 0.3992, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.2969 => 0.3080, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (11.6398 => 12.0393, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.3498 => 0.3615, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.16% (4.6926 => 4.8410, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 1.12% (11.9555 => 12.0892, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6702, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6248, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2039, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5053, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4337, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2206, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5921, std.dev.: 0.0236) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5681, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7918, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -3.00% (17.2379 => 16.7201, std.dev.: 0.0852) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.47% (16.2163 => 15.9780, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 09:34:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 11:34:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920163407.8ADFF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4058?compare_to=4051&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4058, Order: 164301, Start Time: 2012-09-20 13:51:27, End Time: 2012-09-20 16:35:28 To: 4051, Order: 164298, Start Time: 2012-09-20 10:39:08, End Time: 2012-09-20 13:22:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.66% (125.0977 => 128.4312, std.dev.: 0.7703) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 9.85% (1.5932 => 1.7502, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-2: 9.46% (0.3446 => 0.3772, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3488 => 0.3817, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.41% (0.3442 => 0.3766, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.37% (0.3469 => 0.3794, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.32% (0.3465 => 0.3788, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.31% (0.3460 => 0.3782, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.30% (0.3496 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.10% (0.3650 => 0.3982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3643 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.83% (0.3724 => 0.4053, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.49% (0.4994 => 0.5318, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.42% (1.3152 => 1.3997, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.42% (0.4361 => 0.4641, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.40% (1.6211 => 1.7248, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.16% (5.5417 => 5.8833, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 5.97% (0.6634 => 0.7030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (3.5627 => 3.7705, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 5.77% (1.0781 => 1.1403, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (0.5000 => 0.5288, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (2.7292 => 2.8860, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2738 => 0.2893, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (0.5026 => 0.5309, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 5.58% (0.5826 => 0.6151, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3195 => 0.3373, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 5.57% (23.5202 => 24.8294, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2875 => 0.3035, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.3004 => 0.3171, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (0.3930 => 0.4148, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.51% (0.2014 => 0.2125, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.48% (4.2109 => 4.4417, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 5.48% (2.1013 => 2.2164, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/strcat: 5.45% (0.2750 => 0.2900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.43% (0.5889 => 0.6209, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.38% (4.6177 => 4.8663, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3258 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.34% (0.2792 => 0.2941, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 5.30% (0.2813 => 0.2962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3267 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2911 => 0.3065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.28% (0.2823 => 0.2972, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.27% (0.2714 => 0.2857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.25% (0.2040 => 0.2147, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (2.0673 => 2.1757, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2780 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2811 => 0.2957, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.19% (0.9909 => 1.0423, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 5.17% (1.8794 => 1.9766, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3726 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (2.1653 => 2.2766, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.14% (0.2803 => 0.2947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3060 => 0.3217, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.13% (4.4195 => 4.6460, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (0.3890 => 0.4088, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 5.09% (0.4146 => 0.4357, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.3625 => 0.3809, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.3096 => 0.3253, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.3903 => 0.4100, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3124 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.99% (0.3084 => 0.3238, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.94% (0.3317 => 0.3481, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.93% (0.4139 => 0.4343, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3678 => 0.3858, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.88% (1.4269 => 1.4966, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.87% (0.3348 => 0.3511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.86% (0.3477 => 0.3646, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.81% (0.9697 => 1.0163, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 4.80% (0.3336 => 0.3496, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.79% (0.6435 => 0.6743, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.76% (2.0346 => 2.1315, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.75% (0.4251 => 0.4453, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3690 => 0.3865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.67% (0.3981 => 0.4167, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.63% (0.5546 => 0.5803, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.63% (0.3282 => 0.3434, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.62% (0.4029 => 0.4215, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (0.4658 => 0.4873, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.52% (0.3271 => 0.3419, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.49% (0.5012 => 0.5237, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.42% (0.2737 => 0.2858, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.5900 => 0.6160, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.39% (0.7875 => 0.8221, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.36% (1.9694 => 2.0553, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.27% (0.7426 => 0.7743, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.27% (0.2391 => 0.2493, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.25% (0.7171 => 0.7476, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 4.25% (0.4847 => 0.5053, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (1.9966 => 2.0784, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.07% (0.5361 => 0.5579, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.3845 => 0.4001, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (0.5584 => 0.5807, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (0.2691 => 0.2791, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.51% (11.6398 => 12.0484, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 3.46% (0.3498 => 0.3619, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.6926 => 4.8467, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 1.28% (11.9555 => 12.1089, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.2122 => 0.2292, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6778, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8948, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.0491) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6315, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2103, std.dev.: 0.0495) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5045, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4564, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2865, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5854, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4467, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5741, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7909, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -5.41% (0.2402 => 0.2272, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8044, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8249, std.dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9640, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 09:06:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 11:06:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920160634.85ED22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4056?compare_to=4054&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4056, Order: 164304, Start Time: 2012-09-20 14:56:51, End Time: 2012-09-20 16:08:02 To: 4054, Order: 164301, Start Time: 2012-09-20 13:30:28, End Time: 2012-09-20 14:41:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (45 on baseline) Performance Improvements: 5 (42 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 891 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 15.33% (0.7721 => 0.8905, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout/heapsort: 14.87% (3.1337 => 3.5996, std.dev.: 0.1049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.58% (0.7576 => 0.7999, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (4.3128 => 4.4452, std.dev.: 0.0388) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.46% (0.5805 => 0.5662, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.38% (0.6003 => 0.5860, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: -1.18% (1.3614 => 1.3454, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.18% (2.9337 => 2.8404, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: -1.17% (8.8569 => 8.7532, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.96% (1.0002 => 0.9906, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -0.33% (0.6025 => 0.6005, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -4.31% (0.1669 => 0.1597, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.53% (0.1565 => 0.1541, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (0.3077 => 0.3081, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2384 => 0.2374, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (0.3175 => 0.3136, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.48% (0.2305 => 0.2294, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -1.31% (0.0457 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0239 => 0.0243, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.73% (0.0193 => 0.0153, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0388 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.67% (0.0300 => 0.0271, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.84% (0.0283 => 0.0241, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0323 => 0.0322, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: -1.11% (0.0180 => 0.0178, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -10.12% (0.0168 => 0.0151, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -3.54% (0.0254 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 9.72% (0.0288 => 0.0316, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1424 => 0.1420, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -4.19% (1.5327 => 1.4685, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.62% (0.1494 => 0.1410, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.81% (0.4056 => 0.4089, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.1413 => 0.1351, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.30% (0.0566 => 0.0596, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.63% (0.0259 => 0.0247, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.58% (0.0567 => 0.0627, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1296 => 1.1285, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -58.33% (0.0024 => 0.0010, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.41% (0.0535 => 0.0580, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (0.0225 => 0.0155, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7668 => 0.7663, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -0.47% (1.6011 => 1.5935, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.23% (4.1772 => 3.1233, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/except: 82116.67% (0.0006 => 0.4933, std.dev.: 0.0017) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.51% (0.0745 => 0.0868, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.18% (0.6410 => 0.6806, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 5.68% (2.1763 => 2.2999, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/bigfib: 5.59% (0.5309 => 0.5606, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.62% (0.2552 => 0.2670, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.22% (0.3582 => 0.3733, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2073, std.dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: 3.25% (0.6915 => 0.7140, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.21% (1.5150 => 1.5636, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.54% (3.0225 => 3.0689, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.51% (0.7226 => 0.7335, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.46% (1.1827 => 1.2000, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 1.40% (1.3268 => 1.3454, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 1.13% (13.3238 => 13.4745, std.dev.: 0.0521) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.22% (3.4629 => 4.2325, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std.dev.: 0.0545) SingleSource/Benchmarks/Stanford/Puzzle: 13.75% (0.1433 => 0.1630, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5475, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout/heapsort: 11.93% (3.2159 => 3.5996, std.dev.: 0.1049) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8069, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 8.56% (7.0025 => 7.6019, std.dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.10% (1.0063 => 1.0777, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.51% (4.2129 => 4.4452, std.dev.: 0.0388) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.13% (0.7609 => 0.7999, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8321, std.dev.: 0.0430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (40.4792 => 42.0246, std.dev.: 0.4322) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.51% (3.4080 => 3.5277, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5113 => 8.7532, std.dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8967, std.dev.: 0.0507) MultiSource/Benchmarks/sim/sim: 2.73% (3.8907 => 3.9968, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 2.37% (3.5520 => 3.6363, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.13% (0.5876 => 0.6001, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.93% (2.4013 => 2.4477, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.41% (4.6127 => 4.6778, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.33% (1.6110 => 1.6325, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.0194 => 1.0303, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.02% (27.1724 => 27.4501, std.dev.: 0.0266) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.54% (0.7738 => 0.7464, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.22% (4.3380 => 4.2852, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.15% (0.3497 => 0.2093, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.56% (5.2665 => 4.1309, std.dev.: 0.2218) SingleSource/Benchmarks/Shootout-C++/ary3: -18.55% (1.7473 => 1.4232, std.dev.: 0.0792) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.76% (1.1647 => 0.9579, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.10% (15.8312 => 13.1235, std.dev.: 0.1708) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.96% (0.0917 => 0.0789, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.34% (3.2007 => 2.9337, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0243) MultiSource/Applications/SIBsim4/SIBsim4: -6.74% (3.4230 => 3.1922, std.dev.: 0.0404) SingleSource/Benchmarks/Shootout-C++/fibo: -6.61% (4.6355 => 4.3293, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -6.33% (1.4441 => 1.3527, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9526, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1873, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.86% (0.4140 => 0.3939, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.32% (0.4564 => 0.4367, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -4.26% (7.6833 => 7.3558, std.dev.: 0.0663) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.73% (1.2722 => 1.2248, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (9.2503 => 8.9136, std.dev.: 0.0593) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.30% (3.7496 => 3.6257, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.28% (45.4683 => 43.9768, std.dev.: 0.4990) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.16% (61.1734 => 59.2393, std.dev.: 0.4639) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.04% (1.4021 => 1.3595, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.84% (1.1683 => 1.1351, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8293, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std.dev.: 0.0158) MultiSource/Benchmarks/PAQ8p/paq8p: -2.44% (92.7467 => 90.4821, std.dev.: 0.4543) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4177, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.93% (2.8964 => 2.8404, std.dev.: 0.0080) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3628, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3118, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2274, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3082, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4629, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.74% (0.9980 => 0.9906, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.6022 => 0.6005, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -4.14% (0.1666 => 0.1597, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.84% (0.1554 => 0.1541, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (0.3083 => 0.3081, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.84% (0.2394 => 0.2374, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (0.3175 => 0.3136, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.35% (0.2302 => 0.2294, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.31% (0.0192 => 0.0153, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.97% (0.0301 => 0.0271, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.14% (0.0284 => 0.0241, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -20.11% (0.0189 => 0.0151, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -2.77% (0.0325 => 0.0316, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1429 => 0.1420, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -2.22% (1.5019 => 1.4685, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -6.06% (0.1501 => 0.1410, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.10% (0.4264 => 0.4089, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.52% (0.1344 => 0.1351, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.19% (0.0589 => 0.0596, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.47% (0.0232 => 0.0247, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.88% (0.0639 => 0.0627, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1350 => 1.1285, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -58.33% (0.0024 => 0.0010, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.95% (0.0637 => 0.0580, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.99% (0.0246 => 0.0155, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.62% (0.7541 => 0.7663, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.72% (1.5363 => 1.5935, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 09:07:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 11:07:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920160736.E67BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4057?compare_to=4053&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4057, Order: 164304, Start Time: 2012-09-20 14:49:08, End Time: 2012-09-20 16:09:02 To: 4053, Order: 164300, Start Time: 2012-09-20 13:00:45, End Time: 2012-09-20 14:20:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (134 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (714 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.00% (0.5405 => 0.5513, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.16% (1.9863 => 1.9633, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.34% (3.8194 => 3.7682, std.dev.: 0.0180) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.25% (0.5695 => 0.5709, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 0.09% (15.9033 => 15.9177, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 0.55% (14.7148 => 14.7961, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -0.05% (82.5658 => 82.5229, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.3146 => 4.3214, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.20% (1.2220 => 1.2244, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.4037 => 7.4154, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.08% (3.6809 => 3.6839, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.11% (0.6362 => 0.6369, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (0.0650 => 0.0684, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.48% (63.2438 => 82.5229, std.dev.: 0.0131) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14251.81% (0.0720 => 10.3333, std.dev.: 0.0145) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.48% (10.3673 => 15.3934, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 26.39% (0.1622 => 0.2050, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.97% (2.2022 => 2.5318, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.16% (7.0540 => 8.0526, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.48% (1.1194 => 1.2591, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.49% (1.7609 => 1.9633, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.46% (10.4361 => 11.5276, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3543 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.45% (0.3694 => 0.4043, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.45% (0.3927 => 0.4298, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.34% (0.3886 => 0.4249, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.84% (0.1143 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.46% (0.3177 => 0.3414, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 7.37% (9.4845 => 10.1838, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.26% (0.4879 => 0.5233, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.87% (0.7433 => 0.7944, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 6.82% (0.3109 => 0.3321, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.67% (0.6675 => 0.7120, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.2700 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.66% (0.5105 => 0.5445, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.56% (0.2758 => 0.2939, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.55% (5.7591 => 6.1361, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.49% (0.7115 => 0.7577, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.46% (0.4615 => 0.4913, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (1.5415 => 1.6400, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2271 => 0.2416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.37% (0.5860 => 0.6233, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 6.25% (0.3423 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.21% (4.2646 => 4.5296, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (8.1363 => 8.6264, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 5.98% (3.3354 => 3.5349, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.98% (1.1642 => 1.2338, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (1.3050 => 1.3828, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.90% (0.8067 => 0.8543, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.84% (0.2107 => 0.2230, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.84% (0.8172 => 0.8649, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.82% (4.9449 => 5.2329, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.78% (0.5569 => 0.5891, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (0.3121 => 0.3301, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.74% (5.0018 => 5.2891, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 5.68% (0.7835 => 0.8280, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.62% (0.9765 => 1.0314, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.3092 => 0.3265, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.26% (0.3441 => 0.3622, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.19% (0.3180 => 0.3345, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.19% (3.8723 => 4.0732, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 5.11% (0.5925 => 0.6228, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.09% (0.4299 => 0.4518, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.08% (0.5020 => 0.5275, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (7.9617 => 8.3655, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (1.1861 => 1.2459, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.02% (0.6030 => 0.6333, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.99% (1.0722 => 1.1257, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.93% (0.3387 => 0.3554, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.86% (1.5603 => 1.6362, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.81% (0.6450 => 0.6760, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.77% (21.9371 => 22.9839, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 4.67% (2.0273 => 2.1219, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 4.61% (2.2969 => 2.4028, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 4.52% (0.6456 => 0.6748, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8921 => 0.9323, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7326 => 0.7656, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.4103 => 0.4285, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5981 => 0.6242, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (1.5859 => 1.6530, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.23% (0.4636 => 0.4832, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.12% (0.3422 => 0.3563, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4729, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 3.80% (0.4289 => 0.4452, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4203 => 0.4361, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.72% (2.2024 => 2.2844, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.66% (0.3826 => 0.3966, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.4620 => 0.4787, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.58% (0.2905 => 0.3009, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (14.3668 => 14.8807, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.3136 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.1840 => 1.2255, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.49% (0.2891 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.4048 => 0.4187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.39% (0.3098 => 0.3203, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (2.0665 => 2.1344, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.14% (0.3283 => 0.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.12% (0.3684 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.38% (0.8101 => 0.8294, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.88% (1.2842 => 1.3084, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.8922 => 3.9392, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.05% (17.1811 => 17.3623, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4138, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3817, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3501, std.dev.: 0.0037) SingleSource/Regression/C/uint64_to_float: 1.85% (0.5413 => 0.5513, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.38% (2.2771 => 2.3085, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std.dev.: 0.0322) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7891, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1300, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.52% (5.2763 => 3.2439, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.66% (5.3855 => 3.8957, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.26% (5.3526 => 3.8933, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1504, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.63% (2.9384 => 2.5966, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -8.44% (22.1758 => 20.3039, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2860, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (1.8329 => 1.7167, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5839, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1510, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4278, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0128, std.dev.: 0.0162) SingleSource/Benchmarks/McGill/chomp: -2.13% (1.2373 => 1.2109, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0003, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4239, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5782, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.18% (0.5229 => 0.5709, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.19% (14.9895 => 15.9177, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 4.53% (14.1553 => 14.7961, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (4.1105 => 4.3214, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.83% (1.1048 => 1.2244, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.59% (7.1582 => 7.4154, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.38% (3.4629 => 3.6839, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.6222 => 0.6369, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 08:45:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 10:45:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920154558.9FFEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4055?compare_to=4052&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4055, Order: 164301, Start Time: 2012-09-20 14:32:59, End Time: 2012-09-20 15:47:23 To: 4052, Order: 164300, Start Time: 2012-09-20 12:50:13, End Time: 2012-09-20 14:04:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (166 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.4809 => 56.3378, std.dev.: 0.0964) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.46% (2.2952 => 2.2618, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.60% (2.0176 => 2.4130, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.98% (0.1413 => 0.1554, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.25% (3.9660 => 4.3330, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 9.11% (1.3693 => 1.4940, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.2596 => 0.2832, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.01% (0.7038 => 0.7672, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 8.76% (0.4328 => 0.4707, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.65% (0.7710 => 0.8377, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.58% (0.9199 => 0.9988, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.50% (1.2193 => 1.3230, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.49% (0.2721 => 0.2952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.40% (0.7061 => 0.7654, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.36% (0.1327 => 0.1438, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.31% (0.6959 => 0.7537, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.22% (0.5265 => 0.5698, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.20% (0.5818 => 0.6295, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.08% (1.4563 => 1.5739, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5748 => 0.6212, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 8.01% (13.8202 => 14.9269, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.98% (1.1364 => 1.2271, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.3899 => 0.4202, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6283 => 0.6770, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.51% (0.3022 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.44% (0.5577 => 0.5992, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.44% (1.0313 => 1.1080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3580 => 0.3844, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.30% (0.3246 => 0.3483, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.28% (0.4791 => 0.5140, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.16% (1.9828 => 2.1248, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.15% (0.2995 => 0.3209, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.14% (0.3756 => 0.4024, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4379 => 0.4688, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2127 => 0.2277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4016 => 0.4297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.93% (0.2988 => 0.3195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322) MultiSource/Applications/Burg/burg: 6.91% (1.1061 => 1.1825, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8310 => 0.8878, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.76% (0.5637 => 0.6018, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 6.75% (3.8646 => 4.1256, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.2914 => 0.3110, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (7.2180 => 7.7029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.64% (3.6692 => 3.9127, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.58% (0.3192 => 0.3402, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3220 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.47% (0.7506 => 0.7992, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.43% (0.7460 => 0.7940, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.43% (0.2925 => 0.3113, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.21% (2.1791 => 2.3145, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.19% (3.1889 => 3.3864, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.17% (0.1865 => 0.1980, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.12% (0.6744 => 0.7157, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.11% (1.0594 => 1.1241, std.dev.: 0.0119) MultiSource/Applications/treecc/treecc: 6.06% (1.9270 => 2.0438, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 5.95% (0.3578 => 0.3791, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.93% (16.6129 => 17.5983, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.87% (0.6576 => 0.6962, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.82% (0.4003 => 0.4236, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.2749 => 1.3487, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.8698 => 0.9200, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.77% (1.3245 => 1.4009, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3646 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.72% (14.8535 => 15.7037, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions: 5.72% (0.3914 => 0.4138, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.66% (0.4113 => 0.4346, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 5.65% (0.3663 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.65% (0.8818 => 0.9316, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.62% (1.3819 => 1.4595, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 5.61% (0.3940 => 0.4161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3650 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.3813 => 1.4582, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 5.49% (0.3623 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6135 => 0.6467, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (4.4433 => 4.6818, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.35% (8.4961 => 8.9503, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.31% (4.3801 => 4.6128, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.25% (0.2859 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.24% (0.3131 => 0.3295, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9766, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3245 => 0.3404, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.90% (1.1333 => 1.1888, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.85% (14.5298 => 15.2351, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 4.79% (6.5754 => 6.8906, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.76% (3.2742 => 3.4302, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.73% (4.6629 => 4.8836, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (4.9865 => 5.2157, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2292 => 1.2833, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.25% (0.9108 => 0.9495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6250 => 0.6509, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.00% (0.4805 => 0.4997, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (1.5188 => 1.5780, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 3.68% (3.7467 => 3.8845, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.1007 => 2.1708, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.30% (6.2785 => 6.4856, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.2944 => 34.3081, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 1.76% (16.2614 => 16.5477, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.53% (1.1560 => 1.2546, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4115, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.59% (0.2093 => 0.2210, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.88% (11.2619 => 11.6983, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5479, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0884, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6875, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4446, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.03% (0.4657 => 0.3864, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.42% (22.5627 => 21.7906, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2870, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.66% (1.3780 => 1.3000, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1508, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.39% (3.0263 => 2.9238, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5790, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9052, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2441, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0587, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4320, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 07:39:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 09:39:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920143946.8FBCF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4054?compare_to=4050&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4054, Order: 164301, Start Time: 2012-09-20 13:30:28, End Time: 2012-09-20 14:41:13 To: 4050, Order: 164300, Start Time: 2012-09-20 12:04:41, End Time: 2012-09-20 13:14:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (53 on baseline) Performance Improvements: 0 (42 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 894 (795 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 8.53% (21.5525 => 23.3917, std.dev.: 0.3797) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.59% (0.3279 => 0.3495, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.3896 => 2.4509, std.dev.: 0.0177) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.33% (2.8670 => 2.9337, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/ReedSolomon: 1.70% (8.7091 => 8.8569, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.18% (1.2757 => 1.2908, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.64% (0.9938 => 1.0002, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -0.17% (0.6035 => 0.6025, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -0.60% (0.1679 => 0.1669, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.63% (0.1575 => 0.1565, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.84% (0.3103 => 0.3077, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (0.2351 => 0.2384, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.31% (0.3134 => 0.3175, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.63% (0.2268 => 0.2305, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0456 => 0.0457, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.24% (0.0242 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0191 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0386 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0298 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0281 => 0.0283, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 23.28% (0.0262 => 0.0323, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0178 => 0.0180, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -11.58% (0.0190 => 0.0168, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -0.78% (0.0256 => 0.0254, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -6.49% (0.0308 => 0.0288, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -9.09% (0.0011 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1427 => 0.1424, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.95% (1.4888 => 1.5327, std.dev.: 0.0268) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.68% (0.1455 => 0.1494, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.34% (0.4070 => 0.4056, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.37% (0.1341 => 0.1413, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.56% (0.0640 => 0.0566, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.22% (0.0202 => 0.0259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.05% (0.0573 => 0.0567, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1252 => 1.1296, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 440.00% (0.0005 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.97% (0.0563 => 0.0535, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.77% (0.0264 => 0.0225, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7670 => 0.7668, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.09% (1.5996 => 1.6011, std.dev.: 0.0133) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.14% (0.0114 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.01% (4.1772 => 3.0909, std.dev.: 0.0414) SingleSource/Benchmarks/Shootout-C++/except: 81433.33% (0.0006 => 0.4892, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (2.1763 => 2.3196, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.46% (0.6410 => 0.6824, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 6.42% (0.5309 => 0.5650, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (1.1653 => 1.2324, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.16% (0.3582 => 0.3767, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.2552 => 0.2680, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.6915 => 0.7238, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 4.57% (0.6173 => 0.6455, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 3.87% (15.3105 => 15.9037, std.dev.: 0.0585) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.5150 => 1.5607, std.dev.: 0.0081) MultiSource/Applications/siod/siod: 2.82% (2.0972 => 2.1564, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.58% (3.0225 => 3.1004, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.1827 => 1.2065, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.94% (13.3238 => 13.5817, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6069 => 0.6182, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1672 => 1.1882, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 1.62% (14.6079 => 14.8440, std.dev.: 0.0761) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.59% (1.2021 => 1.2212, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 1.36% (4.7455 => 4.8099, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.7256 => 14.9195, std.dev.: 0.0489) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (6.4908 => 6.5679, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.10% (1.8798 => 1.9004, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.54% (0.0766 => 0.0885, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 15.00% (1.7426 => 2.0040, std.dev.: 0.0348) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5501, std.dev.: 0.0640) SingleSource/Benchmarks/McGill/queens: 10.52% (1.6261 => 1.7971, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 10.48% (21.1721 => 23.3917, std.dev.: 0.3797) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.31% (0.2857 => 0.3123, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 8.92% (7.0025 => 7.6273, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.25% (40.4792 => 42.6030, std.dev.: 0.2759) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 4.06% (8.5113 => 8.8569, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/fp-convert: 3.83% (15.2242 => 15.8080, std.dev.: 0.0453) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.79% (3.4080 => 3.5371, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (6.6312 => 6.8743, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.02% (14.4877 => 14.9248, std.dev.: 0.0840) MultiSource/Benchmarks/sim/sim: 2.99% (3.8907 => 4.0071, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.81% (0.5876 => 0.6041, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 2.61% (3.5520 => 3.6446, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: 2.52% (0.5004 => 0.5130, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.09% (2.6656 => 2.7212, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.6127 => 4.7066, std.dev.: 0.0177) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (2.4013 => 2.4495, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.43% (1.2726 => 1.2908, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.15% (2.4455 => 2.4737, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.77% (0.7738 => 0.7601, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.63% (0.3497 => 0.2111, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.50% (5.2665 => 4.1344, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/ary3: -19.70% (1.7473 => 1.4030, std.dev.: 0.0845) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.41% (1.1647 => 0.9619, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.44% (15.8312 => 13.2287, std.dev.: 0.0993) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -10.44% (0.3746 => 0.3355, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.50% (3.2007 => 2.9286, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2877, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3760, std.dev.: 0.0274) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.55% (2.0027 => 1.8715, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3332, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: -6.49% (3.4230 => 3.2010, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/richards_benchmark: -6.23% (1.4441 => 1.3541, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -5.50% (62.4126 => 58.9820, std.dev.: 0.2004) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1892, std.dev.: 0.0344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.48% (1.2959 => 1.2378, std.dev.: 0.0221) MultiSource/Applications/lambda-0_1_3/lambda: -4.28% (7.6833 => 7.3546, std.dev.: 0.0502) MultiSource/Benchmarks/FreeBench/distray/distray: -4.13% (0.2664 => 0.2554, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2225, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/misr: -3.49% (0.4296 => 0.4146, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (9.2503 => 8.9317, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6385, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.77% (1.1683 => 1.1359, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2872, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (92.7467 => 90.5783, std.dev.: 0.5940) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3121, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3647, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: -1.85% (3.4876 => 3.4230, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.82% (61.1734 => 60.0627, std.dev.: 0.1151) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.76% (1.0686 => 1.0498, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2238, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.55% (1.8739 => 1.8449, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -1.43% (3.4659 => 3.4163, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3160, std.dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/fldry: -1.14% (2.4971 => 2.4686, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.22% (0.9980 => 1.0002, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.6022 => 0.6025, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.18% (0.1666 => 0.1669, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.71% (0.1554 => 0.1565, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (0.3083 => 0.3077, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2394 => 0.2384, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3175 => 0.3175, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.13% (0.2302 => 0.2305, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 1.78% (0.0449 => 0.0457, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -11.11% (0.0189 => 0.0168, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -11.38% (0.0325 => 0.0288, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.05% (1.5019 => 1.5327, std.dev.: 0.0268) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.88% (0.4264 => 0.4056, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.1344 => 0.1413, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0589 => 0.0566, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.64% (0.0232 => 0.0259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.27% (0.0639 => 0.0567, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1350 => 1.1296, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.01% (0.0637 => 0.0535, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.54% (0.0246 => 0.0225, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.68% (0.7541 => 0.7668, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.22% (1.5363 => 1.6011, std.dev.: 0.0133) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 07:19:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 09:19:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920141903.715E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4053?compare_to=4049&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4053, Order: 164300, Start Time: 2012-09-20 13:00:45, End Time: 2012-09-20 14:20:25 To: 4049, Order: 164299, Start Time: 2012-09-20 11:12:31, End Time: 2012-09-20 12:32:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (129 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (719 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.39% (77.5989 => 80.2310, std.dev.: 0.2788) SingleSource/Benchmarks/Misc/lowercase: 1.44% (7.9427 => 8.0574, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.15% (1.2971 => 1.3120, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5699 => 0.5695, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -0.01% (15.9050 => 15.9033, std.dev.: 0.0182) MultiSource/Applications/kimwitu++/kc: -0.01% (14.7156 => 14.7148, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: 0.01% (82.5594 => 82.5658, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3118 => 4.3146, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2218 => 1.2220, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (7.4130 => 7.4037, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.07% (3.6784 => 3.6809, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6366 => 0.6362, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0648 => 0.0650, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.55% (63.2438 => 82.5658, std.dev.: 0.0119) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14251.39% (0.0720 => 10.3330, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.36% (10.3673 => 15.3812, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 26.82% (0.1622 => 0.2057, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.70% (2.2022 => 2.5260, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.44% (7.0540 => 8.0725, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 13.97% (0.1432 => 0.1632, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.80% (1.7609 => 1.9863, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.62% (1.1194 => 1.2607, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.41% (10.4361 => 11.5221, std.dev.: 0.0159) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.01% (0.3497 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.00% (0.3543 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.99% (0.3516 => 0.3832, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.98% (0.3543 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3561 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.77% (0.3694 => 0.4018, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.67% (0.3828 => 0.4160, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.63% (0.3927 => 0.4266, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.52% (0.3886 => 0.4217, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.59% (9.4845 => 10.2042, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.58% (0.4879 => 0.5249, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.98% (0.7433 => 0.7952, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.75% (0.3109 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.58% (0.6675 => 0.7114, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.41% (0.7115 => 0.7571, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.2554 => 0.2716, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4615 => 0.4904, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.12% (5.7591 => 6.1114, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 6.11% (0.3423 => 0.3632, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.05% (0.5105 => 0.5414, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.03% (0.2271 => 0.2408, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (4.2646 => 4.5203, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.5860 => 0.6211, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.3050 => 1.3815, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.5415 => 1.6315, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.80% (3.3354 => 3.5290, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (8.1363 => 8.6068, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.8067 => 0.8525, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.60% (5.0018 => 5.2817, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.57% (4.9449 => 5.2203, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.3092 => 0.3264, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.56% (1.1642 => 1.2289, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.8172 => 0.8626, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.53% (0.5569 => 0.5877, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9765 => 1.0290, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.34% (0.7835 => 0.8253, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.33% (0.2758 => 0.2905, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.16% (3.8723 => 4.0722, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 5.14% (1.5603 => 1.6405, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (7.9617 => 8.3683, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 5.00% (1.0722 => 1.1258, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.98% (0.5925 => 0.6220, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 4.88% (0.6030 => 0.6324, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.85% (1.1861 => 1.2436, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4299 => 0.4507, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.78% (0.5020 => 0.5260, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 4.60% (21.9371 => 22.9467, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3422 => 0.3579, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.45% (2.0273 => 2.1175, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 4.43% (0.6456 => 0.6742, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.41% (0.4103 => 0.4284, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8921 => 0.9311, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.34% (2.2969 => 2.3965, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.34% (0.4636 => 0.4837, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.4064 => 0.4235, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.15% (0.7326 => 0.7630, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.4203 => 0.4376, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.05% (0.5981 => 0.6223, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3650 => 0.3796, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.97% (1.5859 => 1.6488, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.4289 => 0.4458, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3826 => 0.3973, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (0.3935 => 0.4085, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.4048 => 0.4202, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.4186 => 1.4712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.70% (0.4620 => 0.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (14.3668 => 14.8841, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.2024 => 2.2803, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary3: 3.50% (0.3283 => 0.3398, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.49% (0.3098 => 0.3206, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.37% (0.3379 => 0.3493, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (2.0665 => 2.1360, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.1840 => 1.2236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.18% (0.3684 => 0.3801, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.8101 => 0.8277, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3107, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.17% (17.1811 => 17.3823, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.8922 => 3.9369, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3803, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (4.2280 => 4.3520, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7886, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2256, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2553, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.70% (5.3855 => 3.8936, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.33% (5.3526 => 3.8896, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1414, std.dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.37% (2.9384 => 2.6042, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: -8.53% (22.1758 => 20.2832, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2852, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.30% (1.8329 => 1.7175, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5070, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4305, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9879, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.09% (8.1563 => 7.9860, std.dev.: 0.0207) SingleSource/Benchmarks/McGill/chomp: -1.81% (1.2373 => 1.2149, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6441 => 4.5776, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.91% (0.5229 => 0.5695, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.10% (14.9895 => 15.9033, std.dev.: 0.0182) MultiSource/Applications/kimwitu++/kc: 3.95% (14.1553 => 14.7148, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 4.97% (4.1105 => 4.3146, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.61% (1.1048 => 1.2220, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (7.1582 => 7.4037, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.30% (3.4629 => 3.6809, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.6222 => 0.6362, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 10:28:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 12:28:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920172848.826352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4059?compare_to=4055&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4059, Order: 164307, Start Time: 2012-09-20 16:15:52, End Time: 2012-09-20 17:30:11 To: 4055, Order: 164301, Start Time: 2012-09-20 14:32:59, End Time: 2012-09-20 15:47:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.11% (80.8975 => 79.1899, std.dev.: 0.5380) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.91% (2.0176 => 2.3991, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.77% (0.1413 => 0.1551, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.19% (3.9660 => 4.3304, std.dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7061 => 0.7690, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.88% (0.7710 => 0.8395, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.78% (1.3693 => 1.4895, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 8.70% (0.7038 => 0.7650, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5818 => 0.6322, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.51% (0.5265 => 0.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.44% (0.9199 => 0.9975, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.2721 => 0.2950, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.37% (1.2193 => 1.3214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.19% (0.6959 => 0.7529, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.98% (1.1364 => 1.2271, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5577 => 0.6016, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.81% (13.8202 => 14.8994, std.dev.: 0.0111) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.80% (1.4563 => 1.5699, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.6283 => 0.6758, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.55% (0.1589 => 0.1709, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3485 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2760 => 0.2963, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.24% (0.4390 => 0.4708, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.22% (0.4791 => 0.5137, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.17% (1.0313 => 1.1052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.12% (0.4016 => 0.4302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.4379 => 0.4690, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.02% (1.9828 => 2.1220, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.02% (1.1061 => 1.1837, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3756 => 0.4018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.5637 => 0.6026, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.2914 => 0.3114, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.81% (0.2995 => 0.3199, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.76% (7.2180 => 7.7059, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.74% (0.7506 => 0.8012, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.70% (0.3192 => 0.3406, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.69% (3.8646 => 4.1232, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 6.65% (0.8310 => 0.8863, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.63% (3.6692 => 3.9124, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.2925 => 0.3114, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.34% (0.6576 => 0.6993, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 6.30% (0.3220 => 0.3423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.07% (2.1791 => 2.3113, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.02% (0.6744 => 0.7150, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 5.96% (1.9270 => 2.0418, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.94% (1.3245 => 1.4032, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 5.94% (3.1889 => 3.3782, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.88% (1.0594 => 1.1217, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 5.85% (16.6129 => 17.5845, std.dev.: 0.0232) SingleSource/UnitTests/ObjC/parameter-passing: 5.82% (0.4003 => 0.4236, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (1.3819 => 1.4619, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3578 => 0.3785, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3914 => 0.4136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.67% (0.3650 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.66% (1.3813 => 1.4595, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.8698 => 0.9189, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.62% (0.3663 => 0.3869, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.2749 => 1.3464, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.56% (0.3940 => 0.4159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.55% (0.3623 => 0.3824, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.52% (14.8535 => 15.6739, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.31% (4.3801 => 4.6127, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.29% (8.4961 => 8.9456, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6135 => 0.6458, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.25% (4.4433 => 4.6766, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.11% (0.8818 => 0.9269, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.11% (0.3131 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.95% (13.2842 => 13.9424, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.93% (1.1333 => 1.1892, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.75% (14.5298 => 15.2205, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 4.61% (6.5754 => 6.8786, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 4.46% (4.6629 => 4.8708, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.43% (3.2742 => 3.4194, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.23% (4.9865 => 5.1973, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.96% (0.9108 => 0.9469, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5188 => 1.5767, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6250 => 0.6488, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.62% (3.7467 => 3.8824, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (6.2785 => 6.4956, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1703, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.57% (33.2944 => 34.1516, std.dev.: 0.0187) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4894, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.81% (1.8175 => 2.2502, std.dev.: 0.0463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2557, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (0.2093 => 0.2196, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6980, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5483, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0755, std.dev.: 0.0632) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6003, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.11% (0.4657 => 0.3860, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.58% (22.5627 => 21.7543, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.97% (20.3410 => 18.3122, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7079, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9225, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5985, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.20% (26.5159 => 25.9330, std.dev.: 0.0227) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2439, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2247, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0602, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4354, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2628, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 10:34:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 12:34:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920173413.3D1E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4060?compare_to=4056&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4060, Order: 164307, Start Time: 2012-09-20 16:24:33, End Time: 2012-09-20 17:35:40 To: 4056, Order: 164304, Start Time: 2012-09-20 14:56:51, End Time: 2012-09-20 16:08:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (47 on baseline) Performance Improvements: 0 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (806 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 10.16% (0.1033 => 0.1138, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.5839 => 0.5954, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.95% (15.7047 => 16.0112, std.dev.: 0.0619) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (4.0417 => 4.0919, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (8.2931 => 8.3842, std.dev.: 0.0219) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (2.5269 => 2.6582, std.dev.: 0.0290) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.10% (39.4398 => 40.6644, std.dev.: 0.3751) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2735 => 1.2942, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.45% (2.6897 => 2.7288, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.09% (1.2248 => 1.2382, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.43% (0.9906 => 0.9863, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 0.15% (0.6005 => 0.6014, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 2.44% (0.1597 => 0.1636, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.56% (0.1541 => 0.1565, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.20% (0.3081 => 0.3118, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.47% (0.2374 => 0.2339, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (0.3136 => 0.3188, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.26% (0.2294 => 0.2300, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 1.33% (0.0451 => 0.0457, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -50.57% (0.0087 => 0.0043, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: -53.93% (0.0089 => 0.0041, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.65% (0.0243 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.80% (0.0153 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.72% (0.0384 => 0.0339, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.33% (0.0271 => 0.0299, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.01% (0.0241 => 0.0282, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0322 => 0.0322, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0178 => 0.0181, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 27.81% (0.0151 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.22% (0.0245 => 0.0248, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 2.53% (0.0316 => 0.0324, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1420 => 0.1428, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.33% (1.4685 => 1.4489, std.dev.: 0.0300) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.20% (0.1410 => 0.1441, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.50% (0.4089 => 0.4314, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1351 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.24% (0.0596 => 0.0529, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.00% (0.0247 => 0.0205, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.31% (0.0627 => 0.0600, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1285 => 1.1278, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0012 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0010 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.41% (0.0580 => 0.0623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.87% (0.0155 => 0.0161, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7663 => 0.7662, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.26% (1.5935 => 1.5893, std.dev.: 0.0141) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.28% (4.1772 => 3.0796, std.dev.: 0.0777) SingleSource/Benchmarks/Shootout-C++/except: 81566.67% (0.0006 => 0.4900, std.dev.: 0.0064) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.08% (0.6410 => 0.6800, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 5.91% (2.1763 => 2.3049, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.5309 => 0.5613, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 4.58% (15.3105 => 16.0112, std.dev.: 0.0619) MultiSource/Applications/lemon/lemon: 3.81% (1.0046 => 1.0429, std.dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: 3.76% (0.6915 => 0.7175, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 3.66% (0.6173 => 0.6399, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 2.81% (29.3170 => 30.1401, std.dev.: 0.0735) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (1.5150 => 1.5533, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 2.24% (1.1440 => 1.1696, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (8.2186 => 8.3842, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (4.0318 => 4.0919, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.41% (1.1672 => 1.1836, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.1827 => 1.1973, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0352) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 14.03% (0.1433 => 0.1634, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.44% (4.0101 => 4.5491, std.dev.: 0.0201) SingleSource/Benchmarks/McGill/queens: 11.16% (1.6261 => 1.8075, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.96% (0.2857 => 0.3113, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.57% (0.2694 => 0.2925, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 8.56% (7.0025 => 7.6019, std.dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.61% (1.0063 => 1.0728, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (0.3301 => 0.3511, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.47% (38.9255 => 40.6644, std.dev.: 0.3751) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.24% (40.4792 => 42.1951, std.dev.: 0.4757) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8325, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8731, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.10% (3.8907 => 4.0113, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8896, std.dev.: 0.0521) MultiSource/Benchmarks/FreeBench/mason/mason: 2.46% (0.5004 => 0.5127, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.37% (2.6656 => 2.7288, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/ReedSolomon: 2.34% (8.5113 => 8.7106, std.dev.: 0.0738) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.25% (0.5876 => 0.6008, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.09% (3.5520 => 3.6263, std.dev.: 0.0172) SingleSource/Benchmarks/Dhrystone/dry: 2.02% (2.4013 => 2.4499, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.86% (4.6127 => 4.6986, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.70% (1.2726 => 1.2942, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 1.20% (4.6414 => 4.6973, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.13% (2.4455 => 2.4732, std.dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.07% (27.1724 => 27.4618, std.dev.: 0.0719) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.68% (0.9029 => 0.8787, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.12% (0.3497 => 0.2059, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.05% (5.2665 => 4.1577, std.dev.: 0.1520) SingleSource/Benchmarks/Shootout-C++/ary3: -20.47% (1.7473 => 1.3897, std.dev.: 0.0477) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.45% (1.1647 => 0.9615, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.71% (15.8312 => 13.1860, std.dev.: 0.1552) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1604, std.dev.: 0.0298) MultiSource/Applications/sgefa/sgefa: -10.78% (0.3746 => 0.3342, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.44% (3.2007 => 2.9307, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3763, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.53% (2.0027 => 1.8719, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/fibo: -6.39% (4.6355 => 4.3392, std.dev.: 0.0231) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (3.4230 => 3.2055, std.dev.: 0.0333) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -5.80% (1.4441 => 1.3603, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -5.51% (62.4126 => 58.9730, std.dev.: 0.1359) SingleSource/Benchmarks/Shootout/fib2: -5.03% (4.4195 => 4.1970, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4140 => 0.3936, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.50% (45.4683 => 43.4228, std.dev.: 0.6153) MultiSource/Applications/lambda-0_1_3/lambda: -4.26% (7.6833 => 7.3559, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/methcall: -3.36% (9.2503 => 8.9394, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.67% (1.2722 => 1.2382, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.66% (3.7496 => 3.6500, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/flops: -2.60% (9.5474 => 9.2991, std.dev.: 0.0357) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.30% (1.1683 => 1.1414, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: -2.19% (1.0926 => 1.0687, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -2.04% (3.4876 => 3.4166, std.dev.: 0.0078) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3635, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3128, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (9.3855 => 9.2143, std.dev.: 0.0296) MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (92.7467 => 91.2190, std.dev.: 0.1258) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3257, std.dev.: 0.1103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.17% (0.9980 => 0.9863, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: -0.13% (0.6022 => 0.6014, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: -1.80% (0.1666 => 0.1636, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.71% (0.1554 => 0.1565, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (0.3083 => 0.3118, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.30% (0.2394 => 0.2339, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.41% (0.3175 => 0.3188, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.09% (0.2302 => 0.2300, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 1.78% (0.0449 => 0.0457, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -51.69% (0.0089 => 0.0043, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: -54.44% (0.0090 => 0.0041, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.08% (0.0390 => 0.0339, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -3.53% (1.5019 => 1.4489, std.dev.: 0.0300) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.00% (0.1501 => 0.1441, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.17% (0.4264 => 0.4314, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1344 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.19% (0.0589 => 0.0529, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.0232 => 0.0205, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0639 => 0.0600, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1350 => 1.1278, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0006 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.20% (0.0637 => 0.0623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.55% (0.0246 => 0.0161, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.45% (1.5363 => 1.5893, std.dev.: 0.0141) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 12:00:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 14:00:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920190049.51AEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4061?compare_to=4060&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4061, Order: 164311, Start Time: 2012-09-20 17:51:43, End Time: 2012-09-20 19:02:15 To: 4060, Order: 164307, Start Time: 2012-09-20 16:24:33, End Time: 2012-09-20 17:35:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 12 (53 on baseline) Performance Improvements: 3 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 885 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.10% (0.1999 => 0.2141, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.7467 => 0.7955, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.2788 => 0.2956, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2675 => 0.2813, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 2.97% (0.7519 => 0.7742, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.68% (1.3281 => 1.3637, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5605 => 0.5735, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.11% (0.8787 => 0.8972, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.80% (1.8816 => 1.9154, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.72% (1.1836 => 1.2040, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.91% (43.4228 => 44.6867, std.dev.: 0.1944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.14% (42.1951 => 42.6770, std.dev.: 0.1593) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (3.1762 => 3.0330, std.dev.: 0.0163) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.59% (2.6582 => 2.6160, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.0175 => 6.9288, std.dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.29% (0.9863 => 1.0089, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6014 => 0.5976, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 2.44% (0.1636 => 0.1676, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.58% (0.1565 => 0.1556, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (0.3118 => 0.3151, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.94% (0.2339 => 0.2361, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.38% (0.3188 => 0.3200, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.65% (0.2300 => 0.2239, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -1.09% (0.0457 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 6.98% (0.0043 => 0.0046, std.dev.: 0.0021) SingleSource/UnitTests/2003-08-11-VaListArg: 117.07% (0.0041 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.69% (0.0239 => 0.0223, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0194 => 0.0195, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.04% (0.0339 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0299 => 0.0300, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0282 => 0.0285, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0322 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0181 => 0.0181, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0193 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0248 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 0.31% (0.0324 => 0.0325, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1428 => 0.1444, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.64% (1.4489 => 1.5161, std.dev.: 0.0138) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.78% (0.1441 => 0.1481, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.45% (0.4314 => 0.4079, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.03% (0.1451 => 0.1407, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.61% (0.0529 => 0.0601, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.46% (0.0205 => 0.0202, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.83% (0.0600 => 0.0623, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: -47.92% (0.0048 => 0.0025, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1278 => 1.1307, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.09% (0.0623 => 0.0610, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.40% (0.0161 => 0.0218, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7662 => 0.7664, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.52% (1.5893 => 1.5975, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -90.42% (0.0261 => 0.0025, std.dev.: 0.0011) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.70% (4.1772 => 3.1036, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0007) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.43% (0.1414 => 0.1519, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 6.95% (0.5309 => 0.5678, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.57% (0.6410 => 0.6831, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 6.37% (2.1763 => 2.3149, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.2552 => 0.2704, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 4.65% (0.6173 => 0.6460, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 4.33% (1.1653 => 1.2157, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.24% (0.3582 => 0.3734, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 4.13% (1.0046 => 1.0461, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.66% (1.5150 => 1.5704, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 3.63% (15.3105 => 15.8661, std.dev.: 0.0985) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (1.1672 => 1.2040, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.7639 => 0.7871, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.7722 => 0.7955, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 2.94% (29.3170 => 30.1780, std.dev.: 0.0839) MultiSource/Applications/hbd/hbd: 2.78% (1.3268 => 1.3637, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.64% (0.3901 => 0.4004, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.36% (0.6069 => 0.6212, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.10% (1.1440 => 1.1680, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (12.6413 => 12.9040, std.dev.: 0.0838) MultiSource/Applications/treecc/treecc: 1.89% (1.8798 => 1.9154, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.69% (6.2546 => 6.3606, std.dev.: 0.0219) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (8.2186 => 8.3412, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.49% (1.2021 => 1.2200, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 1.24% (14.6079 => 14.7895, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.23% (1.0689 => 1.0821, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.80% (0.0766 => 0.0910, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.52% (1.7426 => 1.9957, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.49% (4.0101 => 4.5510, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 10.40% (0.1433 => 0.1582, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.32% (0.2694 => 0.2972, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 8.70% (7.0025 => 7.6114, std.dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.18% (1.0063 => 1.0886, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (0.3301 => 0.3507, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.43% (40.4792 => 42.6770, std.dev.: 0.1593) SingleSource/Benchmarks/Misc/dt: 4.37% (0.9851 => 1.0281, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 4.02% (15.2242 => 15.8362, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.93% (0.8498 => 0.8832, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.79% (3.4080 => 3.5371, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8734, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 2.99% (8.5113 => 8.7655, std.dev.: 0.0431) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8901, std.dev.: 0.0367) MultiSource/Benchmarks/sim/sim: 2.54% (3.8907 => 3.9897, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/hash: 2.31% (0.6308 => 0.6454, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.30% (0.5876 => 0.6011, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4491, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.51% (4.6127 => 4.6825, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.78% (0.3497 => 0.2106, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.52% (5.2665 => 4.0807, std.dev.: 0.0846) SingleSource/Benchmarks/Shootout-C++/ary3: -20.67% (1.7473 => 1.3861, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.33% (1.1647 => 0.9629, std.dev.: 0.0287) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.47% (15.8312 => 13.3823, std.dev.: 0.1964) SingleSource/Benchmarks/Shootout/sieve: -12.36% (8.1594 => 7.1509, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.54% (3.6023 => 3.2947, std.dev.: 0.0771) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.43% (3.2007 => 2.9308, std.dev.: 0.0302) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.4441 => 1.3424, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3778, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -6.73% (3.4230 => 3.1925, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/fibo: -6.65% (4.6355 => 4.3272, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.53% (2.0027 => 1.8719, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.73% (2.9728 => 2.8024, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9317, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1842, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.81% (0.4140 => 0.3941, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.05% (7.6833 => 7.3720, std.dev.: 0.0243) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.02% (1.2722 => 1.2211, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (9.2503 => 8.9486, std.dev.: 0.0334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.23% (3.7496 => 3.6284, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8295, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.72% (61.1734 => 59.5116, std.dev.: 0.5308) SingleSource/Benchmarks/McGill/misr: -2.54% (0.4296 => 0.4187, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.51% (1.1683 => 1.1390, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -2.08% (3.4659 => 3.3939, std.dev.: 0.0267) MultiSource/Benchmarks/PAQ8p/paq8p: -1.98% (92.7467 => 90.9088, std.dev.: 0.4620) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.72% (45.4683 => 44.6867, std.dev.: 0.1944) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3117, std.dev.: 0.0515) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.37% (9.3855 => 9.2566, std.dev.: 0.0450) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.09% (0.9980 => 1.0089, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -0.76% (0.6022 => 0.5976, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 0.60% (0.1666 => 0.1676, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.13% (0.1554 => 0.1556, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (0.3083 => 0.3151, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.38% (0.2394 => 0.2361, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.79% (0.3175 => 0.3200, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.74% (0.2302 => 0.2239, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0449 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -48.31% (0.0089 => 0.0046, std.dev.: 0.0021) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.08% (0.0240 => 0.0223, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1429 => 0.1444, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 0.95% (1.5019 => 1.5161, std.dev.: 0.0138) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.33% (0.1501 => 0.1481, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.34% (0.4264 => 0.4079, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.69% (0.1344 => 0.1407, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.04% (0.0589 => 0.0601, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0232 => 0.0202, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.50% (0.0639 => 0.0623, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1350 => 1.1307, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.24% (0.0637 => 0.0610, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.38% (0.0246 => 0.0218, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7541 => 0.7664, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.98% (1.5363 => 1.5975, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 12:11:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 14:11:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920191142.B61EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4062?compare_to=4059&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4062, Order: 164311, Start Time: 2012-09-20 17:58:45, End Time: 2012-09-20 19:13:09 To: 4059, Order: 164307, Start Time: 2012-09-20 16:15:52, End Time: 2012-09-20 17:30:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (707 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.88% (2.0176 => 2.3985, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.18% (0.1410 => 0.1624, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.32% (0.1588 => 0.1736, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (3.9660 => 4.3315, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.78% (1.3693 => 1.4895, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.75% (0.7710 => 0.8385, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5818 => 0.6323, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.53% (0.7038 => 0.7638, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 8.50% (0.4328 => 0.4696, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5748 => 0.6234, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.41% (0.5265 => 0.5708, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7061 => 0.7655, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.37% (0.9199 => 0.9969, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.34% (1.2193 => 1.3210, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.27% (0.2721 => 0.2946, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.26% (0.6959 => 0.7534, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.14% (0.1327 => 0.1435, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.98% (1.1364 => 1.2271, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.4563 => 1.5708, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std.dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.78% (13.8202 => 14.8960, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.55% (0.5577 => 0.5998, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.54% (0.6283 => 0.6757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4390 => 0.4710, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.17% (0.4016 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.16% (0.4791 => 0.5134, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.15% (0.3246 => 0.3478, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.10% (1.0313 => 1.1045, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3756 => 0.4020, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.02% (1.9828 => 2.1219, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.00% (0.2914 => 0.3118, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.98% (0.2995 => 0.3204, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.94% (1.1061 => 1.1829, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (3.8646 => 4.1315, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.83% (0.5637 => 0.6022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.78% (0.3453 => 0.3687, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (7.2180 => 7.7068, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.71% (0.7506 => 0.8010, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.7460 => 0.7952, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9093, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 6.53% (0.8310 => 0.8853, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.50% (0.2925 => 0.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.30% (0.3220 => 0.3423, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.04% (2.1791 => 2.3107, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.95% (1.0594 => 1.1224, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.94% (1.3245 => 1.4032, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 5.94% (1.9270 => 2.0414, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.89% (16.6129 => 17.5912, std.dev.: 0.0110) MultiSource/Applications/d/make_dparser: 5.85% (3.1889 => 3.3756, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 5.85% (0.4003 => 0.4237, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 5.83% (0.6744 => 0.7137, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3578 => 0.3785, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.78% (0.6576 => 0.6956, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 5.75% (0.3914 => 0.4139, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 5.75% (0.3601 => 0.3808, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.72% (1.3819 => 1.4610, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 5.70% (0.3789 => 0.4005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4600, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.66% (0.3940 => 0.4163, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.65% (0.3663 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.59% (0.4113 => 0.4343, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 5.58% (1.2749 => 1.3460, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 5.58% (0.3623 => 0.3825, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.54% (0.8698 => 0.9180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.44% (14.8535 => 15.6615, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.32% (8.4961 => 8.9479, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6794, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.27% (4.3801 => 4.6108, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6135 => 0.6458, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.11% (0.3131 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.07% (0.8818 => 0.9265, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2504 => 0.2630, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.95% (13.2842 => 13.9419, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.85% (1.1333 => 1.1883, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.72% (14.5298 => 15.2158, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 4.67% (6.5754 => 6.8823, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.50% (3.2742 => 3.4214, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 4.49% (4.6629 => 4.8722, std.dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2292 => 1.2817, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.22% (4.9865 => 5.1967, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4805 => 0.5001, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.02% (0.9108 => 0.9474, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5188 => 1.5767, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.6250 => 0.6480, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 3.62% (3.7467 => 3.8824, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (6.2785 => 6.4967, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.1007 => 2.1695, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 2.58% (33.2944 => 34.1533, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.41% (16.2614 => 16.4904, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2655, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4163, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.89% (1.2998 => 1.3763, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6981, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5465, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1019, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1835, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5939, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1406, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.09% (0.4657 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.67% (22.5627 => 21.7339, std.dev.: 0.0262) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2887, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.99% (1.3780 => 1.2955, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: -3.40% (3.0263 => 2.9235, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5726, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.09% (26.5159 => 25.9622, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2396, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0604, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 12:48:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 14:48:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920194853.417212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4063?compare_to=4057&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4063, Order: 164311, Start Time: 2012-09-20 18:30:20, End Time: 2012-09-20 19:50:18 To: 4057, Order: 164304, Start Time: 2012-09-20 14:49:08, End Time: 2012-09-20 16:09:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (120 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5463 => 56.4990, std.dev.: 0.1056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (15.3934 => 15.1163, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -1.28% (11.5276 => 11.3806, std.dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.44% (0.5709 => 0.5684, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -0.58% (15.9177 => 15.8247, std.dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: -0.67% (14.7961 => 14.6970, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.04% (82.5229 => 81.6616, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: -0.43% (4.3214 => 4.3027, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.53% (1.2244 => 1.2179, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.43% (7.4154 => 7.3832, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.48% (3.6839 => 3.6661, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.27% (0.6369 => 0.6352, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (0.0684 => 0.0696, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.12% (63.2438 => 81.6616, std.dev.: 0.0137) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.72% (0.0720 => 10.3318, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.81% (10.3673 => 15.1163, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 25.22% (0.1622 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.11% (2.2022 => 2.5129, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.87% (7.0540 => 8.0326, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 12.36% (0.1432 => 0.1609, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.89% (1.7609 => 1.9526, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 9.05% (10.4361 => 11.3806, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.96% (0.1584 => 0.1726, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.87% (0.3473 => 0.3781, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3543 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.52% (0.3543 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.52% (0.3497 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3516 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.42% (0.3561 => 0.3861, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3694 => 0.3998, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.23% (0.3927 => 0.4250, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3828 => 0.4141, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.98% (0.3886 => 0.4196, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 7.04% (9.4845 => 10.1526, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.8172 => 0.8747, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.44% (0.3307 => 0.3520, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.7433 => 0.7906, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.30% (0.2700 => 0.2870, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.4615 => 0.4897, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 6.06% (0.7115 => 0.7546, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.6675 => 0.7079, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3109 => 0.3297, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.03% (0.2271 => 0.2408, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.02% (0.3423 => 0.3629, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.87% (5.7591 => 6.0970, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.78% (0.5860 => 0.6199, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.3050 => 1.3801, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.70% (4.2646 => 4.5078, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (1.5415 => 1.6280, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.61% (0.3121 => 0.3296, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.58% (0.5105 => 0.5390, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.56% (3.3354 => 3.5210, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (8.1363 => 8.5870, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (5.0018 => 5.2774, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.46% (0.5569 => 0.5873, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.43% (0.8067 => 0.8505, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.39% (4.9449 => 5.2115, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.33% (0.2758 => 0.2905, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 5.28% (0.5925 => 0.6238, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2107 => 0.2217, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.18% (0.9765 => 1.0271, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 5.17% (0.6030 => 0.6342, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.14% (1.1642 => 1.2240, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 5.11% (0.3092 => 0.3250, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.90% (0.7326 => 0.7685, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.2603 => 0.2728, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3441 => 0.3606, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 4.78% (0.3180 => 0.3332, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (1.1861 => 1.2420, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 4.69% (3.8723 => 4.0540, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.68% (7.9617 => 8.3342, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 4.58% (1.0722 => 1.1213, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.58% (0.3387 => 0.3542, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.48% (0.5020 => 0.5245, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 4.40% (0.4299 => 0.4488, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.36% (1.5603 => 1.6284, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 4.35% (21.9371 => 22.8912, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.6456 => 0.6731, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.07% (2.0273 => 2.1099, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.06% (0.6450 => 0.6712, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 3.98% (2.2969 => 2.3883, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.98% (0.5981 => 0.6219, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3422 => 0.3558, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.97% (0.4636 => 0.4820, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 3.90% (0.8921 => 0.9269, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.4064 => 0.4222, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.88% (0.4103 => 0.4262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4289 => 0.4445, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.4203 => 0.4353, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.50% (1.5859 => 1.6414, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.4186 => 1.4676, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (14.3668 => 14.8438, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (2.0665 => 2.1315, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.14% (0.4048 => 0.4175, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.2024 => 2.2710, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.1840 => 1.2180, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.59% (0.8101 => 0.8311, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3062, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.03% (17.1811 => 17.3576, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.87% (1.1145 => 1.3694, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.1396 => 1.2148, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.11% (4.2280 => 4.3595, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7476, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.51% (0.9540 => 0.9684, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7879, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2237, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.65% (5.2763 => 3.2368, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.17% (5.3855 => 3.8683, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.78% (5.3526 => 3.8657, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0841, std.dev.: 0.0520) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.83% (2.9384 => 2.5909, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -8.68% (22.1758 => 20.2518, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2796, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.45% (1.8329 => 1.7147, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1509, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5017, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4116, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: -2.80% (1.2373 => 1.2026, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9991, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9949, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.21% (6.2999 => 6.2235, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (0.5229 => 0.5684, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.57% (14.9895 => 15.8247, std.dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: 3.83% (14.1553 => 14.6970, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (4.1105 => 4.3027, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.24% (1.1048 => 1.2179, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.14% (7.1582 => 7.3832, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.87% (3.4629 => 3.6661, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.6222 => 0.6352, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.11% (0.2116 => 0.0696, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 13:22:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 15:22:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920202210.BDD6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4064?compare_to=4058&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4064, Order: 164311, Start Time: 2012-09-20 17:39:45, End Time: 2012-09-20 20:23:35 To: 4058, Order: 164301, Start Time: 2012-09-20 13:51:27, End Time: 2012-09-20 16:35:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (117 on baseline) Performance Improvements: 6 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 962 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.48% (2.0495 => 2.1003, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.84% (0.6099 => 0.6211, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.92% (1.7502 => 1.7166, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.52% (1.0163 => 1.0009, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.43% (2.1757 => 2.1445, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.37% (24.8294 => 24.4902, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -1.16% (1.0423 => 1.0302, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.14% (12.0484 => 11.9110, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3446 => 0.3756, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.98% (0.3465 => 0.3776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.94% (0.3488 => 0.3800, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 8.94% (0.3469 => 0.3779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.90% (0.3460 => 0.3768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3496 => 0.3805, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.83% (0.3442 => 0.3746, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.60% (0.3650 => 0.3964, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3643 => 0.3956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.38% (0.3724 => 0.4036, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.75% (1.5932 => 1.7166, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.03% (1.6211 => 1.7188, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (0.4361 => 0.4616, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (0.4994 => 0.5283, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 5.74% (0.6634 => 0.7015, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.72% (1.3152 => 1.3904, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (3.5627 => 3.7592, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.36% (0.5000 => 0.5268, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.32% (2.7292 => 2.8743, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 5.30% (5.5417 => 5.8354, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.15% (1.0781 => 1.1336, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.07% (0.2566 => 0.2696, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (0.3930 => 0.4129, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 5.05% (0.5826 => 0.6120, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.04% (4.2109 => 4.4230, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 4.98% (0.5889 => 0.6182, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.91% (0.4029 => 0.4227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.2736 => 0.2869, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.65% (2.1013 => 2.1990, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.63% (0.3890 => 0.4070, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (1.8794 => 1.9659, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.56% (0.5546 => 0.5799, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (4.4195 => 4.6160, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (2.1653 => 2.2611, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 4.42% (4.6177 => 4.8217, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 4.42% (1.4269 => 1.4899, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.3903 => 0.4072, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.33% (0.3004 => 0.3134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.20% (0.4146 => 0.4320, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 4.12% (23.5202 => 24.4902, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.4139 => 0.4308, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.5900 => 0.6140, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.07% (0.3271 => 0.3404, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (0.4658 => 0.4847, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3195 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 3.98% (0.2691 => 0.2798, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.97% (0.9909 => 1.0302, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2813 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2792 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.86% (0.7171 => 0.7448, std.dev.: 0.0104) MultiSource/Applications/treecc/treecc: 3.82% (0.7875 => 0.8176, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3267 => 0.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3678 => 0.3816, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.75% (2.0346 => 2.1109, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.73% (2.0673 => 2.1445, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (1.9694 => 2.0422, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3477 => 0.3605, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4251 => 0.4407, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.3084 => 0.3197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.66% (0.3060 => 0.3172, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 3.63% (0.2811 => 0.2913, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 3.63% (0.3336 => 0.3457, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.60% (0.3362 => 0.3483, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.6435 => 0.6666, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.3845 => 0.3981, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (1.9966 => 2.0669, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3258 => 0.3372, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.47% (0.2969 => 0.3072, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.46% (0.3096 => 0.3203, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.38% (0.3726 => 0.3852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.38% (0.3348 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3690 => 0.3813, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (0.7426 => 0.7673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.22% (0.9697 => 1.0009, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.5012 => 0.5172, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 3.16% (0.4847 => 0.5000, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (0.5361 => 0.5522, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.81% (0.5584 => 0.5741, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (11.6398 => 11.9110, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.31% (4.6926 => 4.8010, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6763, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6328, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1968, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4457, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5855, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.01% (25.4195 => 16.5207, std.dev.: 0.0213) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7900, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.11% (17.2379 => 16.8747, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9574, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 13:26:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 15:26:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920202618.5DF822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4065?compare_to=4061&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4065, Order: 164314, Start Time: 2012-09-20 19:17:36, End Time: 2012-09-20 20:27:44 To: 4061, Order: 164311, Start Time: 2012-09-20 17:51:43, End Time: 2012-09-20 19:02:15 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 7 (51 on baseline) Performance Improvements: 1 (39 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4148 => 0.4255, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.55% (0.5721 => 0.5867, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.70% (0.5935 => 0.6036, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.39% (21.6139 => 22.5628, std.dev.: 0.1271) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.08% (0.6011 => 0.6136, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.83% (1.4009 => 1.4265, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 1.53% (3.3939 => 3.4457, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.07% (42.6770 => 42.2207, std.dev.: 0.1101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.38% (1.0089 => 0.9950, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.5976 => 0.5992, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.54% (0.1676 => 0.1685, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.96% (0.1556 => 0.1541, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.02% (0.3151 => 0.3119, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.95% (0.2361 => 0.2407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.47% (0.3200 => 0.3215, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (0.2239 => 0.2317, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -21.24% (0.0452 => 0.0356, std.dev.: 0.0046) SingleSource/UnitTests/2003-05-07-VarArgs: 91.30% (0.0046 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.12% (0.0089 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.17% (0.0223 => 0.0207, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.54% (0.0195 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.00% (0.0300 => 0.0258, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.46% (0.0285 => 0.0278, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0323 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.21% (0.0181 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.55% (0.0193 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 2.02% (0.0247 => 0.0252, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -5.23% (0.0325 => 0.0308, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.02% (0.1444 => 0.1386, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -3.15% (1.5161 => 1.4683, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.30% (0.1481 => 0.1447, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.91% (0.4079 => 0.4001, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1407 => 0.1443, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.48% (0.0601 => 0.0664, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.93% (0.0202 => 0.0188, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.79% (0.0623 => 0.0562, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: -56.00% (0.0025 => 0.0011, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1307 => 1.1270, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 118.18% (0.0011 => 0.0024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.85% (0.0610 => 0.0556, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.09% (0.0218 => 0.0196, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7664 => 0.7667, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.09% (1.5975 => 1.5960, std.dev.: 0.0099) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -52.07% (0.0121 => 0.0058, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -95.79% (0.0261 => 0.0011, std.dev.: 0.0017) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.13% (4.1772 => 3.0859, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.04% (0.1414 => 0.1556, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.90% (0.6410 => 0.6852, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 6.57% (0.5309 => 0.5658, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 5.95% (2.1763 => 2.3057, std.dev.: 0.0106) MultiSource/Applications/minisat/minisat: 4.07% (0.6173 => 0.6424, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3582 => 0.3720, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 3.63% (0.6915 => 0.7166, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.59% (0.3062 => 0.3172, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 3.51% (15.3105 => 15.8484, std.dev.: 0.1956) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3217 => 0.3325, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.1653 => 1.2037, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.7639 => 0.7856, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.5150 => 1.5580, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.70% (0.6069 => 0.6233, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.56% (29.3170 => 30.0687, std.dev.: 0.1651) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.22% (1.1672 => 1.1931, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.21% (0.5740 => 0.5867, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 2.00% (1.3268 => 1.3533, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (1.4408 => 1.4687, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.83% (1.1440 => 1.1649, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 1.09% (3.5980 => 3.6372, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (6.2546 => 6.3205, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.62% (0.0766 => 0.0901, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0015, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.46% (4.0101 => 4.5497, std.dev.: 0.0403) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.76% (0.2694 => 0.2957, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.96% (0.2857 => 0.3113, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 8.62% (7.0025 => 7.6062, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.42% (0.5876 => 0.6136, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.30% (40.4792 => 42.2207, std.dev.: 0.1101) SingleSource/Benchmarks/Misc/dt: 4.07% (0.9851 => 1.0252, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8220, std.dev.: 0.0513) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8731, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 3.10% (8.5113 => 8.7750, std.dev.: 0.0430) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8927, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/mason/mason: 2.58% (0.5004 => 0.5133, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.53% (4.2129 => 4.3194, std.dev.: 0.0121) MultiSource/Benchmarks/sim/sim: 2.51% (3.8907 => 3.9883, std.dev.: 0.0271) MultiSource/Applications/siod/siod: 2.25% (3.5520 => 3.6318, std.dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (2.4013 => 2.4505, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (2.4455 => 2.4956, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.05% (1.4117 => 1.4265, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.92% (0.3497 => 0.2136, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.42% (5.2665 => 4.0860, std.dev.: 0.0817) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -16.46% (1.1647 => 0.9730, std.dev.: 0.0264) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.35% (15.8312 => 13.2426, std.dev.: 0.1135) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0146) MultiSource/Applications/sgefa/sgefa: -11.24% (0.3746 => 0.3325, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -10.68% (0.1114 => 0.0995, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9394, std.dev.: 0.0363) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3789, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -6.74% (3.4230 => 3.1922, std.dev.: 0.0407) MultiSource/Benchmarks/FreeBench/distray/distray: -6.68% (0.2664 => 0.2486, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.63% (2.0027 => 1.8700, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3294, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3513, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.67% (3.6023 => 3.3980, std.dev.: 0.0601) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9605, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1845, std.dev.: 0.0395) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -4.37% (7.6833 => 7.3479, std.dev.: 0.0197) SingleSource/Benchmarks/McGill/misr: -3.07% (0.4296 => 0.4164, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -2.92% (9.2503 => 8.9798, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8296, std.dev.: 0.0314) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.79% (61.1734 => 59.4651, std.dev.: 0.5039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.72% (3.7496 => 3.6477, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2888, std.dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.54% (1.1683 => 1.1386, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -2.20% (92.7467 => 90.7044, std.dev.: 0.1680) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4228, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3684, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3075, std.dev.: 0.0579) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.38% (9.3855 => 9.2557, std.dev.: 0.0205) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4638, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.13% (16.5617 => 16.3750, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/oourafft: -1.03% (3.8200 => 3.7805, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.30% (0.9980 => 0.9950, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: -0.50% (0.6022 => 0.5992, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 1.14% (0.1666 => 0.1685, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.84% (0.1554 => 0.1541, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (0.3083 => 0.3119, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.54% (0.2394 => 0.2407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (0.3175 => 0.3215, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2302 => 0.2317, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -20.71% (0.0449 => 0.0356, std.dev.: 0.0046) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -13.75% (0.0240 => 0.0207, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.29% (0.0301 => 0.0258, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -5.23% (0.0325 => 0.0308, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.01% (0.1429 => 0.1386, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -2.24% (1.5019 => 1.4683, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.60% (0.1501 => 0.1447, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.17% (0.4264 => 0.4001, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.1344 => 0.1443, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.73% (0.0589 => 0.0664, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.97% (0.0232 => 0.0188, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.05% (0.0639 => 0.0562, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0006 => 0.0024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.72% (0.0637 => 0.0556, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.33% (0.0246 => 0.0196, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.67% (0.7541 => 0.7667, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.89% (1.5363 => 1.5960, std.dev.: 0.0099) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.14% (0.0070 => 0.0058, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 13:54:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 15:54:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920205427.22CAC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4066?compare_to=4062&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4066, Order: 164315, Start Time: 2012-09-20 19:41:33, End Time: 2012-09-20 20:55:52 To: 4062, Order: 164311, Start Time: 2012-09-20 17:58:45, End Time: 2012-09-20 19:13:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.85% (2.0176 => 2.3980, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.04% (0.1410 => 0.1622, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (3.9660 => 4.3316, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.95% (0.7710 => 0.8400, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.77% (0.7038 => 0.7655, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.64% (0.6959 => 0.7560, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 8.59% (1.3693 => 1.4869, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.53% (0.2721 => 0.2953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.50% (0.9199 => 0.9981, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.47% (0.5265 => 0.5711, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.47% (0.7061 => 0.7659, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.44% (1.2193 => 1.3222, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.36% (0.1327 => 0.1438, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.5818 => 0.6286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4328 => 0.4676, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.99% (1.1364 => 1.2272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.97% (1.4563 => 1.5723, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5748 => 0.6205, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 7.88% (13.8202 => 14.9096, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.55% (0.5577 => 0.5998, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.6283 => 0.6756, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.3899 => 0.4188, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.39% (0.3246 => 0.3486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4062 => 0.4359, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2781 => 0.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.20% (0.4791 => 0.5136, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.17% (1.0313 => 1.1052, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.10% (0.2914 => 0.3121, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.08% (1.1061 => 1.1844, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 7.05% (0.2995 => 0.3206, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.00% (0.3485 => 0.3729, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (3.8646 => 4.1316, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5637 => 0.6024, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (7.2180 => 7.7112, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.82% (0.3022 => 0.3228, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.81% (0.7506 => 0.8017, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.78% (0.7460 => 0.7966, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.75% (0.4016 => 0.4287, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.74% (0.2760 => 0.2946, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 6.73% (0.8310 => 0.8869, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.72% (0.4390 => 0.4685, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.63% (0.2655 => 0.2831, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.60% (0.3578 => 0.3814, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.56% (0.3293 => 0.3509, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.55% (0.4003 => 0.4265, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9092, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 6.53% (0.3646 => 0.3884, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.52% (0.3756 => 0.4001, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 6.51% (0.2243 => 0.2389, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.48% (0.3489 => 0.3715, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3789 => 0.4034, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.44% (0.3601 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.2966 => 0.3157, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.42% (1.9828 => 2.1101, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 6.41% (0.3914 => 0.4165, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3220 => 0.3426, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3650 => 0.3883, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.36% (0.3868 => 0.4114, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 6.35% (0.3940 => 0.4190, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.32% (0.3623 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.31% (0.2696 => 0.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.20% (2.1791 => 2.3141, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.03% (1.0594 => 1.1233, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.00% (3.1889 => 3.3803, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.97% (1.3245 => 1.4036, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.97% (1.9270 => 2.0420, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.95% (0.3107 => 0.3292, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.95% (0.6744 => 0.7145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (1.3819 => 1.4627, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.83% (0.3534 => 0.3740, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.71% (1.3813 => 1.4602, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.64% (16.6129 => 17.5500, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.63% (0.6576 => 0.6946, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 5.57% (1.2749 => 1.3459, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4113 => 0.4341, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.45% (14.8535 => 15.6629, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.44% (0.8698 => 0.9171, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6135 => 0.6464, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.36% (8.4961 => 8.9514, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6141, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6791, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 5.11% (0.3131 => 0.3291, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.05% (0.8818 => 0.9263, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.04% (13.2842 => 13.9531, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.02% (1.1333 => 1.1902, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.98% (0.3755 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2253, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (6.5754 => 6.8863, std.dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 4.54% (4.6629 => 4.8744, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.53% (0.3245 => 0.3392, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.2742 => 3.4212, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.20% (4.9865 => 5.1960, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.02% (0.4805 => 0.4998, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.97% (0.9108 => 0.9470, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2777, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.5188 => 1.5769, std.dev.: 0.0154) MultiSource/Applications/lua/lua: 3.66% (3.7467 => 3.8838, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.6250 => 0.6473, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (6.2785 => 6.4969, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (2.1007 => 2.1706, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.56% (33.2944 => 34.1479, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4958, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2658, std.dev.: 0.0505) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (1.0895 => 1.3502, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.89% (1.2998 => 1.3763, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6978, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5461, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0800, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5932, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5950, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.04% (1.4298 => 1.4447, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.45% (0.4657 => 0.3891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.55% (22.5627 => 21.7627, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2943, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.26% (1.3780 => 1.2917, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.75% (3.2729 => 3.1502, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: -3.50% (3.0263 => 2.9203, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5824, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8954, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2434, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2352, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.19% (4.1080 => 4.0593, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2616, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5633, std.dev.: 0.0114) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4350, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 14:37:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 16:37:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920213710.F2F4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4067?compare_to=4063&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4067, Order: 164316, Start Time: 2012-09-20 20:18:55, End Time: 2012-09-20 21:38:31 To: 4063, Order: 164311, Start Time: 2012-09-20 18:30:20, End Time: 2012-09-20 19:50:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (711 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.05% (3.8657 => 3.9061, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (15.1163 => 14.8011, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5684 => 0.5682, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.15% (15.8247 => 15.8489, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 0.32% (14.6970 => 14.7445, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 0.27% (81.6616 => 81.8805, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 0.25% (4.3027 => 4.3133, std.dev.: 0.0250) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.18% (1.2179 => 1.2201, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (7.3832 => 7.4061, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.43% (3.6661 => 3.6818, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.39% (0.6352 => 0.6377, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.74% (0.0696 => 0.0670, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.47% (63.2438 => 81.8805, std.dev.: 0.0082) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14244.17% (0.0720 => 10.3278, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.77% (10.3673 => 14.8011, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 30.09% (0.1622 => 0.2110, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.45% (2.2022 => 2.5425, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.43% (7.0540 => 8.0718, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.38% (1.7609 => 1.9437, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 9.55% (10.4361 => 11.4330, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3516 => 0.3846, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 9.35% (0.3561 => 0.3894, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.28% (0.1584 => 0.1731, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.3927 => 0.4291, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3828 => 0.4172, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.83% (0.3886 => 0.4229, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.20% (9.4845 => 10.1676, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 7.13% (0.1655 => 0.1773, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7433 => 0.7924, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4615 => 0.4905, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.28% (0.7115 => 0.7562, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.26% (5.7591 => 6.1197, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2271 => 0.2412, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.19% (0.2554 => 0.2712, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.11% (0.3109 => 0.3299, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.8172 => 0.8671, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.02% (0.6675 => 0.7077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (4.2646 => 4.5184, std.dev.: 0.0523) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5860 => 0.6208, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.87% (0.3423 => 0.3624, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (8.1363 => 8.6103, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.3050 => 1.3797, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.69% (3.3354 => 3.5252, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (1.5415 => 1.6283, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.62% (0.5105 => 0.5392, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5569 => 0.5878, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.49% (5.0018 => 5.2762, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7326 => 0.7727, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.8067 => 0.8508, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.47% (0.3092 => 0.3261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.44% (0.9765 => 1.0296, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.44% (0.7835 => 0.8261, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.42% (4.9449 => 5.2128, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.33% (0.2758 => 0.2905, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.16% (1.1642 => 1.2243, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.98% (3.8723 => 4.0650, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.94% (0.3441 => 0.3611, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.91% (0.3180 => 0.3336, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.79% (1.1861 => 1.2429, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.78% (7.9617 => 8.3420, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.72% (0.3387 => 0.3547, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.4103 => 0.4296, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.70% (1.0722 => 1.1226, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.66% (0.5020 => 0.5254, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.63% (0.6456 => 0.6755, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.54% (1.5603 => 1.6312, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.54% (21.9371 => 22.9325, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/lists: 4.53% (0.3422 => 0.3577, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.4064 => 0.4245, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.44% (2.0273 => 2.1173, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4636 => 0.4840, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.37% (0.2905 => 0.3032, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.32% (0.2891 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.32% (0.3865 => 0.4032, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.25% (0.3650 => 0.3805, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.21% (2.2969 => 2.3935, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6450 => 0.6720, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3826 => 0.3983, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.4203 => 0.4374, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5981 => 0.6221, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.4289 => 0.4461, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.95% (0.8921 => 0.9273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.2831 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.81% (2.0665 => 2.1452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.3098 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4620 => 0.4792, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.72% (0.3283 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.71% (0.4048 => 0.4198, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.70% (0.3052 => 0.3165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.70% (0.3162 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.4186 => 1.4693, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.50% (1.5859 => 1.6414, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (14.3668 => 14.8390, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (2.2024 => 2.2705, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.1840 => 1.2190, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.8101 => 0.8291, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.18% (1.2842 => 1.3122, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.05% (3.1595 => 3.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3499, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7883, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2251, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5831, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.01% (26.0924 => 26.3569, std.dev.: 0.0196) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2300, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.47% (5.3855 => 3.9063, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.02% (5.3526 => 3.9061, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1437, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.79% (2.9384 => 2.5920, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -8.72% (22.1758 => 20.2431, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3053, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.45% (1.8329 => 1.7146, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8046, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.00% (3.2827 => 3.1513, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4132, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9921, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.65% (1.2373 => 1.2045, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0096, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5785, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2261, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.66% (0.5229 => 0.5682, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.73% (14.9895 => 15.8489, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 4.16% (14.1553 => 14.7445, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (4.1105 => 4.3133, std.dev.: 0.0250) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.44% (1.1048 => 1.2201, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.46% (7.1582 => 7.4061, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.32% (3.4629 => 3.6818, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.6222 => 0.6377, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 14:52:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 16:52:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920215245.F14A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4068?compare_to=4065&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4068, Order: 164317, Start Time: 2012-09-20 20:43:42, End Time: 2012-09-20 21:54:10 To: 4065, Order: 164314, Start Time: 2012-09-20 19:17:36, End Time: 2012-09-20 20:27:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (48 on baseline) Performance Improvements: 11 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 885 (802 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 15.47% (0.7596 => 0.8771, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.92% (1.0861 => 1.1178, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.08% (2.6988 => 2.7549, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.19% (5.8704 => 5.9403, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: -4.92% (0.2052 => 0.1951, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.98% (0.7909 => 0.7594, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.66% (1.4282 => 1.3902, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: -2.53% (3.9254 => 3.8260, std.dev.: 0.0367) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (4.2891 => 4.2224, std.dev.: 0.0252) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (3.1276 => 3.0920, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.20% (22.5628 => 21.6149, std.dev.: 0.2941) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -1.87% (0.6136 => 0.6021, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -1.54% (1.4184 => 1.3965, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.51% (1.1207 => 1.1038, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.13% (0.9730 => 0.9620, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.23% (0.9950 => 0.9728, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.5992 => 0.5994, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -1.78% (0.1685 => 0.1655, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.23% (0.1541 => 0.1560, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.54% (0.3119 => 0.3071, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.62% (0.2407 => 0.2368, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.09% (0.3215 => 0.3180, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.45% (0.2317 => 0.2237, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 21.35% (0.0356 => 0.0432, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -40.91% (0.0088 => 0.0052, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-11-VaListArg: 4.44% (0.0090 => 0.0094, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.25% (0.0207 => 0.0192, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0385 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.73% (0.0258 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.08% (0.0278 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.85% (0.0321 => 0.0299, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -15.26% (0.0190 => 0.0161, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -2.78% (0.0252 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 6.82% (0.0308 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.38% (0.1386 => 0.1419, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 0.99% (1.4683 => 1.4829, std.dev.: 0.0307) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.32% (0.1447 => 0.1495, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.00% (0.4001 => 0.4241, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.55% (0.1443 => 0.1435, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.73% (0.0664 => 0.0606, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.23% (0.0188 => 0.0258, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0562 => 0.0565, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: -90.91% (0.0011 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1270 => 1.1277, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0024 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.18% (0.0556 => 0.0555, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.76% (0.0196 => 0.0221, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7667 => 0.7660, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -3.99% (1.5960 => 1.5323, std.dev.: 0.0326) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 81.03% (0.0058 => 0.0105, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.88% (4.1772 => 3.0962, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0007) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5309 => 0.5626, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.73% (0.6410 => 0.6777, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 5.50% (2.1763 => 2.2960, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.62% (0.2552 => 0.2670, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 3.86% (0.6173 => 0.6411, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 3.54% (15.3105 => 15.8523, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 3.38% (1.0046 => 1.0386, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 3.17% (0.6915 => 0.7134, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.1653 => 1.2017, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6069 => 0.6170, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 1.58% (2.0972 => 2.1303, std.dev.: 0.0113) MultiSource/Applications/hbd/hbd: 1.55% (1.3268 => 1.3473, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.54% (3.0225 => 3.0690, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0014, std.dev.: 0.0237) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.36% (0.0766 => 0.0876, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.96% (4.0101 => 4.5699, std.dev.: 0.0310) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.08% (1.0063 => 1.1178, std.dev.: 0.0063) SingleSource/Benchmarks/Stanford/Puzzle: 9.63% (0.1433 => 0.1571, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6038, std.dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 8.34% (21.1721 => 22.9378, std.dev.: 0.6385) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.98% (0.2694 => 0.2909, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.25% (40.4792 => 42.1998, std.dev.: 0.4006) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 3.95% (15.2242 => 15.8256, std.dev.: 0.0454) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.35% (2.6656 => 2.7549, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.21% (0.8498 => 0.8771, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5113 => 8.7611, std.dev.: 0.0507) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8996, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: 2.77% (3.8907 => 3.9985, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.72% (4.6127 => 4.7383, std.dev.: 0.0327) SingleSource/Benchmarks/Shootout-C++/hash: 2.50% (0.6308 => 0.6466, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.47% (0.5876 => 0.6021, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 2.44% (3.5520 => 3.6386, std.dev.: 0.0279) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 2.32% (2.4013 => 2.4571, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.4455 => 2.4763, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.17% (4.0659 => 4.1136, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (5.1938 => 5.2530, std.dev.: 0.0118) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4479, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.2080 => 0.1978, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -2.20% (0.7738 => 0.7568, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.04% (0.3497 => 0.2062, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.78% (5.2665 => 4.1195, std.dev.: 0.1261) SingleSource/Benchmarks/Shootout-C++/ary3: -20.08% (1.7473 => 1.3965, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.40% (1.1647 => 0.9620, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.48% (15.8312 => 13.2216, std.dev.: 0.1532) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.62% (3.6023 => 3.2198, std.dev.: 0.1120) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9406, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3776, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3336, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (3.4230 => 3.2056, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3558, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -5.51% (62.4126 => 58.9737, std.dev.: 0.2017) SingleSource/Benchmarks/Shootout/fib2: -5.34% (4.4195 => 4.1835, std.dev.: 0.0319) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -4.18% (7.6833 => 7.3618, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.81% (1.2722 => 1.2237, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.72% (0.4140 => 0.3986, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.24% (1.8739 => 1.8131, std.dev.: 0.0220) SingleSource/Benchmarks/McGill/misr: -3.21% (0.4296 => 0.4158, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -3.16% (9.2503 => 8.9583, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8295, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2931, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.55% (3.7496 => 3.6539, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/neural/neural: -2.17% (1.0926 => 1.0689, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -1.93% (3.4286 => 3.3625, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4204, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3146, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.73% (1.1683 => 1.1481, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2347, std.dev.: 0.0208) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.53% (1.0686 => 1.0522, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.28% (25.6658 => 25.3364, std.dev.: 0.0514) SingleSource/Benchmarks/Shootout-C++/lists: -1.23% (16.5617 => 16.3578, std.dev.: 0.0704) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.19% (1.7361 => 1.7154, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.53% (0.9980 => 0.9728, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: -0.46% (0.6022 => 0.5994, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -0.66% (0.1666 => 0.1655, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1554 => 0.1560, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (0.3083 => 0.3071, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.09% (0.2394 => 0.2368, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (0.3175 => 0.3180, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.82% (0.2302 => 0.2237, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -3.79% (0.0449 => 0.0432, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -41.57% (0.0089 => 0.0052, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-11-VaListArg: 4.44% (0.0090 => 0.0094, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.00% (0.0240 => 0.0192, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.72% (0.0324 => 0.0299, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -14.81% (0.0189 => 0.0161, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.70% (0.1429 => 0.1419, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.27% (1.5019 => 1.4829, std.dev.: 0.0307) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.40% (0.1501 => 0.1495, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.54% (0.4264 => 0.4241, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.77% (0.1344 => 0.1435, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.89% (0.0589 => 0.0606, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.21% (0.0232 => 0.0258, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.58% (0.0639 => 0.0565, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.64% (1.1350 => 1.1277, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0006 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.87% (0.0637 => 0.0555, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.16% (0.0246 => 0.0221, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.26% (1.5363 => 1.5323, std.dev.: 0.0326) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0070 => 0.0105, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 3.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 15:37:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 17:37:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120920223717.42AAB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4069?compare_to=4066&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4069, Order: 164317, Start Time: 2012-09-20 21:24:19, End Time: 2012-09-20 22:38:43 To: 4066, Order: 164315, Start Time: 2012-09-20 19:41:33, End Time: 2012-09-20 20:55:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.15% (2.0176 => 2.4040, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.25% (0.1410 => 0.1625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.51% (0.1588 => 0.1739, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.28% (3.9660 => 4.3339, std.dev.: 0.0137) MultiSource/Applications/hbd/hbd: 8.87% (1.3693 => 1.4908, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.86% (0.2596 => 0.2826, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.86% (0.7710 => 0.8393, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.5818 => 0.6325, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.70% (0.7038 => 0.7650, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.58% (0.5748 => 0.6241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.52% (0.9199 => 0.9983, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7061 => 0.7662, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.50% (1.2193 => 1.3229, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.40% (0.5265 => 0.5707, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.2721 => 0.2948, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.32% (0.6959 => 0.7538, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.10% (1.1364 => 1.2284, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.87% (1.4563 => 1.5709, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.85% (13.8202 => 14.9047, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.80% (0.6283 => 0.6773, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.3899 => 0.4203, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4062 => 0.4373, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1589 => 0.1710, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.58% (0.5577 => 0.6000, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3022 => 0.3248, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.46% (0.2760 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1435 => 0.1540, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.22% (0.4791 => 0.5137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.22% (0.4016 => 0.4306, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3246 => 0.3480, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.14% (1.0313 => 1.1049, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (1.9828 => 2.1239, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.05% (1.1061 => 1.1841, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.2914 => 0.3119, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.99% (0.2988 => 0.3197, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3756 => 0.4018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.5637 => 0.6029, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.94% (0.2995 => 0.3203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (7.2180 => 7.7188, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3107 => 0.3321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3453 => 0.3689, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.82% (0.7506 => 0.8018, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2761 => 0.2949, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.80% (3.8646 => 4.1273, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.77% (3.6692 => 3.9175, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 6.71% (0.8310 => 0.8868, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.58% (0.7460 => 0.7951, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.52% (0.3220 => 0.3430, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2023 => 0.2152, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.14% (2.1791 => 2.3129, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/trivial-interface: 6.09% (0.3578 => 0.3796, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.07% (3.1889 => 3.3824, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.04% (1.0594 => 1.1234, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.3245 => 1.4043, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/parameter-passing: 6.02% (0.4003 => 0.4244, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.01% (0.6576 => 0.6971, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/for-in: 5.99% (0.3789 => 0.4016, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: 5.97% (0.3601 => 0.3816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.95% (0.3646 => 0.3863, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.92% (0.6744 => 0.7143, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.92% (1.9270 => 2.0410, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.90% (1.3819 => 1.4634, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.89% (16.6129 => 17.5921, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.86% (0.3650 => 0.3864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.84% (0.3940 => 0.4170, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.82% (0.3623 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.81% (0.4113 => 0.4352, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.79% (1.3813 => 1.4613, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 5.77% (1.2749 => 1.3485, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.8698 => 0.9191, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.55% (14.8535 => 15.6777, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.54% (0.3755 => 0.3963, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.46% (0.2859 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.42% (4.3801 => 4.6175, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.41% (4.4433 => 4.6838, std.dev.: 0.0108) MultiSource/Benchmarks/mafft/pairlocalalign: 5.41% (8.4961 => 8.9558, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.33% (0.6135 => 0.6462, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.18% (0.8818 => 0.9275, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.11% (0.3131 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2504 => 0.2631, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2321 => 0.2438, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.00% (1.1333 => 1.1900, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.00% (13.2842 => 13.9482, std.dev.: 0.0167) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2257, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.78% (0.3245 => 0.3400, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (6.5754 => 6.8860, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 4.52% (4.6629 => 4.8736, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.2742 => 3.4213, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 4.46% (1.2292 => 1.2840, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.16% (4.9865 => 5.1939, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (0.9108 => 0.9481, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4805 => 0.5000, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (1.5188 => 1.5766, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.62% (3.7467 => 3.8824, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2785 => 6.5009, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.22% (2.1007 => 2.1684, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 2.57% (33.2944 => 34.1510, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5082, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std.dev.: 0.0516) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.92% (1.0895 => 1.3501, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.53% (1.1560 => 1.2546, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6972, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5483, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.93% (10.7476 => 11.0628, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5925, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.65% (22.5627 => 21.7384, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2963, std.dev.: 0.0252) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.74% (1.3780 => 1.2989, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1496, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.62% (1.7688 => 1.7047, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.43% (3.0263 => 2.9224, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5788, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9066, std.dev.: 0.0318) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (0.6615 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2393, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0596, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2451, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8723, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4332, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2603, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 16:19:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 18:19:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120920231939.755782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4070?compare_to=4068&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4070, Order: 164320, Start Time: 2012-09-20 22:10:04, End Time: 2012-09-20 23:21:07 To: 4068, Order: 164317, Start Time: 2012-09-20 20:43:42, End Time: 2012-09-20 21:54:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (41 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 891 (809 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.89% (0.5388 => 0.5759, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 10.64% (3.0430 => 3.3667, std.dev.: 0.1245) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (0.3415 => 0.3560, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.62% (1.3412 => 1.3898, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.58% (21.6149 => 22.1719, std.dev.: 0.1382) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.30% (1.8131 => 1.8548, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.14% (42.1998 => 43.1020, std.dev.: 0.3056) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.67% (4.1195 => 4.1884, std.dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/spiff/spiff: -1.78% (2.8977 => 2.8462, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.21% (0.9728 => 0.9943, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -0.18% (0.5994 => 0.5983, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -2.18% (0.1655 => 0.1619, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.83% (0.1560 => 0.1547, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.23% (0.3071 => 0.3064, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2368 => 0.2368, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.35% (0.3180 => 0.3137, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.2237 => 0.2336, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: 4.17% (0.0432 => 0.0450, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: 67.31% (0.0052 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -5.32% (0.0094 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.33% (0.0192 => 0.0176, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0385 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.68% (0.0296 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0281 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.35% (0.0299 => 0.0318, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0178 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 17.39% (0.0161 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.52% (0.0329 => 0.0324, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1419 => 0.1422, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -6.02% (1.4829 => 1.3937, std.dev.: 0.0572) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.41% (0.1495 => 0.1429, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4241 => 0.4069, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.27% (0.1435 => 0.1345, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0606 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.13% (0.0258 => 0.0188, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0565 => 0.0565, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 4700.00% (0.0001 => 0.0048, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1277 => 1.1300, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.41% (0.0555 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.82% (0.0221 => 0.0133, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.7660 => 0.7681, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.31% (1.5323 => 1.5983, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.24% (0.0105 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.75% (4.1772 => 3.1014, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/except: 82933.33% (0.0006 => 0.4982, std.dev.: 0.0013) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.82% (0.5309 => 0.5671, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.96% (0.6410 => 0.6792, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 5.42% (2.1763 => 2.2943, std.dev.: 0.0372) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.2552 => 0.2657, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 3.69% (0.6915 => 0.7170, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3062 => 0.3169, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.41% (0.3582 => 0.3704, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 3.18% (1.0046 => 1.0365, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 3.18% (0.6173 => 0.6369, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.59% (0.7639 => 0.7837, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 2.17% (1.3268 => 1.3556, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6069 => 0.6200, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.62% (1.1440 => 1.1625, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.46% (1.2021 => 1.2196, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.34% (3.0225 => 3.0630, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 1.17% (2.0972 => 2.1217, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.50% (1.6538 => 2.3402, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.51% (4.0101 => 4.5921, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.74% (1.0063 => 1.1043, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.93% (0.2857 => 0.3112, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 8.47% (7.0025 => 7.5953, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.85% (0.3301 => 0.3560, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.48% (40.4792 => 43.1020, std.dev.: 0.3056) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.11% (4.2129 => 4.4280, std.dev.: 0.0473) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8773, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/dt: 4.21% (0.9851 => 1.0266, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0157) MultiSource/Benchmarks/sim/sim: 3.03% (3.8907 => 4.0084, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8986, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.26% (0.5876 => 0.6009, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.17% (3.5520 => 3.6290, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: 1.94% (2.4013 => 2.4478, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.52% (4.6127 => 4.6828, std.dev.: 0.0233) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.95% (0.7738 => 0.7587, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.63% (4.3380 => 4.2674, std.dev.: 0.0258) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.43% (1.4189 => 1.3986, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.35% (0.3497 => 0.2051, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -20.96% (1.7473 => 1.3811, std.dev.: 0.0393) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.47% (5.2665 => 4.1884, std.dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.61% (1.1647 => 0.9596, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.73% (15.8312 => 13.1821, std.dev.: 0.2477) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.65% (0.0917 => 0.0801, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std.dev.: 0.0351) MultiSource/Applications/sgefa/sgefa: -11.00% (0.3746 => 0.3334, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (3.2007 => 2.9478, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: -6.73% (3.4230 => 3.1925, std.dev.: 0.0284) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.64% (3.6254 => 3.3845, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/fibo: -6.49% (4.6355 => 4.3348, std.dev.: 0.0390) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.32% (1.4441 => 1.3529, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (62.4126 => 58.9193, std.dev.: 0.1312) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1863, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.14% (7.6833 => 7.3652, std.dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.09% (1.2722 => 1.2202, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2865, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.68% (1.1683 => 1.1370, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -2.52% (9.2503 => 9.0174, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.52% (3.7496 => 3.6552, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4181, std.dev.: 0.0234) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3634, std.dev.: 0.0168) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.87% (2.4457 => 2.3999, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2316, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3077, std.dev.: 0.0521) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4640, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.37% (0.9980 => 0.9943, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -0.65% (0.6022 => 0.5983, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -2.82% (0.1666 => 0.1619, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.45% (0.1554 => 0.1547, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.62% (0.3083 => 0.3064, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.09% (0.2394 => 0.2368, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (0.3175 => 0.3137, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.48% (0.2302 => 0.2336, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.67% (0.0240 => 0.0176, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -7.20% (1.5019 => 1.3937, std.dev.: 0.0572) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.80% (0.1501 => 0.1429, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.57% (0.4264 => 0.4069, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.07% (0.1344 => 0.1345, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.89% (0.0589 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.97% (0.0232 => 0.0188, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.58% (0.0639 => 0.0565, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1350 => 1.1300, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.16% (0.0637 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.93% (0.0246 => 0.0133, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.86% (0.7541 => 0.7681, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.04% (1.5363 => 1.5983, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 16:25:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 18:25:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120920232530.BB9F82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4071?compare_to=4067&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4071, Order: 164318, Start Time: 2012-09-20 22:07:12, End Time: 2012-09-20 23:26:57 To: 4067, Order: 164316, Start Time: 2012-09-20 20:18:55, End Time: 2012-09-20 21:38:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (137 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (710 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.56% (55.1367 => 56.5489, std.dev.: 0.0532) MultiSource/Benchmarks/llubenchmark/llu: 1.40% (3.7995 => 3.8526, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.5682 => 0.5692, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 0.02% (15.8489 => 15.8517, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 0.13% (14.7445 => 14.7631, std.dev.: 0.0246) MultiSource/Benchmarks/Bullet/bullet: -0.00% (81.8805 => 81.8782, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.3133 => 4.3152, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2201 => 1.2199, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.4061 => 7.4033, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.04% (3.6818 => 3.6831, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.6377 => 0.6364, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.13% (0.0670 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 29.46% (63.2438 => 81.8782, std.dev.: 0.0198) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14244.44% (0.0720 => 10.3280, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.75% (10.3673 => 14.7989, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 30.15% (0.1622 => 0.2111, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.39% (2.2022 => 2.5412, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.43% (7.0540 => 8.0722, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 12.71% (0.1432 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.94% (0.1566 => 0.1753, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.36% (1.7609 => 1.9433, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3473 => 0.3809, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.51% (10.4361 => 11.4282, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/oourafft: 9.48% (0.3282 => 0.3593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.47% (0.3516 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3497 => 0.3827, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3543 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.40% (0.3543 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.35% (0.3561 => 0.3894, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1584 => 0.1732, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 9.01% (0.3927 => 0.4281, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.96% (0.3828 => 0.4171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.78% (0.3886 => 0.4227, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.31% (0.1655 => 0.1776, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.14% (9.4845 => 10.1621, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.47% (0.7433 => 0.7914, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 6.47% (0.3109 => 0.3310, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2554 => 0.2718, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.37% (0.5860 => 0.6233, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.35% (0.8172 => 0.8691, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 6.29% (5.7591 => 6.1216, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4615 => 0.4904, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.16% (0.7115 => 0.7553, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.11% (0.6675 => 0.7083, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.99% (0.2271 => 0.2407, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (4.2646 => 4.5193, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 5.93% (0.3423 => 0.3626, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (1.5415 => 1.6329, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (8.1363 => 8.6165, std.dev.: 0.0103) SingleSource/UnitTests/ObjC++/Hello: 5.87% (0.5925 => 0.6273, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.82% (0.6030 => 0.6381, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.81% (1.3050 => 1.3808, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.74% (3.3354 => 3.5267, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.71% (0.5569 => 0.5887, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.5105 => 0.5394, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.8067 => 0.8521, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.3092 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.56% (5.0018 => 5.2797, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2758 => 0.2911, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 5.49% (0.7835 => 0.8265, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.43% (4.9449 => 5.2134, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9765 => 1.0292, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 5.32% (1.1642 => 1.2261, std.dev.: 0.0110) SingleSource/UnitTests/ObjC++/property-reference: 5.11% (0.7326 => 0.7700, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 5.04% (3.8723 => 4.0675, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/09-vor/vor: 5.00% (0.3180 => 0.3339, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.3441 => 0.3613, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (1.1861 => 1.2437, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.82% (0.4299 => 0.4506, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.4103 => 0.4300, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (7.9617 => 8.3377, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2603 => 0.2725, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.63% (1.0722 => 1.1218, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3422 => 0.3579, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.58% (21.9371 => 22.9411, std.dev.: 0.0165) MultiSource/Benchmarks/sim/sim: 4.58% (0.3387 => 0.3542, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.54% (0.6456 => 0.6749, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.48% (1.5603 => 1.6302, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 4.43% (2.0273 => 2.1172, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.4064 => 0.4243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.27% (0.3865 => 0.4030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.25% (0.3650 => 0.3805, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 4.24% (2.2969 => 2.3944, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6450 => 0.6720, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.2905 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.05% (0.5981 => 0.6223, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3826 => 0.3980, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8921 => 0.9280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.97% (0.3098 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4203 => 0.4368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.92% (0.2831 => 0.2942, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.85% (2.0665 => 2.1460, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4620 => 0.4795, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2872 => 0.2980, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (1.5859 => 1.6448, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.66% (0.4048 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3232 => 0.3350, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.4186 => 1.4702, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 3.62% (0.2871 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (0.3935 => 0.4077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.58% (0.2793 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.58% (0.3603 => 0.3732, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3684 => 0.3810, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (14.3668 => 14.8438, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.12% (2.2024 => 2.2712, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.1840 => 1.2195, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.8101 => 0.8286, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.14% (1.2842 => 1.3117, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.86% (1.1145 => 1.3693, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.06% (3.1595 => 3.4142, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3861, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3479, std.dev.: 0.0088) MultiSource/Benchmarks/llubenchmark/llu: 1.97% (3.7781 => 3.8526, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.25% (11.6436 => 11.7891, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2255, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.83% (5.2763 => 3.2274, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.47% (5.3855 => 3.9059, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.06% (5.3526 => 3.9044, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1256, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.80% (2.9384 => 2.5916, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: -8.65% (22.1758 => 20.2566, std.dev.: 0.0393) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2745, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4840, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7159, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5112, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5075, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -3.03% (1.2373 => 1.1998, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4331, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9927, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9908, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5770, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2304, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.85% (0.5229 => 0.5692, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 5.75% (14.9895 => 15.8517, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 4.29% (14.1553 => 14.7631, std.dev.: 0.0246) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (4.1105 => 4.3152, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.42% (1.1048 => 1.2199, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.42% (7.1582 => 7.4033, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.36% (3.4629 => 3.6831, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6222 => 0.6364, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 16:34:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 18:34:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120920233434.7F3222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4072?compare_to=4064&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4072, Order: 164317, Start Time: 2012-09-20 20:52:09, End Time: 2012-09-20 23:36:00 To: 4064, Order: 164311, Start Time: 2012-09-20 17:39:45, End Time: 2012-09-20 20:23:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (124 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (770 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.41% (54.0926 => 54.8575, std.dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.34% (0.3488 => 0.3779, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 8.31% (0.3465 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3446 => 0.3730, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.24% (0.3460 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3496 => 0.3783, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3469 => 0.3753, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3442 => 0.3723, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.04% (0.3643 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.00% (0.3650 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.3724 => 0.4016, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.84% (1.5932 => 1.7181, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (0.4361 => 0.4640, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (1.6211 => 1.7179, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (1.3152 => 1.3912, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.67% (1.0781 => 1.1392, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7628, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 5.58% (0.5826 => 0.6151, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.5889 => 0.6217, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.26% (5.5417 => 5.8330, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.13% (2.7292 => 2.8691, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.2866 => 0.3012, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 5.06% (0.6634 => 0.6970, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (0.5000 => 0.5253, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (0.5026 => 0.5279, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3060 => 0.3213, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2875 => 0.3012, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7171 => 0.7512, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.71% (0.2780 => 0.2911, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.69% (4.2109 => 4.4086, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.69% (0.3195 => 0.3345, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.2736 => 0.2864, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.64% (0.4029 => 0.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.64% (0.2823 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.59% (0.2811 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.58% (0.2792 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.54% (0.5546 => 0.5798, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (2.0673 => 2.1603, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.3271 => 0.3418, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.49% (0.9909 => 1.0354, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.48% (2.1013 => 2.1955, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (0.3890 => 0.4064, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.47% (0.2911 => 0.3041, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.40% (4.6177 => 4.8210, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.35% (23.5202 => 24.5444, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/gs/gs: 4.35% (1.8794 => 1.9611, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (4.4195 => 4.6111, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (2.1653 => 2.2589, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2803 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.29% (0.4658 => 0.4858, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.25% (0.3690 => 0.3847, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.23% (1.4269 => 1.4873, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3096 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.23% (0.3903 => 0.4068, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.20% (0.3477 => 0.3623, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3124 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.2969 => 0.3093, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3348 => 0.3487, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.11% (0.3726 => 0.3879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3317 => 0.3453, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.4139 => 0.4307, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.06% (0.6435 => 0.6696, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.3678 => 0.3827, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4251 => 0.4421, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.99% (0.3084 => 0.3207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (1.9694 => 2.0465, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.90% (0.3336 => 0.3466, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.2737 => 0.2843, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.85% (0.7875 => 0.8178, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 3.77% (2.0346 => 2.1113, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.77% (0.3981 => 0.4131, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.75% (0.5012 => 0.5200, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.46% (1.9966 => 2.0657, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 3.40% (0.4847 => 0.5012, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (0.7426 => 0.7674, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.32% (0.9697 => 1.0019, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (0.5361 => 0.5527, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (0.5584 => 0.5750, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.52% (11.6398 => 11.9337, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.6926 => 4.8097, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6711, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8948, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1618, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6360, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1943, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5056, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4607, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2820, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6052, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4484, std.dev.: 0.0212) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5606, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7889, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.42% (17.2379 => 16.8205, std.dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5736, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9686, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7161, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 17:20:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 19:20:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921002009.891492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4073?compare_to=4069&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4073, Order: 164324, Start Time: 2012-09-20 23:07:12, End Time: 2012-09-21 00:21:33 To: 4069, Order: 164317, Start Time: 2012-09-20 21:24:19, End Time: 2012-09-20 22:38:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 18.66% (2.0176 => 2.3940, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 13.32% (0.0826 => 0.0936, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.84% (0.1413 => 0.1552, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.04% (3.9660 => 4.3246, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5265 => 0.5734, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.78% (0.2596 => 0.2824, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.75% (0.7710 => 0.8385, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 8.68% (0.7038 => 0.7649, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.65% (1.3693 => 1.4878, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 8.61% (0.7061 => 0.7669, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.54% (0.9199 => 0.9985, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.32% (1.2193 => 1.3208, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.2721 => 0.2947, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.29% (0.1327 => 0.1437, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.5818 => 0.6300, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.26% (0.6959 => 0.7534, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 8.11% (0.4328 => 0.4679, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.09% (1.1364 => 1.2283, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5748 => 0.6211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.78% (1.4563 => 1.5696, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 7.68% (13.8202 => 14.8822, std.dev.: 0.0126) SingleSource/Benchmarks/McGill/chomp: 7.68% (0.1589 => 0.1711, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.62% (0.6283 => 0.6762, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.42% (0.5577 => 0.5991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4062 => 0.4359, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.31% (0.3899 => 0.4184, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.25% (0.2995 => 0.3212, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1435 => 0.1538, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.15% (0.2782 => 0.2981, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.13% (1.0313 => 1.1048, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1849, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.10% (0.2127 => 0.2278, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.09% (0.3246 => 0.3476, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.07% (0.2914 => 0.3120, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.98% (0.3022 => 0.3233, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (0.4379 => 0.4684, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.85% (0.5637 => 0.6023, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 6.83% (0.7506 => 0.8019, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.76% (0.3580 => 0.3822, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (7.2180 => 7.7041, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.72% (0.4016 => 0.4286, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2607 => 0.2782, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.69% (0.8310 => 0.8866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.63% (0.3756 => 0.4005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.63% (0.2655 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.62% (3.8646 => 4.1205, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (1.9828 => 2.1130, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.56% (0.2988 => 0.3184, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (3.6692 => 3.9092, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.2966 => 0.3159, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.47% (0.3293 => 0.3506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.43% (0.7460 => 0.7940, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.43% (0.2925 => 0.3113, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.28% (0.3868 => 0.4111, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.27% (0.3220 => 0.3422, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.18% (0.2023 => 0.2148, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.97% (1.3245 => 1.4036, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.97% (2.1791 => 2.3091, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.96% (0.4113 => 0.4358, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (1.2749 => 1.3508, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.92% (1.0594 => 1.1221, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.91% (3.1889 => 3.3774, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 5.90% (0.6744 => 0.7142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3534 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.82% (0.6576 => 0.6959, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 5.82% (1.9270 => 2.0392, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (1.3819 => 1.4619, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.3813 => 1.4598, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 5.68% (16.6129 => 17.5559, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 5.62% (0.4003 => 0.4228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.56% (0.3578 => 0.3777, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.54% (0.3646 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.52% (0.3914 => 0.4130, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.50% (0.3601 => 0.3799, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.49% (14.8535 => 15.6693, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/for-in: 5.49% (0.3789 => 0.3997, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (0.8698 => 0.9174, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.43% (0.3663 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.42% (0.3650 => 0.3848, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.40% (0.8818 => 0.9294, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.39% (0.2859 => 0.3013, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 5.38% (0.3940 => 0.4152, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6136, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.33% (0.6135 => 0.6462, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 5.33% (0.3623 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.31% (8.4961 => 8.9472, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.29% (4.4433 => 4.6783, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3755 => 0.3946, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.05% (0.3131 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.99% (13.2842 => 13.9474, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (1.1333 => 1.1872, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.72% (14.5298 => 15.2161, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (6.5754 => 6.8829, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.62% (0.3245 => 0.3395, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.51% (4.6629 => 4.8731, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.50% (3.2742 => 3.4216, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.07% (0.9108 => 0.9479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (4.9865 => 5.1875, std.dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.2292 => 1.2785, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4805 => 0.4996, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.88% (1.5188 => 1.5778, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6250 => 0.6485, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 3.50% (3.7467 => 3.8777, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (6.2785 => 6.4877, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1007 => 2.1703, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.31% (33.2944 => 34.0619, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5006, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5118, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (1.0895 => 1.3503, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6968, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5464, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.98% (10.7476 => 11.0679, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5991, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.20% (0.4657 => 0.3856, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (22.5627 => 21.7176, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2968, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std.dev.: 0.0144) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5125, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.48% (3.0263 => 2.9210, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5880, std.dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.30% (26.5159 => 25.9057, std.dev.: 0.0189) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.13% (0.6615 => 0.6474) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9919, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8617, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2371, std.dev.: 0.0308) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2258, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (4.1080 => 4.0617, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5619, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0310 => 1.0203, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 17:47:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 19:47:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921004707.25DB92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4074?compare_to=4070&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4074, Order: 164330, Start Time: 2012-09-20 23:37:42, End Time: 2012-09-21 00:48:34 To: 4070, Order: 164320, Start Time: 2012-09-20 22:10:04, End Time: 2012-09-20 23:21:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (47 on baseline) Performance Improvements: 2 (35 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (808 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 39.58% (0.0288 => 0.0402, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.7471 => 0.7921, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.70% (0.4331 => 0.4578, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.5376 => 1.5644, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 1.71% (0.7587 => 0.7717, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.48% (1.1730 => 1.1904, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (8.1489 => 8.2611, std.dev.: 0.0403) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.49% (20.2358 => 22.3587, std.dev.: 0.2766) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -2.46% (7.3652 => 7.1840, std.dev.: 0.0427) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.37% (1.1043 => 1.0892, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.56% (0.9943 => 0.9999, std.dev.: 0.0256) MultiSource/Applications/sqlite3/sqlite3: 0.69% (0.5983 => 0.6024, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 3.34% (0.1619 => 0.1673, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.84% (0.1547 => 0.1560, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (0.3064 => 0.3058, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.15% (0.2368 => 0.2246, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (0.3137 => 0.3172, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.40% (0.2336 => 0.2280, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -11.11% (0.0450 => 0.0400, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -65.17% (0.0089 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 27.27% (0.0176 => 0.0224, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.63% (0.0190 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0385 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.01% (0.0298 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0282 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.89% (0.0318 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0178 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 2.85% (0.0246 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0324 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.25% (0.1422 => 0.1454, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.84% (1.3937 => 1.4611, std.dev.: 0.0402) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.66% (0.1429 => 0.1467, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.30% (0.4069 => 0.4016, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.1345 => 0.1461, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.66% (0.0606 => 0.0602, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.13% (0.0188 => 0.0239, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0565 => 0.0568, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.08% (0.0048 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1300 => 1.1312, std.dev.: 0.0285) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.03% (0.0585 => 0.0538, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 66.17% (0.0133 => 0.0221, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7681 => 0.7651, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.65% (1.5983 => 1.5879, std.dev.: 0.0120) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.65% (4.1772 => 3.1057, std.dev.: 0.0658) SingleSource/Benchmarks/Shootout-C++/except: 81450.00% (0.0006 => 0.4893, std.dev.: 0.0087) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.28% (0.0745 => 0.0911, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.26% (0.6410 => 0.6811, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: 5.96% (2.1763 => 2.3059, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 5.71% (0.5309 => 0.5612, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.60% (0.6173 => 0.6457, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 4.31% (1.0046 => 1.0479, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3582 => 0.3728, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.2552 => 0.2653, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.6915 => 0.7163, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3217 => 0.3331, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.5150 => 1.5644, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.08% (0.3901 => 0.4021, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 2.76% (29.3170 => 30.1250, std.dev.: 0.1957) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.73% (0.4248 => 0.4364, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.29% (3.0225 => 3.0917, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.7639 => 0.7810, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.03% (0.6069 => 0.6192, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.99% (1.1672 => 1.1904, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.83% (0.7226 => 0.7358, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 1.41% (3.5980 => 3.6489, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.58% (0.0917 => 0.1069, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.0766 => 0.0878, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0273) SingleSource/Benchmarks/Stanford/Puzzle: 14.03% (0.1433 => 0.1634, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5476, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.81% (7.0025 => 7.6196, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.44% (0.2857 => 0.3098, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.24% (1.0063 => 1.0892, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.60% (21.1721 => 22.3587, std.dev.: 0.2766) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3301 => 0.3472, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 4.04% (15.2242 => 15.8392, std.dev.: 0.0260) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5421, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.87% (14.4877 => 14.9032, std.dev.: 0.0922) MultiSource/Applications/siod/siod: 2.72% (3.5520 => 3.6486, std.dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/dry: 2.11% (2.4013 => 2.4519, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (2.4455 => 2.4956, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.96% (4.6127 => 4.7032, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.80% (0.5876 => 0.5982, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.02% (27.1724 => 27.4496, std.dev.: 0.0479) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0917, std.dev.: 0.1180) SingleSource/Benchmarks/Shootout-C++/ary3: -20.71% (1.7473 => 1.3855, std.dev.: 0.0519) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.1647 => 0.9597, std.dev.: 0.0314) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.12% (15.8312 => 13.2790, std.dev.: 0.1577) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9436, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3755, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: -6.61% (4.6355 => 4.3293, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -6.50% (7.6833 => 7.1840, std.dev.: 0.0427) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3533, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -6.12% (3.4230 => 3.2135, std.dev.: 0.0635) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9306, std.dev.: 0.1160) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1868, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.04% (1.2722 => 1.2208, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.61% (1.4021 => 1.3515, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.59% (1.1683 => 1.1264, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9439, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.28% (3.7496 => 3.6640, std.dev.: 0.0321) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4198, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -1.94% (3.4286 => 3.3620, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2355, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: -1.44% (92.7467 => 91.4119, std.dev.: 0.1878) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/fldry: -1.30% (2.4971 => 2.4646, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.10% (1.8739 => 1.8533, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.19% (0.9980 => 0.9999, std.dev.: 0.0256) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.6022 => 0.6024, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 0.42% (0.1666 => 0.1673, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1554 => 0.1560, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.81% (0.3083 => 0.3058, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.18% (0.2394 => 0.2246, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3175 => 0.3172, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.96% (0.2302 => 0.2280, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -10.91% (0.0449 => 0.0400, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -65.56% (0.0090 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.67% (0.0240 => 0.0224, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.75% (0.1429 => 0.1454, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -2.72% (1.5019 => 1.4611, std.dev.: 0.0402) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.27% (0.1501 => 0.1467, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.82% (0.4264 => 0.4016, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1344 => 0.1461, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.21% (0.0589 => 0.0602, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.02% (0.0232 => 0.0239, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.11% (0.0639 => 0.0568, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1350 => 1.1312, std.dev.: 0.0285) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.54% (0.0637 => 0.0538, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.16% (0.0246 => 0.0221, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.36% (1.5363 => 1.5879, std.dev.: 0.0120) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 18:13:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 20:13:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921011342.4C4102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4075?compare_to=4071&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4075, Order: 164332, Start Time: 2012-09-20 23:55:32, End Time: 2012-09-21 01:15:07 To: 4071, Order: 164318, Start Time: 2012-09-20 22:07:12, End Time: 2012-09-20 23:26:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (131 on baseline) Performance Improvements: 4 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 941 (719 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.71% (14.7989 => 15.1993, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5770 => 4.6424, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.25% (2.9133 => 2.9498, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.13% (1.3693 => 1.3848) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.1998 => 1.2128, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (2.5412 => 2.5007, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.16% (3.9059 => 3.8606, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.08% (3.9044 => 3.8621, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -1.06% (26.3311 => 26.0512, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5692 => 0.5700, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 0.06% (15.8517 => 15.8605, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: -0.28% (14.7631 => 14.7220, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 0.98% (81.8782 => 82.6812, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 0.15% (4.3152 => 4.3215, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2199 => 1.2201, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (7.4033 => 7.3924, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.17% (3.6831 => 3.6767, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.27% (0.6364 => 0.6381, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.0649 => 0.0686, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.73% (63.2438 => 82.6812, std.dev.: 0.0079) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14282.08% (0.0720 => 10.3551, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.61% (10.3673 => 15.1993, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 25.22% (0.1622 => 0.2031, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.55% (2.2022 => 2.5007, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.42% (7.0540 => 8.0008, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.20% (0.1566 => 0.1757, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.96% (1.1194 => 1.2533, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.43% (1.7609 => 1.9446, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 9.55% (10.4361 => 11.4328, std.dev.: 0.0103) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.87% (0.3473 => 0.3781, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 8.71% (0.3282 => 0.3568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.64% (0.3543 => 0.3849, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3516 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.51% (0.3561 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.36% (0.3694 => 0.4003, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3828 => 0.4147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.30% (0.3927 => 0.4253, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 8.21% (0.3886 => 0.4205, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 7.20% (9.4845 => 10.1677, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7433 => 0.7948, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.66% (0.3109 => 0.3316, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.2554 => 0.2715, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.30% (5.7591 => 6.1219, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.22% (0.6675 => 0.7090, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2700 => 0.2867, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 6.16% (0.7115 => 0.7553, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.08% (0.1695 => 0.1798, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.8172 => 0.8664, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (4.2646 => 4.5194, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 5.96% (0.3423 => 0.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.95% (0.5105 => 0.5409, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5860 => 0.6207, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 5.92% (3.3354 => 3.5327, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.3050 => 1.3816, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.5415 => 1.6318, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.8067 => 0.8531, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.73% (8.1363 => 8.6022, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3121 => 0.3297, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.63% (0.9765 => 1.0315, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.60% (0.5569 => 0.5881, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.44% (0.2758 => 0.2908, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.43% (4.9449 => 5.2136, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (5.0018 => 5.2731, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.32% (1.1642 => 1.2261, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (0.3092 => 0.3256, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.29% (1.5603 => 1.6428, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.27% (0.7835 => 0.8248, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.06% (0.3441 => 0.3615, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.95% (1.1861 => 1.2448, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 4.95% (0.5925 => 0.6218, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.92% (1.0722 => 1.1250, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 4.91% (3.8723 => 4.0623, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.83% (0.4103 => 0.4301, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.81% (0.3387 => 0.3550, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.2603 => 0.2727, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.73% (0.6030 => 0.6315, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.5020 => 0.5253, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (7.9617 => 8.3307, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 4.58% (0.6456 => 0.6752, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.45% (2.0273 => 2.1176, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 4.40% (2.2969 => 2.3979, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.3422 => 0.3572, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.4064 => 0.4242, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.36% (0.4636 => 0.4838, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9371 => 22.8888, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8921 => 0.9303, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.3650 => 0.3803, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.17% (0.6450 => 0.6719, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.15% (0.7326 => 0.7630, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3826 => 0.3984, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.5981 => 0.6227, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.97% (1.5859 => 1.6489, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4289 => 0.4459, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3865 => 0.4018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.4048 => 0.4206, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.82% (0.2905 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2831 => 0.2938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.76% (0.3136 => 0.3254, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.4186 => 1.4719, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.70% (0.3162 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.3098 => 0.3212, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3232 => 0.3350, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (2.0665 => 2.1412, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 3.55% (0.2871 => 0.2973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.52% (0.2872 => 0.2973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.51% (0.3052 => 0.3159, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (2.2024 => 2.2792, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 3.47% (0.3603 => 0.3728, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (14.3668 => 14.8635, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3684 => 0.3809, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.1840 => 1.2235, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.8101 => 0.8278, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.14% (1.2842 => 1.3117, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.19% (17.1811 => 17.3859, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.8922 => 3.9323, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3852, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.07% (4.2280 => 4.3576, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7860, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.44% (5.2763 => 3.2479, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.31% (5.3855 => 3.8606, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.85% (5.3526 => 3.8621, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1078, std.dev.: 0.0527) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.99% (2.9384 => 2.5860, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -8.51% (22.1758 => 20.2894, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2985, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4836, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.48% (1.8329 => 1.7141, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5834, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5136, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4308, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9965, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3296, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -1.98% (1.2373 => 1.2128, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0061, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.01% (0.5229 => 0.5700, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.81% (14.9895 => 15.8605, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 4.00% (14.1553 => 14.7220, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (4.1105 => 4.3215, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.44% (1.1048 => 1.2201, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (7.1582 => 7.3924, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.17% (3.4629 => 3.6767, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.6222 => 0.6381, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 19:03:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 21:03:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921020319.1C4A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4076?compare_to=4073&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4076, Order: 164339, Start Time: 2012-09-21 00:50:17, End Time: 2012-09-21 02:04:45 To: 4073, Order: 164324, Start Time: 2012-09-20 23:07:12, End Time: 2012-09-21 00:21:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (169 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 965 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.35% (2.1130 => 2.1415, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (2.3940 => 2.4194, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7771 => 3.8462, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.23% (28.1005 => 27.7556, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.08% (2.3179 => 2.2929, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.91% (2.0176 => 2.4194, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.56% (0.1013 => 0.1120, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.19% (0.1413 => 0.1557, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.59% (0.4328 => 0.4743, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.55% (1.3693 => 1.5001, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.43% (3.9660 => 4.3399, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.24% (0.7038 => 0.7688, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 9.06% (0.2781 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.98% (0.2596 => 0.2829, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.86% (0.7710 => 0.8393, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1327 => 0.1444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.81% (0.9199 => 1.0009, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.77% (1.2193 => 1.3262, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.64% (0.6959 => 0.7560, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.62% (0.3899 => 0.4235, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.58% (0.5265 => 0.5717, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.48% (1.1364 => 1.2328, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.5818 => 0.6311, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.47% (0.7061 => 0.7659, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2782 => 0.3016, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.34% (0.3022 => 0.3274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.32% (0.3485 => 0.3775, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5748 => 0.6225, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.26% (1.4563 => 1.5766, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2726 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.14% (0.2765 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2760 => 0.2984, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.10% (0.2937 => 0.3175, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3489 => 0.3771, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.06% (0.1589 => 0.1717, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.05% (13.8202 => 14.9321, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: 8.03% (0.2988 => 0.3228, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3580 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.00% (1.9828 => 2.1415, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.98% (0.2607 => 0.2815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.96% (0.2966 => 0.3202, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.91% (0.2628 => 0.2836, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.91% (0.3756 => 0.4053, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 7.84% (0.3149 => 0.3396, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.83% (0.2696 => 0.2907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3293 => 0.3550, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.79% (0.3107 => 0.3349, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2761 => 0.2976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.77% (0.4016 => 0.4328, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.75% (0.5577 => 0.6009, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.70% (0.3868 => 0.4166, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.64% (1.0313 => 1.1101, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3246 => 0.3493, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.50% (0.3453 => 0.3712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.46% (0.3192 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.45% (0.4390 => 0.4717, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.33% (0.3534 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.15% (0.5637 => 0.6040, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 7.12% (1.1061 => 1.1849, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 7.05% (0.8310 => 0.8896, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.03% (3.8646 => 4.1361, std.dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.97% (0.2914 => 0.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.97% (7.2180 => 7.7208, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 6.95% (0.7506 => 0.8028, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.87% (0.6576 => 0.7028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.79% (0.2945 => 0.3145, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.78% (3.6692 => 3.9180, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.74% (0.2925 => 0.3122, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.70% (0.7460 => 0.7960, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.2243 => 0.2390, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.48% (3.1889 => 3.3957, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 6.48% (16.6129 => 17.6898, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 6.42% (2.1791 => 2.3190, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 6.33% (1.0594 => 1.1265, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.32% (0.8698 => 0.9248, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.32% (0.6744 => 0.7170, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3755 => 0.3992, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.26% (1.9270 => 2.0477, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (1.3245 => 1.4063, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (1.2749 => 1.3520, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.88% (1.3819 => 1.4631, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 5.74% (14.8535 => 15.7064, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.3813 => 1.4598, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9789, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.60% (4.3801 => 4.6252, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 5.59% (0.3131 => 0.3306, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.53% (0.8818 => 0.9306, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.53% (0.6135 => 0.6474, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (4.4433 => 4.6880, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9990, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1333 => 1.1935, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.19% (1.2292 => 1.2930, std.dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 5.19% (14.5298 => 15.2839, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 5.16% (4.6629 => 4.9033, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 5.10% (0.4003 => 0.4207, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.09% (0.3578 => 0.3760, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.06% (6.5754 => 6.9079, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions: 5.03% (0.3914 => 0.4111, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.01% (0.3789 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.97% (0.3601 => 0.3780, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.2504 => 0.2628, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 4.94% (0.3646 => 0.3826, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.85% (0.6250 => 0.6553, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.82% (0.3940 => 0.4130, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.82% (0.3650 => 0.3826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.78% (0.3663 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.78% (0.3623 => 0.3796, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.66% (3.2742 => 3.4267, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.41% (4.9865 => 5.2065, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.29% (0.4805 => 0.5011, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.28% (0.9108 => 0.9498, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.02% (1.5188 => 1.5798, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 3.98% (3.7467 => 3.8959, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.90% (2.1007 => 2.1826, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4992, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.71% (33.2944 => 34.1976, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5871, std.dev.: 0.0224) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5084, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/fbench: 26.31% (1.8175 => 2.2957, std.dev.: 0.0371) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.01% (1.0895 => 1.3620, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3793, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.2093 => 0.2197, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6966, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5469, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1000, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5940, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.94% (3.7731 => 3.8462, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9704, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.13% (3.6469 => 3.6881, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5863, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.67% (0.4657 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.18% (22.5627 => 21.8447, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2855, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.61% (1.3780 => 1.3007, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.7688 => 1.7056, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.64% (3.0263 => 2.9465, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6046, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6615 => 0.6482, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.65% (28.2225 => 27.7556, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1389, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.22% (4.1080 => 4.0577, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -1.20% (4.4810 => 4.4274, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5655, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 19:15:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 21:15:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921021502.0934C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4077?compare_to=4074&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4077, Order: 164344, Start Time: 2012-09-21 01:04:55, End Time: 2012-09-21 02:16:28 To: 4074, Order: 164330, Start Time: 2012-09-20 23:37:42, End Time: 2012-09-21 00:48:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (51 on baseline) Performance Improvements: 0 (39 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 12.04% (3.0522 => 3.4197, std.dev.: 0.0893) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.04% (0.7552 => 0.7857, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.2515 => 1.2944, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 2.28% (0.6450 => 0.6597, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.73% (1.1264 => 1.1459, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 1.72% (2.5066 => 2.5498, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ReedSolomon: 1.69% (8.7120 => 8.8592, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/whetstone: 1.23% (2.3610 => 2.3900, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 1.14% (29.6180 => 29.9547, std.dev.: 0.0413) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (3.2135 => 3.2462, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.20% (0.9999 => 0.9979, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6024 => 0.6034, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1673 => 0.1654, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.38% (0.1560 => 0.1554, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.59% (0.3058 => 0.3040, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.2246 => 0.2336, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.60% (0.3172 => 0.3191, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.10% (0.2280 => 0.2305, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 11.50% (0.0400 => 0.0446, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -65.91% (0.0088 => 0.0030, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: 54.84% (0.0031 => 0.0048, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.82% (0.0224 => 0.0202, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.54% (0.0195 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0387 => 0.0385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -41.44% (0.0181 => 0.0106, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: -37.95% (0.0195 => 0.0121, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -2.37% (0.0253 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -8.64% (0.0324 => 0.0296, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.37% (0.1454 => 0.1405, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.43% (1.4611 => 1.4820, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.57% (0.1467 => 0.1490, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.20% (0.4016 => 0.4024, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.65% (0.1461 => 0.1393, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.17% (0.0602 => 0.0603, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.90% (0.0239 => 0.0201, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.27% (0.0568 => 0.0615, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1312 => 1.1248, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 280.00% (0.0005 => 0.0019, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.43% (0.0538 => 0.0578, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.91% (0.0221 => 0.0135, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.56% (0.7651 => 0.7694, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.79% (1.5879 => 1.6005, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.07% (4.1772 => 3.0884, std.dev.: 0.0815) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.21% (0.0745 => 0.0903, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.5309 => 0.5634, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 6.11% (2.1763 => 2.3093, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.98% (0.6410 => 0.6793, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 5.07% (1.0046 => 1.0555, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 5.04% (15.3105 => 16.0819, std.dev.: 0.1226) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.6915 => 0.7249, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.75% (0.6173 => 0.6466, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.2552 => 0.2673, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 4.36% (1.1653 => 1.2161, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3582 => 0.3715, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.71% (29.3170 => 30.1117, std.dev.: 0.1924) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.7639 => 0.7845, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.23% (4.7455 => 4.8515, std.dev.: 0.0308) MultiSource/Applications/d/make_dparser: 2.08% (3.0225 => 3.0855, std.dev.: 0.0204) MultiSource/Applications/Burg/burg: 1.80% (1.1440 => 1.1646, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 1.55% (13.3238 => 13.5305, std.dev.: 0.0729) MultiSource/Applications/ClamAV/clamscan: 1.23% (14.6079 => 14.7877, std.dev.: 0.0694) MultiSource/Applications/JM/ldecod/ldecod: 1.14% (6.4908 => 6.5647, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.72% (1.6538 => 2.3437, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9994, std.dev.: 0.0298) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.70% (4.0101 => 4.5595, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.03% (3.0256 => 3.4197, std.dev.: 0.0893) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.74% (1.0063 => 1.1244, std.dev.: 0.0220) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.21% (0.2694 => 0.2942, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 8.76% (7.0025 => 7.6156, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3301 => 0.3513, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.6308 => 0.6597, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 4.32% (15.2242 => 15.8813, std.dev.: 0.0455) SingleSource/Benchmarks/Misc/ReedSolomon: 4.09% (8.5113 => 8.8592, std.dev.: 0.0225) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: 3.73% (0.9851 => 1.0218, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 3.37% (3.8907 => 4.0219, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.95% (14.4877 => 14.9155, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.91% (3.5520 => 3.6553, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/mason/mason: 2.52% (0.5004 => 0.5130, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 1.91% (2.3453 => 2.3900, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.6127 => 4.6944, std.dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.74% (0.5876 => 0.5978, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.69% (4.6414 => 4.7199, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: 1.57% (1.4184 => 1.4406, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 1.46% (29.5232 => 29.9547, std.dev.: 0.0413) MultiSource/Benchmarks/Olden/bh/bh: 1.32% (2.5166 => 2.5498, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.20% (27.1724 => 27.4976, std.dev.: 0.0296) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4455 => 2.4743, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.25% (4.2815 => 4.2278, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.89% (5.2665 => 4.1135, std.dev.: 0.1401) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.26% (1.1647 => 0.9637, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.60% (15.8312 => 13.3620, std.dev.: 0.1395) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -11.08% (0.3746 => 0.3331, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.77% (1.4034 => 1.2803, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.49% (3.2007 => 2.9611, std.dev.: 0.0501) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.6254 => 3.3795, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.58% (2.0027 => 1.8709, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3306, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: -6.23% (7.6833 => 7.2048, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -6.08% (1.4441 => 1.3563, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -5.71% (0.2664 => 0.2512, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9531, std.dev.: 0.0881) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1869, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: -5.17% (3.4230 => 3.2462, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.72% (0.4140 => 0.3986, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -3.71% (9.2503 => 8.9068, std.dev.: 0.0592) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.66% (1.2722 => 1.2257, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8293, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.46% (3.7496 => 3.6574, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/flops: -2.25% (9.5474 => 9.3329, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: -2.17% (92.7467 => 90.7315, std.dev.: 0.4947) MultiSource/Applications/aha/aha: -2.01% (3.4286 => 3.3598, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.92% (1.1683 => 1.1459, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (9.3855 => 9.2123, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: -1.74% (3.4876 => 3.4270, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.43% (1.8739 => 1.8471, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3176, std.dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/fldry: -1.19% (2.4971 => 2.4675, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.01% (2.8599 => 2.8310, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.01% (0.9980 => 0.9979, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 0.20% (0.6022 => 0.6034, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -0.72% (0.1666 => 0.1654, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1554 => 0.1554, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.39% (0.3083 => 0.3040, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.42% (0.2394 => 0.2336, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.50% (0.3175 => 0.3191, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.13% (0.2302 => 0.2305, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -0.67% (0.0449 => 0.0446, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -46.67% (0.0090 => 0.0048, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.83% (0.0240 => 0.0202, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -40.11% (0.0177 => 0.0106, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: -35.98% (0.0189 => 0.0121, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -8.92% (0.0325 => 0.0296, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.68% (0.1429 => 0.1405, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -1.32% (1.5019 => 1.4820, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.73% (0.1501 => 0.1490, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.63% (0.4264 => 0.4024, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1344 => 0.1393, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.38% (0.0589 => 0.0603, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.76% (0.0639 => 0.0615, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1350 => 1.1248, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -20.83% (0.0024 => 0.0019, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.26% (0.0637 => 0.0578, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.12% (0.0246 => 0.0135, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.03% (0.7541 => 0.7694, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.18% (1.5363 => 1.6005, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 19:46:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 21:46:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921024656.32BEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4078?compare_to=4072&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4078, Order: 164332, Start Time: 2012-09-21 00:04:30, End Time: 2012-09-21 02:48:22 To: 4072, Order: 164317, Start Time: 2012-09-20 20:52:09, End Time: 2012-09-20 23:36:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (120 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 966 (772 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.96% (0.3977 => 0.4413, std.dev.: 0.0127) MultiSource/Applications/hbd/hbd: 1.09% (1.0019 => 1.0128, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 9.22% (68.5447 => 74.8668, std.dev.: 0.0493) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.52% (2.0261 => 2.0975, std.dev.: 0.0160) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3496 => 0.3833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3469 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.58% (0.3488 => 0.3822, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3442 => 0.3771, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.55% (0.3465 => 0.3796, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3446 => 0.3774, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.48% (0.3460 => 0.3788, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 9.34% (0.3650 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3643 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.05% (0.3724 => 0.4061, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.65% (1.5932 => 1.7310, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (1.6211 => 1.7254, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.25% (1.3152 => 1.3974, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (0.5000 => 0.5300, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.00% (5.5417 => 5.8742, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.97% (0.4994 => 0.5292, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (3.5627 => 3.7741, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.75% (1.0781 => 1.1401, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (0.5026 => 0.5310, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (0.3930 => 0.4149, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.53% (0.5826 => 0.6148, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.45% (2.7292 => 2.8780, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.37% (4.2109 => 4.4372, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 5.33% (0.5889 => 0.6203, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.31% (1.8794 => 1.9792, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 5.26% (0.2566 => 0.2701, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2875 => 0.3026, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (4.4195 => 4.6507, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.99% (0.6634 => 0.6965, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (2.1013 => 2.2059, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 4.98% (0.2813 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.98% (0.3195 => 0.3354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.93% (0.3004 => 0.3152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2823 => 0.2961, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.87% (4.6177 => 4.8424, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.86% (0.3890 => 0.4079, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.84% (0.2729 => 0.2861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2738 => 0.2869, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.77% (0.2911 => 0.3050, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.77% (0.2725 => 0.2855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (2.0673 => 2.1657, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.74% (0.4139 => 0.4335, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.72% (0.9909 => 1.0377, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (2.1653 => 2.2675, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.71% (0.3903 => 0.4087, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.71% (0.2780 => 0.2911, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.71% (1.4269 => 1.4941, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2803 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3060 => 0.3204, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3258 => 0.3411, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.69% (0.2792 => 0.2923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.69% (0.3348 => 0.3505, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3362 => 0.3519, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.62% (0.5546 => 0.5802, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.61% (23.5202 => 24.6048, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.3317 => 0.3469, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3625 => 0.3790, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.5900 => 0.6166, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (0.4658 => 0.4867, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.49% (0.3477 => 0.3633, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.44% (0.9697 => 1.0128, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3726 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.30% (1.9966 => 2.0825, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.28% (0.4251 => 0.4433, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.25% (0.3690 => 0.3847, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.25% (0.7171 => 0.7476, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 4.23% (0.3336 => 0.3477, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.2969 => 0.3094, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (1.9694 => 2.0520, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.15% (0.7875 => 0.8202, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.15% (0.3084 => 0.3212, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.14% (2.0346 => 2.1189, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.01% (0.6435 => 0.6693, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.89% (0.3981 => 0.4136, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.84% (0.2737 => 0.2842, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.5012 => 0.5203, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 3.69% (0.4847 => 0.5026, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (0.5361 => 0.5543, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.13% (0.5584 => 0.5759, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.3498 => 0.3598, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.83% (11.6398 => 11.9697, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.41% (4.6926 => 4.8056, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-2: 5.21% (1.8057 => 1.8998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6390, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1923, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5084, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4523, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2807, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5933, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.09% (2.4764 => 2.4493, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5501, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ary2: -9.78% (0.2402 => 0.2167, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7860, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7972, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7943, std.dev.: 0.0586) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9643, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 20:02:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 22:02:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921030253.8184F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4079?compare_to=4075&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4079, Order: 164349, Start Time: 2012-09-21 01:44:29, End Time: 2012-09-21 03:04:19 To: 4075, Order: 164332, Start Time: 2012-09-20 23:55:32, End Time: 2012-09-21 01:15:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (132 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.80% (1.9446 => 1.9796, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (2.5007 => 2.5441, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (8.0008 => 8.1135, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.23% (3.8606 => 3.9080, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (3.8621 => 3.9022, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.61% (78.1671 => 80.2093, std.dev.: 0.4222) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.47% (0.5700 => 0.5727, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.67% (15.8605 => 15.9663, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 0.55% (14.7220 => 14.8026, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 1.10% (82.6812 => 83.5942, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 0.26% (4.3215 => 4.3328, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.52% (1.2201 => 1.2265, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.58% (7.3924 => 7.4351, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.45% (3.6767 => 3.6932, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6381 => 0.6377, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.39% (0.0686 => 0.0649, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.18% (63.2438 => 83.5942, std.dev.: 0.0090) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14272.50% (0.0720 => 10.3482, std.dev.: 0.0123) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.20% (10.3673 => 15.1574, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 29.47% (0.1622 => 0.2100, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.53% (2.2022 => 2.5441, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 15.29% (0.1432 => 0.1651, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.02% (7.0540 => 8.1135, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.05% (1.1194 => 1.2655, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.96% (0.1566 => 0.1769, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.42% (1.7609 => 1.9796, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 10.37% (10.4361 => 11.5188, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 9.96% (0.3282 => 0.3609, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.40% (0.4879 => 0.5289, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.13% (9.4845 => 10.2558, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.86% (0.3473 => 0.3746, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.79% (0.3543 => 0.3819, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3543 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.3927 => 0.4227, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.59% (0.3177 => 0.3418, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 7.58% (0.3561 => 0.3831, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3516 => 0.3782, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.52% (0.3828 => 0.4116, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.44% (0.7433 => 0.7986, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3694 => 0.3968, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.28% (0.3886 => 0.4169, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.98% (0.3109 => 0.3326, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.96% (0.7115 => 0.7610, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.81% (0.2554 => 0.2728, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.61% (0.4615 => 0.4920, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.53% (0.6675 => 0.7111, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.51% (0.3423 => 0.3646, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.48% (0.8067 => 0.8590, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 6.46% (5.7591 => 6.1312, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.46% (4.2646 => 4.5399, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.43% (3.3354 => 3.5497, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2271 => 0.2416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.38% (1.5415 => 1.6398, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.34% (1.3050 => 1.3877, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30% (0.5860 => 0.6229, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.25% (0.5105 => 0.5424, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.22% (8.1363 => 8.6424, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.04% (4.9449 => 5.2434, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.96% (5.0018 => 5.3001, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5569 => 0.5899, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2107 => 0.2231, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.85% (0.9765 => 1.0336) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.70% (0.3121 => 0.3299, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.69% (1.1642 => 1.2305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.2758 => 0.2915, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 5.68% (1.0722 => 1.1331, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.65% (0.7835 => 0.8278, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1940 => 0.2049, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8172 => 0.8631, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.53% (1.1861 => 1.2517, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.52% (3.8723 => 4.0862, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 5.52% (0.3387 => 0.3574, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.49% (0.3441 => 0.3630, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 5.47% (1.5603 => 1.6457, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.41% (7.9617 => 8.3923, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.35% (0.3180 => 0.3350, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.14% (0.5020 => 0.5278, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.10% (2.2969 => 2.4140, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 5.05% (0.4299 => 0.4516, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.03% (2.0273 => 2.1292, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 4.96% (21.9371 => 23.0252, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/Hello: 4.95% (0.5925 => 0.6218, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.89% (0.6030 => 0.6325, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.89% (0.8921 => 0.9357, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.75% (1.4186 => 1.4860, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.71% (0.6450 => 0.6754, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.60% (1.5859 => 1.6589, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 4.57% (0.6456 => 0.6751, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.48% (0.4103 => 0.4287, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.44% (0.7326 => 0.7651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (14.3668 => 14.9924, std.dev.: 0.0122) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4636 => 0.4836, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.5981 => 0.6237, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.1840 => 1.2336, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.4064 => 0.4234, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.16% (2.2024 => 2.2941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3422 => 0.3564, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3650 => 0.3801, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3826 => 0.3979, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.4289 => 0.4458, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4203 => 0.4363, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.59% (0.4620 => 0.4786, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.33% (0.4048 => 0.4183, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3603 => 0.3723, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.17% (0.3283 => 0.3387, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (2.0665 => 2.1315, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 3.07% (0.3684 => 0.3797, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.8101 => 0.8300, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3101, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (3.8922 => 3.9645, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.83% (17.1811 => 17.4962, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3826, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3634, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7494, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2416, std.dev.: 0.0163) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7871, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 1.20% (2.2771 => 2.3045, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2572, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.43% (5.3855 => 3.9080, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.10% (5.3526 => 3.9022, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0721, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.76% (2.9384 => 2.5929, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -7.77% (22.1758 => 20.4527, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2755, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.40% (1.8329 => 1.7156, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1507, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.19% (8.6802 => 8.4030, std.dev.: 0.0129) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5078, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0020, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.65% (1.2373 => 1.2045, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9975, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8556, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.52% (0.5229 => 0.5727, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.52% (14.9895 => 15.9663, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 4.57% (14.1553 => 14.8026, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 5.41% (4.1105 => 4.3328, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.02% (1.1048 => 1.2265, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.87% (7.1582 => 7.4351, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.65% (3.4629 => 3.6932, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.6222 => 0.6377, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 20:42:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 22:42:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921034250.A39B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4080?compare_to=4077&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4080, Order: 164351, Start Time: 2012-09-21 02:32:32, End Time: 2012-09-21 03:44:18 To: 4077, Order: 164344, Start Time: 2012-09-21 01:04:55, End Time: 2012-09-21 02:16:28 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 13 (47 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 886 (805 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (0.7341 => 0.7908, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.33% (0.2073 => 0.2225, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.13% (0.5367 => 0.5696, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2073 => 0.2189, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.2772 => 0.2922, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.15% (0.7524 => 0.7836, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.44% (1.3939 => 1.4419, std.dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4496 => 0.4600, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.96% (39.4070 => 42.1493, std.dev.: 0.2536) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.07% (2.3543 => 2.4031, std.dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.28% (13.3620 => 13.5325, std.dev.: 0.0353) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.27% (2.8357 => 2.8716, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.10% (1.8471 => 1.8675, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: -1.60% (2.5498 => 2.5089, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.47% (0.9979 => 0.9932, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 0.07% (0.6034 => 0.6038, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: -0.97% (0.1654 => 0.1638, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.95% (0.3040 => 0.3069, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.2336 => 0.2343, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.25% (0.3191 => 0.3199, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.95% (0.2305 => 0.2283, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 1.57% (0.0446 => 0.0453, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 193.33% (0.0030 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 89.58% (0.0048 => 0.0091, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.43% (0.0202 => 0.0217, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.12% (0.0192 => 0.0138, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.56% (0.0385 => 0.0379, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0300 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.07% (0.0281 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 71.70% (0.0106 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -6.61% (0.0121 => 0.0113, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 1.62% (0.0247 => 0.0251, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -11.82% (0.0296 => 0.0261, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1405 => 0.1448, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 0.28% (1.4820 => 1.4861, std.dev.: 0.0237) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1490 => 0.1490, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.44% (0.4024 => 0.4082, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1393 => 0.1392, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.12% (0.0603 => 0.0542, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.00% (0.0201 => 0.0203, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.33% (0.0615 => 0.0617, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.16% (1.1248 => 1.1378, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0011 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.68% (0.0019 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.06% (0.0578 => 0.0543, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.67% (0.0135 => 0.0144, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.51% (0.7694 => 0.7655, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.24% (1.6005 => 1.5966, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.50% (0.0121 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.57% (4.1772 => 3.0673, std.dev.: 0.0613) SingleSource/Benchmarks/Shootout-C++/except: 82933.33% (0.0006 => 0.4982, std.dev.: 0.0003) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.13% (0.6410 => 0.6931, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.5309 => 0.5649, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 6.27% (2.1763 => 2.3128, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.2552 => 0.2683, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.00% (1.0046 => 1.0548, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: 4.89% (0.6915 => 0.7253, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 4.70% (15.3105 => 16.0304, std.dev.: 0.2508) MultiSource/Applications/minisat/minisat: 4.60% (0.6173 => 0.6457, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 3.52% (29.3170 => 30.3495, std.dev.: 0.3021) MultiSource/Applications/d/make_dparser: 2.42% (3.0225 => 3.0957, std.dev.: 0.0280) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.7722 => 0.7908, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 2.18% (1.3268 => 1.3557, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.07% (1.2021 => 1.2270, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 2.01% (13.3238 => 13.5910, std.dev.: 0.0724) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.98% (0.6069 => 0.6189, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/matrix: 21.82% (3.4629 => 4.2186, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.32% (0.0766 => 0.0891, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 14.95% (1.7426 => 2.0032, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.42% (4.0101 => 4.5481, std.dev.: 0.0160) SingleSource/Benchmarks/Stanford/Puzzle: 12.35% (0.1433 => 0.1610, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 10.82% (1.6261 => 1.8020, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.02% (0.2694 => 0.2937, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.92% (7.0025 => 7.6269, std.dev.: 0.0377) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.95% (1.0063 => 1.0863, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.54% (0.3301 => 0.3550, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.26% (2.4042 => 2.5065, std.dev.: 0.0298) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.13% (40.4792 => 42.1493, std.dev.: 0.2536) SingleSource/Benchmarks/Misc/dt: 4.10% (0.9851 => 1.0255, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 4.01% (15.2242 => 15.8351, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5389, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.11% (2.6656 => 2.7486, std.dev.: 0.0241) MultiSource/Applications/hexxagon/hexxagon: 2.97% (14.4877 => 14.9180, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: 2.91% (3.8907 => 4.0039, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/ReedSolomon: 2.36% (8.5113 => 8.7119, std.dev.: 0.0717) MultiSource/Benchmarks/FreeBench/mason/mason: 2.22% (0.5004 => 0.5115, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.02% (3.5520 => 3.6236, std.dev.: 0.0204) SingleSource/Benchmarks/Dhrystone/dry: 2.02% (2.4013 => 2.4497, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.65% (4.6127 => 4.6890, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/whetstone: 1.63% (2.3453 => 2.3835, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.17% (27.1724 => 27.4907, std.dev.: 0.0970) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4455 => 2.4733, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.01% (0.7738 => 0.7505, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.29% (0.3497 => 0.2053, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -20.64% (1.7473 => 1.3866, std.dev.: 0.0506) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.54% (5.2665 => 4.1845, std.dev.: 0.0761) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.1647 => 0.9597, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.52% (15.8312 => 13.5325, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -11.77% (0.3746 => 0.3305, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9445, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3745, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3310, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -6.40% (7.6833 => 7.1914, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: -6.13% (3.4230 => 3.2130, std.dev.: 0.0407) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/richards_benchmark: -5.89% (1.4441 => 1.3591, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: -5.52% (62.4126 => 58.9662, std.dev.: 0.0900) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1877, std.dev.: 0.0160) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.61% (0.4140 => 0.3949, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.32% (0.4564 => 0.4367, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: -4.09% (0.2664 => 0.2555, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -3.36% (9.2503 => 8.9391, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.09% (3.9413 => 3.8194, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0273) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6464, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.09% (1.0686 => 1.0463, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -1.95% (92.7467 => 90.9394, std.dev.: 0.4586) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4205, std.dev.: 0.0063) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3631, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.76% (2.3569 => 2.3154, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.74% (2.4457 => 2.4031, std.dev.: 0.0165) SingleSource/Benchmarks/Dhrystone/fldry: -1.73% (2.4971 => 2.4538, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2307, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3090, std.dev.: 0.0377) MultiSource/Benchmarks/NPB-serial/is/is: -1.15% (13.4743 => 13.3198, std.dev.: 0.0247) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.48% (0.9980 => 0.9932, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.6022 => 0.6038, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: -1.68% (0.1666 => 0.1638, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.45% (0.3083 => 0.3069, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.13% (0.2394 => 0.2343, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.76% (0.3175 => 0.3199, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.83% (0.2302 => 0.2283, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.58% (0.0240 => 0.0217, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.12% (0.0192 => 0.0138, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.82% (0.0390 => 0.0379, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -40.21% (0.0189 => 0.0113, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -19.69% (0.0325 => 0.0261, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.33% (0.1429 => 0.1448, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -1.05% (1.5019 => 1.4861, std.dev.: 0.0237) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.73% (0.1501 => 0.1490, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.27% (0.4264 => 0.4082, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.57% (0.1344 => 0.1392, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.98% (0.0589 => 0.0542, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.50% (0.0232 => 0.0203, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.44% (0.0639 => 0.0617, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.25% (1.1350 => 1.1378, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.46% (0.0246 => 0.0144, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.93% (1.5363 => 1.5966, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.00% (0.0070 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 20:46:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 22:46:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921034601.775FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4081?compare_to=4076&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4081, Order: 164351, Start Time: 2012-09-21 02:33:10, End Time: 2012-09-21 03:47:27 To: 4076, Order: 164339, Start Time: 2012-09-21 00:50:17, End Time: 2012-09-21 02:04:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (162 on baseline) Performance Improvements: 4 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 965 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.64% (55.5610 => 56.4723, std.dev.: 0.0857) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.16% (2.1415 => 2.1167, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -1.05% (1.5001 => 1.4843, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.53% (0.5537 => 0.5397, std.dev.: 0.0044) MultiSource/Benchmarks/llubenchmark/llu: -2.27% (3.8462 => 3.7587, std.dev.: 0.0313) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.24% (2.0176 => 2.4057, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.11% (0.1410 => 0.1623, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.97% (0.1072 => 0.1211, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.91% (0.1413 => 0.1553, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.19% (0.1588 => 0.1734, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.17% (3.9660 => 4.3297, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 8.94% (0.7038 => 0.7667, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.71% (0.2596 => 0.2822, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.7710 => 0.8372, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.52% (0.9199 => 0.9983, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.44% (0.1327 => 0.1439, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.40% (1.3693 => 1.4843, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.40% (1.2193 => 1.3217, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.27% (0.2721 => 0.2946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.24% (0.5265 => 0.5699, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.22% (1.1364 => 1.2298, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.14% (1.4563 => 1.5748, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.12% (0.6959 => 0.7524, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.87% (0.7061 => 0.7617, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 7.85% (0.5818 => 0.6275, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.6283 => 0.6772, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.3246 => 0.3498, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.73% (13.8202 => 14.8884, std.dev.: 0.0202) SingleSource/UnitTests/ObjC++/Hello: 7.69% (0.5748 => 0.6190) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1589 => 0.1708, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.48% (1.0313 => 1.1084, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.46% (0.3899 => 0.4190, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.45% (0.4791 => 0.5148, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.35% (0.5577 => 0.5987, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.25% (0.1435 => 0.1539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3022 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.11% (0.4390 => 0.4702, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.05% (0.3489 => 0.3735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.02% (1.1061 => 1.1838, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.01% (0.2127 => 0.2276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (0.4379 => 0.4684, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.94% (0.2995 => 0.3203, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.82% (0.8310 => 0.8877, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.82% (0.3756 => 0.4012, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.77% (3.8646 => 4.1262, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (1.9828 => 2.1167, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.74% (0.3220 => 0.3437, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.5637 => 0.6016, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.70% (0.2655 => 0.2833, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.69% (0.2914 => 0.3109, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (7.2180 => 7.6976, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3107 => 0.3312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.49% (0.6576 => 0.7003, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.43% (3.6692 => 3.9051, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 6.43% (0.2925 => 0.3113, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.42% (0.2243 => 0.2387, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.35% (0.7506 => 0.7983, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 6.35% (2.1791 => 2.3174, std.dev.: 0.0179) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.31% (0.7460 => 0.7931, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.28% (0.2023 => 0.2150, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.24% (16.6129 => 17.6490, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.17% (0.6744 => 0.7160, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.14% (3.1889 => 3.3847, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 6.12% (1.9270 => 2.0450, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 6.05% (1.0594 => 1.1235, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.92% (1.3245 => 1.4029, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 5.78% (1.2749 => 1.3486, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.71% (0.8698 => 0.9195, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (1.3819 => 1.4602, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 5.62% (0.4113 => 0.4344, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.61% (1.3813 => 1.4588, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.53% (14.8535 => 15.6743, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/parameter-passing: 5.47% (0.4003 => 0.4222, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.45% (0.3578 => 0.3773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.42% (0.3914 => 0.4126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.39% (4.3801 => 4.6164, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 5.37% (0.3131 => 0.3299, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.36% (0.3789 => 0.3992, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.33% (0.3940 => 0.4150, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.31% (8.4961 => 8.9474, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions-4: 5.29% (0.3646 => 0.3839, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.28% (0.3601 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (4.4433 => 4.6769, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-3: 5.22% (0.3623 => 0.3812, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.22% (0.6135 => 0.6455, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.21% (0.3663 => 0.3854, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1333 => 1.1923, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.21% (0.3650 => 0.3840, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (13.2842 => 13.9698, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3755 => 0.3948) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3245 => 0.3408, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.00% (14.5298 => 15.2557, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2504 => 0.2629, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.92% (0.8818 => 0.9252, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (6.5754 => 6.8833, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 4.63% (4.6629 => 4.8786, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.56% (4.9865 => 5.2139, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.52% (3.2742 => 3.4221, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.2292 => 1.2813, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4805 => 0.5004, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.6250 => 0.6499, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.95% (0.9108 => 0.9468, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.5188 => 1.5772, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 3.81% (3.7467 => 3.8894, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.65% (2.1007 => 2.1774, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.99% (6.2785 => 6.4665, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 2.65% (33.2944 => 34.1760, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5426, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5138, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std.dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6976, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5478, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.65% (10.7476 => 11.1396, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5979, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5869, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.37% (0.4657 => 0.3848, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7485, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2527, std.dev.: 0.0237) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.74% (0.3458 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2926, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5097, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1494, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std.dev.: 0.0110) MultiSource/Applications/spiff/spiff: -2.64% (3.0263 => 2.9464, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5931, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6615 => 0.6482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2464, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7543, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1598, std.dev.: 0.0305) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8707, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.15% (4.1080 => 4.0608, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2319, std.dev.: 0.0206) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4350, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5647, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 21:51:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Sep 2012 23:51:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921045106.A3C802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4082?compare_to=4079&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4082, Order: 164356, Start Time: 2012-09-21 03:32:54, End Time: 2012-09-21 04:52:32 To: 4079, Order: 164349, Start Time: 2012-09-21 01:44:29, End Time: 2012-09-21 03:04:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (720 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.20% (15.1574 => 15.3395, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5727 => 0.5727, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.11% (15.9663 => 15.9489, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: -0.01% (14.8026 => 14.8004, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: -0.64% (83.5942 => 83.0622, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: -0.09% (4.3328 => 4.3291, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2265 => 1.2270, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (7.4351 => 7.4230, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.14% (3.6932 => 3.6881, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.25% (0.6377 => 0.6361, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.34% (63.2438 => 83.0622, std.dev.: 0.0051) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14279.72% (0.0720 => 10.3534, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.96% (10.3673 => 15.3395, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 25.77% (0.1622 => 0.2040, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.94% (0.1432 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.89% (2.2022 => 2.5301, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.75% (7.0540 => 8.0944, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.84% (1.1194 => 1.2631, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.01% (1.7609 => 1.9724, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 10.08% (10.4361 => 11.4880, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: 9.87% (0.3282 => 0.3606, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 8.22% (0.1655 => 0.1791, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.08% (0.4879 => 0.5273, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.89% (9.4845 => 10.2327, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.3927 => 0.4227, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3543 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 7.51% (0.7433 => 0.7991, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.50% (0.3561 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.48% (0.3543 => 0.3808, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.45% (0.3828 => 0.4113, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3497 => 0.3757, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.40% (0.3177 => 0.3412, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.39% (0.3516 => 0.3776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3694 => 0.3966, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.23% (0.3886 => 0.4167, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.20% (0.3109 => 0.3333, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.19% (0.2700 => 0.2894, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.00% (0.7115 => 0.7613, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.71% (5.7591 => 6.1454, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.70% (0.6675 => 0.7122, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.58% (1.5415 => 1.6429, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 6.51% (3.3354 => 3.5524, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3423 => 0.3642, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.35% (1.3050 => 1.3879, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.35% (0.8067 => 0.8579, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (4.2646 => 4.5350, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.33% (0.5860 => 0.6231, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.33% (0.5105 => 0.5428, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2271 => 0.2414, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.03% (8.1363 => 8.6267, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.87% (5.0018 => 5.2956, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 5.80% (1.0722 => 1.1344, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.79% (0.2107 => 0.2229, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.78% (0.5569 => 0.5891, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.78% (0.8172 => 0.8644, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.77% (4.9449 => 5.2303, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.73% (0.9765 => 1.0325, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.73% (0.2758 => 0.2916, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.69% (1.1642 => 1.2304, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.61% (0.3121 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.57% (0.1940 => 0.2048, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.56% (1.1861 => 1.2521, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.55% (0.7835 => 0.8270, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 5.55% (0.3387 => 0.3575, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.50% (3.8723 => 4.0851, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.2065 => 0.2175, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.31% (2.2969 => 2.4188, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.28% (0.5020 => 0.5285, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.25% (0.3180 => 0.3347, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (7.9617 => 8.3726, std.dev.: 0.0124) MultiSource/Applications/treecc/treecc: 5.11% (2.0273 => 2.1308, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8921 => 0.9369, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 4.95% (1.5603 => 1.6376, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.87% (21.9371 => 23.0061, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/05-eks/eks: 4.79% (0.4299 => 0.4505, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.65% (1.5859 => 1.6597, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.60% (0.6450 => 0.6747, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.46% (0.6456 => 0.6744, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.34% (0.5925 => 0.6182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.33% (0.6030 => 0.6291, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.4103 => 0.4280, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (14.3668 => 14.9844, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.5981 => 0.6237, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (2.2024 => 2.2942, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (1.4186 => 1.4776, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.97% (0.4636 => 0.4820, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.4064 => 0.4224, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.87% (1.1840 => 1.2298, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3422 => 0.3550, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.73% (0.3650 => 0.3786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.63% (0.3826 => 0.3965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.4203 => 0.4355, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.59% (0.7326 => 0.7589, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4289 => 0.4441, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.51% (0.4620 => 0.4782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.4048 => 0.4181, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.23% (0.3935 => 0.4062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3603 => 0.3716, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.92% (0.3427 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.83% (2.0665 => 2.1250, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 2.74% (0.3684 => 0.3785, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.8101 => 0.8288, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.99% (17.1811 => 17.5233, std.dev.: 0.0227) MultiSource/Applications/hexxagon/hexxagon: 1.88% (1.2842 => 1.3083, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9633, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.21% (1.1145 => 1.3843, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3808, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7531, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.07% (4.2280 => 4.3580, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2330, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7870, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.02% (2.2771 => 2.3004, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.48% (5.2763 => 3.2458, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.55% (5.3855 => 3.9016, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.20% (5.3526 => 3.8965, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0734, std.dev.: 0.0222) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.78% (2.9384 => 2.5923, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -7.77% (22.1758 => 20.4519, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4181, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2855, std.dev.: 0.1114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.76% (1.6805 => 1.5837, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5087, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4325, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -2.84% (1.2373 => 1.2022, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0025, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0043, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2302, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.52% (0.5229 => 0.5727, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.40% (14.9895 => 15.9489, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 4.56% (14.1553 => 14.8004, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 5.32% (4.1105 => 4.3291, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.06% (1.1048 => 1.2270, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.70% (7.1582 => 7.4230, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.50% (3.4629 => 3.6881, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.6222 => 0.6361, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 22:09:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 00:09:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921050901.BB3EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4083?compare_to=4080&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4083, Order: 164359, Start Time: 2012-09-21 04:00:19, End Time: 2012-09-21 05:10:30 To: 4080, Order: 164351, Start Time: 2012-09-21 02:32:32, End Time: 2012-09-21 03:44:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (56 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (794 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/power/power: 9.50% (0.1084 => 0.1187, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.05% (1.1571 => 1.1692, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.05% (21.5986 => 22.4724, std.dev.: 0.1971) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.53% (1.3387 => 1.3860, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.29% (58.9063 => 60.2562, std.dev.: 0.2944) SingleSource/Benchmarks/Misc/mandel-2: 1.95% (3.0673 => 3.1270, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/whetstone: 1.77% (2.3835 => 2.4256, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.54% (42.1493 => 42.7979, std.dev.: 0.2377) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -2.24% (1.1136 => 1.0886, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.89% (2.5065 => 2.4341, std.dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.58% (0.9932 => 0.9990, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6038 => 0.6039, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 2.56% (0.1638 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1555 => 0.1564, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (0.3069 => 0.3116, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.43% (0.2343 => 0.2353, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.69% (0.3199 => 0.3177, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.53% (0.2283 => 0.2295, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: - (0.0453 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.30% (0.0091 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.68% (0.0217 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.86% (0.0138 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.37% (0.0379 => 0.0388, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0302 => 0.0302, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0327 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -19.23% (0.0182 => 0.0147, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 7.08% (0.0113 => 0.0121, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0251 => 0.0250, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 12.64% (0.0261 => 0.0294, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1448 => 0.1447, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.74% (1.4861 => 1.4602, std.dev.: 0.0365) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1490 => 0.1490, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.82% (0.4082 => 0.4238, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.30% (0.1392 => 0.1438, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.02% (0.0542 => 0.0618, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.26% (0.0203 => 0.0236, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.21% (0.0617 => 0.0643, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.1378 => 1.1292, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0015 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.44% (0.0543 => 0.0616, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.75% (0.0144 => 0.0171, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7655 => 0.7650, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.19% (1.5966 => 1.5996, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 146.94% (0.0049 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.14% (4.1772 => 3.1270, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/except: 82916.67% (0.0006 => 0.4981, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.92% (0.1414 => 0.1526, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.77% (0.6410 => 0.6844, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: 6.74% (2.1763 => 2.3229, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/bigfib: 5.84% (0.5309 => 0.5619, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.14% (0.3582 => 0.3766, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.32% (1.0046 => 1.0480, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 4.16% (0.6173 => 0.6430, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.08% (1.1653 => 1.2128, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.6915 => 0.7184, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 3.78% (15.3105 => 15.8898, std.dev.: 0.0555) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3217 => 0.3332, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.02% (0.3901 => 0.4019, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.80% (29.3170 => 30.1379, std.dev.: 0.1053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.20% (1.1440 => 1.1692, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 2.15% (3.0225 => 3.0874, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: 2.07% (1.3268 => 1.3543, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.91% (0.6069 => 0.6185, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 1.70% (2.0972 => 2.1328, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 1.45% (13.3238 => 13.5172, std.dev.: 0.0445) MultiSource/Applications/treecc/treecc: 1.30% (1.8798 => 1.9042, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 1.24% (14.6079 => 14.7893, std.dev.: 0.0409) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.0689 => 1.0812, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 1.01% (3.5980 => 3.6345, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.32% (1.6538 => 2.3372, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.11% (0.0766 => 0.0943, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout/ary3: 14.94% (1.7426 => 2.0030, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.66% (4.0101 => 4.5580, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/Puzzle: 8.72% (0.1433 => 0.1558, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6080, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.19% (0.2857 => 0.3091, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.80% (1.0063 => 1.0747, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.73% (40.4792 => 42.7979, std.dev.: 0.2377) SingleSource/Benchmarks/Misc/fp-convert: 4.66% (15.2242 => 15.9329, std.dev.: 0.0270) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.57% (4.2129 => 4.4056, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/dt: 4.05% (0.9851 => 1.0250, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5383, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8719, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 3.42% (2.3453 => 2.4256, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.02% (2.6656 => 2.7462, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: 2.99% (8.5113 => 8.7661, std.dev.: 0.0444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8933, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: 2.62% (3.8907 => 3.9925, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 2.45% (3.5520 => 3.6389, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/mason/mason: 2.14% (0.5004 => 0.5111, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4013 => 2.4507, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.42% (4.6127 => 4.6781, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.16% (1.2726 => 1.2873, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.46% (0.7738 => 0.7548, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.41% (0.3497 => 0.2049, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.56% (5.2665 => 4.0782, std.dev.: 0.0968) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9599, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.09% (15.8312 => 13.2837, std.dev.: 0.1499) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.89% (3.2007 => 2.9483, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3760, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3277, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0198) MultiSource/Applications/lambda-0_1_3/lambda: -6.42% (7.6833 => 7.1902, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: -6.27% (1.4441 => 1.3536, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7925, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -6.03% (3.4230 => 3.2166, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9273, std.dev.: 0.1383) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1853, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.02% (0.4140 => 0.3932, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.88% (1.2722 => 1.2229, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -3.41% (9.2503 => 8.9350, std.dev.: 0.0466) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.72% (45.4683 => 44.2330, std.dev.: 0.1273) SingleSource/Benchmarks/Misc/ffbench: -2.41% (1.4117 => 1.3777, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.22% (3.7496 => 3.6662, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.8010, std.dev.: 0.4985) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.92% (1.1683 => 1.1459, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3673, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2305, std.dev.: 0.0343) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.60% (1.8739 => 1.8439, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.51% (2.4457 => 2.4087, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.50% (61.1734 => 60.2562, std.dev.: 0.2944) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std.dev.: 0.0338) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.15% (1.4021 => 1.3860, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: -1.13% (2.4971 => 2.4689, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: -1.07% (16.5617 => 16.3838, std.dev.: 0.0462) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.10% (0.9980 => 0.9990, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 0.28% (0.6022 => 0.6039, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 0.84% (0.1666 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (0.3083 => 0.3116, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.71% (0.2394 => 0.2353, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (0.3175 => 0.3177, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2302 => 0.2295, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -16.95% (0.0177 => 0.0147, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -35.98% (0.0189 => 0.0121, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -9.54% (0.0325 => 0.0294, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1429 => 0.1447, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -2.78% (1.5019 => 1.4602, std.dev.: 0.0365) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.73% (0.1501 => 0.1490, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.61% (0.4264 => 0.4238, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.92% (0.0589 => 0.0618, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.72% (0.0232 => 0.0236, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.63% (0.0639 => 0.0643, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1350 => 1.1292, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.30% (0.0637 => 0.0616, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.49% (0.0246 => 0.0171, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.12% (1.5363 => 1.5996, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 22:28:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 00:28:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921052845.D9D4D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4084?compare_to=4081&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4084, Order: 164359, Start Time: 2012-09-21 04:15:51, End Time: 2012-09-21 05:30:11 To: 4081, Order: 164351, Start Time: 2012-09-21 02:33:10, End Time: 2012-09-21 03:47:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.35% (2.0176 => 2.4081, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.37% (0.1072 => 0.1226, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.68% (0.7038 => 0.7719, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.60% (3.9660 => 4.3469, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.50% (0.1327 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 8.99% (1.3693 => 1.4924, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.87% (0.9199 => 1.0015, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.85% (0.6959 => 0.7575, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.7710 => 0.8392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.77% (0.5265 => 0.5727, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.77% (1.2193 => 1.3262, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.75% (0.2721 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.71% (0.4328 => 0.4705, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.47% (1.1364 => 1.2326, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.44% (13.8202 => 14.9866, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.38% (1.4563 => 1.5783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4062 => 0.4395, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.12% (0.6283 => 0.6793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.5818 => 0.6286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.96% (0.7061 => 0.7623, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.95% (1.0313 => 1.1133, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.93% (0.5577 => 0.6019, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.85% (0.5748 => 0.6199, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.76% (0.4791 => 0.5163, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.74% (1.1061 => 1.1917, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (0.1435 => 0.1546, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.55% (3.8646 => 4.1565, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.4379 => 0.4701, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.33% (0.5637 => 0.6050, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3485 => 0.3740, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.26% (0.8310 => 0.8913, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.24% (0.2127 => 0.2281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.2914 => 0.3123, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 7.15% (2.1791 => 2.3350, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.15% (0.4016 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.06% (0.4390 => 0.4700, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.03% (0.7506 => 0.8034, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.01% (0.2925 => 0.3130, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.00% (0.3756 => 0.4019, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.99% (16.6129 => 17.7738, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.93% (7.2180 => 7.7181, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 6.91% (0.2243 => 0.2398, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.79% (3.6692 => 3.9185, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.3220 => 0.3438, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.73% (0.7460 => 0.7962, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.71% (1.9828 => 2.1159, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3453 => 0.3684, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.63% (0.2655 => 0.2831, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.62% (1.9270 => 2.0545, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 6.61% (3.1889 => 3.3998, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 6.59% (0.3868 => 0.4123, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.58% (0.6744 => 0.7188, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.38% (1.3245 => 1.4090, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.34% (1.0594 => 1.1266, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.19% (0.6576 => 0.6983, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.3192 => 0.3389, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.02% (0.8698 => 0.9222, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.94% (1.2749 => 1.3506, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.2859 => 0.3025, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (1.3819 => 1.4616, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (1.3813 => 1.4608, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (13.2842 => 14.0427, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 5.70% (14.8535 => 15.7003, std.dev.: 0.0174) MultiSource/Benchmarks/mafft/pairlocalalign: 5.70% (8.4961 => 8.9803, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.67% (4.3801 => 4.6286, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.62% (0.6135 => 0.6480, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 5.62% (0.3131 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.62% (4.4433 => 4.6929, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2321 => 0.2450, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (1.1333 => 1.1962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.27% (14.5298 => 15.2948, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 5.22% (4.6629 => 4.9065, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: 5.15% (0.4003 => 0.4209, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.14% (0.8818 => 0.9271, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 5.14% (0.3914 => 0.4115, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.05% (6.5754 => 6.9077, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.05% (4.9865 => 5.2384, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 5.05% (0.3940 => 0.4139, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.02% (3.2742 => 3.4386, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 4.92% (0.3578 => 0.3754) SingleSource/UnitTests/ObjC/for-in: 4.80% (0.3789 => 0.3971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.75% (0.3663 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.75% (0.3601 => 0.3772, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.74% (0.3646 => 0.3819, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.71% (0.3650 => 0.3822, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 4.69% (0.3623 => 0.3793, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.56% (1.5188 => 1.5880, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.41% (0.4805 => 0.5017, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.41% (2.1007 => 2.1933, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 4.34% (3.7467 => 3.9094, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (0.9108 => 0.9503, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6250 => 0.6520, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2785 => 6.4995, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 3.33% (33.2944 => 34.4015, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: 2.03% (16.2614 => 16.5915, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5196, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 27.20% (1.8175 => 2.3118, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.02% (1.0895 => 1.3621, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6966, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5472, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0988, std.dev.: 0.0454) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5941, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5159, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5855, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.84% (0.4657 => 0.3826, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.26% (22.5627 => 21.8279, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2956, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.83% (1.3780 => 1.2976, std.dev.: 0.0292) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5861, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -2.53% (3.0263 => 2.9496, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.00% (0.6615 => 0.6483, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2376, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7526, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1585, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.16% (6.6320 => 6.5552, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.14% (4.1080 => 4.0612, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4313, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2612, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 22:59:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 00:59:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921055911.C797E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4085?compare_to=4078&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4085, Order: 164354, Start Time: 2012-09-21 03:16:54, End Time: 2012-09-21 06:00:38 To: 4078, Order: 164332, Start Time: 2012-09-21 00:04:30, End Time: 2012-09-21 02:48:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (121 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (773 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (114.4278 => 118.5012, std.dev.: 0.0587) MultiSource/Benchmarks/Olden/perimeter/perimeter: 2.00% (0.6107 => 0.6229, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.22% (1.0128 => 1.0004, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3465 => 0.3780, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.04% (0.3496 => 0.3812, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.02% (0.3446 => 0.3757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.97% (0.3488 => 0.3801, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 8.97% (1.5932 => 1.7361, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.97% (0.3469 => 0.3780, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.96% (0.3460 => 0.3770, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3442 => 0.3749, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 8.74% (0.3650 => 0.3969, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.67% (0.3643 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.3724 => 0.4040, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.65% (0.4361 => 0.4651, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.55% (0.4994 => 0.5321, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.23% (1.3152 => 1.3971, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.96% (1.6211 => 1.7177, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (0.5026 => 0.5316, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (3.5627 => 3.7632, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (4.4195 => 4.6629, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 5.50% (5.5417 => 5.8465, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/Hello: 5.48% (0.5826 => 0.6145, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.45% (0.5889 => 0.6210, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.43% (1.0781 => 1.1366, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.32% (0.5000 => 0.5266, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.2866 => 0.3018, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 5.14% (4.2109 => 4.4275, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.11% (0.2566 => 0.2697, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.08% (0.6634 => 0.6971, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.06% (0.3890 => 0.4087, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.2075 => 0.2177, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2738 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.2736 => 0.2868, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 4.80% (4.6177 => 4.8392, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (2.7292 => 2.8563, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 4.65% (2.1013 => 2.1990, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.62% (0.3271 => 0.3422, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 4.60% (2.0346 => 2.1281, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (2.1653 => 2.2644, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.56% (0.2875 => 0.3006, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.51% (0.3903 => 0.4079, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.4139 => 0.4325, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (1.8794 => 1.9630, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.44% (0.3195 => 0.3337, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.43% (0.3004 => 0.3137, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.38% (0.5546 => 0.5789, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 4.36% (23.5202 => 24.5450, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2780 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.27% (1.4269 => 1.4878, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.25% (0.3060 => 0.3190, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.23% (0.2811 => 0.2930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.23% (0.7171 => 0.7474, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 4.22% (0.9909 => 1.0327, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.18% (0.3084 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2823 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (0.2813 => 0.2930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3096 => 0.3224, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.09% (2.0673 => 2.1519, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3317 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2911 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.92% (0.3625 => 0.3767, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.2969 => 0.3085, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.90% (0.5900 => 0.6130, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.87% (0.3362 => 0.3492, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 3.86% (0.2691 => 0.2795, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3477 => 0.3611, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.85% (0.3348 => 0.3477, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.78% (0.3336 => 0.3462, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.77% (0.7875 => 0.8172, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3678 => 0.3816, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0425, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4146 => 0.4299, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 3.67% (0.4847 => 0.5025, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (1.9966 => 2.0698, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 3.65% (0.4251 => 0.4406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.47% (0.3690 => 0.3818, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.42% (0.6435 => 0.6655, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.5012 => 0.5181, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.17% (0.9697 => 1.0004, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.13% (0.5361 => 0.5529, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.09% (0.3845 => 0.3964, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.03% (0.7426 => 0.7651, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (0.5584 => 0.5742, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.46% (11.6398 => 11.9257, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.04% (4.6926 => 4.7885, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6132, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6668, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6370, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2096, std.dev.: 0.0427) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5055, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4557, std.dev.: 0.0267) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2816, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5867, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5161, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7933, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7983, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.28% (17.2379 => 16.8448, std.dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9562, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7152, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 23:36:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 01:36:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921063604.8115F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4086?compare_to=4083&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4086, Order: 164360, Start Time: 2012-09-21 05:26:35, End Time: 2012-09-21 06:37:32 To: 4083, Order: 164359, Start Time: 2012-09-21 04:00:19, End Time: 2012-09-21 05:10:30 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (57 on baseline) Performance Improvements: 0 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.2850 => 0.3020, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8126 => 14.9801, std.dev.: 0.0346) MultiSource/Applications/d/make_dparser: 1.13% (3.0874 => 3.1223, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 8.08% (3.0401 => 3.2858, std.dev.: 0.0731) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.49% (0.3318 => 0.3500, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.03% (1.0747 => 1.1288, std.dev.: 0.0190) MultiSource/Applications/minisat/minisat: 2.10% (6.2751 => 6.4069, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.14% (4.0811 => 4.1277, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.58% (0.9990 => 0.9932, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -0.88% (0.6039 => 0.5986, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: -3.15% (0.1680 => 0.1627, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.77% (0.1564 => 0.1552, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.32% (0.3116 => 0.3126, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.70% (0.2353 => 0.2313, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.50% (0.3177 => 0.3193, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.31% (0.2295 => 0.2302, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -10.60% (0.0453 => 0.0405, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -65.52% (0.0087 => 0.0030, std.dev.: 0.0026) SingleSource/UnitTests/2003-08-11-VaListArg: 2.27% (0.0088 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.52% (0.0238 => 0.0244, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.75% (0.0193 => 0.0124, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0388 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0302 => 0.0300, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.42% (0.0284 => 0.0226, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 23.81% (0.0147 => 0.0182, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0121 => 0.0121, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -10.00% (0.0250 => 0.0225, std.dev.: 0.0033) SingleSource/UnitTests/byval-alignment: 10.20% (0.0294 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 20.00% (0.0005 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1447 => 0.1450, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.75% (1.4602 => 1.5003, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.83% (0.1490 => 0.1418, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.04% (0.4238 => 0.4109, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.22% (0.1438 => 0.1363, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.12% (0.0618 => 0.0574, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.83% (0.0236 => 0.0201, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.47% (0.0643 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1292 => 1.1287, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 60.00% (0.0010 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 340.00% (0.0005 => 0.0022, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.53% (0.0616 => 0.0545, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.32% (0.0171 => 0.0216, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.37% (0.7650 => 0.7678, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.04% (1.5996 => 1.6003, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.24% (4.1772 => 3.1230, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/except: 81133.33% (0.0006 => 0.4874, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.83% (0.6410 => 0.6848, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 6.78% (2.1763 => 2.3239, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 5.91% (0.5309 => 0.5623, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.28% (0.3582 => 0.3771, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.05% (0.2552 => 0.2681, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 4.74% (1.0046 => 1.0522, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 4.49% (0.6173 => 0.6450, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 4.36% (15.3105 => 15.9777, std.dev.: 0.0519) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (1.1653 => 1.2090, std.dev.: 0.0149) MultiSource/Applications/d/make_dparser: 3.30% (3.0225 => 3.1223, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.6915 => 0.7136, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 3.06% (29.3170 => 30.2142, std.dev.: 0.1449) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.92% (0.3901 => 0.4015, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.90% (0.4248 => 0.4371, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (12.6413 => 13.0001, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.76% (0.7639 => 0.7850, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6069 => 0.6209, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 2.08% (1.1440 => 1.1678, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.02% (4.7455 => 4.8412, std.dev.: 0.0346) MultiSource/Applications/SPASS/SPASS: 2.00% (13.3238 => 13.5900, std.dev.: 0.0599) MultiSource/Applications/JM/lencod/lencod: 1.73% (14.7256 => 14.9801, std.dev.: 0.0346) MultiSource/Applications/treecc/treecc: 1.68% (1.8798 => 1.9113, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (0.8569 => 0.8690, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (6.4908 => 6.5763, std.dev.: 0.0292) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.88% (4.0101 => 4.5667, std.dev.: 0.0428) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.41% (0.0917 => 0.1040, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 12.17% (1.0063 => 1.1288, std.dev.: 0.0190) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.21% (0.2694 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.86% (0.2857 => 0.3110, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: 8.82% (7.0025 => 7.6202, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.3301 => 0.3500, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.47% (40.4792 => 42.6945, std.dev.: 0.4217) SingleSource/Benchmarks/Misc/fp-convert: 4.63% (15.2242 => 15.9286, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.35% (0.5876 => 0.6073, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 3.29% (8.5113 => 8.7914, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.19% (2.6656 => 2.7505, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 2.93% (6.2244 => 6.4069, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.6308 => 0.6488, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8930, std.dev.: 0.0175) MultiSource/Benchmarks/sim/sim: 2.75% (3.8907 => 3.9975, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.68% (0.8498 => 0.8726, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/mason/mason: 2.46% (0.5004 => 0.5127, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 2.35% (3.5520 => 3.6353, std.dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: 2.15% (2.4013 => 2.4529, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.94% (4.6127 => 4.7022, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.52% (4.0659 => 4.1277, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.00% (27.1724 => 27.4448, std.dev.: 0.0483) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.09% (0.3497 => 0.2060, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.66% (5.2665 => 4.1260, std.dev.: 0.0626) SingleSource/Benchmarks/Shootout-C++/ary3: -20.08% (1.7473 => 1.3965, std.dev.: 0.0890) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.57% (1.1647 => 0.9601, std.dev.: 0.0252) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.47% (15.8312 => 13.3824, std.dev.: 0.0808) SingleSource/Benchmarks/Shootout/sieve: -12.18% (8.1594 => 7.1652, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: -11.72% (0.3746 => 0.3307, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9381, std.dev.: 0.0263) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3747, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3311, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: -6.42% (7.6833 => 7.1902, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: -6.04% (3.4230 => 3.2164, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -5.87% (1.4441 => 1.3593, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9267, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1876, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: -3.87% (0.2664 => 0.2561, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.80% (1.2722 => 1.2239, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/misr: -3.26% (0.4296 => 0.4156, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.19% (0.4140 => 0.4008, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.18% (1.1683 => 1.1312, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.11% (3.7496 => 3.6331, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (3.9413 => 3.8318, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -2.77% (9.2503 => 8.9939, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash2: -2.05% (3.4876 => 3.4160, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3618, std.dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (92.7467 => 90.9751, std.dev.: 0.3329) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2223, std.dev.: 0.0315) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3202, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/fldry: -1.09% (2.4971 => 2.4699, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.48% (0.9980 => 0.9932, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -0.60% (0.6022 => 0.5986, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: -2.34% (0.1666 => 0.1627, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.13% (0.1554 => 0.1552, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (0.3083 => 0.3126, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.38% (0.2394 => 0.2313, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3175 => 0.3193, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2302 => 0.2302, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -9.80% (0.0449 => 0.0405, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0026) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.42% (0.0192 => 0.0124, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.42% (0.0284 => 0.0226, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -35.98% (0.0189 => 0.0121, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -9.64% (0.0249 => 0.0225, std.dev.: 0.0033) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -0.11% (1.5019 => 1.5003, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.53% (0.1501 => 0.1418, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.64% (0.4264 => 0.4109, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1344 => 0.1363, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.0589 => 0.0574, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.10% (0.0639 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -8.33% (0.0024 => 0.0022, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.20% (0.0246 => 0.0216, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.82% (0.7541 => 0.7678, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.17% (1.5363 => 1.6003, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 20 23:39:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 01:39:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921063949.4984C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4087?compare_to=4082&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4087, Order: 164360, Start Time: 2012-09-21 05:21:19, End Time: 2012-09-21 06:41:12 To: 4082, Order: 164356, Start Time: 2012-09-21 03:32:54, End Time: 2012-09-21 04:52:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (122 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.41% (1.2022 => 1.2191, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.51% (15.3395 => 14.8012, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.16% (8.0944 => 8.0006, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (1.9724 => 1.9501, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.45% (0.5727 => 0.5701, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.59% (15.9489 => 15.8542, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: -0.49% (14.8004 => 14.7283, std.dev.: 0.0273) MultiSource/Benchmarks/Bullet/bullet: 0.08% (83.0622 => 83.1277, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: -0.22% (4.3291 => 4.3195, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.51% (1.2270 => 1.2208, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.58% (7.4230 => 7.3801, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.58% (3.6881 => 3.6668, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.6361 => 0.6348, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (0.0648 => 0.0673, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.44% (63.2438 => 83.1277, std.dev.: 0.0197) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14284.58% (0.0720 => 10.3569, std.dev.: 0.0083) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.77% (10.3673 => 14.8012, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/richards_benchmark: 26.51% (0.1622 => 0.2052, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.70% (2.2022 => 2.5040, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.42% (7.0540 => 8.0006, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.74% (1.7609 => 1.9501, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.91% (10.4361 => 11.4698, std.dev.: 0.0193) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.47% (0.1584 => 0.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.47% (0.3282 => 0.3560, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.60% (0.3473 => 0.3737, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.43% (0.1655 => 0.1778, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.38% (0.3927 => 0.4217, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 7.33% (0.3561 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.32% (0.3497 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.31% (0.3543 => 0.3802, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.26% (9.4845 => 10.1735, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3828 => 0.4106, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.25% (0.3516 => 0.3771, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.22% (0.1440 => 0.1544, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3694 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.3177 => 0.3404, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.4879 => 0.5227, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 6.97% (0.3886 => 0.4157, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7433 => 0.7935, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 6.69% (0.3109 => 0.3317, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.49% (0.7115 => 0.7577, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.30% (5.7591 => 6.1221, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2271 => 0.2414, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3423 => 0.3638, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.24% (0.4615 => 0.4903, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 6.23% (0.2554 => 0.2713, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.22% (1.5415 => 1.6374, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.20% (0.6675 => 0.7089, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.15% (3.3354 => 3.5405, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.8067 => 0.8563, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 6.08% (0.1695 => 0.1798, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.01% (1.3050 => 1.3834, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.5860 => 0.6211, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (8.1363 => 8.6220, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (4.2646 => 4.5177, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.5569 => 0.5890, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.72% (0.5105 => 0.5397, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.71% (4.9449 => 5.2272, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3441 => 0.3637, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.56% (5.0018 => 5.2801, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.8172 => 0.8626, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.55% (0.9765 => 1.0307, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3121 => 0.3292, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 5.33% (1.1642 => 1.2263, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (1.1861 => 1.2483, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.20% (3.8723 => 4.0737, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 5.16% (1.0722 => 1.1275, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.99% (0.3387 => 0.3556, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.88% (0.6030 => 0.6324, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 4.82% (0.4299 => 0.4506, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 4.81% (0.5925 => 0.6210, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.74% (21.9371 => 22.9778, std.dev.: 0.0205) MultiSource/Applications/siod/siod: 4.70% (2.2969 => 2.4049, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 4.65% (1.5603 => 1.6329, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.63% (2.0273 => 2.1211, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5020 => 0.5250, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (7.9617 => 8.3255, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/football/football: 4.53% (0.8921 => 0.9325, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.16% (1.5859 => 1.6518, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6456 => 0.6723, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.06% (0.5981 => 0.6224, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.88% (0.7326 => 0.7610, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4729, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.4636 => 0.4813, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3422 => 0.3552, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (14.3668 => 14.9069, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.2024 => 2.2842, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.4064 => 0.4213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.48% (0.3650 => 0.3777, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.1840 => 1.2235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4289 => 0.4432, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4620 => 0.4769, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4203 => 0.4338, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.88% (2.0665 => 2.1260, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.8101 => 0.8317, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 1.62% (1.2842 => 1.3050, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4517, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3516, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7876, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5761, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.60% (5.2763 => 3.2396, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.75% (5.3855 => 3.8908, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.40% (5.3526 => 3.8860, std.dev.: 0.0123) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1278, std.dev.: 0.0541) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.84% (2.9384 => 2.5904, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: -8.34% (22.1758 => 20.3264, std.dev.: 0.0349) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.44% (1.5373 => 1.3768, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3116, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.31% (1.8329 => 1.7173, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.04% (3.2827 => 3.1502, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5120, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4284, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.61% (10.2830 => 10.0150, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (8.1563 => 7.9793, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -1.47% (1.2373 => 1.2191, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2245, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (0.5229 => 0.5701, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.77% (14.9895 => 15.8542, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 4.05% (14.1553 => 14.7283, std.dev.: 0.0273) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (4.1105 => 4.3195, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.50% (1.1048 => 1.2208, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.10% (7.1582 => 7.3801, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.89% (3.4629 => 3.6668, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.6222 => 0.6348, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.19% (0.2116 => 0.0673, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 5.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 00:16:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 02:16:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921071642.2FC3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4088?compare_to=4084&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4088, Order: 164362, Start Time: 2012-09-21 05:59:51, End Time: 2012-09-21 07:18:06 To: 4084, Order: 164359, Start Time: 2012-09-21 04:15:51, End Time: 2012-09-21 05:30:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (725 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.61% (78.4808 => 80.5265, std.dev.: 0.5234) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.32% (2.0176 => 2.4075, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.37% (0.1072 => 0.1226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.60% (3.9660 => 4.3467, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.45% (0.1588 => 0.1738, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.27% (0.1327 => 0.1450, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.25% (1.3693 => 1.4960, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2596 => 0.2834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.07% (0.9199 => 1.0033, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.7710 => 0.8392, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.81% (1.2193 => 1.3267, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.79% (0.5265 => 0.5728, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.59% (0.3130 => 0.3399, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.56% (0.2721 => 0.2954, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.44% (0.7061 => 0.7657, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.44% (1.1364 => 1.2323, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 8.42% (13.8202 => 14.9842, std.dev.: 0.3211) SingleSource/Benchmarks/Shootout-C++/hash: 8.35% (0.4062 => 0.4401, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.32% (1.4563 => 1.5775, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.5818 => 0.6288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3899 => 0.4213, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6283 => 0.6788, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.91% (0.5577 => 0.6018, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 7.90% (1.0313 => 1.1128, std.dev.: 0.0283) SingleSource/UnitTests/ObjC++/Hello: 7.85% (0.5748 => 0.6199, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 7.80% (0.1589 => 0.1713, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.4791 => 0.5161, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.2781 => 0.2994, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 7.43% (3.8646 => 4.1517, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4390 => 0.4710, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2127 => 0.2282, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.27% (0.8310 => 0.8914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.25% (0.4016 => 0.4307, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.2914 => 0.3123, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.14% (0.3489 => 0.3738, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.10% (0.2760 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3756 => 0.4021, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.5637 => 0.6033, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 7.01% (0.2925 => 0.3130, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.97% (7.2180 => 7.7208, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.85% (0.7460 => 0.7971, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.3220 => 0.3439, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.80% (3.6692 => 3.9187, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (1.9828 => 2.1167, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.66% (0.2628 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.3868 => 0.4124, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.54% (3.1889 => 3.3973, std.dev.: 0.0804) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.45% (0.2696 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.33% (1.3245 => 1.4083, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 6.31% (1.0594 => 1.1263, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.27% (0.6576 => 0.6988, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (0.8698 => 0.9211, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.4113 => 0.4355, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (1.3819 => 1.4627, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.2859 => 0.3025, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.75% (1.3813 => 1.4607, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.69% (4.3801 => 4.6293, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 5.68% (8.4961 => 8.9784, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.64% (13.2842 => 14.0339, std.dev.: 0.0222) MultiSource/Benchmarks/sim/sim: 5.62% (0.3131 => 0.3307, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.56% (0.6135 => 0.6476, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2321 => 0.2450, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (1.1333 => 1.1962, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (4.4433 => 4.6887, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.3245 => 0.3418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.30% (0.4003 => 0.4215, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.09% (0.8818 => 0.9267, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.99% (4.9865 => 5.2354, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 4.97% (0.3578 => 0.3756, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.97% (0.3940 => 0.4136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.96% (0.3914 => 0.4108, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 4.88% (0.3789 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.86% (0.3601 => 0.3776, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 4.85% (0.3646 => 0.3823, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.82% (3.2742 => 3.4321, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 4.78% (0.3663 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.77% (0.3650 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.64% (0.3623 => 0.3791, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.41% (1.5188 => 1.5858, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.33% (0.4805 => 0.5013, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (0.9108 => 0.9502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.30% (0.6250 => 0.6519, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.19% (2.1007 => 2.1887, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2785 => 6.4981, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 3.45% (33.2944 => 34.4436, std.dev.: 0.0309) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 25.66% (1.8175 => 2.2838, std.dev.: 0.0365) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.72% (1.1560 => 1.2568, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.03% (1.2998 => 1.3782, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.2619 => 11.6973, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5470, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5938, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5978, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.67% (0.4657 => 0.3834, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.23% (22.5627 => 21.8346, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2745, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.75% (1.3780 => 1.2988, std.dev.: 0.0175) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std.dev.: 0.0213) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5857, std.dev.: 0.0136) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4836, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.00% (0.6615 => 0.6483, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2388, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -1.67% (28.2225 => 27.7517, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (0.8342 => 0.8233, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.1080 => 4.0595, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2620, std.dev.: 0.0148) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 01:02:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 03:02:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921080230.9A5C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4089?compare_to=4086&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4089, Order: 164364, Start Time: 2012-09-21 06:53:20, End Time: 2012-09-21 08:03:57 To: 4086, Order: 164360, Start Time: 2012-09-21 05:26:35, End Time: 2012-09-21 06:37:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (50 on baseline) Performance Improvements: 3 (43 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 889 (797 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 7.23% (8.5381 => 9.1555, std.dev.: 0.1544) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.50% (0.4405 => 0.4559, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.32% (0.9335 => 0.9458, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (1.3844 => 1.3989, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 5.09% (1.7278 => 1.8158, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.99% (1.7958 => 1.8674, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.67% (59.3324 => 61.5092, std.dev.: 0.4904) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.86% (2.4518 => 2.4975, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.49% (3.1223 => 3.0758, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -1.32% (14.9801 => 14.7818, std.dev.: 0.0418) MultiSource/Applications/oggenc/oggenc: -1.08% (4.8412 => 4.7890, std.dev.: 0.0192) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.34% (0.9932 => 0.9898, std.dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 0.58% (0.5986 => 0.6021, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 2.03% (0.1627 => 0.1660, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.71% (0.1552 => 0.1510, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.74% (0.3126 => 0.3103, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.2313 => 0.2391, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (0.3193 => 0.3198, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2302 => 0.2312, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 9.63% (0.0405 => 0.0444, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: 196.67% (0.0030 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.92% (0.0244 => 0.0232, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.42% (0.0124 => 0.0158, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.83% (0.0389 => 0.0378, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0300 => 0.0302, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 19.47% (0.0226 => 0.0270, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0326 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -24.18% (0.0182 => 0.0138, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: 60.33% (0.0121 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 12.00% (0.0225 => 0.0252, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.93% (0.0324 => 0.0327, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -16.67% (0.0006 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1450 => 0.1449, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -0.04% (1.5003 => 1.4997, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.56% (0.1418 => 0.1426, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.07% (0.4109 => 0.4065, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.48% (0.1363 => 0.1424, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.45% (0.0574 => 0.0611, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.46% (0.0201 => 0.0218, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.92% (0.0646 => 0.0569, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1287 => 1.1307, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.75% (0.0016 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -77.27% (0.0022 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.12% (0.0545 => 0.0562, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.35% (0.0216 => 0.0185, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7678 => 0.7696, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.19% (1.6003 => 1.5973, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.71% (4.1772 => 3.1450, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/except: 82950.00% (0.0006 => 0.4983, std.dev.: 0.0073) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.94% (0.0745 => 0.0901, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.99% (0.5309 => 0.5733, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.22% (0.6410 => 0.6809, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 5.90% (2.1763 => 2.3046, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.2552 => 0.2683, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.08% (0.3582 => 0.3764, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 4.71% (0.6173 => 0.6464, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 4.32% (1.0046 => 1.0480, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.6915 => 0.7184, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 3.87% (15.3105 => 15.9026, std.dev.: 0.1502) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.82% (0.7639 => 0.7931, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 3.56% (1.1653 => 1.2068, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 2.93% (29.3170 => 30.1772, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.5150 => 1.5541, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.3901 => 0.4001, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.27% (1.1440 => 1.1700, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (12.6413 => 12.8870, std.dev.: 0.0774) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.92% (1.1827 => 1.2054, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 1.84% (1.3268 => 1.3512, std.dev.: 0.0087) MultiSource/Applications/d/make_dparser: 1.76% (3.0225 => 3.0758, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 1.65% (2.0972 => 2.1317, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 1.18% (3.5980 => 3.6404, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 1.11% (13.3238 => 13.4719, std.dev.: 0.0554) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2292, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.88% (1.7426 => 2.0019, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.95% (4.0101 => 4.5694, std.dev.: 0.0291) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8069, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 9.18% (7.0025 => 7.6456, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.96% (0.2857 => 0.3113, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3301 => 0.3504, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 4.98% (15.2242 => 15.9827, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 4.78% (1.7330 => 1.8158, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/dt: 4.54% (0.9851 => 1.0298, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (2.4042 => 2.4975, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5377, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (6.6312 => 6.8777, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.29% (0.8498 => 0.8778, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.6308 => 0.6501, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 2.78% (3.8907 => 3.9989, std.dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8887, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.62% (4.2129 => 4.3231, std.dev.: 0.0392) SingleSource/Benchmarks/Misc/ReedSolomon: 2.53% (8.5113 => 8.7265, std.dev.: 0.0774) MultiSource/Applications/siod/siod: 2.32% (3.5520 => 3.6345, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.18% (0.5876 => 0.6004, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 2.04% (2.4013 => 2.4503, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.75% (0.3497 => 0.2107, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.58% (5.2665 => 4.1302, std.dev.: 0.1016) SingleSource/Benchmarks/Shootout-C++/ary3: -19.58% (1.7473 => 1.4052, std.dev.: 0.1080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.1647 => 0.9597, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.50% (15.8312 => 13.2186, std.dev.: 0.0954) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.74% (0.0917 => 0.0791, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1622, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/moments: -10.86% (0.1114 => 0.0993, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.80% (3.6023 => 3.2852, std.dev.: 0.1189) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9446, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.72% (3.6254 => 3.3819, std.dev.: 0.0167) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3334, std.dev.: 0.0198) MultiSource/Applications/lambda-0_1_3/lambda: -6.39% (7.6833 => 7.1922, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: -6.20% (3.4230 => 3.2109, std.dev.: 0.0487) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7969, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -5.52% (62.4126 => 58.9667, std.dev.: 0.1255) MultiSource/Benchmarks/FreeBench/distray/distray: -5.52% (0.2664 => 0.2517, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -5.32% (1.4441 => 1.3673, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1898, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.18% (0.4140 => 0.3967, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.13% (1.2722 => 1.2196, std.dev.: 0.0144) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.01% (1.2959 => 1.2439, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/methcall: -3.61% (9.2503 => 8.9163, std.dev.: 0.0344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.52% (45.4683 => 43.8659, std.dev.: 0.4631) MultiSource/Applications/SPASS/SPASS: -3.19% (8.5323 => 8.2605, std.dev.: 0.0466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6423, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.76% (3.9413 => 3.8326, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -2.59% (9.5474 => 9.3005, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: -2.47% (1.0926 => 1.0656, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.47% (1.1683 => 1.1395, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -2.41% (92.7467 => 90.5075, std.dev.: 0.2329) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4207, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3630, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3121, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2282, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.54% (2.8964 => 2.8517, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: -1.48% (2.4971 => 2.4602, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3184, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/oourafft: -1.02% (3.8200 => 3.7809, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.82% (0.9980 => 0.9898, std.dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: -0.02% (0.6022 => 0.6021, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -0.36% (0.1666 => 0.1660, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.83% (0.1554 => 0.1510, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.65% (0.3083 => 0.3103, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2394 => 0.2391, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.72% (0.3175 => 0.3198, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2302 => 0.2312, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -1.11% (0.0449 => 0.0444, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.33% (0.0240 => 0.0232, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.71% (0.0192 => 0.0158, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.08% (0.0390 => 0.0378, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.93% (0.0284 => 0.0270, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -22.03% (0.0177 => 0.0138, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.40% (0.1429 => 0.1449, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -0.15% (1.5019 => 1.4997, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.00% (0.1501 => 0.1426, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.67% (0.4264 => 0.4065, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.95% (0.1344 => 0.1424, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.74% (0.0589 => 0.0611, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.03% (0.0232 => 0.0218, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.95% (0.0639 => 0.0569, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1350 => 1.1307, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.77% (0.0637 => 0.0562, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.80% (0.0246 => 0.0185, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.06% (0.7541 => 0.7696, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.97% (1.5363 => 1.5973, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 01:32:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 03:32:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921083225.A8EE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4090?compare_to=4087&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4090, Order: 164364, Start Time: 2012-09-21 07:13:36, End Time: 2012-09-21 08:33:53 To: 4087, Order: 164360, Start Time: 2012-09-21 05:21:19, End Time: 2012-09-21 06:41:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (122 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (727 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.03% (79.1547 => 80.7601, std.dev.: 0.4934) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.07% (1.2191 => 1.2060, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5701 => 0.5700, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 0.10% (15.8542 => 15.8708, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: -0.18% (14.7283 => 14.7017, std.dev.: 0.0299) MultiSource/Benchmarks/Bullet/bullet: 0.12% (83.1277 => 83.2295, std.dev.: 0.0848) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.3195 => 4.3236, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.23% (1.2208 => 1.2236, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.12% (7.3801 => 7.3712, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.11% (3.6668 => 3.6628, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.6348 => 0.6340, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.57% (0.0673 => 0.0649, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.60% (63.2438 => 83.2295, std.dev.: 0.0848) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14272.08% (0.0720 => 10.3479, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.96% (10.3673 => 14.8209, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 26.57% (0.1622 => 0.2053, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.01% (2.2022 => 2.5108, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.62% (7.0540 => 8.0146, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.05% (1.1194 => 1.2543, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.34% (1.7609 => 1.9605, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 10.03% (10.4361 => 11.4829, std.dev.: 0.0195) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.53% (0.1584 => 0.1735, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.12% (0.3473 => 0.3755, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.10% (0.1655 => 0.1789, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3561 => 0.3847, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3543 => 0.3824, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.93% (0.3543 => 0.3824, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3497 => 0.3773, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.82% (0.3694 => 0.3983, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 7.79% (0.3516 => 0.3790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.73% (0.3828 => 0.4124, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.3927 => 0.4230, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.42% (9.4845 => 10.1878, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/property: 7.41% (0.3886 => 0.4174, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.30% (0.4879 => 0.5235, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 6.85% (0.3109 => 0.3322, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7433 => 0.7933, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 6.44% (0.7115 => 0.7573, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3423 => 0.3642, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.40% (5.7591 => 6.1274, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.37% (0.2700 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (1.5415 => 1.6372, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.20% (0.6675 => 0.7089, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.18% (0.4615 => 0.4900, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 6.16% (3.3354 => 3.5407, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.10% (1.3050 => 1.3846, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.08% (0.2271 => 0.2409, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5860 => 0.6212, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (4.2646 => 4.5201, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (8.1363 => 8.6160, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.8067 => 0.8534, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.78% (0.5105 => 0.5400, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.74% (0.8172 => 0.8641, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (5.0018 => 5.2852, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.61% (4.9449 => 5.2221, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.3092 => 0.3265, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5569 => 0.5880, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9765 => 1.0297, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: 5.39% (1.1642 => 1.2269, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 5.35% (0.7835 => 0.8254, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.29% (0.3441 => 0.3623, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 5.26% (3.8723 => 4.0758, std.dev.: 0.0234) MultiSource/Applications/lemon/lemon: 5.18% (1.0722 => 1.1277, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.16% (1.1861 => 1.2473, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 5.08% (0.3387 => 0.3559, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.84% (21.9371 => 22.9997, std.dev.: 0.0418) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (7.9617 => 8.3404, std.dev.: 0.0148) MultiSource/Benchmarks/McCat/05-eks/eks: 4.72% (0.4299 => 0.4502, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5020 => 0.5257, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 4.69% (0.6030 => 0.6313, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.65% (2.2969 => 2.4038, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 4.63% (2.0273 => 2.1212, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 4.61% (1.5603 => 1.6323, std.dev.: 0.0110) SingleSource/UnitTests/ObjC++/Hello: 4.56% (0.5925 => 0.6195, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.54% (0.8921 => 0.9326, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (1.5859 => 1.6530, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.23% (1.4186 => 1.4786, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6456 => 0.6719, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.00% (0.5981 => 0.6220, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.92% (0.4103 => 0.4264, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.91% (1.1840 => 1.2303, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 3.75% (0.7326 => 0.7601, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (14.3668 => 14.9057, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.64% (2.2024 => 2.2825, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists: 3.57% (0.3422 => 0.3544, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.4064 => 0.4204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4289 => 0.4432, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.29% (0.3865 => 0.3992, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3650 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3826 => 0.3947, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4620 => 0.4756, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.4048 => 0.4161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (2.0665 => 2.1193, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.8101 => 0.8292, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.70% (17.1811 => 17.4728, std.dev.: 0.0244) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3034, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.8922 => 3.9398, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3841, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (4.2280 => 4.3614, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7469, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7872, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.08% (2.2771 => 2.3018, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.71% (5.2763 => 3.2338, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.48% (5.3855 => 3.9054, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.14% (5.3526 => 3.9000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0683, std.dev.: 0.0509) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.80% (2.9384 => 2.5916, std.dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: -8.17% (22.1758 => 20.3636, std.dev.: 0.0452) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.87% (19.9488 => 18.3797, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.37% (1.8329 => 1.7161, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.72% (1.6805 => 1.5844, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8046, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1506, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (8.6802 => 8.4022, std.dev.: 0.0235) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.53% (1.2373 => 1.2060, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -2.47% (10.2830 => 10.0293, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (8.1563 => 8.0285, std.dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2283, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.01% (0.5229 => 0.5700, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 5.88% (14.9895 => 15.8708, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 3.86% (14.1553 => 14.7017, std.dev.: 0.0299) MultiSource/Benchmarks/MallocBench/gs/gs: 5.18% (4.1105 => 4.3236, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.75% (1.1048 => 1.2236, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.98% (7.1582 => 7.3712, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.77% (3.4629 => 3.6628, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.6222 => 0.6340, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 02:00:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 04:00:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921090026.B006C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4091?compare_to=4088&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4091, Order: 164365, Start Time: 2012-09-21 07:46:59, End Time: 2012-09-21 09:01:51 To: 4088, Order: 164362, Start Time: 2012-09-21 05:59:51, End Time: 2012-09-21 07:18:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 24.55% (0.3951 => 0.4921, std.dev.: 0.0355) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.38% (2.0176 => 2.4087, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.74% (0.1410 => 0.1632, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.37% (0.1072 => 0.1226, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.71% (3.9660 => 4.3512, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.66% (0.7038 => 0.7718, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.58% (0.7710 => 0.8449, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.54% (0.6959 => 0.7623, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.50% (0.1327 => 0.1453, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.29% (0.5265 => 0.5754, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.14% (1.3693 => 1.4944, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.03% (0.9199 => 1.0030, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.00% (1.2193 => 1.3290, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.82% (0.2721 => 0.2961, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.80% (1.4563 => 1.5845, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.46% (1.1364 => 1.2325, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 8.44% (13.8202 => 14.9861, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.32% (0.4062 => 0.4400, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5577 => 0.6024, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 8.00% (1.0313 => 1.1138, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.94% (0.5818 => 0.6280, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.93% (0.3899 => 0.4208, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.88% (1.1061 => 1.1933, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.72% (0.5748 => 0.6192, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.4791 => 0.5161, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.65% (3.8646 => 4.1602, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 7.54% (2.1791 => 2.3433, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 7.47% (0.8310 => 0.8931, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.45% (0.2995 => 0.3218, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.35% (0.7061 => 0.7580, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.17% (0.7506 => 0.8044, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.08% (0.5637 => 0.6036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4016 => 0.4300, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7272, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 7.04% (0.2243 => 0.2401, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.04% (16.6129 => 17.7822, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.96% (0.2760 => 0.2952, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.94% (3.6692 => 3.9238, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.92% (0.6576 => 0.7031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.88% (3.1889 => 3.4083, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.3756 => 0.4014, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.7460 => 0.7964, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (1.9828 => 2.1167, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.66% (1.9270 => 2.0553, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 6.65% (0.3293 => 0.3512, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 6.60% (1.0594 => 1.1293, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.55% (1.3245 => 1.4113, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.47% (0.6744 => 0.7180, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4390 => 0.4673, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.39% (0.3868 => 0.4115, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.37% (0.2761 => 0.2937, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (1.2749 => 1.3553, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.31% (0.2696 => 0.2866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.23% (0.6135 => 0.6517, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.08% (0.4113 => 0.4363, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (1.3819 => 1.4649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (1.3813 => 1.4642, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.96% (14.8535 => 15.7393, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.93% (0.8698 => 0.9214, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (13.2842 => 14.0688, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/parameter-passing: 5.85% (0.4003 => 0.4237, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.72% (8.4961 => 8.9819, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.68% (4.4433 => 4.6957, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3914 => 0.4136, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.65% (0.3578 => 0.3780, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (4.3801 => 4.6273, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.64% (1.1333 => 1.1972, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.63% (0.3940 => 0.4162, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3646 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.62% (0.3131 => 0.3307, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.53% (0.3601 => 0.3800, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.38% (0.3623 => 0.3818, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.31% (14.5298 => 15.3014, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.20% (4.6629 => 4.9053, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3755 => 0.3949, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (6.5754 => 6.9123, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.07% (0.8818 => 0.9265, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.98% (4.9865 => 5.2350, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.88% (3.2742 => 3.4339, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 4.52% (3.7467 => 3.9159, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.46% (1.5188 => 1.5865, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.43% (0.4805 => 0.5018, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.36% (0.9108 => 0.9505, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.32% (2.1007 => 2.1914, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.6250 => 0.6517, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2809, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2785 => 6.5076, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 3.32% (33.2944 => 34.4008, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.29% (16.2614 => 16.6345, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1915, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4163, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.2093 => 0.2213, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.57% (1.9144 => 2.0019, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6964, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5467, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.37% (10.7476 => 11.1097, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5918, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.18% (3.1071 => 3.1437, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5895, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6849, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.26% (0.4657 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.29% (22.5627 => 21.8215, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.99% (20.3410 => 18.3089, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.3458 => 0.3227) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.82% (1.3780 => 1.2978, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7063, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5985, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9493, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.00% (0.6615 => 0.6483, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7539, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1882, std.dev.: 0.0439) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (4.1080 => 4.0588, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2301, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2625, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5655, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 02:15:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 04:15:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921091534.80F642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4092?compare_to=4085&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4092, Order: 164362, Start Time: 2012-09-21 06:29:17, End Time: 2012-09-21 09:17:01 To: 4085, Order: 164354, Start Time: 2012-09-21 03:16:54, End Time: 2012-09-21 06:00:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (110 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (783 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.34% (2.0704 => 2.1189, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.55% (73.7820 => 74.9272, std.dev.: 0.0412) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 8.71% (1.5932 => 1.7320, std.dev.: 0.0395) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3488 => 0.3789, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.56% (0.3446 => 0.3741, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.46% (0.3465 => 0.3758, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.45% (0.3442 => 0.3733, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.35% (0.3496 => 0.3788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3469 => 0.3756, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.27% (0.3460 => 0.3746, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3643 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.16% (0.3650 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.98% (0.3724 => 0.4021, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.70% (1.3152 => 1.4033, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (1.6211 => 1.7245, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.24% (0.4361 => 0.4633, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (0.5026 => 0.5329, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (3.5627 => 3.7704, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.73% (0.3930 => 0.4155, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.61% (0.2566 => 0.2710, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (0.5000 => 0.5280, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (2.7292 => 2.8812, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (4.4195 => 4.6631, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (0.4994 => 0.5268, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 5.37% (0.5826 => 0.6139, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 5.21% (0.5889 => 0.6196, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.12% (0.2736 => 0.2876, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (2.1013 => 2.2087, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 5.10% (1.8794 => 1.9752, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 5.08% (23.5202 => 24.7144, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (0.2040 => 0.2143, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.90% (0.4139 => 0.4342, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.3004 => 0.3151, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.86% (0.3890 => 0.4079, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2738 => 0.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3195 => 0.3350, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.83% (0.2875 => 0.3014, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.67% (1.4269 => 1.4935, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.62% (0.3271 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.59% (0.2725 => 0.2850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.59% (0.3096 => 0.3238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.2823 => 0.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.55% (0.2813 => 0.2941, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0673 => 2.1596, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.3903 => 0.4077, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.44% (0.2792 => 0.2916, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.41% (0.3084 => 0.3220, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.36% (0.2750 => 0.2870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.35% (0.3124 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (0.4658 => 0.4860, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3726 => 0.3887, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.29% (0.5900 => 0.6153, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 4.28% (0.4251 => 0.4433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.25% (0.3060 => 0.3190, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3258 => 0.3396, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.19% (0.2911 => 0.3033, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.16% (0.7171 => 0.7469, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 4.12% (0.4146 => 0.4317, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.3477 => 0.3620, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3678 => 0.3829, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0493, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.6435 => 0.6695, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3690 => 0.3839, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.02% (0.3282 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (1.9966 => 2.0766, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.98% (0.3845 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.91% (0.7426 => 0.7716, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.85% (0.5012 => 0.5205, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 3.80% (0.4847 => 0.5031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.2737 => 0.2840, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3981 => 0.4130, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (0.5361 => 0.5559, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.2969 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.60% (0.5584 => 0.5785, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (11.6398 => 12.0013, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (4.6926 => 4.8242, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.37% (0.4253 => 0.4354, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.36% (0.2162 => 0.3575, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6691, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8979, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std.dev.: 0.0946) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6345, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5040, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.77% (2.0820 => 2.1189, std.dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.67% (41.7953 => 42.4937, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.33% (1.0927 => 1.1072, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5152, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5897, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4589, std.dev.: 0.0400) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5685, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0407) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7864, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -2.24% (17.2379 => 16.8520, std.dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5704, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9771, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 02:29:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 04:29:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921092943.E8D3B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4093?compare_to=4089&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4093, Order: 164365, Start Time: 2012-09-21 08:19:36, End Time: 2012-09-21 09:31:13 To: 4089, Order: 164364, Start Time: 2012-09-21 06:53:20, End Time: 2012-09-21 08:03:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (64 on baseline) Performance Improvements: 2 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (789 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.86% (0.4386 => 0.4599, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.92% (0.2911 => 0.3025, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5610 => 0.5747, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 2.20% (1.8756 => 1.9169, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.3046 => 2.3279, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 14.09% (0.0724 => 0.0826, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 1.51% (2.3576 => 2.3932, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.03% (2.9233 => 2.9535, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -4.95% (1.8158 => 1.7259, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.39% (2.4975 => 2.4379, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.35% (0.9898 => 0.9933, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 0.47% (0.6021 => 0.6049, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1660 => 0.1658, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.98% (0.1510 => 0.1555, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.84% (0.3103 => 0.3129, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.59% (0.2391 => 0.2377, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.88% (0.3198 => 0.3226, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.55% (0.2312 => 0.2253, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 2.70% (0.0444 => 0.0456, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -14.61% (0.0089 => 0.0076, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: 2.25% (0.0089 => 0.0091, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.02% (0.0232 => 0.0225, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 20.89% (0.0158 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.59% (0.0378 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0302 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.70% (0.0270 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0322 => 0.0321, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 28.26% (0.0138 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.55% (0.0194 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.79% (0.0252 => 0.0250, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.31% (0.0327 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1449 => 0.1451, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.15% (1.4997 => 1.5320, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.75% (0.1426 => 0.1451, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.15% (0.4065 => 0.4059, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.42% (0.1424 => 0.1361, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.46% (0.0611 => 0.0541, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.31% (0.0218 => 0.0271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.71% (0.0569 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.08% (0.0048 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1307 => 1.1296, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 107.69% (0.0013 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.35% (0.0562 => 0.0637, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.70% (0.0185 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.7696 => 0.7650, std.dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.10% (1.5973 => 1.5989, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.59% (4.1772 => 3.1082, std.dev.: 0.0710) SingleSource/Benchmarks/Shootout-C++/except: 82266.67% (0.0006 => 0.4942, std.dev.: 0.0065) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.31% (0.5309 => 0.5697, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.14% (0.1414 => 0.1515, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 6.97% (2.1763 => 2.3279, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.26% (0.6410 => 0.6811, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.2552 => 0.2688, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 4.36% (15.3105 => 15.9785, std.dev.: 0.0303) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (1.1653 => 1.2138, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 4.08% (0.6173 => 0.6425, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 4.08% (1.0046 => 1.0456, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: 3.69% (29.3170 => 30.3974, std.dev.: 0.1470) MultiSource/Applications/lambda-0_1_3/lambda: 3.56% (0.6915 => 0.7161, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3901 => 0.4031, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.13% (1.1440 => 1.1798, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.68% (0.7639 => 0.7844, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.66% (0.4248 => 0.4361, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.44% (1.3268 => 1.3592, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 2.31% (2.0972 => 2.1456, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.1827 => 1.2096, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.2186 => 8.4034, std.dev.: 0.0481) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (12.6413 => 12.9033, std.dev.: 0.0578) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1672 => 1.1908, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.97% (1.8798 => 1.9169, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 1.74% (13.3238 => 13.5552, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (1.4408 => 1.4638, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 1.53% (14.6079 => 14.8310, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.41% (1.2021 => 1.2191, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.20% (4.7455 => 4.8023, std.dev.: 0.0205) MultiSource/Benchmarks/nbench/nbench: 1.09% (1.0821 => 1.0939, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 1.05% (3.5980 => 3.6356, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (4.0318 => 4.0731, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.73% (0.0263 => 0.0378, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.81% (0.0917 => 0.1062, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 15.02% (1.7426 => 2.0043, std.dev.: 0.0343) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.13% (4.0101 => 4.5368, std.dev.: 0.0239) SingleSource/Benchmarks/Stanford/Puzzle: 12.91% (0.1433 => 0.1618, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.66% (7.0025 => 7.6088, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.37% (1.0063 => 1.0905, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (0.3301 => 0.3491, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 4.65% (15.2242 => 15.9321, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.51% (0.7609 => 0.7952, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.34% (0.8498 => 0.8782, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 2.91% (8.5113 => 8.7594, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8958, std.dev.: 0.0161) MultiSource/Applications/siod/siod: 2.81% (3.5520 => 3.6517, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: 2.60% (0.5004 => 0.5134, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 2.58% (3.8907 => 3.9910, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash: 2.57% (0.6308 => 0.6470, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (2.6656 => 2.7253, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: 2.04% (2.3453 => 2.3932, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.94% (4.6127 => 4.7021, std.dev.: 0.0312) SingleSource/Benchmarks/Dhrystone/dry: 1.66% (2.4013 => 2.4412, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (2.4042 => 2.4379, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.31% (2.9152 => 2.9535, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.4184 => 1.4354, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.89% (0.3497 => 0.2137, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.53% (5.2665 => 4.0801, std.dev.: 0.0849) SingleSource/Benchmarks/Shootout-C++/ary3: -19.97% (1.7473 => 1.3983, std.dev.: 0.0423) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.33% (1.1647 => 0.9629, std.dev.: 0.0305) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.25% (15.8312 => 13.1001, std.dev.: 0.1742) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.31% (3.2007 => 2.9667, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3745, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.58% (2.0027 => 1.8709, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3318, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -6.52% (7.6833 => 7.1827, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -5.71% (1.4441 => 1.3617, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9413, std.dev.: 0.1596) SingleSource/Benchmarks/Shootout/fib2: -5.33% (4.4195 => 4.1840, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.69% (1.4021 => 1.3364, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.09% (1.2722 => 1.2329, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/methcall: -2.96% (9.2503 => 8.9765, std.dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8282, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.60% (3.7496 => 3.6521, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.23% (1.1683 => 1.1423, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.99% (3.4286 => 3.3604, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -1.95% (92.7467 => 90.9361, std.dev.: 0.5750) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4197, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3132, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.62% (1.7361 => 1.7079, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2349, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3108, std.dev.: 0.0886) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4637, std.dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: -1.22% (2.0192 => 1.9945, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.5617 => 16.3679, std.dev.: 0.0508) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.47% (0.9980 => 0.9933, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 0.45% (0.6022 => 0.6049, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -0.48% (0.1666 => 0.1658, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1554 => 0.1555, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.49% (0.3083 => 0.3129, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.2394 => 0.2377, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.61% (0.3175 => 0.3226, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.13% (0.2302 => 0.2253, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -14.61% (0.0089 => 0.0076, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.25% (0.0240 => 0.0225, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1429 => 0.1451, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.00% (1.5019 => 1.5320, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.33% (0.1501 => 0.1451, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.81% (0.4264 => 0.4059, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.26% (0.1344 => 0.1361, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.15% (0.0589 => 0.0541, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.81% (0.0232 => 0.0271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1350 => 1.1296, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0637 => 0.0637, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.0246 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.07% (1.5363 => 1.5989, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 03:21:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 05:21:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921102107.674C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4094?compare_to=4090&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4094, Order: 164365, Start Time: 2012-09-21 09:02:33, End Time: 2012-09-21 10:22:34 To: 4090, Order: 164364, Start Time: 2012-09-21 07:13:36, End Time: 2012-09-21 08:33:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 2.11% (1.2060 => 1.2315, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5700 => 0.5701, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.05% (15.8708 => 15.8626, std.dev.: 0.0246) MultiSource/Applications/kimwitu++/kc: - (14.7017 => 14.7017, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -0.00% (83.2295 => 83.2270, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.3236 => 4.3175, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.16% (1.2236 => 1.2217, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.3712 => 7.3761, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.05% (3.6628 => 3.6611, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6340 => 0.6338, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0649 => 0.0650, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.60% (63.2438 => 83.2270, std.dev.: 0.0210) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14273.33% (0.0720 => 10.3488, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.00% (10.3673 => 14.8257, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 26.70% (0.1622 => 0.2055, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.06% (2.2022 => 2.5119, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.54% (7.0540 => 8.0094, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.12% (1.1194 => 1.2551, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (1.7609 => 1.9607, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 9.95% (10.4361 => 11.4747, std.dev.: 0.0210) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.53% (0.1584 => 0.1735, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.71% (0.3282 => 0.3568, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.15% (0.3473 => 0.3756, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.96% (0.3543 => 0.3825, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3497 => 0.3773, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3561 => 0.3839, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 7.78% (0.3828 => 0.4126, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.3927 => 0.4231, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.66% (0.3694 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.51% (0.3886 => 0.4178, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.27% (9.4845 => 10.1740, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 7.15% (0.1440 => 0.1543, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.82% (0.3109 => 0.3321, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7433 => 0.7935, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 6.60% (0.3423 => 0.3649, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.44% (0.2700 => 0.2874, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.42% (0.7115 => 0.7572, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.40% (5.7591 => 6.1275, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.2554 => 0.2716, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.26% (0.6675 => 0.7093, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.24% (0.4615 => 0.4903, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 6.18% (3.3354 => 3.5415, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (1.3050 => 1.3853, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.12% (0.2271 => 0.2410, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (1.5415 => 1.6354, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.06% (0.5860 => 0.6215, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (4.2646 => 4.5173, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.88% (8.1363 => 8.6144, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.80% (0.8067 => 0.8535, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.70% (0.5105 => 0.5396, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (5.0018 => 5.2862, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5569 => 0.5880, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.56% (4.9449 => 5.2199, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3441 => 0.3631, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.52% (0.8172 => 0.8623, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.3092 => 0.3262, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9765 => 1.0298, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.41% (0.3121 => 0.3290, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.31% (0.7835 => 0.8251, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 5.29% (1.1642 => 1.2258, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 5.18% (3.8723 => 4.0730, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 5.18% (1.0722 => 1.1277, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.16% (1.1861 => 1.2473, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 5.08% (0.3387 => 0.3559, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.86% (0.4299 => 0.4508, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.81% (21.9371 => 22.9928, std.dev.: 0.0274) MultiSource/Applications/treecc/treecc: 4.73% (2.0273 => 2.1232, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (7.9617 => 8.3371, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 4.70% (2.2969 => 2.4048, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 4.64% (0.6030 => 0.6310, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.52% (1.5603 => 1.6309, std.dev.: 0.0080) SingleSource/UnitTests/ObjC++/Hello: 4.51% (0.5925 => 0.6192, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8921 => 0.9323, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.31% (0.6450 => 0.6728, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.31% (1.5859 => 1.6542, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.5981 => 0.6231, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6456 => 0.6716, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.77% (0.7326 => 0.7602, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.4186 => 1.4720, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.68% (0.4103 => 0.4254, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (14.3668 => 14.8924, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.64% (2.2024 => 2.2825, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4636 => 0.4803, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (0.4064 => 0.4205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.35% (1.1840 => 1.2237, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3650 => 0.3770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.29% (0.3865 => 0.3992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.97% (0.4203 => 0.4328, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.87% (0.4048 => 0.4164, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (2.0665 => 2.1195, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.8101 => 0.8297, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4707, std.dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.2842 => 1.3030, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.8922 => 3.9396, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.28% (1.1145 => 1.3851, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4128, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3816, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (1.1396 => 1.2162, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3516, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 1.47% (2.2771 => 2.3105, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7863, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2275, std.dev.: 0.0427) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5777, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.64% (5.2763 => 3.2374, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.50% (5.3855 => 3.9045, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.18% (5.3526 => 3.8976, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0669, std.dev.: 0.0469) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.95% (2.9384 => 2.5874, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.26% (22.1758 => 20.3438, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2894, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.53% (1.8329 => 1.7133, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5841, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1504, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5072, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4269, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.84% (10.2830 => 9.9907, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9901, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (0.5229 => 0.5701, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 5.82% (14.9895 => 15.8626, std.dev.: 0.0246) MultiSource/Applications/kimwitu++/kc: 3.86% (14.1553 => 14.7017, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 5.04% (4.1105 => 4.3175, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.58% (1.1048 => 1.2217, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.04% (7.1582 => 7.3761, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.72% (3.4629 => 3.6611, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.6222 => 0.6338, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 03:51:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 05:51:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921105119.71E142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4095?compare_to=4091&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4095, Order: 164366, Start Time: 2012-09-21 09:38:04, End Time: 2012-09-21 10:52:46 To: 4091, Order: 164365, Start Time: 2012-09-21 07:46:59, End Time: 2012-09-21 09:01:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.38% (0.5331 => 0.5458, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.27% (2.0176 => 2.4064, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.27% (0.1072 => 0.1225, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.25% (0.0770 => 0.0872, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.77% (3.9660 => 4.3535, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.62% (0.7710 => 0.8452, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.56% (0.7038 => 0.7711, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.08% (1.4563 => 1.5886, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 8.98% (1.3693 => 1.4923, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.98% (0.9199 => 1.0025, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.95% (0.6959 => 0.7582, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5265 => 0.5734, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.89% (1.2193 => 1.3277, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.47% (1.1364 => 1.2326, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 8.45% (0.7061 => 0.7658, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5818 => 0.6309, std.dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 8.27% (13.8202 => 14.9629, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.23% (0.3899 => 0.4220, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4062 => 0.4395, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.11% (0.5748 => 0.6214, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.10% (0.6283 => 0.6792, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.89% (0.5577 => 0.6017, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 7.88% (1.0313 => 1.1126, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.76% (0.4791 => 0.5163, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.2781 => 0.2993, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.59% (1.1061 => 1.1900, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 7.55% (3.8646 => 4.1565, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4016 => 0.4309, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 7.29% (2.1791 => 2.3380, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.2914 => 0.3125, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.21% (0.8310 => 0.8909, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4390 => 0.4706, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.14% (0.3220 => 0.3450, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5637 => 0.6038, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (7.2180 => 7.7245, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 7.01% (0.7506 => 0.8032, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (3.6692 => 3.9247, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 6.95% (16.6129 => 17.7674, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.9828 => 2.1184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3453 => 0.3689, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.80% (0.2690 => 0.2873, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.62% (1.0594 => 1.1295, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 6.60% (3.1889 => 3.3995, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 6.57% (1.9270 => 2.0536, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2726 => 0.2905, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.55% (0.6744 => 0.7186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.52% (0.1657 => 0.1765, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.50% (1.3245 => 1.4106, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3107 => 0.3306, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.27% (0.6576 => 0.6988, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.12% (1.3819 => 1.4665, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (1.2749 => 1.3508, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.93% (0.8698 => 0.9214, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.92% (14.8535 => 15.7321, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.4113 => 0.4355, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.85% (1.3813 => 1.4621, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (4.4433 => 4.6987, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 5.75% (8.4961 => 8.9844, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 5.75% (0.4003 => 0.4233, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.3801 => 4.6305, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.68% (13.2842 => 14.0381, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.66% (0.6135 => 0.6482, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.56% (0.3578 => 0.3777, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.56% (0.3940 => 0.4159, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 5.56% (0.3131 => 0.3305, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (1.1333 => 1.1962, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 5.54% (0.3646 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.52% (0.3789 => 0.3998, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.45% (0.3650 => 0.3849, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 5.42% (0.3601 => 0.3796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.38% (0.3663 => 0.3860, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 5.33% (0.3623 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.32% (0.8818 => 0.9287, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.30% (0.3245 => 0.3417, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.25% (14.5298 => 15.2920, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.13% (4.6629 => 4.9019, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.05% (4.9865 => 5.2385, std.dev.: 0.0171) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (6.5754 => 6.9050, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (3.2742 => 3.4335, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.56% (0.4805 => 0.5024, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.56% (1.5188 => 1.5880, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 4.37% (3.7467 => 3.9105, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.36% (1.2292 => 1.2828, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.29% (2.1007 => 2.1909, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.23% (0.9108 => 0.9493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.22% (0.6250 => 0.6514, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (6.2785 => 6.5000, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 3.49% (33.2944 => 34.4579, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 2.15% (16.2614 => 16.6113, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.04% (1.0895 => 1.3623, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std.dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (0.2093 => 0.2223, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6970, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5477, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1066, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5938, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5882, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.24% (0.4657 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.27% (22.5627 => 21.8244, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2668, std.dev.: 0.0284) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.28% (1.3780 => 1.2915, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5097, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1494, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9468, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5984, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6615 => 0.6482, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7539, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2513, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1380, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (4.1080 => 4.0602, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4333, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2606, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2393, std.dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 03:55:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 05:55:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921105539.7B1962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4096?compare_to=4093&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4096, Order: 164366, Start Time: 2012-09-21 09:47:01, End Time: 2012-09-21 10:57:08 To: 4093, Order: 164365, Start Time: 2012-09-21 08:19:36, End Time: 2012-09-21 09:31:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 14 (56 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 885 (796 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.7747 => 0.7963, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.94% (0.8920 => 0.9093, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.70% (0.7282 => 0.7406, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (0.7988 => 0.8110, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.48% (4.3151 => 4.3789, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.46% (1.1908 => 1.2082, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (1.4228 => 1.4429, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.2519 => 4.3017, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 8.99% (3.3972 => 3.7026, std.dev.: 0.0742) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.55% (1.3364 => 1.3972, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.67% (0.5911 => 0.6069, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (13.1001 => 13.4024, std.dev.: 0.0887) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.23% (2.8478 => 2.9113, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.58% (1.7079 => 1.7348, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.20% (1.8574 => 1.8352, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.65% (0.9933 => 0.9868, std.dev.: 0.0209) MultiSource/Applications/sqlite3/sqlite3: 0.23% (0.6049 => 0.6063, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 0.54% (0.1658 => 0.1667, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.32% (0.1555 => 0.1560, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.57% (0.3129 => 0.3080, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.21% (0.2377 => 0.2372, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (0.3226 => 0.3174, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.78% (0.2253 => 0.2293, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -9.43% (0.0456 => 0.0413, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: 15.79% (0.0076 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0091 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.44% (0.0225 => 0.0244, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.09% (0.0191 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.35% (0.0297 => 0.0301, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.79% (0.0280 => 0.0285, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.82% (0.0321 => 0.0267, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.57% (0.0191 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0250 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -7.67% (0.0326 => 0.0301, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1451 => 0.1455, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -3.45% (1.5320 => 1.4792, std.dev.: 0.0230) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.89% (0.1451 => 0.1493, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.48% (0.4059 => 0.3999, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1361 => 0.1433, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 20.33% (0.0541 => 0.0651, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.39% (0.0271 => 0.0232, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.67% (0.0647 => 0.0565, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1296 => 1.1286, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0637 => 0.0600, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.98% (0.0264 => 0.0235, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7650 => 0.7661, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 0.14% (1.5989 => 1.6012, std.dev.: 0.0096) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.07% (4.1772 => 3.0465, std.dev.: 0.0452) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.15% (0.6410 => 0.6868, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: 6.57% (2.1763 => 2.3193, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/bigfib: 5.88% (0.5309 => 0.5621, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.7722 => 0.8110, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 5.00% (1.0046 => 1.0548, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.58% (0.2552 => 0.2669, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.58% (0.3582 => 0.3746, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.6915 => 0.7197, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.1653 => 1.2124, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 3.58% (15.3105 => 15.8591, std.dev.: 0.1486) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.5150 => 1.5690, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.51% (1.1672 => 1.2082, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.13% (0.3901 => 0.4023, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.89% (29.3170 => 30.1629, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.7639 => 0.7845, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.7226 => 0.7406, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.30% (0.7784 => 0.7963, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.24% (1.4113 => 1.4429, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 2.16% (1.1440 => 1.1687, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.07% (3.0225 => 3.0852, std.dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (6.2546 => 6.3835, std.dev.: 0.0404) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.01% (1.2021 => 1.2263, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6069 => 0.6188, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.62% (1.0821 => 1.0996, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.54% (13.3238 => 13.5290, std.dev.: 0.0583) MultiSource/Applications/siod/siod: 1.53% (2.0972 => 2.1292, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (4.0318 => 4.0819, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 14.67% (1.7426 => 1.9983, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5552, std.dev.: 0.0771) SingleSource/Benchmarks/Stanford/Puzzle: 11.30% (0.1433 => 0.1595, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.5995, std.dev.: 0.0287) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.12% (0.2857 => 0.3089, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.94% (1.0063 => 1.0761, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8579, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5368, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8736, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.28% (0.5876 => 0.6069, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.88% (14.4877 => 14.9045, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.75% (2.6656 => 2.7390, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 2.71% (3.8907 => 3.9963, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ReedSolomon: 2.46% (8.5113 => 8.7209, std.dev.: 0.0256) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6327, std.dev.: 0.0258) SingleSource/Benchmarks/Dhrystone/dry: 1.82% (2.4013 => 2.4449, std.dev.: 0.0101) MultiSource/Applications/lua/lua: 1.32% (29.5232 => 29.9134, std.dev.: 0.0816) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (2.4455 => 2.4738, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.04% (1.6110 => 1.6278, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.87% (0.7738 => 0.7593, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.26% (5.2665 => 4.0940, std.dev.: 0.0949) SingleSource/Benchmarks/Shootout-C++/ary3: -20.26% (1.7473 => 1.3933, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.43% (1.1647 => 0.9617, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.34% (15.8312 => 13.4024, std.dev.: 0.0887) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.87% (0.0917 => 0.0799, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0328) MultiSource/Applications/sgefa/sgefa: -11.19% (0.3746 => 0.3327, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.60% (1.4034 => 1.2827, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9514, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3323, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0179) MultiSource/Applications/lambda-0_1_3/lambda: -6.18% (7.6833 => 7.2085, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3549, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7962, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (3.4230 => 3.2296, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9234, std.dev.: 0.2014) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1858, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.87% (61.1734 => 58.8072, std.dev.: 0.8519) SingleSource/Benchmarks/McGill/misr: -3.58% (0.4296 => 0.4142, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.33% (1.2959 => 1.2528, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9437, std.dev.: 0.0682) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.17% (45.4683 => 44.0290, std.dev.: 0.4200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8296, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.77% (3.7496 => 3.6456, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.11% (1.1683 => 1.1437, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.07% (1.8739 => 1.8352, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -2.05% (92.7467 => 90.8418, std.dev.: 0.0894) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (9.3855 => 9.2193, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -1.41% (2.4971 => 2.4619, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std.dev.: 0.0286) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.12% (0.9980 => 0.9868, std.dev.: 0.0209) MultiSource/Applications/sqlite3/sqlite3: 0.68% (0.6022 => 0.6063, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 0.06% (0.1666 => 0.1667, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1554 => 0.1560, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (0.3083 => 0.3080, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2394 => 0.2372, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -8.02% (0.0449 => 0.0413, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.59% (0.0324 => 0.0267, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -7.38% (0.0325 => 0.0301, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.51% (1.5019 => 1.4792, std.dev.: 0.0230) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.53% (0.1501 => 0.1493, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.21% (0.4264 => 0.3999, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.62% (0.1344 => 0.1433, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.53% (0.0589 => 0.0651, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.58% (0.0639 => 0.0565, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1286, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0637 => 0.0600, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.47% (0.0246 => 0.0235, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.59% (0.7541 => 0.7661, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.22% (1.5363 => 1.6012, std.dev.: 0.0096) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 05:09:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 07:09:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921120924.7A024352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4097?compare_to=4094&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4097, Order: 164366, Start Time: 2012-09-21 10:51:14, End Time: 2012-09-21 12:10:52 To: 4094, Order: 164365, Start Time: 2012-09-21 09:02:33, End Time: 2012-09-21 10:22:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (121 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (727 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (14.8257 => 14.4903, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.22% (81.3108 => 78.6928, std.dev.: 0.7855) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5701 => 0.5699, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 0.02% (15.8626 => 15.8654, std.dev.: 0.0144) MultiSource/Applications/kimwitu++/kc: 0.00% (14.7017 => 14.7021, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 0.19% (83.2270 => 83.3881, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 0.37% (4.3175 => 4.3335, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2217 => 1.2227, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.3761 => 7.3803, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.18% (3.6611 => 3.6676, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6338 => 0.6342, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (0.0650 => 0.0684, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.85% (63.2438 => 83.3881, std.dev.: 0.0198) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14276.94% (0.0720 => 10.3514, std.dev.: 0.0083) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.77% (10.3673 => 14.4903, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 26.63% (0.1622 => 0.2054, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.26% (2.2022 => 2.5163, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (7.0540 => 8.0479, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.11% (1.1194 => 1.2550, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.24% (1.7609 => 1.9588, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 10.79% (10.4361 => 11.5623, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.78% (0.3282 => 0.3570, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.49% (0.3473 => 0.3768, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3543 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.33% (0.3543 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.32% (0.3497 => 0.3788, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.3927 => 0.4248, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.16% (0.3516 => 0.3803, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.12% (0.3561 => 0.3850, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3828 => 0.4135, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.93% (0.3694 => 0.3987, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.75% (0.3886 => 0.4187, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.41% (9.4845 => 10.1871, std.dev.: 0.0181) SingleSource/Benchmarks/McGill/chomp: 7.37% (0.1655 => 0.1777, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7433 => 0.7937, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 6.63% (0.3109 => 0.3315, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.47% (0.7115 => 0.7575, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.36% (5.7591 => 6.1252, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2271 => 0.2414, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.28% (0.6675 => 0.7094, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.22% (0.3423 => 0.3636, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.3050 => 1.3854, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.08% (1.5415 => 1.6353, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.8172 => 0.8668, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.07% (3.3354 => 3.5378, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (4.2646 => 4.5227, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.05% (8.1363 => 8.6285, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.5860 => 0.6214, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.8067 => 0.8554, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.78% (0.5569 => 0.5891, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.76% (0.5105 => 0.5399, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.71% (5.0018 => 5.2873, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.70% (4.9449 => 5.2269, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.65% (0.9765 => 1.0317, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1940 => 0.2047, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2758 => 0.2909, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.42% (0.7835 => 0.8260, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.39% (1.1642 => 1.2270, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 5.27% (3.8723 => 4.0762, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 5.20% (0.3387 => 0.3563, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.1861 => 1.2477, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 5.17% (1.0722 => 1.1276, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.97% (0.3180 => 0.3338, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.86% (0.4299 => 0.4508, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (7.9617 => 8.3487, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 4.76% (0.6030 => 0.6317, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.74% (0.5925 => 0.6206, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.72% (21.9371 => 22.9716, std.dev.: 0.0155) MultiSource/Applications/hbd/hbd: 4.70% (1.5603 => 1.6337, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.66% (2.0273 => 2.1217, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.5020 => 0.5253, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.59% (2.2969 => 2.4023, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.57% (0.8921 => 0.9329, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.25% (0.6450 => 0.6724, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.24% (1.5859 => 1.6531, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/bigfib: 4.12% (0.6456 => 0.6722, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.03% (0.5981 => 0.6222, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.4186 => 1.4748, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 3.78% (0.7326 => 0.7603, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.4103 => 0.4258, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (14.3668 => 14.8973, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.2024 => 2.2823, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4636 => 0.4803, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.4064 => 0.4209, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.1840 => 1.2238, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.4289 => 0.4431, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3650 => 0.3770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.4203 => 0.4332, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.4048 => 0.4168, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1206, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.8101 => 0.8291, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4496, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3034, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.8922 => 3.9466, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3446, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2293, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7877, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5748, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.80% (5.2763 => 3.2289, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.76% (5.3855 => 3.8903, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.44% (5.3526 => 3.8836, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0464, std.dev.: 0.0456) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.06% (2.9384 => 2.5841, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -8.19% (22.1758 => 20.3596, std.dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2879, std.dev.: 0.0711) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.38% (1.8329 => 1.7160, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.78% (1.6805 => 1.5833, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8041, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1506, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5034, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.6802 => 8.4364, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9978, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.65% (1.2373 => 1.2045, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9999, std.dev.: 0.0148) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5082, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2350, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (0.5229 => 0.5699, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.84% (14.9895 => 15.8654, std.dev.: 0.0144) MultiSource/Applications/kimwitu++/kc: 3.86% (14.1553 => 14.7021, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 5.43% (4.1105 => 4.3335, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.67% (1.1048 => 1.2227, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.10% (7.1582 => 7.3803, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.91% (3.4629 => 3.6676, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.6222 => 0.6342, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 05:28:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 07:28:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921122857.AD791352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4098?compare_to=4092&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4098, Order: 164366, Start Time: 2012-09-21 09:46:09, End Time: 2012-09-21 12:30:24 To: 4092, Order: 164362, Start Time: 2012-09-21 06:29:17, End Time: 2012-09-21 09:17:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (767 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.54% (9.4004 => 9.9214, std.dev.: 0.0192) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3488 => 0.3817, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.40% (0.3446 => 0.3770, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3465 => 0.3790, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.37% (0.3469 => 0.3794, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3460 => 0.3784, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3442 => 0.3764, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.18% (0.3650 => 0.3985, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.14% (0.3643 => 0.3976, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.00% (0.3724 => 0.4059, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.42% (1.5932 => 1.7274, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.18% (0.1421 => 0.1523, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.1619 => 0.1728, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (1.6211 => 1.7280, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.54% (1.3152 => 1.4012, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (0.4994 => 0.5306, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (0.5026 => 0.5334, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 6.09% (5.5417 => 5.8791, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (3.5627 => 3.7728, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (0.5000 => 0.5292, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.70% (1.0781 => 1.1395, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (0.3930 => 0.4152, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (2.7292 => 2.8833, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (4.4195 => 4.6631, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 5.51% (4.2109 => 4.4430, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.51% (0.2014 => 0.2125, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.48% (0.5826 => 0.6145, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 5.38% (0.5889 => 0.6206, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.34% (0.2566 => 0.2703, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.5900 => 0.6211, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (0.2691 => 0.2832, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.17% (2.1013 => 2.2099, std.dev.: 0.0064) MultiSource/Applications/spiff/spiff: 5.16% (0.4029 => 0.4237, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 5.13% (0.6634 => 0.6974, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 5.12% (4.6177 => 4.8543, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (1.8794 => 1.9749, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.90% (0.5546 => 0.5818, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.2040 => 0.2140, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.81% (0.7171 => 0.7516, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.81% (2.1653 => 2.2694, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 4.80% (1.4269 => 1.4954, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 4.78% (23.5202 => 24.6439, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (0.4658 => 0.4877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.70% (0.2875 => 0.3010, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.68% (2.0346 => 2.1299, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.68% (0.9909 => 1.0373, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.63% (0.3195 => 0.3343, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.63% (0.3004 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.3903 => 0.4081, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.53% (0.2823 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2750 => 0.2874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2813 => 0.2939, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.4139 => 0.4324, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3362 => 0.3512, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (2.0673 => 2.1589, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.42% (0.2714 => 0.2834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.36% (0.2911 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2780 => 0.2901, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 4.35% (0.3336 => 0.3481, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 4.34% (0.9697 => 1.0118, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.34% (0.2811 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.33% (0.3348 => 0.3493, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.33% (0.7875 => 0.8216, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3678 => 0.3835, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3726 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.25% (0.3317 => 0.3458, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.25% (0.3060 => 0.3190, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3096 => 0.3227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.3845 => 0.4004, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.11% (0.3625 => 0.3774, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (1.9694 => 2.0503, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 4.08% (0.3477 => 0.3619, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.05% (0.4146 => 0.4314, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (1.9966 => 2.0775, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.6435 => 0.6695, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 4.02% (0.4251 => 0.4422, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.93% (0.7426 => 0.7718, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.78% (0.4847 => 0.5030, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.77% (0.2969 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.5012 => 0.5201, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.71% (0.3690 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.3981 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.66% (0.5361 => 0.5557, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.64% (0.5584 => 0.5787, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 3.43% (0.3498 => 0.3618, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.06% (11.6398 => 11.9963, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (4.6926 => 4.8180, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6677, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std.dev.: 0.1385) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6341, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.62% (41.7953 => 42.4710, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6035, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.20% (2.4764 => 2.4467, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5421, std.dev.: 0.0253) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7901, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7934, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.24% (17.2379 => 16.8511, std.dev.: 0.0400) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5702, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9576, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 06:33:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 08:33:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921133340.8F2EA352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4099?compare_to=4096&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4099, Order: 164368, Start Time: 2012-09-21 12:25:03, End Time: 2012-09-21 13:35:08 To: 4096, Order: 164366, Start Time: 2012-09-21 09:47:01, End Time: 2012-09-21 10:57:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 2 (56 on baseline) Performance Improvements: 9 (43 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 889 (791 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 14.64% (0.7650 => 0.8770, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/heapsort: 8.21% (3.0128 => 3.2603, std.dev.: 0.0719) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.77% (1.2082 => 1.1868, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.59% (1.4429 => 1.4200, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.3835 => 6.3083, std.dev.: 0.0279) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.37% (2.4988 => 2.4147, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.08% (0.6069 => 0.5943, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.86% (1.2914 => 1.2674, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: -1.69% (3.7026 => 3.6401, std.dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.43% (13.4024 => 13.2107, std.dev.: 0.0503) MultiSource/Benchmarks/llubenchmark/llu: -1.04% (2.0173 => 1.9964, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.27% (0.9868 => 0.9993, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -1.47% (0.6063 => 0.5974, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 0.36% (0.1667 => 0.1673, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.26% (0.1560 => 0.1556, std.dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.45% (0.3080 => 0.3094, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.51% (0.2372 => 0.2360, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (0.3174 => 0.3185, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.09% (0.2293 => 0.2295, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 9.20% (0.0413 => 0.0451, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.79% (0.0244 => 0.0225, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.54% (0.0195 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0388 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.05% (0.0285 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.12% (0.0267 => 0.0270, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: -1.10% (0.0181 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.03% (0.0194 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.60% (0.0250 => 0.0246, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -3.99% (0.0301 => 0.0289, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1455 => 0.1452, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.35% (1.4792 => 1.4991, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.35% (0.1493 => 0.1428, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.40% (0.3999 => 0.4055, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.74% (0.1433 => 0.1408, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.06% (0.0651 => 0.0566, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.31% (0.0565 => 0.0595, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.87% (0.0047 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1286 => 1.1269, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.17% (0.0600 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.79% (0.0235 => 0.0165, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7661 => 0.7654, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 66.67% (0.0003 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.12% (1.6012 => 1.5993, std.dev.: 0.0159) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -5.79% (0.0121 => 0.0114, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.85% (4.1772 => 3.0974, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/except: 81016.67% (0.0006 => 0.4867, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.26% (0.1414 => 0.1545, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.78% (0.5309 => 0.5669, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.72% (0.6410 => 0.6841, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 6.09% (2.1763 => 2.3089, std.dev.: 0.0149) MultiSource/Applications/minisat/minisat: 4.55% (0.6173 => 0.6454, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.2552 => 0.2668, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.41% (0.3582 => 0.3740, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.10% (1.0046 => 1.0458, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.6915 => 0.7182, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 3.76% (15.3105 => 15.8864, std.dev.: 0.1237) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3217 => 0.3329, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.3901 => 0.4035, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (1.5150 => 1.5556, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 2.66% (29.3170 => 30.0959, std.dev.: 0.2805) MultiSource/Applications/hbd/hbd: 2.43% (1.3268 => 1.3590, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.1827 => 1.2084, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.7639 => 0.7804, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.06% (0.6069 => 0.6194, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.82% (3.0225 => 3.0776, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 1.81% (13.3238 => 13.5653, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 1.81% (1.1440 => 1.1647, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.68% (1.1672 => 1.1868, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 1.60% (4.7455 => 4.8214, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (12.6413 => 12.8339, std.dev.: 0.0552) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.2021 => 1.2202, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 1.43% (2.0972 => 2.1271, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.35% (1.4408 => 1.4602, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 1.31% (3.5980 => 3.6452, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.16% (2.0317 => 2.0553, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.6079 => 14.7706, std.dev.: 0.0287) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0320) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.36% (0.0766 => 0.0876, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5546, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 8.94% (7.0025 => 7.6282, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.07% (1.0063 => 1.0875, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.89% (3.0256 => 3.2644, std.dev.: 0.0471) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.17% (4.2129 => 4.4308, std.dev.: 0.0461) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8285, std.dev.: 0.0319) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.07% (8.5113 => 8.7726, std.dev.: 0.0768) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8887, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/hash: 2.62% (0.6308 => 0.6473, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: 2.48% (0.5004 => 0.5128, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.32% (3.5520 => 3.6343, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4455 => 2.4735, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.82% (0.7738 => 0.7597, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.21% (0.3497 => 0.2091, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.65% (5.2665 => 4.1791, std.dev.: 0.0599) SingleSource/Benchmarks/Shootout-C++/ary3: -20.16% (1.7473 => 1.3950, std.dev.: 0.0356) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.43% (1.1647 => 0.9617, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.55% (15.8312 => 13.2107, std.dev.: 0.0503) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0292) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.34% (0.0917 => 0.0813, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -11.21% (0.3746 => 0.3326, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.63% (3.2007 => 2.9246, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.22% (1.4034 => 1.2880, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3751, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3282, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.45% (2.0027 => 1.8736, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -6.41% (7.6833 => 7.1909, std.dev.: 0.0250) MultiSource/Applications/SIBsim4/SIBsim4: -6.27% (3.4230 => 3.2085, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/richards_benchmark: -6.02% (1.4441 => 1.3571, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -5.51% (62.4126 => 58.9737, std.dev.: 0.0334) SingleSource/Benchmarks/Shootout/fib2: -5.19% (4.4195 => 4.1902, std.dev.: 0.0314) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.33% (61.1734 => 58.5272, std.dev.: 0.9681) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.16% (45.4683 => 43.5746, std.dev.: 0.1803) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.2959 => 1.2506, std.dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.39% (1.2722 => 1.2291, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9451, std.dev.: 0.0509) SingleSource/Benchmarks/McGill/misr: -2.93% (0.4296 => 0.4170, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std.dev.: 0.0220) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.63% (1.1683 => 1.1376, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (92.7467 => 90.8197, std.dev.: 0.3071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.99% (3.7496 => 3.6751, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4227, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3134, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3667, std.dev.: 0.0230) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2162, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.74% (1.8739 => 1.8413, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3077, std.dev.: 0.1049) MultiSource/Benchmarks/llubenchmark/llu: -1.13% (2.0192 => 1.9964, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.03% (4.5374 => 4.4907, std.dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.13% (0.9980 => 0.9993, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -0.80% (0.6022 => 0.5974, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 0.42% (0.1666 => 0.1673, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.13% (0.1554 => 0.1556, std.dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.36% (0.3083 => 0.3094, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.42% (0.2394 => 0.2360, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.31% (0.3175 => 0.3185, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2302 => 0.2295, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.25% (0.0240 => 0.0225, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.67% (0.0324 => 0.0270, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -11.08% (0.0325 => 0.0289, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -0.19% (1.5019 => 1.4991, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.86% (0.1501 => 0.1428, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.90% (0.4264 => 0.4055, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.76% (0.1344 => 0.1408, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0589 => 0.0566, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.89% (0.0639 => 0.0595, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1350 => 1.1269, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.94% (0.0637 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (0.0246 => 0.0165, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.10% (1.5363 => 1.5993, std.dev.: 0.0159) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.86% (0.0070 => 0.0114, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 06:51:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 08:51:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921135124.E5BFA352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4100?compare_to=4095&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4100, Order: 164368, Start Time: 2012-09-21 12:38:06, End Time: 2012-09-21 13:52:50 To: 4095, Order: 164366, Start Time: 2012-09-21 09:38:04, End Time: 2012-09-21 10:52:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (168 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.66% (0.4245 => 0.4740, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.04% (27.7141 => 29.6656, std.dev.: 0.0712) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.97% (54.2839 => 56.4410, std.dev.: 0.0500) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.2915 => 1.3054, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.34% (2.0176 => 2.4078, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.10% (0.1410 => 0.1637, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.27% (0.1072 => 0.1225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.54% (0.1413 => 0.1562, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.78% (3.9660 => 4.3539, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.70% (0.1588 => 0.1742, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 9.66% (0.7038 => 0.7718, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.18% (0.6959 => 0.7598, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.11% (0.9199 => 1.0037, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.07% (0.7710 => 0.8409, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 9.02% (1.3693 => 1.4928, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.91% (1.2193 => 1.3280, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.81% (0.5265 => 0.5729, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7061 => 0.7679, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.55% (1.4563 => 1.5808, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.54% (1.1364 => 1.2334, std.dev.: 0.0093) SingleSource/UnitTests/ObjC++/property-reference-object: 8.46% (0.5818 => 0.6310, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.38% (13.8202 => 14.9779, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/Hello: 8.21% (0.5748 => 0.6220, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.13% (0.3246 => 0.3510, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.03% (0.3899 => 0.4212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.95% (0.4062 => 0.4385, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.95% (1.0313 => 1.1133, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.93% (1.1061 => 1.1938, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.91% (0.5577 => 0.6018, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.83% (0.4791 => 0.5166, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.62% (3.8646 => 4.1591, std.dev.: 0.0085) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2127 => 0.2286, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.47% (0.4379 => 0.4706, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.41% (0.2995 => 0.3217, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.31% (0.7506 => 0.8055, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4016 => 0.4308, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.2914 => 0.3124, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8310 => 0.8908, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.13% (7.2180 => 7.7327, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.3220 => 0.3449, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.08% (2.1791 => 2.3333, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5637 => 0.6035, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3756 => 0.4021, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.03% (16.6129 => 17.7815, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.00% (3.6692 => 3.9260, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.89% (0.3293 => 0.3520, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.78% (1.9828 => 2.1172, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.7460 => 0.7964, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.4390 => 0.4686, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 6.74% (1.9270 => 2.0568, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.73% (3.1889 => 3.4036, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2726 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.3868 => 0.4124, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3107 => 0.3312, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.58% (0.6744 => 0.7188, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.53% (1.3245 => 1.4110, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 6.46% (1.0594 => 1.1278, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.40% (0.1657 => 0.1763, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.18% (0.6135 => 0.6514, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.10% (0.8698 => 0.9229, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.2749 => 1.3526, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.03% (0.4113 => 0.4361, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6576 => 0.6972, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (1.3819 => 1.4650, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (13.2842 => 14.0686, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/parameter-passing: 5.87% (0.4003 => 0.4238, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3914 => 0.4143, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4619, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.79% (14.8535 => 15.7142, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.79% (0.2504 => 0.2649, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.77% (4.4433 => 4.6997, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 5.76% (0.3940 => 0.4167, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.76% (8.4961 => 8.9852, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.3801 => 4.6321, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 5.59% (0.3578 => 0.3778, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.59% (0.3131 => 0.3306, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.58% (1.1333 => 1.1965, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 5.57% (0.3789 => 0.4000, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.57% (0.3646 => 0.3849, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.55% (0.3601 => 0.3801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.53% (0.3650 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.47% (0.2321 => 0.2448, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.36% (0.8818 => 0.9291, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.35% (0.3623 => 0.3817, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.34% (14.5298 => 15.3050, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 5.16% (4.6629 => 4.9037, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.13% (6.5754 => 6.9128, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.08% (4.9865 => 5.2396, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.97% (3.2742 => 3.4368, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2858, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 4.54% (3.7467 => 3.9168, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.53% (1.5188 => 1.5876, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4805 => 0.5021, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (0.9108 => 0.9502, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.29% (2.1007 => 2.1909, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6250 => 0.6518, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.64% (6.2785 => 6.5073, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 3.52% (33.2944 => 34.4668, std.dev.: 0.0202) MultiSource/Applications/sqlite3/sqlite3: 2.22% (16.2614 => 16.6223, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.02% (1.0895 => 1.3621, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std.dev.: 0.0507) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.2093 => 0.2217, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6964, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0948, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5951, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5883, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.18% (0.4657 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.32% (22.5627 => 21.8128, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.20% (1.0460 => 0.8556) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2916, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5091, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.73% (3.2729 => 3.1507, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5916, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9486, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6615 => 0.6482, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7533, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std.dev.: 0.0058) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1428, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.17% (4.1080 => 4.0600, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2303, std.dev.: 0.0180) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4335, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 06:58:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 08:58:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921135806.A433F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4101?compare_to=4097&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4101, Order: 164368, Start Time: 2012-09-21 12:39:26, End Time: 2012-09-21 13:59:33 To: 4097, Order: 164366, Start Time: 2012-09-21 10:51:14, End Time: 2012-09-21 12:10:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (726 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.07% (0.5363 => 0.5474, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.11% (0.5699 => 0.5705, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 0.03% (15.8654 => 15.8699, std.dev.: 0.0278) MultiSource/Applications/kimwitu++/kc: 0.01% (14.7021 => 14.7029, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 0.02% (83.3881 => 83.4042, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.3335 => 4.3261, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.31% (1.2227 => 1.2265, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.3803 => 7.3783, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.05% (3.6676 => 3.6658, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.09% (0.6342 => 0.6348, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0684 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.88% (63.2438 => 83.4042, std.dev.: 0.0277) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14275.97% (0.0720 => 10.3507, std.dev.: 0.0158) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.71% (10.3673 => 14.4843, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 26.70% (0.1622 => 0.2055, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.36% (2.2022 => 2.5185, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.99% (7.0540 => 8.0410, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 13.48% (0.1432 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.26% (0.1566 => 0.1758, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.27% (1.7609 => 1.9593, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 10.93% (10.4361 => 11.5764, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.53% (0.1584 => 0.1735, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3543 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.84% (0.3282 => 0.3572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3473 => 0.3770, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.33% (0.3543 => 0.3838, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.31% (0.3561 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3516 => 0.3807, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3828 => 0.4139, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.12% (0.3694 => 0.3994, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.00% (0.3927 => 0.4241, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.72% (0.3886 => 0.4186, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.45% (9.4845 => 10.1911, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.19% (0.4879 => 0.5230, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7433 => 0.7938, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 6.69% (0.3109 => 0.3317, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.55% (0.5860 => 0.6244, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.49% (0.7115 => 0.7577, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 6.43% (0.1695 => 0.1804, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.43% (0.2271 => 0.2417, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.39% (5.7591 => 6.1272, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4615 => 0.4907, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.6675 => 0.7097, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.25% (0.3423 => 0.3637, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.24% (3.3354 => 3.5434, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.18% (1.5415 => 1.6368, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.16% (4.2646 => 4.5275, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.3050 => 1.3854, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (8.1363 => 8.6314, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.8172 => 0.8661, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.8067 => 0.8542, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5569 => 0.5896, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.84% (0.5105 => 0.5403, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.70% (5.0018 => 5.2871, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (4.9449 => 5.2259, std.dev.: 0.0106) MultiSource/Applications/Burg/burg: 5.67% (1.1642 => 1.2302, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3121 => 0.3297, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3441 => 0.3633, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.54% (0.7835 => 0.8269, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.9765 => 1.0305, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (1.1861 => 1.2488, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 5.28% (3.8723 => 4.0766, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: 5.17% (0.3387 => 0.3562, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.15% (1.0722 => 1.1274, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.3180 => 0.3342, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.99% (0.2603 => 0.2733, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.93% (0.4299 => 0.4511, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.83% (0.6030 => 0.6321, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (7.9617 => 8.3427, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5020 => 0.5259, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 4.76% (2.0273 => 2.1237, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 4.74% (2.2969 => 2.4058, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 4.71% (21.9371 => 22.9697, std.dev.: 0.0203) MultiSource/Applications/hbd/hbd: 4.68% (1.5603 => 1.6334, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/Hello: 4.68% (0.5925 => 0.6202, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8921 => 0.9331, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.53% (0.5981 => 0.6252, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.37% (0.6450 => 0.6732, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.34% (1.5859 => 1.6548, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6456 => 0.6723, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (1.4186 => 1.4741, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 3.90% (0.7326 => 0.7612, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.4636 => 0.4811, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (14.3668 => 14.9052, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (0.4064 => 0.4216, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (2.2024 => 2.2811, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.42% (0.3865 => 0.3997, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.1840 => 1.2234, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.4289 => 0.4431, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.19% (0.3826 => 0.3948, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.4203 => 0.4333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.97% (0.4620 => 0.4757, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.4048 => 0.4167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.8101 => 0.8325, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0665 => 2.1201, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4509, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.8922 => 3.9369, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.04% (3.1595 => 3.4134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7563, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.07% (4.2280 => 4.3577, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2282, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7867, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.82% (5.2763 => 3.2281, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.80% (5.3855 => 3.8881, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.44% (5.3526 => 3.8841, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0567, std.dev.: 0.0680) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.06% (2.9384 => 2.5840, std.dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: -8.21% (22.1758 => 20.3548, std.dev.: 0.0330) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2764, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (1.8329 => 1.7167, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5839, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5103, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1512, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5056, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: -2.99% (1.2373 => 1.2003, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.6802 => 8.4354, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0060, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0073, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6788, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2223, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7054, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.10% (0.5229 => 0.5705, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 5.87% (14.9895 => 15.8699, std.dev.: 0.0278) MultiSource/Applications/kimwitu++/kc: 3.87% (14.1553 => 14.7029, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 5.25% (4.1105 => 4.3261, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.02% (1.1048 => 1.2265, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.07% (7.1582 => 7.3783, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.86% (3.4629 => 3.6658, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.6222 => 0.6348, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 08:41:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 10:41:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921154142.5604C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4102?compare_to=4098&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4102, Order: 164368, Start Time: 2012-09-21 12:59:01, End Time: 2012-09-21 15:43:07 To: 4098, Order: 164366, Start Time: 2012-09-21 09:46:09, End Time: 2012-09-21 12:30:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.50% (124.2428 => 128.5945, std.dev.: 1.4835) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 9.54% (0.3460 => 0.3790, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3488 => 0.3818, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 9.43% (0.3446 => 0.3771, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.38% (0.3442 => 0.3765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3465 => 0.3790, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 9.35% (0.3496 => 0.3823, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3469 => 0.3792, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.21% (0.3650 => 0.3986, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.14% (0.3643 => 0.3976, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 9.02% (0.3724 => 0.4060, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.43% (1.5932 => 1.7275, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (1.6211 => 1.7268, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.36% (1.3152 => 1.3989, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.31% (0.4361 => 0.4636, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.07% (0.4994 => 0.5297, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 6.04% (5.5417 => 5.8764, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (0.5000 => 0.5300, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.93% (1.0781 => 1.1420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (3.5627 => 3.7738, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (0.5026 => 0.5306, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 5.55% (4.2109 => 4.4447, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (0.3930 => 0.4148, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (4.4195 => 4.6632, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (2.7292 => 2.8794, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 5.46% (0.5826 => 0.6144, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.43% (0.6634 => 0.6994, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.5889 => 0.6205, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.34% (0.2566 => 0.2703, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.2736 => 0.2882, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 5.09% (2.1013 => 2.2083, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 5.03% (4.6177 => 4.8500, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.95% (1.4269 => 1.4976, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.95% (0.2040 => 0.2141, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 4.88% (1.8794 => 1.9711, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.87% (0.2875 => 0.3015, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.83% (2.1653 => 2.2699, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 4.78% (23.5202 => 24.6440, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 4.69% (0.9909 => 1.0374, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.66% (0.3195 => 0.3344, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.65% (2.0346 => 2.1293, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.59% (0.3004 => 0.3142, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.59% (0.4139 => 0.4329, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2813 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.53% (0.2823 => 0.2951, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.49% (2.0673 => 2.1602, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.3903 => 0.4078, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.47% (1.9694 => 2.0575, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 4.47% (0.2750 => 0.2873, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (0.4658 => 0.4866, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3124 => 0.3261, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.38% (0.5546 => 0.5789, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.38% (0.3084 => 0.3219, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.37% (0.3362 => 0.3509, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.36% (0.3258 => 0.3400, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.33% (0.2911 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2780 => 0.2900, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.30% (0.3096 => 0.3229, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.30% (0.3678 => 0.3836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 4.25% (0.3317 => 0.3458, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.23% (0.7171 => 0.7474, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (0.3625 => 0.3778, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.20% (0.3336 => 0.3476, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.19% (0.3726 => 0.3882, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.3477 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (1.9966 => 2.0790, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.09% (0.7875 => 0.8197, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4251 => 0.4424, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (0.2691 => 0.2800, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 4.00% (0.4146 => 0.4312, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (0.4847 => 0.5038, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3690 => 0.3835, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.93% (0.3845 => 0.3996, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.92% (0.6435 => 0.6687, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (0.7426 => 0.7714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.2969 => 0.3084, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.83% (0.9697 => 1.0068, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.5012 => 0.5203, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.2737 => 0.2840, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.72% (0.3981 => 0.4129, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (0.5361 => 0.5559, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.62% (0.5584 => 0.5786, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (11.6398 => 12.0021, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (4.6926 => 4.8160, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.48% (1.8057 => 1.8866, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6350, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2028, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5095, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.60% (2.0820 => 2.1154, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4426, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5899, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5547, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary2: -9.45% (0.2402 => 0.2175, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7961, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7981, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7882, std.dev.: 0.0687) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5729, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9719, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 09:11:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 11:11:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921161130.57F67352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4103?compare_to=4099&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4103, Order: 164369, Start Time: 2012-09-21 15:01:30, End Time: 2012-09-21 16:12:57 To: 4099, Order: 164368, Start Time: 2012-09-21 12:25:03, End Time: 2012-09-21 13:35:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (49 on baseline) Performance Improvements: 3 (41 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 887 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.03% (1.1647 => 1.1767, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 9.10% (3.2603 => 3.5571, std.dev.: 0.0748) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.57% (1.3017 => 1.3742, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3323 => 0.3508, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.66% (43.5746 => 45.1686, std.dev.: 0.1791) SingleSource/Benchmarks/Misc/ffbench: 3.29% (1.3609 => 1.4057, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.99% (0.5943 => 0.6061, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.69% (2.9246 => 2.9740, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.43% (1.8413 => 1.8676, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.00% (4.6432 => 4.6897, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.71% (0.4613 => 0.4442, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.87% (0.5784 => 0.5618, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.87% (1.2084 => 1.1858, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.23% (0.9993 => 0.9870, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.07% (0.5974 => 0.6038, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -0.72% (0.1673 => 0.1661, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.89% (0.1556 => 0.1511, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (0.3094 => 0.3089, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.72% (0.2360 => 0.2377, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.28% (0.3185 => 0.3176, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.26% (0.2295 => 0.2289, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -5.54% (0.0451 => 0.0426, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -13.33% (0.0225 => 0.0195, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0388 => 0.0387, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0300 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0282 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.00% (0.0270 => 0.0324) SingleSource/UnitTests/Vector/Altivec/casts: -21.79% (0.0179 => 0.0140, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 0.52% (0.0192 => 0.0193, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: 1.63% (0.0246 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 12.46% (0.0289 => 0.0325, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -60.00% (0.0005 => 0.0002, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: - (0.1452 => 0.1452, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.42% (1.4991 => 1.4029, std.dev.: 0.0472) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.28% (0.1428 => 0.1424, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.86% (0.4055 => 0.4090, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.55% (0.1408 => 0.1458, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.77% (0.0566 => 0.0522, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.71% (0.0210 => 0.0222, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.52% (0.0595 => 0.0580, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 4600.00% (0.0001 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1269 => 1.1293, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.31% (0.0643 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0165 => 0.0165, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7654 => 0.7662, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.31% (1.5993 => 1.5944, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 5.26% (0.0114 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.97% (4.1772 => 3.0924, std.dev.: 0.0658) SingleSource/Benchmarks/Shootout-C++/except: 82000.00% (0.0006 => 0.4926, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.28% (0.1414 => 0.1517, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.33% (0.5309 => 0.5645, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 6.13% (2.1763 => 2.3096, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6410 => 0.6796, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 4.44% (1.1653 => 1.2170, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 4.37% (0.6173 => 0.6443, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.24% (0.3582 => 0.3734, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.19% (0.2552 => 0.2659, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 4.16% (1.0046 => 1.0464, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 3.84% (15.3105 => 15.8989, std.dev.: 0.1622) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.6915 => 0.7160, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.11% (0.6069 => 0.6258, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.86% (1.1440 => 1.1767, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.7639 => 0.7848, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.67% (0.3901 => 0.4005, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.54% (1.2021 => 1.2326, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 2.53% (3.0225 => 3.0989, std.dev.: 0.0201) MultiSource/Applications/siod/siod: 2.45% (2.0972 => 2.1485, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 2.43% (29.3170 => 30.0291, std.dev.: 0.1510) MultiSource/Applications/SPASS/SPASS: 2.03% (13.3238 => 13.5937, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.80% (1.4408 => 1.4668, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.73% (1.3268 => 1.3498, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0118) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.25% (0.0917 => 0.1066, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 15.06% (1.7426 => 2.0050, std.dev.: 0.0547) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5550, std.dev.: 0.0177) SingleSource/Benchmarks/Stanford/Puzzle: 11.24% (0.1433 => 0.1594, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 10.96% (1.6261 => 1.8044, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/heapsort: 10.61% (3.2159 => 3.5571, std.dev.: 0.0748) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.07% (1.0063 => 1.0976, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.96% (7.0025 => 7.6298, std.dev.: 0.0356) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.27% (0.3301 => 0.3508, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 4.35% (15.2242 => 15.8869, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.15% (0.5876 => 0.6061, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8907, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ReedSolomon: 2.77% (8.5113 => 8.7468, std.dev.: 0.0504) MultiSource/Applications/siod/siod: 2.56% (3.5520 => 3.6431, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 2.54% (3.8907 => 3.9896, std.dev.: 0.0192) SingleSource/Benchmarks/Dhrystone/dry: 2.08% (2.4013 => 2.4512, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.67% (4.6127 => 4.6897, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.4184 => 1.4337, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.35% (0.4596 => 0.4442, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: -1.94% (0.7738 => 0.7588, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -1.34% (0.9425 => 0.9299, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.83% (0.3497 => 0.2104, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -20.45% (1.7473 => 1.3900, std.dev.: 0.0857) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.72% (5.2665 => 4.2282, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9600, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.78% (15.8312 => 13.1746, std.dev.: 0.0772) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.98% (0.0917 => 0.0798, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0238) MultiSource/Applications/sgefa/sgefa: -10.81% (0.3746 => 0.3341, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.08% (3.2007 => 2.9740, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3727, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3319, std.dev.: 0.0262) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3512, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -6.30% (7.6833 => 7.1992, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9354, std.dev.: 0.0534) SingleSource/Benchmarks/Shootout/fib2: -5.14% (4.4195 => 4.1925, std.dev.: 0.0157) MultiSource/Applications/SIBsim4/SIBsim4: -5.01% (3.4230 => 3.2516, std.dev.: 0.0415) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.55% (1.1683 => 1.1268, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2303, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -3.23% (9.2503 => 8.9516, std.dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.88% (3.9413 => 3.8277, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0345) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.07% (2.3569 => 2.3081, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -2.04% (1.0926 => 1.0703, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3651, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (9.3855 => 9.2130, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: -1.75% (3.4876 => 3.4264, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.61% (1.7361 => 1.7082, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3134, std.dev.: 0.0578) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4629, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.34% (2.4457 => 2.4130, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.06% (16.5617 => 16.3857, std.dev.: 0.0554) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.10% (0.9980 => 0.9870, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.6022 => 0.6038, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -0.30% (0.1666 => 0.1661, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.77% (0.1554 => 0.1511, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (0.3083 => 0.3089, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.2394 => 0.2377, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3175 => 0.3176, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.56% (0.2302 => 0.2289, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -5.12% (0.0449 => 0.0426, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.75% (0.0240 => 0.0195, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324) SingleSource/UnitTests/Vector/Altivec/casts: -20.90% (0.0177 => 0.0140, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -80.00% (0.0010 => 0.0002, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.59% (1.5019 => 1.4029, std.dev.: 0.0472) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.13% (0.1501 => 0.1424, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.08% (0.4264 => 0.4090, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.48% (0.1344 => 0.1458, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.38% (0.0589 => 0.0522, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (0.0232 => 0.0222, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.23% (0.0639 => 0.0580, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1350 => 1.1293, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.44% (0.0637 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (0.0246 => 0.0165, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.78% (1.5363 => 1.5944, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 09:27:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 11:27:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921162716.34697352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4104?compare_to=4100&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4104, Order: 164369, Start Time: 2012-09-21 15:14:12, End Time: 2012-09-21 16:28:43 To: 4100, Order: 164368, Start Time: 2012-09-21 12:38:06, End Time: 2012-09-21 13:52:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -16.94% (0.4740 => 0.3937, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.52% (2.0176 => 2.4115, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.46% (0.1410 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.99% (0.1072 => 0.1222, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.76% (0.1588 => 0.1743, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.67% (3.9660 => 4.3496, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 9.62% (0.7038 => 0.7715, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.31% (0.7710 => 0.8428, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.07% (1.3693 => 1.4935, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.89% (0.9199 => 1.0017, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.83% (1.2193 => 1.3270, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.78% (0.2721 => 0.2960, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.77% (0.5265 => 0.5727, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.58% (1.1364 => 1.2339, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.54% (1.4563 => 1.5807, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.46% (13.8202 => 14.9899, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5818 => 0.6298, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.24% (0.6283 => 0.6801, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.23% (0.5577 => 0.6036, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 7.98% (1.0313 => 1.1136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5748 => 0.6205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.92% (0.3246 => 0.3503, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.87% (0.4791 => 0.5168, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.83% (0.7061 => 0.7614, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.59% (1.1061 => 1.1900, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 7.53% (3.8646 => 4.1557, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.47% (0.4379 => 0.4706, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.22% (0.8310 => 0.8910, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.14% (3.6692 => 3.9313, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.09% (2.1791 => 2.3335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3580 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (7.2180 => 7.7268, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5637 => 0.6034, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.2925 => 0.3131, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3489 => 0.3732, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 6.96% (0.3220 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.87% (0.7506 => 0.8022, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.86% (16.6129 => 17.7520, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.77% (0.7460 => 0.7965, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.68% (3.1889 => 3.4019, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.67% (0.6744 => 0.7194, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.66% (0.6576 => 0.7014, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.62% (1.9828 => 2.1140, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.47% (0.2937 => 0.3127, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.43% (1.9270 => 2.0509, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.43% (1.0594 => 1.1275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.40% (0.3453 => 0.3674, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.37% (1.3245 => 1.4089, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.33% (0.4390 => 0.4668, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.14% (0.3534 => 0.3751, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (1.2749 => 1.3528, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 6.05% (0.3192 => 0.3385, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.98% (14.8535 => 15.7421, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.93% (0.4113 => 0.4357, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.92% (0.8698 => 0.9213, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.84% (1.3819 => 1.4626, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (13.2842 => 14.0578, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 5.82% (8.4961 => 8.9908, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.82% (4.4433 => 4.7020, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.81% (1.3813 => 1.4615, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.80% (4.3801 => 4.6343, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 5.77% (0.4003 => 0.4234, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.75% (0.6135 => 0.6488, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 5.72% (0.3131 => 0.3310, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.57% (0.3789 => 0.4000, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1333 => 1.1964, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 5.56% (0.3940 => 0.4159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.53% (0.3578 => 0.3776, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.46% (0.3646 => 0.3845, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.44% (0.3601 => 0.3797, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.41% (0.3663 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2504 => 0.2639, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 5.38% (0.3623 => 0.3818, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.37% (0.3650 => 0.3846, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.34% (0.8818 => 0.9289, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.30% (14.5298 => 15.3006, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.20% (4.9865 => 5.2459, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.17% (6.5754 => 6.9156, std.dev.: 0.0107) MultiSource/Applications/oggenc/oggenc: 4.99% (4.6629 => 4.8956, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (3.2742 => 3.4335, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.52% (1.5188 => 1.5875, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4805 => 0.5019, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.43% (3.7467 => 3.9126, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.6250 => 0.6517, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2292 => 1.2816, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.24% (2.1007 => 2.1898, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.9108 => 0.9491, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.71% (6.2785 => 6.5117, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.46% (33.2944 => 34.4449, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (0.3511 => 0.3624, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.16% (16.2614 => 16.6129, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std.dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (0.2093 => 0.2204, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6969, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.75% (12.0921 => 12.5461, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0883, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4271 => 7.6115, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5872, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.24% (0.4657 => 0.3854, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.93% (22.5627 => 21.9006, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2874, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1493, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5923, std.dev.: 0.0190) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9467, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6615 => 0.6482, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2458, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7544, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1504, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (0.8342 => 0.8232) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.25% (4.1080 => 4.0565, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2623, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 09:32:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 11:32:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921163213.797EB352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4105?compare_to=4101&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4105, Order: 164369, Start Time: 2012-09-21 15:13:51, End Time: 2012-09-21 16:33:40 To: 4101, Order: 164368, Start Time: 2012-09-21 12:39:26, End Time: 2012-09-21 13:59:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (125 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (724 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (14.4843 => 14.7885, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (54.9309 => 56.4775, std.dev.: 0.1072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5705 => 0.5708, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.11% (15.8699 => 15.8871, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 0.16% (14.7029 => 14.7262, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -0.19% (83.4042 => 83.2459, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.3261 => 4.3318, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.31% (1.2265 => 1.2227, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (7.3783 => 7.3928, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (3.6658 => 3.6648, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6348 => 0.6344, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0684 => 0.0685, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.63% (63.2438 => 83.2459, std.dev.: 0.0055) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14279.03% (0.0720 => 10.3529, std.dev.: 0.0055) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.65% (10.3673 => 14.7885, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 26.63% (0.1622 => 0.2054, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.14% (2.2022 => 2.5136, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.74% (7.0540 => 8.0233, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.27% (1.1194 => 1.2567, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.40% (1.7609 => 1.9617, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.02% (10.4361 => 11.4815, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.95% (0.3543 => 0.3860, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 8.81% (0.3282 => 0.3571, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3473 => 0.3778, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.55% (0.3543 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.34% (0.3561 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.33% (0.3516 => 0.3809, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.25% (0.3927 => 0.4251, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3828 => 0.4142, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.15% (0.3694 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.87% (0.3886 => 0.4192, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 7.44% (9.4845 => 10.1902, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.4879 => 0.5234, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.21% (0.3177 => 0.3406, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.98% (0.3109 => 0.3326, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.97% (0.7433 => 0.7951, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.45% (0.7115 => 0.7574, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.42% (5.7591 => 6.1287, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.4615 => 0.4911, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.35% (0.6675 => 0.7099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.31% (0.3423 => 0.3639, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2271 => 0.2413, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.23% (1.5415 => 1.6375, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.3050 => 1.3860, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.5860 => 0.6220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.13% (8.1363 => 8.6353, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (4.2646 => 4.5254, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 6.10% (3.3354 => 3.5387, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.8067 => 0.8558, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.86% (0.5105 => 0.5404, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.84% (0.5569 => 0.5894, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.3092 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.74% (5.0018 => 5.2891, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.74% (4.9449 => 5.2289, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.8172 => 0.8639, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3121 => 0.3295, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.55% (0.9765 => 1.0307, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.49% (0.3441 => 0.3630, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.49% (1.1642 => 1.2281, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.48% (0.7835 => 0.8264, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.42% (0.5020 => 0.5292, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 5.35% (3.8723 => 4.0793, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.28% (1.1861 => 1.2487, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.17% (1.0722 => 1.1276, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.14% (0.4299 => 0.4520, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 5.14% (0.3387 => 0.3561, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.90% (21.9371 => 23.0118, std.dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference-object: 4.86% (0.6030 => 0.6323, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.80% (7.9617 => 8.3438, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 4.79% (1.5603 => 1.6351, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 4.76% (0.5925 => 0.6207, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.74% (2.0273 => 2.1233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.70% (2.2969 => 2.4048, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.58% (0.8921 => 0.9330, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 4.38% (0.6456 => 0.6739, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.28% (0.6450 => 0.6726, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.27% (0.4103 => 0.4278, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (1.5859 => 1.6533, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.23% (0.5981 => 0.6234, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4636 => 0.4826, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 4.01% (0.7326 => 0.7620, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.4186 => 1.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3422 => 0.3554, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.79% (0.4064 => 0.4218, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (14.3668 => 14.9065, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3865 => 0.4009, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.2024 => 2.2842, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.4048 => 0.4187, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.1840 => 1.2238, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4620 => 0.4768, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0665 => 2.1258, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.8101 => 0.8297, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.84% (1.2842 => 1.3078, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.62% (17.1811 => 17.4598, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (3.8922 => 3.9445, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.07% (3.1595 => 3.4146, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3853, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7608, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3487, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7883, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2225, std.dev.: 0.0231) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5752, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.76% (5.2763 => 3.2310, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.45% (5.3855 => 3.9074, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.10% (5.3526 => 3.9018, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0357, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.94% (2.9384 => 2.5875, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -8.18% (22.1758 => 20.3617, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3069, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4839, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (1.8329 => 1.7164, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5838, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8043, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5109, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4326, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9931, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.44% (1.2373 => 1.2071, std.dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5068, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0164, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.16% (0.5229 => 0.5708, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 5.99% (14.9895 => 15.8871, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 4.03% (14.1553 => 14.7262, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 5.38% (4.1105 => 4.3318, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.67% (1.1048 => 1.2227, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.28% (7.1582 => 7.3928, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.83% (3.4629 => 3.6648, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.96% (0.6222 => 0.6344, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 10:41:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 12:41:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921174126.3B8AB352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4106?compare_to=4103&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4106, Order: 164374, Start Time: 2012-09-21 16:31:48, End Time: 2012-09-21 17:42:54 To: 4103, Order: 164369, Start Time: 2012-09-21 15:01:30, End Time: 2012-09-21 16:12:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (54 on baseline) Performance Improvements: 4 (41 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (795 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.37% (0.4480 => 0.4586, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.18% (3.8258 => 3.8711, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.2614 => 1.2741, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 14.29% (0.7663 => 0.8758, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.57% (1.1268 => 1.1445, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.46% (4.4808 => 4.5463, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (1.3742 => 1.3150, std.dev.: 0.0225) MultiSource/Applications/minisat/minisat: -2.50% (6.4190 => 6.2585, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.37% (3.6956 => 3.6448, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: -1.25% (3.2516 => 3.2111, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.22% (0.9870 => 0.9892, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: -0.56% (0.6038 => 0.6004, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -1.99% (0.1661 => 0.1628, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.79% (0.1511 => 0.1484, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3089 => 0.3091, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.62% (0.2377 => 0.2291, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.22% (0.3176 => 0.3169, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.18% (0.2289 => 0.2239, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 1.64% (0.0426 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: -43.18% (0.0088 => 0.0050, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 22.05% (0.0195 => 0.0238, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.38% (0.0195 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.78% (0.0387 => 0.0384, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.00% (0.0300 => 0.0258, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.72% (0.0283 => 0.0247, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 12.14% (0.0140 => 0.0157, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -38.86% (0.0193 => 0.0118, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: - (0.0250 => 0.0250, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -10.77% (0.0325 => 0.0290, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 450.00% (0.0002 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1452 => 0.1449, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.33% (1.4029 => 1.5197, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.95% (0.1424 => 0.1466, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.30% (0.4090 => 0.4037, std.dev.: 0.0380) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.84% (0.1458 => 0.1402, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.00% (0.0522 => 0.0569, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.95% (0.0222 => 0.0211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.55% (0.0580 => 0.0571, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.87% (0.0047 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1293 => 1.1302, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0011 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0596 => 0.0597, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.91% (0.0165 => 0.0183, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7662 => 0.7674, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.68% (1.5944 => 1.5836, std.dev.: 0.0081) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.13% (4.1772 => 3.1274, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/except: 80933.33% (0.0006 => 0.4862, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.72% (0.0745 => 0.0877, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.72% (0.6410 => 0.6841, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 6.53% (2.1763 => 2.3184, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: 5.78% (0.5309 => 0.5616, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.31% (0.2552 => 0.2662, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.13% (1.0046 => 1.0461, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 4.10% (0.6173 => 0.6426, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 3.90% (15.3105 => 15.9072, std.dev.: 0.1161) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (1.1653 => 1.2090, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.6915 => 0.7144, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.5150 => 1.5613, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.72% (0.3901 => 0.4007, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.7639 => 0.7840, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (12.6413 => 12.9672, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.37% (1.2021 => 1.2306, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1672 => 1.1934, std.dev.: 0.0079) MultiSource/Applications/d/make_dparser: 2.01% (3.0225 => 3.0833, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6069 => 0.6183, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 1.79% (4.7455 => 4.8306, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.56% (6.2546 => 6.3523, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.0689 => 1.0841, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.31% (13.3238 => 13.4984, std.dev.: 0.0340) MultiSource/Benchmarks/nbench/nbench: 1.14% (1.0821 => 1.0944, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 1.05% (14.6079 => 14.7615, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (4.0318 => 4.0727, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.53% (1.6538 => 2.3406, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9988, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.11% (4.0101 => 4.5759, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 12.28% (0.1433 => 0.1609, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.96% (0.2857 => 0.3113, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.35% (7.0025 => 7.5873, std.dev.: 0.0503) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.10% (1.0063 => 1.0777, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.50% (40.4792 => 42.3006, std.dev.: 0.3523) SingleSource/Benchmarks/Misc/dt: 4.22% (0.9851 => 1.0267, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (2.4042 => 2.4993, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8240, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.60% (3.4080 => 3.5307, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.06% (0.8498 => 0.8758, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 2.98% (8.5113 => 8.7646, std.dev.: 0.0583) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.81% (3.8907 => 4.0000, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8896, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.6308 => 0.6480, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.53% (2.6656 => 2.7331, std.dev.: 0.0212) MultiSource/Applications/siod/siod: 2.43% (3.5520 => 3.6383, std.dev.: 0.0317) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.03% (4.6127 => 4.7063, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.26% (1.2726 => 1.2886, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.4184 => 1.4357, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.4455 => 2.4712, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.03% (27.1724 => 27.4511, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.77% (0.2080 => 0.1960, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -1.41% (0.9425 => 0.9292, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.89% (0.3497 => 0.2067, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.58% (5.2665 => 4.0774, std.dev.: 0.0979) SingleSource/Benchmarks/Shootout-C++/ary3: -20.70% (1.7473 => 1.3856, std.dev.: 0.0445) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.32% (1.1647 => 0.9630, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.17% (15.8312 => 13.2706, std.dev.: 0.1006) MultiSource/Applications/sgefa/sgefa: -12.49% (0.3746 => 0.3278, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.15% (3.2007 => 2.9399, std.dev.: 0.0988) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.50% (3.6023 => 3.3323, std.dev.: 0.0678) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3790, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3278, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -6.59% (1.4441 => 1.3490, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -6.44% (7.6833 => 7.1888, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.21% (1.4021 => 1.3150, std.dev.: 0.0225) MultiSource/Applications/SIBsim4/SIBsim4: -6.19% (3.4230 => 3.2111, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.50% (62.4126 => 58.9825, std.dev.: 0.1972) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1881, std.dev.: 0.0440) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4140 => 0.3936, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.77% (1.2722 => 1.2243, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: -3.38% (0.4296 => 0.4151, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -3.16% (9.2503 => 8.9581, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.79% (3.7496 => 3.6448, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2939, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.18% (1.8739 => 1.8330, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.04% (1.1683 => 1.1445, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3120, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4233, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: -1.75% (92.7467 => 91.1197, std.dev.: 0.4819) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3716, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (9.3855 => 9.2487, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3093, std.dev.: 0.1031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.88% (0.9980 => 0.9892, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: -0.30% (0.6022 => 0.6004, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -2.28% (0.1666 => 0.1628, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.50% (0.1554 => 0.1484, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (0.3083 => 0.3091, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.30% (0.2394 => 0.2291, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.19% (0.3175 => 0.3169, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.74% (0.2302 => 0.2239, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -3.56% (0.0449 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: -43.82% (0.0089 => 0.0050, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.37% (0.0192 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.29% (0.0301 => 0.0258, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.03% (0.0284 => 0.0247, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -11.30% (0.0177 => 0.0157, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -37.57% (0.0189 => 0.0118, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -10.77% (0.0325 => 0.0290, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.40% (0.1429 => 0.1449, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.19% (1.5019 => 1.5197, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.33% (0.1501 => 0.1466, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.32% (0.4264 => 0.4037, std.dev.: 0.0380) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.32% (0.1344 => 0.1402, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.40% (0.0589 => 0.0569, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.05% (0.0232 => 0.0211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.1350 => 1.1302, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.28% (0.0637 => 0.0597, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.61% (0.0246 => 0.0183, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.76% (0.7541 => 0.7674, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.08% (1.5363 => 1.5836, std.dev.: 0.0081) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 11:10:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 13:10:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921181027.61F99352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4107?compare_to=4104&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4107, Order: 164374, Start Time: 2012-09-21 16:57:20, End Time: 2012-09-21 18:11:52 To: 4104, Order: 164369, Start Time: 2012-09-21 15:14:12, End Time: 2012-09-21 16:28:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.11% (0.5358 => 0.5471, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.53% (2.0176 => 2.4117, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.53% (0.1410 => 0.1629, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1072 => 0.1223, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.40% (0.1413 => 0.1560, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1013 => 0.1118, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.70% (3.9660 => 4.3509, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 9.61% (0.7038 => 0.7714, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.57% (0.1588 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1327 => 0.1452, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.34% (0.7710 => 0.8430, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.28% (0.2596 => 0.2837, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.98% (0.6959 => 0.7584, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.95% (0.9199 => 1.0022, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.94% (1.3693 => 1.4917, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.86% (0.2721 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.85% (1.2193 => 1.3272, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.72% (0.5265 => 0.5724, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.64% (1.1364 => 1.2346, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7061 => 0.7661, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.48% (1.4563 => 1.5798, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.41% (13.8202 => 14.9819, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5818 => 0.6301, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.21% (0.6283 => 0.6799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5748 => 0.6209, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.97% (1.0313 => 1.1135, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.83% (0.4791 => 0.5166, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5577 => 0.6011, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.3899 => 0.4202, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.64% (1.1061 => 1.1906, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.61% (3.8646 => 4.1587, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.42% (0.4379 => 0.4704, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.38% (0.2995 => 0.3216, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.27% (0.8310 => 0.8914, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.13% (0.5637 => 0.6039, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.10% (7.2180 => 7.7308, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 7.09% (2.1791 => 2.3336, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.06% (3.6692 => 3.9282, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.03% (0.3485 => 0.3730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.96% (0.7460 => 0.7979, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.95% (0.7506 => 0.8028, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.94% (16.6129 => 17.7659, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.91% (0.3489 => 0.3730, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4390 => 0.4688, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.71% (3.1889 => 3.4029, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.71% (0.6576 => 0.7017, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.58% (0.6744 => 0.7188, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.58% (1.9828 => 2.1132, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.52% (1.0594 => 1.1285, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.51% (1.9270 => 2.0524, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.44% (0.2655 => 0.2826, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.40% (1.3245 => 1.4093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.2937 => 0.3125, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.37% (0.2761 => 0.2937, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.19% (0.3149 => 0.3344, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.07% (1.2749 => 1.3523, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.95% (1.3813 => 1.4635, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.94% (0.8698 => 0.9215, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4638, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.90% (14.8535 => 15.7298, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/parameter-passing: 5.90% (0.4003 => 0.4239, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (8.4961 => 8.9929, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.82% (0.6135 => 0.6492, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.81% (0.4113 => 0.4352, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (4.4433 => 4.7002, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.78% (4.3801 => 4.6333, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.75% (0.3131 => 0.3311, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (13.2842 => 14.0455, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3914 => 0.4136, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.64% (1.1333 => 1.1972, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 5.61% (0.3940 => 0.4161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.51% (0.3578 => 0.3775, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 5.44% (0.3789 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.42% (0.3650 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.40% (0.3646 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.38% (0.3663 => 0.3860, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.36% (14.5298 => 15.3089, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-2: 5.36% (0.3601 => 0.3794, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2504 => 0.2638, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.31% (4.9865 => 5.2511, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 5.28% (6.5754 => 6.9224, std.dev.: 0.0175) SingleSource/UnitTests/ObjC/exceptions-3: 5.24% (0.3623 => 0.3813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.22% (0.3755 => 0.3951, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.06% (0.8818 => 0.9264, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.95% (4.6629 => 4.8938, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.93% (3.2742 => 3.4356, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (1.5188 => 1.5872, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.48% (3.7467 => 3.9144, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4805 => 0.5016, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.28% (2.1007 => 2.1907, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.28% (0.9108 => 0.9498, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 4.13% (0.6250 => 0.6508, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2785 => 6.5107, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 3.44% (33.2944 => 34.4404, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.13% (0.3511 => 0.3621, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.10% (16.2614 => 16.6024, std.dev.: 0.0228) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.02% (1.0895 => 1.3621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2648, std.dev.: 0.0508) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.39% (1.2998 => 1.3828, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6970, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5473, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.57% (10.7476 => 11.1313, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4271 => 7.6130, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.19% (7.9275 => 8.0218, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6864, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.20% (0.4657 => 0.3856, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.95% (22.5627 => 21.8968, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2901, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2729 => 3.1498, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.8259 => 8.5650, std.dev.: 0.0225) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.52% (3.0263 => 2.9499, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4837, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.00% (0.6615 => 0.6483, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.65% (28.2225 => 27.7568, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1614, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.22% (4.1080 => 4.0579, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2260, std.dev.: 0.0124) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4336, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2621, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 11:22:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 13:22:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921182227.CFBA3352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4108?compare_to=4105&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4108, Order: 164377, Start Time: 2012-09-21 17:03:55, End Time: 2012-09-21 18:23:54 To: 4105, Order: 164369, Start Time: 2012-09-21 15:13:51, End Time: 2012-09-21 16:33:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (124 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (725 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.81% (1.2071 => 1.2290, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.88% (0.5489 => 0.5331, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5708 => 0.5704, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -0.01% (15.8871 => 15.8853, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 0.03% (14.7262 => 14.7313, std.dev.: 0.0218) MultiSource/Benchmarks/Bullet/bullet: -0.02% (83.2459 => 83.2310, std.dev.: 0.0327) MultiSource/Benchmarks/MallocBench/gs/gs: -0.21% (4.3318 => 4.3228, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.01% (1.2227 => 1.2228, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (7.3928 => 7.3871, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.6648 => 3.6668, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6344 => 0.6342, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1432 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0685 => 0.0684, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.60% (63.2438 => 83.2310, std.dev.: 0.0327) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14285.56% (0.0720 => 10.3576, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.66% (10.3673 => 14.7895, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 26.94% (0.1622 => 0.2059, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.16% (2.2022 => 2.5140, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.73% (7.0540 => 8.0228, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 13.34% (0.1432 => 0.1623, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.30% (1.1194 => 1.2571, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.42% (1.7609 => 1.9620, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 9.99% (10.4361 => 11.4782, std.dev.: 0.0168) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3473 => 0.3773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.51% (0.3561 => 0.3864) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3543 => 0.3841, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.35% (0.3543 => 0.3839, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.32% (0.3497 => 0.3788, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3694 => 0.3998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3828 => 0.4142, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.10% (0.3927 => 0.4245, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.87% (0.3886 => 0.4192, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.61% (0.1655 => 0.1781, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.41% (9.4845 => 10.1872, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.38% (0.4879 => 0.5239, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 7.29% (0.1440 => 0.1545, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2554 => 0.2735, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.96% (0.7433 => 0.7950, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 6.75% (0.3109 => 0.3319, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 6.72% (0.3423 => 0.3653, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.59% (0.4615 => 0.4919, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.41% (5.7591 => 6.1285, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 6.41% (0.7115 => 0.7571, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5860 => 0.6235, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.34% (1.5415 => 1.6392, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3307 => 0.3516, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.6675 => 0.7095, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.27% (1.3050 => 1.3868, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.27% (3.3354 => 3.5444, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2271 => 0.2412, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.15% (4.2646 => 4.5268, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.8172 => 0.8669, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.00% (0.8067 => 0.8551, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.99% (8.1363 => 8.6239, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.95% (0.5105 => 0.5409, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5569 => 0.5898, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.84% (5.0018 => 5.2941, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.81% (4.9449 => 5.2322, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.74% (0.2107 => 0.2228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3441 => 0.3638, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.66% (0.9765 => 1.0318, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 5.51% (1.1642 => 1.2283, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 5.50% (0.7835 => 0.8266, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 5.35% (3.8723 => 4.0796, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.25% (1.1861 => 1.2484, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 5.22% (1.0722 => 1.1282, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.12% (0.4299 => 0.4519, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 5.11% (0.3387 => 0.3560, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.00% (0.5020 => 0.5271, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (7.9617 => 8.3517, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 4.89% (21.9371 => 23.0104, std.dev.: 0.0228) MultiSource/Applications/treecc/treecc: 4.86% (2.0273 => 2.1259, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 4.81% (0.6030 => 0.6320, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.80% (1.5603 => 1.6352, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 4.79% (0.5925 => 0.6209, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.70% (2.2969 => 2.4048, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 4.55% (0.8921 => 0.9327, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.51% (0.6450 => 0.6741, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.36% (1.5859 => 1.6550, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.23% (0.4636 => 0.4832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6456 => 0.6727, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5981 => 0.6232, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.00% (0.7326 => 0.7619, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.00% (0.4103 => 0.4267, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.4186 => 1.4744, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3422 => 0.3555, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3650 => 0.3790, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (14.3668 => 14.9175, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.2024 => 2.2842, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash: 3.68% (0.4289 => 0.4447, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3865 => 0.4003, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.1840 => 1.2250, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4203 => 0.4342, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.18% (0.4620 => 0.4767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0665 => 2.1284, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.8101 => 0.8302, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.79% (1.2842 => 1.3072, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.62% (17.1811 => 17.4596, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.8922 => 3.9410, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.31% (1.1145 => 1.3854, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3819, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.04% (4.2280 => 4.3564, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7462, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7881, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std.dev.: 0.0392) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5781, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.69% (5.2763 => 3.2347, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.36% (5.3855 => 3.9120, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.13% (5.3526 => 3.9003, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0536, std.dev.: 0.0414) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.95% (2.9384 => 2.5874, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.19% (22.1758 => 20.3604, std.dev.: 0.0377) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.56% (19.9488 => 18.2415, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4841, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.42% (1.8329 => 1.7152, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.75% (1.6805 => 1.5839, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8044, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.03% (3.2827 => 3.1505, std.dev.: 0.0110) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5039, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4214, std.dev.: 0.0227) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0110, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9964, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.08% (0.5229 => 0.5704, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 5.98% (14.9895 => 15.8853, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 4.07% (14.1553 => 14.7313, std.dev.: 0.0218) MultiSource/Benchmarks/MallocBench/gs/gs: 5.16% (4.1105 => 4.3228, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.68% (1.1048 => 1.2228, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.20% (7.1582 => 7.3871, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.89% (3.4629 => 3.6668, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.6222 => 0.6342, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 11:54:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 13:54:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921185404.91487352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4109?compare_to=4102&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4109, Order: 164371, Start Time: 2012-09-21 16:11:45, End Time: 2012-09-21 18:55:30 To: 4102, Order: 164368, Start Time: 2012-09-21 12:59:01, End Time: 2012-09-21 15:43:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (778 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3460 => 0.3762, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.72% (0.3488 => 0.3792, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3465 => 0.3766, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.68% (0.3446 => 0.3745, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 8.67% (0.3496 => 0.3799, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3442 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3469 => 0.3767, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.52% (0.3650 => 0.3961, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions: 8.40% (0.3643 => 0.3949, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.35% (1.5932 => 1.7262, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.3724 => 0.4032, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.03% (1.6211 => 1.7188, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.66% (1.3152 => 1.3897, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 5.65% (5.5417 => 5.8550, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (0.4994 => 0.5275, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (0.5026 => 0.5306, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.46% (1.0781 => 1.1370, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.42% (0.3930 => 0.4143, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.39% (3.5627 => 3.7546, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 5.36% (0.5826 => 0.6138, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.30% (0.5889 => 0.6201, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.26% (0.6634 => 0.6983, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 5.20% (4.2109 => 4.4298, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.13% (2.7292 => 2.8693, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 5.07% (0.2566 => 0.2696, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.98% (0.3195 => 0.3354, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 4.92% (0.9909 => 1.0397, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (4.4195 => 4.6369, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 4.87% (2.1013 => 2.2036, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 4.76% (0.2750 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.5900 => 0.6181, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (0.3890 => 0.4075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 4.73% (4.6177 => 4.8363, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2714 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.69% (23.5202 => 24.6242, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2738 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.66% (0.4139 => 0.4332, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.64% (0.2823 => 0.2954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.58% (0.2792 => 0.2920, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.58% (2.0673 => 2.1620, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.54% (0.2729 => 0.2853, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.52% (1.4269 => 1.4914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.51% (0.3903 => 0.4079, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.2911 => 0.3042, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.50% (0.2780 => 0.2905, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.3096 => 0.3235, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.48% (0.3258 => 0.3404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.46% (0.3317 => 0.3465, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (1.8794 => 1.9631, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.43% (0.3362 => 0.3511, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3726 => 0.3891, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.41% (0.3625 => 0.3785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (2.1653 => 2.2604, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3124 => 0.3261, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.38% (0.3060 => 0.3194, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.38% (0.3084 => 0.3219, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (0.4251 => 0.4437, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.2866 => 0.2991, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.35% (2.0346 => 2.1232, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (0.4658 => 0.4860, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3678 => 0.3837, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 4.28% (0.9697 => 1.0112, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.23% (0.3477 => 0.3624, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.17% (0.3282 => 0.3419, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.17% (0.3336 => 0.3475, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.13% (0.5546 => 0.5775, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.10% (0.7171 => 0.7465, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.6435 => 0.6697, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.01% (0.3690 => 0.3838, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.92% (0.7875 => 0.8184, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.5012 => 0.5207, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.84% (0.7426 => 0.7711, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.82% (0.3981 => 0.4133, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 3.80% (0.4847 => 0.5031, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.3271 => 0.3394, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (1.9966 => 2.0713, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0424, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.56% (0.5361 => 0.5552, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.53% (0.5584 => 0.5781, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (11.6398 => 11.9904, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.59% (4.6926 => 4.8140, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1736, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6303, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2026, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5064, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4408, std.dev.: 0.0142) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5942, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5591, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary2: -9.74% (0.2402 => 0.2168, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7960, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7919, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7876, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.49% (16.2163 => 15.9745, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 12:53:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 14:53:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921195335.29ECD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4110?compare_to=4107&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4110, Order: 164395, Start Time: 2012-09-21 18:40:25, End Time: 2012-09-21 19:55:00 To: 4107, Order: 164374, Start Time: 2012-09-21 16:57:20, End Time: 2012-09-21 18:11:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.11% (54.2729 => 56.5038, std.dev.: 0.0905) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.45% (2.0176 => 2.4100, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1410 => 0.1627, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.26% (0.1413 => 0.1558, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 9.97% (0.1013 => 0.1114, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.63% (3.9660 => 4.3481, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.47% (0.7710 => 0.8440, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2596 => 0.2838, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.29% (0.7038 => 0.7692, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.05% (0.6959 => 0.7589, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 8.97% (1.3693 => 1.4921, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.90% (0.9199 => 1.0018, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.87% (0.5265 => 0.5732, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.83% (0.4328 => 0.4710, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.73% (1.2193 => 1.3257, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.61% (1.4563 => 1.5817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.42% (1.1364 => 1.2321, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 8.29% (13.8202 => 14.9663, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.85% (0.6283 => 0.6776, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.81% (1.0313 => 1.1118, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.80% (0.5577 => 0.6012, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2127 => 0.2287, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.46% (0.3485 => 0.3745, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.41% (1.1061 => 1.1881, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.38% (0.4379 => 0.4702, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.35% (0.2995 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.34% (0.5637 => 0.6051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4390 => 0.4711, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.2914 => 0.3126, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.27% (0.8310 => 0.8914, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.27% (3.8646 => 4.1454, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.22% (0.3756 => 0.4027, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 7.20% (0.3293 => 0.3530, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.19% (7.2180 => 7.7373, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.10% (0.4016 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.9828 => 2.1231, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.04% (0.2243 => 0.2401, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.98% (0.7506 => 0.8030, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.93% (3.6692 => 3.9236, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6.88% (2.1791 => 2.3290, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.84% (0.2690 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (0.7460 => 0.7970, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 6.83% (0.2607 => 0.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.83% (0.2988 => 0.3192, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.77% (0.2023 => 0.2160, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3534 => 0.3772, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.73% (16.6129 => 17.7303, std.dev.: 0.0238) SingleSource/UnitTests/ObjC/parameter-passing: 6.69% (0.4003 => 0.4271, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3578 => 0.3817, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.62% (0.3914 => 0.4173, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.60% (0.3940 => 0.4200, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.57% (0.3789 => 0.4038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.52% (0.3663 => 0.3902, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.52% (0.6744 => 0.7184, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.52% (1.9270 => 2.0526, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.44% (0.3650 => 0.3885, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.42% (3.1889 => 3.3937, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.35% (1.3245 => 1.4086, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.27% (1.0594 => 1.1258, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1657 => 0.1760, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (1.3813 => 1.4631, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.91% (0.8698 => 0.9212, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (1.2749 => 1.3501, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 5.88% (14.8535 => 15.7274, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 5.84% (0.2859 => 0.3026, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.84% (0.6576 => 0.6960, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.80% (1.3819 => 1.4621, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.3801 => 4.6318, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.73% (4.4433 => 4.6981, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (8.4961 => 8.9796, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.6135 => 0.6484, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 5.65% (0.3131 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1333 => 1.1964, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (13.2842 => 14.0237, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.35% (0.8818 => 0.9290, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.31% (0.2504 => 0.2637, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.24% (0.3245 => 0.3415, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.20% (14.5298 => 15.2849, std.dev.: 0.0236) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (6.5754 => 6.9118, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.94% (3.2742 => 3.4361, std.dev.: 0.0187) MultiSource/Applications/oggenc/oggenc: 4.91% (4.6629 => 4.8920, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (4.9865 => 5.2159, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2292 => 1.2848, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (1.5188 => 1.5845, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.31% (0.4805 => 0.5012, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.25% (0.9108 => 0.9495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.22% (0.6250 => 0.6514, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 4.20% (3.7467 => 3.9039, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (2.1007 => 2.1866, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.69% (6.2785 => 6.5103, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 3.37% (33.2944 => 34.4168, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 1.90% (16.2614 => 16.5699, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.03% (1.0895 => 1.3622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std.dev.: 0.0449) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.06% (1.2998 => 1.3786, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.61% (1.9144 => 2.0027, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6965, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.77% (12.0921 => 12.5482, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1073, std.dev.: 0.0609) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6035, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.57% (0.2670 => 0.2548, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.35% (22.5627 => 21.8064, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.22% (1.0460 => 0.8554, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3056, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.71% (0.3458 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.23% (5.0168 => 4.8048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1494, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5808, std.dev.: 0.0124) MultiSource/Applications/spiff/spiff: -2.53% (3.0263 => 2.9496, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6615 => 0.6482, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2465, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7542, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (0.8342 => 0.8231, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2037, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2300, std.dev.: 0.0308) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (4.1080 => 4.0622, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 13:10:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 15:10:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921201050.1D093352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4111?compare_to=4108&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4111, Order: 164397, Start Time: 2012-09-21 18:52:28, End Time: 2012-09-21 20:12:15 To: 4108, Order: 164377, Start Time: 2012-09-21 17:03:55, End Time: 2012-09-21 18:23:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (120 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (730 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.84% (14.7895 => 15.2098, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (3.9120 => 3.8700, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -2.38% (1.2290 => 1.1997, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5704 => 0.5712, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.06% (15.8853 => 15.8950, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 0.36% (14.7313 => 14.7845, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: -0.23% (83.2310 => 83.0384, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.3228 => 4.3277, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2228 => 1.2235, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (7.3871 => 7.3886, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.11% (3.6668 => 3.6710, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.6342 => 0.6334, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0684 => 0.0684, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.30% (63.2438 => 83.0384, std.dev.: 0.0091) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14281.25% (0.0720 => 10.3545, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.71% (10.3673 => 15.2098, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/richards_benchmark: 26.70% (0.1622 => 0.2055, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.51% (2.2022 => 2.5218, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.20% (7.0540 => 8.0557, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.53% (1.7609 => 1.9464, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 9.92% (10.4361 => 11.4714, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3473 => 0.3805, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.44% (0.3561 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3543 => 0.3875, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3516 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.29% (0.3543 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.27% (0.3497 => 0.3821, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.3927 => 0.4282, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.04% (0.3828 => 0.4174, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.96% (0.3282 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.93% (0.3886 => 0.4233, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.52% (9.4845 => 10.1977, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.3177 => 0.3404, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.05% (0.4879 => 0.5223, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.00% (0.7433 => 0.7953, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.72% (0.3109 => 0.3318, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.60% (0.5860 => 0.6247, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.58% (1.5415 => 1.6429, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.58% (0.7115 => 0.7583, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 6.55% (0.1695 => 0.1806, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3307 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.42% (4.2646 => 4.5383, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3423 => 0.3642, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.6675 => 0.7096, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.30% (1.3050 => 1.3872, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.5105 => 0.5426, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.23% (5.7591 => 6.1181, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.23% (3.3354 => 3.5431, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5569 => 0.5910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.12% (8.1363 => 8.6344, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.11% (0.8067 => 0.8560, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: 6.08% (0.3092 => 0.3280, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.08% (0.7835 => 0.8311, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.97% (0.8172 => 0.8660, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.84% (0.9765 => 1.0335, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.83% (1.1642 => 1.2321, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.81% (5.0018 => 5.2925, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.79% (4.9449 => 5.2314, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.2758 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.68% (1.1861 => 1.2535, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.38% (0.3180 => 0.3351, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.33% (1.0722 => 1.1294, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.33% (3.8723 => 4.0788, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.28% (0.3387 => 0.3566, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.02% (0.4299 => 0.4515, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.93% (2.2969 => 2.4101, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.91% (2.0273 => 2.1268, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.86% (0.5020 => 0.5264, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.86% (0.6030 => 0.6323, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.83% (7.9617 => 8.3466, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/Hello: 4.81% (0.5925 => 0.6210, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 4.81% (21.9371 => 22.9918, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 4.65% (0.8921 => 0.9336, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 4.56% (1.5603 => 1.6315, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.44% (1.5859 => 1.6563, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 4.35% (0.6456 => 0.6737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5981 => 0.6240, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.4186 => 1.4769, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.08% (0.7326 => 0.7625, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.00% (2.2024 => 2.2905, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (14.3668 => 14.9343, std.dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.93% (0.4636 => 0.4818, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.1840 => 1.2267, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.48% (0.3650 => 0.3777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.42% (0.3865 => 0.3997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4203 => 0.4340, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.14% (0.4620 => 0.4765, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.89% (0.4048 => 0.4165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.55% (2.0665 => 2.1192, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.8101 => 0.8302, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4679, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2842 => 1.3052, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.8922 => 3.9375, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 8.02% (3.1595 => 3.4130, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (3.1578 => 3.3799, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2142, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (4.2280 => 4.3583, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2389, std.dev.: 0.0313) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7876, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5767, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2309, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.14% (5.3855 => 3.8700, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.70% (5.3526 => 3.8697, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0466, std.dev.: 0.0329) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.96% (2.9384 => 2.5871, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: -8.15% (22.1758 => 20.3679, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2914, std.dev.: 0.0614) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.32% (1.8329 => 1.7170, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.74% (1.6805 => 1.5840, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.02% (3.2827 => 3.1508, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4923, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: -3.04% (1.2373 => 1.1997, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4199, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0083, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0121, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (1.7254 => 1.7053, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.24% (0.5229 => 0.5712, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 6.04% (14.9895 => 15.8950, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 4.44% (14.1553 => 14.7845, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 5.28% (4.1105 => 4.3277, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.74% (1.1048 => 1.2235, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.22% (7.1582 => 7.3886, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.01% (3.4629 => 3.6710, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.6222 => 0.6334, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 13:52:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 15:52:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921205258.1A1D5352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4112?compare_to=4106&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4112, Order: 164402, Start Time: 2012-09-21 19:43:17, End Time: 2012-09-21 20:54:25 To: 4106, Order: 164374, Start Time: 2012-09-21 16:31:48, End Time: 2012-09-21 17:42:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (46 on baseline) Performance Improvements: 0 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 896 (807 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.4118 => 1.4364, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.66% (0.9292 => 0.9446, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 2.39% (1.0267 => 1.0512, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.29% (1.8330 => 1.8567, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.27% (0.9892 => 0.9865, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 0.43% (0.6004 => 0.6030, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 2.21% (0.1628 => 0.1664, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.40% (0.1484 => 0.1579, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.65% (0.3091 => 0.3040, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.48% (0.2291 => 0.2302, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.16% (0.3169 => 0.3164, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.40% (0.2239 => 0.2248, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 0.92% (0.0433 => 0.0437, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -40.00% (0.0050 => 0.0030, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.51% (0.0238 => 0.0163, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.52% (0.0126 => 0.0138, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.11% (0.0384 => 0.0349, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.12% (0.0258 => 0.0297, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 13.36% (0.0247 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0321 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 12.10% (0.0157 => 0.0176, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 61.02% (0.0118 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -9.60% (0.0250 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: 8.62% (0.0290 => 0.0315, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1449 => 0.1460, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: -6.67% (1.5197 => 1.4184, std.dev.: 0.0287) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.82% (0.1466 => 0.1454, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.86% (0.4037 => 0.4193, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.50% (0.1402 => 0.1423, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.73% (0.0569 => 0.0613, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.21% (0.0211 => 0.0200, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.03% (0.0571 => 0.0594, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 4600.00% (0.0001 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1302 => 1.1264, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.21% (0.0597 => 0.0542, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.02% (0.0183 => 0.0161, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.25% (0.7674 => 0.7655, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.88% (1.5836 => 1.5975, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.31% (4.1772 => 3.1201, std.dev.: 0.0453) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.88% (0.0745 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.08% (0.6410 => 0.6864, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5309 => 0.5626, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 5.64% (2.1763 => 2.2991, std.dev.: 0.0114) MultiSource/Applications/minisat/minisat: 4.55% (0.6173 => 0.6454, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.24% (0.3582 => 0.3734, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 4.19% (1.0046 => 1.0467, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: 4.06% (1.1653 => 1.2126, std.dev.: 0.0154) MultiSource/Applications/lambda-0_1_3/lambda: 3.95% (0.6915 => 0.7188, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.5150 => 1.5578, std.dev.: 0.0094) MultiSource/Applications/d/make_dparser: 2.49% (3.0225 => 3.0979, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.7639 => 0.7802, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.98% (1.1440 => 1.1666, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (1.4113 => 1.4364, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.51% (1.3268 => 1.3468, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.1827 => 1.1972, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (1.4408 => 1.4582, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.0766 => 0.0906, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9970, std.dev.: 0.0138) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.34% (4.0101 => 4.5450, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 8.29% (7.0025 => 7.5833, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.22% (4.2129 => 4.4328, std.dev.: 0.0581) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.86% (0.5876 => 0.6103, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.71% (3.4080 => 3.5343, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 3.39% (15.2242 => 15.7408, std.dev.: 0.1033) SingleSource/Benchmarks/McGill/chomp: 3.12% (1.0194 => 1.0512, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/ReedSolomon: 3.12% (8.5113 => 8.7767, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8926, std.dev.: 0.0406) MultiSource/Benchmarks/sim/sim: 2.62% (3.8907 => 3.9928, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 2.39% (0.6308 => 0.6459, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.04% (3.5520 => 3.6243, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/mason/mason: 2.00% (0.5004 => 0.5104, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4013 => 2.4484, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.60% (4.6127 => 4.6866, std.dev.: 0.0277) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.4184 => 1.4388, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.15% (4.6414 => 4.6949, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.07% (0.9029 => 0.8752, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.46% (0.3497 => 0.2047, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0916, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/ary3: -20.81% (1.7473 => 1.3836, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.40% (1.1647 => 0.9620, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.05% (15.8312 => 13.2897, std.dev.: 0.0806) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1576, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9514, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3751, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3287, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -6.43% (7.6833 => 7.1896, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/richards_benchmark: -6.22% (1.4441 => 1.3543, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (62.4126 => 58.9186, std.dev.: 0.0776) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1845, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -4.66% (3.4230 => 3.2634, std.dev.: 0.0338) MultiSource/Benchmarks/FreeBench/distray/distray: -4.24% (0.2664 => 0.2551, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -3.56% (9.2503 => 8.9213, std.dev.: 0.0469) SingleSource/Benchmarks/McGill/misr: -3.47% (0.4296 => 0.4147, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.34% (1.2722 => 1.2297, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8283, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0275) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.68% (0.4140 => 0.4029, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.66% (3.7496 => 3.6499, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.32% (1.1683 => 1.1412, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -2.25% (92.7467 => 90.6641, std.dev.: 0.2957) MultiSource/Benchmarks/FreeBench/neural/neural: -2.12% (1.0926 => 1.0694, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -1.98% (3.4286 => 3.3606, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (9.3855 => 9.2174, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: -1.75% (3.4876 => 3.4264, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4616, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3069, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.15% (0.9980 => 0.9865, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.6022 => 0.6030, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1666 => 0.1664, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.61% (0.1554 => 0.1579, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.39% (0.3083 => 0.3040, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.84% (0.2394 => 0.2302, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.35% (0.3175 => 0.3164, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.35% (0.2302 => 0.2248, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -2.67% (0.0449 => 0.0437, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -32.08% (0.0240 => 0.0163, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.12% (0.0192 => 0.0138, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.51% (0.0390 => 0.0349, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -9.24% (0.0249 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -3.08% (0.0325 => 0.0315, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.17% (0.1429 => 0.1460, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: -5.56% (1.5019 => 1.4184, std.dev.: 0.0287) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.13% (0.1501 => 0.1454, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.67% (0.4264 => 0.4193, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.88% (0.1344 => 0.1423, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.79% (0.0232 => 0.0200, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.04% (0.0639 => 0.0594, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.1350 => 1.1264, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.91% (0.0637 => 0.0542, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.55% (0.0246 => 0.0161, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.98% (1.5363 => 1.5975, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 14:36:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 16:36:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921213634.EBC51352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4113?compare_to=4110&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4113, Order: 164407, Start Time: 2012-09-21 20:23:35, End Time: 2012-09-21 21:37:58 To: 4110, Order: 164395, Start Time: 2012-09-21 18:40:25, End Time: 2012-09-21 19:55:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.69% (56.5038 => 54.4198, std.dev.: 0.6742) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.14% (80.6044 => 79.6853, std.dev.: 0.3472) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.41% (2.0176 => 2.4093, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1013 => 0.1115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.82% (0.1588 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.60% (3.9660 => 4.3466, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.36% (0.7710 => 0.8432, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.24% (0.2596 => 0.2836, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7038 => 0.7679, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 9.09% (0.7061 => 0.7703, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.04% (0.5818 => 0.6344, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.99% (1.3693 => 1.4924, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.89% (0.9199 => 1.0017, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1327 => 0.1445, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.87% (0.4328 => 0.4712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.78% (1.2193 => 1.3263, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.77% (0.5265 => 0.5727, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.75% (0.6959 => 0.7568, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.2721 => 0.2958, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.44% (1.1364 => 1.2323, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.36% (1.4563 => 1.5781, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 8.22% (13.8202 => 14.9564, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.18% (0.5577 => 0.6033, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.89% (0.3246 => 0.3502, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.87% (0.1589 => 0.1714, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.86% (1.0313 => 1.1124, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.6283 => 0.6772, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.75% (0.3899 => 0.4201, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.2781 => 0.2994, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.56% (1.1061 => 1.1897, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.47% (0.4791 => 0.5149, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (0.4379 => 0.4703, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.38% (0.2127 => 0.2284, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.35% (0.3485 => 0.3741, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4390 => 0.4710, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.28% (0.2995 => 0.3213, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3489 => 0.3742, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.24% (0.3756 => 0.4028, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.23% (0.8310 => 0.8911, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.22% (0.5637 => 0.6044, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.17% (3.8646 => 4.1417, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.2914 => 0.3122, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3293 => 0.3528, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.13% (0.7506 => 0.8041, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (7.2180 => 7.7312, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.3220 => 0.3448, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.92% (1.9828 => 2.1201, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (3.6692 => 3.9223, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.86% (0.7460 => 0.7972, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.83% (2.1791 => 2.3280, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.2023 => 0.2161, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3578 => 0.3819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.67% (0.4003 => 0.4270, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.66% (0.3601 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.65% (16.6129 => 17.7174, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.59% (0.3914 => 0.4172, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.58% (0.3192 => 0.3402, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3789 => 0.4037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3534 => 0.3765, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-4: 6.53% (0.3646 => 0.3884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.50% (1.9270 => 2.0522, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.47% (3.1889 => 3.3953, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 6.44% (0.3663 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.44% (0.3650 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.37% (0.3940 => 0.4191, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.30% (0.6744 => 0.7169, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.30% (1.3245 => 1.4079, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.16% (1.0594 => 1.1247, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1789 => 0.1899, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4113 => 0.4362, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (1.2749 => 1.3508, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.3819 => 1.4624, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.82% (14.8535 => 15.7183, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.82% (0.8698 => 0.9204, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.2859 => 0.3025, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.79% (0.6576 => 0.6957, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.6135 => 0.6490, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.77% (4.3801 => 4.6328, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (4.4433 => 4.6945, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.62% (1.3813 => 1.4589, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 5.61% (8.4961 => 8.9730, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.56% (1.1333 => 1.1963, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.2842 => 14.0170, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: 5.43% (0.3131 => 0.3301, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.34% (0.8818 => 0.9289, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.27% (0.2504 => 0.2636, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.25% (0.3755 => 0.3952, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.21% (14.5298 => 15.2868, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (6.5754 => 6.9049, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.88% (3.2742 => 3.4339, std.dev.: 0.0226) MultiSource/Applications/oggenc/oggenc: 4.74% (4.6629 => 4.8837, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.59% (4.9865 => 5.2153, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 4.49% (1.2292 => 1.2844, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.27% (0.6250 => 0.6517, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.22% (0.4805 => 0.5008, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.18% (0.9108 => 0.9489, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.10% (3.7467 => 3.9002, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.08% (1.5188 => 1.5808, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.01% (2.1007 => 2.1850, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2785 => 6.5064, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.32% (33.2944 => 34.3984, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5596, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.04% (1.0895 => 1.3623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.00% (1.8175 => 2.2718, std.dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.73% (1.1560 => 1.2569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (0.2093 => 0.2199, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.2619 => 11.6967, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (1.7081 => 1.7738, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.76% (12.0921 => 12.5462, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.18% (10.7476 => 11.0893, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6067, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5154, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5952, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.45% (0.4657 => 0.3891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.72% (0.2670 => 0.2544, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.42% (22.5627 => 21.7920, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.21% (1.0460 => 0.8555, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2967, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.74% (0.3458 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.86% (1.3780 => 1.2972, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8049, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1494, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5928, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.00% (0.6615 => 0.6483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2354, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7545, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1392, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (0.8342 => 0.8230, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.22% (4.1080 => 4.0579, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2259, std.dev.: 0.0176) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5641, std.dev.: 0.0138) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 4.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 14:59:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 16:59:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921215922.724C2352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4114?compare_to=4111&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4114, Order: 164407, Start Time: 2012-09-21 20:41:02, End Time: 2012-09-21 22:00:49 To: 4111, Order: 164397, Start Time: 2012-09-21 18:52:28, End Time: 2012-09-21 20:12:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (120 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (728 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.48% (80.8210 => 79.6249, std.dev.: 0.2915) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.04% (0.5712 => 0.5710, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: -0.01% (15.8950 => 15.8939, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 0.05% (14.7845 => 14.7916, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 0.01% (83.0384 => 83.0501, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 0.08% (4.3277 => 4.3313, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.21% (1.2235 => 1.2261, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (7.3886 => 7.3904, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.6710 => 3.6713, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.11% (0.6334 => 0.6341, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.46% (0.0684 => 0.0674, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.32% (63.2438 => 83.0501, std.dev.: 0.0089) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14278.33% (0.0720 => 10.3524, std.dev.: 0.0135) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.72% (10.3673 => 15.2112, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 26.76% (0.1622 => 0.2056, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.56% (2.2022 => 2.5228, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.15% (7.0540 => 8.0520, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2502, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.51% (1.7609 => 1.9460, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 9.99% (10.4361 => 11.4782, std.dev.: 0.0106) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3473 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.35% (0.3561 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.34% (0.3543 => 0.3874, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3543 => 0.3874, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.27% (0.3497 => 0.3821, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3828 => 0.4181, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.04% (0.3694 => 0.4028, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.01% (0.3927 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.93% (0.3282 => 0.3575, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.88% (0.3886 => 0.4231, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.53% (9.4845 => 10.1991, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4615 => 0.4945, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.05% (0.4879 => 0.5223, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.89% (0.7433 => 0.7945, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 6.85% (0.2554 => 0.2729, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.85% (0.2700 => 0.2885, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 6.82% (0.3109 => 0.3321, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 6.61% (0.7115 => 0.7585, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.48% (1.5415 => 1.6414, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3307 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.40% (0.3423 => 0.3642, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.39% (4.2646 => 4.5373, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.37% (0.5569 => 0.5924, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.31% (1.3050 => 1.3874, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 6.31% (3.3354 => 3.5458, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.28% (0.5860 => 0.6228, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.25% (0.6675 => 0.7092, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.21% (5.7591 => 6.1169, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.16% (8.1363 => 8.6377, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.06% (0.8067 => 0.8556, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.06% (0.8172 => 0.8667, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.05% (0.5105 => 0.5414, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.81% (5.0018 => 5.2926, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.80% (0.2758 => 0.2918, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3121 => 0.3302, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.9449 => 5.2298, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: 5.75% (0.3180 => 0.3363, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.71% (0.7835 => 0.8282, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.70% (0.9765 => 1.0322, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.60% (1.1642 => 1.2294, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.40% (1.1861 => 1.2501, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 5.33% (1.0722 => 1.1294, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.26% (0.2603 => 0.2740, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.26% (0.3387 => 0.3565, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.26% (3.8723 => 4.0758, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4299 => 0.4517, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.86% (0.6030 => 0.6323, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 4.85% (2.2969 => 2.4084, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 4.84% (0.5925 => 0.6212, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.84% (0.5020 => 0.5263, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.84% (7.9617 => 8.3469, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.83% (2.0273 => 2.1252, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 4.72% (21.9371 => 22.9719, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/football/football: 4.65% (0.8921 => 0.9336, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.56% (1.5603 => 1.6314, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6450 => 0.6738, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.39% (1.5859 => 1.6555, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.6456 => 0.6735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5981 => 0.6239, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.31% (1.4186 => 1.4797, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 3.99% (0.7326 => 0.7618, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.4103 => 0.4265, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.91% (14.3668 => 14.9279, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.4636 => 0.4816, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (2.2024 => 2.2871, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.70% (1.1840 => 1.2278, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (0.4064 => 0.4212, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.4289 => 0.4431, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.4203 => 0.4341, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 3.14% (0.4620 => 0.4765, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1207, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (0.8101 => 0.8305, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4710, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 1.55% (1.2842 => 1.3041, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.8922 => 3.9360, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.03% (3.1595 => 3.4132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3500, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2342, std.dev.: 0.0235) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7871, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2303, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.13% (5.3855 => 3.8704, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.71% (5.3526 => 3.8693, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0616, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.93% (2.9384 => 2.5879, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -8.24% (22.1758 => 20.3495, std.dev.: 0.0382) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3795, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2618, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4837, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (1.8329 => 1.7155, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5836, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.84% (5.0483 => 4.8042, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.01% (3.2827 => 3.1511, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5015, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4220, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0028, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.50% (1.2373 => 1.2064, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0198, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.20% (0.5229 => 0.5710, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 6.03% (14.9895 => 15.8939, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 4.50% (14.1553 => 14.7916, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 5.37% (4.1105 => 4.3313, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.98% (1.1048 => 1.2261, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.24% (7.1582 => 7.3904, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.02% (3.4629 => 3.6713, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.6222 => 0.6341, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 15:06:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 17:06:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120921220638.96BC2352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4115?compare_to=4109&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4115, Order: 164402, Start Time: 2012-09-21 19:24:16, End Time: 2012-09-21 22:08:05 To: 4109, Order: 164371, Start Time: 2012-09-21 16:11:45, End Time: 2012-09-21 18:55:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.24% (125.4263 => 129.4920, std.dev.: 0.9174) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3465 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.52% (0.3469 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.50% (0.3446 => 0.3808, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.49% (0.3488 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.46% (0.3460 => 0.3822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.44% (0.3496 => 0.3861, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/trivial-interface: 10.43% (0.3442 => 0.3801, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.19% (0.3650 => 0.4022, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.10% (0.3643 => 0.4011, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 9.94% (0.3724 => 0.4094, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.64% (1.5932 => 1.7308, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.95% (1.6211 => 1.7338, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.93% (0.4361 => 0.4663, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.50% (5.5417 => 5.9020, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.48% (1.3152 => 1.4004, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.38% (3.5627 => 3.7899, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (0.5026 => 0.5346, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.5889 => 0.6245, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.02% (2.7292 => 2.8936, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.91% (0.4994 => 0.5289, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.88% (0.5000 => 0.5294, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 5.87% (1.0781 => 1.1414, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (0.3930 => 0.4159, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.66% (4.2109 => 4.4493, std.dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 5.65% (0.2566 => 0.2711, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.61% (0.4029 => 0.4255, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2875 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3195 => 0.3370, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.46% (4.4195 => 4.6606, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 5.43% (0.6634 => 0.6994, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 5.40% (23.5202 => 24.7895, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 5.36% (2.1013 => 2.2140, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.31% (4.6177 => 4.8629, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 5.27% (1.8794 => 1.9785, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (0.3890 => 0.4095, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.3271 => 0.3443, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.1968 => 0.2071, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.3004 => 0.3161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.2866 => 0.3015, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (2.1653 => 2.2762, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2813 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (2.0673 => 2.1718, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.05% (0.2750 => 0.2889, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2738 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.03% (0.2803 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.3903 => 0.4099, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2911 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.01% (0.2792 => 0.2932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3267 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.3096 => 0.3250, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.97% (1.4269 => 1.4978, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.97% (0.9909 => 1.0401, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 4.96% (0.7171 => 0.7527, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.95% (0.2729 => 0.2864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.94% (0.2811 => 0.2950, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 4.94% (0.3258 => 0.3419, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3060 => 0.3210, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.5900 => 0.6188, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (0.4658 => 0.4885, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3362 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3124 => 0.3274, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.80% (0.5546 => 0.5812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3317 => 0.3476, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (0.4139 => 0.4336, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.75% (0.3348 => 0.3507, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3625 => 0.3797, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.70% (2.0346 => 2.1302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.70% (0.3726 => 0.3901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.69% (0.3477 => 0.3640, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.65% (0.7875 => 0.8241, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.61% (0.4251 => 0.4447, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.3084 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.3678 => 0.3847, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.51% (0.9697 => 1.0134, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 4.49% (0.4146 => 0.4332, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.44% (0.3336 => 0.3484, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3690 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.41% (1.9694 => 2.0563, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (1.9966 => 2.0844, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.2969 => 0.3096, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (0.2691 => 0.2806, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 4.25% (0.5012 => 0.5225, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.25% (0.3981 => 0.4150, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.20% (0.6435 => 0.6705, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (0.7426 => 0.7733, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.11% (0.3845 => 0.4003, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.02% (0.2737 => 0.2847, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 3.96% (0.4847 => 0.5039, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.81% (0.5584 => 0.5797, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (0.5361 => 0.5563, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.25% (11.6398 => 12.0178, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (4.6926 => 4.8201, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.47% (0.4253 => 0.4358, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.17% (11.9555 => 12.0956, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.2122 => 0.2269, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6723, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6449, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2133, std.dev.: 0.0295) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4436, std.dev.: 0.0180) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5924, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5436, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9736, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8068, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0038) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7915, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: -2.92% (17.2379 => 16.7353, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5765, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9559, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 15:20:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 17:20:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921222012.B06F7352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4116?compare_to=4112&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4116, Order: 164412, Start Time: 2012-09-21 21:10:41, End Time: 2012-09-21 22:21:41 To: 4112, Order: 164402, Start Time: 2012-09-21 19:43:17, End Time: 2012-09-21 20:54:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 14 (50 on baseline) Performance Improvements: 3 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 883 (803 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2784 => 0.2916, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2700 => 0.2828, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.61% (0.5934 => 0.6089, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1735 => 1.1994, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.4028 => 1.4335, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.84% (1.1666 => 1.1881, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 1.28% (13.5300 => 13.7035, std.dev.: 0.0535) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8180 => 14.9990, std.dev.: 0.0547) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.73% (0.7613 => 0.7897, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.57% (2.6808 => 2.7498, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 2.04% (2.3480 => 2.3959, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.13% (1.7079 => 1.7272, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.10% (13.2897 => 13.4362, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/fp-convert: 1.05% (15.7408 => 15.9068, std.dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -2.74% (4.4328 => 4.3115, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: -2.30% (1.0512 => 1.0270, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -1.87% (0.6103 => 0.5989, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.79% (0.9865 => 1.0042, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 0.41% (0.6030 => 0.6055, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: -1.50% (0.1664 => 0.1639, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.66% (0.1579 => 0.1537, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.71% (0.3040 => 0.3092, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.56% (0.2302 => 0.2315, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.66% (0.3164 => 0.3185, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.25% (0.2248 => 0.2276, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -1.60% (0.0437 => 0.0430, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: 190.00% (0.0030 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -6.82% (0.0088 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 42.94% (0.0163 => 0.0233, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 40.58% (0.0138 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.75% (0.0349 => 0.0390, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.35% (0.0297 => 0.0301, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.43% (0.0280 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.94% (0.0320 => 0.0285, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: 1.70% (0.0176 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.58% (0.0190 => 0.0193, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 9.73% (0.0226 => 0.0248, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -11.75% (0.0315 => 0.0278, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1460 => 0.1455, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 6.26% (1.4184 => 1.5072, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.65% (0.1454 => 0.1430, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.46% (0.4193 => 0.4090, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.76% (0.1423 => 0.1398, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.0613 => 0.0575, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.00% (0.0200 => 0.0206, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.35% (0.0594 => 0.0602, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1264 => 1.1264, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0012 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.29% (0.0542 => 0.0549, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.71% (0.0161 => 0.0204, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7655 => 0.7652, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.02% (1.5975 => 1.5978, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.56% (4.1772 => 3.0678, std.dev.: 0.0609) SingleSource/Benchmarks/Shootout-C++/except: 82766.67% (0.0006 => 0.4972, std.dev.: 0.0059) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.00% (0.6410 => 0.6859, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.5309 => 0.5607, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 5.60% (2.1763 => 2.2982, std.dev.: 0.0090) MultiSource/Applications/lemon/lemon: 5.49% (1.0046 => 1.0598, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 5.44% (0.6173 => 0.6509, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 4.36% (15.3105 => 15.9783, std.dev.: 0.2331) MultiSource/Applications/SIBsim4/SIBsim4: 4.08% (1.1653 => 1.2129, std.dev.: 0.0134) MultiSource/Applications/Burg/burg: 3.85% (1.1440 => 1.1881, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.6915 => 0.7148, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: 3.27% (3.0225 => 3.1213, std.dev.: 0.0258) MultiSource/Applications/SPASS/SPASS: 2.85% (13.3238 => 13.7035, std.dev.: 0.0535) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1672 => 1.1994, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.56% (0.5937 => 0.6089, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.27% (29.3170 => 29.9828, std.dev.: 0.2531) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.7639 => 0.7797, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.92% (14.6079 => 14.8883, std.dev.: 0.0593) MultiSource/Applications/JM/lencod/lencod: 1.86% (14.7256 => 14.9990, std.dev.: 0.0547) MultiSource/Applications/JM/ldecod/ldecod: 1.86% (6.4908 => 6.6113, std.dev.: 0.0462) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (1.4189 => 1.4335, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std.dev.: 0.0523) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.41% (0.0766 => 0.0907, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 15.01% (1.7426 => 2.0041, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.77% (4.0101 => 4.5622, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.12% (0.0917 => 0.1019, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 11.04% (1.6261 => 1.8056, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 9.26% (7.0025 => 7.6507, std.dev.: 0.0632) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.14% (1.0063 => 1.0882, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Puzzle: 7.75% (0.1433 => 0.1544, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.35% (0.2694 => 0.2892, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: 4.48% (15.2242 => 15.9068, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/ReedSolomon: 4.15% (8.5113 => 8.8643, std.dev.: 0.0578) SingleSource/Benchmarks/Misc/dt: 3.93% (0.9851 => 1.0238, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.78% (0.7609 => 0.7897, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.16% (2.6656 => 2.7498, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.6308 => 0.6488, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8967, std.dev.: 0.0668) MultiSource/Benchmarks/sim/sim: 2.79% (3.8907 => 3.9993, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 2.65% (3.5520 => 3.6462, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.34% (4.2129 => 4.3115, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: 2.16% (2.3453 => 2.3959, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4491, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: 1.42% (1.4184 => 1.4386, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 1.12% (4.3016 => 4.3496, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.12% (0.3497 => 0.2094, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.03% (5.2665 => 4.1590, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ary3: -20.55% (1.7473 => 1.3883, std.dev.: 0.0332) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.57% (1.1647 => 0.9601, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.13% (15.8312 => 13.4362, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1644, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: -11.77% (0.3746 => 0.3305, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9395, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3747, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -6.42% (4.6355 => 4.3380, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -6.33% (7.6833 => 7.1968, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7922, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -6.06% (1.4441 => 1.3566, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: -6.04% (0.2664 => 0.2503, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9479, std.dev.: 0.1171) MultiSource/Applications/SIBsim4/SIBsim4: -5.52% (3.4230 => 3.2341, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/fib2: -5.17% (4.4195 => 4.1912, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.18% (0.4564 => 0.4373, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.29% (45.4683 => 43.9702, std.dev.: 0.5450) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.16% (3.7496 => 3.6310, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.04% (0.4140 => 0.4014, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -3.02% (9.2503 => 8.9711, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2896, std.dev.: 0.0112) MultiSource/Benchmarks/PAQ8p/paq8p: -2.18% (92.7467 => 90.7287, std.dev.: 0.1767) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4204, std.dev.: 0.0087) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3649, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.81% (2.3569 => 2.3143, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2218, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -1.16% (2.4971 => 2.4681, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (25.6658 => 25.3754, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: -1.03% (16.5617 => 16.3919, std.dev.: 0.0424) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.62% (0.9980 => 1.0042, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 0.55% (0.6022 => 0.6055, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: -1.62% (0.1666 => 0.1639, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.09% (0.1554 => 0.1537, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3083 => 0.3092, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.30% (0.2394 => 0.2315, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.31% (0.3175 => 0.3185, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.13% (0.2302 => 0.2276, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -4.23% (0.0449 => 0.0430, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -8.89% (0.0090 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.92% (0.0240 => 0.0233, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.04% (0.0324 => 0.0285, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -14.46% (0.0325 => 0.0278, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 0.35% (1.5019 => 1.5072, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.73% (0.1501 => 0.1430, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.08% (0.4264 => 0.4090, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1344 => 0.1398, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.38% (0.0589 => 0.0575, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.21% (0.0232 => 0.0206, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.79% (0.0639 => 0.0602, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.1350 => 1.1264, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.81% (0.0637 => 0.0549, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (0.0246 => 0.0204, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.00% (1.5363 => 1.5978, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 16:19:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 18:19:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120921231939.D93CD352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4117?compare_to=4113&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4117, Order: 164415, Start Time: 2012-09-21 22:06:37, End Time: 2012-09-21 23:21:04 To: 4113, Order: 164407, Start Time: 2012-09-21 20:23:35, End Time: 2012-09-21 21:37:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 6 (172 on baseline) Performance Improvements: 2 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 962 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.75% (0.6957 => 0.7079, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.43% (0.3225 => 0.3626) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.63% (8.5928 => 8.9044, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.2928 => 2.3234, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (27.7545 => 28.0534, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.04% (1.5792 => 1.5957, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -2.57% (12.5462 => 12.2242, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -2.25% (0.5456 => 0.5333, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.96% (2.0176 => 2.4204, std.dev.: 0.0123) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.67% (0.1410 => 0.1631, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.63% (0.1072 => 0.1186, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.47% (0.1413 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.88% (3.9660 => 4.3577, std.dev.: 0.0148) MultiSource/Applications/hbd/hbd: 9.63% (1.3693 => 1.5012, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.51% (0.2596 => 0.2843, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 9.49% (0.7038 => 0.7706, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7061 => 0.7726, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.40% (0.4328 => 0.4735, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.39% (0.7710 => 0.8434, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.23% (1.2193 => 1.3318, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.15% (0.2721 => 0.2970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.12% (0.1327 => 0.1448, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.08% (0.5265 => 0.5743, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.03% (0.4062 => 0.4429, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.95% (0.9199 => 1.0022, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.86% (1.1364 => 1.2371, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.77% (0.6283 => 0.6834, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.70% (1.4563 => 1.5830, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 8.60% (13.8202 => 15.0094, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.41% (0.3899 => 0.4227, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.31% (1.0313 => 1.1170, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: 8.31% (0.2781 => 0.3012, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.31% (0.3022 => 0.3273, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.09% (0.3485 => 0.3767, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.06% (0.4791 => 0.5177, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.97% (0.4390 => 0.4740, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.96% (0.5577 => 0.6021, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.96% (0.3756 => 0.4055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.92% (0.3246 => 0.3503, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.87% (0.1435 => 0.1548, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.85% (0.2995 => 0.3230, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.83% (0.4379 => 0.4722, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.82% (0.3489 => 0.3762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2726 => 0.2939, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2127 => 0.2293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3580 => 0.3859, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.74% (0.3293 => 0.3548, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.69% (0.4016 => 0.4325, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.65% (0.6576 => 0.7079, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.62% (0.2690 => 0.2895, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.61% (1.9828 => 2.1337, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.61% (0.2655 => 0.2857, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2765 => 0.2975, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.59% (0.8310 => 0.8941, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2966 => 0.3191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.57% (0.2761 => 0.2970, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (7.2180 => 7.7638, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3149 => 0.3387, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2607 => 0.2804, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.55% (1.1061 => 1.1896, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 7.53% (0.3107 => 0.3341, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.47% (3.6692 => 3.9433, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 7.43% (0.2988 => 0.3210, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.39% (0.3192 => 0.3428, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 7.38% (3.8646 => 4.1500, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.38% (0.5637 => 0.6053, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.38% (0.2914 => 0.3129, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.36% (0.3220 => 0.3457, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.3868 => 0.4152, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2696 => 0.2892, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.22% (0.2243 => 0.2405, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 7.21% (0.3453 => 0.3702, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.18% (3.1889 => 3.4180, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 7.06% (16.6129 => 17.7858, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: 7.03% (0.7506 => 0.8034, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.99% (1.0594 => 1.1335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.99% (0.3534 => 0.3781, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.97% (2.1791 => 2.3310, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.85% (0.6744 => 0.7206, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (0.7460 => 0.7970, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 6.77% (1.9270 => 2.0575, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.72% (0.2023 => 0.2159, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1865 => 0.1990, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.60% (1.2749 => 1.3591, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.58% (1.3245 => 1.4116, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 6.54% (0.2859 => 0.3046, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 6.52% (0.1657 => 0.1765, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.47% (0.8698 => 0.9261, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.47% (14.8535 => 15.8142, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 6.35% (8.4961 => 9.0360, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.34% (0.3578 => 0.3805, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.32% (0.1789 => 0.1902, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.23% (0.3646 => 0.3873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.4003 => 0.4251, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.12% (1.3819 => 1.4665, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.10% (13.2842 => 14.0951, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.08% (4.3801 => 4.6465, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions: 6.08% (0.3914 => 0.4152, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 6.07% (0.3131 => 0.3321, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.03% (4.4433 => 4.7112, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (1.3813 => 1.4642, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.6135 => 0.6503, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.98% (0.8818 => 0.9345, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 5.97% (0.3601 => 0.3816, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (1.1333 => 1.2007, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.95% (0.3650 => 0.3867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.3755 => 0.3978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.89% (0.3940 => 0.4172, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.80% (14.5298 => 15.3721, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.67% (0.2504 => 0.2646, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.65% (0.2140 => 0.2261, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.65% (6.5754 => 6.9468, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.59% (4.6629 => 4.9236, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3245 => 0.3423, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.43% (3.2742 => 3.4519, std.dev.: 0.0151) MultiSource/Applications/hexxagon/hexxagon: 5.04% (1.2292 => 1.2911, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.03% (4.9865 => 5.2373, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.87% (0.9108 => 0.9552, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.79% (0.4805 => 0.5035, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 4.77% (0.6250 => 0.6548, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.75% (1.5188 => 1.5910, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.43% (6.2785 => 6.5567, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 4.41% (3.7467 => 3.9119, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.39% (2.1007 => 2.1929, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.76% (0.3511 => 0.3643, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.58% (33.2944 => 34.4880, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 2.58% (16.2614 => 16.6806, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2723, std.dev.: 0.0451) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4122, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7243, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1132, std.dev.: 0.0573) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 1.95% (7.4271 => 7.5718, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5848, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2242, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.83% (22.5627 => 21.9241, std.dev.: 0.0226) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.28% (20.3410 => 18.2499, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.32% (1.3780 => 1.3047, std.dev.: 0.0177) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0224) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9208, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9459, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2468, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1214, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std.dev.: 0.0335) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.12% (2.5254 => 2.4970, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4344, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2553, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 16:48:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 18:48:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120921234804.C51C1352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4118?compare_to=4114&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4118, Order: 164415, Start Time: 2012-09-21 22:29:29, End Time: 2012-09-21 23:49:24 To: 4114, Order: 164407, Start Time: 2012-09-21 20:41:02, End Time: 2012-09-21 22:00:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (146 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.13% (1.3041 => 1.3188, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (15.2112 => 15.3742, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.40% (0.3226 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.55% (1.7052 => 1.7657, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 1.08% (3.4132 => 3.4500, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -2.48% (12.5618 => 12.2500, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5710 => 0.5718, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.36% (15.8939 => 15.9510, std.dev.: 0.0211) MultiSource/Applications/kimwitu++/kc: 0.57% (14.7916 => 14.8761, std.dev.: 0.0183) MultiSource/Benchmarks/Bullet/bullet: -0.52% (83.0501 => 82.6220, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/gs/gs: -0.09% (4.3313 => 4.3272, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.33% (1.2261 => 1.2302, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.53% (7.3904 => 7.4298, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.47% (3.6713 => 3.6884, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.95% (0.6341 => 0.6401, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.01% (0.0674 => 0.0647, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.64% (63.2438 => 82.6220, std.dev.: 0.0232) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14231.39% (0.0720 => 10.3186, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.30% (10.3673 => 15.3742, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 26.57% (0.1622 => 0.2053, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.17% (2.2022 => 2.5142, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.80% (7.0540 => 8.0278, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.98% (1.7609 => 1.9543, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.33% (10.4361 => 11.5140, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.45% (0.1143 => 0.1251, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.81% (0.3543 => 0.3855, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3473 => 0.3776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.55% (0.3543 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.51% (0.3561 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.48% (0.3516 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3694 => 0.4004, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.36% (0.3828 => 0.4148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.35% (0.3927 => 0.4255, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.13% (0.3886 => 0.4202, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.58% (9.4845 => 10.2030, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.47% (0.7433 => 0.7988, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.4879 => 0.5238, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.14% (0.3307 => 0.3543, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.80% (0.7115 => 0.7599, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.75% (0.3109 => 0.3319, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.71% (0.6675 => 0.7123, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.65% (5.7591 => 6.1422, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3423 => 0.3645, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5105 => 0.5435, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.5860 => 0.6236, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (1.3050 => 1.3885, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.33% (4.2646 => 4.5345, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.31% (1.5415 => 1.6387, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.30% (3.3354 => 3.5455, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (8.1363 => 8.6470, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2271 => 0.2413, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.24% (0.8067 => 0.8570, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.11% (0.5569 => 0.5909, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.02% (0.7835 => 0.8307, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.94% (5.0018 => 5.2987, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.93% (0.8172 => 0.8657, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (0.3092 => 0.3275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.90% (0.9765 => 1.0341, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.75% (0.6030 => 0.6377, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.74% (4.9449 => 5.2285, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3441 => 0.3637, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.67% (1.1642 => 1.2302, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5925 => 0.6260, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3121 => 0.3295, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 5.51% (1.0722 => 1.1313, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (1.1861 => 1.2507, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.39% (3.8723 => 4.0810, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 5.31% (0.3180 => 0.3349, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 5.31% (0.3387 => 0.3567, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.29% (1.5603 => 1.6429, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.26% (0.2603 => 0.2740, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.24% (0.5020 => 0.5283, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4636 => 0.4878, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 5.14% (0.3422 => 0.3598, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.12% (0.4103 => 0.4313, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.10% (2.2969 => 2.4140, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 5.09% (2.0273 => 2.1304, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (7.9617 => 8.3648, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 5.03% (0.6456 => 0.6781, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.98% (0.4299 => 0.4513, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7326 => 0.7687, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.4064 => 0.4258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.71% (0.3865 => 0.4047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8921 => 0.9341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.69% (0.4289 => 0.4490, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.65% (21.9371 => 22.9564, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.64% (0.6450 => 0.6749, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.57% (1.5859 => 1.6583, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3826 => 0.3998, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.45% (0.4203 => 0.4390, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.2831 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.33% (0.3232 => 0.3372, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.29% (0.3283 => 0.3424, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4620 => 0.4817, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.24% (0.3935 => 0.4102, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.5981 => 0.6233, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.20% (0.4048 => 0.4218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.14% (0.3162 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (14.3668 => 14.9605, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.4186 => 1.4772, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.3136 => 0.3265, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.2024 => 2.2926, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.07% (0.3098 => 0.3224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.06% (0.2756 => 0.2868, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3603 => 0.3749, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.03% (0.3052 => 0.3175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0665 => 2.1491, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/methcall: 3.93% (0.2877 => 0.2990, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3684 => 0.3826, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2802 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3379 => 0.3507, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.67% (1.1840 => 1.2274, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.69% (1.2842 => 1.3188, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.58% (0.8101 => 0.8310, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4815, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.8922 => 3.9528, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: 6.71% (1.1396 => 1.2161, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.38% (3.6395 => 3.7624, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3503, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.50% (9.1159 => 9.2524, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5822, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.00% (2.6546 => 2.6812, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.36% (5.2763 => 3.2522, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.98% (5.3855 => 3.8784, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.66% (5.3526 => 3.8723, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1597, std.dev.: 0.0400) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.76% (2.9384 => 2.5927, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -8.09% (22.1758 => 20.3817, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2820, std.dev.: 0.0730) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5970, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1656, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4943, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.82% (1.3677 => 1.3291, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -2.22% (1.2373 => 1.2098, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9864, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5044, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0912, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2500, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5074, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2296, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0172) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.35% (0.5229 => 0.5718, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.41% (14.9895 => 15.9510, std.dev.: 0.0211) MultiSource/Applications/kimwitu++/kc: 5.09% (14.1553 => 14.8761, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: 5.27% (4.1105 => 4.3272, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.35% (1.1048 => 1.2302, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.79% (7.1582 => 7.4298, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.51% (3.4629 => 3.6884, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.88% (0.6222 => 0.6401, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 16:57:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 18:57:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120921235744.C3E72352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4119?compare_to=4116&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4119, Order: 164421, Start Time: 2012-09-21 22:47:23, End Time: 2012-09-21 23:59:12 To: 4116, Order: 164412, Start Time: 2012-09-21 21:10:41, End Time: 2012-09-21 22:21:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (56 on baseline) Performance Improvements: 3 (36 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 889 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.0994 => 0.1100, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.47% (15.9783 => 16.3733, std.dev.: 0.1397) MultiSource/Applications/siod/siod: 2.31% (2.1254 => 2.1745, std.dev.: 0.0149) MultiSource/Applications/spiff/spiff: 2.24% (0.7491 => 0.7659, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 2.12% (1.2129 => 1.2386, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.31% (0.3372 => 0.3551, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.32% (1.8318 => 1.8560, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.13% (4.6443 => 4.6969, std.dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.02% (0.6089 => 0.5905, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.33% (1.4367 => 1.4176, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.55% (1.4140 => 1.3779, std.dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.13% (1.0042 => 0.9929, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 0.83% (0.6055 => 0.6105, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: -1.46% (0.1639 => 0.1615, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.69% (0.1537 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.74% (0.3092 => 0.3115, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.04% (0.2315 => 0.2339, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (0.3185 => 0.3152, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.41% (0.2276 => 0.2244, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -7.91% (0.0430 => 0.0396, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 8.54% (0.0082 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.58% (0.0233 => 0.0239, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.55% (0.0194 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.37% (0.0284 => 0.0229, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.98% (0.0285 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -26.82% (0.0179 => 0.0131, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -22.80% (0.0193 => 0.0149, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -0.81% (0.0248 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -2.52% (0.0278 => 0.0271, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1455 => 0.1458, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -7.63% (1.5072 => 1.3922, std.dev.: 0.0632) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1430 => 0.1432, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.23% (0.4090 => 0.4222, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.00% (0.1398 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.65% (0.0575 => 0.0531, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.25% (0.0206 => 0.0189, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.66% (0.0602 => 0.0592, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.13% (0.0047 => 0.0046, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.94% (1.1264 => 1.1370, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.25% (0.0016 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.36% (0.0549 => 0.0551, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.16% (0.0204 => 0.0169, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7652 => 0.7649, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.11% (1.5978 => 1.5996, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -82.38% (0.0261 => 0.0046, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.77% (4.1772 => 3.0589, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/except: 82966.67% (0.0006 => 0.4984, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.33% (0.0745 => 0.0889, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 6.94% (15.3105 => 16.3733, std.dev.: 0.1397) SingleSource/Benchmarks/Misc-C++/bigfib: 6.55% (0.5309 => 0.5657, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.51% (1.0046 => 1.0700, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.33% (0.6410 => 0.6816, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (1.1653 => 1.2386, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 5.96% (2.1763 => 2.3060, std.dev.: 0.0346) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.11% (0.3582 => 0.3765, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 4.96% (0.6915 => 0.7258, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 4.73% (0.6173 => 0.6465, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.2552 => 0.2652, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.79% (4.7455 => 4.9254, std.dev.: 0.0361) MultiSource/Applications/siod/siod: 3.69% (2.0972 => 2.1745, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.67% (0.4248 => 0.4404, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 3.46% (3.0225 => 3.1271, std.dev.: 0.0240) MultiSource/Applications/SPASS/SPASS: 2.87% (13.3238 => 13.7065, std.dev.: 0.0994) MultiSource/Applications/Burg/burg: 2.66% (1.1440 => 1.1744, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5150 => 1.5514, std.dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: 2.36% (8.9977 => 9.2102, std.dev.: 0.0744) MultiSource/Benchmarks/Bullet/bullet: 2.28% (29.3170 => 29.9855, std.dev.: 0.0992) MultiSource/Applications/JM/ldecod/ldecod: 2.08% (6.4908 => 6.6261, std.dev.: 0.0428) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (12.6413 => 12.8809, std.dev.: 0.0760) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6069 => 0.6180, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.77% (0.7226 => 0.7354, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.75% (1.8798 => 1.9127, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 1.62% (14.6079 => 14.8450, std.dev.: 0.0716) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (8.2186 => 8.3462, std.dev.: 0.0232) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2546 => 6.3386, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5462, std.dev.: 0.1450) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8070, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Puzzle: 10.19% (0.1433 => 0.1579, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6054, std.dev.: 0.0489) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.17% (0.2694 => 0.2914, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.57% (0.3301 => 0.3551, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.20% (1.0063 => 1.0788, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8293, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: 3.86% (0.9851 => 1.0231, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8731, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 3.01% (3.5520 => 3.6589, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.95% (14.4877 => 14.9154, std.dev.: 0.0485) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.6308 => 0.6465, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 2.33% (8.5113 => 8.7096, std.dev.: 0.0760) SingleSource/Benchmarks/Misc/whetstone: 1.98% (2.3453 => 2.3918, std.dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.83% (4.6127 => 4.6969, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/power/power: 1.30% (1.4184 => 1.4368, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4455 => 2.4749, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.04% (27.1724 => 27.4559, std.dev.: 0.1008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.00% (0.2080 => 0.1872, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.21% (0.3497 => 0.2056, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.20% (5.2665 => 4.0976, std.dev.: 0.2003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.30% (1.1647 => 0.9632, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.95% (15.8312 => 13.1486, std.dev.: 0.1671) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0221) MultiSource/Applications/sgefa/sgefa: -11.27% (0.3746 => 0.3324, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.21% (1.4034 => 1.2882, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.74% (3.2007 => 2.9529, std.dev.: 0.0810) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (4.6355 => 4.3247, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8729, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3520, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -6.37% (7.6833 => 7.1936, std.dev.: 0.0526) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9247, std.dev.: 0.0950) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1872, std.dev.: 0.0181) MultiSource/Applications/SIBsim4/SIBsim4: -4.81% (3.4230 => 3.2582, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.4140 => 0.3980, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -3.85% (9.2503 => 8.8941, std.dev.: 0.0386) SingleSource/Benchmarks/McGill/misr: -3.45% (0.4296 => 0.4148, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0321) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: -2.39% (1.4117 => 1.3779, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4221, std.dev.: 0.0197) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3665, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.75% (1.0686 => 1.0499, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.71% (2.3569 => 2.3167, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -1.47% (2.4971 => 2.4603, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std.dev.: 0.1172) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.18% (2.8964 => 2.8622, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.16% (2.4457 => 2.4174, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: -1.11% (16.5617 => 16.3781, std.dev.: 0.0316) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.51% (0.9980 => 0.9929, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 1.38% (0.6022 => 0.6105, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: -3.06% (0.1666 => 0.1615, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (0.3083 => 0.3115, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.30% (0.2394 => 0.2339, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.72% (0.3175 => 0.3152, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.52% (0.2302 => 0.2244, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -11.80% (0.0449 => 0.0396, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.37% (0.0284 => 0.0229, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -25.99% (0.0177 => 0.0131, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -21.16% (0.0189 => 0.0149, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -16.62% (0.0325 => 0.0271, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -7.30% (1.5019 => 1.3922, std.dev.: 0.0632) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.60% (0.1501 => 0.1432, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.98% (0.4264 => 0.4222, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.85% (0.0589 => 0.0531, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.53% (0.0232 => 0.0189, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.36% (0.0639 => 0.0592, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1350 => 1.1370, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.50% (0.0637 => 0.0551, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (0.0246 => 0.0169, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.12% (1.5363 => 1.5996, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 18:02:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 20:02:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922010246.B25CA352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4120?compare_to=4117&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4120, Order: 164426, Start Time: 2012-09-21 23:49:35, End Time: 2012-09-22 01:04:12 To: 4117, Order: 164415, Start Time: 2012-09-21 22:06:37, End Time: 2012-09-21 23:21:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (174 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (700 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.68% (55.2511 => 56.1804, std.dev.: 0.1516) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.56% (2.0176 => 2.4123, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.89% (0.1410 => 0.1634, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.50% (0.1072 => 0.1206, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.27% (0.1013 => 0.1117, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.00% (0.7710 => 0.8481, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.99% (3.9660 => 4.3621, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 9.96% (0.4328 => 0.4759, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.82% (0.1588 => 0.1744, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.63% (0.2596 => 0.2846, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 9.60% (1.3693 => 1.5007, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 9.58% (0.7038 => 0.7712, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 9.55% (0.7061 => 0.7735, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.28% (0.2781 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.17% (0.5265 => 0.5748, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.17% (1.2193 => 1.3311, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.11% (0.9199 => 1.0037, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.05% (0.3899 => 0.4252, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.03% (0.4062 => 0.4429, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.01% (0.6959 => 0.7586, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.86% (0.2721 => 0.2962, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.85% (13.8202 => 15.0437, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.84% (0.2782 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.80% (0.3022 => 0.3288, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.76% (1.1364 => 1.2359, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 8.69% (0.2726 => 0.2963, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.68% (1.4563 => 1.5827, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 8.66% (0.2760 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.64% (0.3485 => 0.3786, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.59% (0.6283 => 0.6823, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.55% (0.3580 => 0.3886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.51% (0.3489 => 0.3786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.48% (0.2607 => 0.2828, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.44% (0.3756 => 0.4073, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.44% (1.9828 => 2.1501, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 8.40% (0.3107 => 0.3368, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2765 => 0.2997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.37% (0.4016 => 0.4352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.36% (0.2690 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.36% (0.2655 => 0.2877, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.36% (0.2966 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.35% (0.3149 => 0.3412, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.2988 => 0.3237, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: 8.32% (0.3293 => 0.3567, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.31% (0.1589 => 0.1721, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.27% (0.2937 => 0.3180, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.26% (0.2761 => 0.2989, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2628 => 0.2845, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.16% (1.0313 => 1.1155, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5577 => 0.6028, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.02% (0.4791 => 0.5175, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.99% (0.4379 => 0.4729, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.97% (0.2696 => 0.2911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.96% (0.3868 => 0.4176, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.94% (0.3453 => 0.3727, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.90% (0.2127 => 0.2295, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.88% (1.1061 => 1.1933, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 7.88% (0.2995 => 0.3231, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.80% (0.3192 => 0.3441, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.75% (0.3534 => 0.3808, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4390 => 0.4728, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 7.60% (3.8646 => 4.1584, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (7.2180 => 7.7636, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 7.52% (16.6129 => 17.8627, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.48% (0.3220 => 0.3461, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.45% (0.2914 => 0.3131, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.38% (0.7506 => 0.8060, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.38% (0.5637 => 0.6053, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.29% (0.8310 => 0.8916, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.25% (3.6692 => 3.9353, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 7.21% (0.2925 => 0.3136, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.14% (0.7460 => 0.7993, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 7.12% (2.1791 => 2.3343, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 7.05% (0.3914 => 0.4190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.03% (0.2945 => 0.3152, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3646 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.94% (0.4003 => 0.4281, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.91% (3.1889 => 3.4093, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3789 => 0.4047, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.79% (0.6744 => 0.7202, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 6.79% (1.9270 => 2.0578, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.75% (0.6576 => 0.7020, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.75% (0.3940 => 0.4206, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.75% (0.8698 => 0.9285, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.72% (1.3245 => 1.4135, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.67% (1.0594 => 1.1301, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.52% (0.3755 => 0.4000, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (1.2749 => 1.3564, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.25% (0.4113 => 0.4370, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.16% (4.4433 => 4.7172, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.16% (4.3801 => 4.6500, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 6.14% (14.8535 => 15.7651, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 6.13% (8.4961 => 9.0173, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 6.12% (0.2859 => 0.3034, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.03% (0.6135 => 0.6505, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.01% (1.3813 => 1.4643, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.98% (0.3245 => 0.3439, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.85% (1.1333 => 1.1996, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (1.3819 => 1.4627, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (13.2842 => 14.0568, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.76% (0.8818 => 0.9326, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.72% (0.3131 => 0.3310, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.52% (1.2292 => 1.2971, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.48% (14.5298 => 15.3261, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2504 => 0.2641, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (6.5754 => 6.9285, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 5.36% (4.6629 => 4.9129, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 5.12% (0.6250 => 0.6570, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.10% (3.2742 => 3.4411, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.06% (4.9865 => 5.2390, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.89% (0.4805 => 0.5040, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.78% (0.9108 => 0.9543, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.67% (1.5188 => 1.5898, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.42% (2.1007 => 2.1936, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.42% (3.7467 => 3.9122, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.35% (6.2785 => 6.5516, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 3.56% (33.2944 => 34.4801, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 2.22% (16.2614 => 16.6219, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4117, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.03% (1.2998 => 1.3782, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7249, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.53% (10.7476 => 11.1267, std.dev.: 0.0407) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5930, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5844, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5950, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2237, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.96% (22.5627 => 21.8953, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2818, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0046) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5110, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0263) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.23% (0.4867 => 0.4710, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.82% (1.9762 => 1.9204, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9445, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2380, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1598, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2242, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2529, std.dev.: 0.0198) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 18:18:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 20:18:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922011837.0E856352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4121?compare_to=4115&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4121, Order: 164415, Start Time: 2012-09-21 22:36:38, End Time: 2012-09-22 01:20:03 To: 4115, Order: 164402, Start Time: 2012-09-21 19:24:16, End Time: 2012-09-21 22:08:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.54% (0.2149 => 0.2268, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3465 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.35% (0.3488 => 0.3849, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 10.33% (0.3446 => 0.3802, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.30% (0.3496 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.29% (0.3469 => 0.3826, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3442 => 0.3796, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.26% (0.3460 => 0.3815, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 10.03% (0.3650 => 0.4016, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.99% (0.3643 => 0.4007, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3724 => 0.4091, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 8.69% (1.5932 => 1.7316, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (1.6211 => 1.7280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.47% (0.4361 => 0.4643, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.37% (1.3152 => 1.3990, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 6.33% (5.5417 => 5.8923, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5826 => 0.6192, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.18% (0.5889 => 0.6253, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (3.5627 => 3.7826, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.08% (2.7292 => 2.8952, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 5.91% (1.0781 => 1.1418, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (0.4994 => 0.5283, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (0.5026 => 0.5310, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.50% (0.5000 => 0.5275, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.49% (0.2566 => 0.2707, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.49% (0.3004 => 0.3169, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 5.47% (4.2109 => 4.4414, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2875 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.2736 => 0.2882, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.32% (0.3195 => 0.3365, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.25% (2.1013 => 2.2116, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 5.23% (0.9909 => 1.0427, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.21% (4.6177 => 4.8582, std.dev.: 0.0143) MultiSource/Applications/siod/siod: 5.20% (0.6634 => 0.6979, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (4.4195 => 4.6480, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 5.16% (0.2750 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.14% (0.2780 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (2.0673 => 2.1731, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (0.2040 => 0.2144, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.09% (0.2811 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2813 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.04% (0.3890 => 0.4086, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.3258 => 0.3421, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.98% (1.4269 => 1.4980, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 4.97% (0.2714 => 0.2849, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (2.1653 => 2.2730, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.97% (0.3060 => 0.3212, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7171 => 0.7526, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.94% (0.3317 => 0.3481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2738 => 0.2873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.3348 => 0.3513, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.91% (0.2911 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.90% (0.3267 => 0.3427, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.87% (0.2729 => 0.2862, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.84% (0.3096 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3362 => 0.3524, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2803 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.3625 => 0.3799, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.79% (1.8794 => 1.9694, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3726 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (0.4139 => 0.4336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 4.73% (2.0346 => 2.1308, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4146 => 0.4339, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3678 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3124 => 0.3269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.63% (0.4251 => 0.4448, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 4.57% (23.5202 => 24.5958, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.57% (0.3084 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.54% (0.3477 => 0.3635, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.53% (0.3903 => 0.4080, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.53% (0.5546 => 0.5797, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.48% (0.3282 => 0.3429, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.47% (0.3845 => 0.4017, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 4.47% (0.3336 => 0.3485, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (0.4658 => 0.4866, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.37% (0.3981 => 0.4155, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.34% (0.6435 => 0.6714, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.5900 => 0.6155, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.29% (0.7875 => 0.8213, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.25% (1.9694 => 2.0531, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.3271 => 0.3410, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.22% (0.2391 => 0.2492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.13% (0.2737 => 0.2850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.09% (0.5012 => 0.5217, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.08% (0.7426 => 0.7729, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (1.9966 => 2.0774, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (0.5584 => 0.5806, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 3.88% (0.4847 => 0.5035, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (0.2691 => 0.2794, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 3.76% (0.9697 => 1.0062, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (0.5361 => 0.5559, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.40% (11.6398 => 12.0355, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (4.6926 => 4.8275, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.42% (0.4253 => 0.4356, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.29% (11.9555 => 12.1098, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6741, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1653, std.dev.: 0.1468) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6456, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1954, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5037, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4358, std.dev.: 0.0226) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2902, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5803, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4415, std.dev.: 0.0578) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5614, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8061, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.58% (0.2402 => 0.2268, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7966, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.73% (0.6293 => 0.6121, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7974, std.dev.: 0.0816) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9628, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 18:26:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 20:26:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922012645.A7090352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4122?compare_to=4119&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4122, Order: 164430, Start Time: 2012-09-22 00:18:00, End Time: 2012-09-22 01:28:13 To: 4119, Order: 164421, Start Time: 2012-09-21 22:47:23, End Time: 2012-09-21 23:59:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (51 on baseline) Performance Improvements: 17 (41 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 878 (798 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.10% (0.1872 => 0.2005, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.26% (0.7554 => 0.7725, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.97% (2.3041 => 2.3955, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/ffbench: 2.33% (1.3779 => 1.4100, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 1.63% (8.7096 => 8.8515, std.dev.: 0.0285) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.47% (16.3733 => 15.8046, std.dev.: 0.0694) MultiSource/Applications/oggenc/oggenc: -2.76% (4.9254 => 4.7893, std.dev.: 0.0272) MultiSource/Applications/lambda-0_1_3/lambda: -2.74% (0.7258 => 0.7059, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: -2.42% (1.0700 => 1.0441, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -2.26% (2.1745 => 2.1254, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: -2.19% (1.2386 => 1.2115, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: -1.85% (13.7065 => 13.4531, std.dev.: 0.0465) MultiSource/Applications/d/make_dparser: -1.68% (3.1271 => 3.0746, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: -1.54% (6.6261 => 6.5239, std.dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: -1.47% (0.9476 => 0.9337, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: -1.38% (14.9498 => 14.7440, std.dev.: 0.0745) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -32.81% (0.2085 => 0.1401, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: -10.31% (0.7197 => 0.6455, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.61% (0.9337 => 0.8813, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.62% (1.2931 => 1.2333, std.dev.: 0.0122) MultiSource/Benchmarks/llubenchmark/llu: -1.64% (2.0374 => 2.0039, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (2.4537 => 2.4257, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.19% (0.9929 => 0.9910, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -5.85% (0.6105 => 0.5748, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -6.38% (0.1615 => 0.1512, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -18.62% (0.1563 => 0.1272, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.22% (0.3115 => 0.2859, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.01% (0.2339 => 0.2175, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.19% (0.3152 => 0.2957, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.75% (0.2244 => 0.2070, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel: -38.64% (0.0396 => 0.0243, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -45.45% (0.0088 => 0.0048, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: -24.72% (0.0089 => 0.0067, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -72.80% (0.0239 => 0.0065, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.70% (0.0191 => 0.0119, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -22.94% (0.0388 => 0.0299, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.84% (0.0298 => 0.0221, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 11.79% (0.0229 => 0.0256, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0322 => 0.0321, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -16.79% (0.0131 => 0.0109, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/test1: 9.40% (0.0149 => 0.0163, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: 2.44% (0.0246 => 0.0252, std.dev.: 0.0101) SingleSource/UnitTests/byval-alignment: -61.99% (0.0271 => 0.0103, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1458 => 0.1450, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.72% (1.3922 => 1.4857, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.54% (0.1432 => 0.1497, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.98% (0.4222 => 0.4054, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.60% (0.1440 => 0.1417, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.99% (0.0531 => 0.0600, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.64% (0.0189 => 0.0211, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.52% (0.0592 => 0.0601, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (0.0046 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.93% (1.1370 => 1.1264, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.09% (0.0011 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.25% (0.0551 => 0.0635, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.51% (0.0169 => 0.0158, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.24% (0.7649 => 0.7667, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.10% (1.5996 => 1.6012, std.dev.: 0.0067) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.74% (0.0121 => 0.0108, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.75% (4.1772 => 3.1016, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/except: 82400.00% (0.0006 => 0.4950, std.dev.: 0.0013) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.58% (0.0745 => 0.0876, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.78% (0.1414 => 0.1524, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 6.78% (2.1763 => 2.3238, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.16% (0.6410 => 0.6805, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.5309 => 0.5634, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3.96% (1.1653 => 1.2115, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 3.93% (1.0046 => 1.0441, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.71% (0.6173 => 0.6402, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.32% (0.3582 => 0.3701, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3217 => 0.3321, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.23% (15.3105 => 15.8046, std.dev.: 0.0694) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (1.5150 => 1.5488, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 2.08% (0.6915 => 0.7059, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 2.02% (29.3170 => 29.9086, std.dev.: 0.2281) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.96% (0.7639 => 0.7789, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6069 => 0.6174, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.72% (3.0225 => 3.0746, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.67% (1.1827 => 1.2024, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.66% (1.2021 => 1.2221, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.41% (12.6413 => 12.8201, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 1.34% (2.0972 => 2.1254, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (6.2546 => 6.3272, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.0689 => 1.0798, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.12% (1.6538 => 2.3339, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9987, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.89% (4.0101 => 4.5671, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0107) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.45% (0.2857 => 0.3127, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6076, std.dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.83% (1.0063 => 1.0750, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: 4.59% (0.9851 => 1.0303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8431, std.dev.: 0.0468) SingleSource/Benchmarks/Misc/ReedSolomon: 4.00% (8.5113 => 8.8515, std.dev.: 0.0285) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.71% (0.8498 => 0.8813, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.44% (0.5587 => 0.5779, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8931, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 2.59% (3.8907 => 3.9916, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/mason/mason: 2.54% (0.5004 => 0.5131, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.54% (0.5876 => 0.6025, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 2.41% (0.6308 => 0.6460, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 2.16% (3.5520 => 3.6289, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: 1.95% (2.4013 => 2.4481, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.01% (4.0659 => 4.1068, std.dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.07% (0.7738 => 0.7578, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.36% (5.2665 => 4.0891, std.dev.: 0.1117) SingleSource/Benchmarks/Shootout-C++/ary3: -20.73% (1.7473 => 1.3851, std.dev.: 0.0459) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.1647 => 0.9597, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.73% (15.8312 => 13.1826, std.dev.: 0.1602) SingleSource/Benchmarks/Shootout/sieve: -12.32% (8.1594 => 7.1542, std.dev.: 0.0158) MultiSource/Applications/sgefa/sgefa: -11.21% (0.3746 => 0.3326, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.45% (3.2007 => 2.9301, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3790, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3286, std.dev.: 0.0386) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -6.43% (7.6833 => 7.1893, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3515, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/distray/distray: -5.78% (0.2664 => 0.2510, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (3.4230 => 3.2314, std.dev.: 0.0475) MultiSource/Benchmarks/mafft/pairlocalalign: -5.51% (62.4126 => 58.9750, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1875, std.dev.: 0.0159) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.83% (1.2959 => 1.2333, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.61% (0.4140 => 0.3949, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2225, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.74% (45.4683 => 43.7690, std.dev.: 0.4987) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9495, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2857, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.45% (3.7496 => 3.6579, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.42% (61.1734 => 59.6960, std.dev.: 0.3097) MultiSource/Benchmarks/PAQ8p/paq8p: -2.13% (92.7467 => 90.7691, std.dev.: 0.5563) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.08% (0.6119 => 0.5992, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3124, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -1.83% (3.4286 => 3.3657, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.4876 => 3.4242, std.dev.: 0.0236) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2359, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/lists: -1.43% (16.5617 => 16.3245, std.dev.: 0.0607) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3055, std.dev.: 0.0768) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.70% (0.9980 => 0.9910, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -4.55% (0.6022 => 0.5748, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -9.24% (0.1666 => 0.1512, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -18.15% (0.1554 => 0.1272, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (0.3083 => 0.2859, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.15% (0.2394 => 0.2175, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.87% (0.3175 => 0.2957, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.08% (0.2302 => 0.2070, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel: -45.88% (0.0449 => 0.0243, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -46.07% (0.0089 => 0.0048, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: -25.56% (0.0090 => 0.0067, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -72.92% (0.0240 => 0.0065, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.02% (0.0192 => 0.0119, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -23.33% (0.0390 => 0.0299, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.58% (0.0301 => 0.0221, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.86% (0.0284 => 0.0256, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -38.42% (0.0177 => 0.0109, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/test1: -13.76% (0.0189 => 0.0163, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0101) SingleSource/UnitTests/byval-alignment: -68.31% (0.0325 => 0.0103, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -1.08% (1.5019 => 1.4857, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1501 => 0.1497, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.92% (0.4264 => 0.4054, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.43% (0.1344 => 0.1417, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0589 => 0.0600, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.05% (0.0232 => 0.0211, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0639 => 0.0601, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.1350 => 1.1264, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.31% (0.0637 => 0.0635, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.77% (0.0246 => 0.0158, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.67% (0.7541 => 0.7667, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.22% (1.5363 => 1.6012, std.dev.: 0.0067) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.29% (0.0070 => 0.0108, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 18:38:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 20:38:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922013822.DBE27352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4123?compare_to=4118&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4123, Order: 164428, Start Time: 2012-09-22 00:19:53, End Time: 2012-09-22 01:39:48 To: 4118, Order: 164415, Start Time: 2012-09-21 22:29:29, End Time: 2012-09-21 23:49:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.30% (0.5718 => 0.5735, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.16% (15.9510 => 15.9772, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: -0.10% (14.8761 => 14.8609, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 0.08% (82.6220 => 82.6909, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3272 => 4.3262, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.15% (1.2302 => 1.2283, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.36% (7.4298 => 7.4564, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.46% (3.6884 => 3.7054, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.6401 => 0.6409, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.0647 => 0.0686, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 30.75% (63.2438 => 82.6909, std.dev.: 0.0064) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14231.39% (0.0720 => 10.3186, std.dev.: 0.0080) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.43% (10.3673 => 15.2843, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 27.00% (0.1622 => 0.2060, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.84% (2.2022 => 2.5289, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.29% (7.0540 => 8.0622, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.71% (0.1566 => 0.1765, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.36% (1.1194 => 1.2578, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.01% (1.7609 => 1.9723, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 10.67% (10.4361 => 11.5493, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.10% (0.3473 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3543 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3497 => 0.3807, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.81% (0.3543 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3561 => 0.3873, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.62% (0.3828 => 0.4158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3694 => 0.4010, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.48% (0.3927 => 0.4260, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.34% (0.3886 => 0.4210, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.92% (9.4845 => 10.2359, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.73% (0.4879 => 0.5256) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.26% (0.3307 => 0.3547, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.20% (0.3109 => 0.3333, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 7.08% (5.7591 => 6.1670, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7433 => 0.7958, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.5105 => 0.5461, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.86% (0.7115 => 0.7603, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.83% (0.6675 => 0.7131, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.72% (0.3423 => 0.3653, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.68% (1.5415 => 1.6445, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.5860 => 0.6242, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.50% (3.3354 => 3.5522, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (4.2646 => 4.5413, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.48% (0.4615 => 0.4914, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.43% (1.3050 => 1.3889, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.41% (0.8067 => 0.8584, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.34% (0.2271 => 0.2415, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.27% (0.8172 => 0.8684, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.19% (8.1363 => 8.6402, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3092 => 0.3278, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.96% (0.3441 => 0.3646, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.93% (4.9449 => 5.2381, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.89% (5.0018 => 5.2962, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.87% (0.2758 => 0.2920, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.84% (0.2107 => 0.2230, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 5.73% (1.1642 => 1.2309, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.70% (0.9765 => 1.0322, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 5.67% (0.7835 => 0.8279, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5925 => 0.6260, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.61% (0.3121 => 0.3296, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.56% (1.0722 => 1.1318, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.54% (1.1861 => 1.2518, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 5.51% (1.5603 => 1.6462, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 5.45% (3.8723 => 4.0835, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 5.37% (0.3387 => 0.3569, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.31% (0.6456 => 0.6799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4289 => 0.4515, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3422 => 0.3602, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 5.25% (0.3180 => 0.3347, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.25% (7.9617 => 8.3798, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4636 => 0.4874, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.12% (0.5020 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.09% (0.4299 => 0.4518, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.4103 => 0.4312, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.07% (0.4064 => 0.4270, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.05% (21.9371 => 23.0460, std.dev.: 0.0236) MultiSource/Applications/treecc/treecc: 5.03% (2.0273 => 2.1292, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 4.95% (2.2969 => 2.4105, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.90% (0.4203 => 0.4409, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.84% (0.8921 => 0.9353, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.3650 => 0.3826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.77% (0.3603 => 0.3775, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.73% (0.3865 => 0.4048, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.73% (0.6450 => 0.6755, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2872 => 0.3006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.3136 => 0.3280, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3826 => 0.4000, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.50% (0.4620 => 0.4828, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (1.5859 => 1.6572, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3935 => 0.4109, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.41% (1.4186 => 1.4811, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5981 => 0.6244, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.31% (0.2831 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.30% (0.4048 => 0.4222, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3232 => 0.3370, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.26% (2.0665 => 2.1546, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.25% (0.2871 => 0.2993, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.21% (0.3162 => 0.3295, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (14.3668 => 14.9660, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.16% (0.3052 => 0.3179, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2756 => 0.2870, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (2.2024 => 2.2934, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3684 => 0.3832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.00% (0.2877 => 0.2992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2793 => 0.2904, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2802 => 0.2913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3379 => 0.3510, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.86% (1.1840 => 1.2297, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.74% (1.2842 => 1.3194, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.59% (0.8101 => 0.8311, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5026, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.62% (3.8922 => 3.9552, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7677, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3488, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2565, std.dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.32% (0.9540 => 0.9666, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5799, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2569, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.81% (5.3855 => 3.8880, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.47% (5.3526 => 3.8824, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0343, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.12% (2.9384 => 2.5824, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -7.97% (22.1758 => 20.4082, std.dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2896, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4973, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -2.63% (1.2373 => 1.2048, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9988, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.79% (8.6802 => 8.5250, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2538, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6839, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1271, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.68% (0.5229 => 0.5735, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.59% (14.9895 => 15.9772, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 4.98% (14.1553 => 14.8609, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 5.25% (4.1105 => 4.3262, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.18% (1.1048 => 1.2283, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.17% (7.1582 => 7.4564, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.00% (3.4629 => 3.7054, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.6222 => 0.6409, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 19:45:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 21:45:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922024546.43853352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4124?compare_to=4120&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4124, Order: 164437, Start Time: 2012-09-22 01:32:47, End Time: 2012-09-22 02:47:13 To: 4120, Order: 164426, Start Time: 2012-09-21 23:49:35, End Time: 2012-09-22 01:04:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (2.0176 => 2.4141, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.60% (0.1410 => 0.1630, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.29% (0.0826 => 0.0944, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.75% (0.1072 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.33% (0.1413 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.69% (3.9660 => 4.3503, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.38% (0.1588 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.36% (0.2596 => 0.2839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.33% (0.7061 => 0.7720, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 9.19% (1.3693 => 1.4952, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7038 => 0.7679, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 9.06% (0.4328 => 0.4720, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.05% (0.7710 => 0.8408, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.04% (0.1327 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.01% (1.2193 => 1.3292, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.5818 => 0.6341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.6959 => 0.7578, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.89% (0.5265 => 0.5733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.86% (0.2721 => 0.2962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.83% (0.9199 => 1.0011, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.60% (1.1364 => 1.2341, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.43% (1.4563 => 1.5791, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 8.37% (13.8202 => 14.9764, std.dev.: 0.0153) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.24% (0.1589 => 0.1720, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.15% (0.4062 => 0.4393, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.13% (0.3899 => 0.4216, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.6283 => 0.6789, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.92% (1.0313 => 1.1130, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.92% (0.3246 => 0.3503) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.91% (0.2782 => 0.3002, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.84% (0.3022 => 0.3259, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.84% (0.5577 => 0.6014, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3485 => 0.3758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.75% (0.2760 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.75% (0.2607 => 0.2809, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.74% (0.3580 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.68% (0.3489 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.53% (0.4791 => 0.5152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2765 => 0.2973, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2966 => 0.3189, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.49% (0.4379 => 0.4707, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.48% (0.2726 => 0.2930, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 7.48% (0.2995 => 0.3219, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3756 => 0.4036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.44% (0.3293 => 0.3538, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.44% (1.9828 => 2.1303, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2127 => 0.2285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.42% (0.2937 => 0.3155, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4016 => 0.4313, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 7.38% (3.8646 => 4.1498, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.34% (1.1061 => 1.1873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.18% (0.5637 => 0.6042, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (7.2180 => 7.7362, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.18% (0.3149 => 0.3375, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8310 => 0.8903, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.3868 => 0.4143, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.08% (3.6692 => 3.9290, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.07% (0.6576 => 0.7041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3192 => 0.3417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.01% (2.1791 => 2.3318, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.98% (16.6129 => 17.7718, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/09-vor/vor: 6.94% (0.2925 => 0.3128, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.2914 => 0.3116, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.7460 => 0.7977, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.93% (0.7506 => 0.8026, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3220 => 0.3443, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4390 => 0.4693, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.2243 => 0.2396, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.75% (3.1889 => 3.4042, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.2023 => 0.2158, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1865 => 0.1989, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.48% (1.0594 => 1.1280, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.47% (0.6744 => 0.7180, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (1.3245 => 1.4101, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.43% (1.9270 => 2.0510, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.38% (1.3819 => 1.4700, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.23% (1.3813 => 1.4674, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.21% (0.2945 => 0.3128, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.21% (1.2749 => 1.3541, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.4003 => 0.4251, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.16% (0.8698 => 0.9234, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.06% (0.3914 => 0.4151, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.02% (14.8535 => 15.7471, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/for-in: 5.99% (0.3789 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (8.4961 => 8.9986, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (0.2859 => 0.3028, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4113 => 0.4356, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.89% (0.3650 => 0.3865, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3601 => 0.3813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.86% (0.3940 => 0.4171, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.81% (0.3131 => 0.3313, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3623 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.71% (4.3801 => 4.6300, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.70% (0.3755 => 0.3969, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.67% (0.6135 => 0.6483, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.66% (4.6629 => 4.9266, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.65% (13.2842 => 14.0350, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6941, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.63% (1.1333 => 1.1971, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.60% (0.8818 => 0.9312, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.47% (14.5298 => 15.3253, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.30% (0.2321 => 0.2444, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.2504 => 0.2635, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (6.5754 => 6.9123, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.98% (3.2742 => 3.4373, std.dev.: 0.0160) MultiSource/Applications/hexxagon/hexxagon: 4.78% (1.2292 => 1.2879, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.52% (0.9108 => 0.9520, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.49% (4.9865 => 5.2106, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.48% (1.5188 => 1.5868, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4805 => 0.5016, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.30% (0.6250 => 0.6519, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 4.24% (3.7467 => 3.9057, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (2.1007 => 2.1875, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (6.2785 => 6.5305, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 2.94% (33.2944 => 34.2717, std.dev.: 0.0219) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6141, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4117, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7237, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.37% (10.7476 => 11.1103, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5834, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2261, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9187, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5851, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.94% (0.2670 => 0.2538, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.60% (22.5627 => 21.7512, std.dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2665, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5096, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7939, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1573, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.31% (1.7688 => 1.7102, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.79% (1.9762 => 1.9210, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2361, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1799, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.10% (7.3305 => 7.2499, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2403, std.dev.: 0.0170) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 19:53:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 21:53:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922025348.9C408352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4125?compare_to=4122&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4125, Order: 164437, Start Time: 2012-09-22 01:44:38, End Time: 2012-09-22 02:55:18 To: 4122, Order: 164430, Start Time: 2012-09-22 00:18:00, End Time: 2012-09-22 01:28:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (55 on baseline) Performance Improvements: 0 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 895 (795 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.16% (4.7893 => 4.8447, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: 1.04% (29.9086 => 30.2210, std.dev.: 0.0914) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 6.47% (3.1831 => 3.3892, std.dev.: 0.0363) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.72% (13.1826 => 13.4087, std.dev.: 0.0802) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.55% (2.6948 => 2.7366, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.62% (0.9910 => 0.9971, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.22% (0.5748 => 0.5818, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -2.58% (0.1512 => 0.1473, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.28% (0.1272 => 0.1301, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.2859 => 0.2919, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (0.2175 => 0.2204, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (0.2957 => 0.2972, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.87% (0.2070 => 0.2052, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/mandel: 14.40% (0.0243 => 0.0278, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: 81.25% (0.0048 => 0.0087, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 34.33% (0.0067 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 24.62% (0.0065 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 61.34% (0.0119 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 29.43% (0.0299 => 0.0387, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.51% (0.0221 => 0.0284, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 10.55% (0.0256 => 0.0283, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0321 => 0.0323, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 63.30% (0.0109 => 0.0178, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 16.56% (0.0163 => 0.0190, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.59% (0.0252 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -28.16% (0.0103 => 0.0074, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -80.00% (0.0005 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: - (0.1450 => 0.1450, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 3.06% (1.4857 => 1.5311, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.95% (0.1497 => 0.1408, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.65% (0.4054 => 0.4121, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.48% (0.1417 => 0.1438, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.33% (0.0600 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.64% (0.0211 => 0.0178, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.32% (0.0601 => 0.0569, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.19% (1.1264 => 1.1398, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.07% (0.0635 => 0.0552, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.56% (0.0158 => 0.0181, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.7667 => 0.7655, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.04% (1.6012 => 1.6018, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.93% (0.0108 => 0.0109, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.14% (4.1772 => 3.0852, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/except: 82800.00% (0.0006 => 0.4974, std.dev.: 0.0120) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 6.69% (2.1763 => 2.3219, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.27% (0.6410 => 0.6812, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 5.91% (0.5309 => 0.5623, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 4.99% (1.0046 => 1.0547, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.2552 => 0.2677, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 4.83% (0.6173 => 0.6471, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.58% (0.3582 => 0.3746, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.1653 => 1.2173, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 4.05% (15.3105 => 15.9308, std.dev.: 0.0713) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.6915 => 0.7150, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.08% (29.3170 => 30.2210, std.dev.: 0.0914) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.7639 => 0.7866, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.64% (0.3901 => 0.4004, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 2.09% (4.7455 => 4.8447, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6069 => 0.6195, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.97% (1.2021 => 1.2258, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 1.88% (3.0225 => 3.0792, std.dev.: 0.0209) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (8.2186 => 8.3685, std.dev.: 0.0297) MultiSource/Applications/SPASS/SPASS: 1.50% (13.3238 => 13.5240, std.dev.: 0.0771) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (6.4908 => 6.5626, std.dev.: 0.0192) MultiSource/Applications/ClamAV/clamscan: 1.04% (14.6079 => 14.7593, std.dev.: 0.0336) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.39% (0.0263 => 0.0385, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0177) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.56% (0.0917 => 0.1078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 15.09% (1.7426 => 2.0055, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.48% (4.0101 => 4.5506, std.dev.: 0.0190) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.87% (0.2694 => 0.2960, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 8.81% (7.0025 => 7.6192, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.75% (1.0063 => 1.0843, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (0.3301 => 0.3502, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: 5.39% (3.2159 => 3.3892, std.dev.: 0.0363) SingleSource/Benchmarks/Misc/dt: 4.71% (0.9851 => 1.0315, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 4.21% (15.2242 => 15.8652, std.dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (6.6312 => 6.8779, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 2.81% (3.8907 => 4.0000, std.dev.: 0.0302) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8888, std.dev.: 0.0477) MultiSource/Applications/siod/siod: 2.72% (3.5520 => 3.6487, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.66% (2.6656 => 2.7366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 2.54% (8.5113 => 8.7278, std.dev.: 0.0533) MultiSource/Benchmarks/FreeBench/mason/mason: 2.36% (0.5004 => 0.5122, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.14% (0.5876 => 0.6002, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 1.80% (2.4013 => 2.4446, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.53% (4.6127 => 4.6832, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.39% (4.0659 => 4.1225, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (4.6414 => 4.6910, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4455 => 2.4707, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.53% (0.7738 => 0.7542, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.29% (5.2665 => 4.0924, std.dev.: 0.0745) SingleSource/Benchmarks/Shootout-C++/ary3: -20.27% (1.7473 => 1.3932, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.56% (1.1647 => 0.9602, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.30% (15.8312 => 13.4087, std.dev.: 0.0802) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: -11.11% (0.3746 => 0.3330, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9394, std.dev.: 0.0298) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.76% (3.6254 => 3.3802, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3319, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: -6.55% (7.6833 => 7.1804, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.36% (2.0027 => 1.8754, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (3.4230 => 3.2160, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7963, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9411, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/richards_benchmark: -5.55% (1.4441 => 1.3639, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1869, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: -5.18% (0.2664 => 0.2526, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.2959 => 1.2499, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: -3.38% (8.5323 => 8.2438, std.dev.: 0.0594) SingleSource/Benchmarks/Shootout-C++/methcall: -2.95% (9.2503 => 8.9772, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.94% (3.9413 => 3.8255, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -2.60% (9.5474 => 9.2994, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.44% (3.7496 => 3.6580, std.dev.: 0.0212) MultiSource/Applications/aha/aha: -2.06% (3.4286 => 3.3579, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -2.02% (92.7467 => 90.8722, std.dev.: 0.3662) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4222, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: -1.74% (1.0926 => 1.0736, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2282, std.dev.: 0.0323) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.67% (2.8964 => 2.8480, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.48% (1.8739 => 1.8462, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3235, std.dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/fldry: -1.09% (2.4971 => 2.4698, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: -1.05% (16.5617 => 16.3874, std.dev.: 0.0471) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.09% (0.9980 => 0.9971, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -3.39% (0.6022 => 0.5818, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -11.58% (0.1666 => 0.1473, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.28% (0.1554 => 0.1301, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.32% (0.3083 => 0.2919, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.94% (0.2394 => 0.2204, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.39% (0.3175 => 0.2972, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.86% (0.2302 => 0.2052, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/mandel: -38.08% (0.0449 => 0.0278, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -66.25% (0.0240 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.65% (0.0301 => 0.0284, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -77.23% (0.0325 => 0.0074, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.94% (1.5019 => 1.5311, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -6.20% (0.1501 => 0.1408, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.35% (0.4264 => 0.4121, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.23% (0.0589 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.95% (0.0639 => 0.0569, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.42% (1.1350 => 1.1398, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.34% (0.0637 => 0.0552, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.42% (0.0246 => 0.0181, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.26% (1.5363 => 1.6018, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 55.71% (0.0070 => 0.0109, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 20:27:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 22:27:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922032734.8C41F352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4126?compare_to=4123&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4126, Order: 164449, Start Time: 2012-09-22 02:08:40, End Time: 2012-09-22 03:29:01 To: 4123, Order: 164428, Start Time: 2012-09-22 00:19:53, End Time: 2012-09-22 01:39:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 34 (154 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 915 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 3.19% (0.6260 => 0.6460, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.13% (0.3807 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.11% (0.6366 => 0.6564, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 3.06% (0.3855 => 0.3973, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.06% (0.3823 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.05% (0.3867 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.05% (0.3873 => 0.3991, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 2.98% (0.3789 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.98% (0.7690 => 0.7919, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.98% (0.3863 => 0.3978, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 2.94% (0.4010 => 0.4128, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 2.89% (0.4260 => 0.4383, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 2.80% (0.4210 => 0.4328, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 2.77% (0.4158 => 0.4273, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.1546 => 2.2044, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.96% (1.3194 => 1.3453, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.73% (8.6402 => 8.7897, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (8.3798 => 8.5139, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (0.8684 => 0.8806, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (5.2962 => 5.3701, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.35% (23.0460 => 23.3561, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3889 => 1.4069, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.29% (5.2381 => 5.3058, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: 1.26% (3.5522 => 3.5969, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (0.8311 => 0.8413, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.22% (4.5413 => 4.5968, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.20% (1.6462 => 1.6660, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.18% (4.0835 => 4.1318, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.15% (1.0322 => 1.0441, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.2518 => 1.2660, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.11% (1.2309 => 1.2446, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (8.0622 => 8.1498, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (1.6572 => 1.6745, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.13% (54.5213 => 56.2260, std.dev.: 0.1622) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -2.23% (11.5493 => 11.2919, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (0.5735 => 0.5804, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.00% (15.9772 => 16.1367, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 1.17% (14.8609 => 15.0346, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: 0.83% (82.6909 => 83.3798, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (4.3262 => 4.3793, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.87% (1.2283 => 1.2390, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (7.4564 => 7.5503, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.77% (3.7054 => 3.7340, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.6409 => 0.6514, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.48% (0.0686 => 0.0669, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.84% (63.2438 => 83.3798, std.dev.: 0.0109) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14226.94% (0.0720 => 10.3154, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.25% (10.3673 => 15.3696, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 30.95% (0.1622 => 0.2124, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.53% (7.0540 => 8.1498, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.44% (2.2022 => 2.5423, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.73% (0.1566 => 0.1781, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.72% (1.1194 => 1.2618, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.82% (1.7609 => 1.9690, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.98% (0.1584 => 0.1758, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.57% (0.3282 => 0.3629, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 9.24% (0.1440 => 0.1573, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5925 => 0.6460, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (9.4845 => 10.3346, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.84% (0.3177 => 0.3458, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.37% (0.2700 => 0.2926, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.28% (0.4615 => 0.4997, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.20% (10.4361 => 11.2919, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 8.17% (0.3109 => 0.3363, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.14% (0.4879 => 0.5276, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 8.12% (5.7591 => 6.2270, std.dev.: 0.0191) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 8.07% (0.2554 => 0.2760, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.06% (0.3423 => 0.3699, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 8.05% (0.7115 => 0.7688, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.03% (8.1363 => 8.7897, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 7.98% (0.7433 => 0.8026, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.84% (3.3354 => 3.5969, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2271 => 0.2449, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.81% (1.3050 => 1.4069, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.6675 => 0.7196, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (4.2646 => 4.5968, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.76% (0.8172 => 0.8806, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (0.1510 => 0.1627, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.63% (1.5415 => 1.6591, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.63% (0.5860 => 0.6307, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.62% (0.8067 => 0.8682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5569 => 0.5988, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.39% (0.3422 => 0.3675, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.36% (5.0018 => 5.3701, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.30% (4.9449 => 5.3058, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.29% (0.2758 => 0.2959, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.28% (0.7835 => 0.8405, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.25% (0.5105 => 0.5475, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.3121 => 0.3346, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2891 => 0.3099, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: 7.12% (0.3092 => 0.3312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.04% (0.4103 => 0.4392, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.01% (0.4636 => 0.4961, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.01% (0.1940 => 0.2076, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.95% (0.5020 => 0.5369, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.94% (7.9617 => 8.5139, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.93% (0.3650 => 0.3903, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.92% (0.9765 => 1.0441, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.91% (1.1642 => 1.2446, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.89% (0.2872 => 0.3070, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.88% (0.1555 => 0.1662, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2831 => 0.3024, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.4064 => 0.4340, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.77% (1.5603 => 1.6660, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.76% (0.4289 => 0.4579, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.74% (1.1861 => 1.2660, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.71% (0.6456 => 0.6889, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.70% (3.8723 => 4.1318, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.67% (2.0665 => 2.2044, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.66% (0.2793 => 0.2979, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.65% (0.4299 => 0.4585, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3052 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.64% (0.3826 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.62% (0.3865 => 0.4121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.56% (1.0722 => 1.1425, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.54% (0.3180 => 0.3388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.54% (0.3441 => 0.3666, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.53% (0.2603 => 0.2773, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 6.52% (0.3387 => 0.3608, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4203 => 0.4476, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.47% (21.9371 => 23.3561, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3603 => 0.3834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.41% (0.4620 => 0.4916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.40% (0.4048 => 0.4307, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2877 => 0.3060, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 6.24% (2.0273 => 2.1539, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3935 => 0.4179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.19% (0.3684 => 0.3912, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6450 => 0.6841, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.84% (2.2969 => 2.4310, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.75% (0.8921 => 0.9434, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.59% (1.5859 => 1.6745, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.53% (0.5981 => 0.6312, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (1.4186 => 1.4927, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.05% (14.3668 => 15.0925, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.95% (2.2024 => 2.3115, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 4.81% (1.1840 => 1.2410, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2842 => 1.3453, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3817 => 0.3985, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.85% (0.8101 => 0.8413, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.3427 => 0.3554, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.75% (17.1811 => 17.6541, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (3.8922 => 3.9814, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3841, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.40% (3.6395 => 3.7633, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.10% (4.2280 => 4.3592, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2645, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.39% (5.2763 => 3.2509, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.23% (5.3855 => 3.9191, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.01% (5.3526 => 3.9066, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1465, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.52% (2.9384 => 2.5998, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -7.40% (22.1758 => 20.5348, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2875, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1603, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5128, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.55% (1.2373 => 1.2057, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0042, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.81% (8.6802 => 8.5230, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2519, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6833, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -1.66% (10.2830 => 10.1128, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.09% (1.0313 => 1.0201, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.00% (0.5229 => 0.5804, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.65% (14.9895 => 16.1367, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 6.21% (14.1553 => 15.0346, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 6.54% (4.1105 => 4.3793, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.15% (1.1048 => 1.2390, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.48% (7.1582 => 7.5503, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.83% (3.4629 => 3.7340, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.69% (0.6222 => 0.6514, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 21:20:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 23:20:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922042057.4BCBB352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4127?compare_to=4125&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4127, Order: 164451, Start Time: 2012-09-22 03:11:17, End Time: 2012-09-22 04:22:25 To: 4125, Order: 164437, Start Time: 2012-09-22 01:44:38, End Time: 2012-09-22 02:55:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 48 (83 on baseline) Performance Improvements: 0 (36 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 852 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.66% (0.4275 => 0.4688, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.60% (0.2803 => 0.3016, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.75% (1.1489 => 1.2035, std.dev.: 0.0146) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.70% (0.7613 => 0.7971, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: 4.68% (8.5447 => 8.9443, std.dev.: 0.1406) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.7173 => 0.7500, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.8863 => 0.9235, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 3.76% (3.6182 => 3.7544, std.dev.: 0.0459) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.72% (0.2772 => 0.2875, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.70% (1.4052 => 1.4572, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.70% (1.4089 => 1.4610, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.70% (0.4327 => 0.4487, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4905 => 0.5081, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.2266 => 4.3769, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.5450 => 1.5988, std.dev.: 0.0108) MultiSource/Applications/treecc/treecc: 3.41% (1.8929 => 1.9575, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.28% (1.1789 => 1.2176, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (4.2997 => 4.4408, std.dev.: 0.0239) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (6.2987 => 6.5007, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.0758 => 1.1103, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (3.1089 => 3.2018, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.88% (4.0345 => 4.1507, std.dev.: 0.0252) MultiSource/Applications/SPASS/SPASS: 2.82% (13.5240 => 13.9048, std.dev.: 0.0530) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.79% (1.1902 => 1.2234, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7150 => 0.7349, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.75% (0.8488 => 0.8721, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.0488 => 2.1018, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 2.58% (0.6471 => 0.6638, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.47% (1.2666 => 1.2979, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 2.45% (1.0547 => 1.0805, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 2.42% (0.5623 => 0.5759, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.41% (1.0932 => 1.1195, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: 2.40% (1.3482 => 1.3806, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 2.38% (14.7593 => 15.1100, std.dev.: 0.0590) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (8.2146 => 8.4014, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.24% (0.6195 => 0.6334, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.5626 => 6.7083, std.dev.: 0.0241) MultiSource/Applications/oggenc/oggenc: 2.18% (4.8447 => 4.9504, std.dev.: 0.0340) MultiSource/Applications/SIBsim4/SIBsim4: 2.14% (1.2173 => 1.2434, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.11% (14.8488 => 15.1617, std.dev.: 0.0751) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.02% (0.5649 => 0.5763, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 1.99% (0.9394 => 0.9581, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.5947 => 0.6053, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (8.3685 => 8.5126, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.6812 => 0.6916, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.23% (30.2210 => 30.5935, std.dev.: 0.1387) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.22% (8.2438 => 8.3446, std.dev.: 0.0334) SingleSource/Benchmarks/Misc/ReedSolomon: 1.11% (8.7278 => 8.8250, std.dev.: 0.0200) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.45% (0.9971 => 1.0116, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.44% (0.5818 => 0.5902, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 2.17% (0.1473 => 0.1505, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.00% (0.1301 => 0.1340, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.47% (0.2919 => 0.2962, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.18% (0.2204 => 0.2156, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.84% (0.2972 => 0.2947, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.2052 => 0.2117, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 2.16% (0.0278 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -31.03% (0.0087 => 0.0060, std.dev.: 0.0015) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.70% (0.0081 => 0.0084, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.33% (0.0192 => 0.0128, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0387 => 0.0391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.85% (0.0284 => 0.0239, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0283 => 0.0286, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0323 => 0.0324, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: 2.25% (0.0178 => 0.0182, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -24.74% (0.0190 => 0.0143, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 1.21% (0.0248 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 71.62% (0.0074 => 0.0127, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1450 => 0.1451, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -2.58% (1.5311 => 1.4916, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.99% (0.1408 => 0.1436, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.45% (0.4121 => 0.4020, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.13% (0.1438 => 0.1393, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.02% (0.0608 => 0.0541, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.21% (0.0178 => 0.0230, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0569 => 0.0571, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.08% (0.0048 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.75% (1.1398 => 1.1312, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 75.00% (0.0012 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.27% (0.0552 => 0.0559, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.31% (0.0181 => 0.0137, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7655 => 0.7645, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.20% (1.6018 => 1.5986, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.61% (0.0109 => 0.0068, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.11% (4.1772 => 3.1284, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0124) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 8.60% (2.1763 => 2.3635, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/bigfib: 8.48% (0.5309 => 0.5759, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.89% (0.6410 => 0.6916, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 7.56% (1.0046 => 1.0805, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 7.53% (0.6173 => 0.6638, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 6.70% (1.1653 => 1.2434, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.67% (0.3582 => 0.3821, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.6915 => 0.7349, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 5.75% (15.3105 => 16.1911, std.dev.: 0.2676) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.63% (0.4248 => 0.4487, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (1.5150 => 1.5988, std.dev.: 0.0108) MultiSource/Applications/Burg/burg: 5.20% (1.1440 => 1.2035, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.3901 => 0.4099, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 4.88% (3.0225 => 3.1701, std.dev.: 0.0440) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.52% (0.2654 => 0.2774, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.50% (0.2886 => 0.3016, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.37% (0.6069 => 0.6334, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 4.36% (13.3238 => 13.9048, std.dev.: 0.0530) MultiSource/Benchmarks/Bullet/bullet: 4.35% (29.3170 => 30.5935, std.dev.: 0.1387) MultiSource/Applications/lua/lua: 4.35% (3.5980 => 3.7544, std.dev.: 0.0459) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.32% (1.1672 => 1.2176, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 4.32% (4.7455 => 4.9504, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.31% (0.2552 => 0.2662, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (12.6413 => 13.1845, std.dev.: 0.1665) MultiSource/Applications/treecc/treecc: 4.13% (1.8798 => 1.9575, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.12% (0.4880 => 0.5081, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (3.0758 => 3.2018, std.dev.: 0.0256) MultiSource/Applications/hbd/hbd: 4.05% (1.3268 => 1.3806, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (6.2546 => 6.5007, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.90% (0.2797 => 0.2906, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.87% (1.0689 => 1.1103, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.7226 => 0.7500, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 3.76% (0.8405 => 0.8721, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (8.2186 => 8.5126, std.dev.: 0.0467) MultiSource/Applications/sgefa/sgefa: 3.55% (0.2877 => 0.2979, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (1.4113 => 1.4610, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.0821 => 1.1195, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.45% (2.0317 => 2.1018, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (1.1827 => 1.2234, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 3.44% (14.6079 => 15.1100, std.dev.: 0.0590) MultiSource/Applications/JM/ldecod/ldecod: 3.35% (6.4908 => 6.7083, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.19% (1.2021 => 1.2404, std.dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 2.96% (14.7256 => 15.1617, std.dev.: 0.0751) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.95% (4.0318 => 4.1507, std.dev.: 0.0252) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.70% (1.4189 => 1.4572, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.37% (4.3380 => 4.4408, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9029 => 0.9235, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.25% (0.5636 => 0.5763, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.23% (4.2815 => 4.3769, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.2742 => 1.2979, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.76% (8.2559 => 8.4014, std.dev.: 0.0344) MultiSource/Applications/hexxagon/hexxagon: 1.66% (0.9425 => 0.9581, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.23% (1.6538 => 2.3357, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.45% (0.0766 => 0.0938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.06% (3.4629 => 4.2268, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.94% (1.7426 => 2.0029, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.86% (4.0101 => 4.5661, std.dev.: 0.0680) SingleSource/Benchmarks/McGill/queens: 10.68% (1.6261 => 1.7997, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/Puzzle: 9.35% (0.1433 => 0.1567, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 8.54% (7.0025 => 7.6003, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.44% (1.0063 => 1.0812, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 4.32% (15.2242 => 15.8820, std.dev.: 0.0361) SingleSource/Benchmarks/Misc/dt: 4.03% (0.9851 => 1.0248, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.90% (4.2129 => 4.3774, std.dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (40.4792 => 42.0276, std.dev.: 0.4785) SingleSource/Benchmarks/Misc/ReedSolomon: 3.69% (8.5113 => 8.8250, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.18% (3.8907 => 4.0144, std.dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 2.87% (14.4877 => 14.9039, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/hash: 2.39% (0.6308 => 0.6459, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6327, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/mason/mason: 2.26% (0.5004 => 0.5117, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.99% (2.6656 => 2.7187, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: 1.91% (2.4013 => 2.4471, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.4184 => 1.4339, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.07% (1.2726 => 1.2862, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.98% (0.3497 => 0.2134, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.20% (5.2665 => 4.1498, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/ary3: -20.64% (1.7473 => 1.3866, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.41% (1.1647 => 0.9619, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.56% (15.8312 => 13.2101, std.dev.: 0.1612) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.34% (0.0917 => 0.0813, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.96% (3.2007 => 2.9458, std.dev.: 0.0732) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.76% (3.6254 => 3.3803, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3297, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8730, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -6.36% (7.6833 => 7.1944, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -6.23% (1.4441 => 1.3541, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (3.4230 => 3.2313, std.dev.: 0.0368) MultiSource/Benchmarks/mafft/pairlocalalign: -5.45% (62.4126 => 59.0099, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1878, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/misr: -5.00% (0.4296 => 0.4081, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.16% (0.4564 => 0.4374, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.72% (1.2722 => 1.2249, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/methcall: -3.08% (9.2503 => 8.9651, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.87% (3.7496 => 3.6420, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8295, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2842, std.dev.: 0.0235) MultiSource/Applications/SPASS/SPASS: -2.20% (8.5323 => 8.3446, std.dev.: 0.0334) MultiSource/Benchmarks/PAQ8p/paq8p: -2.02% (92.7467 => 90.8705, std.dev.: 0.1534) MultiSource/Applications/aha/aha: -2.00% (3.4286 => 3.3599, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4181, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3133, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2346, std.dev.: 0.0276) SingleSource/Benchmarks/Dhrystone/fldry: -1.44% (2.4971 => 2.4612, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3114, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.36% (0.9980 => 1.0116, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: -1.99% (0.6022 => 0.5902, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -9.66% (0.1666 => 0.1505, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.77% (0.1554 => 0.1340, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.92% (0.3083 => 0.2962, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.94% (0.2394 => 0.2156, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.18% (0.3175 => 0.2947, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.04% (0.2302 => 0.2117, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -36.75% (0.0449 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -32.58% (0.0089 => 0.0060, std.dev.: 0.0015) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.00% (0.0240 => 0.0084, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.33% (0.0192 => 0.0128, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.60% (0.0301 => 0.0239, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -24.34% (0.0189 => 0.0143, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -60.92% (0.0325 => 0.0127, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1429 => 0.1451, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.69% (1.5019 => 1.4916, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.33% (0.1501 => 0.1436, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.72% (0.4264 => 0.4020, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1344 => 0.1393, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.15% (0.0589 => 0.0541, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.86% (0.0232 => 0.0230, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1350 => 1.1312, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 250.00% (0.0006 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.24% (0.0637 => 0.0559, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.31% (0.0246 => 0.0137, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.38% (0.7541 => 0.7645, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.06% (1.5363 => 1.5986, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.86% (0.0070 => 0.0068, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 21:29:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 23:29:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922042917.85428352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4128?compare_to=4124&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4128, Order: 164451, Start Time: 2012-09-22 03:16:00, End Time: 2012-09-22 04:30:44 To: 4124, Order: 164437, Start Time: 2012-09-22 01:32:47, End Time: 2012-09-22 02:47:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 16 (178 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 954 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 3.39% (0.6246 => 0.6458, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.6341 => 0.6546, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.50% (0.7720 => 0.7913, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.41% (0.4693 => 0.4806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.06% (2.1303 => 2.1742, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2879 => 1.3103, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.64% (0.6519 => 0.6626, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.59% (34.2717 => 34.8175, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: 1.30% (1.4952 => 1.5146, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.23% (0.9234 => 0.9348, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.15% (1.1873 => 1.2009, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (7.7362 => 7.8240, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.07% (4.6300 => 4.6797, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.05% (4.6941 => 4.7433, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 1.01% (14.9764 => 15.1272, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.49% (55.0836 => 56.4550, std.dev.: 0.0549) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.13% (2.0176 => 2.4237, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.24% (0.1410 => 0.1639, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.51% (0.5818 => 0.6546, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.35% (0.5748 => 0.6458, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 12.07% (0.7061 => 0.7913, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.75% (0.1072 => 0.1198) MultiSource/Benchmarks/Olden/tsp/tsp: 11.45% (0.1013 => 0.1129) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 10.79% (0.4328 => 0.4795, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.73% (3.9660 => 4.3917, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 10.61% (1.3693 => 1.5146, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 10.46% (0.2781 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.32% (0.2596 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.31% (0.7710 => 0.8505, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.03% (0.2721 => 0.2994, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.02% (0.4062 => 0.4469, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.02% (0.7038 => 0.7743, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.01% (0.5265 => 0.5792, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.87% (1.2193 => 1.3396, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.84% (0.2765 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.72% (0.2655 => 0.2913, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 9.71% (0.2760 => 0.3028, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.71% (0.9199 => 1.0092, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.65% (1.9828 => 2.1742, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.64% (0.6959 => 0.7630, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.64% (0.3485 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.62% (0.3130 => 0.3431, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2726 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.55% (0.2607 => 0.2856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.54% (0.4016 => 0.4399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.51% (0.2628 => 0.2878, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.51% (0.2966 => 0.3248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2761 => 0.3023, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.48% (0.4390 => 0.4806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.47% (0.3580 => 0.3919, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.46% (13.8202 => 15.1272, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.43% (0.3489 => 0.3818, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.38% (1.4563 => 1.5929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 9.35% (0.3293 => 0.3601, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.35% (0.3756 => 0.4107, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.31% (1.1364 => 1.2422, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.17% (0.6283 => 0.6859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 9.13% (0.3868 => 0.4221, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.09% (0.3453 => 0.3767, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.88% (0.5577 => 0.6072, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 8.80% (0.3192 => 0.3473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.74% (0.3534 => 0.3843, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.74% (1.0313 => 1.1214, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.70% (0.4379 => 0.4760, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 8.57% (1.1061 => 1.2009, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3914 => 0.4245, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.43% (0.1435 => 0.1556, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.40% (7.2180 => 7.8240, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.4791 => 0.5192, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.28% (0.2995 => 0.3243, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.27% (0.3940 => 0.4266, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.24% (0.2914 => 0.3154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.22% (0.2945 => 0.3187, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 8.21% (0.7506 => 0.8122, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 8.09% (3.8646 => 4.1774, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.08% (3.6692 => 3.9656, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 8.07% (0.3220 => 0.3480, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.05% (0.5637 => 0.6091, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 8.02% (0.2243 => 0.2423, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.98% (16.6129 => 17.9392, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.98% (0.7460 => 0.8055, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.93% (0.2925 => 0.3157, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.93% (0.8310 => 0.8969, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1865 => 0.2009, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.69% (0.6576 => 0.7082, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.66% (3.1889 => 3.4331, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 7.54% (2.1791 => 2.3434, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.49% (1.9270 => 2.0713, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.47% (0.8698 => 0.9348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.38% (0.3755 => 0.4032, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.31% (1.3245 => 1.4213, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 7.30% (0.6744 => 0.7236, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 7.25% (1.0594 => 1.1362, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/05-eks/eks: 7.17% (0.4113 => 0.4408, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 7.03% (0.2859 => 0.3060, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.03% (1.3819 => 1.4790, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 6.96% (14.8535 => 15.8877, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.95% (0.1569 => 0.1678, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.86% (1.3813 => 1.4761, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.84% (4.3801 => 4.6797, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 6.83% (1.2749 => 1.3620, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.81% (0.6135 => 0.6553, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (8.4961 => 9.0728, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.75% (4.4433 => 4.7433, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.75% (0.3245 => 0.3464, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.73% (0.2140 => 0.2284, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.70% (4.6629 => 4.9754, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 6.60% (1.2292 => 1.3103, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.53% (1.1333 => 1.2073, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 6.25% (14.5298 => 15.4372, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.23% (13.2842 => 14.1116, std.dev.: 0.0190) MultiSource/Applications/JM/ldecod/ldecod: 6.12% (6.5754 => 6.9777, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.02% (0.6250 => 0.6626, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.00% (0.8818 => 0.9347, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.67% (3.2742 => 3.4598, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.44% (4.9865 => 5.2577, std.dev.: 0.0218) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.32% (0.9108 => 0.9593, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.22% (1.5188 => 1.5981, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.04% (6.2785 => 6.5952, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 4.99% (3.7467 => 3.9335, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.85% (2.1007 => 2.2025, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 4.57% (33.2944 => 34.8175, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.16% (0.3511 => 0.3622, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.84% (16.2614 => 16.7231, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2567, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.40% (0.1322 => 0.1433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4134, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.3458 => 0.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7239, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1157, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5898, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5827, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2243, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5830, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.88% (0.4657 => 0.3964, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.81% (22.5627 => 21.9294, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2831, std.dev.: 0.0332) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0228) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2411, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1434, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2174, std.dev.: 0.0175) SingleSource/Benchmarks/McGill/chomp: -1.26% (1.2308 => 1.2153, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2526, std.dev.: 0.0094) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4339, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 21:30:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Sep 2012 23:30:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922043051.82DFF352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4129?compare_to=4121&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4129, Order: 164437, Start Time: 2012-09-22 01:48:39, End Time: 2012-09-22 04:32:18 To: 4121, Order: 164415, Start Time: 2012-09-21 22:36:38, End Time: 2012-09-22 01:20:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (126 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (767 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.40% (1.7316 => 1.7559, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.95% (60.9351 => 74.9175, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.35% (115.2965 => 124.9221, std.dev.: 2.6004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 10.21% (1.5932 => 1.7559, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.21% (0.3488 => 0.3844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3442 => 0.3791, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.07% (0.3465 => 0.3814, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3446 => 0.3792, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3496 => 0.3847, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3460 => 0.3804, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.92% (0.3469 => 0.3813, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.70% (0.3650 => 0.4004, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3643 => 0.3996, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.48% (0.3724 => 0.4077, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (1.6211 => 1.7319, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.65% (0.4361 => 0.4651, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.60% (3.5627 => 3.7977, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.58% (1.3152 => 1.4018, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (2.7292 => 2.9070, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 6.40% (5.5417 => 5.8962, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 6.36% (1.0781 => 1.1467, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5826 => 0.6192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.19% (4.4195 => 4.6929, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 6.16% (0.5889 => 0.6252, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (0.4994 => 0.5301, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (0.5000 => 0.5297, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (0.5026 => 0.5323, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.78% (0.2040 => 0.2158, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.71% (2.1013 => 2.2212, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 5.62% (0.6634 => 0.7007, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.61% (0.2566 => 0.2710, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2875 => 0.3035, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.55% (4.6177 => 4.8741, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 5.53% (4.2109 => 4.4437, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.40% (0.3890 => 0.4100, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.32% (0.3195 => 0.3365, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 5.27% (0.2750 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.3004 => 0.3161, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.22% (2.1653 => 2.2783, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.22% (0.4139 => 0.4355, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.3903 => 0.4106, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 5.20% (0.2714 => 0.2855, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.19% (0.9909 => 1.0423, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 5.14% (1.8794 => 1.9760, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2738 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3267 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.04% (23.5202 => 24.7047, std.dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference: 5.03% (0.7171 => 0.7532, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.03% (0.3258 => 0.3422, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.03% (2.0673 => 2.1712, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.02% (0.2866 => 0.3010, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2823 => 0.2964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.96% (0.2780 => 0.2918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.95% (0.2729 => 0.2864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2792 => 0.2930, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.2075 => 0.2177, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 4.91% (1.4269 => 1.4970, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.90% (0.3124 => 0.3277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.88% (0.2911 => 0.3053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.87% (0.2811 => 0.2948, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.85% (2.0346 => 2.1332, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.84% (0.3096 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.83% (0.4658 => 0.4883, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3060 => 0.3207, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.80% (0.5546 => 0.5812, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3625 => 0.3798, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3317 => 0.3475, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.69% (0.3282 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.69% (0.3348 => 0.3505, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.67% (0.3726 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.66% (0.3477 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.61% (0.3362 => 0.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.3678 => 0.3847, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.56% (0.2391 => 0.2500, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4146 => 0.4333, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.51% (0.3084 => 0.3223, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.5900 => 0.6165, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.46% (0.7875 => 0.8226, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.45% (0.4251 => 0.4440, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 4.41% (0.3336 => 0.3483, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.39% (1.9694 => 2.0558, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.36% (0.3690 => 0.3851, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.27% (1.9966 => 2.0818, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.3271 => 0.3410, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.22% (0.3981 => 0.4149, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (0.2691 => 0.2803, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.14% (0.2969 => 0.3092, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.2737 => 0.2846, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (0.4847 => 0.5038, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.5012 => 0.5207, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (0.7426 => 0.7701, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.67% (0.9697 => 1.0053, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.51% (0.5584 => 0.5780, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (0.5361 => 0.5549, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (0.4253 => 0.4397, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.06% (11.6398 => 11.9961, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.6926 => 4.8108, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 1.04% (11.9555 => 12.0803, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0293, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6754, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.89% (15.4430 => 16.1983, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ary: 4.81% (0.2122 => 0.2224, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6438, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5037, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4519, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2825, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5485, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8059, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9597, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7967, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6909, std.dev.: 0.0684) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9661, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 22:47:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 00:47:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922054705.F2EC9352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4130?compare_to=4127&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4130, Order: 164452, Start Time: 2012-09-22 04:38:07, End Time: 2012-09-22 05:48:32 To: 4127, Order: 164451, Start Time: 2012-09-22 03:11:17, End Time: 2012-09-22 04:22:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 1 (83 on baseline) Performance Improvements: 5 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 894 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.25% (21.5516 => 22.8984, std.dev.: 0.1044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.34% (8.9443 => 8.3776, std.dev.: 0.1665) MultiSource/Applications/hexxagon/hexxagon: -1.08% (0.9581 => 0.9478, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -1.01% (3.7544 => 3.7166, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.83% (4.7743 => 4.6868, std.dev.: 0.0327) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.45% (1.8645 => 1.8375, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.96% (1.0116 => 1.0213, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -0.85% (0.5902 => 0.5852, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: 2.33% (0.1505 => 0.1540, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.60% (0.1340 => 0.1332, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.51% (0.2962 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.18% (0.2156 => 0.2203, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.76% (0.2947 => 0.2999, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.99% (0.2117 => 0.2096, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 46.67% (0.0060 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.19% (0.0084 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 51.56% (0.0128 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0391 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.20% (0.0239 => 0.0304, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0286 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0182 => 0.0182, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -15.38% (0.0143 => 0.0121, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0251 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -2.36% (0.0127 => 0.0124, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1451 => 0.1455, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 0.49% (1.4916 => 1.4989, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.65% (0.1436 => 0.1474, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.4020 => 0.4018, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1393 => 0.1506, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.12% (0.0541 => 0.0612, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.09% (0.0230 => 0.0193, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.96% (0.0571 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -46.81% (0.0047 => 0.0025, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1312 => 1.1329, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -47.62% (0.0021 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.79% (0.0559 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 56.93% (0.0137 => 0.0215, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7645 => 0.7656, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.36% (1.5986 => 1.5929, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0068 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -90.42% (0.0261 => 0.0025, std.dev.: 0.0011) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.97% (4.1772 => 3.0923, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/except: 82200.00% (0.0006 => 0.4938, std.dev.: 0.0021) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.54% (0.1414 => 0.1563, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 8.51% (2.1763 => 2.3614, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6410 => 0.6954, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 7.40% (0.5309 => 0.5702, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.15% (0.3582 => 0.3838, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 6.87% (1.0046 => 1.0736, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 6.59% (0.6173 => 0.6580, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (1.1653 => 1.2398, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 6.31% (0.3217 => 0.3420, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (1.5150 => 1.6064, std.dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: 5.78% (0.6915 => 0.7315, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 5.65% (15.3105 => 16.1756, std.dev.: 0.1137) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.2552 => 0.2675, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3901 => 0.4088, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (12.6413 => 13.2306, std.dev.: 0.0776) MultiSource/Applications/d/make_dparser: 4.60% (3.0225 => 3.1614, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1672 => 1.2206, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 4.37% (29.3170 => 30.5971, std.dev.: 0.0977) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.18% (0.2654 => 0.2765, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.11% (0.7639 => 0.7953, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.10% (0.6069 => 0.6318, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4248 => 0.4415, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (1.1827 => 1.2290, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.83% (1.0689 => 1.1098, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.79% (1.4113 => 1.4648, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 3.73% (13.3238 => 13.8211, std.dev.: 0.0765) MultiSource/Applications/siod/siod: 3.72% (2.0972 => 2.1752, std.dev.: 0.0163) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.69% (0.7722 => 0.8007, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.68% (0.2797 => 0.2900, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.68% (4.7455 => 4.9202, std.dev.: 0.0232) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (8.2186 => 8.5126, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/09-vor/vor: 3.47% (0.3026 => 0.3131, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.40% (1.2021 => 1.2430, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.30% (3.5980 => 3.7166, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.28% (1.4408 => 1.4880, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 3.26% (0.8405 => 0.8679, std.dev.: 0.0092) MultiSource/Applications/hbd/hbd: 3.23% (1.3268 => 1.3697, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.08% (3.0758 => 3.1706, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.03% (0.5636 => 0.5807, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 3.02% (1.1440 => 1.1785, std.dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 3.01% (14.6079 => 15.0478, std.dev.: 0.0806) MultiSource/Applications/treecc/treecc: 2.98% (1.8798 => 1.9359, std.dev.: 0.0173) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.4908 => 6.6820, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.86% (2.0317 => 2.0899, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.86% (6.2546 => 6.4337, std.dev.: 0.0658) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0821 => 1.1130, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.7256 => 15.1387, std.dev.: 0.1349) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.76% (1.2742 => 1.3094, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.4880 => 0.5011, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (4.0318 => 4.1330, std.dev.: 0.0372) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.50% (0.4562 => 0.4676, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.5963 => 0.6107, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.98% (0.0766 => 0.0942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9988, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5526, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 8.94% (7.0025 => 7.6284, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Puzzle: 8.51% (0.1433 => 0.1555, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 8.15% (21.1721 => 22.8984, std.dev.: 0.1044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.69% (1.0063 => 1.0837, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.57% (0.8498 => 0.8886, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/fp-convert: 4.39% (15.2242 => 15.8920, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.10% (4.2129 => 4.3855, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/dt: 4.03% (0.9851 => 1.0248, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.68% (3.4080 => 3.5335, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.6308 => 0.6499, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8928, std.dev.: 0.0331) MultiSource/Benchmarks/sim/sim: 2.63% (3.8907 => 3.9929, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.57% (0.5876 => 0.6027, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/mason/mason: 2.44% (0.5004 => 0.5126, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 2.29% (3.5520 => 3.6332, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: 1.77% (2.4013 => 2.4437, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.4455 => 2.4721, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (4.6414 => 4.6896, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.89% (8.9977 => 8.3776, std.dev.: 0.1665) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.92% (0.3497 => 0.2066, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.39% (5.2665 => 4.0874, std.dev.: 0.0906) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.37% (1.1647 => 0.9624, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.17% (15.8312 => 13.1126, std.dev.: 0.1157) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -9.61% (0.1114 => 0.1007, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.11% (3.2007 => 2.9410, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3750, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/fibo: -6.68% (4.6355 => 4.3257, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/distray/distray: -6.53% (0.2664 => 0.2490, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8732, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -6.40% (7.6833 => 7.1919, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: -6.23% (3.4230 => 3.2098, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3559, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9493, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1883, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.23% (0.4564 => 0.4371, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2225, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.62% (2.4457 => 2.3572, std.dev.: 0.0259) SingleSource/Benchmarks/McGill/misr: -3.05% (0.4296 => 0.4165, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -2.99% (9.2503 => 8.9739, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.90% (3.7496 => 3.6407, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0184) MultiSource/Benchmarks/PAQ8p/paq8p: -2.18% (92.7467 => 90.7257, std.dev.: 0.2039) MultiSource/Applications/aha/aha: -1.94% (3.4286 => 3.3620, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.94% (1.8739 => 1.8375, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4222, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3137, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2228, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3080, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: -1.30% (16.5617 => 16.3458, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -1.20% (2.4971 => 2.4671, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.33% (0.9980 => 1.0213, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -2.82% (0.6022 => 0.5852, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: -7.56% (0.1666 => 0.1540, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.29% (0.1554 => 0.1332, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.44% (0.3083 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.98% (0.2394 => 0.2203, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.54% (0.3175 => 0.2999, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.95% (0.2302 => 0.2096, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -36.75% (0.0449 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -35.98% (0.0189 => 0.0121, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -0.20% (1.5019 => 1.4989, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.80% (0.1501 => 0.1474, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.77% (0.4264 => 0.4018, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.05% (0.1344 => 0.1506, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.81% (0.0232 => 0.0193, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1350 => 1.1329, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.68% (0.0637 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.60% (0.0246 => 0.0215, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.52% (0.7541 => 0.7656, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.68% (1.5363 => 1.5929, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.71% (0.0070 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 3.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 21 23:12:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 01:12:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922061257.ADCD9352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4131?compare_to=4128&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4131, Order: 164452, Start Time: 2012-09-22 04:59:31, End Time: 2012-09-22 06:14:24 To: 4128, Order: 164451, Start Time: 2012-09-22 03:16:00, End Time: 2012-09-22 04:30:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.23% (2.0176 => 2.4258, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.39% (0.5818 => 0.6539, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5748 => 0.6456, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 11.95% (0.7061 => 0.7905, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.74% (0.4328 => 0.4793, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.73% (3.9660 => 4.3916, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.62% (1.3693 => 1.5147, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.52% (0.2596 => 0.2869, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.36% (0.2781 => 0.3069, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.18% (0.7710 => 0.8495, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 10.17% (0.7038 => 0.7754, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.14% (0.4062 => 0.4474, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.03% (0.3022 => 0.3325, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.01% (0.5265 => 0.5792, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.93% (0.3899 => 0.4286, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.90% (1.2193 => 1.3400, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.86% (0.6959 => 0.7645, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.81% (0.9199 => 1.0101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.78% (0.3130 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.64% (0.3485 => 0.3821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.62% (1.9828 => 2.1735, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2726 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.55% (0.2607 => 0.2856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.53% (0.2761 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.48% (0.4390 => 0.4806, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.45% (0.2655 => 0.2906, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.45% (1.4563 => 1.5939, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.44% (0.2966 => 0.3246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.44% (0.4016 => 0.4395, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.44% (13.8202 => 15.1242, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.43% (0.3489 => 0.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3580 => 0.3915, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.34% (1.1364 => 1.2425, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 9.32% (0.3293 => 0.3600, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.28% (0.2628 => 0.2872, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.27% (0.3756 => 0.4104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.24% (0.3107 => 0.3394, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.18% (0.4379 => 0.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.15% (0.3149 => 0.3437, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.10% (0.3868 => 0.4220, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.09% (0.3453 => 0.3767, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.06% (0.6283 => 0.6852, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.88% (0.5577 => 0.6072, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.80% (0.3192 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.80% (0.3534 => 0.3845, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.75% (1.0313 => 1.1215, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.65% (0.2127 => 0.2311, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.46% (1.1061 => 1.1997, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 8.43% (0.7506 => 0.8139, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.41% (7.2180 => 7.8252, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.4791 => 0.5194, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.38% (0.2995 => 0.3246, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.28% (0.5637 => 0.6104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.20% (0.2914 => 0.3153, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.19% (3.8646 => 4.1810, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 8.17% (16.6129 => 17.9699, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.11% (3.6692 => 3.9666, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2945 => 0.3183, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.02% (0.2243 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.01% (0.3220 => 0.3478, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.90% (0.7460 => 0.8049, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 7.85% (0.8310 => 0.8962, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.81% (3.1889 => 3.4380, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2023 => 0.2181, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.66% (0.6576 => 0.7080, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.61% (1.9270 => 2.0736, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.54% (0.8698 => 0.9354, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.53% (2.1791 => 2.3431, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 7.38% (0.6744 => 0.7242, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3755 => 0.4030, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.32% (1.0594 => 1.1369, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.30% (1.3245 => 1.4212, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.09% (1.3819 => 1.4799, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.00% (0.4113 => 0.4401, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 7.00% (0.2859 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.99% (4.3801 => 4.6862, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 6.98% (8.4961 => 9.0892, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.95% (1.3813 => 1.4773, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.95% (0.1569 => 0.1678, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.93% (14.8535 => 15.8835, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (1.2749 => 1.3621, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.83% (0.6135 => 0.6554, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.79% (4.4433 => 4.7451, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.78% (0.3245 => 0.3465, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.74% (4.6629 => 4.9771, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.2140 => 0.2282, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.1333 => 1.2076, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.51% (1.2292 => 1.3092, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.27% (14.5298 => 15.4406, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (13.2842 => 14.1091, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.20% (0.2321 => 0.2465, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.17% (6.5754 => 6.9810, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.02% (0.8818 => 0.9349, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 5.92% (0.6250 => 0.6620, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.70% (0.4805 => 0.5079, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.68% (3.2742 => 3.4602, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.51% (4.9865 => 5.2611, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.28% (0.9108 => 0.9589, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.28% (1.5188 => 1.5990, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (6.2785 => 6.5996, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 4.98% (3.7467 => 3.9332, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.81% (2.1007 => 2.2017, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.52% (33.2944 => 34.8006, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.70% (0.3511 => 0.3641, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.80% (16.2614 => 16.7173, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 25.19% (1.8175 => 2.2754, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7251, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1180, std.dev.: 0.0599) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5918, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1887, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.19% (12.4560 => 12.6040, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2255, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.90% (0.4657 => 0.3963, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.61% (22.5627 => 21.9749, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2730, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0136) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.76% (3.0263 => 2.9428, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2373, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1809, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std.dev.: 0.0165) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2331, std.dev.: 0.0142) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4320, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2603, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -1.02% (7.3305 => 7.2555, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 00:15:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 02:15:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922071528.0B179352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4132?compare_to=4126&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4132, Order: 164452, Start Time: 2012-09-22 05:53:29, End Time: 2012-09-22 07:16:55 To: 4126, Order: 164449, Start Time: 2012-09-22 02:08:40, End Time: 2012-09-22 03:29:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (115 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (734 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.21% (0.4051 => 0.4505, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.44% (1.2948 => 1.3134, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.38% (15.3696 => 15.1571, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5804 => 0.5799, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: -0.11% (16.1367 => 16.1192, std.dev.: 0.3004) MultiSource/Applications/kimwitu++/kc: -0.22% (15.0346 => 15.0021, std.dev.: 0.3314) MultiSource/Benchmarks/Bullet/bullet: 0.03% (83.3798 => 83.4049, std.dev.: 0.0599) MultiSource/Benchmarks/MallocBench/gs/gs: -0.35% (4.3793 => 4.3640, std.dev.: 0.1733) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.33% (1.2390 => 1.2349, std.dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (7.5503 => 7.5404, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.7340 => 3.7360, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6514 => 0.6509, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0669 => 0.0668, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.88% (63.2438 => 83.4049, std.dev.: 0.0599) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14225.56% (0.0720 => 10.3144, std.dev.: 0.1304) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.20% (10.3673 => 15.1571, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 30.83% (0.1622 => 0.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.94% (0.1432 => 0.1646, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.85% (7.0540 => 8.1014, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.71% (2.2022 => 2.5261, std.dev.: 0.0419) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3543 => 0.3998, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.43% (1.1194 => 1.2585, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.89% (1.7609 => 1.9702, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.98% (0.1584 => 0.1758, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/oourafft: 9.51% (0.3282 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.82% (9.4845 => 10.3209, std.dev.: 0.0174) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.62% (0.3177 => 0.3451, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.60% (0.8172 => 0.8875, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.56% (0.3307 => 0.3590, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4615 => 0.5009, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.46% (0.1655 => 0.1795, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.36% (0.3121 => 0.3382, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.16% (0.4879 => 0.5277, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 7.94% (0.3109 => 0.3356, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (4.2646 => 4.5972, std.dev.: 0.1257) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.74% (1.5415 => 1.6608, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 7.69% (5.7591 => 6.2017, std.dev.: 0.0156) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.6675 => 0.7183, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.59% (10.4361 => 11.2277, std.dev.: 0.1376) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (8.1363 => 8.7534, std.dev.: 0.1933) MultiSource/Applications/d/make_dparser: 7.56% (3.3354 => 3.5876, std.dev.: 0.0822) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.52% (0.2700 => 0.2903, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.38% (0.1625 => 0.1745, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.20% (4.9449 => 5.3009, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.15% (0.5105 => 0.5470, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.10% (5.0018 => 5.3571, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.75% (7.9617 => 8.4991, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.73% (0.4636 => 0.4948, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.70% (0.4103 => 0.4378, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3650 => 0.3894, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.63% (0.5020 => 0.5353, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.4064 => 0.4332, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 6.55% (0.6456 => 0.6879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.53% (0.4289 => 0.4569, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.52% (2.0665 => 2.2013, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.46% (0.3826 => 0.4073, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.36% (0.3865 => 0.4111, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.36% (0.3052 => 0.3246, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.23% (2.0273 => 2.1537, std.dev.: 0.0478) MultiSource/Benchmarks/sim/sim: 6.23% (0.3387 => 0.3598, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.22% (0.3603 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.21% (0.4203 => 0.4464, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4620 => 0.4905, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.3162 => 0.3357, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2603 => 0.2763, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3935 => 0.4171, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.92% (21.9371 => 23.2360, std.dev.: 0.3946) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.36% (1.1840 => 1.2475, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.24% (1.5859 => 1.6690, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (14.3668 => 15.0652, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.84% (2.2024 => 2.3091, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.30% (0.3817 => 0.3981, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.8922 => 3.9709, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3823, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 6.77% (1.1396 => 1.2167, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7608, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (4.2280 => 4.3640, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7979, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2587, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.70% (5.3855 => 3.8938, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.36% (5.3526 => 3.8880, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1231, std.dev.: 0.0288) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.62% (2.9384 => 2.5970, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -7.39% (22.1758 => 20.5377, std.dev.: 0.5100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2741, std.dev.: 0.1115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.81% (1.8329 => 1.7080, std.dev.: 0.0419) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7914, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1639, std.dev.: 0.0302) SingleSource/Benchmarks/McGill/chomp: -3.32% (1.2373 => 1.1962, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5091, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (8.1563 => 7.9942, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0925, std.dev.: 0.0213) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.84% (8.6802 => 8.5209, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2551, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6840, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2206, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.90% (0.5229 => 0.5799, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: 7.54% (14.9895 => 16.1192, std.dev.: 0.3004) MultiSource/Applications/kimwitu++/kc: 5.98% (14.1553 => 15.0021, std.dev.: 0.3314) MultiSource/Benchmarks/MallocBench/gs/gs: 6.17% (4.1105 => 4.3640, std.dev.: 0.1733) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.78% (1.1048 => 1.2349, std.dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.34% (7.1582 => 7.5404, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.89% (3.4629 => 3.7360, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.61% (0.6222 => 0.6509, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 00:16:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 02:16:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922071644.5B0DA352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4133?compare_to=4130&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4133, Order: 164453, Start Time: 2012-09-22 06:07:40, End Time: 2012-09-22 07:18:13 To: 4130, Order: 164452, Start Time: 2012-09-22 04:38:07, End Time: 2012-09-22 05:48:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (79 on baseline) Performance Improvements: 2 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 890 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.41% (0.5011 => 0.5182, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.1706 => 3.2034, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (1.2794 => 1.3800, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.67% (0.3260 => 0.3510, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (3.0537 => 3.2370, std.dev.: 0.0646) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.36% (1.2404 => 1.2821, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (59.6407 => 60.7056, std.dev.: 0.2519) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.34% (2.7079 => 2.7442, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.75% (0.1166 => 0.1064, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -3.07% (0.8886 => 0.8613, std.dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.92% (1.0213 => 1.0119, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 0.67% (0.5852 => 0.5891, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: -0.32% (0.1540 => 0.1535, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.23% (0.1332 => 0.1335, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (0.2977 => 0.2984, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.04% (0.2203 => 0.2226, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.07% (0.2999 => 0.2967, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.00% (0.2096 => 0.2117, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -65.91% (0.0088 => 0.0030, std.dev.: 0.0030) SingleSource/UnitTests/2003-08-11-VaListArg: -66.29% (0.0089 => 0.0030, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.43% (0.0083 => 0.0076, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.93% (0.0194 => 0.0134, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0304 => 0.0303, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 0.55% (0.0182 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 61.16% (0.0121 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 3.16% (0.0253 => 0.0261, std.dev.: 0.0014) SingleSource/UnitTests/byval-alignment: 2.42% (0.0124 => 0.0127, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -1.99% (0.1455 => 0.1426, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.56% (1.4989 => 1.5223, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.65% (0.1474 => 0.1435, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.60% (0.4018 => 0.4444, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.92% (0.1506 => 0.1447, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0612 => 0.0613, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.77% (0.0193 => 0.0208, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.65% (0.0645 => 0.0615, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 88.00% (0.0025 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1329 => 1.1288, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0011 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.22% (0.0569 => 0.0545, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.86% (0.0215 => 0.0168, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7656 => 0.7664, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 0.40% (1.5929 => 1.5993, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.63% (0.0102 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.86% (4.1772 => 3.0970, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/except: 82333.33% (0.0006 => 0.4946, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.70% (0.0745 => 0.0929, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.91% (2.1763 => 2.3701, std.dev.: 0.0527) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.46% (0.6410 => 0.6952, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.85% (0.5309 => 0.5726, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 7.35% (0.6173 => 0.6627, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 7.23% (1.0046 => 1.0772, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: 6.74% (1.1653 => 1.2438, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 6.46% (15.3105 => 16.2999, std.dev.: 0.0800) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.45% (0.3582 => 0.3813, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.38% (0.3901 => 0.4150, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.19% (0.4880 => 0.5182, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 6.02% (0.6915 => 0.7331, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.60% (1.5150 => 1.5998, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.6069 => 0.6397, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.2552 => 0.2688, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 4.86% (29.3170 => 30.7418, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (12.6413 => 13.2013, std.dev.: 0.0828) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.4248 => 0.4435, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.33% (0.7639 => 0.7970, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 4.23% (0.3217 => 0.3353, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3062 => 0.3190, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.15% (3.0758 => 3.2034, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 3.91% (4.7455 => 4.9309, std.dev.: 0.0675) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.88% (1.2021 => 1.2487, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (8.2186 => 8.5313, std.dev.: 0.0652) MultiSource/Applications/Burg/burg: 3.79% (1.1440 => 1.1874, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.77% (1.0689 => 1.1092, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 3.70% (3.5980 => 3.7313, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.2546 => 6.4786, std.dev.: 0.0173) MultiSource/Applications/sgefa/sgefa: 3.58% (0.2877 => 0.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.58% (0.2797 => 0.2897, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.42% (2.0317 => 2.1011, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 3.39% (2.0972 => 2.1682, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.29% (0.3195 => 0.3300, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.28% (1.4408 => 1.4881, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 3.27% (0.3084 => 0.3185, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.1827 => 1.2203, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.17% (0.8569 => 0.8841, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 3.13% (14.6079 => 15.0649, std.dev.: 0.1115) MultiSource/Applications/hbd/hbd: 3.10% (1.3268 => 1.3679, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.4908 => 6.6773, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.83% (1.4113 => 1.4513, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.7256 => 15.1316, std.dev.: 0.1371) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.0821 => 1.1118, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.72% (0.5740 => 0.5896, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (4.0318 => 4.1382, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.42% (4.2815 => 4.3424, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Bubblesort: 39.54% (0.0263 => 0.0367, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9987, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.82% (4.0101 => 4.5641, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/queens: 10.57% (1.6261 => 1.7980, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 8.43% (7.0025 => 7.5929, std.dev.: 0.0425) SingleSource/Benchmarks/Stanford/Puzzle: 8.30% (0.1433 => 0.1552, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.90% (1.0063 => 1.0858, std.dev.: 0.0188) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.76% (0.2694 => 0.2903, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.99% (3.0256 => 3.2370, std.dev.: 0.0646) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.72% (0.7609 => 0.7968, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8282, std.dev.: 0.0493) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5387, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (6.6312 => 6.8748, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.36% (0.5587 => 0.5775, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.95% (2.6656 => 2.7442, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 2.89% (14.4877 => 14.9060, std.dev.: 0.0532) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.79% (0.5876 => 0.6040, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 2.72% (3.8907 => 3.9964, std.dev.: 0.0296) MultiSource/Benchmarks/FreeBench/mason/mason: 2.54% (0.5004 => 0.5131, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.44% (0.6308 => 0.6462, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.84% (4.6127 => 4.6975, std.dev.: 0.0169) SingleSource/Benchmarks/Dhrystone/dry: 1.80% (2.4013 => 2.4445, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 1.17% (4.6414 => 4.6957, std.dev.: 0.0073) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (5.1938 => 5.2524, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.14% (5.2665 => 4.1533, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/ary3: -20.74% (1.7473 => 1.3849, std.dev.: 0.0231) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.34% (1.1647 => 0.9627, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.94% (15.8312 => 13.4660, std.dev.: 0.1540) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -11.24% (0.3746 => 0.3325, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9374, std.dev.: 0.0424) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3732, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3303, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8734, std.dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -6.23% (7.6833 => 7.2049, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -6.00% (1.4441 => 1.3575, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: -5.83% (3.4230 => 3.2233, std.dev.: 0.0664) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.55% (2.9728 => 2.8079, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -5.52% (62.4126 => 58.9647, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1883, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.27% (0.4564 => 0.4369, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.36% (3.7496 => 3.6235, std.dev.: 0.0244) SingleSource/Benchmarks/McGill/misr: -3.12% (0.4296 => 0.4162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -3.03% (9.2503 => 8.9703, std.dev.: 0.0326) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.81% (3.9413 => 3.8306, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.32% (1.1683 => 1.1412, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.15% (1.8739 => 1.8337, std.dev.: 0.0131) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.7989, std.dev.: 0.6043) MultiSource/Applications/aha/aha: -1.96% (3.4286 => 3.3615, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3128, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.73% (2.8964 => 2.8464, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -1.58% (3.4876 => 3.4326, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3136, std.dev.: 0.0314) SingleSource/Benchmarks/Dhrystone/fldry: -1.25% (2.4971 => 2.4660, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.39% (0.9980 => 1.0119, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -2.18% (0.6022 => 0.5891, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: -7.86% (0.1666 => 0.1535, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.09% (0.1554 => 0.1335, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.21% (0.3083 => 0.2984, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.02% (0.2394 => 0.2226, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.55% (0.3175 => 0.2967, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.04% (0.2302 => 0.2117, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -36.97% (0.0449 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0030) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.21% (0.0192 => 0.0134, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 4.82% (0.0249 => 0.0261, std.dev.: 0.0014) SingleSource/UnitTests/byval-alignment: -60.92% (0.0325 => 0.0127, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.36% (1.5019 => 1.5223, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.40% (0.1501 => 0.1435, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.22% (0.4264 => 0.4444, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.66% (0.1344 => 0.1447, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.34% (0.0232 => 0.0208, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.76% (0.0639 => 0.0615, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.55% (1.1350 => 1.1288, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (0.0246 => 0.0168, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7541 => 0.7664, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.10% (1.5363 => 1.5993, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 00:46:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 02:46:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922074609.3C6A4352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4134?compare_to=4129&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4134, Order: 164452, Start Time: 2012-09-22 05:01:08, End Time: 2012-09-22 07:47:36 To: 4129, Order: 164437, Start Time: 2012-09-22 01:48:39, End Time: 2012-09-22 04:32:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 30 (131 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 940 (762 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 2.85% (0.3792 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3804 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.83% (0.6252 => 0.6429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 2.81% (0.3813 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 2.77% (0.4004 => 0.4115, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 2.73% (0.3847 => 0.3952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.70% (0.3814 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.70% (0.6192 => 0.6359, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.68% (0.3994 => 0.4101, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 2.64% (0.3791 => 0.3891, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.63% (0.3844 => 0.3945, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 2.62% (0.4077 => 0.4184, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.60% (0.3996 => 0.4100, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.58% (0.7532 => 0.7726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.20% (2.1712 => 2.2190, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.15% (1.0053 => 1.0269, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (0.6165 => 0.6266, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.46% (3.7977 => 3.8533, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (2.9070 => 2.9479, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (1.7319 => 1.7536, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 1.24% (4.4437 => 4.4987, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (2.0558 => 2.0805, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.20% (2.0818 => 2.1067, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 1.17% (12.0803 => 12.2222, std.dev.: 0.0251) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (2.2212 => 2.2471, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (1.4018 => 1.4180, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.12% (1.1467 => 1.1595, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: 1.11% (2.4595 => 2.4868, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.00% (24.7047 => 24.9518, std.dev.: 0.0397) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (54.2488 => 54.8758, std.dev.: 0.0519) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3488 => 0.3945, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.06% (0.3460 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3442 => 0.3891, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3469 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.74% (0.3650 => 0.4115, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3643 => 0.4100, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.1063 => 0.1179, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.65% (1.5932 => 1.7470, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.5889 => 0.6429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5826 => 0.6359, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.1218 => 0.1327, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.89% (0.1619 => 0.1763, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 8.52% (0.1421 => 0.1542, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.17% (1.6211 => 1.7536, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.16% (3.5627 => 3.8533, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.14% (0.2738 => 0.2961) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.01% (2.7292 => 2.9479, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2792 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.90% (0.2875 => 0.3102) SingleSource/Regression/C++/ofstream_ctor: 7.89% (0.3004 => 0.3241, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.89% (0.4361 => 0.4705, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.82% (1.3152 => 1.4180, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7171 => 0.7726, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2813 => 0.3030, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.55% (1.0781 => 1.1595, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.49% (0.2750 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2729 => 0.2933, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.45% (5.5417 => 5.9546, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.39% (0.4994 => 0.5363, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 7.38% (0.2803 => 0.3010, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 7.37% (0.2823 => 0.3031, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.37% (0.2566 => 0.2755, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.34% (2.0673 => 2.2190, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2780 => 0.2983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.29% (0.2811 => 0.3016, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.19% (0.9909 => 1.0621, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary2: 7.18% (0.3317 => 0.3555, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (0.5026 => 0.5386, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.13% (0.3267 => 0.3500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.3258 => 0.3490, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (0.3930 => 0.4209, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.09% (0.3060 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.07% (0.3096 => 0.3315, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.04% (0.5000 => 0.5352, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 6.99% (0.3477 => 0.3720, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.3678 => 0.3935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3124 => 0.3342, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 6.94% (2.1013 => 2.2471, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.84% (0.3362 => 0.3592, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 6.83% (4.2109 => 4.4987, std.dev.: 0.0186) MultiSource/Applications/spiff/spiff: 6.75% (0.4029 => 0.4301, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.72% (0.2068 => 0.2207, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3348 => 0.3573, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.3726 => 0.3975, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.66% (0.3845 => 0.4101, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.65% (0.2736 => 0.2918, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.61% (0.4146 => 0.4420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.2866 => 0.3055, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4251 => 0.4531) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.56% (0.3690 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3282 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.43% (0.3890 => 0.4140, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 6.41% (4.6177 => 4.9136, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.25% (0.3981 => 0.4230, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (4.4195 => 4.6958, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.5900 => 0.6266, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.11% (0.4139 => 0.4392, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 6.09% (23.5202 => 24.9518, std.dev.: 0.0397) MultiSource/Applications/siod/siod: 6.06% (0.6634 => 0.7036, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (2.1653 => 2.2948, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.98% (0.2040 => 0.2162, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.90% (0.9697 => 1.0269, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.87% (0.3903 => 0.4132, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.86% (0.5546 => 0.5871, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.83% (1.4269 => 1.5101, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 5.82% (1.8794 => 1.9888, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.82% (0.4658 => 0.4929, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (1.9694 => 2.0805, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.3084 => 0.3256, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (1.9966 => 2.1067, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.48% (0.2737 => 0.2887, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.3271 => 0.3450, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.46% (0.7875 => 0.8305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (0.2075 => 0.2188, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.31% (0.3336 => 0.3513, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.12% (0.2969 => 0.3121, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.2103 => 0.2208, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 4.87% (2.0346 => 2.1336, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 4.79% (0.2691 => 0.2820, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 4.64% (0.2391 => 0.2502, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (0.4847 => 0.5054, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (0.7426 => 0.7732, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.93% (0.4253 => 0.4420, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.73% (0.5361 => 0.5561, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.67% (0.3792 => 0.3931, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.55% (0.5584 => 0.5782, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.43% (0.3498 => 0.3618, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.32% (11.6398 => 12.0260, std.dev.: 0.0216) MultiSource/Applications/kimwitu++/kc: 2.23% (11.9555 => 12.2222, std.dev.: 0.0251) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6729, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1714, std.dev.: 0.0195) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6394, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5066, std.dev.: 0.0238) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4450, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6094, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4446, std.dev.: 0.0208) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5663, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7940, std.dev.: 0.1265) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7287, std.dev.: 0.1115) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.69% (0.6293 => 0.6124, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9631, std.dev.: 0.0684) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 00:59:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 02:59:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922075946.479F8352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4135?compare_to=4131&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4135, Order: 164453, Start Time: 2012-09-22 06:43:19, End Time: 2012-09-22 08:01:12 To: 4131, Order: 164452, Start Time: 2012-09-22 04:59:31, End Time: 2012-09-22 06:14:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (715 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.15% (2.0176 => 2.4242, std.dev.: 0.0544) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.94% (0.0770 => 0.0885, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0819 => 0.0929, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 12.43% (0.5818 => 0.6541, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.35% (0.5748 => 0.6458, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.95% (0.7061 => 0.7905, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.75% (0.1072 => 0.1198) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.03% (3.9660 => 4.4034, std.dev.: 0.1019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.94% (0.2596 => 0.2880, std.dev.: 0.0105) MultiSource/Applications/hbd/hbd: 10.85% (1.3693 => 1.5179, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 10.74% (0.4328 => 0.4793, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.59% (0.4062 => 0.4492, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 10.43% (0.2781 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.33% (0.5265 => 0.5809, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 10.14% (0.7038 => 0.7752, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.87% (1.2193 => 1.3397, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.87% (0.6959 => 0.7646, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.82% (0.9199 => 1.0102, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.81% (1.4563 => 1.5991, std.dev.: 0.0425) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3485 => 0.3825, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.69% (0.3489 => 0.3827, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.68% (1.9828 => 2.1748, std.dev.: 0.0529) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.62% (0.3130 => 0.3431, std.dev.: 0.0100) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2726 => 0.2985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.47% (0.3580 => 0.3919, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 9.47% (13.8202 => 15.1284, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.43% (0.4390 => 0.4804, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.31% (0.4016 => 0.4390, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.30% (1.1364 => 1.2421, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.27% (0.5577 => 0.6094, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/ary: 9.27% (0.3107 => 0.3395, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.26% (0.3293 => 0.3598, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.24% (0.3756 => 0.4103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.23% (0.2937 => 0.3208, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.15% (0.3149 => 0.3437, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.10% (0.3868 => 0.4220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.06% (0.6283 => 0.6852, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/sieve: 9.04% (0.3453 => 0.3765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.84% (1.0313 => 1.1225, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 8.74% (0.3192 => 0.3471, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.66% (0.3534 => 0.3840, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.64% (0.4791 => 0.5205, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.55% (1.1061 => 1.2007, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.53% (0.5637 => 0.6118, std.dev.: 0.0185) MultiSource/Applications/spiff/spiff: 8.51% (0.7506 => 0.8145, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.43% (3.6692 => 3.9786, std.dev.: 0.0937) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.41% (7.2180 => 7.8250, std.dev.: 0.1699) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.39% (0.4003 => 0.4339, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.38% (0.2995 => 0.3246, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.34% (0.3623 => 0.3925, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.16% (16.6129 => 17.9683, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/objinst: 8.15% (0.2945 => 0.3185, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.09% (0.6576 => 0.7108, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/08-main/main: 8.02% (0.2243 => 0.2423, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.88% (0.8310 => 0.8965, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 7.76% (2.1791 => 2.3483, std.dev.: 0.0066) MultiSource/Applications/d/make_dparser: 7.75% (3.1889 => 3.4361, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1865 => 0.2009, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 7.62% (1.9270 => 2.0738, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.56% (0.8698 => 0.9356, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.48% (1.0594 => 1.1386, std.dev.: 0.0255) MultiSource/Applications/minisat/minisat: 7.47% (0.6744 => 0.7248, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3755 => 0.4034, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.38% (1.3245 => 1.4222, std.dev.: 0.0356) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.37% (0.6135 => 0.6587, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/bh/bh: 7.17% (0.2859 => 0.3064, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4763, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.87% (1.3819 => 1.4768, std.dev.: 0.0309) MultiSource/Applications/JM/lencod/lencod: 6.87% (14.8535 => 15.8733, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (1.2749 => 1.3621, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.78% (4.3801 => 4.6771, std.dev.: 0.1120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.75% (4.4433 => 4.7433, std.dev.: 0.1052) MultiSource/Applications/oggenc/oggenc: 6.73% (4.6629 => 4.9768, std.dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 6.73% (8.4961 => 9.0675, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.72% (0.3245 => 0.3463, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.59% (1.2292 => 1.3102, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.36% (0.8818 => 0.9379, std.dev.: 0.0110) MultiSource/Applications/ClamAV/clamscan: 6.35% (14.5298 => 15.4519, std.dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (6.5754 => 6.9818, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.16% (0.2321 => 0.2464, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.6250 => 0.6623, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.76% (3.2742 => 3.4629, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.4805 => 0.5077, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.51% (4.9865 => 5.2614, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.25% (1.5188 => 1.5985, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 4.94% (3.7467 => 3.9319, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.81% (2.1007 => 2.2017, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.61% (33.2944 => 34.8287, std.dev.: 0.0647) MultiSource/Applications/sqlite3/sqlite3: 2.77% (16.2614 => 16.7123, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5189, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std.dev.: 0.0260) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4163, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (0.2093 => 0.2204, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7259, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.37% (10.7476 => 11.1102, std.dev.: 0.0539) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5885, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0405) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5851, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1862, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2261, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5937, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.90% (0.4657 => 0.3963, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2799, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3050, std.dev.: 0.0094) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5154, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1569, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2488, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.66% (0.6615 => 0.6505, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1341, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2257, std.dev.: 0.0342) MultiSource/Benchmarks/Bullet/bullet: -1.10% (7.3305 => 7.2501, std.dev.: 0.0124) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 02:05:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 04:05:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922090521.2BC46352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4136?compare_to=4132&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4136, Order: 164453, Start Time: 2012-09-22 07:45:58, End Time: 2012-09-22 09:06:49 To: 4132, Order: 164452, Start Time: 2012-09-22 05:53:29, End Time: 2012-09-22 07:16:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (152 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.13% (1.3134 => 1.2985, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5799 => 0.5798, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 0.09% (16.1192 => 16.1343, std.dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: -0.11% (15.0021 => 14.9851, std.dev.: 0.0293) MultiSource/Benchmarks/Bullet/bullet: 0.01% (83.4049 => 83.4121, std.dev.: 0.0634) MultiSource/Benchmarks/MallocBench/gs/gs: 0.37% (4.3640 => 4.3803, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.28% (1.2349 => 1.2384, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.5404 => 7.5410, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (3.7360 => 3.7384, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.22% (0.6509 => 0.6523, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (0.0668 => 0.0698, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.89% (63.2438 => 83.4121, std.dev.: 0.0634) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14225.56% (0.0720 => 10.3144, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.23% (10.3673 => 15.1603, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: 30.89% (0.1622 => 0.2123, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.91% (7.0540 => 8.1059, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.69% (2.2022 => 2.5258, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.60% (0.1566 => 0.1779, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.46% (1.1194 => 1.2589, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (1.7609 => 1.9697, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3927 => 0.4373, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.60% (0.1625 => 0.1781, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.51% (0.3282 => 0.3594, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.41% (0.3177 => 0.3476, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.82% (9.4845 => 10.3206, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.69% (0.8172 => 0.8882, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.59% (0.5925 => 0.6434, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.44% (0.3307 => 0.3586, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4615 => 0.5004, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.31% (0.2107 => 0.2282, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 8.25% (0.7115 => 0.7702, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.22% (0.4879 => 0.5280, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 8.08% (0.7326 => 0.7918, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 8.01% (0.3109 => 0.3358, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 7.89% (0.3092 => 0.3336, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.87% (0.7433 => 0.8018, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.3423 => 0.3689, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.76% (5.7591 => 6.2061, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.75% (0.5860 => 0.6314, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.73% (0.6675 => 0.7191, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.71% (1.5415 => 1.6604, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 7.67% (3.3354 => 3.5912, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (8.1363 => 8.7599, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 7.66% (0.7835 => 0.8435, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.65% (0.5569 => 0.5995, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 7.64% (0.2554 => 0.2749, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.59% (4.2646 => 4.5882, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.56% (1.3050 => 1.4037, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.48% (0.1510 => 0.1623, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.42% (10.4361 => 11.2107, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.38% (0.8067 => 0.8662, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.14% (0.2758 => 0.2955, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.14% (4.9449 => 5.2979, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (5.0018 => 5.3587, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.11% (0.5105 => 0.5468, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.96% (0.9765 => 1.0445, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3422 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3121 => 0.3338, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.4103 => 0.4387, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.86% (1.5603 => 1.6674, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.80% (1.1861 => 1.2668, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.75% (7.9617 => 8.4988, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.73% (0.5020 => 0.5358, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.65% (1.1642 => 1.2416, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4636 => 0.4940, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.55% (0.4064 => 0.4330, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2831 => 0.3016, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4203 => 0.4477, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.51% (0.6456 => 0.6876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.48% (0.4289 => 0.4567, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4299 => 0.4576, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.42% (0.3865 => 0.4113, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (2.0665 => 2.1986, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.3441 => 0.3660, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 6.36% (3.8723 => 4.1186, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 6.35% (0.3387 => 0.3602, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.32% (1.0722 => 1.1400, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4620 => 0.4910, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.3180 => 0.3377, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2603 => 0.2763, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.14% (0.3162 => 0.3356, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 6.13% (0.4048 => 0.4296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3684 => 0.3909, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3603 => 0.3822, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.05% (2.0273 => 2.1500, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.98% (21.9371 => 23.2495, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3935 => 0.4170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.67% (2.2969 => 2.4271, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 5.66% (0.8921 => 0.9426, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.63% (0.6450 => 0.6813, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.40% (0.5981 => 0.6304, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.32% (1.5859 => 1.6703, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.03% (1.4186 => 1.4900, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (14.3668 => 15.0637, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.81% (2.2024 => 2.3083, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2842 => 1.3450, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.1840 => 1.2386, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.24% (0.3817 => 0.3979, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.3131 => 0.3263, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.95% (0.8101 => 0.8421, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.50% (0.3427 => 0.3547, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.60% (17.1811 => 17.6279, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.8922 => 3.9742, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (3.1578 => 3.3856, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2159, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (3.6395 => 3.7659, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (4.2280 => 4.3637, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.68% (9.1159 => 9.2687, std.dev.: 0.0444) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5747, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2555, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.65% (5.3855 => 3.8964, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.30% (5.3526 => 3.8914, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.0983, std.dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.55% (2.9384 => 2.5989, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -7.30% (22.1758 => 20.5568, std.dev.: 0.0500) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3178, std.dev.: 0.0666) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.54% (1.8329 => 1.7130, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.95% (1.6805 => 1.5973, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1642, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5008, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.45% (1.2373 => 1.2070, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9956, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.93% (8.6802 => 8.5131, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2540, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1051, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2366, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.88% (0.5229 => 0.5798, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 7.64% (14.9895 => 16.1343, std.dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: 5.86% (14.1553 => 14.9851, std.dev.: 0.0293) MultiSource/Benchmarks/MallocBench/gs/gs: 6.56% (4.1105 => 4.3803, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.09% (1.1048 => 1.2384, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.35% (7.1582 => 7.5410, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.96% (3.4629 => 3.7384, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.84% (0.6222 => 0.6523, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.01% (0.2116 => 0.0698, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 03:38:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 05:38:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922103824.068FE352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4137?compare_to=4133&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4137, Order: 164454, Start Time: 2012-09-22 09:29:17, End Time: 2012-09-22 10:39:52 To: 4133, Order: 164453, Start Time: 2012-09-22 06:07:40, End Time: 2012-09-22 07:18:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (86 on baseline) Performance Improvements: 2 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 892 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.08% (0.0625 => 0.0788, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: 2.94% (8.5720 => 8.8243, std.dev.: 0.0815) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.01% (1.2011 => 1.2132, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (4.3359 => 4.4691, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/ReedSolomon: 1.68% (8.7120 => 8.8581, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.22% (2.3776 => 2.4066, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.03% (0.5182 => 0.5025, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.00% (1.1092 => 1.0981, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: - (1.0119 => 1.0119, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: -0.49% (0.5891 => 0.5862, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: -0.91% (0.1535 => 0.1521, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.12% (0.1335 => 0.1320, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.75% (0.2984 => 0.2902, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.35% (0.2226 => 0.2196, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.27% (0.2967 => 0.2975, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.90% (0.2117 => 0.2098, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -1.77% (0.0283 => 0.0278, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 193.33% (0.0030 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 200.00% (0.0030 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.26% (0.0076 => 0.0080, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 44.03% (0.0134 => 0.0193, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.53% (0.0393 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -28.71% (0.0303 => 0.0216, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.40% (0.0286 => 0.0282, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0325 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.73% (0.0183 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.54% (0.0195 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (0.0261 => 0.0248, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -1.57% (0.0127 => 0.0125, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -9.09% (0.0011 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1426 => 0.1455, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.70% (1.5223 => 1.4964, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.32% (0.1435 => 0.1497, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.43% (0.4444 => 0.4247, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.48% (0.1447 => 0.1440, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.48% (0.0613 => 0.0561, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.58% (0.0208 => 0.0230, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.99% (0.0615 => 0.0572, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.12% (1.1288 => 1.1302, std.dev.: 0.1298) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 60.00% (0.0015 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.67% (0.0545 => 0.0565, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.24% (0.0168 => 0.0134, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7664 => 0.7656, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 66.67% (0.0003 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.06% (1.5993 => 1.5984, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.27% (4.1772 => 3.1216, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/except: 82983.33% (0.0006 => 0.4985, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1159 => 0.1261, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: 8.80% (2.1763 => 2.3678, std.dev.: 0.0141) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.35% (0.1414 => 0.1532, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 7.97% (0.5309 => 0.5732, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.82% (0.6410 => 0.6911, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 6.59% (0.6173 => 0.6580, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 6.59% (1.1653 => 1.2421, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 6.56% (1.0046 => 1.0705, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.89% (0.3582 => 0.3793, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 5.62% (15.3105 => 16.1702, std.dev.: 0.0436) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.2552 => 0.2688, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.20% (1.5150 => 1.5938, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (12.6413 => 13.2852, std.dev.: 0.0987) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.6915 => 0.7261, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.67% (0.3901 => 0.4083, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.63% (0.3217 => 0.3366, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.56% (29.3170 => 30.6551, std.dev.: 0.1219) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.7639 => 0.7962, std.dev.: 0.0121) MultiSource/Applications/d/make_dparser: 4.11% (3.0225 => 3.1467, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.94% (1.1672 => 1.2132, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.94% (0.6069 => 0.6308, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.88% (0.4248 => 0.4413, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.68% (8.2186 => 8.5211, std.dev.: 0.0602) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.64% (1.1827 => 1.2257, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 3.50% (4.7455 => 4.9116, std.dev.: 0.0175) MultiSource/Applications/siod/siod: 3.43% (2.0972 => 2.1691, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.41% (1.2021 => 1.2431, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.33% (13.3238 => 13.7675, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.18% (3.0758 => 3.1737, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8405 => 0.8665, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 3.09% (14.6079 => 15.0595, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.02% (6.2546 => 6.4438, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.97% (0.4880 => 0.5025, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.0317 => 2.0896, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.81% (1.1440 => 1.1762, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.7256 => 15.1365, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.73% (1.0689 => 1.0981, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 2.69% (3.5980 => 3.6947, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.68% (0.7226 => 0.7420, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: 2.56% (1.3268 => 1.3607, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.4908 => 6.6553, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (4.0318 => 4.1293, std.dev.: 0.0301) MultiSource/Applications/treecc/treecc: 2.31% (1.8798 => 1.9232, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (1.4113 => 1.4438, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.27% (0.5937 => 0.6072, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8796 => 3.9630, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.09% (0.5636 => 0.5754, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.92% (1.4189 => 1.4462, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (4.3380 => 4.4008, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.2559 => 8.3618, std.dev.: 0.0235) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.97% (0.0263 => 0.0376, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.49% (1.6538 => 2.3400, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std.dev.: 0.0108) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.67% (0.0917 => 0.1079, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.49% (0.0766 => 0.0900, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 15.01% (1.7426 => 2.0042, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5632, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.54% (0.2694 => 0.2978, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 9.19% (7.0025 => 7.6458, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.87% (1.0063 => 1.0956, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.08% (4.2129 => 4.4691, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.98% (0.7609 => 0.7988, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.23% (15.2242 => 15.8684, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/ReedSolomon: 4.07% (8.5113 => 8.8581, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8732, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.97% (2.4042 => 2.4755, std.dev.: 0.0236) MultiSource/Benchmarks/sim/sim: 2.84% (3.8907 => 4.0013, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8970, std.dev.: 0.0796) SingleSource/Benchmarks/Shootout-C++/hash: 2.81% (0.6308 => 0.6485, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/mason/mason: 2.58% (0.5004 => 0.5133, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.50% (2.6656 => 2.7323, std.dev.: 0.0093) MultiSource/Applications/siod/siod: 2.44% (3.5520 => 3.6386, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4468, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.60% (2.3453 => 2.3828, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.4455 => 2.4762, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.14% (27.1724 => 27.4835, std.dev.: 0.0534) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.83% (0.3497 => 0.2104, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.27% (5.2665 => 4.1463, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -19.81% (1.7473 => 1.4011, std.dev.: 0.0479) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.46% (1.1647 => 0.9614, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.01% (15.8312 => 13.4549, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.40% (3.2007 => 2.9319, std.dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.23% (1.4034 => 1.2879, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: -6.66% (4.6355 => 4.3267, std.dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: -6.48% (7.6833 => 7.1856, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8733, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3559, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.10% (3.6254 => 3.4041, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.77% (3.4230 => 3.2255, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -5.53% (4.4195 => 4.1753, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: -5.49% (62.4126 => 58.9850, std.dev.: 0.0546) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -4.04% (8.5323 => 8.1880, std.dev.: 0.1307) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.62% (1.2722 => 1.2261, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8284, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -2.80% (9.2503 => 8.9910, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.75% (45.4683 => 44.2190, std.dev.: 0.3222) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.44% (3.7496 => 3.6582, std.dev.: 0.0124) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3617, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4207, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.74% (1.1683 => 1.1480, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2318, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.60% (2.4457 => 2.4066, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.57% (1.8739 => 1.8444, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3255, std.dev.: 0.0301) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (92.7467 => 91.5675, std.dev.: 0.0797) SingleSource/Benchmarks/Shootout-C++/lists: -1.22% (16.5617 => 16.3589, std.dev.: 0.0575) SingleSource/Benchmarks/Dhrystone/fldry: -1.13% (2.4971 => 2.4689, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.39% (0.9980 => 1.0119, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: -2.66% (0.6022 => 0.5862, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: -8.70% (0.1666 => 0.1521, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.06% (0.1554 => 0.1320, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.87% (0.3083 => 0.2902, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.27% (0.2394 => 0.2196, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.30% (0.3175 => 0.2975, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.86% (0.2302 => 0.2098, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -38.08% (0.0449 => 0.0278, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -66.67% (0.0240 => 0.0080, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -28.24% (0.0301 => 0.0216, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -0.37% (1.5019 => 1.4964, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1501 => 0.1497, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.40% (0.4264 => 0.4247, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.0589 => 0.0561, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.86% (0.0232 => 0.0230, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.49% (0.0639 => 0.0572, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.1350 => 1.1302, std.dev.: 0.1298) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0006 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.30% (0.0637 => 0.0565, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.53% (0.0246 => 0.0134, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.52% (0.7541 => 0.7656, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.04% (1.5363 => 1.5984, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 03:58:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 05:58:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922105818.06CF1352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4138?compare_to=4135&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4138, Order: 164454, Start Time: 2012-09-22 09:42:26, End Time: 2012-09-22 10:59:44 To: 4135, Order: 164453, Start Time: 2012-09-22 06:43:19, End Time: 2012-09-22 08:01:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.22% (7.9492 => 8.0461, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.97% (2.0176 => 2.4206, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.53% (0.0819 => 0.0938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.73% (0.5748 => 0.6422, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.34% (0.7061 => 0.7862, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.71% (1.3693 => 1.5160, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.65% (0.7710 => 0.8531, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.54% (3.9660 => 4.3839, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.52% (0.2596 => 0.2869, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 10.47% (0.4328 => 0.4781, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 10.39% (0.4062 => 0.4484, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.22% (0.2721 => 0.2999, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.19% (0.7038 => 0.7755, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.91% (0.5265 => 0.5787, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.85% (0.2782 => 0.3056, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.83% (0.6959 => 0.7643, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.78% (1.2193 => 1.3386, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.77% (0.3899 => 0.4280, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.74% (0.9199 => 1.0095, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.63% (0.3022 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.50% (0.1327 => 0.1453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.41% (0.3485 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.41% (1.9828 => 2.1694, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 9.37% (13.8202 => 15.1147, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.34% (0.1478 => 0.1616, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.31% (1.4563 => 1.5919, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 9.29% (0.2690 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.28% (0.2760 => 0.3016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.1364 => 1.2418, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.23% (0.3489 => 0.3811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.21% (0.2607 => 0.2847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.16% (0.3580 => 0.3908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.16% (0.2937 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.13% (0.4390 => 0.4791, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.13% (0.2628 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.09% (0.2761 => 0.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.05% (0.3293 => 0.3591, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.00% (0.3756 => 0.4094, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.00% (0.3868 => 0.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.99% (0.6283 => 0.6848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.98% (0.3107 => 0.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.94% (0.4016 => 0.4375, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.90% (0.2696 => 0.2936, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.89% (0.3149 => 0.3429, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.73% (0.2988 => 0.3249, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.71% (1.0313 => 1.1211, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.70% (0.5577 => 0.6062, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 8.62% (0.1589 => 0.1726, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3453 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.60% (0.3246 => 0.3525, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.53% (1.1061 => 1.2005, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3623 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.49% (0.3192 => 0.3463, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.46% (0.2127 => 0.2307, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 8.43% (0.3534 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.35% (0.4791 => 0.5191, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.23% (7.2180 => 7.8119, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 8.17% (0.3220 => 0.3483, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.17% (0.2914 => 0.3152, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 8.14% (0.7506 => 0.8117, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.14% (0.6576 => 0.7111, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.11% (0.5637 => 0.6094, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 8.09% (3.8646 => 4.1771, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 8.08% (0.2995 => 0.3237, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 7.95% (0.8310 => 0.8971, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 7.94% (0.2243 => 0.2421, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.91% (3.6692 => 3.9594, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.86% (0.7460 => 0.8046, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.2925 => 0.3154, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.81% (0.2945 => 0.3175, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.69% (16.6129 => 17.8909, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 7.55% (3.1889 => 3.4298, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 7.55% (1.9270 => 2.0725, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.51% (2.1791 => 2.3428, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.29% (0.8698 => 0.9332, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.27% (1.3245 => 1.4208, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.24% (0.6744 => 0.7232, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.11% (0.3755 => 0.4022, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.06% (1.0594 => 1.1342, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 7.00% (1.2749 => 1.3642, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 6.88% (4.6629 => 4.9836, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.87% (0.2140 => 0.2287, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.87% (1.3819 => 1.4768, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 6.86% (0.2859 => 0.3055, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.84% (1.3813 => 1.4758, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.81% (0.4113 => 0.4393, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.78% (0.6135 => 0.6551, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1569 => 0.1675, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.75% (14.8535 => 15.8566, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.67% (4.3801 => 4.6723, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.60% (4.4433 => 4.7365, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.58% (1.1333 => 1.2079, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 6.55% (8.4961 => 9.0527, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3245 => 0.3455, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.29% (0.3131 => 0.3328, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 6.25% (14.5298 => 15.4372, std.dev.: 0.0361) MultiSource/Applications/hexxagon/hexxagon: 6.22% (1.2292 => 1.3057, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.17% (13.2842 => 14.1034, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 6.04% (6.5754 => 6.9727, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2504 => 0.2654, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.90% (0.8818 => 0.9338, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 5.78% (0.6250 => 0.6611, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.48% (3.2742 => 3.4537, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.47% (0.4805 => 0.5068, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.19% (4.9865 => 5.2452, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.10% (6.2785 => 6.5990, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.01% (0.9108 => 0.9564, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.00% (1.5188 => 1.5947, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.87% (3.7467 => 3.9290, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.76% (2.1007 => 2.2006, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 4.37% (33.2944 => 34.7493, std.dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.13% (0.3511 => 0.3621, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6882, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.48% (3.1736 => 3.4109, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3780, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7243, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1220, std.dev.: 0.0843) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5892, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.92% (1.4298 => 1.4573, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5833, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5994, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2232, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3232, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6839, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.88% (0.4657 => 0.3964, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.93% (0.2670 => 0.2565, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.83% (22.5627 => 21.9233, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2563, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1575, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722) MultiSource/Benchmarks/Olden/bh/bh: -2.81% (1.9762 => 1.9206, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.72% (3.0263 => 2.9439, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2420, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1912, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.10% (7.3305 => 7.2498, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2375, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5643, std.dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 04:00:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 06:00:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922110045.BB2C4352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/4139?compare_to=4134&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4139, Order: 164453, Start Time: 2012-09-22 08:16:37, End Time: 2012-09-22 11:02:14 To: 4134, Order: 164452, Start Time: 2012-09-22 05:01:08, End Time: 2012-09-22 07:47:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (133 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (760 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.19% (0.3488 => 0.3948, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.09% (0.3460 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.06% (0.3446 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3643 => 0.4111, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1063 => 0.1181, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.77% (1.5932 => 1.7489, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5826 => 0.6370, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5889 => 0.6427, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 9.03% (0.1218 => 0.1328, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 9.02% (0.1619 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.37% (1.3152 => 1.4253, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.33% (1.6211 => 1.7561, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (3.5627 => 3.8527, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.14% (0.3195 => 0.3455, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.05% (2.7292 => 2.9488, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.03% (0.4361 => 0.4711, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.86% (0.2875 => 0.3101, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7171 => 0.7733, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.64% (0.2750 => 0.2960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.59% (5.5417 => 5.9623, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 7.56% (0.3004 => 0.3231, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.52% (0.2738 => 0.2944, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2792 => 0.3002, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.52% (0.2566 => 0.2759, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.2823 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2813 => 0.3024, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.48% (0.2780 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2729 => 0.2933, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2803 => 0.3011, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.41% (0.9909 => 1.0643, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/except: 7.33% (0.2811 => 0.3017, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.1421 => 0.1525, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.32% (1.0781 => 1.1570, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.30% (2.0673 => 2.2183, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2911 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.27% (0.4994 => 0.5357, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3258 => 0.3493, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 7.20% (4.2109 => 4.5142, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.12% (0.3930 => 0.4210, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.12% (0.5000 => 0.5356, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3096 => 0.3316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.10% (0.3267 => 0.3499, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 7.10% (2.1013 => 2.2504, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3124 => 0.3342, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3317 => 0.3546, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3678 => 0.3931, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.84% (0.5026 => 0.5370, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 6.76% (0.3726 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.2736 => 0.2921, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.75% (0.4146 => 0.4426, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3348 => 0.3573, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3282 => 0.3501, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3477 => 0.3709, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.5900 => 0.6292, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4251 => 0.4533, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.56% (0.2866 => 0.3054, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.55% (0.4139 => 0.4410, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.53% (0.3890 => 0.4144, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.48% (4.6177 => 4.9167, std.dev.: 0.0094) MultiSource/Applications/spiff/spiff: 6.40% (0.4029 => 0.4287, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 6.39% (1.8794 => 1.9995, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.38% (0.5546 => 0.5900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.34% (0.3690 => 0.3924, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.29% (0.6634 => 0.7051, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (4.4195 => 4.6953, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (0.2040 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.3981 => 0.4226, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 6.15% (2.1653 => 2.2985, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.15% (0.3903 => 0.4143, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 6.13% (23.5202 => 24.9628, std.dev.: 0.0251) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.11% (0.3845 => 0.4080, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (0.4658 => 0.4937, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.91% (0.9697 => 1.0270, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.91% (1.4269 => 1.5112, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.2068 => 0.2189, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.5012 => 0.5302, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (1.9694 => 2.0828, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.74% (0.3084 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.66% (0.2737 => 0.2892, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (1.9966 => 2.1086, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.3271 => 0.3450, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.39% (0.2969 => 0.3129, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.38% (0.7875 => 0.8299, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 5.25% (0.3336 => 0.3511, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 5.03% (2.0346 => 2.1369, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 5.02% (0.2691 => 0.2826, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 4.81% (0.2391 => 0.2506, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 4.46% (0.4847 => 0.5063, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.07% (0.7426 => 0.7728, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.02% (0.4253 => 0.4424, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3792 => 0.3941, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (0.5361 => 0.5562, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (0.5584 => 0.5783, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.43% (0.3498 => 0.3618, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.40% (11.6398 => 12.0354, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.6926 => 4.8464, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 2.35% (11.9555 => 12.2370, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8927, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1645, std.dev.: 0.1408) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6335, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2017, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5048, std.dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4463, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4436, std.dev.: 0.0335) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.71% (25.4195 => 16.5974, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary2: -10.41% (0.2402 => 0.2152, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7852, std.dev.: 0.0587) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6922, std.dev.: 0.0931) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5708, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9588, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 05:50:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 07:50:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922125058.0F8B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4140?compare_to=4137&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4140, Order: 164456, Start Time: 2012-09-22 11:41:29, End Time: 2012-09-22 12:52:27 To: 4137, Order: 164454, Start Time: 2012-09-22 09:29:17, End Time: 2012-09-22 10:39:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (76 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 894 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.4438 => 1.4608, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: 1.07% (1.1762 => 1.1888, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.70% (21.9653 => 22.7786, std.dev.: 0.0807) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.98% (39.5098 => 40.2927, std.dev.: 0.1647) MultiSource/Applications/SPASS/SPASS: 1.46% (8.1880 => 8.3078, std.dev.: 0.0302) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.4399 => 1.4218, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.71% (1.0119 => 1.0047, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 0.36% (0.5862 => 0.5883, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -0.13% (0.1521 => 0.1519, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.52% (0.1320 => 0.1340, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.34% (0.2902 => 0.2892, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.23% (0.2196 => 0.2201, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.54% (0.2975 => 0.2991, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.10% (0.2098 => 0.2121, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: 2.88% (0.0278 => 0.0286, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.75% (0.0080 => 0.0053, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0193 => 0.0193, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.78% (0.0387 => 0.0390, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 38.89% (0.0216 => 0.0300, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0282 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0323 => 0.0326, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0178 => 0.0179, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0192 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0248 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: - (0.0125 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1455 => 0.1458, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -1.39% (1.4964 => 1.4756, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1497 => 0.1496, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.75% (0.4247 => 0.4003, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.74% (0.1440 => 0.1343, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.80% (0.0561 => 0.0616, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.91% (0.0230 => 0.0221, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.85% (0.0572 => 0.0594, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1302 => 1.1286, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 12.50% (0.0024 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.77% (0.0565 => 0.0555, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.88% (0.0134 => 0.0166, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7656 => 0.7649, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.5984 => 1.5985, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.16% (4.1772 => 3.1262, std.dev.: 0.0638) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 9.41% (2.1763 => 2.3811, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.36% (0.6410 => 0.6946, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 7.14% (0.5309 => 0.5688, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 6.69% (0.6173 => 0.6586, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.34% (0.3582 => 0.3809, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 6.32% (1.0046 => 1.0681, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.25% (1.1653 => 1.2381, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.5150 => 1.5942, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 4.84% (15.3105 => 16.0517, std.dev.: 0.1786) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3217 => 0.3364, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (0.6915 => 0.7228, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 4.40% (29.3170 => 30.6082, std.dev.: 0.1308) MultiSource/Applications/d/make_dparser: 4.34% (3.0225 => 3.1536, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.2552 => 0.2661, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2886 => 0.3007, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.18% (0.3901 => 0.4064, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.11% (12.6413 => 13.1603, std.dev.: 0.0640) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.99% (0.2654 => 0.2760, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.92% (1.1440 => 1.1888, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.6069 => 0.6305, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.82% (0.7639 => 0.7931, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.72% (0.2797 => 0.2901, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.65% (0.4248 => 0.4403, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.59% (4.7455 => 4.9158, std.dev.: 0.0254) MultiSource/Applications/SPASS/SPASS: 3.53% (13.3238 => 13.7946, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.51% (1.4113 => 1.4608, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.41% (1.1672 => 1.2070, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (8.2186 => 8.4963, std.dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: 3.30% (14.6079 => 15.0900, std.dev.: 0.0248) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0821 => 1.1165, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.1827 => 1.2202, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.16% (0.4562 => 0.4706, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.14% (1.3268 => 1.3685, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.2021 => 1.2393, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 3.02% (2.0972 => 2.1605, std.dev.: 0.0146) MultiSource/Applications/treecc/treecc: 2.88% (1.8798 => 1.9340, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.73% (0.8569 => 0.8803, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.63% (6.2546 => 6.4192, std.dev.: 0.0278) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (1.0689 => 1.0970, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.4908 => 6.6614, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.4408 => 1.4780, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8405 => 0.8611, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (4.0318 => 4.1301, std.dev.: 0.0205) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.7256 => 15.0704, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4880 => 0.4984, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.5963 => 0.6075, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.3380 => 4.4084, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.44% (8.2559 => 8.3750, std.dev.: 0.0441) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.41% (0.0766 => 0.0930, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.94% (0.0917 => 0.1054, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.54% (1.7426 => 1.9960, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.46% (4.0101 => 4.5498, std.dev.: 0.0973) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8059, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.09% (0.2694 => 0.2939, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.08% (1.0063 => 1.0977, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6068, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.33% (4.2129 => 4.4375, std.dev.: 0.0404) MultiSource/Benchmarks/Olden/health/health: 4.53% (0.3420 => 0.3575, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8453, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8719, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.51% (38.9255 => 40.2927, std.dev.: 0.1647) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.70% (14.4877 => 14.8794, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/mason/mason: 2.50% (0.5004 => 0.5129, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.21% (0.5876 => 0.6006, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.97% (22.3381 => 22.7786, std.dev.: 0.0807) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9152 => 2.9590, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.60% (8.9977 => 8.7638, std.dev.: 0.0793) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.21% (0.3497 => 0.2056, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.58% (5.2665 => 4.0774, std.dev.: 0.0780) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.1647 => 0.9594, std.dev.: 0.0312) SingleSource/Benchmarks/Shootout-C++/ary3: -17.48% (1.7473 => 1.4419, std.dev.: 0.1112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.77% (15.8312 => 13.1758, std.dev.: 0.1829) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.34% (0.0917 => 0.0813, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9407, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3729, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8713, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3316, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -6.55% (1.4441 => 1.3495, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: -6.50% (7.6833 => 7.1840, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: -6.02% (3.4230 => 3.2168, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9536, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1867, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.14% (0.4564 => 0.4375, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -3.45% (0.4296 => 0.4148, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.34% (1.2722 => 1.2297, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9426, std.dev.: 0.0740) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.14% (3.7496 => 3.6318, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2864, std.dev.: 0.0193) MultiSource/Applications/SPASS/SPASS: -2.63% (8.5323 => 8.3078, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.47% (3.9413 => 3.8441, std.dev.: 0.0248) MultiSource/Benchmarks/PAQ8p/paq8p: -2.44% (92.7467 => 90.4875, std.dev.: 0.5631) MultiSource/Benchmarks/FreeBench/neural/neural: -2.19% (1.0926 => 1.0687, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -2.04% (3.4286 => 3.3586, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.02% (1.1683 => 1.1447, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3118, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -1.91% (3.4876 => 3.4209, std.dev.: 0.0215) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.76% (2.4457 => 2.4027, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: -1.75% (2.4971 => 2.4533, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2234, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (16.5617 => 16.3132, std.dev.: 0.0740) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3084, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.67% (0.9980 => 1.0047, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: -2.31% (0.6022 => 0.5883, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -8.82% (0.1666 => 0.1519, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.77% (0.1554 => 0.1340, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (0.3083 => 0.2892, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.06% (0.2394 => 0.2201, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.80% (0.3175 => 0.2991, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.86% (0.2302 => 0.2121, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -36.30% (0.0449 => 0.0286, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -77.92% (0.0240 => 0.0053, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -1.75% (1.5019 => 1.4756, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.12% (0.4264 => 0.4003, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1344 => 0.1343, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.58% (0.0589 => 0.0616, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.74% (0.0232 => 0.0221, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.04% (0.0639 => 0.0594, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1286, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.87% (0.0637 => 0.0555, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.52% (0.0246 => 0.0166, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.05% (1.5363 => 1.5985, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 06:08:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 08:08:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922130802.36CBA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4141?compare_to=4138&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4141, Order: 164456, Start Time: 2012-09-22 11:54:26, End Time: 2012-09-22 13:09:30 To: 4138, Order: 164454, Start Time: 2012-09-22 09:42:26, End Time: 2012-09-22 10:59:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (182 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (693 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5147 => 56.5716, std.dev.: 0.0618) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.72% (2.0176 => 2.4356, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 12.39% (0.5818 => 0.6539, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 12.33% (0.5748 => 0.6457, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.47% (0.7061 => 0.7871, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 11.30% (0.4328 => 0.4817, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.06% (0.7710 => 0.8563, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.06% (0.2596 => 0.2883, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.05% (3.9660 => 4.4043, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.97% (1.3693 => 1.5195, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.83% (0.1588 => 0.1760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.68% (0.4062 => 0.4496, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.56% (0.5265 => 0.5821, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.41% (0.3899 => 0.4305, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (0.7038 => 0.7766, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.27% (1.2193 => 1.3445, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.19% (0.3022 => 0.3330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.17% (0.1327 => 0.1462, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.16% (0.3130 => 0.3448, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.16% (0.6959 => 0.7666, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.10% (0.3485 => 0.3837, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183) SingleSource/Benchmarks/Shootout-C++/random: 10.04% (0.2690 => 0.2960, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.00% (0.9199 => 1.0119, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2760 => 0.3035, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.96% (1.9828 => 2.1803, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.95% (1.4563 => 1.6012, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.90% (13.8202 => 15.1889, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.86% (0.3489 => 0.3833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.82% (0.2761 => 0.3032, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2988 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.69% (0.6283 => 0.6892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.69% (0.3756 => 0.4120, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.69% (1.1364 => 1.2465, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 9.66% (0.3293 => 0.3611, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.57% (0.3868 => 0.4238, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4016 => 0.4400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.29% (0.5577 => 0.6095, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3453 => 0.3773, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3650 => 0.3987, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4390 => 0.4795, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.14% (0.3534 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.05% (0.3789 => 0.4132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.04% (0.3914 => 0.4268, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.03% (1.0313 => 1.1244, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2127 => 0.2316, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.81% (0.4379 => 0.4765, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.81% (0.4791 => 0.5213, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560) MultiSource/Applications/Burg/burg: 8.69% (1.1061 => 1.2022, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.62% (0.2945 => 0.3199, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.59% (7.2180 => 7.8381, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.48% (0.2914 => 0.3161, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.47% (0.7506 => 0.8142, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.43% (0.5637 => 0.6112, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 8.41% (3.8646 => 4.1897, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: 8.34% (0.2243 => 0.2430, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.32% (0.7460 => 0.8081, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 8.32% (0.3220 => 0.3488, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.32% (16.6129 => 17.9948, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 8.24% (0.8310 => 0.8995, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.23% (3.6692 => 3.9710, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.11% (0.2023 => 0.2187, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 8.10% (0.2925 => 0.3162, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.03% (2.1791 => 2.3541, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 7.94% (1.9270 => 2.0801, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.94% (0.3755 => 0.4053, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.92% (3.1889 => 3.4415, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.89% (0.8698 => 0.9384, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.80% (0.6576 => 0.7089, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.69% (1.0594 => 1.1409, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.67% (1.3245 => 1.4261, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.55% (0.6744 => 0.7253, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.25% (0.4113 => 0.4411, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.12% (1.3813 => 1.4797, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 7.10% (0.2859 => 0.3062, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 7.09% (1.2749 => 1.3653, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.03% (4.3801 => 4.6881, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 7.03% (8.4961 => 9.0932, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 7.02% (14.8535 => 15.8959, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.01% (0.6135 => 0.6565, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.00% (4.4433 => 4.7545, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (1.3819 => 1.4766, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.83% (1.2292 => 1.3132, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.82% (0.2140 => 0.2286, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.79% (1.1333 => 1.2103, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (13.2842 => 14.1706, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 6.64% (0.3131 => 0.3339, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.64% (4.6629 => 4.9725, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.53% (0.8818 => 0.9394, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 6.52% (14.5298 => 15.4773, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 6.42% (0.6250 => 0.6651, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.38% (0.2321 => 0.2469, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 6.25% (6.5754 => 6.9864, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.08% (0.4805 => 0.5097, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.90% (3.2742 => 3.4675, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.73% (4.9865 => 5.2722, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.66% (1.5188 => 1.6047, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (6.2785 => 6.6284, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.9108 => 0.9594, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.21% (3.7467 => 3.9419, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.14% (2.1007 => 2.2086, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 4.71% (33.2944 => 34.8635, std.dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.16% (0.3511 => 0.3622, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.97% (16.2614 => 16.7436, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5136, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std.dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.52% (1.1560 => 1.2545, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4168, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7238, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.44% (10.7476 => 11.1173, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5821, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0510, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6005, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2236, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.41% (0.4657 => 0.3986, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.37% (22.5627 => 22.0284, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2778, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9657, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0260) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9209, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4787, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2466, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1989, std.dev.: 0.0208) MultiSource/Benchmarks/Bullet/bullet: -1.12% (7.3305 => 7.2486, std.dev.: 0.0294) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2423, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 06:13:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 08:13:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922131320.AA3E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4142?compare_to=4136&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4142, Order: 164456, Start Time: 2012-09-22 11:54:07, End Time: 2012-09-22 13:14:49 To: 4136, Order: 164453, Start Time: 2012-09-22 07:45:58, End Time: 2012-09-22 09:06:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (156 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (693 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (15.1603 => 15.5289, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.6178 => 56.5406, std.dev.: 0.0615) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5798 => 0.5800, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.03% (16.1343 => 16.1298, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 0.38% (14.9851 => 15.0419, std.dev.: 0.0160) MultiSource/Benchmarks/Bullet/bullet: 0.09% (83.4121 => 83.4869, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.3803 => 4.3741, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2384 => 1.2378, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.5410 => 7.5379, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.12% (3.7384 => 3.7340, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.18% (0.6523 => 0.6511, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.57% (0.0698 => 0.0694, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.01% (63.2438 => 83.4869, std.dev.: 0.0131) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14216.81% (0.0720 => 10.3081, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.79% (10.3673 => 15.5289, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/richards_benchmark: 29.72% (0.1622 => 0.2104, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.64% (2.2022 => 2.5467, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.42% (7.0540 => 8.1415, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.67% (0.0834 => 0.0948, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.21% (0.3543 => 0.4011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3473 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.80% (1.1194 => 1.2627) SingleSource/UnitTests/ObjC/exceptions-2: 12.64% (0.3497 => 0.3939, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 12.55% (0.3561 => 0.4008, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3516 => 0.3957, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.26% (0.3694 => 0.4147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.97% (0.3886 => 0.4351, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.95% (1.7609 => 1.9714, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.91% (0.1655 => 0.1819, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.42% (0.1125 => 0.1231, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.15% (0.2065 => 0.2254, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.98% (0.8172 => 0.8906, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 8.88% (9.4845 => 10.3267, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.69% (0.3177 => 0.3453, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.4879 => 0.5302, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.62% (0.3307 => 0.3592, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5925 => 0.6435, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.60% (0.4615 => 0.5012, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.37% (10.4361 => 11.3095, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.22% (0.5569 => 0.6027, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.11% (0.3121 => 0.3374, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.05% (0.8067 => 0.8716, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.01% (0.3109 => 0.3358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.99% (5.7591 => 6.2194, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 7.91% (0.2554 => 0.2756, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.89% (0.2700 => 0.2913, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.87% (0.7115 => 0.7675, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.83% (0.7433 => 0.8015, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.3423 => 0.3689, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.73% (1.3050 => 1.4059, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 7.71% (0.7326 => 0.7891, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2271 => 0.2446, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6675 => 0.7187, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.65% (4.2646 => 4.5908, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.55% (1.5415 => 1.6579, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (8.1363 => 8.7505, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 7.54% (3.3354 => 3.5868, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.42% (0.5860 => 0.6295, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2758 => 0.2961, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.35% (0.5105 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.29% (5.0018 => 5.3664, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.21% (4.9449 => 5.3015, std.dev.: 0.0071) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2905 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2107 => 0.2258, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.08% (0.7835 => 0.8390, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 7.05% (0.3092 => 0.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.00% (0.2714 => 0.2904, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.96% (0.1940 => 0.2075, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4636 => 0.4958, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.90% (7.9617 => 8.5108, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.89% (0.9765 => 1.0438, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3422 => 0.3657, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.4103 => 0.4384, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.75% (1.1642 => 1.2428, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.71% (0.5020 => 0.5357, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.4064 => 0.4332, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.58% (0.6456 => 0.6881, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.1861 => 1.2639, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.51% (0.4299 => 0.4579, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.50% (0.3387 => 0.3607, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4203 => 0.4475, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.47% (0.3865 => 0.4115, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 6.45% (3.8723 => 4.1221, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.42% (0.3441 => 0.3662, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.42% (0.3180 => 0.3384, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4289 => 0.4564, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.40% (1.5603 => 1.6602, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 6.37% (0.2871 => 0.3054, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.35% (2.0665 => 2.1977, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3650 => 0.3881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.3098 => 0.3293, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 6.25% (1.0722 => 1.1392, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.22% (0.2603 => 0.2765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4620 => 0.4905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3826 => 0.4062, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.16% (0.3603 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 6.10% (2.0273 => 2.1510, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.4048 => 0.4293, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 6.01% (21.9371 => 23.2554, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.92% (0.3935 => 0.4168, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.78% (0.6450 => 0.6823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.75% (0.3684 => 0.3896, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8921 => 0.9428, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 5.67% (2.2969 => 2.4272, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.53% (0.5981 => 0.6312, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 5.27% (0.2049 => 0.2157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.23% (1.5859 => 1.6688, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.17% (1.4186 => 1.4920, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.87% (0.3817 => 0.4003, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (14.3668 => 15.0637, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.1840 => 1.2401, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.63% (2.2024 => 2.3043, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2842 => 1.3414, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.64% (0.8101 => 0.8396, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.39% (17.1811 => 17.5910, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.07% (3.8922 => 3.9726, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.65% (3.6395 => 3.7724, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3473, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.58% (9.1159 => 9.2598, std.dev.: 0.0348) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5780, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2589, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.22% (5.3855 => 3.9194, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.85% (5.3526 => 3.9156, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1138, std.dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.29% (2.9384 => 2.6067, std.dev.: 0.0200) MultiSource/Applications/ClamAV/clamscan: -7.49% (22.1758 => 20.5142, std.dev.: 0.0303) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.75% (0.0400 => 0.0205, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3034, std.dev.: 0.1095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.94% (1.6805 => 1.5975, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5051, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -2.89% (1.2373 => 1.2015, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4973, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0902, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0076, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2517, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6842, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2342, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: -1.00% (12.5348 => 12.4094, std.dev.: 0.0167) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.92% (0.5229 => 0.5800, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.61% (14.9895 => 16.1298, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 6.26% (14.1553 => 15.0419, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/gs/gs: 6.41% (4.1105 => 4.3741, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.04% (1.1048 => 1.2378, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.30% (7.1582 => 7.5379, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.83% (3.4629 => 3.7340, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.64% (0.6222 => 0.6511, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.20% (0.2116 => 0.0694, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 07:14:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 09:14:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922141411.56F3D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4143?compare_to=4139&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4143, Order: 164454, Start Time: 2012-09-22 11:31:22, End Time: 2012-09-22 14:15:40 To: 4139, Order: 164453, Start Time: 2012-09-22 08:16:37, End Time: 2012-09-22 11:02:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.42% (0.3465 => 0.3930, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.38% (0.3469 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3442 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.87% (0.3643 => 0.4112, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.04% (0.1063 => 0.1191, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 10.77% (0.0947 => 0.1049, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.76% (1.5932 => 1.7646, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.95% (0.1620 => 0.1765, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.77% (0.5826 => 0.6337, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.77% (0.1619 => 0.1761, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.70% (0.1218 => 0.1324, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.5889 => 0.6396, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.54% (1.3152 => 1.4275, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.15% (2.7292 => 2.9515, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.10% (3.5627 => 3.8513, std.dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.3004 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.02% (0.1421 => 0.1535, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.98% (1.6211 => 1.7504, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.81% (0.4994 => 0.5384, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.74% (0.2738 => 0.2950, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.64% (0.5000 => 0.5382, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2875 => 0.3093, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.55% (1.0781 => 1.1595, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.54% (0.4361 => 0.4690, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 7.35% (5.5417 => 5.9491, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7171 => 0.7697, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 7.31% (0.2803 => 0.3008, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.25% (0.9909 => 1.0627, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.20% (0.3362 => 0.3604, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.17% (0.2566 => 0.2750, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.2014 => 0.2158, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3195 => 0.3423, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.04% (0.2729 => 0.2921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.98% (0.2750 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.98% (0.2780 => 0.2974, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.97% (0.2911 => 0.3114, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.97% (0.2813 => 0.3009, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.97% (2.0673 => 2.2113, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.95% (0.2792 => 0.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.94% (0.2823 => 0.3019, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.87% (0.2811 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (0.3930 => 0.4199, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 6.83% (4.2109 => 4.4986, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.82% (2.1013 => 2.2446, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3096 => 0.3305, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.71% (0.5026 => 0.5363, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3060 => 0.3265, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3267 => 0.3481, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.5900 => 0.6286, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.54% (0.3258 => 0.3471, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.53% (0.2068 => 0.2203, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.51% (0.6634 => 0.7066, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.46% (0.3903 => 0.4155, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.42% (0.2866 => 0.3050, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.1968 => 0.2094, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.40% (0.3282 => 0.3492, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.2736 => 0.2911, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.37% (0.3124 => 0.3323, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3317 => 0.3527, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (0.2691 => 0.2861, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.30% (0.3348 => 0.3559, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 6.26% (4.6177 => 4.9066, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 6.25% (0.3678 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.24% (0.3477 => 0.3694, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.23% (0.3625 => 0.3851, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.18% (0.4029 => 0.4278, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.07% (0.3726 => 0.3952, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.03% (1.8794 => 1.9927, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.02% (0.3890 => 0.4124, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.98% (4.4195 => 4.6838, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.93% (0.3690 => 0.3909, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.92% (0.4139 => 0.4384, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.90% (0.9697 => 1.0269, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 5.88% (2.1653 => 2.2926, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4146 => 0.4389, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 5.86% (0.4251 => 0.4500, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.84% (0.4658 => 0.4930, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 5.83% (23.5202 => 24.8921, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.80% (0.3845 => 0.4068, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 5.78% (1.4269 => 1.5094, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.71% (1.9694 => 2.0818, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 5.70% (0.3336 => 0.3526, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.65% (0.3981 => 0.4206, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.2040 => 0.2154, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (1.9966 => 2.1069, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 5.39% (0.5546 => 0.5845, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.38% (0.3271 => 0.3447, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.22% (0.6435 => 0.6771, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 5.19% (0.5012 => 0.5272, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 5.19% (0.2391 => 0.2515, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.15% (0.2969 => 0.3122, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2737 => 0.2878, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.05% (0.7875 => 0.8273, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.96% (0.3084 => 0.3237, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4.85% (2.0346 => 2.1332, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.16% (0.4253 => 0.4430, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3792 => 0.3946, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 3.98% (0.4847 => 0.5040, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.60% (0.7426 => 0.7693, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.38% (0.5361 => 0.5542, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.90% (11.6398 => 11.9779, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.76% (4.6926 => 4.8221, std.dev.: 0.0121) MultiSource/Applications/kimwitu++/kc: 1.91% (11.9555 => 12.1843, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6782, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1753, std.dev.: 0.1425) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6274, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2050, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5071, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2274, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4452, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2893, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5792, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4580, std.dev.: 0.0343) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2451 => 1.2578, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5636, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7907, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std.dev.: 0.0105) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7937, std.dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9762, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 07:47:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 09:47:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922144719.86BED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4144?compare_to=4140&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4144, Order: 164459, Start Time: 2012-09-22 13:37:03, End Time: 2012-09-22 14:48:47 To: 4140, Order: 164456, Start Time: 2012-09-22 11:41:29, End Time: 2012-09-22 12:52:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 9 (71 on baseline) Performance Improvements: 3 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 888 (782 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 1.01% (1.0681 => 1.0789, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 12.92% (1.6451 => 1.8577, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.51% (2.3566 => 2.5806, std.dev.: 0.0787) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.84% (4.0774 => 4.1930, std.dev.: 0.0250) MultiSource/Applications/siod/siod: 2.64% (3.5623 => 3.6562, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.84% (2.6851 => 2.7344, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout/hash: 1.57% (4.2896 => 4.3568, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 1.37% (6.9209 => 7.0157, std.dev.: 0.0298) SingleSource/Benchmarks/McGill/chomp: 1.32% (1.0258 => 1.0393, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.56% (22.7786 => 21.0558, std.dev.: 0.5542) SingleSource/Benchmarks/Misc/ffbench: -2.66% (1.4046 => 1.3673, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/tsp/tsp: -1.64% (1.7706 => 1.7415, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.55% (1.0047 => 1.0102, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 0.34% (0.5883 => 0.5903, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 0.99% (0.1519 => 0.1534, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.64% (0.1340 => 0.1318, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.56% (0.2892 => 0.2995, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.86% (0.2201 => 0.2242, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.37% (0.2991 => 0.3002, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.14% (0.2121 => 0.2118, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -5.24% (0.0286 => 0.0271, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -44.94% (0.0089 => 0.0049, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: 2.27% (0.0088 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 56.60% (0.0053 => 0.0083) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.59% (0.0193 => 0.0198, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0300 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.00% (0.0284 => 0.0213, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0326 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0179 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -15.62% (0.0192 => 0.0162, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -3.61% (0.0249 => 0.0240, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -34.40% (0.0125 => 0.0082, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1458 => 0.1457, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 0.19% (1.4756 => 1.4784, std.dev.: 0.0367) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.41% (0.1496 => 0.1430, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.35% (0.4003 => 0.4057, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.54% (0.1343 => 0.1404, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.15% (0.0616 => 0.0535, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.91% (0.0221 => 0.0177, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.91% (0.0594 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1286 => 1.1267, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.41% (0.0555 => 0.0585, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.60% (0.0166 => 0.0165, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7649 => 0.7660, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.06% (1.5985 => 1.5994, std.dev.: 0.0063) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.45% (4.1772 => 3.1559, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 9.64% (2.1763 => 2.3860, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.99% (0.6410 => 0.6986, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1159 => 0.1261, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.78% (0.1414 => 0.1524, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 7.46% (0.5309 => 0.5705, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 7.40% (1.0046 => 1.0789, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 6.91% (1.1653 => 1.2458, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 6.69% (0.6173 => 0.6586, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 5.65% (15.3105 => 16.1753, std.dev.: 0.0947) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.16% (0.3582 => 0.3767, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 5.02% (29.3170 => 30.7885, std.dev.: 0.1205) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.6915 => 0.7251, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.5150 => 1.5828, std.dev.: 0.0180) MultiSource/Applications/hbd/hbd: 4.47% (1.3268 => 1.3861, std.dev.: 0.0168) MultiSource/Applications/d/make_dparser: 4.45% (3.0225 => 3.1571, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.33% (0.3901 => 0.4070, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.03% (0.7639 => 0.7947, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.6069 => 0.6299, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.72% (0.2797 => 0.2901, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (12.6413 => 13.1088, std.dev.: 0.1754) MultiSource/Applications/SPASS/SPASS: 3.65% (13.3238 => 13.8101, std.dev.: 0.1097) MultiSource/Applications/oggenc/oggenc: 3.58% (4.7455 => 4.9152, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.53% (1.2021 => 1.2445, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3217 => 0.3327, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.41% (0.4248 => 0.4393, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (8.2186 => 8.4917, std.dev.: 0.0544) MultiSource/Applications/lua/lua: 3.26% (3.5980 => 3.7154, std.dev.: 0.0269) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.6079 => 15.0746, std.dev.: 0.1374) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.14% (3.0758 => 3.1725, std.dev.: 0.0132) MultiSource/Applications/siod/siod: 3.14% (2.0972 => 2.1630, std.dev.: 0.0254) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0821 => 1.1156, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8405 => 0.8660, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.7256 => 15.1474, std.dev.: 0.1070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.76% (2.0317 => 2.0878, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.4408 => 1.4800, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.61% (0.8569 => 0.8793, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.1827 => 1.2133, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.57% (1.0689 => 1.0964, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4880 => 0.4983, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.91% (1.4189 => 1.4460, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.65% (4.2616 => 4.3320, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 15.53% (1.7426 => 2.0133, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5503, std.dev.: 0.0212) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.19% (1.0063 => 1.1088, std.dev.: 0.0134) SingleSource/Benchmarks/Stanford/Puzzle: 10.12% (0.1433 => 0.1578, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.07% (0.2857 => 0.3116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.56% (7.0025 => 7.6017, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (0.3301 => 0.3464, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8499, std.dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: 3.87% (0.9851 => 1.0232, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8726, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 3.17% (8.5113 => 8.7812, std.dev.: 0.0334) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.10% (0.5876 => 0.6058, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.93% (3.5520 => 3.6562, std.dev.: 0.0152) MultiSource/Benchmarks/sim/sim: 2.83% (3.8907 => 4.0008, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8971, std.dev.: 0.0673) SingleSource/Benchmarks/Shootout-C++/hash: 2.74% (0.6308 => 0.6481, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.58% (2.6656 => 2.7344, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/mason/mason: 2.44% (0.5004 => 0.5126, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 1.95% (1.0194 => 1.0393, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: 1.58% (2.3453 => 2.3823, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (2.4455 => 2.4782, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/hash: 1.28% (4.3016 => 4.3568, std.dev.: 0.0136) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4455, std.dev.: 0.0485) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.03% (0.3497 => 0.2097, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -20.56% (1.7473 => 1.3880, std.dev.: 0.0476) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.38% (5.2665 => 4.1930, std.dev.: 0.0250) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.1647 => 0.9608, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.60% (15.8312 => 13.3616, std.dev.: 0.1069) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std.dev.: 0.0143) MultiSource/Applications/sgefa/sgefa: -11.24% (0.3746 => 0.3325, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.96% (3.2007 => 2.9458, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3748, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.58% (2.0027 => 1.8709, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3343, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -6.22% (7.6833 => 7.2056, std.dev.: 0.0332) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3548, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: -6.07% (3.4230 => 3.2152, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9372, std.dev.: 0.0543) SingleSource/Benchmarks/Shootout/fib2: -5.15% (4.4195 => 4.1918, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.25% (0.4564 => 0.4370, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -3.59% (9.2503 => 8.9186, std.dev.: 0.0238) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.51% (1.2722 => 1.2276, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: -3.15% (1.4117 => 1.3673, std.dev.: 0.0101) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.86% (1.2959 => 1.2588, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2864, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.54% (3.7496 => 3.6542, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.25% (1.1683 => 1.1420, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -2.07% (1.0926 => 1.0700, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3626, std.dev.: 0.0187) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4226, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2366, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: -1.47% (92.7467 => 91.3828, std.dev.: 0.2925) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3352, std.dev.: 0.0388) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.22% (0.9980 => 1.0102, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: -1.98% (0.6022 => 0.5903, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -7.92% (0.1666 => 0.1534, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.19% (0.1554 => 0.1318, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.85% (0.3083 => 0.2995, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.35% (0.2394 => 0.2242, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (0.3175 => 0.3002, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.99% (0.2302 => 0.2118, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -39.64% (0.0449 => 0.0271, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -44.94% (0.0089 => 0.0049, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.13% (0.0192 => 0.0198, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.00% (0.0284 => 0.0213, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -14.29% (0.0189 => 0.0162, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -3.61% (0.0249 => 0.0240, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -74.77% (0.0325 => 0.0082, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.96% (0.1429 => 0.1457, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -1.56% (1.5019 => 1.4784, std.dev.: 0.0367) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.73% (0.1501 => 0.1430, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1344 => 0.1404, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.17% (0.0589 => 0.0535, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.71% (0.0232 => 0.0177, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.31% (0.0639 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.73% (1.1350 => 1.1267, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.16% (0.0637 => 0.0585, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (0.0246 => 0.0165, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.11% (1.5363 => 1.5994, std.dev.: 0.0063) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 08:03:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 10:03:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922150323.6E1A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4145?compare_to=4141&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4145, Order: 164459, Start Time: 2012-09-22 13:50:01, End Time: 2012-09-22 15:04:51 To: 4141, Order: 164456, Start Time: 2012-09-22 11:54:26, End Time: 2012-09-22 13:09:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.70% (2.0176 => 2.4352, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.52% (0.1410 => 0.1657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0819 => 0.0927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 12.50% (0.5818 => 0.6545, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5748 => 0.6456, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 12.28% (0.7061 => 0.7928, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.30% (0.4328 => 0.4817, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.04% (0.2781 => 0.3088, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.99% (3.9660 => 4.4020, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 10.99% (1.3693 => 1.5198, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.96% (0.7710 => 0.8555, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.89% (0.1588 => 0.1761, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.88% (0.4062 => 0.4504, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.86% (0.2596 => 0.2878, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.52% (0.6959 => 0.7691, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.49% (0.3899 => 0.4308, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.41% (0.5265 => 0.5813, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.39% (0.3022 => 0.3336, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (0.7038 => 0.7766, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.24% (0.3485 => 0.3842, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.20% (0.2607 => 0.2873, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.19% (0.3130 => 0.3449, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.18% (1.2193 => 1.3434, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.16% (0.9199 => 1.0134, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.14% (1.4563 => 1.6039, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.12% (1.9828 => 2.1835, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2721 => 0.2993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.97% (0.3580 => 0.3937, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.95% (0.1327 => 0.1459, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3489 => 0.3834, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.85% (0.3868 => 0.4249, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.84% (0.3293 => 0.3617, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.82% (0.3756 => 0.4125, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.81% (13.8202 => 15.1753, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.78% (1.1364 => 1.2475, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.76% (0.4016 => 0.4408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.67% (0.2988 => 0.3277) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.6283 => 0.6886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.53% (0.3453 => 0.3782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.52% (0.3192 => 0.3496, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3578 => 0.3914, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5577 => 0.6090, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.16% (0.4390 => 0.4792, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733) MultiSource/Applications/lemon/lemon: 9.06% (1.0313 => 1.1247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.05% (0.3789 => 0.4132, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.03% (0.3246 => 0.3539, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.95% (0.4379 => 0.4771, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.88% (0.2995 => 0.3261, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.87% (0.4791 => 0.5216, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.79% (0.2127 => 0.2314, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.79% (1.1061 => 1.2033, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.74% (0.7506 => 0.8162, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.73% (0.3220 => 0.3501, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.61% (7.2180 => 7.8392, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.54% (0.2914 => 0.3163, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.52% (0.5637 => 0.6117, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.47% (0.7460 => 0.8092, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 8.38% (16.6129 => 18.0047, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 8.36% (3.8646 => 4.1875, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.34% (3.6692 => 3.9751, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.2243 => 0.2429, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.16% (0.8310 => 0.8988, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.16% (0.2023 => 0.2188, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 8.06% (1.9270 => 2.0823, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.99% (0.1865 => 0.2014, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.98% (2.1791 => 2.3531, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 7.96% (3.1889 => 3.4428, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.92% (0.8698 => 0.9387, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.86% (0.3755 => 0.4050, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 7.78% (0.6744 => 0.7269, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1478 => 0.1593, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.68% (0.6576 => 0.7081, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.64% (1.3245 => 1.4257, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 7.63% (1.0594 => 1.1402, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.4113 => 0.4413, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 7.25% (14.8535 => 15.9306, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.24% (0.3245 => 0.3480, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 7.18% (1.2749 => 1.3664, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (4.4433 => 4.7605, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 7.14% (0.2859 => 0.3063, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.13% (4.3801 => 4.6922, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.04% (0.6135 => 0.6567, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.01% (8.4961 => 9.0921, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.99% (1.3813 => 1.4779, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.99% (1.3819 => 1.4785, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.2140 => 0.2289, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.94% (1.2292 => 1.3145, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.89% (13.2842 => 14.1990, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (1.1333 => 1.2108, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 6.71% (0.3131 => 0.3341, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.61% (4.6629 => 4.9710, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 6.55% (14.5298 => 15.4809, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6250 => 0.6656, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.33% (0.8818 => 0.9376, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.25% (6.5754 => 6.9862, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.01% (0.4805 => 0.5094, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.93% (3.2742 => 3.4684, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.85% (4.9865 => 5.2780, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.63% (1.5188 => 1.6043, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (6.2785 => 6.6221, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.46% (0.9108 => 0.9605, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.24% (3.7467 => 3.9431, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.17% (2.1007 => 2.2093, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.84% (33.2944 => 34.9072, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7790, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.16% (0.3511 => 0.3622, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std.dev.: 0.0418) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (0.2093 => 0.2223, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7242, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.53% (1.9199 => 1.9876, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1147, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5932, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0512, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5831, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.07% (12.0921 => 12.2213, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5875, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.34% (0.4657 => 0.3989, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.50% (22.5627 => 21.9991, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2861, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0274) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9445, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2408, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1248, std.dev.: 0.0397) SingleSource/Benchmarks/McGill/chomp: -1.36% (1.2308 => 1.2141, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2215, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.05% (7.3305 => 7.2534, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2631, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 08:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 10:08:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922150831.183662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4146?compare_to=4142&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4146, Order: 164459, Start Time: 2012-09-22 13:49:47, End Time: 2012-09-22 15:09:58 To: 4142, Order: 164456, Start Time: 2012-09-22 11:54:07, End Time: 2012-09-22 13:14:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (156 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.14% (3.7685 => 3.8870, std.dev.: 0.0280) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.5800 => 0.5790, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.04% (16.1298 => 16.1365, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: -0.14% (15.0419 => 15.0211, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: -0.05% (83.4869 => 83.4483, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/gs/gs: 0.18% (4.3741 => 4.3818, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.08% (1.2378 => 1.2368, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.5379 => 7.5373, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.7340 => 3.7338, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6511 => 0.6509, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.75% (0.0694 => 0.0668, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.95% (63.2438 => 83.4483, std.dev.: 0.0232) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14234.58% (0.0720 => 10.3209, std.dev.: 0.0059) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.76% (10.3673 => 15.5261, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/richards_benchmark: 29.65% (0.1622 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.95% (0.0834 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.63% (2.2022 => 2.5465, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.42% (7.0540 => 8.1417, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/flops: 14.66% (0.1432 => 0.1642, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.92% (0.1566 => 0.1784, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.41% (0.3543 => 0.4018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3473 => 0.3921, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.77% (1.1194 => 1.2624, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 12.67% (0.3497 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.50% (0.3561 => 0.4006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.18% (0.3694 => 0.4144, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.97% (1.7609 => 1.9717, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.97% (0.1655 => 0.1820, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.91% (0.1625 => 0.1786, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.33% (0.1125 => 0.1230, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.84% (0.3177 => 0.3458, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.72% (9.4845 => 10.3117, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.56% (0.4615 => 0.5010, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 8.10% (10.4361 => 11.2816, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.10% (0.4879 => 0.5274, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (0.8172 => 0.8833, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 8.01% (5.7591 => 6.2206, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 7.99% (0.7433 => 0.8027, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 7.99% (0.2554 => 0.2758, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.93% (0.2700 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3423 => 0.3693, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.88% (0.3109 => 0.3354, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.86% (0.7115 => 0.7674, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.79% (0.6675 => 0.7195, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.75% (1.5415 => 1.6609, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2271 => 0.2446, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.66% (3.3354 => 3.5909, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.61% (1.3050 => 1.4043, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (8.1363 => 8.7531, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (4.2646 => 4.5872, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5569 => 0.5988, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.49% (0.5860 => 0.6299, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.43% (0.4103 => 0.4408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2758 => 0.2963, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.35% (0.5105 => 0.5480, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.34% (0.3121 => 0.3350, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.31% (0.2107 => 0.2261, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.30% (0.3136 => 0.3365, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.30% (0.7835 => 0.8407, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.30% (5.0018 => 5.3668, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.29% (0.1892 => 0.2030, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.27% (4.9449 => 5.3042, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 7.21% (0.3092 => 0.3315, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.07% (0.2714 => 0.2906, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.04% (0.8067 => 0.8635, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.01% (0.1940 => 0.2076, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4636 => 0.4959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.95% (0.2793 => 0.2987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.91% (7.9617 => 8.5117, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.86% (0.9765 => 1.0435, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.73% (0.5020 => 0.5358, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.73% (0.3865 => 0.4125, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.73% (1.1642 => 1.2425, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 6.65% (0.4299 => 0.4585, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.64% (0.4064 => 0.4334, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.61% (0.6456 => 0.6883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4289 => 0.4568, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1861 => 1.2630, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.45% (0.3180 => 0.3385, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.43% (3.8723 => 4.1213, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/strcat: 6.43% (0.2831 => 0.3013, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.40% (1.5603 => 1.6601, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.38% (0.3650 => 0.3883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.35% (0.4203 => 0.4470, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.34% (2.0665 => 2.1975, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.30% (0.3603 => 0.3830) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.26% (0.2603 => 0.2766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3379 => 0.3590, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.20% (0.3387 => 0.3597, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.19% (1.0722 => 1.1386, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.07% (2.0273 => 2.1503, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 6.06% (21.9371 => 23.2668, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: 6.06% (0.4620 => 0.4900, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.02% (0.3935 => 0.4172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 5.80% (2.2969 => 2.4302, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3684 => 0.3897, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.72% (0.6450 => 0.6819, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.65% (0.8921 => 0.9425, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.42% (0.5981 => 0.6305, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.20% (1.5859 => 1.6684, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 5.17% (0.2049 => 0.2155, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.4186 => 1.4905, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.82% (0.3817 => 0.4001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (14.3668 => 15.0570, std.dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 4.79% (1.1840 => 1.2407, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.68% (2.2024 => 2.3055, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3409, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.82% (0.3427 => 0.3558, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.64% (0.8101 => 0.8396, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5742, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.8922 => 3.9745, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8965, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3837, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 2.88% (3.7781 => 3.8870, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3491, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2864, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2579, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.23% (5.3855 => 3.9191, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.87% (5.3526 => 3.9146, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1623, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.39% (2.9384 => 2.6038, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -7.56% (22.1758 => 20.4986, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2858, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7087, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5970, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5057, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.34% (1.2373 => 1.2084, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5013, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0043, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2499, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1049, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4248, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.35% (6.2999 => 6.2148, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.73% (0.5229 => 0.5790, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.65% (14.9895 => 16.1365, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: 6.12% (14.1553 => 15.0211, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 6.60% (4.1105 => 4.3818, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.95% (1.1048 => 1.2368, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.30% (7.1582 => 7.5373, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.82% (3.4629 => 3.7338, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.61% (0.6222 => 0.6509, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 09:38:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 11:38:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922163813.1D17F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4147?compare_to=4144&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4147, Order: 164460, Start Time: 2012-09-22 15:29:11, End Time: 2012-09-22 16:39:42 To: 4144, Order: 164459, Start Time: 2012-09-22 13:37:03, End Time: 2012-09-22 14:48:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (90 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 893 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.70% (0.4509 => 0.4721, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.68% (0.8845 => 0.9259, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.57% (0.5533 => 0.5675, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.30% (57.2275 => 60.2588, std.dev.: 0.3540) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.61% (21.0558 => 22.0259, std.dev.: 0.3560) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.59% (1.3861 => 1.3640, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.33% (44.8013 => 44.2074, std.dev.: 0.0279) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.62% (1.0102 => 1.0165, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.5903 => 0.5866, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -0.98% (0.1534 => 0.1519, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.99% (0.1318 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.93% (0.2995 => 0.2967, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.12% (0.2242 => 0.2217, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.53% (0.3002 => 0.2986, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.85% (0.2118 => 0.2100, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 3.69% (0.0271 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 81.63% (0.0049 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0083 => 0.0083, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.53% (0.0198 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.74% (0.0389 => 0.0355, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.99% (0.0303 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 33.80% (0.0213 => 0.0285, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0323 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.55% (0.0181 => 0.0182, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -6.79% (0.0162 => 0.0151, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 2.50% (0.0240 => 0.0246, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 54.88% (0.0082 => 0.0127, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1457 => 0.1468, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 2.66% (1.4784 => 1.5177, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.59% (0.1430 => 0.1510, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.52% (0.4057 => 0.4036, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.78% (0.1404 => 0.1415, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 18.69% (0.0535 => 0.0635, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.13% (0.0177 => 0.0179, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.62% (0.0641 => 0.0605, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1267 => 1.1270, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.54% (0.0585 => 0.0594, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.85% (0.0165 => 0.0239, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7660 => 0.7655, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.5994 => 1.5995, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.41% (0.0121 => 0.0060, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.61% (4.1772 => 3.1075, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.32% (0.1159 => 0.1267, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.35% (0.1414 => 0.1532, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 8.16% (2.1763 => 2.3539, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++/bigfib: 7.67% (0.5309 => 0.5716, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.57% (0.6410 => 0.6895, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 6.84% (1.0046 => 1.0733, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 6.54% (0.6173 => 0.6577, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (1.1653 => 1.2375, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 5.39% (15.3105 => 16.1355, std.dev.: 0.0740) MultiSource/Applications/lambda-0_1_3/lambda: 5.34% (0.6915 => 0.7284, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.5150 => 1.5943, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.16% (0.3582 => 0.3767, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.92% (0.3901 => 0.4093, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.4248 => 0.4450, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.2552 => 0.2672, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3217 => 0.3364, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.45% (0.7639 => 0.7979, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 4.32% (1.1440 => 1.1934, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 4.24% (3.0225 => 3.1506, std.dev.: 0.0377) MultiSource/Benchmarks/Bullet/bullet: 4.09% (29.3170 => 30.5148, std.dev.: 0.3384) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.08% (0.4880 => 0.5079, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (12.6413 => 13.1451, std.dev.: 0.1118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.97% (0.6069 => 0.6310, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (3.0758 => 3.1977, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.86% (0.7722 => 0.8020, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.84% (0.2654 => 0.2756, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.79% (0.2797 => 0.2903, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.69% (0.3008 => 0.3119, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.67% (0.2886 => 0.2992, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.57% (13.3238 => 13.7988, std.dev.: 0.1133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.7226 => 0.7480, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 3.50% (3.5980 => 3.7239, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (1.1672 => 1.2080, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (8.2186 => 8.4985, std.dev.: 0.0326) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.37% (0.2996 => 0.3097, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.1827 => 1.2205, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 3.09% (14.6079 => 15.0594, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.96% (0.8569 => 0.8823, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 2.93% (0.8405 => 0.8651, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.81% (0.5520 => 0.5675, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.80% (1.3268 => 1.3640, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.0317 => 2.0870, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.72% (0.4596 => 0.4721, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.72% (6.2546 => 6.4246, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.71% (1.2021 => 1.2347, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.4908 => 6.6668, std.dev.: 0.0407) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0821 => 1.1114, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.0689 => 1.0973, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.7256 => 15.1136, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9029 => 0.9259, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (4.0318 => 4.1319, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (1.4189 => 1.4524, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (1.4113 => 1.4443, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.5963 => 0.6082, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.94% (4.2616 => 4.3441, std.dev.: 0.0271) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.87% (4.3380 => 4.4190, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 1.81% (3.8796 => 3.9498, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.36% (8.2559 => 8.3680, std.dev.: 0.0207) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.29% (1.6538 => 2.3366, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.76% (0.0766 => 0.0948, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0138) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.59% (0.0917 => 0.1060, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.78% (1.7426 => 2.0002, std.dev.: 0.0562) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.36% (4.0101 => 4.5457, std.dev.: 0.0219) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.77% (0.1433 => 0.1573, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 8.28% (7.0025 => 7.5822, std.dev.: 0.0777) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.39% (1.0063 => 1.0807, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.69% (40.4792 => 42.3778, std.dev.: 0.4464) SingleSource/Benchmarks/Misc/ReedSolomon: 4.03% (8.5113 => 8.8541, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (6.6312 => 6.8730, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 3.60% (15.2242 => 15.7717, std.dev.: 0.0814) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.32% (0.5876 => 0.6071, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: 3.05% (0.9851 => 1.0151, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 3.04% (14.4877 => 14.9277, std.dev.: 0.0449) MultiSource/Benchmarks/FreeBench/mason/mason: 2.64% (0.5004 => 0.5136, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 2.56% (3.8907 => 3.9904, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 2.20% (1.0194 => 1.0418, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 2.12% (0.6308 => 0.6442, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 1.92% (2.4013 => 2.4473, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.90% (4.6127 => 4.7003, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/whetstone: 1.88% (2.3453 => 2.3895, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 1.02% (1.4184 => 1.4329, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.02% (27.1724 => 27.4485, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.06% (0.3497 => 0.2061, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.02% (5.2665 => 4.1594, std.dev.: 0.0884) SingleSource/Benchmarks/Shootout-C++/ary3: -20.50% (1.7473 => 1.3891, std.dev.: 0.0494) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.35% (1.1647 => 0.9626, std.dev.: 0.0297) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.14% (15.8312 => 13.4342, std.dev.: 0.0797) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1572, std.dev.: 0.0205) MultiSource/Applications/sgefa/sgefa: -11.24% (0.3746 => 0.3325, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.83% (3.2007 => 2.9501, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3754, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -6.66% (4.6355 => 4.3268, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -6.43% (7.6833 => 7.1889, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -5.73% (1.4441 => 1.3613, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9564, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1872, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/misr: -3.51% (0.4296 => 0.4145, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -3.14% (9.2503 => 8.9599, std.dev.: 0.0326) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6393, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.77% (45.4683 => 44.2074, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.67% (3.9413 => 3.8360, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4204, std.dev.: 0.0145) MultiSource/Benchmarks/llubenchmark/llu: -1.91% (2.0192 => 1.9807, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2300, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -1.54% (2.4971 => 2.4587, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.50% (61.1734 => 60.2588, std.dev.: 0.3540) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3096, std.dev.: 0.1345) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.85% (0.9980 => 1.0165, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -2.59% (0.6022 => 0.5866, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -8.82% (0.1666 => 0.1519, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.35% (0.1554 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (0.3083 => 0.2967, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.39% (0.2394 => 0.2217, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.95% (0.3175 => 0.2986, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.77% (0.2302 => 0.2100, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -37.42% (0.0449 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.97% (0.0390 => 0.0355, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -20.11% (0.0189 => 0.0151, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -60.92% (0.0325 => 0.0127, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.73% (0.1429 => 0.1468, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.05% (1.5019 => 1.5177, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.60% (0.1501 => 0.1510, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.35% (0.4264 => 0.4036, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.1344 => 0.1415, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.81% (0.0589 => 0.0635, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.84% (0.0232 => 0.0179, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.32% (0.0639 => 0.0605, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.0637 => 0.0594, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.85% (0.0246 => 0.0239, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.11% (1.5363 => 1.5995, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.29% (0.0070 => 0.0060, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 09:55:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 11:55:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922165519.E23212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4148?compare_to=4145&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4148, Order: 164460, Start Time: 2012-09-22 15:42:02, End Time: 2012-09-22 16:56:46 To: 4145, Order: 164459, Start Time: 2012-09-22 13:50:01, End Time: 2012-09-22 15:04:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.6060 => 56.5079, std.dev.: 0.0756) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.75% (2.0176 => 2.4363, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.77% (0.5748 => 0.6482, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.74% (0.5818 => 0.6559, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937) SingleSource/UnitTests/ObjC++/property-reference: 12.21% (0.7061 => 0.7923, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.55% (0.1013 => 0.1130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.23% (0.4328 => 0.4814, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.20% (3.9660 => 4.4100, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.09% (0.7710 => 0.8565, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.87% (1.3693 => 1.5182, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.83% (0.1588 => 0.1760, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.79% (0.0964 => 0.1068, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.2596 => 0.2875, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 10.68% (0.4062 => 0.4496, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.57% (0.3899 => 0.4311, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.54% (0.5265 => 0.5820, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.53% (0.3485 => 0.3852, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.7038 => 0.7776, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.30% (0.6959 => 0.7676, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 10.26% (0.2690 => 0.2966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.26% (1.2193 => 1.3444, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.25% (0.2966 => 0.3270, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.20% (1.9828 => 2.1850, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.15% (0.9199 => 1.0133, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.13% (0.3130 => 0.3447, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.05% (0.2628 => 0.2892, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.96% (0.2761 => 0.3036, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.92% (1.4563 => 1.6007, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.82% (0.3756 => 0.4125, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.82% (0.4390 => 0.4821, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 9.81% (0.3293 => 0.3616, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 9.80% (13.8202 => 15.1746, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/moments: 9.80% (0.3868 => 0.4247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.78% (0.3107 => 0.3411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.71% (0.4016 => 0.4406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.66% (1.1364 => 1.2462, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.52% (0.6283 => 0.6881, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 9.49% (0.3192 => 0.3495, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.14% (0.5577 => 0.6087, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.10% (1.0313 => 1.1251, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 8.99% (0.4003 => 0.4363, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.93% (0.3246 => 0.3536, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.89% (0.7506 => 0.8173, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.84% (0.2127 => 0.2315, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.84% (0.4379 => 0.4766, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.83% (0.4791 => 0.5214, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.75% (0.2914 => 0.3169, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.69% (0.5637 => 0.6127, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.68% (0.2995 => 0.3255, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.66% (1.1061 => 1.2019, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.66% (7.2180 => 7.8429, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 8.45% (3.8646 => 4.1911, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 8.39% (0.3220 => 0.3490, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.37% (3.6692 => 3.9763, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.37% (16.6129 => 18.0026, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/09-vor/vor: 8.34% (0.2925 => 0.3169, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 8.34% (0.2243 => 0.2430, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.26% (0.7460 => 0.8076, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 8.23% (0.8310 => 0.8994, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 8.15% (1.9270 => 2.0841, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.06% (0.2023 => 0.2186, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1865 => 0.2015, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 7.98% (2.1791 => 2.3529, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.96% (0.3755 => 0.4054, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.91% (0.8698 => 0.9386, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.87% (3.1889 => 3.4398, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 7.67% (0.6744 => 0.7261, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 7.66% (1.0594 => 1.1405, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.52% (0.1569 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.52% (1.3245 => 1.4241, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.38% (0.6576 => 0.7061, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 7.34% (0.4113 => 0.4415, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 7.26% (1.2749 => 1.3675, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 7.23% (14.8535 => 15.9279, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 7.21% (0.2859 => 0.3065, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.18% (0.3245 => 0.3478, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.16% (0.6135 => 0.6574, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.12% (4.3801 => 4.6918, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.11% (4.4433 => 4.7593, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 7.08% (8.4961 => 9.0975, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 6.96% (1.2292 => 1.3148, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.95% (1.3819 => 1.4780, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (1.1333 => 1.2117, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.2140 => 0.2288, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.3813 => 1.4750, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.77% (13.2842 => 14.1842, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 6.64% (0.3131 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.51% (0.8818 => 0.9392, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.51% (4.6629 => 4.9663, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 6.48% (0.6250 => 0.6655, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.48% (14.5298 => 15.4713, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 6.37% (0.2008 => 0.2136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.32% (6.5754 => 6.9907, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.03% (3.2742 => 3.4715, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.89% (0.4805 => 0.5088, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.82% (4.9865 => 5.2768, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.62% (1.5188 => 1.6042, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (6.2785 => 6.6272, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.47% (0.9108 => 0.9606, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.31% (3.7467 => 3.9457, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.18% (2.1007 => 2.2095, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 4.76% (33.2944 => 34.8791, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.19% (0.3511 => 0.3623, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.10% (16.2614 => 16.7650, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.73% (1.1560 => 1.2569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1117, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.06% (7.4271 => 7.5799, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5850, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2240, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.2986 => 2.3236, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5908, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9168, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.42% (22.5627 => 22.0158, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2667, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.51% (1.3780 => 1.3021, std.dev.: 0.0166) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.92% (0.4867 => 0.4725, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.79% (1.9762 => 1.9210, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2456, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.66% (0.6615 => 0.6505, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1554, std.dev.: 0.0613) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2240, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.11% (6.6320 => 6.5582, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -1.09% (7.3305 => 7.2503, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2635, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 10:27:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 12:27:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922172719.D9B1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4149?compare_to=4143&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4149, Order: 164459, Start Time: 2012-09-22 14:44:34, End Time: 2012-09-22 17:28:48 To: 4143, Order: 164454, Start Time: 2012-09-22 11:31:22, End Time: 2012-09-22 14:15:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3488 => 0.3931, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.13% (0.3643 => 0.4085, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.67% (0.1063 => 0.1187, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 11.19% (1.5932 => 1.7715, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 10.77% (0.0947 => 0.1049, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 8.70% (0.1218 => 0.1324, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5826 => 0.6325, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.5889 => 0.6388, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.97% (0.1505 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (1.3152 => 1.4200, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.90% (2.7292 => 2.9447, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.89% (0.4994 => 0.5388, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.5000 => 0.5389, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.74% (1.6211 => 1.7466, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (3.5627 => 3.8361, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.57% (0.4361 => 0.4691, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 7.43% (1.0781 => 1.1582, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 7.42% (5.5417 => 5.9530, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.41% (0.2875 => 0.3088, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.40% (0.2566 => 0.2756, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.34% (0.5026 => 0.5395, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 7.22% (0.3004 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.22% (0.1968 => 0.2110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.18% (0.7171 => 0.7686, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.13% (0.2736 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.08% (0.2866 => 0.3069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.3195 => 0.3420, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.89% (0.9909 => 1.0592, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.82% (0.3930 => 0.4198, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.81% (0.2803 => 0.2994, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.78% (0.2729 => 0.2914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.76% (0.2750 => 0.2936, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2780 => 0.2968, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (2.0673 => 2.2071, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2792 => 0.2980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.73% (0.2823 => 0.3013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.72% (0.2813 => 0.3002, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.65% (4.2109 => 4.4911, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.2911 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3096 => 0.3301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2811 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.57% (0.3625 => 0.3863, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 6.56% (0.6634 => 0.7069, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.54% (2.1013 => 2.2388, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.54% (0.3060 => 0.3260, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3362 => 0.3581, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.51% (0.3258 => 0.3470, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.47% (0.5900 => 0.6282, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 6.45% (0.4029 => 0.4289, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3267 => 0.3477, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (0.2691 => 0.2863, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 6.25% (23.5202 => 24.9898, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/lists: 6.21% (0.3348 => 0.3556, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3317 => 0.3523, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.17% (0.3678 => 0.3905, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.15% (0.3282 => 0.3484, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.15% (0.3124 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.14% (4.4195 => 4.6907, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 6.09% (0.3726 => 0.3953, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.07% (0.3477 => 0.3688, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.99% (1.4269 => 1.5124, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (0.4658 => 0.4937, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.97% (4.6177 => 4.8935, std.dev.: 0.0179) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.97% (0.4139 => 0.4386, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.94% (0.3890 => 0.4121, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.93% (0.3690 => 0.3909, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 5.89% (0.4146 => 0.4390, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.87% (0.3903 => 0.4132, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.83% (1.8794 => 1.9890, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 5.81% (0.5546 => 0.5868, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.73% (2.1653 => 2.2894, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 5.72% (0.4251 => 0.4494, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.55% (0.3981 => 0.4202, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.54% (1.9966 => 2.1072, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.51% (0.3845 => 0.4057, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.44% (0.2040 => 0.2151, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.42% (0.2068 => 0.2180, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 5.39% (0.5012 => 0.5282, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (1.9694 => 2.0743, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.2969 => 0.3126, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.25% (0.6435 => 0.6773, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 5.19% (0.7875 => 0.8284, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 5.19% (0.2391 => 0.2515, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.3271 => 0.3440, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.2737 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.3084 => 0.3241, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.03% (0.9697 => 1.0185, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 4.86% (0.3336 => 0.3498, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 4.86% (2.0346 => 2.1334, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.09% (0.4253 => 0.4427, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 3.90% (0.4847 => 0.5036, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (0.7426 => 0.7714, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.3498 => 0.3632, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.45% (0.3792 => 0.3923, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (0.5361 => 0.5543, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.33% (0.5584 => 0.5770, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.21% (11.6398 => 12.0130, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.6926 => 4.8362, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.86% (11.9555 => 12.1775, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0563) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6391, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2054, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5008, std.dev.: 0.0161) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.61% (41.7953 => 42.4695, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2798, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5753, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4561, std.dev.: 0.0359) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5432, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8003, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std.dev.: 0.0119) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.71% (17.2379 => 16.7711, std.dev.: 0.0830) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.95% (0.6293 => 0.6170, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5806, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.42% (16.2163 => 15.9855, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 11:03:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 13:03:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922180351.3CEE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4150?compare_to=4147&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4150, Order: 164462, Start Time: 2012-09-22 16:55:09, End Time: 2012-09-22 18:05:20 To: 4147, Order: 164460, Start Time: 2012-09-22 15:29:11, End Time: 2012-09-22 16:39:42 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (91 on baseline) Performance Improvements: 4 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 888 (761 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.22% (30.5148 => 30.8857, std.dev.: 0.0203) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.58% (19.6178 => 22.0864, std.dev.: 0.3511) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.76% (3.0286 => 3.2029, std.dev.: 0.0344) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.63% (4.2931 => 4.5348, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/ffbench: 2.88% (1.3672 => 1.4066, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.98% (2.3628 => 2.4095, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/mandel-2: 1.87% (3.1075 => 3.1656, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/dt: 1.35% (1.0151 => 1.0288, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -11.17% (3.4243 => 3.0419, std.dev.: 0.1390) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.59% (1.3858 => 1.3222, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: -1.33% (2.8710 => 2.8329, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -1.09% (1.7559 => 1.7368, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.37% (1.0165 => 1.0127, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.5866 => 0.5882, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 0.92% (0.1519 => 0.1533, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1331 => 0.1331, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (0.2967 => 0.2969, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.32% (0.2217 => 0.2224, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.30% (0.2986 => 0.2995, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.29% (0.2100 => 0.2106, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -0.36% (0.0281 => 0.0280, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.20% (0.0083 => 0.0082, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0193 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.30% (0.0355 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.00% (0.0300 => 0.0270, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -1.10% (0.0182 => 0.0180, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 27.81% (0.0151 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 4.47% (0.0246 => 0.0257, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -1.57% (0.0127 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.02% (0.1468 => 0.1453, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -2.81% (1.5177 => 1.4751, std.dev.: 0.0426) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.86% (0.1510 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.94% (0.4036 => 0.4074, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.32% (0.1415 => 0.1368, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.89% (0.0635 => 0.0647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.70% (0.0179 => 0.0225, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.13% (0.0605 => 0.0580, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: -89.58% (0.0048 => 0.0005, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1270 => 1.1287, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.71% (0.0594 => 0.0566, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.53% (0.0239 => 0.0257, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7655 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -7.01% (1.5995 => 1.4873, std.dev.: 0.0607) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0060 => 0.0075, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -98.08% (0.0261 => 0.0005, std.dev.: 0.0018) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.22% (4.1772 => 3.1656, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/except: 83150.00% (0.0006 => 0.4995, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.34% (0.1414 => 0.1546, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 8.48% (2.1763 => 2.3609, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: 8.12% (0.5309 => 0.5740, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.96% (0.6410 => 0.6920, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 6.78% (1.0046 => 1.0727, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 6.38% (0.6173 => 0.6567, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 6.19% (1.1653 => 1.2374, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.6915 => 0.7328, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 5.85% (15.3105 => 16.2056, std.dev.: 0.1312) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.81% (0.3582 => 0.3790, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.5150 => 1.5976, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 5.35% (29.3170 => 30.8857, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.17% (0.2552 => 0.2684, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 4.76% (0.3217 => 0.3370, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.74% (0.7722 => 0.8088, std.dev.: 0.0070) MultiSource/Applications/d/make_dparser: 4.42% (3.0225 => 3.1562, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.26% (0.4248 => 0.4429, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.23% (0.3901 => 0.4066, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.11% (0.2797 => 0.2912, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (12.6413 => 13.1587, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.95% (0.6069 => 0.6309, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.83% (1.1440 => 1.1878, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 3.74% (13.3238 => 13.8222, std.dev.: 0.0392) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.71% (1.0689 => 1.1086, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (1.1672 => 1.2104, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.67% (0.2886 => 0.2992, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 3.64% (0.3026 => 0.3136, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2877 => 0.2981, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 3.41% (2.0972 => 2.1688, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.40% (0.7226 => 0.7472, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.2186 => 8.4946, std.dev.: 0.0709) MultiSource/Applications/lua/lua: 3.27% (3.5980 => 3.7156, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.1827 => 1.2205, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.10% (0.8569 => 0.8835, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.4408 => 1.4850, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 3.05% (4.7455 => 4.8903, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 3.01% (14.6079 => 15.0469, std.dev.: 0.0657) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.4113 => 1.4531, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0821 => 1.1133, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 2.84% (1.3268 => 1.3645, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.0758 => 3.1620, std.dev.: 0.0186) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.4908 => 6.6722, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.75% (1.2021 => 1.2352, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.69% (6.2546 => 6.4228, std.dev.: 0.0225) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.7256 => 15.1200, std.dev.: 0.0770) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.5937 => 0.6095, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.59% (1.8798 => 1.9285, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8405 => 0.8615, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.0317 => 2.0824, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (4.0318 => 4.1290, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.4880 => 0.4995, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.22% (3.8796 => 3.9659, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5520 => 0.5642, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.13% (0.5963 => 0.6090, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.4189 => 1.4481, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.96% (4.2616 => 4.3453, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.94% (0.9029 => 0.9204, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.2815 => 4.3545, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.69% (8.2559 => 8.3954, std.dev.: 0.0250) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (4.3380 => 4.4046, std.dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3375, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.03% (0.0917 => 0.1064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.67% (1.7426 => 1.9983, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.10% (0.0766 => 0.0874, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.18% (4.0101 => 4.5388, std.dev.: 0.0167) SingleSource/Benchmarks/McGill/queens: 11.14% (1.6261 => 1.8072, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.02% (0.2694 => 0.2991, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6075, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.64% (4.2129 => 4.5348, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.86% (1.0063 => 1.0753, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (3.0256 => 3.2029, std.dev.: 0.0344) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.3301 => 0.3484, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: 4.44% (0.9851 => 1.0288, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.32% (21.1721 => 22.0864, std.dev.: 0.3511) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8120, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8985, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/mason/mason: 2.72% (0.5004 => 0.5140, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.71% (3.8907 => 3.9961, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/ReedSolomon: 2.42% (8.5113 => 8.7175, std.dev.: 0.0746) MultiSource/Applications/siod/siod: 2.30% (3.5520 => 3.6336, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.18% (2.3580 => 2.4095, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.18% (0.5876 => 0.6004, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (2.4042 => 2.4360, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4472, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.89% (0.3497 => 0.2067, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.00% (5.2665 => 4.1607, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary3: -20.39% (1.7473 => 1.3911, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.43% (1.1647 => 0.9617, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -15.56% (3.6023 => 3.0419, std.dev.: 0.1390) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.61% (15.8312 => 13.5179, std.dev.: 0.0834) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: -11.37% (0.3746 => 0.3320, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -10.77% (0.1114 => 0.0994, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.38% (3.2007 => 2.9325, std.dev.: 0.0339) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.23% (1.4034 => 1.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.82% (3.6254 => 3.3781, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -6.67% (4.6355 => 4.3261, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8733, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -6.46% (7.6833 => 7.1873, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -6.28% (1.4441 => 1.3534, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.92% (3.4230 => 3.2204, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.70% (1.4021 => 1.3222, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9408, std.dev.: 0.1000) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1876, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.35% (1.2722 => 1.2296, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: -3.29% (8.5323 => 8.2512, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.21% (61.1734 => 59.2070, std.dev.: 0.6886) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -2.64% (9.2503 => 9.0063, std.dev.: 0.0214) SingleSource/Benchmarks/McGill/misr: -2.51% (0.4296 => 0.4188, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -2.16% (92.7467 => 90.7441, std.dev.: 0.5759) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4233, std.dev.: 0.0168) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3695, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2293, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/neural/neural: -1.50% (1.0926 => 1.0762, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3082, std.dev.: 0.0673) SingleSource/Benchmarks/Shootout-C++/lists: -1.26% (16.5617 => 16.3523, std.dev.: 0.0488) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.47% (0.9980 => 1.0127, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: -2.32% (0.6022 => 0.5882, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -7.98% (0.1666 => 0.1533, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.35% (0.1554 => 0.1331, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.70% (0.3083 => 0.2969, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.10% (0.2394 => 0.2224, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.67% (0.3175 => 0.2995, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.51% (0.2302 => 0.2106, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.83% (0.0240 => 0.0082, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.30% (0.0301 => 0.0270, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.21% (0.0249 => 0.0257, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.78% (1.5019 => 1.4751, std.dev.: 0.0426) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1501 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.46% (0.4264 => 0.4074, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.79% (0.1344 => 0.1368, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.85% (0.0589 => 0.0647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.02% (0.0232 => 0.0225, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.23% (0.0639 => 0.0580, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 233.33% (0.0006 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.15% (0.0637 => 0.0566, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (0.0246 => 0.0257, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -3.19% (1.5363 => 1.4873, std.dev.: 0.0607) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.14% (0.0070 => 0.0075, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 11:39:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 13:39:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922183906.E41B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4151?compare_to=4148&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4151, Order: 164462, Start Time: 2012-09-22 17:25:44, End Time: 2012-09-22 18:40:35 To: 4148, Order: 164460, Start Time: 2012-09-22 15:42:02, End Time: 2012-09-22 16:56:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (184 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (687 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.02% (1.3095 => 1.3228, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.86% (2.0176 => 2.4385, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 12.77% (0.5818 => 0.6561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.68% (0.7061 => 0.7956, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 12.65% (0.5748 => 0.6475, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.41% (0.4328 => 0.4822, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.25% (3.9660 => 4.4120, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069) MultiSource/Applications/hbd/hbd: 10.89% (1.3693 => 1.5184, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.84% (0.7710 => 0.8546, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.83% (0.1588 => 0.1760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.52% (0.3899 => 0.4309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.48% (0.5265 => 0.5817, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 10.44% (0.7038 => 0.7773, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.30% (0.3485 => 0.3844, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.29% (0.9199 => 1.0146, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.26% (1.2193 => 1.3444, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (0.2765 => 0.3048, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.23% (0.6959 => 0.7671, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (1.9828 => 2.1852, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 10.20% (0.2607 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.16% (1.4563 => 1.6042, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.15% (0.2937 => 0.3235, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.10% (0.3130 => 0.3446, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.01% (0.2726 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3489 => 0.3837, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.91% (0.4390 => 0.4825, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.90% (0.3756 => 0.4128, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.87% (13.8202 => 15.1837, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: 9.85% (0.3868 => 0.4249, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.80% (1.1364 => 1.2478, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.79% (0.4016 => 0.4409, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2988 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.72% (0.6283 => 0.6894, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.70% (0.1062 => 0.1165, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.56% (0.3453 => 0.3783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3534 => 0.3863, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.29% (0.5577 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.15% (1.0313 => 1.1257, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.12% (0.3246 => 0.3542, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.08% (0.1157 => 0.1262, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.06% (0.4791 => 0.5225, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 9.04% (0.3914 => 0.4268, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.93% (0.4379 => 0.4770, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.90% (0.7506 => 0.8174, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.4003 => 0.4359, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2127 => 0.2316, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.79% (0.2914 => 0.3170, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 8.77% (1.1061 => 1.2031, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.73% (7.2180 => 7.8483, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 8.69% (0.2243 => 0.2438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.57% (0.5637 => 0.6120, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 8.50% (3.8646 => 4.1931, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 8.48% (0.3220 => 0.3493, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.46% (16.6129 => 18.0178, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.45% (0.7460 => 0.8090, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.42% (3.6692 => 3.9783, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 8.31% (0.2925 => 0.3168, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 8.23% (0.8310 => 0.8994, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.20% (0.3755 => 0.4063, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.08% (1.9270 => 2.0827, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 8.06% (2.1791 => 2.3548, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.00% (0.8698 => 0.9394, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.87% (3.1889 => 3.4399, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 7.84% (0.6744 => 0.7273, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.80% (1.3245 => 1.4278, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 7.66% (1.0594 => 1.1406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.65% (0.1569 => 0.1689, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4113 => 0.4420, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.44% (0.6576 => 0.7065, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.33% (0.3245 => 0.3483, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.22% (0.6135 => 0.6578, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 7.21% (0.2859 => 0.3065, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.20% (0.2140 => 0.2294, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 7.16% (14.8535 => 15.9177, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.15% (4.3801 => 4.6934, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (4.4433 => 4.7606, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.11% (8.4961 => 9.1003, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 7.06% (1.2749 => 1.3649, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3153, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.98% (1.3813 => 1.4777, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.97% (1.3819 => 1.4782, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.87% (1.1333 => 1.2112, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 6.74% (0.3131 => 0.3342, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.64% (13.2842 => 14.1659, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 6.52% (4.6629 => 4.9670, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.51% (0.2321 => 0.2472, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.50% (14.5298 => 15.4738, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.43% (0.6250 => 0.6652, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.37% (6.5754 => 6.9945, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.35% (0.2504 => 0.2663, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.33% (0.8818 => 0.9376, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.10% (0.4805 => 0.5098, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.00% (3.2742 => 3.4708, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.78% (4.9865 => 5.2748, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.66% (6.2785 => 6.6340, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.64% (1.5188 => 1.6045, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.46% (0.9108 => 0.9605, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.36% (3.7467 => 3.9477, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.21% (2.1007 => 2.2101, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.2008 => 0.2109, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.79% (33.2944 => 34.8895, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.19% (0.3511 => 0.3623, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.97% (16.2614 => 16.7439, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std.dev.: 0.0498) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.70% (3.1736 => 3.4180, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7240, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1008, std.dev.: 0.0447) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5836, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5853, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.19% (8.8259 => 8.9307, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5941, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2224, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.37% (22.5627 => 22.0290, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2873, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3030, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4787, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2511, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: -1.45% (1.2308 => 1.2130, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2254, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2187, std.dev.: 0.0251) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4329, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2539, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2634, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 12:00:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 14:00:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922190005.CE11A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4152?compare_to=4146&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4152, Order: 164462, Start Time: 2012-09-22 17:41:25, End Time: 2012-09-22 19:01:32 To: 4146, Order: 164459, Start Time: 2012-09-22 13:49:47, End Time: 2012-09-22 15:09:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (155 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.05% (0.5790 => 0.5787, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.04% (16.1365 => 16.1303, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: -0.01% (15.0211 => 15.0190, std.dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 0.06% (83.4483 => 83.4974, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: -0.27% (4.3818 => 4.3698, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2368 => 1.2380, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.5373 => 7.5480, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (3.7338 => 3.7349, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6509 => 0.6504, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0668 => 0.0667, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.02% (63.2438 => 83.4974, std.dev.: 0.0066) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14222.78% (0.0720 => 10.3124, std.dev.: 0.0112) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.77% (10.3673 => 15.5273, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 29.65% (0.1622 => 0.2103, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.66% (2.2022 => 2.5470, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.39% (7.0540 => 8.1399, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.90% (0.3543 => 0.4000, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.87% (1.1194 => 1.2635, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3473 => 0.3912, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.42% (1.7609 => 1.9796, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3516 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.51% (0.3282 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.17% (0.1440 => 0.1572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (9.4845 => 10.3126, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.72% (0.3177 => 0.3454, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.49% (0.4615 => 0.5007, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.24% (0.4879 => 0.5281, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 8.14% (0.2554 => 0.2762, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.14% (10.4361 => 11.2853, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 8.01% (5.7591 => 6.2204, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.91% (0.3109 => 0.3355, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.89% (0.2700 => 0.2913, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.88% (0.7115 => 0.7676, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6675 => 0.7201, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7326 => 0.7901, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 7.82% (0.7433 => 0.8014, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.80% (1.5415 => 1.6617, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.3423 => 0.3689, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2271 => 0.2447, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.61% (4.2646 => 4.5893, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.59% (0.8172 => 0.8792, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.58% (0.5105 => 0.5492, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.55% (0.1510 => 0.1624, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.55% (3.3354 => 3.5872, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.53% (8.1363 => 8.7490, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 7.53% (0.7835 => 0.8425, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5860 => 0.6301, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.49% (1.3050 => 1.4027, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.32% (0.2758 => 0.2960, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.28% (4.9449 => 5.3050, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5569 => 0.5970, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.16% (5.0018 => 5.3601, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.15% (0.8067 => 0.8644, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3121 => 0.3339, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 6.95% (0.3092 => 0.3307, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.87% (7.9617 => 8.5089, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1940 => 0.2073, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.4103 => 0.4384, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.4064 => 0.4342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.82% (0.9765 => 1.0431, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.73% (0.5020 => 0.5358, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.68% (1.1642 => 1.2420, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.58% (0.4299 => 0.4582, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.54% (0.6456 => 0.6878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.53% (1.1861 => 1.2635, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 6.48% (3.8723 => 4.1234, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.45% (0.3441 => 0.3663, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3865 => 0.4114, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.42% (0.3180 => 0.3384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4289 => 0.4564, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3826 => 0.4071, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.36% (1.5603 => 1.6595, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3650 => 0.3882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4203 => 0.4468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.28% (1.0722 => 1.1395, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hello: 6.26% (0.2714 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.22% (0.3603 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.18% (2.0665 => 2.1943, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.18% (0.4048 => 0.4298, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 6.17% (0.3387 => 0.3596, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2603 => 0.2763, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.14% (2.0273 => 2.1518, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 6.10% (21.9371 => 23.2762, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (0.4620 => 0.4898, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3283 => 0.3480, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.92% (0.3935 => 0.4168, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8921 => 0.9428, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.68% (2.2969 => 2.4274, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.66% (0.6450 => 0.6815, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5981 => 0.6310, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.30% (1.5859 => 1.6699, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (1.4186 => 1.4898, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (14.3668 => 15.0539, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.74% (2.2024 => 2.3069, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.72% (1.1840 => 1.2399, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (0.2266 => 0.2370, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3817 => 0.3988, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3410, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.12% (0.3131 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.68% (0.8101 => 0.8399, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.3427 => 0.3549, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.28% (17.1811 => 17.5727, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.13% (3.8922 => 3.9751, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4509, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3827, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2142, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7696, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3491, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 2.24% (3.7781 => 3.8626, std.dev.: 0.0327) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2564, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7994, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5750, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.21% (5.2763 => 3.2603, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.01% (5.3855 => 3.9307, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.71% (5.3526 => 3.9230, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1753, std.dev.: 0.0513) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.35% (2.9384 => 2.6049, std.dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: -7.50% (22.1758 => 20.5121, std.dev.: 0.0226) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2976, std.dev.: 0.0595) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4794, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1606, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5049, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: -2.72% (1.2373 => 1.2036, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5026, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/salsa20: -2.04% (10.2830 => 10.0737, std.dev.: 0.0269) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9969, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2497, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6845, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.67% (0.5229 => 0.5787, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 7.61% (14.9895 => 16.1303, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: 6.10% (14.1553 => 15.0190, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 6.31% (4.1105 => 4.3698, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.06% (1.1048 => 1.2380, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.45% (7.1582 => 7.5480, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.85% (3.4629 => 3.7349, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.53% (0.6222 => 0.6504, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 12:30:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 14:30:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922193012.516C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4153?compare_to=4150&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4153, Order: 164464, Start Time: 2012-09-22 18:21:04, End Time: 2012-09-22 19:31:40 To: 4150, Order: 164462, Start Time: 2012-09-22 16:55:09, End Time: 2012-09-22 18:05:20 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (87 on baseline) Performance Improvements: 3 (35 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 886 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.65% (0.7719 => 0.7846, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.81% (0.7571 => 0.8162, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (1.7318 => 1.8492, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.22% (1.3222 => 1.3912, std.dev.: 0.0237) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.01% (1.2446 => 1.2945, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.45% (21.6320 => 22.3774, std.dev.: 0.2255) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.55% (2.6859 => 2.7545, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.00% (1.4266 => 1.4552, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.52% (59.2070 => 60.1095, std.dev.: 0.2879) SingleSource/Benchmarks/Shootout/hash: 1.33% (4.3047 => 4.3621, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (1.0753 => 1.0863, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.08% (30.8857 => 30.5532, std.dev.: 0.0421) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -7.19% (22.0864 => 20.4988, std.dev.: 0.5825) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.65% (4.5348 => 4.3241, std.dev.: 0.0319) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.13% (1.0127 => 1.0343, std.dev.: 0.0232) MultiSource/Applications/sqlite3/sqlite3: -0.75% (0.5882 => 0.5838, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.46% (0.1533 => 0.1540, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.08% (0.1331 => 0.1290, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.47% (0.2969 => 0.2955, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.51% (0.2224 => 0.2146, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.23% (0.2995 => 0.3002, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.19% (0.2106 => 0.2110, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: 1.07% (0.0280 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -37.80% (0.0082 => 0.0051, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0193 => 0.0194, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0388 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.85% (0.0270 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0323 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0180 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -21.76% (0.0193 => 0.0151, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 0.78% (0.0257 => 0.0259, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0125 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1000.00% (0.0001 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1453 => 0.1451, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.94% (1.4751 => 1.5185, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.81% (0.1497 => 0.1410, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.25% (0.4074 => 0.4064, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.51% (0.1368 => 0.1457, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.41% (0.0647 => 0.0612, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.89% (0.0225 => 0.0223, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.21% (0.0580 => 0.0616, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 840.00% (0.0005 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1287 => 1.1343, std.dev.: 0.0617) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 35.00% (0.0020 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.88% (0.0566 => 0.0571, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.23% (0.0257 => 0.0241, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7649 => 0.7657, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 7.58% (1.4873 => 1.6001, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.00% (0.0075 => 0.0069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.20% (4.1772 => 3.1246, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/except: 83300.00% (0.0006 => 0.5004, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.94% (0.1414 => 0.1597, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 8.28% (2.1763 => 2.3565, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.99% (0.6410 => 0.6922, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 7.50% (0.5309 => 0.5707, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 7.32% (0.6173 => 0.6625, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 7.00% (15.3105 => 16.3826, std.dev.: 0.1642) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (1.1653 => 1.2390, std.dev.: 0.0212) MultiSource/Applications/lemon/lemon: 6.23% (1.0046 => 1.0672, std.dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: 5.76% (0.6915 => 0.7313, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 5.63% (0.3217 => 0.3398, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3582 => 0.3783, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.05% (0.3901 => 0.4098, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.00% (1.5150 => 1.5908, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.71% (0.4248 => 0.4448, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.2552 => 0.2667, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 4.48% (3.0225 => 3.1580, std.dev.: 0.0311) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.46% (1.1672 => 1.2193, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 4.40% (0.3026 => 0.3159, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.37% (0.7639 => 0.7973, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 4.22% (29.3170 => 30.5532, std.dev.: 0.0421) MultiSource/Applications/SPASS/SPASS: 4.20% (13.3238 => 13.8835, std.dev.: 0.0706) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.16% (1.1827 => 1.2319, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 4.16% (3.5980 => 3.7475, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 4.00% (2.0972 => 2.1811, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (12.6413 => 13.1414, std.dev.: 0.0365) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.7722 => 0.8026, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.6069 => 0.6307, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 3.81% (1.1440 => 1.1876, std.dev.: 0.0103) MultiSource/Benchmarks/sim/sim: 3.76% (0.3084 => 0.3200, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.71% (0.8569 => 0.8887, std.dev.: 0.0119) MultiSource/Applications/treecc/treecc: 3.64% (1.8798 => 1.9483, std.dev.: 0.0210) MultiSource/Applications/hbd/hbd: 3.60% (1.3268 => 1.3746, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.2186 => 8.4922, std.dev.: 0.0270) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.18% (6.2546 => 6.4535, std.dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.7226 => 0.7452, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 3.10% (14.6079 => 15.0613, std.dev.: 0.0857) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (6.4908 => 6.6898, std.dev.: 0.0557) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (1.4113 => 1.4545, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.01% (0.5520 => 0.5686, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.93% (0.8405 => 0.8651, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0821 => 1.1131, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (4.2616 => 4.3820, std.dev.: 0.0466) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9029 => 0.9282, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.67% (1.2021 => 1.2342, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (3.8796 => 3.9817, std.dev.: 0.0351) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.60% (0.4880 => 0.5007, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.47% (1.4189 => 1.4539, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.43% (0.4562 => 0.4673, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.03% (4.0318 => 4.1136, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.02% (4.3380 => 4.4257, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.2742 => 1.2969, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.37% (0.0766 => 0.0945, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2292, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout/ary3: 14.89% (1.7426 => 2.0020, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.36% (4.0101 => 4.5860, std.dev.: 0.0353) SingleSource/Benchmarks/Stanford/Puzzle: 14.17% (0.1433 => 0.1636, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.21% (0.0917 => 0.1029, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 11.14% (1.6261 => 1.8072, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.91% (0.2694 => 0.2934, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 8.89% (7.0025 => 7.6252, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.95% (1.0063 => 1.0863, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.27% (0.7609 => 0.8162, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.39% (40.4792 => 42.6613, std.dev.: 0.4418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (0.3301 => 0.3443, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 3.99% (0.9851 => 1.0244, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8238, std.dev.: 0.0470) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8727, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.34% (2.6656 => 2.7545, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5113 => 8.7636, std.dev.: 0.0531) MultiSource/Applications/hexxagon/hexxagon: 2.85% (14.4877 => 14.9007, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.64% (4.2129 => 4.3241, std.dev.: 0.0319) MultiSource/Benchmarks/FreeBench/mason/mason: 2.64% (0.5004 => 0.5136, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 2.55% (0.6308 => 0.6469, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 2.48% (3.5520 => 3.6401, std.dev.: 0.0191) MultiSource/Applications/minisat/minisat: 2.46% (6.2244 => 6.3774, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.45% (4.6127 => 4.7259, std.dev.: 0.0258) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4501, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.59% (1.4324 => 1.4552, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/hash: 1.41% (4.3016 => 4.3621, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.30% (2.9152 => 2.9532, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.86% (0.3497 => 0.2138, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.98% (5.2665 => 4.1616, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ary3: -19.72% (1.7473 => 1.4028, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.33% (1.1647 => 0.9628, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.10% (15.8312 => 13.4406, std.dev.: 0.1218) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std.dev.: 0.0169) MultiSource/Applications/sgefa/sgefa: -11.21% (0.3746 => 0.3326, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.49% (3.2007 => 2.9291, std.dev.: 0.0244) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3358, std.dev.: 0.0409) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.45% (2.0027 => 1.8735, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -6.27% (1.4441 => 1.3536, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: -6.19% (7.6833 => 7.2075, std.dev.: 0.0306) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7923, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.95% (3.4230 => 3.2192, std.dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (62.4126 => 58.9156, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1867, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.16% (45.4683 => 43.5770, std.dev.: 0.6449) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9501, std.dev.: 0.0156) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.88% (1.2722 => 1.2356, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2916, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.23% (1.1683 => 1.1422, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4216, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2161, std.dev.: 0.0387) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3148, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.74% (61.1734 => 60.1095, std.dev.: 0.2879) MultiSource/Benchmarks/PAQ8p/paq8p: -1.73% (92.7467 => 91.1457, std.dev.: 0.2103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3166, std.dev.: 0.0554) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.32% (1.8739 => 1.8492, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.64% (0.9980 => 1.0343, std.dev.: 0.0232) MultiSource/Applications/sqlite3/sqlite3: -3.06% (0.6022 => 0.5838, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -7.56% (0.1666 => 0.1540, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.99% (0.1554 => 0.1290, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.15% (0.3083 => 0.2955, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.36% (0.2394 => 0.2146, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (0.3175 => 0.3002, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.34% (0.2302 => 0.2110, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -36.97% (0.0449 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -78.75% (0.0240 => 0.0051, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -20.11% (0.0189 => 0.0151, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 4.02% (0.0249 => 0.0259, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1429 => 0.1451, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.11% (1.5019 => 1.5185, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -6.06% (0.1501 => 0.1410, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.69% (0.4264 => 0.4064, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1344 => 0.1457, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.88% (0.0232 => 0.0223, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.60% (0.0639 => 0.0616, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1350 => 1.1343, std.dev.: 0.0617) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.36% (0.0637 => 0.0571, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.03% (0.0246 => 0.0241, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.15% (1.5363 => 1.6001, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.43% (0.0070 => 0.0069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 13:22:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 15:22:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922202229.6C7D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4154?compare_to=4151&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4154, Order: 164464, Start Time: 2012-09-22 19:09:14, End Time: 2012-09-22 20:23:57 To: 4151, Order: 164462, Start Time: 2012-09-22 17:25:44, End Time: 2012-09-22 18:40:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (182 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.54% (81.3530 => 79.2888, std.dev.: 0.7536) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.73% (2.0176 => 2.4358, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 12.81% (0.5818 => 0.6563, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.63% (0.5748 => 0.6474, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.19% (0.7061 => 0.7922, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.68% (0.1413 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.55% (0.1013 => 0.1130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.44% (0.4328 => 0.4823, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.06% (3.9660 => 4.4048, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.88% (0.7710 => 0.8549, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 10.87% (1.3693 => 1.5182, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.2596 => 0.2875, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.71% (0.1588 => 0.1758, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.62% (0.3899 => 0.4313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.59% (0.4062 => 0.4492, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.47% (0.5265 => 0.5816, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.24% (0.7038 => 0.7759, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.20% (1.2193 => 1.3437, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.19% (0.3485 => 0.3840, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.18% (1.9828 => 2.1847, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.10% (0.6959 => 0.7662, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.09% (0.9199 => 1.0127, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.06% (0.3130 => 0.3445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.04% (0.2690 => 0.2960, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.02% (0.1327 => 0.1460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.89% (1.4563 => 1.6004, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3489 => 0.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.85% (0.3756 => 0.4126, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.85% (0.3107 => 0.3413) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.78% (0.3293 => 0.3615, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.71% (13.8202 => 15.1626, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: 9.67% (0.3868 => 0.4242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.61% (0.6283 => 0.6887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.61% (0.4016 => 0.4402, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.61% (1.1364 => 1.2456, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.37% (0.3534 => 0.3865, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4390 => 0.4795, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 9.19% (0.3646 => 0.3981, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.13% (0.5577 => 0.6086, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.10% (1.0313 => 1.1251, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.97% (0.4379 => 0.4772, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2127 => 0.2317, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.93% (0.2945 => 0.3208, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.4003 => 0.4360, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.90% (0.3246 => 0.3535, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.89% (0.4791 => 0.5217, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.66% (1.1061 => 1.2019, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.63% (7.2180 => 7.8411, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 8.52% (0.2243 => 0.2434, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.51% (0.2914 => 0.3162, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.50% (0.7506 => 0.8144, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.35% (3.6692 => 3.9755, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.34% (0.5637 => 0.6107, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 8.30% (3.8646 => 4.1853, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 8.28% (16.6129 => 17.9883, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/18-imp/imp: 8.26% (0.3220 => 0.3486, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.19% (0.7460 => 0.8071, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 8.17% (0.8310 => 0.8989, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.11% (0.2023 => 0.2187, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3755 => 0.4058, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 7.88% (2.1791 => 2.3508, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: 7.83% (1.9270 => 2.0779, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.81% (3.1889 => 3.4380, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.77% (0.8698 => 0.9374, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.66% (0.2140 => 0.2304, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.53% (0.6744 => 0.7252, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.51% (1.0594 => 1.1390, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.46% (1.3245 => 1.4233, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.44% (0.6576 => 0.7065, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.39% (0.4113 => 0.4417, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.11% (14.8535 => 15.9094, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.09% (4.3801 => 4.6908, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.06% (0.3245 => 0.3474, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.05% (1.2749 => 1.3648, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 7.03% (0.2859 => 0.3060, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.03% (4.4433 => 4.7556, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 7.00% (8.4961 => 9.0905, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.91% (1.3819 => 1.4774, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.88% (0.6135 => 0.6557, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4763, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 6.84% (1.2292 => 1.3133, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.80% (1.1333 => 1.2104, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.64% (13.2842 => 14.1663, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: 6.55% (0.3131 => 0.3336, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6250 => 0.6656, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.45% (4.6629 => 4.9637, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 6.45% (14.5298 => 15.4669, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.38% (0.2321 => 0.2469, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.31% (0.8818 => 0.9374, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.23% (6.5754 => 6.9849, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.16% (0.4805 => 0.5101, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.93% (3.2742 => 3.4685, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.84% (4.9865 => 5.2776, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.55% (1.5188 => 1.6031, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (6.2785 => 6.6219, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.30% (0.9108 => 0.9591, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.28% (3.7467 => 3.9447, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.13% (2.1007 => 2.2084, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.72% (33.2944 => 34.8646, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (0.3511 => 0.3624, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.91% (16.2614 => 16.7344, std.dev.: 0.0223) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7248, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1158, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5806, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5154, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5831, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2256, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5884, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.45% (22.5627 => 22.0088, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2769, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.24% (1.3780 => 1.2920, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1575, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.28% (1.7688 => 1.7108, std.dev.: 0.0147) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: -2.73% (3.0263 => 2.9437, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2477, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.6320 => 6.5316, std.dev.: 0.0223) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1275, std.dev.: 0.0335) SingleSource/Benchmarks/McGill/chomp: -1.24% (1.2308 => 1.2155, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2625, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4360, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 13:40:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 15:40:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922204031.261B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4155?compare_to=4149&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4155, Order: 164462, Start Time: 2012-09-22 17:57:53, End Time: 2012-09-22 20:41:58 To: 4149, Order: 164459, Start Time: 2012-09-22 14:44:34, End Time: 2012-09-22 17:28:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (137 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (756 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.08% (126.5226 => 131.6872, std.dev.: 0.1563) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.2007 => 54.8704, std.dev.: 0.0810) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.21% (0.3460 => 0.3917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.02% (0.3442 => 0.3890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.41% (1.5932 => 1.7591, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5889 => 0.6448, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.49% (0.5826 => 0.6379, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.1218 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.89% (0.1619 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.37% (2.7292 => 2.9576, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7171 => 0.7766, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.21% (1.3152 => 1.4232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.12% (0.4361 => 0.4715, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.07% (1.6211 => 1.7520, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.05% (0.4994 => 0.5396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (3.5627 => 3.8493, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.00% (0.2738 => 0.2957, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.86% (0.2875 => 0.3101, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.3004 => 0.3234, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.49% (1.0781 => 1.1588, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.39% (0.3195 => 0.3431, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.38% (0.2803 => 0.3010, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.38% (5.5417 => 5.9508, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.32% (0.1968 => 0.2112, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.30% (0.5000 => 0.5365, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.29% (0.2729 => 0.2928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2792 => 0.2994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2780 => 0.2981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.23% (0.2823 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.22% (0.2813 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.20% (0.2750 => 0.2948, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.17% (0.2566 => 0.2750, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2811 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.1421 => 0.1522, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 7.07% (0.9909 => 1.0610, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.06% (2.0673 => 2.2132, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.05% (0.3930 => 0.4207, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3096 => 0.3313, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.5900 => 0.6313, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.98% (0.2866 => 0.3066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.97% (0.2911 => 0.3114, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.93% (0.3060 => 0.3272, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.90% (0.4029 => 0.4307, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3267 => 0.3489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.78% (0.3258 => 0.3479, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.72% (0.3124 => 0.3334, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.69% (4.2109 => 4.4928, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.3362 => 0.3587, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.69% (2.1013 => 2.2418, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.2736 => 0.2917, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3317 => 0.3536, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.54% (0.3625 => 0.3862, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.51% (0.3348 => 0.3566, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.50% (0.3678 => 0.3917, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3282 => 0.3495, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.47% (0.4139 => 0.4407, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 6.44% (0.3477 => 0.3701, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.42% (0.3845 => 0.4092, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 6.39% (0.3726 => 0.3964, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.38% (0.6634 => 0.7057, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 6.30% (23.5202 => 25.0014, std.dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 6.20% (4.6177 => 4.9041, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3690 => 0.3918, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.3903 => 0.4144, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 6.17% (0.4146 => 0.4402, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (4.4195 => 4.6914, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.12% (0.4658 => 0.4943, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.08% (1.8794 => 1.9936, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.07% (0.3890 => 0.4126, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (0.4251 => 0.4508, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.00% (2.1653 => 2.2953, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.3981 => 0.4218, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.94% (1.4269 => 1.5117, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 5.78% (0.2075 => 0.2195, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (0.2691 => 0.2846, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.74% (0.2737 => 0.2894, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (1.9694 => 2.0821, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 5.55% (0.9697 => 1.0235, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 5.52% (0.5546 => 0.5852, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.2068 => 0.2182, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (1.9966 => 2.1066, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.3271 => 0.3450, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (0.6435 => 0.6787, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.43% (0.5012 => 0.5284, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.42% (0.2969 => 0.3130, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.40% (0.7875 => 0.8300, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 5.34% (0.3336 => 0.3514, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.2040 => 0.2148, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.29% (0.3084 => 0.3247, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 4.82% (2.0346 => 2.1327, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.80% (0.2103 => 0.2204, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.77% (0.2391 => 0.2505, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.25% (0.4847 => 0.5053, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.11% (0.4253 => 0.4428, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.92% (0.3498 => 0.3635, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (0.7426 => 0.7712) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3792 => 0.3935, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.51% (0.5361 => 0.5549, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.42% (0.5584 => 0.5775, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.19% (11.6398 => 12.0113, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.6926 => 4.8362, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.11% (11.9555 => 12.2083, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: 1.08% (2.4764 => 2.5032, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1719, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6449, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std.dev.: 0.0465) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5065, std.dev.: 0.0245) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4394, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5917, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5481, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7922, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9567, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.70% (0.6293 => 0.6123, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (17.2379 => 16.8100, std.dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9570, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 13:49:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 15:49:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922204918.F1D802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4156?compare_to=4152&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4156, Order: 164464, Start Time: 2012-09-22 19:30:30, End Time: 2012-09-22 20:50:46 To: 4152, Order: 164462, Start Time: 2012-09-22 17:41:25, End Time: 2012-09-22 19:01:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (153 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.86% (54.9964 => 56.5708, std.dev.: 0.0615) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.20% (79.6882 => 81.4453, std.dev.: 0.2608) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5787 => 0.5789, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: -0.09% (16.1303 => 16.1158, std.dev.: 0.0264) MultiSource/Applications/kimwitu++/kc: 0.14% (15.0190 => 15.0406, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -0.03% (83.4974 => 83.4713, std.dev.: 0.0344) MultiSource/Benchmarks/MallocBench/gs/gs: -0.03% (4.3698 => 4.3683, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2380 => 1.2371, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.5480 => 7.5424, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.7349 => 3.7352, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.28% (0.6504 => 0.6522, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1432 => 0.1431, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.00% (0.0667 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.98% (63.2438 => 83.4713, std.dev.: 0.0344) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14227.08% (0.0720 => 10.3155, std.dev.: 0.0082) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.73% (10.3673 => 15.5227, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.70% (2.2022 => 2.5479, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.30% (7.0540 => 8.1335, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.01% (0.3543 => 0.4004, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.90% (1.1194 => 1.2638, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.71% (0.0834 => 0.0940, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.31% (1.7609 => 1.9777, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.24% (0.3497 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.48% (0.3282 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.17% (0.1440 => 0.1572, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.84% (0.3177 => 0.3458, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5925 => 0.6449, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (9.4845 => 10.3170, std.dev.: 0.0124) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.24% (0.4879 => 0.5281, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 8.15% (10.4361 => 11.2868, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 8.00% (5.7591 => 6.2199, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference: 7.96% (0.7326 => 0.7909, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 7.95% (0.2554 => 0.2757, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.91% (0.3109 => 0.3355, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.6675 => 0.7202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.89% (0.2700 => 0.2913, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3423 => 0.3693, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 7.85% (0.1695 => 0.1828, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.82% (0.7433 => 0.8014, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.80% (0.7115 => 0.7670, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.78% (0.4615 => 0.4974, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2271 => 0.2446, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (1.3050 => 1.4040, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.57% (0.1625 => 0.1748, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.55% (4.2646 => 4.5866, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.53% (8.1363 => 8.7491, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 7.51% (3.3354 => 3.5860, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.50% (0.5105 => 0.5488, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.47% (0.5860 => 0.6298, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.35% (1.5415 => 1.6548, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.8172 => 0.8770, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.31% (0.2107 => 0.2261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.31% (0.5569 => 0.5976, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.26% (4.9449 => 5.3041, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.24% (5.0018 => 5.3639, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.20% (0.8067 => 0.8648, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 7.06% (0.7835 => 0.8388, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.00% (0.2758 => 0.2951, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3121 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.97% (0.4103 => 0.4389, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.91% (0.1940 => 0.2074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.89% (0.3092 => 0.3305, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.4064 => 0.4342, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.84% (7.9617 => 8.5061, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.81% (0.9765 => 1.0430, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.79% (0.5020 => 0.5361, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 6.79% (1.1642 => 1.2432, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.75% (0.4636 => 0.4949, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.63% (0.6456 => 0.6884, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.63% (0.3441 => 0.3669, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4289 => 0.4568, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1861 => 1.2630, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.46% (1.5603 => 1.6611, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.3098 => 0.3298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3865 => 0.4114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.40% (0.4299 => 0.4574, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 6.38% (3.8723 => 4.1195, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/09-vor/vor: 6.38% (0.3180 => 0.3383, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.38% (0.3603 => 0.3833, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3650 => 0.3882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.35% (0.4203 => 0.4470, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.33% (0.3162 => 0.3362, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.30% (2.0273 => 2.1551, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 6.27% (0.4048 => 0.4302, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.26% (0.3387 => 0.3599, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.24% (1.0722 => 1.1391, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.23% (0.4620 => 0.4908, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.23% (2.0665 => 2.1953, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3826 => 0.4062, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.06% (0.3232 => 0.3428, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.06% (21.9371 => 23.2657, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.02% (0.3935 => 0.4172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3684 => 0.3897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.69% (0.8921 => 0.9429, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6450 => 0.6814, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 5.60% (2.2969 => 2.4256, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.43% (0.5981 => 0.6306, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (1.5859 => 1.6676, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.01% (1.4186 => 1.4897, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (14.3668 => 15.0693, std.dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.1840 => 1.2394, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.65% (2.2024 => 2.3049, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2842 => 1.3425, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3817 => 0.3988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.97% (0.8101 => 0.8423, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5790, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (3.8922 => 3.9777, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7663, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3510, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 2.05% (3.7781 => 3.8554, std.dev.: 0.0287) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2553, std.dev.: 0.0276) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2561, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.01% (5.3855 => 3.9311, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.70% (5.3526 => 3.9236, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1326, std.dev.: 0.0322) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.23% (2.9384 => 2.6083, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: -7.37% (22.1758 => 20.5414, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2927, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.61% (1.8329 => 1.7117, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7914, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.76% (3.2827 => 3.1593, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4996, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: -3.03% (1.2373 => 1.1998, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (8.1563 => 7.9940, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5084, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0874, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2518, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4198, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.71% (0.5229 => 0.5789, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 7.51% (14.9895 => 16.1158, std.dev.: 0.0264) MultiSource/Applications/kimwitu++/kc: 6.25% (14.1553 => 15.0406, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 6.27% (4.1105 => 4.3683, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.98% (1.1048 => 1.2371, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.37% (7.1582 => 7.5424, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.86% (3.4629 => 3.7352, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.82% (0.6222 => 0.6522, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 15:40:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 17:40:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120922224014.9BB842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4157?compare_to=4153&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4157, Order: 164465, Start Time: 2012-09-22 21:31:08, End Time: 2012-09-22 22:41:44 To: 4153, Order: 164464, Start Time: 2012-09-22 18:21:04, End Time: 2012-09-22 19:31:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 0 (75 on baseline) Performance Improvements: 8 (44 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 892 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lua/lua: -1.32% (3.7475 => 3.6979, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.68% (0.8162 => 0.7698, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.2945 => 1.2490, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.05% (13.4406 => 13.1650, std.dev.: 0.1042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.01% (1.4552 => 1.4260, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: -1.72% (6.3774 => 6.2680, std.dev.: 0.0134) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.11% (1.2356 => 1.2219, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (1.4028 => 1.3879, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.01% (1.0343 => 1.0135, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 0.89% (0.5838 => 0.5890, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -0.13% (0.1540 => 0.1538, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.02% (0.1290 => 0.1329, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (0.2955 => 0.2957, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.56% (0.2146 => 0.2201, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.10% (0.3002 => 0.3005, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.24% (0.2110 => 0.2105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -1.77% (0.0283 => 0.0278, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.10% (0.0091 => 0.0092, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 49.02% (0.0051 => 0.0076, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.55% (0.0194 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0388 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.99% (0.0302 => 0.0299, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0323 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.11% (0.0180 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -14.57% (0.0151 => 0.0129, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -25.48% (0.0259 => 0.0193, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: -0.80% (0.0125 => 0.0124, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -9.09% (0.0011 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.03% (0.1451 => 0.1407, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -1.80% (1.5185 => 1.4912, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.70% (0.1410 => 0.1448, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4064 => 0.4098, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.36% (0.1457 => 0.1408, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.98% (0.0612 => 0.0606, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.45% (0.0223 => 0.0222, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.38% (0.0616 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1343 => 1.1261, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -62.50% (0.0024 => 0.0009, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.0571 => 0.0543, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.75% (0.0241 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7657 => 0.7627, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.30% (1.6001 => 1.5953, std.dev.: 0.0082) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.58% (0.0069 => 0.0041, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.33% (4.1772 => 3.0775, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/except: 83100.00% (0.0006 => 0.4992, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 40.00% (0.0005 => 0.0007) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 8.25% (2.1763 => 2.3559, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.46% (0.6410 => 0.6888, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 7.14% (0.5309 => 0.5688, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 6.88% (1.1653 => 1.2455, std.dev.: 0.0137) MultiSource/Applications/lemon/lemon: 6.69% (1.0046 => 1.0718, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 6.00% (15.3105 => 16.2287, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.81% (0.3582 => 0.3790, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 5.75% (0.6173 => 0.6528, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.5150 => 1.5965, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.23% (0.3901 => 0.4105, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.86% (0.2552 => 0.2676, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.63% (0.2654 => 0.2777, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 4.46% (3.0225 => 3.1573, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3217 => 0.3358, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (12.6413 => 13.1642, std.dev.: 0.0594) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4248 => 0.4423, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.06% (0.7639 => 0.7949, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.97% (0.6069 => 0.6310, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.85% (29.3170 => 30.4457, std.dev.: 0.2409) MultiSource/Applications/oggenc/oggenc: 3.82% (4.7455 => 4.9266, std.dev.: 0.0696) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.79% (1.1672 => 1.2114, std.dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 3.69% (13.3238 => 13.8159, std.dev.: 0.0921) MultiSource/Applications/Burg/burg: 3.51% (1.1440 => 1.1842, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.43% (3.0758 => 3.1813, std.dev.: 0.0376) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.1827 => 1.2200, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (2.0317 => 2.0945, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.05% (1.2021 => 1.2388, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.2186 => 8.4655, std.dev.: 0.0727) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.4408 => 1.4837, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 2.97% (14.6079 => 15.0413, std.dev.: 0.0931) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (6.2546 => 6.4385, std.dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.7226 => 0.7437, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.91% (1.4113 => 1.4523, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.4908 => 6.6764, std.dev.: 0.0679) MultiSource/Applications/treecc/treecc: 2.81% (1.8798 => 1.9326, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 2.78% (3.5980 => 3.6979, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.65% (0.8569 => 0.8796, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 2.59% (1.3268 => 1.3612, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.4880 => 0.5001, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (4.0318 => 4.1270, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.26% (0.5520 => 0.5645, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.01% (0.5963 => 0.6083, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.4189 => 1.4447, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.78% (0.9029 => 0.9190, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.3380 => 4.4099, std.dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2293, std.dev.: 0.0510) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0010, std.dev.: 0.0587) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.78% (4.0101 => 4.5626, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8070, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.91% (0.2694 => 0.2934, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6240, std.dev.: 0.0275) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.53% (1.0063 => 1.0821, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (0.3301 => 0.3476, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.54% (40.4792 => 42.3156, std.dev.: 0.6242) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.24% (4.2129 => 4.3914, std.dev.: 0.0341) SingleSource/Benchmarks/Misc/ReedSolomon: 3.96% (8.5113 => 8.8486, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7911, std.dev.: 0.0636) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8725, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 2.96% (3.5520 => 3.6570, std.dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: 2.89% (14.4877 => 14.9068, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 2.72% (3.8907 => 3.9966, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.67% (2.6656 => 2.7369, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.77% (2.4013 => 2.4439, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.50% (5.2665 => 4.0816, std.dev.: 0.0708) SingleSource/Benchmarks/Shootout-C++/ary3: -20.57% (1.7473 => 1.3879, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.39% (1.1647 => 0.9622, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.84% (15.8312 => 13.1650, std.dev.: 0.1042) SingleSource/Benchmarks/Shootout/sieve: -12.04% (8.1594 => 7.1773, std.dev.: 0.0208) MultiSource/Applications/sgefa/sgefa: -11.27% (0.3746 => 0.3324, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.12% (0.0917 => 0.0815, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.92% (3.2007 => 2.9471, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.74% (3.6254 => 3.3810, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8714, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3332, std.dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: -6.39% (7.6833 => 7.1920, std.dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -5.87% (1.4441 => 1.3593, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (3.4230 => 3.2269, std.dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9265, std.dev.: 0.1205) SingleSource/Benchmarks/Shootout/fib2: -5.17% (4.4195 => 4.1908, std.dev.: 0.0532) MultiSource/Benchmarks/FreeBench/distray/distray: -5.07% (0.2664 => 0.2529, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.23% (0.4564 => 0.4371, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.2722 => 1.2219, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.62% (1.2959 => 1.2490, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: -3.55% (8.5323 => 8.2293, std.dev.: 0.0710) SingleSource/Benchmarks/McGill/misr: -3.51% (0.4296 => 0.4145, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (9.2503 => 8.9488, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.04% (0.4140 => 0.4014, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.03% (45.4683 => 44.0904, std.dev.: 0.4443) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8294, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2902, std.dev.: 0.0145) MultiSource/Applications/aha/aha: -2.00% (3.4286 => 3.3599, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.00% (1.1683 => 1.1449, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4205, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.86% (92.7467 => 91.0251, std.dev.: 0.4145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.84% (3.7496 => 3.6807, std.dev.: 0.0227) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2298, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.45% (2.8964 => 2.8545, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3188, std.dev.: 0.0503) SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.5617 => 16.3672, std.dev.: 0.0505) SingleSource/Benchmarks/Dhrystone/fldry: -1.17% (2.4971 => 2.4680, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.55% (0.9980 => 1.0135, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -2.19% (0.6022 => 0.5890, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -7.68% (0.1666 => 0.1538, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.48% (0.1554 => 0.1329, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.09% (0.3083 => 0.2957, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.06% (0.2394 => 0.2201, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.35% (0.3175 => 0.3005, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.56% (0.2302 => 0.2105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -38.08% (0.0449 => 0.0278, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -31.75% (0.0189 => 0.0129, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -22.49% (0.0249 => 0.0193, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.54% (0.1429 => 0.1407, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -0.71% (1.5019 => 1.4912, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.53% (0.1501 => 0.1448, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.89% (0.4264 => 0.4098, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.76% (0.1344 => 0.1408, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.89% (0.0589 => 0.0606, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (0.0232 => 0.0222, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.63% (0.0639 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.78% (1.1350 => 1.1261, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -62.50% (0.0024 => 0.0009, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.36% (0.0246 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.14% (0.7541 => 0.7627, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.84% (1.5363 => 1.5953, std.dev.: 0.0082) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.43% (0.0070 => 0.0041, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 15:56:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 17:56:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120922225654.A7CD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4158?compare_to=4154&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4158, Order: 164465, Start Time: 2012-09-22 21:43:45, End Time: 2012-09-22 22:58:23 To: 4154, Order: 164464, Start Time: 2012-09-22 19:09:14, End Time: 2012-09-22 20:23:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (180 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 966 (692 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.48% (55.1640 => 56.5327, std.dev.: 0.1163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.44% (79.2888 => 80.4322, std.dev.: 0.3833) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.2920 => 1.3090, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.26% (0.4200 => 0.3979, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.84% (2.0176 => 2.4381, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 12.84% (0.5818 => 0.6565) SingleSource/UnitTests/ObjC++/Hello: 12.73% (0.5748 => 0.6480, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 12.28% (0.7061 => 0.7928, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.75% (0.1013 => 0.1132, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.68% (0.1413 => 0.1578, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 11.55% (0.4328 => 0.4828, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.13% (3.9660 => 4.4074, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.90% (0.2596 => 0.2879, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 10.79% (1.3693 => 1.5170, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.78% (0.7710 => 0.8541, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.62% (0.2760 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.49% (0.3899 => 0.4308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.33% (0.3485 => 0.3845, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.30% (0.7038 => 0.7763, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.22% (0.6959 => 0.7670, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.18% (0.9199 => 1.0135, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.17% (0.1327 => 0.1462, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.15% (1.2193 => 1.3431, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.15% (1.9828 => 2.1840, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.06% (0.3130 => 0.3445, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (0.2765 => 0.3043, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3489 => 0.3837, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.95% (0.4390 => 0.4827, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.91% (13.8202 => 15.1900, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists: 9.90% (0.3293 => 0.3619, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.89% (0.3580 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.78% (0.3107 => 0.3411, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.76% (1.4563 => 1.5985, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.76% (0.4016 => 0.4408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.75% (0.3149 => 0.3456, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.70% (0.1062 => 0.1165, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.67% (1.1364 => 1.2463, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.55% (0.6283 => 0.6883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.46% (0.3192 => 0.3494, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.25% (0.5577 => 0.6093, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 9.11% (0.3534 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.95% (1.0313 => 1.1236, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.93% (0.3246 => 0.3536, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.88% (0.4379 => 0.4768, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.84% (0.2127 => 0.2315, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.81% (0.4791 => 0.5213, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.65% (0.2995 => 0.3254, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.64% (7.2180 => 7.8416, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 8.62% (1.1061 => 1.2014, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.50% (0.7506 => 0.8144, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.48% (0.5637 => 0.6115, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 8.43% (0.2243 => 0.2432, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 8.42% (0.3220 => 0.3491, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.42% (3.6692 => 3.9780, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 8.37% (3.8646 => 4.1882, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 8.29% (16.6129 => 17.9893, std.dev.: 0.0360) MultiSource/Benchmarks/McCat/09-vor/vor: 8.27% (0.2925 => 0.3167, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.27% (0.7460 => 0.8077, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.15% (0.3755 => 0.4061, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.10% (0.8310 => 0.8983, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.99% (0.8698 => 0.9393, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.89% (2.1791 => 2.3511, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 7.86% (1.9270 => 2.0785, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.78% (3.1889 => 3.4371, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.63% (1.0594 => 1.1402, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.53% (1.3245 => 1.4243, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 7.53% (0.6744 => 0.7252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.42% (0.6576 => 0.7064, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4113 => 0.4416, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.08% (4.3801 => 4.6903, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 7.08% (1.2749 => 1.3651, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 7.07% (14.8535 => 15.9042, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 7.07% (8.4961 => 9.0966, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 7.07% (0.2859 => 0.3061, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.03% (1.3819 => 1.4790, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.01% (4.4433 => 4.7548, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 6.89% (1.2292 => 1.3139, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4763, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.85% (1.1333 => 1.2109, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.85% (0.6135 => 0.6555, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.78% (0.2140 => 0.2285, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (13.2842 => 14.1708, std.dev.: 0.0117) MultiSource/Applications/oggenc/oggenc: 6.53% (4.6629 => 4.9673, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.46% (0.6250 => 0.6654, std.dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 6.46% (14.5298 => 15.4685, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.36% (0.8818 => 0.9379, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.29% (6.5754 => 6.9891, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.89% (0.4805 => 0.5088, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.88% (3.2742 => 3.4667, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.83% (4.9865 => 5.2771, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.52% (1.5188 => 1.6027, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (6.2785 => 6.6239, std.dev.: 0.0185) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.40% (0.9108 => 0.9600, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.27% (3.7467 => 3.9442, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.11% (2.1007 => 2.2081, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 4.62% (33.2944 => 34.8337, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.19% (0.3511 => 0.3623, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.90% (16.2614 => 16.7334, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.54% (1.1560 => 1.2547, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7239, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1160, std.dev.: 0.0346) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5923, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5854, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2245, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5893, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9176, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.58% (0.4657 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.33% (22.5627 => 22.0376, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2944, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.47% (3.2729 => 3.1592, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.74% (3.0263 => 2.9433, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2516, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1402, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: -1.33% (1.2308 => 1.2144, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2132, std.dev.: 0.0235) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4339, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.05% (7.3305 => 7.2537, std.dev.: 0.0268) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 16:03:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 18:03:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120922230307.27CFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4159?compare_to=4156&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4159, Order: 164465, Start Time: 2012-09-22 21:44:04, End Time: 2012-09-22 23:04:08 To: 4156, Order: 164464, Start Time: 2012-09-22 19:30:30, End Time: 2012-09-22 20:50:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (155 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.87% (81.4453 => 79.1105, std.dev.: 0.7833) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5789 => 0.5788, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.08% (16.1158 => 16.1294, std.dev.: 0.0218) MultiSource/Applications/kimwitu++/kc: -0.02% (15.0406 => 15.0378, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: -0.01% (83.4713 => 83.4666, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.3683 => 4.3754, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.2371 => 1.2377, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.5424 => 7.5416, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.7352 => 3.7350, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.6522 => 0.6511, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (0.0647 => 0.0674, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.98% (63.2438 => 83.4666, std.dev.: 0.0255) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14220.69% (0.0720 => 10.3109, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.77% (10.3673 => 15.5267, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.65% (2.2022 => 2.5468, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.42% (7.0540 => 8.1417, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.67% (0.0834 => 0.0948, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.54% (0.1566 => 0.1778, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3543 => 0.4002, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.82% (1.1194 => 1.2629, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.31% (1.7609 => 1.9776, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3516 => 0.3943, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.03% (0.1625 => 0.1788, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 9.03% (0.1440 => 0.1570, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5925 => 0.6453, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.76% (9.4845 => 10.3152, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.69% (0.3177 => 0.3453, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.65% (0.4879 => 0.5301, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4615 => 0.5009, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 8.11% (10.4361 => 11.2821, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 8.07% (5.7591 => 6.2238, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.01% (0.2271 => 0.2453, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.2700 => 0.2916, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.94% (0.3109 => 0.3356, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 7.88% (0.7433 => 0.8019, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.87% (0.2554 => 0.2755, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.85% (0.1695 => 0.1828, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3423 => 0.3690, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 7.77% (0.7115 => 0.7668, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.73% (0.6675 => 0.7191, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.64% (1.5415 => 1.6593, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.61% (0.5860 => 0.6306, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (1.3050 => 1.4041, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.52% (4.2646 => 4.5853, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (8.1363 => 8.7481, std.dev.: 0.0081) MultiSource/Applications/d/make_dparser: 7.52% (3.3354 => 3.5861, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.50% (0.5105 => 0.5488, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.48% (0.1510 => 0.1623, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2758 => 0.2961, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.36% (0.2107 => 0.2262, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.33% (4.9449 => 5.3073, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.31% (0.3121 => 0.3349, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5569 => 0.5974, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.8172 => 0.8764, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.24% (5.0018 => 5.3639, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 7.16% (0.7835 => 0.8396, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.12% (0.8067 => 0.8641, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.96% (0.9765 => 1.0445, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.96% (0.1940 => 0.2075, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 6.92% (0.3092 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (7.9617 => 8.5072, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 6.71% (0.4289 => 0.4577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.69% (1.1642 => 1.2421, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.67% (0.5020 => 0.5355, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.67% (0.4064 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.64% (0.3162 => 0.3372, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.64% (0.3826 => 0.4080, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 6.60% (0.6456 => 0.6882, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.51% (0.4299 => 0.4579, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.49% (1.1861 => 1.2631, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.3098 => 0.3298, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.42% (0.3865 => 0.4113, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.42% (1.5603 => 1.6604, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 6.42% (0.3180 => 0.3384, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.3441 => 0.3661, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.37% (3.8723 => 4.1188, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4203 => 0.4468, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.30% (0.3650 => 0.3880, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.24% (0.3603 => 0.3828, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.20% (2.0665 => 2.1946, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.19% (1.0722 => 1.1386, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2603 => 0.2764, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 6.14% (0.3387 => 0.3595, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.12% (21.9371 => 23.2800, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 6.08% (0.4048 => 0.4294, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.3232 => 0.3427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (0.4620 => 0.4898, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.02% (0.2793 => 0.2961, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3935 => 0.4170, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.97% (2.0273 => 2.1483, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.88% (0.6450 => 0.6829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3684 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 5.69% (2.2969 => 2.4277, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.65% (0.8921 => 0.9425, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.52% (0.5981 => 0.6311, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.28% (1.5859 => 1.6696, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.4186 => 1.4893, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (14.3668 => 15.0596, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.78% (1.1840 => 1.2406, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.76% (2.2024 => 2.3072, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.61% (0.3817 => 0.3993, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (0.2266 => 0.2370, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2842 => 1.3411, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.63% (0.8101 => 0.8395, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.50% (0.3427 => 0.3547, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.28% (17.1811 => 17.5731, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (3.8922 => 3.9779, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3853, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (3.6395 => 3.7752, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.04% (4.2280 => 4.3564, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7660, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.60% (9.1159 => 9.2621, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7990, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 1.23% (2.2771 => 2.3051, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.21% (5.2763 => 3.2601, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.96% (5.3855 => 3.9335, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.71% (5.3526 => 3.9231, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1063, std.dev.: 0.0419) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.27% (2.9384 => 2.6071, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: -7.51% (22.1758 => 20.5107, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2610, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7114, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7919, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.90% (1.6805 => 1.5982, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5081, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.52% (1.2373 => 1.2061, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9884, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0904, std.dev.: 0.0117) SingleSource/UnitTests/Vector/multiplies: -1.82% (2.5528 => 2.5064, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.78% (8.6802 => 8.5256, std.dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2536, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2325, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.69% (0.5229 => 0.5788, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 7.60% (14.9895 => 16.1294, std.dev.: 0.0218) MultiSource/Applications/kimwitu++/kc: 6.23% (14.1553 => 15.0378, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 6.44% (4.1105 => 4.3754, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.03% (1.1048 => 1.2377, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.36% (7.1582 => 7.5416, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.86% (3.4629 => 3.7350, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.64% (0.6222 => 0.6511, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 28.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 16:53:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 18:53:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120922235319.5573A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4159?compare_to=4155&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4159, Order: 164464, Start Time: 2012-09-22 21:10:46, End Time: 2012-09-22 23:54:47 To: 4155, Order: 164462, Start Time: 2012-09-22 17:57:53, End Time: 2012-09-22 20:41:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (756 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.21% (61.3116 => 74.9290, std.dev.: 0.0260) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.01% (0.3460 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.38% (1.5932 => 1.7586, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.51% (0.5826 => 0.6380, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5889 => 0.6438, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.96% (0.1619 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.14% (1.6211 => 1.7531, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.14% (2.7292 => 2.9514, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.09% (1.3152 => 1.4216, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (3.5627 => 3.8491, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.04% (0.2738 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.03% (0.4994 => 0.5395, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7171 => 0.7744, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.83% (0.2875 => 0.3100, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.5000 => 0.5389, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.61% (0.4361 => 0.4693, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.3004 => 0.3232, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.46% (1.0781 => 1.1585, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.43% (5.5417 => 5.9532, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.36% (0.3195 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.34% (0.3625 => 0.3891, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.29% (0.2729 => 0.2928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.28% (0.2803 => 0.3007, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2792 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.20% (0.5026 => 0.5388, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.20% (0.2750 => 0.2948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.18% (0.2813 => 0.3015, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.12% (0.2780 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.08% (0.2823 => 0.3023, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 7.06% (0.9909 => 1.0609, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.05% (2.0673 => 2.2130, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2811 => 0.3009, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3096 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.01% (0.1968 => 0.2106, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2911 => 0.3115, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (0.3930 => 0.4205, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3060 => 0.3268, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3267 => 0.3489, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.78% (0.4146 => 0.4427, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.75% (0.3124 => 0.3335, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.72% (0.3258 => 0.3477, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.71% (2.1013 => 2.2422, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 6.70% (4.2109 => 4.4929, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.60% (0.3362 => 0.3584, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3317 => 0.3536, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.58% (0.2736 => 0.2916, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.58% (0.2068 => 0.2204, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.56% (1.8794 => 2.0027, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 6.54% (0.3348 => 0.3567, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.53% (0.5900 => 0.6285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.53% (0.3678 => 0.3918, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.52% (0.1549 => 0.1650, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.44% (0.3477 => 0.3701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.43% (0.3282 => 0.3493, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.39% (0.2566 => 0.2730, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.33% (0.3726 => 0.3962, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.33% (0.4139 => 0.4401, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.33% (0.4029 => 0.4284, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 6.31% (23.5202 => 25.0042, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.26% (0.3690 => 0.3921, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.20% (4.6177 => 4.9042, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.18% (0.3981 => 0.4227, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.2866 => 0.3043, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (0.3890 => 0.4128, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.10% (4.4195 => 4.6890, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (0.2691 => 0.2855, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.09% (0.4251 => 0.4510, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.3271 => 0.3470, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.03% (0.3845 => 0.4077, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.97% (0.3903 => 0.4136, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (0.4658 => 0.4935, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.88% (2.1653 => 2.2926, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 5.84% (1.4269 => 1.5103, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.83% (0.6634 => 0.7021, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.81% (1.9694 => 2.0838, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.5012 => 0.5293, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.55% (0.5546 => 0.5854, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.53% (1.9966 => 2.1070, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.49% (0.2040 => 0.2152, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.44% (0.6435 => 0.6785, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.37% (0.2737 => 0.2884, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.25% (0.2969 => 0.3125, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.25% (0.3084 => 0.3246, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 5.23% (0.2391 => 0.2516, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.14% (0.9697 => 1.0195, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 5.13% (0.3336 => 0.3507, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 5.10% (0.7875 => 0.8277, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.2075 => 0.2179, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.99% (2.0346 => 2.1362, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.95% (0.2103 => 0.2207, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.33% (0.4847 => 0.5057, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.92% (0.3498 => 0.3635, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.86% (0.7426 => 0.7713, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3792 => 0.3933, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.72% (0.4253 => 0.4411, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (0.5361 => 0.5554, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.40% (0.5584 => 0.5774, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.18% (11.6398 => 12.0104, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.04% (4.6926 => 4.8353, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 2.04% (11.9555 => 12.1989, std.dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: 1.24% (2.4764 => 2.5070, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.45% (0.2162 => 0.3577, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6731, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1725, std.dev.: 0.0441) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6339, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5035, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4418, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5791, std.dev.: 0.0270) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5603, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ary2: -10.70% (0.2402 => 0.2145, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7863, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -3.78% (11.2080 => 10.7841, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8541, std.dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5777, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9652, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 17:06:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 19:06:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923000619.AEF182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4160?compare_to=4157&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4160, Order: 164468, Start Time: 2012-09-22 22:57:23, End Time: 2012-09-23 00:07:50 To: 4157, Order: 164465, Start Time: 2012-09-22 21:31:08, End Time: 2012-09-22 22:41:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 14 (99 on baseline) Performance Improvements: 1 (37 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 885 (754 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 7.61% (0.2905 => 0.3126, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.7766 => 0.8132, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.47% (0.5617 => 0.5812, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.0860 => 1.1054, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.63% (0.7437 => 0.7558, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 1.49% (3.9441 => 4.0029, std.dev.: 0.0151) MultiSource/Applications/spiff/spiff: 1.37% (0.7738 => 0.7844, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 1.28% (1.3612 => 1.3786, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 1.20% (0.9440 => 0.9553, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.05% (1.2114 => 1.2241, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.07% (21.2152 => 22.2915, std.dev.: 0.2319) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.04% (0.7698 => 0.8009, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.85% (2.2782 => 2.3659, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.67% (4.0816 => 4.1498, std.dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.13% (60.4401 => 59.7548, std.dev.: 0.0493) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0135 => 1.0227, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -0.14% (0.5890 => 0.5882, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: - (0.1538 => 0.1538, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.68% (0.1329 => 0.1338, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (0.2957 => 0.2958, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.04% (0.2201 => 0.2224, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.23% (0.3005 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.33% (0.2105 => 0.2112, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -12.59% (0.0278 => 0.0243, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.17% (0.0092 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.58% (0.0076 => 0.0081, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0191 => 0.0191, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.04% (0.0386 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.08% (0.0299 => 0.0227, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0282 => 0.0282, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0323 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0178 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 48.84% (0.0129 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 30.05% (0.0193 => 0.0251, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 0.81% (0.0124 => 0.0125, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.70% (0.1407 => 0.1459, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -3.28% (1.4912 => 1.4423, std.dev.: 0.0213) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.04% (0.1448 => 0.1433, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.88% (0.4098 => 0.4298, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.49% (0.1408 => 0.1387, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.25% (0.0606 => 0.0656, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.36% (0.0222 => 0.0245, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.35% (0.0643 => 0.0570, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.90% (1.1261 => 1.1362, std.dev.: 0.0986) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -58.33% (0.0012 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 166.67% (0.0009 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.29% (0.0543 => 0.0588, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.70% (0.0191 => 0.0263, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7627 => 0.7647, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.14% (1.5953 => 1.5975, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.76% (0.0041 => 0.0037, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.52% (4.1772 => 3.1111, std.dev.: 0.1284) SingleSource/Benchmarks/Shootout-C++/except: 82833.33% (0.0006 => 0.4976, std.dev.: 0.0023) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.83% (0.0745 => 0.0930, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.47% (0.1414 => 0.1562, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 9.46% (2.1763 => 2.3822, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6410 => 0.6949, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 8.17% (0.5309 => 0.5743, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 6.97% (0.6173 => 0.6603, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 6.69% (1.0046 => 1.0718, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 6.45% (1.1653 => 1.2405, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.06% (0.3582 => 0.3799, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.91% (0.3217 => 0.3407, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.52% (0.6915 => 0.7297, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 5.50% (15.3105 => 16.1532, std.dev.: 0.1947) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (1.5150 => 1.5967, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.31% (0.7722 => 0.8132, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.28% (0.3901 => 0.4107, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.06% (0.4248 => 0.4463, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.98% (0.2552 => 0.2679, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.1672 => 1.2241, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 4.85% (3.0225 => 3.1692, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.64% (0.2886 => 0.3020, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.59% (0.7226 => 0.7558, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.55% (0.6069 => 0.6345, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (12.6413 => 13.1930, std.dev.: 0.0368) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.35% (0.7639 => 0.7971, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 4.29% (29.3170 => 30.5741, std.dev.: 0.2350) MultiSource/Benchmarks/McCat/09-vor/vor: 4.20% (0.3026 => 0.3153, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.13% (13.3238 => 13.8738, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.2797 => 0.2910, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (1.1827 => 1.2301, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: 3.96% (0.3084 => 0.3206, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.92% (0.3008 => 0.3126, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.90% (1.3268 => 1.3786, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (3.0758 => 3.1951, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 3.86% (1.1440 => 1.1882, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 3.61% (3.5980 => 3.7280, std.dev.: 0.0170) MultiSource/Applications/treecc/treecc: 3.55% (1.8798 => 1.9466, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (8.2186 => 8.5091, std.dev.: 0.0845) MultiSource/Applications/oggenc/oggenc: 3.45% (4.7455 => 4.9094, std.dev.: 0.0126) MultiSource/Applications/ClamAV/clamscan: 3.45% (14.6079 => 15.1123, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 3.43% (0.8405 => 0.8693, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.0689 => 1.1054, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.35% (6.2546 => 6.4644, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 3.24% (2.0972 => 2.1651, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (1.4408 => 1.4870, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.20% (0.7784 => 0.8033, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0821 => 1.1166, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 3.18% (3.8796 => 4.0029, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.12% (0.5636 => 0.5812, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (4.0318 => 4.1575, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.4113 => 1.4553, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (6.4908 => 6.6913, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.08% (1.2021 => 1.2391, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.01% (0.8569 => 0.8827, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.00% (0.4562 => 0.4699, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.91% (0.4880 => 0.5022, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.86% (2.0317 => 2.0899, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.86% (0.9029 => 0.9287, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (1.2742 => 1.3106, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.7256 => 15.1450, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.85% (0.5937 => 0.6106, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.38% (1.4189 => 1.4526, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.2815 => 4.3809, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5520 => 0.5646, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (4.2616 => 4.3573, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (8.2559 => 8.4374, std.dev.: 0.0258) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.5963 => 0.6088, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.3380 => 4.4173, std.dev.: 0.0277) MultiSource/Applications/spiff/spiff: 1.37% (0.7738 => 0.7844, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.36% (0.9425 => 0.9553, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.34% (0.0917 => 0.1076, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.54% (0.0766 => 0.0885, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 15.04% (1.7426 => 2.0047, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5629, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.95% (0.2694 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.74% (7.0025 => 7.6146, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.58% (1.0063 => 1.0926, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.19% (0.2857 => 0.3091, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.26% (0.7609 => 0.8009, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: 4.47% (15.2242 => 15.9047, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.10% (0.5587 => 0.5816, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/dt: 4.01% (0.9851 => 1.0246, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (40.4792 => 41.9484, std.dev.: 0.4022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8718, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.6308 => 0.6524, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.95% (2.6656 => 2.7442, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.94% (0.5876 => 0.6049, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5113 => 8.7606, std.dev.: 0.0921) MultiSource/Applications/hexxagon/hexxagon: 2.74% (14.4877 => 14.8840, std.dev.: 0.0487) MultiSource/Benchmarks/sim/sim: 2.64% (3.8907 => 3.9934, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/mason/mason: 2.60% (0.5004 => 0.5134, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 2.31% (3.5520 => 3.6339, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 1.88% (2.4013 => 2.4464, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.10% (2.4455 => 2.4724, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.18% (0.3497 => 0.2092, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.20% (5.2665 => 4.1498, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/ary3: -20.44% (1.7473 => 1.3901, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.41% (1.1647 => 0.9619, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.04% (15.8312 => 13.2920, std.dev.: 0.1794) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.36% (3.2007 => 2.9330, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3752, std.dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3310, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.55% (2.0027 => 1.8716, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -6.54% (7.6833 => 7.1805, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: -6.11% (3.4230 => 3.2137, std.dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -5.96% (1.4441 => 1.3580, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9303, std.dev.: 0.1586) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1857, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.81% (1.4021 => 1.3347, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -4.19% (8.5323 => 8.1752, std.dev.: 0.0957) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (9.2503 => 8.9262, std.dev.: 0.0461) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8283, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std.dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.65% (3.7496 => 3.6504, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.54% (1.0686 => 1.0415, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: -2.47% (1.4117 => 1.3769, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.46% (2.4457 => 2.3855, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.32% (61.1734 => 59.7548, std.dev.: 0.0493) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.21% (1.1683 => 1.1425, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -2.04% (3.4286 => 3.3587, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3121, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -1.43% (2.4971 => 2.4615, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3063, std.dev.: 0.0432) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.27% (1.7361 => 1.7140, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.47% (0.9980 => 1.0227, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -2.32% (0.6022 => 0.5882, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -7.68% (0.1666 => 0.1538, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.90% (0.1554 => 0.1338, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.05% (0.3083 => 0.2958, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.10% (0.2394 => 0.2224, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.57% (0.3175 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.25% (0.2302 => 0.2112, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -45.88% (0.0449 => 0.0243, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -66.25% (0.0240 => 0.0081, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.58% (0.0301 => 0.0227, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.10% (0.1429 => 0.1459, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -3.97% (1.5019 => 1.4423, std.dev.: 0.0213) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.53% (0.1501 => 0.1433, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.80% (0.4264 => 0.4298, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.20% (0.1344 => 0.1387, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.38% (0.0589 => 0.0656, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.60% (0.0232 => 0.0245, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.80% (0.0639 => 0.0570, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1350 => 1.1362, std.dev.: 0.0986) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0637 => 0.0588, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (0.0246 => 0.0263, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7541 => 0.7647, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.98% (1.5363 => 1.5975, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.14% (0.0070 => 0.0037, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 17:40:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 19:40:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923004011.1BD752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4161?compare_to=4158&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4161, Order: 164468, Start Time: 2012-09-22 23:27:03, End Time: 2012-09-23 00:41:39 To: 4158, Order: 164465, Start Time: 2012-09-22 21:43:45, End Time: 2012-09-22 22:58:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.27% (3.7755 => 3.8613, std.dev.: 0.0291) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.35% (2.0176 => 2.4282, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 13.27% (0.5818 => 0.6590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 13.26% (0.5748 => 0.6510, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.59% (0.7061 => 0.7950, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4328 => 0.4800, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.54% (3.9660 => 4.3842, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.49% (1.3693 => 1.5130, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.7710 => 0.8512, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.21% (0.2596 => 0.2861, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.21% (0.3899 => 0.4297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 10.09% (0.4062 => 0.4472, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2721 => 0.2993) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.83% (1.2193 => 1.3391, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.81% (0.3485 => 0.3827, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.80% (0.7038 => 0.7728, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.80% (0.5265 => 0.5781, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.76% (1.9828 => 2.1763, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.74% (0.9199 => 1.0095, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.72% (0.2726 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.64% (0.2655 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.61% (0.2966 => 0.3251, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.60% (0.6959 => 0.7627, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3578 => 0.3921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.57% (0.1327 => 0.1454, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.52% (0.4390 => 0.4808, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.48% (13.8202 => 15.1303, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3789 => 0.4148, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.42% (0.3756 => 0.4110, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3489 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.39% (0.3601 => 0.3939, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.39% (0.3580 => 0.3916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.38% (0.3293 => 0.3602, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.35% (0.2696 => 0.2948, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.34% (1.4563 => 1.5923, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3623 => 0.3961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3663 => 0.4004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.30% (0.3914 => 0.4278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.29% (0.4016 => 0.4389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.28% (0.3868 => 0.4227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.27% (0.3107 => 0.3395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.21% (0.3149 => 0.3439, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.4003 => 0.4371, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.18% (1.1364 => 1.2407, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.06% (0.3453 => 0.3766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.05% (0.3192 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.02% (0.6283 => 0.6850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.77% (0.3534 => 0.3844, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.68% (1.0313 => 1.1208, std.dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.65% (0.4379 => 0.4758, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.63% (0.3246 => 0.3526, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.62% (0.5577 => 0.6058, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.56% (0.1589 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.46% (0.2127 => 0.2307, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.43% (0.1435 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.36% (7.2180 => 7.8215, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.29% (0.4791 => 0.5188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.25% (0.7506 => 0.8125, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 8.23% (1.1061 => 1.1971, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.18% (0.2995 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.12% (0.6576 => 0.7110, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.11% (0.5637 => 0.6094, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.98% (0.2243 => 0.2422, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.98% (3.8646 => 4.1729, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (3.6692 => 3.9612, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3220 => 0.3475, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.91% (0.7460 => 0.8050, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 7.85% (16.6129 => 17.9174, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.2925 => 0.3154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.78% (0.3755 => 0.4047, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 7.73% (0.8310 => 0.8952, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 7.53% (3.1889 => 3.4290, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.51% (0.8698 => 0.9351, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 7.42% (1.9270 => 2.0700, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.38% (0.6744 => 0.7242, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.31% (2.1791 => 2.3384, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 7.24% (1.0594 => 1.1361, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.12% (1.3245 => 1.4188, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1569 => 0.1676, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (1.2749 => 1.3618, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.78% (0.3245 => 0.3465, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.78% (14.8535 => 15.8605, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 6.72% (8.4961 => 9.0671, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.71% (1.3813 => 1.4740, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.68% (0.2140 => 0.2283, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.68% (4.3801 => 4.6725, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.65% (1.3819 => 1.4738, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.62% (4.4433 => 4.7376, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 6.62% (1.2292 => 1.3106, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.62% (0.6135 => 0.6541, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.58% (0.2859 => 0.3047, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.45% (1.1333 => 1.2064, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.41% (4.6629 => 4.9617, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 6.29% (0.3131 => 0.3328, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (13.2842 => 14.1184, std.dev.: 0.0195) MultiSource/Applications/ClamAV/clamscan: 6.18% (14.5298 => 15.4281, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (6.5754 => 6.9791, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2504 => 0.2655, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.02% (0.6250 => 0.6626, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.90% (0.8818 => 0.9338, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.54% (0.4805 => 0.5071, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.47% (3.2742 => 3.4533, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (6.2785 => 6.6088, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.19% (4.9865 => 5.2455, std.dev.: 0.0189) MultiSource/Applications/lua/lua: 5.12% (3.7467 => 3.9385, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.09% (0.9108 => 0.9572, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.08% (1.5188 => 1.5959, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.60% (2.1007 => 2.1974, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 4.22% (33.2944 => 34.6989, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3511 => 0.3626, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.71% (16.2614 => 16.7026, std.dev.: 0.0243) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std.dev.: 0.0296) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2557, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (3.1736 => 3.4114, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1218, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-6: 3.28% (1.9199 => 1.9828, std.dev.: 0.0016) MultiSource/Benchmarks/llubenchmark/llu: 2.34% (3.7731 => 3.8613, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.04% (7.4271 => 7.5789, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.32% (5.5130 => 5.5857, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2264, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6852, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.80% (22.5627 => 21.9300, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2868, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.62% (1.3780 => 1.3006, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.35% (1.7688 => 1.7095, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2482, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1615, std.dev.: 0.0188) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2351, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2524, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4340, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 17:52:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 19:52:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120923005226.16C202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4162?compare_to=4156&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4162, Order: 164469, Start Time: 2012-09-22 23:33:38, End Time: 2012-09-23 00:53:52 To: 4156, Order: 164464, Start Time: 2012-09-22 19:30:30, End Time: 2012-09-22 20:50:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (155 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5789 => 0.5785, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: -0.16% (16.1158 => 16.0899, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: -0.50% (15.0406 => 14.9651, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: -0.01% (83.4713 => 83.4654, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: -0.19% (4.3683 => 4.3598, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.15% (1.2371 => 1.2352, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (7.5424 => 7.5308, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.40% (3.7352 => 3.7204, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6522 => 0.6517, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.77% (0.0647 => 0.0652, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.97% (63.2438 => 83.4654, std.dev.: 0.0083) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14221.39% (0.0720 => 10.3114, std.dev.: 0.0079) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.62% (10.3673 => 15.5120, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: 30.33% (0.1622 => 0.2114, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.09% (7.0540 => 8.1891, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.89% (2.2022 => 2.5521, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3473 => 0.3922, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.78% (0.3497 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.69% (1.1194 => 1.2614, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3543 => 0.3992, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3516 => 0.3957, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 12.50% (0.3561 => 0.4006, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3694 => 0.4142, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.91% (1.7609 => 1.9707, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 9.96% (0.3282 => 0.3609, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 9.28% (0.5925 => 0.6475, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.09% (0.6030 => 0.6578, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.98% (0.1125 => 0.1226, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1440 => 0.1567, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7326 => 0.7969, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.59% (0.3177 => 0.3450, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.56% (9.4845 => 10.2963, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3307 => 0.3582, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.08% (0.4615 => 0.4988, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.96% (0.2700 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.4879 => 0.5267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.79% (0.2554 => 0.2753, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.66% (0.3109 => 0.3347, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.63% (10.4361 => 11.2320, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/18-imp/imp: 7.57% (0.3423 => 0.3682, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 7.56% (0.7433 => 0.7995, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 7.52% (0.7115 => 0.7650, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.50% (5.7591 => 6.1911, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.47% (8.1363 => 8.7443, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 7.38% (0.7835 => 0.8413, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.35% (0.5860 => 0.6291, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.34% (0.6675 => 0.7165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.33% (1.3050 => 1.4006, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.32% (4.2646 => 4.5768, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.30% (1.5415 => 1.6541, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 7.24% (3.3354 => 3.5769, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.23% (0.8172 => 0.8763, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5569 => 0.5963, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.06% (7.9617 => 8.5234, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.00% (5.0018 => 5.3519, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.99% (0.8067 => 0.8631, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.89% (0.2758 => 0.2948, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.89% (0.3121 => 0.3336, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.88% (0.5105 => 0.5456, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.87% (4.9449 => 5.2846, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.75% (0.3422 => 0.3653, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.61% (0.9765 => 1.0410, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.60% (0.4636 => 0.4942, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.60% (0.3092 => 0.3296, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 6.49% (1.1642 => 1.2398, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 6.48% (0.4289 => 0.4567, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.43% (0.4103 => 0.4367, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 6.41% (1.5603 => 1.6603, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3650 => 0.3882, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4299 => 0.4570, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.27% (0.4064 => 0.4319, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.27% (1.1861 => 1.2605, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.25% (21.9371 => 23.3081, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 6.22% (3.8723 => 4.1133, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2877 => 0.3056, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.22% (0.5020 => 0.5332, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3441 => 0.3654, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.19% (0.4203 => 0.4463, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.16% (2.0665 => 2.1937, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 6.14% (0.3387 => 0.3595, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.08% (0.4048 => 0.4294, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.05% (0.3865 => 0.4099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3603 => 0.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2603 => 0.2759, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.98% (1.0722 => 1.1363, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.95% (0.3162 => 0.3350, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.93% (0.3826 => 0.4053, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4620 => 0.4893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 5.77% (2.0273 => 2.1443, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.77% (0.3935 => 0.4162, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.51% (0.3684 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5981 => 0.6310, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.46% (0.6450 => 0.6802, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.29% (0.8921 => 0.9393, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.20% (2.2969 => 2.4163, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.91% (1.5859 => 1.6637, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (1.4186 => 1.4874, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3817 => 0.4002, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (14.3668 => 15.0247, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.45% (2.2024 => 2.3003, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.39% (1.1840 => 1.2360, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2842 => 1.3390, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (0.8101 => 0.8389, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5559, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (3.8922 => 3.9625, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3851, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (3.6395 => 3.7678, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3476, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.56% (9.1159 => 9.2580, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7990, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2580, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.83% (5.3855 => 3.9405, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.55% (5.3526 => 3.9317, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1416, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.35% (2.9384 => 2.6049, std.dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: -7.64% (22.1758 => 20.4813, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3072, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1619, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -3.21% (1.2373 => 1.1976, std.dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5038, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9913, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5136, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0948, std.dev.: 0.0369) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2513, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.63% (0.5229 => 0.5785, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 7.34% (14.9895 => 16.0899, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 5.72% (14.1553 => 14.9651, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 6.06% (4.1105 => 4.3598, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.80% (1.1048 => 1.2352, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (7.1582 => 7.5308, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.44% (3.4629 => 3.7204, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.74% (0.6222 => 0.6517, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 4.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 18:34:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 20:34:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923013403.A16572A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4163?compare_to=4160&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4163, Order: 164470, Start Time: 2012-09-23 00:23:20, End Time: 2012-09-23 01:35:31 To: 4160, Order: 164468, Start Time: 2012-09-22 22:57:23, End Time: 2012-09-23 00:07:50 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (96 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 894 (756 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5866 => 0.5992, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.93% (3.1111 => 3.1711, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.48% (2.9057 => 2.9488, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.7606 => 8.8696, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.08% (1.7140 => 1.7325, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.86% (0.6639 => 0.6449, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.08% (1.0227 => 1.0219, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 0.46% (0.5882 => 0.5909, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: -0.20% (0.1538 => 0.1535, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1338 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.74% (0.2958 => 0.2980, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.31% (0.2224 => 0.2231, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.20% (0.2998 => 0.2992, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.28% (0.2112 => 0.2106, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 15.23% (0.0243 => 0.0280, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 2.27% (0.0088 => 0.0090) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.70% (0.0081 => 0.0084) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.57% (0.0191 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.48% (0.0227 => 0.0303, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.42% (0.0282 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.68% (0.0179 => 0.0182) SingleSource/UnitTests/Vector/Altivec/test1: 1.04% (0.0192 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0251 => 0.0254, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 0.80% (0.0125 => 0.0126, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1459 => 0.1458, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 0.85% (1.4423 => 1.4546, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.40% (0.1433 => 0.1496, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.40% (0.4298 => 0.3937, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.01% (0.1387 => 0.1373, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.52% (0.0656 => 0.0646, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.71% (0.0245 => 0.0259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.11% (0.0570 => 0.0558, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.92% (0.0048 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1362 => 1.1268, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 360.00% (0.0005 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.97% (0.0588 => 0.0547, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.38% (0.0263 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7647 => 0.7648, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.06% (1.5975 => 1.5985, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 227.03% (0.0037 => 0.0121, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.09% (4.1772 => 3.1711, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/except: 82133.33% (0.0006 => 0.4934, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.90% (0.1414 => 0.1554, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6410 => 0.6983, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 8.34% (2.1763 => 2.3577, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: 8.29% (0.5309 => 0.5749, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.65% (0.6173 => 0.6645, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.53% (1.0046 => 1.0702, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (1.1653 => 1.2406, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.34% (0.3582 => 0.3809, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.76% (0.6915 => 0.7313, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 5.69% (0.3217 => 0.3400, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.2552 => 0.2693, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 5.47% (15.3105 => 16.1480, std.dev.: 0.0812) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (1.5150 => 1.5957, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.3026 => 0.3174, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3901 => 0.4088, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.1672 => 1.2218, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.54% (0.4248 => 0.4441, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.39% (0.5740 => 0.5992, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.39% (0.7226 => 0.7543, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 4.34% (29.3170 => 30.5882, std.dev.: 0.1140) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (12.6413 => 13.1865, std.dev.: 0.0549) MultiSource/Applications/d/make_dparser: 4.30% (3.0225 => 3.1526, std.dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 4.28% (13.3238 => 13.8944, std.dev.: 0.0507) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.03% (0.7639 => 0.7947, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.97% (0.6069 => 0.6310, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.86% (1.1827 => 1.2284, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.84% (0.2654 => 0.2756, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.81% (0.2806 => 0.2913, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.77% (0.5937 => 0.6161, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.77% (1.1440 => 1.1871, std.dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.69% (0.3008 => 0.3119, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 3.66% (3.5980 => 3.7296, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.56% (1.4408 => 1.4921, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.53% (3.0758 => 3.1843, std.dev.: 0.0229) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (6.2546 => 6.4718, std.dev.: 0.0218) MultiSource/Applications/hbd/hbd: 3.44% (1.3268 => 1.3725, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 3.44% (2.0972 => 2.1694, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 3.39% (3.8796 => 4.0113, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.6079 => 15.0986, std.dev.: 0.0547) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5636 => 0.5824, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 3.30% (4.7455 => 4.9019, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/football/football: 3.30% (0.8405 => 0.8682, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4880 => 0.5040, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.27% (1.4113 => 1.4574, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (6.4908 => 6.6954, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.0317 => 2.0956, std.dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0821 => 1.1161, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.09% (0.4596 => 0.4738, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.0689 => 1.1019, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (1.2021 => 1.2389, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.5520 => 0.5688, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.99% (8.2186 => 8.4641, std.dev.: 0.0571) MultiSource/Applications/treecc/treecc: 2.94% (1.8798 => 1.9350, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash: 2.93% (0.3520 => 0.3623, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9029 => 0.9290, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.77% (14.7256 => 15.1330, std.dev.: 0.0516) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (1.4189 => 1.4580, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (4.0318 => 4.1427, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/hash2: 2.65% (0.3847 => 0.3949, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (1.2742 => 1.3078, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (4.2616 => 4.3707, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.55% (4.3380 => 4.4487, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.2815 => 4.3801, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.2559 => 8.4229, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.01% (0.5963 => 0.6083, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 28.86% (0.0499 => 0.0643, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0692) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.93% (0.0766 => 0.0911, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 14.93% (1.7426 => 2.0028, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (4.0101 => 4.5522, std.dev.: 0.0236) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.93% (0.2857 => 0.3112, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6074, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.64% (1.0063 => 1.0832, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (0.3301 => 0.3491, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.43% (40.4792 => 42.6756, std.dev.: 0.4489) SingleSource/Benchmarks/Misc/ReedSolomon: 4.21% (8.5113 => 8.8696, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/fp-convert: 4.19% (15.2242 => 15.8616, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: 3.71% (0.9851 => 1.0216, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.40% (0.5876 => 0.6076, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.01% (2.6656 => 2.7459, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8977, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/mason/mason: 2.74% (0.5004 => 0.5141, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 2.69% (3.8907 => 3.9952, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash: 2.27% (0.6308 => 0.6451, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 2.16% (3.5520 => 3.6287, std.dev.: 0.0158) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4491, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 1.33% (1.4184 => 1.4373, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.15% (2.9152 => 2.9488, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4455 => 2.4707, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.61% (0.3497 => 0.2042, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.34% (5.2665 => 4.1424, std.dev.: 0.0479) SingleSource/Benchmarks/Shootout-C++/ary3: -20.19% (1.7473 => 1.3945, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.34% (1.1647 => 0.9627, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.13% (15.8312 => 13.1191, std.dev.: 0.2454) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: -10.91% (0.0917 => 0.0817, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9438, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.2664 => 0.2460, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3790, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3304, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -6.35% (7.6833 => 7.1952, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: -6.06% (3.4230 => 3.2155, std.dev.: 0.0697) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -5.82% (1.4441 => 1.3601, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -5.50% (62.4126 => 58.9829, std.dev.: 0.0752) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1866, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: -4.61% (8.5323 => 8.1388, std.dev.: 0.1050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (9.2503 => 8.8709, std.dev.: 0.0669) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.50% (61.1734 => 59.0323, std.dev.: 0.4736) SingleSource/Benchmarks/McGill/misr: -3.05% (0.4296 => 0.4165, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8289, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.69% (3.7496 => 3.6487, std.dev.: 0.0206) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.92% (2.3569 => 2.3117, std.dev.: 0.0055) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3666, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (92.7467 => 91.0721, std.dev.: 0.2473) SingleSource/Benchmarks/Shootout-C++/hash2: -1.77% (3.4876 => 3.4260, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2285, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3066, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (2.4971 => 2.4635, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: -1.02% (3.8200 => 3.7809, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.39% (0.9980 => 1.0219, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -1.88% (0.6022 => 0.5909, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: -7.86% (0.1666 => 0.1535, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.90% (0.1554 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.34% (0.3083 => 0.2980, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.81% (0.2394 => 0.2231, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.76% (0.3175 => 0.2992, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.51% (0.2302 => 0.2106, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.00% (0.0240 => 0.0084) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -61.23% (0.0325 => 0.0126, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -3.15% (1.5019 => 1.4546, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.67% (0.4264 => 0.3937, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.16% (0.1344 => 0.1373, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.68% (0.0589 => 0.0646, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.64% (0.0232 => 0.0259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.68% (0.0639 => 0.0558, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1350 => 1.1268, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 283.33% (0.0006 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.13% (0.0637 => 0.0547, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.0246 => 0.0264, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.05% (1.5363 => 1.5985, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 19:23:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 21:23:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923022333.6671B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4164?compare_to=4161&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4164, Order: 164470, Start Time: 2012-09-23 01:10:20, End Time: 2012-09-23 02:25:01 To: 4161, Order: 164468, Start Time: 2012-09-22 23:27:03, End Time: 2012-09-23 00:41:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (181 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.78% (3.8613 => 3.7927, std.dev.: 0.0236) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.77% (2.0176 => 2.4366, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.32% (0.5818 => 0.6535, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.20% (0.5748 => 0.6449, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 11.85% (0.7061 => 0.7898, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 11.75% (0.1013 => 0.1132, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.37% (1.3693 => 1.5250, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.11% (0.4328 => 0.4809, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.06% (3.9660 => 4.4048, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.68% (0.2781 => 0.3078, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.67% (0.7710 => 0.8533, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.67% (0.2596 => 0.2873, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.36% (0.4062 => 0.4483, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.36% (0.7038 => 0.7767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.34% (0.3899 => 0.4302, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.2721 => 0.3001, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.21% (1.2193 => 1.3438, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.14% (0.5265 => 0.5799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.10% (0.3130 => 0.3446, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.09% (0.9199 => 1.0127, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.04% (0.6959 => 0.7658, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.89% (0.2690 => 0.2956, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.84% (1.9828 => 2.1780, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.84% (0.2765 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.74% (1.4563 => 1.5981, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.3489 => 0.3828, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 9.71% (13.8202 => 15.1615, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.68% (0.4390 => 0.4815, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.66% (0.3580 => 0.3926, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 9.63% (0.3293 => 0.3610, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.62% (1.1364 => 1.2457, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.58% (0.3756 => 0.4116, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.58% (0.6283 => 0.6885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.49% (0.4016 => 0.4397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.46% (0.3868 => 0.4234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.46% (0.2696 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.24% (0.3453 => 0.3772, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 9.18% (0.3192 => 0.3485, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.01% (1.0313 => 1.1242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.94% (0.3534 => 0.3850, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.93% (0.3246 => 0.3536, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2127 => 0.2317, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.93% (0.5577 => 0.6075, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.91% (0.4379 => 0.4769, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 8.88% (0.2995 => 0.3261, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.87% (0.4791 => 0.5216, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3646 => 0.3966, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3601 => 0.3917, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3650 => 0.3969, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.70% (7.2180 => 7.8461, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 8.69% (0.3623 => 0.3938, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 8.67% (0.4003 => 0.4350, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.2914 => 0.3166, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.54% (3.6692 => 3.9824, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: 8.47% (1.1061 => 1.1998, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 8.42% (0.2945 => 0.3193, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.42% (0.7506 => 0.8138, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 8.39% (3.8646 => 4.1889, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/18-imp/imp: 8.39% (0.3220 => 0.3490, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.2243 => 0.2429, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.28% (0.5637 => 0.6104, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.2925 => 0.3165, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.16% (16.6129 => 17.9691, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/football/football: 8.16% (0.8310 => 0.8988, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.11% (0.7460 => 0.8065, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.00% (0.6576 => 0.7102, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.96% (0.2023 => 0.2184, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.83% (0.1865 => 0.2011, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 7.81% (1.9270 => 2.0775, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 7.80% (2.1791 => 2.3491, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 7.75% (3.1889 => 3.4360, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 7.74% (0.6744 => 0.7266, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.71% (0.8698 => 0.9369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.70% (0.3755 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.65% (1.0594 => 1.1404, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.48% (0.1657 => 0.1781, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.48% (1.3245 => 1.4236, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 7.38% (0.2859 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.34% (0.4113 => 0.4415, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.30% (1.3813 => 1.4821, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.29% (1.3819 => 1.4827, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 7.14% (14.8535 => 15.9136, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 7.12% (1.2749 => 1.3657, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.10% (0.2140 => 0.2292, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.07% (8.4961 => 9.0971, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.07% (4.3801 => 4.6898, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.03% (4.4433 => 4.7555, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.93% (0.3245 => 0.3470, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.86% (0.6135 => 0.6556, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 6.76% (1.2292 => 1.3123, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.75% (1.1333 => 1.2098, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 6.64% (0.3131 => 0.3339, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.61% (13.2842 => 14.1621, std.dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: 6.57% (14.5298 => 15.4850, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.51% (0.2321 => 0.2472, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.45% (4.6629 => 4.9638, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.42% (0.8818 => 0.9384, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.35% (6.5754 => 6.9932, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.35% (0.2504 => 0.2663, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6250 => 0.6640, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.82% (3.2742 => 3.4647, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.81% (0.4805 => 0.5084, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (6.2785 => 6.6380, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.60% (4.9865 => 5.2658, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.43% (1.5188 => 1.6012, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.42% (0.9108 => 0.9602, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.24% (3.7467 => 3.9430, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.2008 => 0.2110, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.03% (2.1007 => 2.2063, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 4.58% (33.2944 => 34.8196, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.53% (0.3511 => 0.3635, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7398, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2687, std.dev.: 0.0403) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.3458 => 0.3627, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7249, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.63% (10.7476 => 11.1376, std.dev.: 0.0529) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5820, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5829, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2244, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.69% (0.4657 => 0.3973, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.51% (22.5627 => 21.9955, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2648, std.dev.: 0.0496) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.13% (1.3780 => 1.2935, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.59% (3.2729 => 3.1554, std.dev.: 0.0262) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0181) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9222, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2452, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1392, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2526, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 19:41:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 21:41:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120923024121.8C1B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4165?compare_to=4162&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4165, Order: 164470, Start Time: 2012-09-23 01:22:47, End Time: 2012-09-23 02:42:49 To: 4162, Order: 164469, Start Time: 2012-09-22 23:33:38, End Time: 2012-09-23 00:53:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (152 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5785 => 0.5795, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.05% (16.0899 => 16.0816, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: -0.12% (14.9651 => 14.9477, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: 0.16% (83.4654 => 83.6012, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.3598 => 4.3562, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.09% (1.2352 => 1.2363, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.5308 => 7.5337, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.10% (3.7204 => 3.7243, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.46% (0.6517 => 0.6487, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.61% (0.0652 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.19% (63.2438 => 83.6012, std.dev.: 0.0012) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14218.61% (0.0720 => 10.3094, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.12% (10.3673 => 15.5631, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 30.27% (0.1622 => 0.2113, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.45% (7.0540 => 8.2141, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.10% (2.2022 => 2.5567, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.19% (1.1194 => 1.2671, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.58% (0.3561 => 0.4009, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3516 => 0.3958, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.40% (1.7609 => 1.9793, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.24% (0.3282 => 0.3618, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 9.03% (0.1440 => 0.1570, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.75% (0.3177 => 0.3455, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.62% (9.4845 => 10.3024, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1655 => 0.1793, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.18% (0.4879 => 0.5278, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.11% (0.2700 => 0.2919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3307 => 0.3574, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.91% (0.4615 => 0.4980, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.76% (10.4361 => 11.2460, std.dev.: 0.0174) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3109 => 0.3348, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 7.68% (0.3423 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (8.1363 => 8.7584, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.56% (0.2554 => 0.2747, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7326 => 0.7878, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7433 => 0.7992, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.52% (0.7115 => 0.7650, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.44% (7.9617 => 8.5539, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 7.44% (5.7591 => 6.1873, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.34% (0.6675 => 0.7165, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.30% (1.3050 => 1.4003, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.23% (4.2646 => 4.5731, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.19% (0.8067 => 0.8647, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.17% (0.5860 => 0.6280, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (1.5415 => 1.6519, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.8172 => 0.8757, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.15% (0.5569 => 0.5967, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 7.14% (3.3354 => 3.5737, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2107 => 0.2256, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.00% (4.9449 => 5.2910, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.98% (5.0018 => 5.3511, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.90% (0.5105 => 0.5457, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.89% (0.1625 => 0.1737, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.85% (0.7835 => 0.8372, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.85% (0.2758 => 0.2947, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.3121 => 0.3333, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 6.79% (0.3092 => 0.3302, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1940 => 0.2070, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.54% (0.9765 => 1.0404, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 6.50% (0.1555 => 0.1656, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.34% (21.9371 => 23.3290, std.dev.: 0.0163) MultiSource/Applications/Burg/burg: 6.30% (1.1642 => 1.2376, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4299 => 0.4570, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.30% (1.1861 => 1.2608, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.28% (0.3422 => 0.3637, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4636 => 0.4926, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.18% (3.8723 => 4.1118, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: 6.18% (1.5603 => 1.6567, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.14% (0.3387 => 0.3595, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.13% (0.4064 => 0.4313, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.12% (0.5020 => 0.5327, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.09% (0.4103 => 0.4353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.05% (0.2891 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.04% (0.6456 => 0.6846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.99% (0.3441 => 0.3647, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.97% (0.4289 => 0.4545, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.92% (0.3650 => 0.3866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.90% (0.2831 => 0.2998, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.89% (1.0722 => 1.1354, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.88% (0.2603 => 0.2756, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3865 => 0.4091, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 5.73% (2.0273 => 2.1435, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.69% (0.4203 => 0.4442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.68% (0.3098 => 0.3274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2872 => 0.3035, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 5.67% (0.4620 => 0.4882, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.64% (0.3136 => 0.3313, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (2.0665 => 2.1821, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3826 => 0.4040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2756 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.59% (0.2793 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3232 => 0.3411, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.4048 => 0.4272, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2802 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3935 => 0.4152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3603 => 0.3801, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2871 => 0.3028, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.44% (0.3162 => 0.3334, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.40% (0.6450 => 0.6798, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.32% (0.8921 => 0.9396, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.25% (0.5981 => 0.6295, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 5.24% (0.3684 => 0.3877, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.18% (2.2969 => 2.4159, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.03% (0.3379 => 0.3549, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.87% (0.3817 => 0.4003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (1.4186 => 1.4869, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.81% (1.5859 => 1.6622, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (14.3668 => 15.0270, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.35% (2.2024 => 2.2981, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.34% (1.1840 => 1.2354, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2842 => 1.3333, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.55% (0.3131 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (0.8101 => 0.8369, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.24% (0.3427 => 0.3538, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.24% (17.1811 => 17.5657, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (3.8922 => 3.9640, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (3.1578 => 3.3855, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7704, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (4.2280 => 4.3531, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.64% (9.1159 => 9.2650, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5780, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2664, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.37% (5.3855 => 3.9656, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.07% (5.3526 => 3.9572, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1732, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.27% (2.9384 => 2.6073, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -7.47% (22.1758 => 20.5183, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -10.46% (1.5373 => 1.3765, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2848, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5023, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.51% (1.2373 => 1.2062, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4985, std.dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9949, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2531, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.68% (10.2830 => 10.1098, std.dev.: 0.0261) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0154) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.82% (0.5229 => 0.5795, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 7.29% (14.9895 => 16.0816, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 5.60% (14.1553 => 14.9477, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: 5.98% (4.1105 => 4.3562, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.90% (1.1048 => 1.2363, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.25% (7.1582 => 7.5337, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.55% (3.4629 => 3.7243, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.26% (0.6222 => 0.6487, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 20:46:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 22:46:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923034651.4AC052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4166?compare_to=4163&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4166, Order: 164471, Start Time: 2012-09-23 02:37:14, End Time: 2012-09-23 03:48:20 To: 4163, Order: 164470, Start Time: 2012-09-23 00:23:20, End Time: 2012-09-23 01:35:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (67 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 891 (783 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 49.50% (0.0202 => 0.0302, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.04% (2.4043 => 2.5975, std.dev.: 0.0427) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.93% (1.3207 => 1.3990, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.66% (13.1191 => 13.4675, std.dev.: 0.0436) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (4.5093 => 4.5846, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (4.6812 => 4.7352, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: 1.08% (8.8709 => 8.9671, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.02% (5.8739 => 5.9339, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -29.39% (0.0643 => 0.0454, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.97% (1.0219 => 1.0120, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -0.39% (0.5909 => 0.5886, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: -1.69% (0.1535 => 0.1509, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.37% (0.1338 => 0.1343, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.51% (0.2980 => 0.2935, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.05% (0.2231 => 0.2163, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.84% (0.2992 => 0.3017, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.33% (0.2106 => 0.2113, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -11.79% (0.0280 => 0.0247, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: -66.67% (0.0090 => 0.0030, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.52% (0.0084 => 0.0076, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0194 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.84% (0.0391 => 0.0376, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0303 => 0.0301, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0286 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -23.69% (0.0325 => 0.0248, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -1.10% (0.0182 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.52% (0.0194 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.57% (0.0254 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.79% (0.0126 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1458 => 0.1455, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.52% (1.4546 => 1.4767, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.75% (0.1496 => 0.1410, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.40% (0.3937 => 0.4071, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.24% (0.1373 => 0.1356, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.15% (0.0646 => 0.0574, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.39% (0.0259 => 0.0201, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.77% (0.0558 => 0.0646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.42% (1.1268 => 1.1315, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -30.43% (0.0023 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.89% (0.0547 => 0.0623, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.88% (0.0264 => 0.0230, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7648 => 0.7650, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.22% (1.5985 => 1.6020, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.18% (4.1772 => 3.1252, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/except: 82000.00% (0.0006 => 0.4926, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.23% (2.1763 => 2.3772, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.22% (0.6410 => 0.7001, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.5309 => 0.5693, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 6.97% (0.6173 => 0.6603, std.dev.: 0.0164) MultiSource/Applications/SIBsim4/SIBsim4: 6.43% (1.1653 => 1.2402, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.80% (0.2552 => 0.2700, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.65% (0.6915 => 0.7306, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.64% (0.3582 => 0.3784, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (1.5150 => 1.5969, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (12.6413 => 13.2512, std.dev.: 0.0354) MultiSource/Benchmarks/Bullet/bullet: 4.36% (29.3170 => 30.5945, std.dev.: 0.4107) MultiSource/Applications/d/make_dparser: 4.31% (3.0225 => 3.1527, std.dev.: 0.0331) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.19% (0.7639 => 0.7959, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.07% (0.2952 => 0.3072, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.03% (1.2021 => 1.2505, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4562 => 0.4743, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6069 => 0.6304, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.78% (13.3238 => 13.8268, std.dev.: 0.1288) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.61% (0.3901 => 0.4042, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.61% (0.3217 => 0.3333, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (3.0758 => 3.1853, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (2.0317 => 2.1034, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.53% (1.4408 => 1.4916, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.51% (0.4248 => 0.4397, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2546 => 6.4736, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1672 => 1.2073, std.dev.: 0.0150) MultiSource/Applications/hbd/hbd: 3.30% (1.3268 => 1.3706, std.dev.: 0.0143) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (8.2186 => 8.4805, std.dev.: 0.0750) MultiSource/Applications/oggenc/oggenc: 3.12% (4.7455 => 4.8936, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.07% (4.0318 => 4.1556, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.6079 => 15.0299, std.dev.: 0.1073) MultiSource/Applications/siod/siod: 2.84% (2.0972 => 2.1567, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8405 => 0.8630, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (1.4113 => 1.4485, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4880 => 0.4997, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.85% (4.2815 => 4.3608, std.dev.: 0.0289) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.84% (1.4189 => 1.4450, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0010, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.08% (4.0101 => 4.5747, std.dev.: 0.0092) SingleSource/Benchmarks/Stanford/Puzzle: 10.75% (0.1433 => 0.1587, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 10.49% (1.6261 => 1.7966, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6214, std.dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.79% (1.0063 => 1.0948, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.37% (0.2857 => 0.3096, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.79% (0.3301 => 0.3558, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.00% (40.4792 => 42.5044, std.dev.: 0.5405) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 3.66% (15.2242 => 15.7809, std.dev.: 0.0790) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8723, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.03% (0.5876 => 0.6054, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 3.01% (8.5113 => 8.7671, std.dev.: 0.0489) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8953, std.dev.: 0.0877) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.77% (0.5587 => 0.5742, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 2.70% (3.8907 => 3.9957, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.66% (4.6127 => 4.7352, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.56% (2.6656 => 2.7338, std.dev.: 0.0108) MultiSource/Applications/siod/siod: 2.46% (3.5520 => 3.6393, std.dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/dry: 1.84% (2.4013 => 2.4455, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (4.5056 => 4.5846, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/hash: 1.72% (4.3016 => 4.3755, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.81% (5.2665 => 4.1707, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/ary3: -20.14% (1.7473 => 1.3954, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.1647 => 0.9603, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.93% (15.8312 => 13.4675, std.dev.: 0.0436) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std.dev.: 0.0308) MultiSource/Applications/sgefa/sgefa: -12.01% (0.3746 => 0.3296, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: -10.05% (0.1114 => 0.1002, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.19% (3.2007 => 2.9385, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.6254 => 3.3786, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: -6.64% (0.2664 => 0.2487, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3341, std.dev.: 0.0269) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8733, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -6.35% (7.6833 => 7.1951, std.dev.: 0.0377) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3559, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.87% (3.4230 => 3.2222, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: -5.51% (62.4126 => 58.9730, std.dev.: 0.0531) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1888, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.20% (0.4140 => 0.3966, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/misr: -3.45% (0.4296 => 0.4148, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -3.06% (9.2503 => 8.9671, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.7496 => 3.6389, std.dev.: 0.0303) MultiSource/Applications/SPASS/SPASS: -2.81% (8.5323 => 8.2929, std.dev.: 0.0879) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std.dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.72% (1.2722 => 1.2376, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.68% (3.9413 => 3.8355, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.58% (45.4683 => 44.2938, std.dev.: 0.3306) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.41% (1.1683 => 1.1402, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -2.02% (3.4286 => 3.3592, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4190, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3133, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2480, std.dev.: 0.0304) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3162, std.dev.: 0.0860) SingleSource/Benchmarks/Dhrystone/fldry: -1.19% (2.4971 => 2.4673, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.12% (2.4457 => 2.4182, std.dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.40% (0.9980 => 1.0120, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -2.26% (0.6022 => 0.5886, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: -9.42% (0.1666 => 0.1509, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.58% (0.1554 => 0.1343, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.80% (0.3083 => 0.2935, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.65% (0.2394 => 0.2163, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.98% (0.3175 => 0.3017, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.21% (0.2302 => 0.2113, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -44.99% (0.0449 => 0.0247, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0025) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.59% (0.0390 => 0.0376, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -23.46% (0.0324 => 0.0248, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.68% (1.5019 => 1.4767, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.06% (0.1501 => 0.1410, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.53% (0.4264 => 0.4071, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.89% (0.1344 => 0.1356, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.0589 => 0.0574, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.10% (0.0639 => 0.0646, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.31% (1.1350 => 1.1315, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.20% (0.0637 => 0.0623, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.50% (0.0246 => 0.0230, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.28% (1.5363 => 1.6020, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 21:06:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 23:06:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923040659.353412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4167?compare_to=4164&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4167, Order: 164471, Start Time: 2012-09-23 02:53:49, End Time: 2012-09-23 04:08:26 To: 4164, Order: 164470, Start Time: 2012-09-23 01:10:20, End Time: 2012-09-23 02:25:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (182 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.6386 => 56.4903, std.dev.: 0.1167) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.86% (2.0176 => 2.4384, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939) SingleSource/UnitTests/ObjC++/property-reference-object: 12.29% (0.5818 => 0.6533, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.11% (0.5748 => 0.6444, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.83% (0.7061 => 0.7896, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.45% (0.1013 => 0.1129, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.37% (1.3693 => 1.5250, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.07% (0.4328 => 0.4807, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.99% (3.9660 => 4.4019, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.99% (0.7710 => 0.8557, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.67% (0.2596 => 0.2873, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.47% (0.2721 => 0.3006, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.39% (0.2782 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.32% (0.4062 => 0.4481, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.21% (0.3899 => 0.4297, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.20% (1.2193 => 1.3437, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.19% (0.3022 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.16% (0.5265 => 0.5800, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.16% (0.7038 => 0.7753, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.06% (0.6959 => 0.7659, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.03% (0.3130 => 0.3444, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.99% (0.3485 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.98% (0.9199 => 1.0117, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.92% (13.8202 => 15.1909, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.80% (1.9828 => 2.1771, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.72% (1.4563 => 1.5979, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.68% (0.4390 => 0.4815, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.66% (1.1364 => 1.2462, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.2726 => 0.2989, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.63% (0.3489 => 0.3825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.58% (0.3580 => 0.3923, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.54% (0.3293 => 0.3607, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.53% (0.2696 => 0.2953, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.50% (0.3756 => 0.4113, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.47% (0.6283 => 0.6878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.46% (0.4016 => 0.4396, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.44% (0.3868 => 0.4233, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.38% (0.3453 => 0.3777, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3149 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.25% (0.1589 => 0.1736, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.05% (1.0313 => 1.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.03% (0.3246 => 0.3539, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.02% (0.5577 => 0.6080, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.91% (0.3534 => 0.3849, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.84% (0.2127 => 0.2315, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.84% (0.4379 => 0.4766, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 8.80% (0.3646 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.79% (0.3650 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3601 => 0.3917, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.77% (0.4791 => 0.5211, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1276 => 0.1387, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.69% (7.2180 => 7.8451, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 8.66% (0.3914 => 0.4253, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.55% (1.1061 => 1.2007, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 8.52% (0.2243 => 0.2434, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.46% (0.7506 => 0.8141, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.41% (0.5637 => 0.6111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2945 => 0.3190, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 8.31% (3.8646 => 4.1859, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.30% (0.6576 => 0.7122, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.29% (3.6692 => 3.9734, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 8.23% (0.8310 => 0.8994, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/18-imp/imp: 8.20% (0.3220 => 0.3484, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.17% (16.6129 => 17.9699, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.16% (0.2023 => 0.2188, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.14% (0.7460 => 0.8067, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.84% (2.1791 => 2.3500, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.83% (0.1865 => 0.2011, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.80% (3.1889 => 3.4377, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.79% (0.8698 => 0.9376, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.76% (1.9270 => 2.0765, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.67% (0.3755 => 0.4043, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.66% (0.1657 => 0.1784, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.61% (1.0594 => 1.1400, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.52% (0.6744 => 0.7251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.47% (1.3245 => 1.4235, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 7.42% (0.4113 => 0.4418, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685) MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (1.2749 => 1.3685, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.34% (1.3813 => 1.4827, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.34% (1.3819 => 1.4833, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 7.21% (0.2859 => 0.3065, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.20% (14.8535 => 15.9227, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 7.15% (8.4961 => 9.1033, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.06% (0.2140 => 0.2291, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.05% (4.3801 => 4.6890, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.04% (4.4433 => 4.7563, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.86% (0.6135 => 0.6556, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.84% (0.3245 => 0.3467, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.79% (1.1333 => 1.2103, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 6.73% (1.2292 => 1.3119, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.68% (0.3131 => 0.3340, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (13.2842 => 14.1605, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.52% (14.5298 => 15.4775, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 6.48% (4.6629 => 4.9649, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.46% (0.8818 => 0.9388) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 6.37% (6.5754 => 6.9940, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.29% (0.6250 => 0.6643, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.84% (3.2742 => 3.4655, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.83% (0.4805 => 0.5085, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.71% (6.2785 => 6.6373, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.56% (4.9865 => 5.2637, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.50% (0.9108 => 0.9609, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.43% (1.5188 => 1.6013, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.29% (3.7467 => 3.9450, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.2008 => 0.2110, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.01% (2.1007 => 2.2059, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 4.52% (33.2944 => 34.7982, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.56% (0.3511 => 0.3636, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7402, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5089, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2627, std.dev.: 0.0364) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.11% (1.2998 => 1.3792, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7242, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1145, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5914, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5991, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9262, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2243, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.69% (0.4657 => 0.3973, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.51% (22.5627 => 21.9975, std.dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2917, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.66% (1.3780 => 1.3000, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -5.35% (2.5089 => 2.3746, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.49% (3.2729 => 3.1586, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2398, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1452, std.dev.: 0.0217) SingleSource/Benchmarks/McGill/chomp: -1.37% (1.2308 => 1.2139, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2251, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2545, std.dev.: 0.0162) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 21:30:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Sep 2012 23:30:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120923043019.C80D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4168?compare_to=4165&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4168, Order: 164471, Start Time: 2012-09-23 03:11:43, End Time: 2012-09-23 04:31:47 To: 4165, Order: 164470, Start Time: 2012-09-23 01:22:47, End Time: 2012-09-23 02:42:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (152 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.22% (0.5795 => 0.5782, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -0.03% (16.0816 => 16.0768, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: -0.00% (14.9477 => 14.9476, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: -0.02% (83.6012 => 83.5844, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.3562 => 4.3602, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2363 => 1.2367, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (7.5337 => 7.5220, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.02% (3.7243 => 3.7250, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.6487 => 0.6485, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.16% (63.2438 => 83.5844, std.dev.: 0.0096) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14239.31% (0.0720 => 10.3243, std.dev.: 0.0062) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.78% (10.3673 => 15.5286, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: 30.33% (0.1622 => 0.2114, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.35% (7.0540 => 8.2071, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.15% (2.2022 => 2.5578, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.05% (1.1194 => 1.2655, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.73% (0.3497 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.66% (0.3561 => 0.4012, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.40% (1.7609 => 1.9792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.79% (0.3886 => 0.4344, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.30% (0.3282 => 0.3620, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.78% (0.3177 => 0.3456, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.64% (9.4845 => 10.3041, std.dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1655 => 0.1793, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.11% (0.2700 => 0.2919, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3307 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.82% (0.4615 => 0.4976, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 7.78% (10.4361 => 11.2482, std.dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 7.72% (0.3109 => 0.3349, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2554 => 0.2751, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.62% (0.3423 => 0.3684, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (8.1363 => 8.7532, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 7.47% (0.7433 => 0.7988, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.46% (0.6675 => 0.7173, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.42% (0.7115 => 0.7643, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.41% (7.9617 => 8.5516, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.41% (4.2646 => 4.5805, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 7.36% (5.7591 => 6.1831, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.8172 => 0.8770, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.28% (0.1510 => 0.1620, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.24% (1.3050 => 1.3995, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.18% (5.0018 => 5.3607, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.17% (1.5415 => 1.6521, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 7.17% (3.3354 => 3.5747, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.17% (0.5860 => 0.6280, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.08% (4.9449 => 5.2952, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 7.08% (0.3092 => 0.3311, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5569 => 0.5963, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2107 => 0.2256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.95% (0.8067 => 0.8628, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2758 => 0.2949, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.89% (0.3121 => 0.3336, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 6.85% (0.7835 => 0.8372, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.80% (0.5105 => 0.5452, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.55% (1.1642 => 1.2404, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.53% (0.9765 => 1.0403, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.32% (21.9371 => 23.3244, std.dev.: 0.0287) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.32% (1.1861 => 1.2611, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4299 => 0.4570, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4636 => 0.4926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.25% (0.3422 => 0.3636, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.22% (0.5020 => 0.5332, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 6.18% (3.8723 => 4.1115, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.11% (0.3387 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3441 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.07% (0.4103 => 0.4352, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.6456 => 0.6845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.02% (0.2891 => 0.3065, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.00% (1.5603 => 1.6539, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2603 => 0.2759, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.2905 => 0.3079, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.97% (0.3650 => 0.3868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.97% (0.4289 => 0.4545, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.4064 => 0.4304, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.89% (1.0722 => 1.1354, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 5.84% (2.0273 => 2.1457, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3865 => 0.4086, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.69% (0.4203 => 0.4442, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.68% (0.3136 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (2.0665 => 2.1835, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2831 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2872 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3098 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.57% (0.2871 => 0.3031, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.57% (0.3826 => 0.4039, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2756 => 0.2909, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.55% (0.3603 => 0.3803, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.3232 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.50% (0.3052 => 0.3220, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4620 => 0.4873, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.47% (0.3162 => 0.3335, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.4048 => 0.4268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2802 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.41% (0.3935 => 0.4148, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.36% (0.3283 => 0.3459, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.33% (0.2793 => 0.2942, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.32% (0.6450 => 0.6793, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.30% (0.5981 => 0.6298, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 5.26% (2.2969 => 2.4177, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.8921 => 0.9389, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists1: 5.16% (0.3684 => 0.3874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.06% (0.3379 => 0.3550, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.90% (0.3817 => 0.4004, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.87% (1.5859 => 1.6632, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.4186 => 1.4863, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (14.3668 => 15.0327, std.dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.1840 => 1.2363, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.35% (2.2024 => 2.2983, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2842 => 1.3334, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.3131 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.41% (0.8101 => 0.8377, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.21% (0.3427 => 0.3537, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.10% (17.1811 => 17.5422, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9635, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (3.1578 => 3.3840, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (1.1396 => 1.2162, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.67% (3.6395 => 3.7729, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (4.2280 => 4.3508, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7660, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.79% (9.1159 => 9.2793, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5761, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.14% (5.2763 => 3.2639, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.42% (5.3855 => 3.9625, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.12% (5.3526 => 3.9544, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1817, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.31% (2.9384 => 2.6060, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -7.47% (22.1758 => 20.5189, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2682, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.48% (1.8329 => 1.7142, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.56% (3.2827 => 3.1660, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4967, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.65% (1.2373 => 1.2045, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -2.00% (10.2830 => 10.0777, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5140, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0052, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2552, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2338, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.58% (0.5229 => 0.5782, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 7.25% (14.9895 => 16.0768, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 5.60% (14.1553 => 14.9476, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 6.07% (4.1105 => 4.3602, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.94% (1.1048 => 1.2367, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.08% (7.1582 => 7.5220, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.57% (3.4629 => 3.7250, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.6222 => 0.6485, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 22:13:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 00:13:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923051330.A6ECA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4169?compare_to=4166&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4169, Order: 164473, Start Time: 2012-09-23 04:04:17, End Time: 2012-09-23 05:15:01 To: 4166, Order: 164471, Start Time: 2012-09-23 02:37:14, End Time: 2012-09-23 03:48:20 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (85 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 892 (765 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.79% (0.4521 => 0.4647, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.2746 => 1.2952, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.2120 => 1.2291, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 1.36% (3.9016 => 3.9548, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 2.69% (8.2929 => 8.5158, std.dev.: 0.0399) SingleSource/Benchmarks/Misc/ReedSolomon: 1.06% (8.7671 => 8.8599, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.61% (0.4743 => 0.4619, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.95% (13.4675 => 13.2045, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.36% (1.0120 => 1.0084, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: -0.44% (0.5886 => 0.5860, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 0.27% (0.1509 => 0.1513, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.49% (0.1343 => 0.1323, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.37% (0.2935 => 0.2836, std.dev.: 0.0150) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.13% (0.2163 => 0.2209, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.04% (0.3017 => 0.2895, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.24% (0.2113 => 0.2108, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -19.03% (0.0247 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: 146.67% (0.0030 => 0.0074, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0076 => 0.0076, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0193 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.66% (0.0376 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.09% (0.0287 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 29.44% (0.0248 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.11% (0.0180 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.55% (0.0193 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0250 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.80% (0.0125 => 0.0124, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1455 => 0.1451, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.02% (1.4767 => 1.4918, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.05% (0.1410 => 0.1453, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.05% (0.4071 => 0.4073, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.47% (0.1356 => 0.1376, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.32% (0.0574 => 0.0616, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.98% (0.0201 => 0.0209, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.71% (0.0646 => 0.0551, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 4600.00% (0.0001 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1315 => 1.1250, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0016 => 0.0010, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.91% (0.0023 => 0.0006, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.27% (0.0623 => 0.0559, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.30% (0.0230 => 0.0204, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7650 => 0.7674, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.16% (1.6020 => 1.5995, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.01% (0.0121 => 0.0098, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.95% (4.1772 => 3.1348, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/except: 82450.00% (0.0006 => 0.4953, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.56% (2.1763 => 2.3625, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.14% (0.6410 => 0.6932, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.5309 => 0.5721, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 6.84% (0.6173 => 0.6595, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 6.79% (1.0046 => 1.0728, std.dev.: 0.0244) MultiSource/Applications/SIBsim4/SIBsim4: 6.30% (1.1653 => 1.2387, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.95% (0.3582 => 0.3795, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.75% (15.3105 => 16.1905, std.dev.: 0.0906) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (0.6915 => 0.7307, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.85% (0.4248 => 0.4454, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.2552 => 0.2674, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.75% (1.5150 => 1.5870, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 4.69% (3.0225 => 3.1644, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.58% (0.6069 => 0.6347, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (12.6413 => 13.2049, std.dev.: 0.1213) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.39% (0.7639 => 0.7974, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.36% (3.0758 => 3.2100, std.dev.: 0.0408) MultiSource/Benchmarks/Bullet/bullet: 4.22% (29.3170 => 30.5548, std.dev.: 0.1528) MultiSource/Applications/SPASS/SPASS: 3.99% (13.3238 => 13.8559, std.dev.: 0.0863) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.98% (1.4408 => 1.4981, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.92% (1.1827 => 1.2291, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 3.76% (1.1440 => 1.1870, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.63% (1.1672 => 1.2096, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (6.2546 => 6.4818, std.dev.: 0.0205) MultiSource/Applications/siod/siod: 3.57% (2.0972 => 2.1720, std.dev.: 0.0149) MultiSource/Applications/hbd/hbd: 3.53% (1.3268 => 1.3736, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: 3.49% (0.3520 => 0.3643, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3062 => 0.3168, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.34% (0.3084 => 0.3187, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.0689 => 1.1045, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (8.2186 => 8.4869, std.dev.: 0.0411) MultiSource/Applications/treecc/treecc: 3.25% (1.8798 => 1.9408, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 3.19% (3.5980 => 3.7128, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0821 => 1.1166, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 3.11% (14.6079 => 15.0618, std.dev.: 0.0490) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (6.4908 => 6.6918, std.dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.05% (2.0317 => 2.0937, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.99% (0.8569 => 0.8825, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.93% (1.2021 => 1.2373, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.7256 => 15.1437, std.dev.: 0.0894) MultiSource/Benchmarks/Prolangs-C/football/football: 2.81% (0.8405 => 0.8641, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.78% (0.7226 => 0.7427, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.0318 => 4.1404, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4880 => 0.4997, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.5963 => 0.6100, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.26% (0.5937 => 0.6071, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.06% (4.2815 => 4.3695, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (3.8796 => 3.9548, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (8.2559 => 8.4104, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.2742 => 1.2952, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.60% (4.3380 => 4.4072, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.44% (4.2616 => 4.3229, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: 1.36% (0.9425 => 0.9553, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.36% (0.7738 => 0.7843, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.98% (0.0766 => 0.0942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout/ary3: 14.75% (1.7426 => 1.9996, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.71% (4.0101 => 4.5600, std.dev.: 0.0110) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.98% (0.0917 => 0.1036, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 10.58% (1.6261 => 1.7981, std.dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6244, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.24% (1.0063 => 1.0792, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/fp-convert: 4.60% (15.2242 => 15.9241, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 4.10% (8.5113 => 8.8599, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.07% (0.8498 => 0.8844, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8729, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.09% (14.4877 => 14.9348, std.dev.: 0.0322) MultiSource/Benchmarks/sim/sim: 2.74% (3.8907 => 3.9974, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.6308 => 0.6477, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/mason/mason: 2.46% (0.5004 => 0.5127, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.40% (3.5520 => 3.6373, std.dev.: 0.0230) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4013 => 2.4483, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.4184 => 1.4394, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.03% (27.1724 => 27.4529, std.dev.: 0.0438) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4455 => 2.4706, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.29% (0.3497 => 0.2053, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: -21.03% (1.7473 => 1.3798, std.dev.: 0.0272) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.57% (5.2665 => 4.2359, std.dev.: 0.1529) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.49% (1.1647 => 0.9610, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.59% (15.8312 => 13.2045, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -11.08% (0.3746 => 0.3331, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: -8.60% (0.2664 => 0.2435, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9390, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3776, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.70% (2.0027 => 1.8685, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3341, std.dev.: 0.0203) MultiSource/Applications/lambda-0_1_3/lambda: -6.27% (7.6833 => 7.2018, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7923, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9226, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/richards_benchmark: -5.59% (1.4441 => 1.3634, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1862, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.40% (0.4140 => 0.3958, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.02% (1.2722 => 1.2211, std.dev.: 0.0120) SingleSource/Benchmarks/McGill/misr: -3.54% (0.4296 => 0.4144, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -3.22% (9.2503 => 8.9523, std.dev.: 0.0645) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.94% (2.4457 => 2.3737, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2838, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.47% (0.6119 => 0.5968, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.43% (1.1683 => 1.1399, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.14% (3.7496 => 3.6695, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.05% (1.0686 => 1.0467, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: -2.01% (3.4876 => 3.4176, std.dev.: 0.0079) MultiSource/Applications/aha/aha: -1.93% (3.4286 => 3.3624, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2227, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/neural/neural: -1.65% (1.0926 => 1.0746, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.50% (1.8739 => 1.8458, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -1.43% (2.4971 => 2.4615, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists: -1.27% (16.5617 => 16.3515, std.dev.: 0.0668) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.04% (0.9980 => 1.0084, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: -2.69% (0.6022 => 0.5860, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -9.18% (0.1666 => 0.1513, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.86% (0.1554 => 0.1323, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.01% (0.3083 => 0.2836, std.dev.: 0.0150) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.73% (0.2394 => 0.2209, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.82% (0.3175 => 0.2895, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.43% (0.2302 => 0.2108, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -55.46% (0.0449 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: -16.85% (0.0089 => 0.0074, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1429 => 0.1451, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -0.67% (1.5019 => 1.4918, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.20% (0.1501 => 0.1453, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.48% (0.4264 => 0.4073, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.38% (0.1344 => 0.1376, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.58% (0.0589 => 0.0616, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.91% (0.0232 => 0.0209, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.77% (0.0639 => 0.0551, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.88% (1.1350 => 1.1250, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0024 => 0.0006, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.24% (0.0637 => 0.0559, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (0.0246 => 0.0204, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.76% (0.7541 => 0.7674, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.11% (1.5363 => 1.5995, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.00% (0.0070 => 0.0098, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 22:50:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 00:50:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923055018.451172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4170?compare_to=4167&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4170, Order: 164474, Start Time: 2012-09-23 04:37:14, End Time: 2012-09-23 05:51:46 To: 4167, Order: 164471, Start Time: 2012-09-23 02:53:49, End Time: 2012-09-23 04:08:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (693 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.82% (2.0176 => 2.4376, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 13.17% (0.5818 => 0.6584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.98% (0.5748 => 0.6494, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 12.49% (0.7061 => 0.7943, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.68% (0.1413 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.35% (0.1013 => 0.1128, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.18% (0.4328 => 0.4812, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.10% (1.3693 => 1.5213, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.99% (3.9660 => 4.4017, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.59% (0.2596 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.58% (0.7710 => 0.8526, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.49% (0.4062 => 0.4488, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.28% (0.3899 => 0.4300, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.24% (1.2193 => 1.3442, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.16% (0.5265 => 0.5800, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.13% (0.7038 => 0.7751, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.10% (0.9199 => 1.0128, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.07% (0.2690 => 0.2961, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.07% (0.3485 => 0.3836, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.03% (0.3130 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.01% (1.9828 => 2.1812, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.99% (0.6959 => 0.7654, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.95% (0.1327 => 0.1459, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.83% (0.3489 => 0.3832, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.82% (0.2761 => 0.3032, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.75% (0.3293 => 0.3614, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.75% (13.8202 => 15.1673, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 9.74% (0.2937 => 0.3223, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.70% (1.4563 => 1.5976, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.67% (1.1364 => 1.2463, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.61% (0.6283 => 0.6887, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.61% (0.4016 => 0.4402, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 9.59% (0.3868 => 0.4239, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.50% (0.2988 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.43% (0.4390 => 0.4804, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.33% (0.3453 => 0.3775, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.30% (0.3601 => 0.3936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.30% (0.3646 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3914 => 0.4277, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3623 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3789 => 0.4139, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3534 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3663 => 0.3998, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.02% (0.4379 => 0.4774, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 9.02% (1.0313 => 1.1243, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.00% (0.5577 => 0.6079, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.96% (0.3940 => 0.4293, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.91% (0.4791 => 0.5218, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.79% (0.2127 => 0.2314, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.70% (7.2180 => 7.8460, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.58% (1.1061 => 1.2010, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5637 => 0.6114, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.33% (3.6692 => 3.9747, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 8.32% (0.3220 => 0.3488, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.30% (0.2914 => 0.3156, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.30% (0.7506 => 0.8129, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 8.28% (3.8646 => 4.1846, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 8.26% (16.6129 => 17.9844, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 8.21% (0.8310 => 0.8992, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.20% (0.2243 => 0.2427, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.20% (0.6576 => 0.7115, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.03% (0.7460 => 0.8059, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.01% (0.2023 => 0.2185, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.91% (0.8698 => 0.9386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.91% (0.3755 => 0.4052, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 7.79% (1.9270 => 2.0771, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.74% (3.1889 => 3.4358, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 7.74% (2.1791 => 2.3477, std.dev.: 0.0142) MultiSource/Benchmarks/nbench/nbench: 7.69% (1.0594 => 1.1409, std.dev.: 0.0106) MultiSource/Applications/minisat/minisat: 7.67% (0.6744 => 0.7261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.58% (0.1569 => 0.1688, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.50% (1.3245 => 1.4238, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 7.48% (0.1657 => 0.1781, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.38% (1.3813 => 1.4833, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.37% (1.3819 => 1.4837, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.32% (0.4113 => 0.4414, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 7.21% (0.2859 => 0.3065, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.21% (14.8535 => 15.9237, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.15% (0.3245 => 0.3477, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 7.14% (1.2749 => 1.3659, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.07% (4.3801 => 4.6898, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 7.06% (8.4961 => 9.0960, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.01% (4.4433 => 4.7549, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.98% (0.6135 => 0.6563, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.2140 => 0.2289, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 6.87% (1.2292 => 1.3137, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.83% (1.1333 => 1.2107, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 6.68% (0.3131 => 0.3340, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (13.2842 => 14.1651, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: 6.53% (14.5298 => 15.4780, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.43% (0.8818 => 0.9385, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 6.42% (6.5754 => 6.9977, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.39% (0.2504 => 0.2664, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.29% (4.6629 => 4.9562, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.22% (0.6250 => 0.6639, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.06% (0.4805 => 0.5096, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.82% (3.2742 => 3.4647, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.80% (4.9865 => 5.2756, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.54% (6.2785 => 6.6263, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.35% (0.9108 => 0.9595, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.30% (1.5188 => 1.5993, std.dev.: 0.0123) MultiSource/Applications/lua/lua: 5.26% (3.7467 => 3.9437, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.00% (2.1007 => 2.2057, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.65% (33.2944 => 34.8426, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.56% (0.3511 => 0.3636, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.07% (16.2614 => 16.7610, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 26.77% (1.8175 => 2.3040, std.dev.: 0.0304) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.03% (1.0895 => 1.3622, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4159, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.60% (1.9144 => 2.0025, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7249, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1061, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5899, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5947, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2266, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.28% (0.4657 => 0.3992, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.52% (22.5627 => 21.9950, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2757, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2939, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.32% (2.6470 => 2.5062, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1570, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.81% (1.9762 => 1.9207, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2486, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1194, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2293, std.dev.: 0.0347) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2519, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2612, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 23:19:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 01:19:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120923061911.A9EF62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4171?compare_to=4168&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4171, Order: 164474, Start Time: 2012-09-23 05:00:48, End Time: 2012-09-23 06:20:41 To: 4168, Order: 164471, Start Time: 2012-09-23 03:11:43, End Time: 2012-09-23 04:31:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (699 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.7934 => 56.6580, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5782 => 0.5785, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 0.04% (16.0768 => 16.0831, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 0.15% (14.9476 => 14.9703, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -0.06% (83.5844 => 83.5384, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.3602 => 4.3656, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.2367 => 1.2354, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.5220 => 7.5240, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (3.7250 => 3.7239, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.6485 => 0.6487, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.09% (63.2438 => 83.5384, std.dev.: 0.0089) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14220.97% (0.0720 => 10.3111, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.91% (10.3673 => 15.5415, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 30.27% (0.1622 => 0.2113, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.10% (7.0540 => 8.1895, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.73% (2.2022 => 2.5485, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.76% (0.3473 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.63% (0.3543 => 0.4026, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-3: 13.54% (0.3516 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.53% (0.3497 => 0.3970, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.45% (0.3561 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.43% (0.3543 => 0.4019, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.05% (0.3694 => 0.4176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.83% (1.1194 => 1.2630, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.83% (0.3828 => 0.4319, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.71% (0.3927 => 0.4426, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.61% (0.3886 => 0.4376, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.80% (1.7609 => 1.9687, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.05% (0.3282 => 0.3612, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5925 => 0.6493, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.52% (0.6030 => 0.6604, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 8.89% (0.1440 => 0.1568, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.62% (0.3177 => 0.3451, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.54% (9.4845 => 10.2944, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7326 => 0.7949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3307 => 0.3581, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.15% (0.2700 => 0.2920, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.87% (0.4879 => 0.5263, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.71% (0.4615 => 0.4971, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.71% (0.2554 => 0.2751, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.70% (0.7433 => 0.8005, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 7.67% (0.1695 => 0.1825, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.66% (10.4361 => 11.2354, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (8.1363 => 8.7568, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 7.62% (0.3423 => 0.3684, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.62% (0.3109 => 0.3346, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.62% (0.7115 => 0.7657, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.43% (0.6675 => 0.7171, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.39% (4.2646 => 4.5796, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 7.35% (5.7591 => 6.1822, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.30% (1.3050 => 1.4003, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.8172 => 0.8768, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.28% (3.3354 => 3.5783, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27% (0.5860 => 0.6286, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (7.9617 => 8.5337, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.17% (1.5415 => 1.6520, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.15% (0.8067 => 0.8644, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2107 => 0.2256, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.04% (0.5569 => 0.5961, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.01% (4.9449 => 5.2915, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.99% (5.0018 => 5.3512, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3121 => 0.3338, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2758 => 0.2949, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.90% (0.7835 => 0.8376, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.88% (0.5105 => 0.5456, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.75% (0.1940 => 0.2071, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.75% (0.4636 => 0.4949, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 6.75% (0.3422 => 0.3653, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.73% (0.9765 => 1.0422, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.63% (0.4103 => 0.4375, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.60% (0.3092 => 0.3296, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.56% (1.1642 => 1.2406, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 6.50% (0.1555 => 0.1656, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.5020 => 0.5343, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.38% (1.1861 => 1.2618, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.37% (0.2905 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.34% (0.4289 => 0.4561, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3650 => 0.3881, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.30% (0.4064 => 0.4320, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 6.29% (21.9371 => 23.3176, std.dev.: 0.0114) MultiSource/Applications/hbd/hbd: 6.24% (1.5603 => 1.6577, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.22% (3.8723 => 4.1132, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3441 => 0.3655, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.3180 => 0.3377, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.19% (0.4299 => 0.4565, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.15% (0.6456 => 0.6853, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.15% (0.2831 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.14% (0.3387 => 0.3595, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.14% (0.4203 => 0.4461, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.14% (0.3162 => 0.3356, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.11% (2.0665 => 2.1928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.11% (0.3865 => 0.4101, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.06% (0.2871 => 0.3045, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2603 => 0.2760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3603 => 0.3820, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.97% (0.3098 => 0.3283, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 5.97% (1.0722 => 1.1362, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.85% (0.4048 => 0.4285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.83% (2.0273 => 2.1455, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4620 => 0.4888, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.79% (0.3935 => 0.4163, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.58% (0.3817 => 0.4030, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.53% (0.6450 => 0.6807, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.51% (0.3684 => 0.3887, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.50% (2.2969 => 2.4232, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3379 => 0.3563, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.26% (0.8921 => 0.9390, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.17% (0.5981 => 0.6290, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.93% (1.5859 => 1.6641, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.4186 => 1.4866, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (14.3668 => 15.0349, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.38% (2.2024 => 2.2989, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.1840 => 1.2352, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2842 => 1.3392, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.06% (0.3131 => 0.3258, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.8101 => 0.8378, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5558, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.76% (3.8922 => 3.9607, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3819, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7630, std.dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3476, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.67% (9.1159 => 9.2685, std.dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5797, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2578, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.83% (5.3855 => 3.9407, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.57% (5.3526 => 3.9302, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1589, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.31% (2.9384 => 2.6061, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -7.60% (22.1758 => 20.4914, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2875, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7102, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5080, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -2.40% (1.2373 => 1.2076, std.dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9867, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: -2.04% (10.2830 => 10.0736, std.dev.: 0.0474) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5042, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2512, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.63% (0.5229 => 0.5785, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 7.30% (14.9895 => 16.0831, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 5.76% (14.1553 => 14.9703, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 6.21% (4.1105 => 4.3656, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.82% (1.1048 => 1.2354, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.11% (7.1582 => 7.5240, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.54% (3.4629 => 3.7239, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.26% (0.6222 => 0.6487, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 23:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 01:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120923062632.1CB652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4172?compare_to=4159&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4172, Order: 164473, Start Time: 2012-09-23 03:44:15, End Time: 2012-09-23 06:28:01 To: 4159, Order: 164464, Start Time: 2012-09-22 21:10:46, End Time: 2012-09-22 23:54:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (131 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 965 (762 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.70% (0.2118 => 0.2281, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.46% (115.6821 => 124.3082, std.dev.: 2.4720) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (54.2050 => 54.8348, std.dev.: 0.0809) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.02% (2.1362 => 2.1145, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -1.01% (2.0027 => 1.9825, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.38% (0.3460 => 0.3923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 12.87% (0.3643 => 0.4112, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3724 => 0.4198, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1063 => 0.1181, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.84% (0.5826 => 0.6399, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.78% (0.5889 => 0.6465, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.35% (1.5932 => 1.7422, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.19% (0.4994 => 0.5403, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7171 => 0.7755, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.85% (0.2738 => 0.2953, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.82% (2.7292 => 2.9425, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.66% (1.3152 => 1.4159, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2875 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (3.5627 => 3.8321, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.42% (1.6211 => 1.7414, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.30% (0.5000 => 0.5365, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.29% (0.4361 => 0.4679, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.29% (0.3004 => 0.3223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.2792 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.13% (0.2750 => 0.2946, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.1421 => 0.1522, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.10% (0.3195 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.07% (0.2729 => 0.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2803 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 7.05% (0.2823 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2811 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.97% (0.2813 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.2780 => 0.2973) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.88% (2.0673 => 2.2095, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 6.83% (0.9909 => 1.0586, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.80% (0.2911 => 0.3109, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3096 => 0.3306, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3267 => 0.3486, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3060 => 0.3265, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3258 => 0.3472, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (0.3930 => 0.4188, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 6.54% (5.5417 => 5.9044, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 6.51% (1.0781 => 1.1483, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3317 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.37% (0.3362 => 0.3576, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.36% (0.3477 => 0.3698, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 6.31% (0.3678 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3124 => 0.3321, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.29% (2.1013 => 2.2334, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 6.20% (23.5202 => 24.9781, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: 6.18% (0.3348 => 0.3555, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.15% (0.5900 => 0.6263, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 6.15% (0.3726 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.12% (0.3282 => 0.3483, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.12% (0.2566 => 0.2723, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 6.12% (4.2109 => 4.4684, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.07% (0.2736 => 0.2902, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4146 => 0.4392, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (0.5026 => 0.5324, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 5.91% (0.4029 => 0.4267, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.90% (0.2068 => 0.2190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3690 => 0.3906, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 5.83% (0.4251 => 0.4499, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.80% (0.4139 => 0.4379, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (4.4195 => 4.6755, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.2866 => 0.3031, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.3981 => 0.4208, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.57% (0.3845 => 0.4059, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.53% (0.9697 => 1.0233, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 5.51% (4.6177 => 4.8722, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 5.49% (1.8794 => 1.9825, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (0.3890 => 0.4103, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.3903 => 0.4110, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.25% (2.1653 => 2.2790, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 5.17% (1.4269 => 1.5007, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 5.17% (0.6634 => 0.6977, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 5.12% (0.5546 => 0.5830, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.09% (0.5012 => 0.5267, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.07% (0.6435 => 0.6761, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (1.9694 => 2.0691, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (1.9966 => 2.0966, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (0.4658 => 0.4890, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.79% (0.2737 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.74% (0.3271 => 0.3426, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.2969 => 0.3108, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.64% (0.3084 => 0.3227, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.57% (0.7875 => 0.8235, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 4.44% (0.3336 => 0.3484, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.09% (0.3792 => 0.3947, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 3.93% (2.0346 => 2.1145, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 3.59% (0.4847 => 0.5021, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.46% (0.4253 => 0.4400, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (0.7426 => 0.7652, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (0.5361 => 0.5512, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.47% (11.6398 => 11.9273, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.44% (0.5584 => 0.5720, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (4.6926 => 4.8046, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.56% (11.9555 => 12.1417, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.2122 => 0.2281, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6784, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8982, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std.dev.: 0.0177) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6370, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1993, std.dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5113, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2267, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4353, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6037, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5621, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary2: -9.24% (0.2402 => 0.2180, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9733, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7891, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7996, std.dev.: 0.0101) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.64% (0.6293 => 0.6127, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -2.25% (17.2379 => 16.8500, std.dev.: 0.0584) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5694, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9624, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 22 23:39:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 01:39:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923063954.5030E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4173?compare_to=4169&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4173, Order: 164474, Start Time: 2012-09-23 05:30:44, End Time: 2012-09-23 06:41:24 To: 4169, Order: 164473, Start Time: 2012-09-23 04:04:17, End Time: 2012-09-23 05:15:01 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (99 on baseline) Performance Improvements: 1 (39 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 888 (752 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.03% (0.2744 => 0.2882, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.7746 => 0.8060, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9042 => 0.9256, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7867 => 0.8052, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.61% (4.9055 => 4.9846, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.12% (4.3229 => 4.3715, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.99% (0.3274 => 0.3503, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: 5.91% (0.2435 => 0.2579, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: 4.19% (3.0513 => 3.1792, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.93% (21.7399 => 22.3770, std.dev.: 0.2274) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.02% (2.6933 => 2.7209, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (3.2100 => 3.1748, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.45% (1.0084 => 1.0230, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 0.12% (0.5860 => 0.5867, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: -4.56% (0.1513 => 0.1444, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.68% (0.1323 => 0.1332, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.14% (0.2836 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.63% (0.2209 => 0.2223, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.94% (0.2895 => 0.2980, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.38% (0.2108 => 0.2100, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 26.00% (0.0200 => 0.0252, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: 18.92% (0.0074 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.58% (0.0076 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0386 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0299 => 0.0298, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.53% (0.0321 => 0.0284, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0178 => 0.0177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0253 => 0.0254, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0124 => 0.0124, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -9.09% (0.0011 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1451 => 0.1450, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 3.21% (1.4918 => 1.5397, std.dev.: 0.0147) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.03% (0.1453 => 0.1497, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.52% (0.4073 => 0.4011, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.65% (0.1376 => 0.1440, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.57% (0.0616 => 0.0638, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.36% (0.0209 => 0.0262, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.88% (0.0551 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1250 => 1.1310, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 170.00% (0.0010 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 300.00% (0.0006 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.55% (0.0559 => 0.0590, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.98% (0.0204 => 0.0257, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7674 => 0.7653, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.09% (1.5995 => 1.5980, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.45% (0.0098 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.45% (4.1772 => 3.0725, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout-C++/except: 82650.00% (0.0006 => 0.4965, std.dev.: 0.0012) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.90% (0.1414 => 0.1554, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.06% (0.1159 => 0.1264, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.88% (2.1763 => 2.3696, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: 8.06% (0.5309 => 0.5737, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.94% (0.6410 => 0.6919, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: 7.53% (1.0046 => 1.0802, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 7.45% (1.1653 => 1.2521, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 6.98% (0.6173 => 0.6604, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 6.17% (15.3105 => 16.2553, std.dev.: 0.1110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.17% (0.3582 => 0.3803, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.76% (0.6915 => 0.7313, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.37% (3.0225 => 3.1849, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.5150 => 1.5949, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.10% (0.3901 => 0.4100, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 5.04% (4.7455 => 4.9846, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3217 => 0.3377, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.1672 => 1.2244, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (12.6413 => 13.2472, std.dev.: 0.1317) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.65% (0.7639 => 0.7994, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 4.62% (13.3238 => 13.9389, std.dev.: 0.0681) MultiSource/Applications/siod/siod: 4.54% (2.0972 => 2.1924, std.dev.: 0.0211) MultiSource/Benchmarks/Bullet/bullet: 4.53% (29.3170 => 30.6440, std.dev.: 0.1084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.38% (0.7722 => 0.8060, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.33% (1.1440 => 1.1935, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: 4.23% (0.3026 => 0.3154, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.21% (0.4248 => 0.4427, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.18% (1.8798 => 1.9583, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.15% (0.2797 => 0.2913, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.14% (6.4908 => 6.7595, std.dev.: 0.0381) MultiSource/Applications/hbd/hbd: 4.11% (1.3268 => 1.3813, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.97% (1.1827 => 1.2296, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 3.96% (0.8405 => 0.8738, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 3.90% (14.7256 => 15.3001, std.dev.: 0.0638) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.86% (0.6069 => 0.6303, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.65% (0.7226 => 0.7490, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3008 => 0.3117, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 3.61% (3.8796 => 4.0195, std.dev.: 0.0335) MultiSource/Benchmarks/nbench/nbench: 3.57% (1.0821 => 1.1207, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 3.49% (14.6079 => 15.1177, std.dev.: 0.1083) MultiSource/Applications/lua/lua: 3.47% (3.5980 => 3.7227, std.dev.: 0.0458) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.44% (0.7784 => 0.8052, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.38% (1.4113 => 1.4590, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (6.2546 => 6.4631, std.dev.: 0.0339) MultiSource/Benchmarks/sim/sim: 3.31% (0.3084 => 0.3186, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.2186 => 8.4875, std.dev.: 0.0322) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.22% (1.2021 => 1.2408, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.22% (3.0758 => 3.1748, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.22% (0.5937 => 0.6128, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (1.4408 => 1.4870, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.17% (0.5963 => 0.6152, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.0318 => 4.1567, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.0689 => 1.1017, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.98% (0.8569 => 0.8824, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.76% (2.0317 => 2.0877, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.4880 => 0.5010, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.61% (0.5636 => 0.5783, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (4.2616 => 4.3715, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9029 => 0.9256, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (4.2815 => 4.3831, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.22% (0.4596 => 0.4698, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.18% (4.3380 => 4.4324, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.2742 => 1.3015, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.2559 => 8.4241, std.dev.: 0.0511) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5520 => 0.5624, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.87% (0.9425 => 0.9601, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9962, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5552, std.dev.: 0.0771) SingleSource/Benchmarks/Stanford/Puzzle: 11.37% (0.1433 => 0.1596, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 11.10% (0.2694 => 0.2993, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6104, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.68% (1.0063 => 1.0836, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3301 => 0.3503, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8383, std.dev.: 0.0470) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8721, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.93% (14.4877 => 14.9129, std.dev.: 0.0270) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.80% (4.2129 => 4.3308, std.dev.: 0.0405) MultiSource/Benchmarks/sim/sim: 2.69% (3.8907 => 3.9954, std.dev.: 0.0343) MultiSource/Applications/siod/siod: 2.68% (3.5520 => 3.6472, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/mason/mason: 2.66% (0.5004 => 0.5137, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.55% (6.2244 => 6.3829, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/ReedSolomon: 2.48% (8.5113 => 8.7223, std.dev.: 0.0630) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.44% (0.8498 => 0.8705, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.6308 => 0.6456, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.07% (2.6656 => 2.7209, std.dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/dry: 1.95% (2.4013 => 2.4481, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.81% (4.6127 => 4.6962, std.dev.: 0.0261) MultiSource/Benchmarks/Olden/power/power: 1.28% (1.4184 => 1.4366, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 1.14% (2.3453 => 2.3720, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.10% (27.1724 => 27.4720, std.dev.: 0.0742) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.21% (5.2665 => 4.0968, std.dev.: 0.0577) SingleSource/Benchmarks/Shootout-C++/ary3: -20.44% (1.7473 => 1.3901, std.dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.33% (1.1647 => 0.9628, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.40% (15.8312 => 13.3931, std.dev.: 0.0981) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: -11.37% (0.3746 => 0.3320, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.87% (3.2007 => 2.9487, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3789, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3286, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.40% (2.0027 => 1.8746, std.dev.: 0.0200) MultiSource/Applications/lambda-0_1_3/lambda: -6.17% (7.6833 => 7.2091, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -6.03% (1.4441 => 1.3570, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9215, std.dev.: 0.1282) MultiSource/Applications/SIBsim4/SIBsim4: -5.54% (3.4230 => 3.2333, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1881, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.29% (45.4683 => 43.5166, std.dev.: 0.7088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.00% (1.2722 => 1.2213, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.87% (1.4021 => 1.3478, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/misr: -3.68% (0.4296 => 0.4138, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (9.2503 => 8.9105, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.54% (61.1734 => 59.0068, std.dev.: 0.4462) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6393, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2895, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4182, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.78% (2.3569 => 2.3150, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3680, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2226, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: -1.68% (92.7467 => 91.1882, std.dev.: 0.2961) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3090, std.dev.: 0.0682) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.20% (1.8739 => 1.8514, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: -1.16% (16.5617 => 16.3700, std.dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.51% (0.9980 => 1.0230, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: -2.57% (0.6022 => 0.5867, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: -13.33% (0.1666 => 0.1444, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.29% (0.1554 => 0.1332, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.12% (0.3083 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.14% (0.2394 => 0.2223, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.14% (0.3175 => 0.2980, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.77% (0.2302 => 0.2100, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -43.88% (0.0449 => 0.0252, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -66.25% (0.0240 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.35% (0.0324 => 0.0284, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 2.52% (1.5019 => 1.5397, std.dev.: 0.0147) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1501 => 0.1497, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.93% (0.4264 => 0.4011, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.32% (0.0589 => 0.0638, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.93% (0.0232 => 0.0262, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.78% (0.0639 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.35% (1.1350 => 1.1310, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.38% (0.0637 => 0.0590, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (0.0246 => 0.0257, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.02% (1.5363 => 1.5980, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 02:42:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 04:42:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120923094229.E97EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4174?compare_to=4172&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4174, Order: 164474, Start Time: 2012-09-23 06:56:46, End Time: 2012-09-23 09:43:59 To: 4172, Order: 164473, Start Time: 2012-09-23 03:44:15, End Time: 2012-09-23 06:28:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (779 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.11% (112.8145 => 118.5774, std.dev.: 0.0589) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.45% (124.3082 => 129.8399, std.dev.: 0.8996) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.10% (0.3650 => 0.4128, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5826 => 0.6407, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.5889 => 0.6472, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.40% (1.5932 => 1.7430, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7171 => 0.7766, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 8.09% (0.1421 => 0.1536, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.96% (2.7292 => 2.9464, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.89% (0.4994 => 0.5388, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.86% (0.2875 => 0.3101, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.58% (1.3152 => 1.4149, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (3.5627 => 3.8321, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.51% (1.6211 => 1.7428, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.49% (0.9909 => 1.0651, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.3004 => 0.3222, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.15% (0.4361 => 0.4673, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.11% (0.3362 => 0.3601, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.05% (0.2750 => 0.2944, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 7.05% (0.2780 => 0.2976, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.01% (0.3195 => 0.3419, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.95% (2.0673 => 2.2109, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.90% (1.0781 => 1.1525, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.88% (0.3258 => 0.3482, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.87% (0.2911 => 0.3111, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3060 => 0.3269, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.82% (0.2566 => 0.2741, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3096 => 0.3306, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 6.70% (5.5417 => 5.9130, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.66% (0.5000 => 0.5333, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3267 => 0.3483, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.5900 => 0.6287, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.36% (0.2736 => 0.2910, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3124 => 0.3322, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 6.26% (4.2109 => 4.4744, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 6.24% (2.1013 => 2.2324, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 6.19% (23.5202 => 24.9771, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.15% (0.3282 => 0.3484, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.02% (0.4139 => 0.4388, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.90% (0.2866 => 0.3035, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.84% (0.4146 => 0.4388, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: 5.84% (0.9697 => 1.0263, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.83% (0.4029 => 0.4264, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 5.78% (1.8794 => 1.9880, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (4.4195 => 4.6719, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 5.66% (4.6177 => 4.8791, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.58% (0.3890 => 0.4107, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.54% (0.3845 => 0.4058, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 5.50% (1.4269 => 1.5054, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.3903 => 0.4117, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.46% (2.1653 => 2.2835, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 5.37% (0.5012 => 0.5281, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (1.9694 => 2.0712, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.15% (0.4658 => 0.4898, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 5.09% (0.6634 => 0.6972, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 5.09% (0.2691 => 0.2828, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.04% (0.2737 => 0.2875, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.3271 => 0.3435, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.00% (0.6435 => 0.6757, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (1.9966 => 2.0961, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.93% (0.2068 => 0.2170, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.85% (0.2969 => 0.3113, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.83% (0.5546 => 0.5814, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.3084 => 0.3226, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.56% (0.7875 => 0.8234, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.50% (0.3336 => 0.3486, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3792 => 0.3948, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.87% (2.0346 => 2.1133, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.62% (0.4253 => 0.4407, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 3.45% (0.4847 => 0.5014, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.3498 => 0.3616, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.96% (0.7426 => 0.7646, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (0.5361 => 0.5504, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.51% (11.6398 => 11.9323, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (0.5584 => 0.5718, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (4.6926 => 4.8047, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 1.51% (11.9555 => 12.1358, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 4.97% (12.0509 => 12.6494, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6351, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5108, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary3: 1.79% (15.8721 => 16.1555, std.dev.: 0.0238) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4459, std.dev.: 0.0125) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.38% (1.0927 => 1.1078, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5955, std.dev.: 0.0273) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.39% (25.4195 => 16.1700, std.dev.: 0.2058) MultiSource/Applications/hexxagon/hexxagon: -7.73% (28.1477 => 25.9732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7899, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7998, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7735, std.dev.: 0.0861) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9735, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 06:17:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 08:17:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923131708.03D262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4175?compare_to=4173&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4175, Order: 164475, Start Time: 2012-09-23 12:07:40, End Time: 2012-09-23 13:18:39 To: 4173, Order: 164474, Start Time: 2012-09-23 05:30:44, End Time: 2012-09-23 06:41:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 2 (81 on baseline) Performance Improvements: 7 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 891 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.13% (42.1041 => 43.4212, std.dev.: 0.1937) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (16.3700 => 16.5512, std.dev.: 0.0674) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -2.24% (4.0195 => 3.9295, std.dev.: 0.0314) MultiSource/Applications/treecc/treecc: -1.57% (1.9583 => 1.9275, std.dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: -1.53% (4.9846 => 4.9084, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: -1.27% (0.9601 => 0.9479, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: -1.27% (1.1935 => 1.1784, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: -1.00% (15.3001 => 15.1470, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.84% (8.3900 => 8.2358, std.dev.: 0.0367) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.82% (1.0230 => 1.0146, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -0.15% (0.5867 => 0.5858, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 5.19% (0.1444 => 0.1519, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.08% (0.1332 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.99% (0.2925 => 0.2896, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.38% (0.2223 => 0.2170, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.13% (0.2980 => 0.2976, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.24% (0.2100 => 0.2105, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -21.03% (0.0252 => 0.0199, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0081 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0191 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0386 => 0.0386, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.34% (0.0298 => 0.0299, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.42% (0.0281 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.85% (0.0284 => 0.0239, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0190 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.94% (0.0254 => 0.0244, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: - (0.0124 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1450 => 0.1452, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -4.36% (1.5397 => 1.4725, std.dev.: 0.0287) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.27% (0.1497 => 0.1448, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.62% (0.4011 => 0.4076, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.21% (0.1440 => 0.1443, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.0638 => 0.0612, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.87% (0.0262 => 0.0244, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.58% (0.0644 => 0.0563, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (0.0047 => 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1310 => 1.1347, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -29.63% (0.0027 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.54% (0.0590 => 0.0605, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (0.0257 => 0.0176, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7653 => 0.7651, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.05% (1.5980 => 1.5988, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.61% (0.0261 => 0.0048) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.00% (4.1772 => 3.0493, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.64% (2.1763 => 2.3643, std.dev.: 0.0238) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.25% (0.6410 => 0.6939, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 7.97% (0.5309 => 0.5732, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.17% (0.3582 => 0.3839, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.65% (1.1653 => 1.2428, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 6.62% (1.0046 => 1.0711, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 6.30% (0.6173 => 0.6562, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 5.33% (15.3105 => 16.1260, std.dev.: 0.0542) MultiSource/Applications/lambda-0_1_3/lambda: 5.19% (0.6915 => 0.7274, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.08% (1.5150 => 1.5920, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.2552 => 0.2680, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.1672 => 1.2256, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.00% (0.3901 => 0.4096, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4248 => 0.4437, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 4.42% (3.0225 => 3.1560, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (12.6413 => 13.1991, std.dev.: 0.0711) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (0.7639 => 0.7967, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 4.29% (0.3217 => 0.3355, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.79% (0.2797 => 0.2903, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.7226 => 0.7496, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.71% (0.6069 => 0.6294, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 3.70% (13.3238 => 13.8162, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.67% (1.2021 => 1.2462, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 3.64% (2.0972 => 2.1735, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.59% (0.3062 => 0.3172, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3008 => 0.3112, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.1827 => 1.2235, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.44% (0.2996 => 0.3099, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.43% (4.7455 => 4.9084, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.31% (6.2546 => 6.4616, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.30% (1.4408 => 1.4883, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 3.28% (14.6079 => 15.0876, std.dev.: 0.0175) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (6.4908 => 6.6947, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.03% (3.0758 => 3.1691, std.dev.: 0.0084) MultiSource/Applications/Burg/burg: 3.01% (1.1440 => 1.1784, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.0317 => 2.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.3418 => 0.3518, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.7256 => 15.1470, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.82% (0.8569 => 0.8811, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (4.0318 => 4.1429, std.dev.: 0.0308) MultiSource/Applications/hbd/hbd: 2.66% (1.3268 => 1.3621, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.4880 => 0.5009, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 2.62% (3.5980 => 3.6924, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.0689 => 1.0968, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 2.54% (1.8798 => 1.9275, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.52% (0.5520 => 0.5659, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9029 => 0.9246, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.5963 => 0.6098, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.25% (0.5636 => 0.5763, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 48.67% (0.0263 => 0.0391, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.14% (0.0917 => 0.1065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std.dev.: 0.0354) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.45% (0.0766 => 0.0869, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.29% (4.0101 => 4.5431, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.80% (0.2694 => 0.2958, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Puzzle: 8.65% (0.1433 => 0.1557, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6013, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.27% (40.4792 => 43.4212, std.dev.: 0.1937) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.17% (1.0063 => 1.0684, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.26% (0.6308 => 0.6577, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8481, std.dev.: 0.0472) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8722, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8930, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 2.78% (3.8907 => 3.9987, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/mason/mason: 2.48% (0.5004 => 0.5128, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 2.25% (3.5520 => 3.6319, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4492, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.82% (4.6127 => 4.6965, std.dev.: 0.0237) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0862, std.dev.: 0.0964) SingleSource/Benchmarks/Shootout-C++/ary3: -20.44% (1.7473 => 1.3902, std.dev.: 0.0259) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.1647 => 0.9603, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.47% (15.8312 => 13.2239, std.dev.: 0.1057) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: -11.43% (0.3746 => 0.3318, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -10.41% (0.1114 => 0.0998, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.85% (3.2007 => 2.9494, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3746, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3319, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.54% (2.0027 => 1.8718, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: -6.52% (7.6833 => 7.1825, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -6.08% (1.4441 => 1.3563, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.93% (3.4230 => 3.2201, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9313, std.dev.: 0.1163) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1876, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.21% (0.4564 => 0.4372, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.99% (1.2722 => 1.2215, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: -3.79% (0.2664 => 0.2563, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -3.70% (0.4296 => 0.4137, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: -3.48% (8.5323 => 8.2358, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/methcall: -3.12% (9.2503 => 8.9619, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.89% (3.7496 => 3.6411, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.68% (0.4140 => 0.4029, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (92.7467 => 90.6247, std.dev.: 0.5144) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4187, std.dev.: 0.0139) MultiSource/Applications/aha/aha: -1.97% (3.4286 => 3.3609, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.97% (1.0686 => 1.0475, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.79% (1.8739 => 1.8403, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2245, std.dev.: 0.0225) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.62% (1.7361 => 1.7079, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3085, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4644, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.66% (0.9980 => 1.0146, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -2.72% (0.6022 => 0.5858, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -8.82% (0.1666 => 0.1519, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.35% (0.1554 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (0.3083 => 0.2896, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.36% (0.2394 => 0.2170, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.27% (0.3175 => 0.2976, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.56% (0.2302 => 0.2105, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -55.68% (0.0449 => 0.0199, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -66.25% (0.0240 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -26.23% (0.0324 => 0.0239, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -1.96% (1.5019 => 1.4725, std.dev.: 0.0287) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.53% (0.1501 => 0.1448, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.41% (0.4264 => 0.4076, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.1344 => 0.1443, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.17% (0.0232 => 0.0244, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.89% (0.0639 => 0.0563, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1350 => 1.1347, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 216.67% (0.0006 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.02% (0.0637 => 0.0605, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.46% (0.0246 => 0.0176, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.07% (1.5363 => 1.5988, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 06:33:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 08:33:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923133349.962CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4176?compare_to=4170&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4176, Order: 164475, Start Time: 2012-09-23 12:20:18, End Time: 2012-09-23 13:35:19 To: 4170, Order: 164474, Start Time: 2012-09-23 04:37:14, End Time: 2012-09-23 05:51:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.97% (79.3482 => 80.9135, std.dev.: 0.4686) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.10% (2.0176 => 2.4231, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 13.29% (0.5818 => 0.6591, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.91% (0.5748 => 0.6490, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 12.05% (0.7061 => 0.7912, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.19% (0.7710 => 0.8573, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 11.18% (0.4328 => 0.4812, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 11.15% (1.3693 => 1.5220, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 11.04% (0.2781 => 0.3088, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.67% (3.9660 => 4.3892, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 10.66% (0.4062 => 0.4495, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.57% (0.1986 => 0.2196, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.39% (0.3022 => 0.3336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.28% (0.3899 => 0.4300, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.26% (0.2690 => 0.2966, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.22% (0.3485 => 0.3841, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.18% (0.2760 => 0.3041, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1842, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.13% (0.2765 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.05% (0.7038 => 0.7745, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.93% (0.5265 => 0.5788, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.90% (0.6959 => 0.7648, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.81% (0.3149 => 0.3458, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.76% (0.9199 => 1.0097, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.75% (0.3293 => 0.3614, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.74% (1.2193 => 1.3381, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.73% (1.4563 => 1.5980, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.64% (0.3868 => 0.4241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.61% (0.4016 => 0.4402, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.57% (0.1327 => 0.1454, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.53% (0.3650 => 0.3998, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.50% (0.3453 => 0.3781, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.42% (13.8202 => 15.1216, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3601 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.38% (0.3623 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.36% (1.1364 => 1.2428, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3914 => 0.4277, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4390 => 0.4795, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 9.21% (0.3940 => 0.4303, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.14% (0.4003 => 0.4369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.14% (0.3534 => 0.3857, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.04% (0.6283 => 0.6851, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.75% (0.5577 => 0.6065, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.61% (1.0313 => 1.1201, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.56% (0.2127 => 0.2309, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.55% (0.7506 => 0.8148, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.47% (0.4379 => 0.4750, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.39% (1.1061 => 1.1989, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.4791 => 0.5192, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (7.2180 => 7.8209, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.14% (0.5637 => 0.6096, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 8.14% (3.8646 => 4.1792, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.14% (0.6576 => 0.7111, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 8.11% (0.2243 => 0.2425, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 8.11% (0.2995 => 0.3238, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.06% (3.6692 => 3.9651, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3755 => 0.4055, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.98% (0.3220 => 0.3477, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.98% (16.6129 => 17.9382, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.88% (0.7460 => 0.8048, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.73% (0.8698 => 0.9370, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.54% (3.1889 => 3.4293, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 7.47% (1.9270 => 2.0710, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 7.47% (2.1791 => 2.3418, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.32% (1.3245 => 1.4215, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.28% (0.6744 => 0.7235, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 7.09% (1.0594 => 1.1345, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.00% (4.3801 => 4.6865, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.95% (1.3813 => 1.4773, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.95% (0.1569 => 0.1678, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.90% (0.4113 => 0.4397, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.90% (1.3819 => 1.4772, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.87% (1.2292 => 1.3137, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.3245 => 0.3468, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.78% (0.2140 => 0.2285, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.77% (8.4961 => 9.0709, std.dev.: 0.0145) MultiSource/Applications/JM/lencod/lencod: 6.74% (14.8535 => 15.8546, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 6.73% (1.2749 => 1.3607, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.2859 => 0.3051, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.69% (4.4433 => 4.7406, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.62% (0.6135 => 0.6541, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.49% (1.1333 => 1.2068, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (13.2842 => 14.1368, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 6.34% (14.5298 => 15.4504, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 6.23% (0.3131 => 0.3326, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.17% (0.8818 => 0.9362, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (6.5754 => 6.9790, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 6.13% (0.6250 => 0.6633, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.12% (4.6629 => 4.9482, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.54% (0.4805 => 0.5071, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.52% (4.9865 => 5.2620, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.47% (3.2742 => 3.4533, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (6.2785 => 6.6078, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 5.03% (3.7467 => 3.9351, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.01% (0.9108 => 0.9564, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.92% (1.5188 => 1.5935, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.57% (2.1007 => 2.1966, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 4.43% (33.2944 => 34.7684, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.47% (0.3511 => 0.3633, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.71% (16.2614 => 16.7013, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std.dev.: 0.0477) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (0.2093 => 0.2220, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.27% (10.7476 => 11.2066, std.dev.: 0.0251) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7242, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5882, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5842, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2244, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.73% (22.5627 => 21.9458, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2899, std.dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.29% (1.3780 => 1.2913, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7939, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0262) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9461, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2370, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1329, std.dev.: 0.0336) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2271, std.dev.: 0.0361) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2539, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 06:39:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 08:39:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120923133925.58A062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4177?compare_to=4171&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4177, Order: 164475, Start Time: 2012-09-23 12:20:25, End Time: 2012-09-23 13:40:54 To: 4171, Order: 164474, Start Time: 2012-09-23 05:00:48, End Time: 2012-09-23 06:20:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.13% (80.1151 => 81.0202, std.dev.: 0.2699) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.32% (15.5415 => 15.3367, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5785 => 0.5783, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 0.22% (16.0831 => 16.1179, std.dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 0.20% (14.9703 => 15.0004, std.dev.: 0.0193) MultiSource/Benchmarks/Bullet/bullet: 0.00% (83.5384 => 83.5404, std.dev.: 0.0841) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.3656 => 4.3698, std.dev.: 0.0260) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2354 => 1.2370, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (7.5240 => 7.5374, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.19% (3.7239 => 3.7311, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.37% (0.6487 => 0.6511, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (0.0647 => 0.0660, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.09% (63.2438 => 83.5404, std.dev.: 0.0841) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14227.78% (0.0720 => 10.3160, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.93% (10.3673 => 15.3367, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 30.02% (0.1622 => 0.2109, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.91% (2.2022 => 2.5526, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.86% (7.0540 => 8.1726, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.02% (0.3473 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.97% (0.3543 => 0.4038, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3543 => 0.4031, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3497 => 0.3976, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.59% (0.3561 => 0.4045, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 13.32% (0.3694 => 0.4186, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3828 => 0.4327, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.96% (0.3927 => 0.4436, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.76% (0.3886 => 0.4382, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.72% (1.1194 => 1.2618, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.23% (0.0834 => 0.0936, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.04% (1.7609 => 1.9730, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.54% (0.1584 => 0.1751, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 10.27% (0.3282 => 0.3619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.89% (0.5925 => 0.6511, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.62% (0.6030 => 0.6610, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.84% (0.3177 => 0.3458, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (9.4845 => 10.3127, std.dev.: 0.0147) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7326 => 0.7965, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3307 => 0.3582, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 8.30% (0.2554 => 0.2766, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.26% (0.2700 => 0.2923, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 8.07% (10.4361 => 11.2786, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.99% (0.4879 => 0.5269, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.4615 => 0.4983, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 7.85% (0.3109 => 0.3353, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3423 => 0.3691, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 7.77% (0.7115 => 0.7668, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.71% (0.7433 => 0.8006, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (8.1363 => 8.7561, std.dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.55% (0.6675 => 0.7179, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.55% (4.2646 => 4.5866, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.54% (0.5860 => 0.6302, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.51% (0.8172 => 0.8786, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.50% (1.3050 => 1.4029, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.50% (5.7591 => 6.1911, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.43% (1.5415 => 1.6560, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 7.41% (3.3354 => 3.5825, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.31% (0.2107 => 0.2261, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.31% (0.5569 => 0.5976, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.29% (0.8067 => 0.8655, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.29% (7.9617 => 8.5418, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.25% (4.9449 => 5.3033, std.dev.: 0.0185) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.3121 => 0.3347, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.20% (5.0018 => 5.3618, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.13% (0.5105 => 0.5469, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.02% (0.7835 => 0.8385, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.00% (0.2758 => 0.2951, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.91% (0.1940 => 0.2074, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 6.86% (0.3092 => 0.3304, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2756 => 0.2944, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.77% (0.9765 => 1.0426, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 6.76% (1.1642 => 1.2429, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.3180 => 0.3391, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.63% (0.4103 => 0.4375, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 6.62% (0.1555 => 0.1658, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.58% (1.1861 => 1.2642, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 6.58% (0.6456 => 0.6881, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4289 => 0.4571, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.55% (0.3865 => 0.4118, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.52% (0.4064 => 0.4329, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.4299 => 0.4578, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5020 => 0.5345, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.45% (0.2603 => 0.2771, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.45% (3.8723 => 4.1221, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 6.42% (21.9371 => 23.3453, std.dev.: 0.0309) MultiSource/Applications/hbd/hbd: 6.39% (1.5603 => 1.6600, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.35% (2.0665 => 2.1978, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 6.32% (0.3387 => 0.3601, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3826 => 0.4066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.19% (0.4203 => 0.4463, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 6.18% (1.0722 => 1.1385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.16% (0.3232 => 0.3431, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.08% (2.0273 => 2.1505, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.4048 => 0.4293, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4636 => 0.4916, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.02% (0.3935 => 0.4172, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3603 => 0.3820, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (0.4620 => 0.4895, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.87% (0.3817 => 0.4041, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.75% (0.3684 => 0.3896, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.61% (0.6450 => 0.6812, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.58% (0.8921 => 0.9419, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 5.55% (2.2969 => 2.4244, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.53% (0.5981 => 0.6312, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.23% (1.5859 => 1.6689, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.11% (1.4186 => 1.4911, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (14.3668 => 15.0638, std.dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.1840 => 1.2382, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.58% (2.2024 => 2.3032, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 4.51% (1.2842 => 1.3421, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.8101 => 0.8394, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.30% (17.1811 => 17.5755, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.92% (3.8922 => 3.9669, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (3.1578 => 3.3839, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7694, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.65% (9.1159 => 9.2660, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6818, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2574, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.88% (5.3855 => 3.9381, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.53% (5.3526 => 3.9326, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1607, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.35% (2.9384 => 2.6050, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -7.50% (22.1758 => 20.5118, std.dev.: 0.0461) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.13% (19.9488 => 18.3267, std.dev.: 0.0913) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.31% (1.2373 => 1.2087, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5031, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0946, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0089, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2526, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5111, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2281, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.59% (0.5229 => 0.5783, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 7.53% (14.9895 => 16.1179, std.dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 5.97% (14.1553 => 15.0004, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 6.31% (4.1105 => 4.3698, std.dev.: 0.0260) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.97% (1.1048 => 1.2370, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.30% (7.1582 => 7.5374, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.74% (3.4629 => 3.7311, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.64% (0.6222 => 0.6511, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.81% (0.2116 => 0.0660, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 08:03:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 10:03:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120923150325.7EB2A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4178?compare_to=4174&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4178, Order: 164475, Start Time: 2012-09-23 12:20:21, End Time: 2012-09-23 15:04:55 To: 4174, Order: 164474, Start Time: 2012-09-23 06:56:46, End Time: 2012-09-23 09:43:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (132 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (761 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.93% (0.2175 => 0.2304, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 2.56% (16.1700 => 16.5844, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.08% (54.1740 => 54.7601, std.dev.: 0.1568) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 12.54% (0.3724 => 0.4191, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5826 => 0.6404, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5889 => 0.6461, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.21% (1.5932 => 1.7400, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7171 => 0.7801, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.3004 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.76% (2.7292 => 2.9409, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.65% (1.3152 => 1.4158, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.63% (1.6211 => 1.7448, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.59% (3.5627 => 3.8330, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2875 => 0.3092, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.53% (0.4994 => 0.5370, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.24% (0.5000 => 0.5362, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (0.4361 => 0.4675, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2738 => 0.2934, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.06% (0.2792 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.01% (0.3195 => 0.3419, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.00% (0.2729 => 0.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2803 => 0.2999, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.98% (0.2750 => 0.2942, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.98% (2.0673 => 2.2115, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94% (0.5026 => 0.5375, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 6.94% (0.2823 => 0.3019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2813 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.87% (0.2780 => 0.2971, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.86% (0.2566 => 0.2742, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.85% (0.3096 => 0.3308, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.82% (0.9909 => 1.0585, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.77% (0.2911 => 0.3108, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.70% (1.0781 => 1.1503, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (0.3930 => 0.4191, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.63% (0.3060 => 0.3263, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.58% (5.5417 => 5.9062, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.58% (0.5900 => 0.6288, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3267 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.51% (0.3348 => 0.3566, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.51% (0.3258 => 0.3470, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.48% (0.3362 => 0.3580, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 6.35% (4.2109 => 4.4785, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.34% (0.3625 => 0.3855, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (2.1013 => 2.2346, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3124 => 0.3322, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.33% (0.3678 => 0.3911, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3317 => 0.3527, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 6.28% (23.5202 => 24.9970, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.27% (0.3845 => 0.4086, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.24% (0.3477 => 0.3694, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 6.23% (0.4029 => 0.4280, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3726 => 0.3958, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.21% (0.4139 => 0.4396, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3282 => 0.3485, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.16% (4.6177 => 4.9021, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.07% (0.2736 => 0.2902, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (4.4195 => 4.6851, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.96% (0.3690 => 0.3910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4146 => 0.4389, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.83% (0.2866 => 0.3033, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 5.76% (0.4251 => 0.4496, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.71% (0.3890 => 0.4112, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.3981 => 0.4208, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 5.67% (1.8794 => 1.9860, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.60% (0.4658 => 0.4919, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.58% (2.1653 => 2.2861, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 5.57% (1.4269 => 1.5064, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 5.50% (0.2691 => 0.2839, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.3903 => 0.4116, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (1.9966 => 2.1048, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.40% (0.6634 => 0.6992, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.38% (0.9697 => 1.0219, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.2068 => 0.2177, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.23% (0.5012 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.21% (1.9694 => 2.0720, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.20% (0.2040 => 0.2146, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.03% (0.7875 => 0.8271, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.96% (0.5546 => 0.5821, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.95% (0.3336 => 0.3501, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.93% (0.6435 => 0.6752, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.92% (0.2969 => 0.3115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.2737 => 0.2871, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.73% (0.3084 => 0.3230, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.73% (0.2391 => 0.2504, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.43% (2.0346 => 2.1248, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.13% (0.4847 => 0.5047, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3792 => 0.3948, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.52% (0.3498 => 0.3621, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.10% (0.4253 => 0.4385, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.08% (0.7426 => 0.7655, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.95% (0.5361 => 0.5519, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (0.5584 => 0.5729, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.57% (11.6398 => 11.9390, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.6926 => 4.8100, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 1.78% (11.9555 => 12.1685, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.45% (0.2162 => 0.3577, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.58% (0.2122 => 0.2304, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6660, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1749, std.dev.: 0.0680) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6322, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1971, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5011, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.61% (41.7953 => 42.4687, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5856, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5844, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: -9.33% (0.2402 => 0.2178, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7993, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7938, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9616, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 10:31:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 12:31:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120923173114.C34FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4179?compare_to=4175&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4179, Order: 164476, Start Time: 2012-09-23 16:21:38, End Time: 2012-09-23 17:32:44 To: 4175, Order: 164475, Start Time: 2012-09-23 12:07:40, End Time: 2012-09-23 13:18:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (82 on baseline) Performance Improvements: 1 (40 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 895 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 4.57% (8.4667 => 8.8535, std.dev.: 0.0296) MultiSource/Benchmarks/nbench/nbench: 2.44% (22.3623 => 22.9076, std.dev.: 0.0567) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.67% (13.2239 => 13.4451, std.dev.: 0.0746) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.22% (1.7079 => 1.7287, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -1.04% (16.5512 => 16.3784, std.dev.: 0.0275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0146 => 1.0238, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 0.31% (0.5858 => 0.5876, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 0.39% (0.1519 => 0.1525, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.05% (0.1331 => 0.1345, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (0.2896 => 0.2930, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.75% (0.2170 => 0.2208, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.94% (0.2976 => 0.2948, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.24% (0.2105 => 0.2110, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 40.70% (0.0199 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -6.74% (0.0089 => 0.0083, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 3.37% (0.0089 => 0.0092, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -41.98% (0.0081 => 0.0047, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.57% (0.0193 => 0.0134, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.89% (0.0386 => 0.0371, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0299 => 0.0299, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.05% (0.0285 => 0.0282, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 35.98% (0.0239 => 0.0325, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0179 => 0.0178, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -0.52% (0.0191 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.87% (0.0244 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -20.16% (0.0124 => 0.0099, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1452 => 0.1450, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.06% (1.4725 => 1.4716, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.11% (0.1448 => 0.1522, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.00% (0.4076 => 0.4239, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.61% (0.1443 => 0.1362, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.94% (0.0612 => 0.0594, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.57% (0.0244 => 0.0206, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.42% (0.0563 => 0.0571, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.92% (0.0048 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1347 => 1.1308, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -36.84% (0.0019 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 120.00% (0.0005 => 0.0011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.32% (0.0605 => 0.0597, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.55% (0.0176 => 0.0184, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7651 => 0.7657, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.5988 => 1.5989, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.77% (4.1772 => 3.1006, std.dev.: 0.1475) SingleSource/Benchmarks/Shootout-C++/except: 82333.33% (0.0006 => 0.4946, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.89% (0.1414 => 0.1568, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.63% (0.1159 => 0.1259, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 8.51% (2.1763 => 2.3615, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.39% (0.6410 => 0.6948, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 7.84% (0.5309 => 0.5725, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 7.55% (0.6173 => 0.6639, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.04% (0.3582 => 0.3834, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 6.65% (1.0046 => 1.0714, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (1.1653 => 1.2414, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 5.76% (15.3105 => 16.1923, std.dev.: 0.2064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (1.5150 => 1.5994, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.2552 => 0.2693, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 5.28% (0.6915 => 0.7280, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.18% (0.3901 => 0.4103, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 4.69% (0.3217 => 0.3368, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 4.56% (3.0225 => 3.1602, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.41% (1.1672 => 1.2187, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 4.40% (29.3170 => 30.6079, std.dev.: 0.1343) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (12.6413 => 13.1889, std.dev.: 0.1646) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.32% (0.7639 => 0.7969, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.15% (0.2797 => 0.2913, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.11% (0.2654 => 0.2763, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.99% (0.3008 => 0.3128, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4248 => 0.4417, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.67% (13.3238 => 13.8132, std.dev.: 0.0605) MultiSource/Applications/oggenc/oggenc: 3.65% (4.7455 => 4.9186, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.61% (1.2021 => 1.2455, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.60% (0.3026 => 0.3135, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2546 => 6.4748, std.dev.: 0.0414) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.43% (3.0758 => 3.1813, std.dev.: 0.0323) MultiSource/Applications/lua/lua: 3.43% (3.5980 => 3.7214, std.dev.: 0.0275) MultiSource/Applications/ClamAV/clamscan: 3.37% (14.6079 => 15.1002, std.dev.: 0.0218) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.2186 => 8.4950, std.dev.: 0.0446) MultiSource/Applications/Burg/burg: 3.31% (1.1440 => 1.1819, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3062 => 0.3163, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 3.28% (2.0972 => 2.1660, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.7226 => 0.7460, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.19% (1.1827 => 1.2204, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0821 => 1.1157, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.00% (4.0318 => 4.1528, std.dev.: 0.0243) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.4908 => 6.6855, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.95% (1.4408 => 1.4833, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5636 => 0.5800, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.7256 => 15.1381, std.dev.: 0.0604) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.0689 => 1.0988, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (3.8796 => 3.9847, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/football/football: 2.57% (0.8405 => 0.8621, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.7784 => 0.7972, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 2.41% (1.8798 => 1.9251, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.35% (1.4113 => 1.4444, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (1.2742 => 1.3037, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.20% (4.2616 => 4.3552, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (4.2815 => 4.3724, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.88% (8.2559 => 8.4109, std.dev.: 0.0517) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9971, std.dev.: 0.0547) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.36% (4.0101 => 4.5460, std.dev.: 0.0809) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.32% (0.0917 => 0.1030, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.1433 => 0.1584, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.20% (1.0063 => 1.0989, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.51% (7.0025 => 7.5986, std.dev.: 0.0268) MultiSource/Benchmarks/nbench/nbench: 8.20% (21.1721 => 22.9076, std.dev.: 0.0567) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.6308 => 0.6685, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (0.3301 => 0.3471, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 4.36% (15.2242 => 15.8886, std.dev.: 0.0399) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.22% (0.8498 => 0.8857, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 4.02% (8.5113 => 8.8535, std.dev.: 0.0296) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.76% (14.4877 => 14.8880, std.dev.: 0.0641) MultiSource/Applications/siod/siod: 2.26% (3.5520 => 3.6321, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: 1.92% (2.4013 => 2.4475, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 1.32% (1.4184 => 1.4371, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.16% (1.2726 => 1.2873, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.4455 => 2.4710, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.18% (0.3497 => 0.2057, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0861, std.dev.: 0.0821) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.57% (1.1647 => 0.9601, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.07% (15.8312 => 13.4451, std.dev.: 0.0746) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.65% (0.0917 => 0.0801, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.66% (1.4034 => 1.2818, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.32% (3.2007 => 2.9344, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3758, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: -6.74% (1.4441 => 1.3467, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.66% (2.0027 => 1.8694, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3311, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: -6.13% (3.4230 => 3.2132, std.dev.: 0.0532) MultiSource/Applications/lambda-0_1_3/lambda: -6.05% (7.6833 => 7.2186, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -5.73% (9.2503 => 8.7206, std.dev.: 0.1051) MultiSource/Benchmarks/FreeBench/distray/distray: -5.67% (0.2664 => 0.2513, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9596, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout/fib2: -5.35% (4.4195 => 4.1831, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.14% (3.6023 => 3.4172, std.dev.: 0.0511) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -3.89% (0.4296 => 0.4129, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.29% (1.2722 => 1.2303, std.dev.: 0.0114) MultiSource/Applications/SPASS/SPASS: -3.18% (8.5323 => 8.2607, std.dev.: 0.0529) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.17% (1.4021 => 1.3577, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.04% (3.7496 => 3.6357, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8286, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2840, std.dev.: 0.0318) MultiSource/Benchmarks/PAQ8p/paq8p: -2.05% (92.7467 => 90.8480, std.dev.: 0.3596) MultiSource/Applications/aha/aha: -2.01% (3.4286 => 3.3596, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4227, std.dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.71% (1.1683 => 1.1483, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2353, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.60% (1.8739 => 1.8440, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3106, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -1.28% (2.4971 => 2.4652, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -1.11% (16.5617 => 16.3784, std.dev.: 0.0275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.59% (0.9980 => 1.0238, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -2.42% (0.6022 => 0.5876, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -8.46% (0.1666 => 0.1525, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.45% (0.1554 => 0.1345, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.96% (0.3083 => 0.2930, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.77% (0.2394 => 0.2208, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.15% (0.3175 => 0.2948, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.34% (0.2302 => 0.2110, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -6.74% (0.0089 => 0.0083, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -80.42% (0.0240 => 0.0047, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.21% (0.0192 => 0.0134, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.87% (0.0390 => 0.0371, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -69.54% (0.0325 => 0.0099, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -2.02% (1.5019 => 1.4716, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.40% (0.1501 => 0.1522, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.59% (0.4264 => 0.4239, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.34% (0.1344 => 0.1362, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.85% (0.0589 => 0.0594, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.21% (0.0232 => 0.0206, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1350 => 1.1308, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.17% (0.0024 => 0.0011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.28% (0.0637 => 0.0597, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.20% (0.0246 => 0.0184, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.07% (1.5363 => 1.5989, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 10:47:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 12:47:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923174701.114852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4180?compare_to=4176&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4180, Order: 164476, Start Time: 2012-09-23 16:33:53, End Time: 2012-09-23 17:48:30 To: 4176, Order: 164475, Start Time: 2012-09-23 12:20:18, End Time: 2012-09-23 13:35:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.07% (2.0176 => 2.4225, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.38% (0.1410 => 0.1641, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.93% (0.5818 => 0.6570, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 12.80% (0.5748 => 0.6484, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 12.59% (0.7061 => 0.7950, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 11.29% (0.2781 => 0.3095, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.16% (0.4328 => 0.4811, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 11.08% (1.3693 => 1.5210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.03% (0.4062 => 0.4510, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.55% (3.9660 => 4.3844, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.28% (0.3899 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.20% (0.2628 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.19% (0.7710 => 0.8496, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.17% (0.2596 => 0.2860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.06% (1.9828 => 2.1822, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.99% (0.7038 => 0.7741, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.94% (0.2937 => 0.3229, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.92% (0.2721 => 0.2991, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.89% (0.6959 => 0.7647, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.75% (1.2193 => 1.3382, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.75% (0.3149 => 0.3456, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.3489 => 0.3828, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.71% (0.5265 => 0.5776, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.69% (0.3756 => 0.4120, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.58% (0.9199 => 1.0080, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.57% (0.2988 => 0.3274, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.55% (0.3580 => 0.3922, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.51% (0.4016 => 0.4398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.50% (0.1327 => 0.1453, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3601 => 0.3942, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.44% (1.4563 => 1.5938, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.3868 => 0.4232, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.37% (13.8202 => 15.1153, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.33% (0.3646 => 0.3986, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3453 => 0.3773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 9.23% (0.3663 => 0.4001, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3623 => 0.3957, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.21% (1.1364 => 1.2411, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3789 => 0.4138, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3914 => 0.4274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3534 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.14% (0.4003 => 0.4369, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.14% (0.3940 => 0.4300, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.07% (0.4390 => 0.4788, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.96% (0.6283 => 0.6846, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.79% (0.5577 => 0.6067, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.55% (1.0313 => 1.1195, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.44% (0.3246 => 0.3520, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4379 => 0.4748, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.37% (7.2180 => 7.8220, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.33% (0.4791 => 0.5190, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.29% (0.1435 => 0.1554, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.19% (1.1061 => 1.1967, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.09% (0.5637 => 0.6093, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 8.08% (0.2995 => 0.3237, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.00% (3.6692 => 3.9628, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.2914 => 0.3147, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.96% (3.8646 => 4.1721, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.94% (0.3755 => 0.4053, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.93% (0.7506 => 0.8101, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 7.89% (0.2243 => 0.2420, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3220 => 0.3473, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 7.81% (16.6129 => 17.9105, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.76% (0.7460 => 0.8039, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 7.76% (0.2925 => 0.3152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.68% (0.8310 => 0.8948, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.56% (0.8698 => 0.9356, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1865 => 0.2006, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 7.49% (3.1889 => 3.4279, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.31% (1.9270 => 2.0678, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 7.28% (2.1791 => 2.3378, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.21% (0.6744 => 0.7230, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4190, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.03% (1.0594 => 1.1339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.93% (0.3245 => 0.3470, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.81% (4.3801 => 4.6784, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.76% (14.8535 => 15.8578, std.dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 6.74% (1.2292 => 1.3120, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.4113 => 0.4390, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.68% (1.2749 => 1.3601, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.62% (8.4961 => 9.0585, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (1.3819 => 1.4733, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.61% (1.3813 => 1.4726, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.60% (4.4433 => 4.7364, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.59% (0.2140 => 0.2281, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 6.58% (0.2859 => 0.3047, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.46% (1.1333 => 1.2065, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.32% (13.2842 => 14.1241, std.dev.: 0.0113) MultiSource/Benchmarks/sim/sim: 6.16% (0.3131 => 0.3324, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 6.13% (0.6250 => 0.6633, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.09% (4.6629 => 4.9467, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 6.08% (14.5298 => 15.4129, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 5.96% (6.5754 => 6.9670, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2504 => 0.2653, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.82% (0.2321 => 0.2456, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.78% (0.8818 => 0.9328, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.58% (0.4805 => 0.5073, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.46% (3.2742 => 3.4529, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.40% (4.9865 => 5.2556, std.dev.: 0.0197) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.12% (6.2785 => 6.5997, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.96% (0.9108 => 0.9560, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.90% (3.7467 => 3.9302, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.88% (1.5188 => 1.5929, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.58% (2.1007 => 2.1970, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 4.31% (33.2944 => 34.7286, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.53% (0.3511 => 0.3635, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.68% (16.2614 => 16.6965, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4161, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7254, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.50% (10.7476 => 11.1236, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5842, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5939, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2239, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.24% (0.4657 => 0.3994, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.82% (0.2670 => 0.2568, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.82% (22.5627 => 21.9271, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3044, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.34% (1.3780 => 1.2907, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5099, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0289) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723) MultiSource/Benchmarks/Olden/bh/bh: -2.81% (1.9762 => 1.9206, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2422, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -1.58% (1.2308 => 1.2113, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1918, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2609, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2541, std.dev.: 0.0185) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2407, std.dev.: 0.0138) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 10:52:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 12:52:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120923175207.4C9F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4181?compare_to=4177&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4181, Order: 164476, Start Time: 2012-09-23 16:33:53, End Time: 2012-09-23 17:53:37 To: 4177, Order: 164475, Start Time: 2012-09-23 12:20:25, End Time: 2012-09-23 13:40:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (154 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.14% (15.3367 => 15.9711, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.6446 => 56.6077, std.dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.2945 => 1.3116, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.90% (81.0202 => 78.6679, std.dev.: 0.6411) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5783 => 0.5786, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.08% (16.1179 => 16.1309, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -0.09% (15.0004 => 14.9867, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 0.04% (83.5404 => 83.5767, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: -0.03% (4.3698 => 4.3684, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2370 => 1.2373, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.5374 => 7.5365, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (3.7311 => 3.7311, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.34% (0.6511 => 0.6489, std.dev.: 0.0120) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.97% (0.0660 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.15% (63.2438 => 83.5767, std.dev.: 0.0082) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14221.39% (0.0720 => 10.3114, std.dev.: 0.0055) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 54.05% (10.3673 => 15.9711, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: 30.83% (0.1622 => 0.2122, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.59% (7.0540 => 8.2246, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.09% (2.2022 => 2.5565, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.29% (0.1432 => 0.1651, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.54% (0.1566 => 0.1778, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3473 => 0.3940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.41% (0.3543 => 0.4018, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.17% (0.3516 => 0.3979, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3497 => 0.3957, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.11% (0.3561 => 0.4028, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3543 => 0.4007, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.92% (1.1194 => 1.2640, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3828 => 0.4309, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.33% (1.7609 => 1.9780, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.30% (0.3282 => 0.3620, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 9.52% (0.5925 => 0.6489, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.6030 => 0.6599, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.38% (0.1440 => 0.1575, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.91% (0.3177 => 0.3460, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.82% (9.4845 => 10.3208, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.53% (0.3307 => 0.3589, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.42% (0.7326 => 0.7943, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.37% (10.4361 => 11.3096, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.26% (0.4879 => 0.5282, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.19% (0.2700 => 0.2921, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.10% (0.4615 => 0.4989, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 8.04% (0.3109 => 0.3359, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.03% (0.2554 => 0.2759, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (8.1363 => 8.7793, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.3423 => 0.3689, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.74% (0.7433 => 0.8008, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.67% (0.8172 => 0.8799, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.57% (5.7591 => 6.1952, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.57% (0.6675 => 0.7180, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (4.2646 => 4.5872, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.56% (0.5860 => 0.6303, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.55% (0.7115 => 0.7652, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.54% (7.9617 => 8.5619, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 7.43% (3.3354 => 3.5831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.42% (1.3050 => 1.4018, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.40% (1.5415 => 1.6555, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.38% (0.5569 => 0.5980, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.26% (0.2107 => 0.2260, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.22% (0.2758 => 0.2957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.20% (0.8067 => 0.8648, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.18% (5.0018 => 5.3611, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.16% (4.9449 => 5.2991, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.05% (0.3121 => 0.3341, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.03% (0.7835 => 0.8386, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.99% (0.3092 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.95% (0.5105 => 0.5460, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.86% (0.9765 => 1.0435, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.80% (0.1940 => 0.2072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.78% (0.3422 => 0.3654, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.77% (21.9371 => 23.4215, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.4103 => 0.4380, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.73% (1.1642 => 1.2426, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.62% (0.1555 => 0.1658, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.61% (1.1861 => 1.2645, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4289 => 0.4568, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.48% (0.3180 => 0.3386, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.46% (1.5603 => 1.6611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.45% (0.4064 => 0.4326, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4299 => 0.4576, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.41% (3.8723 => 4.1207, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.25% (0.5020 => 0.5334, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.2831 => 0.3008, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.23% (0.3387 => 0.3598, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.6456 => 0.6858, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3441 => 0.3655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3650 => 0.3876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3865 => 0.4104, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.17% (2.0665 => 2.1941, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.3162 => 0.3357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.13% (1.0722 => 1.1379, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.09% (0.4203 => 0.4459, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3826 => 0.4058, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4636 => 0.4916, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.00% (0.4048 => 0.4291, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.97% (2.0273 => 2.1484, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3283 => 0.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.90% (0.3935 => 0.4167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3603 => 0.3815, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.88% (0.2603 => 0.2756, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.84% (0.4620 => 0.4890, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.62% (0.3684 => 0.3891, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.60% (0.6450 => 0.6811, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.52% (0.5981 => 0.6311, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.51% (2.2969 => 2.4234, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.44% (0.8921 => 0.9406, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.42% (0.3817 => 0.4024, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (1.4186 => 1.4898, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (14.3668 => 15.0696, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.87% (1.5859 => 1.6631, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.1840 => 1.2374, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.38% (2.2024 => 2.2989, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2842 => 1.3388, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.76% (0.8101 => 0.8406, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.68% (0.3427 => 0.3553, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5754, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9635, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3862, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (3.6395 => 3.7680, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3546, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 2.07% (3.7781 => 3.8562, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2418, std.dev.: 0.0393) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7992, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5762, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1294, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.93% (5.2763 => 3.2751, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.59% (5.3855 => 3.9537, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.33% (5.3526 => 3.9431, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0746, std.dev.: 0.0424) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.26% (2.9384 => 2.6074, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.46% (22.1758 => 20.5207, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3790, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2695, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7116, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0156) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1648, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -3.18% (1.2373 => 1.1980, std.dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5106, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.12% (8.6802 => 8.4959, std.dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9948, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0900, std.dev.: 0.0227) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2542, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.65% (0.5229 => 0.5786, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.61% (14.9895 => 16.1309, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 5.87% (14.1553 => 14.9867, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 6.27% (4.1105 => 4.3684, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.99% (1.1048 => 1.2373, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.28% (7.1582 => 7.5365, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.74% (3.4629 => 3.7311, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (0.6222 => 0.6489, std.dev.: 0.0120) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 12:16:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 14:16:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120923191638.949C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4182?compare_to=4178&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4182, Order: 164476, Start Time: 2012-09-23 16:34:07, End Time: 2012-09-23 19:18:07 To: 4178, Order: 164475, Start Time: 2012-09-23 12:20:21, End Time: 2012-09-23 15:04:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (131 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (762 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3442 => 0.3896, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 13.15% (0.3460 => 0.3915, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 12.71% (0.3650 => 0.4114, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.68% (0.5826 => 0.6390, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 9.51% (0.5889 => 0.6449, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.36% (1.5932 => 1.7424, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7171 => 0.7750, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.76% (2.7292 => 2.9410, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.63% (0.2738 => 0.2947, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (1.3152 => 1.4143, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (3.5627 => 3.8251, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (1.6211 => 1.7404, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (0.4361 => 0.4675, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.3004 => 0.3217, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.00% (0.2714 => 0.2904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3195 => 0.3416, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.2014 => 0.2153, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.89% (0.9909 => 1.0592, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.89% (0.4994 => 0.5338, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.82% (0.3930 => 0.4198, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3096 => 0.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.78% (0.2729 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2803 => 0.2993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.77% (0.2792 => 0.2981, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.76% (0.2750 => 0.2936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.75% (0.2813 => 0.3003, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2780 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.73% (0.5026 => 0.5364, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.72% (0.5000 => 0.5336, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 6.72% (1.0781 => 1.1505, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 6.70% (0.2823 => 0.3012, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.64% (2.0673 => 2.2046, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.2911 => 0.3104, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.60% (0.3060 => 0.3262, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.54% (0.3625 => 0.3862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.47% (0.2811 => 0.2993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3267 => 0.3476, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.39% (4.2109 => 4.4800, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.38% (5.5417 => 5.8950, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.34% (0.3362 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.29% (0.3258 => 0.3463, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.15% (0.3317 => 0.3521, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.11% (0.3124 => 0.3315, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.11% (2.1013 => 2.2296, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 6.07% (23.5202 => 24.9473, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (4.4195 => 4.6865, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 6.04% (0.3678 => 0.3900, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.03% (0.3282 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.03% (0.2736 => 0.2901, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 6.00% (0.3348 => 0.3549, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.98% (0.3477 => 0.3685, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.96% (0.3726 => 0.3948, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.90% (0.2866 => 0.3035, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.84% (0.3903 => 0.4131, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.81% (0.5900 => 0.6243, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 5.77% (2.1653 => 2.2902, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.72% (0.4146 => 0.4383, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.71% (0.3890 => 0.4112, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 5.70% (1.8794 => 1.9865, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.69% (0.3690 => 0.3900, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.62% (4.6177 => 4.8774, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.58% (0.4139 => 0.4370, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 5.56% (1.4269 => 1.5063, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4251 => 0.4487, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.46% (0.3845 => 0.4055, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.3981 => 0.4198) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.3271 => 0.3443, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (0.4658 => 0.4902, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.19% (0.5546 => 0.5834, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (1.9966 => 2.0987, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 5.09% (0.6634 => 0.6972, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.2969 => 0.3118, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.02% (1.9694 => 2.0682, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 5.01% (0.5012 => 0.5263, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.98% (0.2068 => 0.2171, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.95% (0.2040 => 0.2141, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.88% (0.6435 => 0.6749, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.84% (0.9697 => 1.0166, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.79% (0.2737 => 0.2868, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.76% (0.7875 => 0.8250, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.70% (0.3084 => 0.3229, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.62% (0.3336 => 0.3490, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 4.16% (2.0346 => 2.1193, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 4.12% (0.2691 => 0.2802, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 3.92% (0.4847 => 0.5037, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3792 => 0.3938, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.34% (0.4253 => 0.4395, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.03% (0.7426 => 0.7651, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (0.5361 => 0.5509, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.52% (11.6398 => 11.9336, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.48% (4.6926 => 4.8091, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.68% (11.9555 => 12.1567, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8951, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1656, std.dev.: 0.1505) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6406, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2019, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5043, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4316, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.29% (7.1849 => 7.2775, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5921, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4599, std.dev.: 0.0747) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5352, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7886, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8026, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (17.2379 => 16.8562, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (16.2163 => 15.9808, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 15:21:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 17:21:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120923222100.DB1172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4183?compare_to=4180&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4183, Order: 164477, Start Time: 2012-09-23 21:07:59, End Time: 2012-09-23 22:22:30 To: 4180, Order: 164476, Start Time: 2012-09-23 16:33:53, End Time: 2012-09-23 17:48:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (692 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.75% (79.2813 => 80.6673, std.dev.: 0.2691) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.05% (2.0176 => 2.4221, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.24% (0.1410 => 0.1639, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 13.03% (0.5818 => 0.6576, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 12.80% (0.5748 => 0.6484, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.70% (0.0819 => 0.0923, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 12.43% (0.7061 => 0.7939, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.09% (0.4328 => 0.4808, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 11.01% (1.3693 => 1.5201, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.59% (3.9660 => 4.3860, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.49% (0.7710 => 0.8519, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 10.36% (0.4062 => 0.4483, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.32% (0.2596 => 0.2864, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.31% (0.3899 => 0.4301, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.09% (0.7038 => 0.7748, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.03% (1.9828 => 2.1817, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.01% (0.3485 => 0.3834, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.01% (0.1588 => 0.1747, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.96% (0.2721 => 0.2992, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.94% (0.2726 => 0.2997, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.90% (0.3130 => 0.3440, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.85% (0.2761 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.82% (0.5265 => 0.5782, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.81% (0.6959 => 0.7642, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.81% (0.2937 => 0.3225, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.75% (1.2193 => 1.3382, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.74% (0.9199 => 1.0095, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.74% (0.4016 => 0.4407, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 9.72% (0.3107 => 0.3409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.3489 => 0.3828, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.66% (0.3293 => 0.3611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.64% (0.3756 => 0.4118, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.57% (0.1327 => 0.1454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.51% (0.3868 => 0.4236, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.44% (0.2988 => 0.3270, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.35% (0.3453 => 0.3776, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.33% (13.8202 => 15.1098, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.27% (0.3192 => 0.3488, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.26% (1.1364 => 1.2416, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.25% (0.4390 => 0.4796, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3623 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.24% (0.3646 => 0.3983, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3650 => 0.3987, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.22% (1.4563 => 1.5905, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3914 => 0.4273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.16% (0.3789 => 0.4136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.01% (0.6283 => 0.6849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.98% (0.3940 => 0.4294, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.94% (0.3534 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.79% (0.5577 => 0.6067, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.59% (0.4379 => 0.4755, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.55% (1.0313 => 1.1195, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.41% (7.2180 => 7.8248, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.4791 => 0.5189, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.25% (1.1061 => 1.1973, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.20% (0.2914 => 0.3153, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 8.14% (0.7506 => 0.8117, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.11% (0.2995 => 0.3238, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 8.02% (3.8646 => 4.1747, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.00% (0.5637 => 0.6088, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.98% (3.6692 => 3.9619, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 7.97% (0.2925 => 0.3158, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.95% (0.6576 => 0.7099, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.94% (0.8310 => 0.8970, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3220 => 0.3475, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.82% (16.6129 => 17.9118, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.75% (0.7460 => 0.8038, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.70% (0.3755 => 0.4044, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.2140 => 0.2303, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.61% (0.8698 => 0.9360, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.59% (3.1889 => 3.4308, std.dev.: 0.0126) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.44% (1.9270 => 2.0703, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.36% (2.1791 => 2.3394, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 7.30% (0.6744 => 0.7236, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.16% (1.3245 => 1.4193, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.07% (1.0594 => 1.1343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.81% (4.3801 => 4.6782, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 6.79% (14.8535 => 15.8623, std.dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 6.76% (1.2292 => 1.3123, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.75% (0.3245 => 0.3464, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.74% (4.4433 => 4.7426, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.2859 => 0.3051, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.71% (0.4113 => 0.4389, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.67% (1.3813 => 1.4734, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.65% (8.4961 => 9.0611, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 6.60% (1.2749 => 1.3591, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.56% (1.3819 => 1.4725, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 6.52% (0.3131 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (1.1333 => 1.2071, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (13.2842 => 14.1379, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.10% (4.6629 => 4.9472, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.07% (14.5298 => 15.4121, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (6.5754 => 6.9688, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.6250 => 0.6622, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.91% (0.2504 => 0.2652, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.75% (0.8818 => 0.9325, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.62% (0.4805 => 0.5075, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.39% (4.9865 => 5.2554, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.34% (3.2742 => 3.4492, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (6.2785 => 6.5994, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.02% (0.9108 => 0.9565, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.96% (1.5188 => 1.5941, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 4.95% (3.7467 => 3.9321, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.63% (2.1007 => 2.1979, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 4.28% (33.2944 => 34.7191, std.dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.56% (0.3511 => 0.3636, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6871, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5207, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std.dev.: 0.0540) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (3.1736 => 3.4175, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7250, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1142, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5921, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5852, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5985, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2249, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.2986 => 2.3236, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9172, std.dev.: 0.0186) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.17% (0.4657 => 0.3997, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.82% (22.5627 => 21.9272, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2772, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.64% (1.3780 => 1.3003, std.dev.: 0.0205) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9657, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.41% (3.2729 => 3.1613, std.dev.: 0.0235) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2562, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: -1.36% (1.2308 => 1.2140, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1544, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2257, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.13% (6.6320 => 6.5573, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4353, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 16:50:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 18:50:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120923235040.CE81D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4184?compare_to=4182&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4184, Order: 164477, Start Time: 2012-09-23 21:08:09, End Time: 2012-09-23 23:52:11 To: 4182, Order: 164476, Start Time: 2012-09-23 16:34:07, End Time: 2012-09-23 19:18:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (763 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.35% (2.0695 => 2.1182, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.32% (0.3446 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3724 => 0.4187, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.19% (0.1063 => 0.1182, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5826 => 0.6393, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.58% (0.5889 => 0.6453, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.35% (1.5932 => 1.7421, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.98% (0.7171 => 0.7743, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.91% (2.7292 => 2.9452, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.61% (1.3152 => 1.4153, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.60% (3.5627 => 3.8333, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.53% (1.6211 => 1.7431, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2875 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.25% (0.4361 => 0.4677, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.23% (0.4994 => 0.5355, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.3004 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.08% (0.5000 => 0.5354, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.98% (0.2738 => 0.2929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3195 => 0.3416, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.90% (0.9909 => 1.0593, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.89% (0.2729 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.84% (0.2750 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.81% (0.2803 => 0.2994, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.77% (0.2792 => 0.2981, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.70% (0.2823 => 0.3012, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.69% (2.0673 => 2.2056, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.2780 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3096 => 0.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.65% (0.2813 => 0.3000, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.2911 => 0.3103, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2811 => 0.2995, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.49% (1.0781 => 1.1481, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 6.49% (5.5417 => 5.9014, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.49% (0.3930 => 0.4185, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.45% (0.5026 => 0.5350, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 6.42% (4.2109 => 4.4811, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.3258 => 0.3467, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3267 => 0.3476, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.37% (0.3060 => 0.3255, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 6.27% (2.1013 => 2.2330, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 6.20% (0.3678 => 0.3906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.19% (0.3362 => 0.3570, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.18% (0.3317 => 0.3522, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.16% (0.2566 => 0.2724, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.15% (0.3124 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.14% (0.2736 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4146 => 0.4400, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.09% (0.3348 => 0.3552, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.07% (0.3625 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.04% (23.5202 => 24.9406, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists1: 5.98% (0.3477 => 0.3685, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.97% (0.5900 => 0.6252, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 5.93% (0.3726 => 0.3947, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.91% (0.3282 => 0.3476, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.89% (4.4195 => 4.6798, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.78% (4.6177 => 4.8845, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3690 => 0.3902, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.66% (0.4029 => 0.4257, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.4251 => 0.4489, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.52% (1.8794 => 1.9831, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.3903 => 0.4117, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.47% (2.1653 => 2.2838, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (0.3890 => 0.4101, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.41% (0.3845 => 0.4053, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.3981 => 0.4196, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.4139 => 0.4362, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.28% (0.6634 => 0.6984, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 5.24% (1.4269 => 1.5016, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.21% (0.5546 => 0.5835, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.20% (0.2691 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.15% (0.4658 => 0.4898, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (1.9694 => 2.0698, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 5.05% (0.9697 => 1.0187, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (1.9966 => 2.0968, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 4.97% (0.5012 => 0.5261, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.93% (0.2068 => 0.2170, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.3084 => 0.3236, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.83% (0.6435 => 0.6746, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.75% (0.2737 => 0.2867, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.71% (0.7875 => 0.8246, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.71% (0.3336 => 0.3493, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.2969 => 0.3106, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.10% (2.0346 => 2.1181, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3792 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 3.65% (0.4847 => 0.5024, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.34% (0.4253 => 0.4395, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.96% (0.7426 => 0.7646, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.3498 => 0.3598, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (0.5361 => 0.5512, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.51% (4.6926 => 4.8102, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.47% (11.6398 => 11.9272, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 1.62% (11.9555 => 12.1495, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.45% (0.2122 => 0.2280, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.14% (1.8057 => 1.8985, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.0886) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6373, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1922, std.dev.: 0.0575) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5022, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.74% (2.0820 => 2.1182, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4285, std.dev.: 0.0231) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2886, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5158, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5928, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5584, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7963, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7992, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.29% (0.6293 => 0.6149, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.15% (17.2379 => 16.8665, std.dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9623, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 19:10:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 21:10:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120924021056.8ED9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4185?compare_to=4179&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4185, Order: 164479, Start Time: 2012-09-24 01:01:30, End Time: 2012-09-24 02:12:28 To: 4179, Order: 164476, Start Time: 2012-09-23 16:21:38, End Time: 2012-09-23 17:32:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (78 on baseline) Performance Improvements: 1 (43 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 895 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 4.96% (1.7372 => 1.8233, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.29% (2.9179 => 2.9846, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 2.15% (8.7206 => 8.9081, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout/hash: 1.44% (4.3114 => 4.3734, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -2.93% (0.6685 => 0.6489, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.25% (1.0238 => 1.0212, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -1.80% (0.5876 => 0.5770, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -1.57% (0.1525 => 0.1501, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.89% (0.1345 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.88% (0.2930 => 0.2875, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.22% (0.2208 => 0.2181, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.81% (0.2948 => 0.2972, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.43% (0.2110 => 0.2101, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -6.43% (0.0280 => 0.0262, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -44.58% (0.0083 => 0.0046, std.dev.: 0.0023) SingleSource/UnitTests/2003-08-11-VaListArg: -1.09% (0.0092 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 68.09% (0.0047 => 0.0079, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 29.85% (0.0134 => 0.0174, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.85% (0.0371 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0299 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0282 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0325 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0178 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.05% (0.0190 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.59% (0.0251 => 0.0260, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.01% (0.0099 => 0.0100, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1450 => 0.1461, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.83% (1.4716 => 1.4986, std.dev.: 0.0183) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.50% (0.1522 => 0.1423, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.02% (0.4239 => 0.4238, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.08% (0.1362 => 0.1404, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.18% (0.0594 => 0.0601, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.94% (0.0206 => 0.0210, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0571 => 0.0572, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 4600.00% (0.0001 => 0.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1308 => 1.1275, std.dev.: 0.0379) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 50.00% (0.0012 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.55% (0.0011 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.34% (0.0597 => 0.0599, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.46% (0.0184 => 0.0229, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.71% (0.7657 => 0.7603, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.33% (1.5989 => 1.5937, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.02% (4.1772 => 3.0904, std.dev.: 0.0826) SingleSource/Benchmarks/Shootout-C++/except: 81233.33% (0.0006 => 0.4880, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.68% (0.0745 => 0.0914, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.46% (0.1414 => 0.1576, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 8.81% (2.1763 => 2.3681, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.47% (0.6410 => 0.6953, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.59% (0.3582 => 0.3854, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.48% (0.5309 => 0.5706, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.03% (0.6173 => 0.6607, std.dev.: 0.0127) MultiSource/Applications/lemon/lemon: 6.66% (1.0046 => 1.0715, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 6.62% (1.1653 => 1.2424, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.56% (1.5150 => 1.5993, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 5.19% (0.6915 => 0.7274, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.17% (0.2552 => 0.2684, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.10% (15.3105 => 16.0910, std.dev.: 0.1455) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.3901 => 0.4089, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.69% (0.3217 => 0.3368, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 4.52% (3.0225 => 3.1590, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (12.6413 => 13.2042, std.dev.: 0.0732) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.20% (0.7639 => 0.7960, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4248 => 0.4424, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.6069 => 0.6319, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.00% (0.2797 => 0.2909, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.92% (13.3238 => 13.8466, std.dev.: 0.0675) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.92% (0.2654 => 0.2758, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 3.84% (29.3170 => 30.4420, std.dev.: 0.1115) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (8.2186 => 8.5226, std.dev.: 0.0179) MultiSource/Applications/oggenc/oggenc: 3.70% (4.7455 => 4.9209, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.60% (1.2021 => 1.2454, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.0821 => 1.1201, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 3.47% (2.0972 => 2.1700, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 3.45% (1.1440 => 1.1835, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 3.45% (1.3268 => 1.3726, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.6079 => 15.0724, std.dev.: 0.0751) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.18% (1.1672 => 1.2043, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (6.2546 => 6.4503, std.dev.: 0.0304) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.4908 => 6.6928, std.dev.: 0.0213) MultiSource/Applications/treecc/treecc: 3.06% (1.8798 => 1.9373, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.7256 => 15.1465, std.dev.: 0.0629) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.0758 => 3.1616, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.0317 => 2.0846, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.4408 => 1.4778, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.46% (1.4113 => 1.4460, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.32% (0.4880 => 0.4993, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.13% (0.5963 => 0.6090, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.15% (0.0766 => 0.0905, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 15.04% (1.7426 => 2.0046, std.dev.: 0.0348) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.69% (4.0101 => 4.5590, std.dev.: 0.0262) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.43% (0.0917 => 0.1031, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 10.82% (1.6261 => 1.8020, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.76% (7.0025 => 7.6159, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.55% (1.0063 => 1.0823, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.79% (40.4792 => 42.8229, std.dev.: 0.4452) MultiSource/Benchmarks/Olden/tsp/tsp: 5.21% (1.7330 => 1.8233, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/dt: 4.42% (0.9851 => 1.0286, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8560, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.93% (4.2129 => 4.3783, std.dev.: 0.0501) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 3.89% (8.5113 => 8.8428, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8724, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.6308 => 0.6489, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.83% (0.5876 => 0.6042, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8969, std.dev.: 0.0243) MultiSource/Benchmarks/sim/sim: 2.77% (3.8907 => 3.9983, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.38% (2.9152 => 2.9846, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.36% (3.5520 => 3.6358, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7146, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/whetstone: 2.03% (2.3453 => 2.3929, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 1.98% (2.4013 => 2.4489, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: 1.67% (4.3016 => 4.3734, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.14% (4.0659 => 4.1122, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.00% (2.4455 => 2.4700, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.10% (5.2665 => 4.1553, std.dev.: 0.0648) SingleSource/Benchmarks/Shootout-C++/ary3: -20.01% (1.7473 => 1.3976, std.dev.: 0.0306) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9599, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.83% (15.8312 => 13.1663, std.dev.: 0.1603) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.22% (3.2007 => 2.9375, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3728, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3343, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8726, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -6.43% (7.6833 => 7.1889, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/richards_benchmark: -6.42% (1.4441 => 1.3514, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: -6.16% (3.4230 => 3.2123, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7917, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9630, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout/fib2: -5.18% (4.4195 => 4.1907, std.dev.: 0.0460) MultiSource/Benchmarks/FreeBench/distray/distray: -4.80% (0.2664 => 0.2536, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.03% (2.3580 => 2.2630, std.dev.: 0.0306) MultiSource/Applications/SPASS/SPASS: -3.71% (8.5323 => 8.2154, std.dev.: 0.1020) SingleSource/Benchmarks/Shootout-C++/methcall: -3.70% (9.2503 => 8.9081, std.dev.: 0.0281) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.61% (1.2722 => 1.2263, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.31% (3.7496 => 3.6254, std.dev.: 0.0258) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.29% (0.4140 => 0.4004, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: -3.21% (0.4296 => 0.4158, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2849, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.43% (1.1683 => 1.1399, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.30% (61.1734 => 59.7640, std.dev.: 0.2156) MultiSource/Benchmarks/PAQ8p/paq8p: -2.25% (92.7467 => 90.6609, std.dev.: 0.4276) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.22% (2.4457 => 2.3915, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.84% (2.8964 => 2.8432, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.4876 => 3.4237, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3679, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2314, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -1.36% (2.4971 => 2.4631, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3168, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.01% (1.8739 => 1.8550, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.32% (0.9980 => 1.0212, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -4.18% (0.6022 => 0.5770, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -9.90% (0.1666 => 0.1501, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.22% (0.1554 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (0.3083 => 0.2875, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.90% (0.2394 => 0.2181, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.39% (0.3175 => 0.2972, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.73% (0.2302 => 0.2101, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -41.65% (0.0449 => 0.0262, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -48.31% (0.0089 => 0.0046, std.dev.: 0.0023) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -67.08% (0.0240 => 0.0079, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.37% (0.0192 => 0.0174, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 4.42% (0.0249 => 0.0260, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -69.23% (0.0325 => 0.0100, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.24% (0.1429 => 0.1461, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.22% (1.5019 => 1.4986, std.dev.: 0.0183) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.20% (0.1501 => 0.1423, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.61% (0.4264 => 0.4238, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1344 => 0.1404, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.04% (0.0589 => 0.0601, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.49% (0.0639 => 0.0572, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1350 => 1.1275, std.dev.: 0.0379) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0006 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.0637 => 0.0599, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.91% (0.0246 => 0.0229, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.82% (0.7541 => 0.7603, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.74% (1.5363 => 1.5937, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 20:36:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 22:36:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120924033607.4486E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4186?compare_to=4183&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4186, Order: 164481, Start Time: 2012-09-24 02:23:11, End Time: 2012-09-24 03:37:36 To: 4183, Order: 164477, Start Time: 2012-09-23 21:07:59, End Time: 2012-09-23 22:22:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 9 (176 on baseline) Performance Improvements: 14 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 947 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 5.86% (0.2422 => 0.2564, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5905 => 1.6130, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (0.9325 => 0.9425, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.4492 => 3.4857, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1343 => 1.1462, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 9.85% (2.0754 => 2.2798, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.21% (0.5333 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.98% (54.8363 => 56.4681, std.dev.: 0.0689) MultiSource/Applications/sqlite3/sqlite3: 1.25% (4.5595 => 4.6164, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.56% (0.2570 => 0.1399, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.73% (0.0622 => 0.0350, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.55% (1.4734 => 1.1853, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.48% (1.4725 => 1.1857, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -19.24% (0.0738 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -5.11% (0.3051 => 0.2895, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -3.60% (34.7191 => 33.4692, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -2.73% (15.4121 => 14.9906, std.dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.60% (21.9272 => 21.5768, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.48% (0.0994 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -8.85% (0.2182 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.37% (0.9963 => 0.9528, std.dev.: 0.0044) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/llubenchmark/llu: -1.59% (3.8401 => 3.7791, std.dev.: 0.0189) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.17% (2.0176 => 2.4447, std.dev.: 0.0133) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.31% (0.2243 => 0.2564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 13.32% (0.5818 => 0.6593, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 13.17% (0.5748 => 0.6505, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.25% (0.7061 => 0.7926, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.58% (1.3693 => 1.5278, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.44% (0.4328 => 0.4823, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.27% (0.1588 => 0.1767, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.24% (3.9660 => 4.4118, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 10.96% (0.4062 => 0.4507, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.82% (0.2596 => 0.2877) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.76% (1.4563 => 1.6130, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.71% (0.9199 => 1.0184, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.68% (1.2193 => 1.3495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.56% (0.5265 => 0.5821, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.54% (0.7710 => 0.8523, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.49% (0.3899 => 0.4308, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.47% (0.7038 => 0.7775, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.40% (0.6959 => 0.7683, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.40% (0.1327 => 0.1465, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.32% (0.3293 => 0.3633, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.32% (0.2655 => 0.2929, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.26% (0.3130 => 0.3451, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (1.9828 => 2.1853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.18% (0.2760 => 0.3041, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 10.15% (13.8202 => 15.2235, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.13% (0.2696 => 0.2969, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.08% (0.3789 => 0.4171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.06% (0.6283 => 0.6915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3650 => 0.4017, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.05% (0.3601 => 0.3963, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.04% (0.3756 => 0.4133, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.01% (0.3646 => 0.4011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.99% (0.3663 => 0.4029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.97% (0.3149 => 0.3463, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.96% (0.4016 => 0.4416, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.94% (1.1364 => 1.2494, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.91% (0.3623 => 0.3982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.87% (0.3192 => 0.3507, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.87% (0.4003 => 0.4398, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.86% (0.3914 => 0.4300, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.85% (0.3868 => 0.4249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.77% (0.3940 => 0.4325, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 9.56% (0.3453 => 0.3783, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists1: 9.48% (0.3534 => 0.3869, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.48% (0.4390 => 0.4806, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.29% (0.5577 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.26% (0.2127 => 0.2324, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.25% (0.4379 => 0.4784, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 9.19% (1.0313 => 1.1261, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 9.18% (0.2995 => 0.3270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.16% (0.1157 => 0.1263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.15% (0.3246 => 0.3543, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.90% (7.2180 => 7.8605, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 8.86% (16.6129 => 18.0855, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 8.86% (0.7506 => 0.8171, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6576 => 0.7156, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.81% (0.4791 => 0.5213, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 8.80% (1.1061 => 1.2034, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.68% (0.2914 => 0.3167, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.62% (0.8310 => 0.9026, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.55% (0.5637 => 0.6119, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.51% (0.8698 => 0.9438, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.45% (0.3220 => 0.3492, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.34% (0.7460 => 0.8082, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.23% (0.3755 => 0.4064, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.19% (1.0594 => 1.1462, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.2925 => 0.3163, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 8.12% (2.1791 => 2.3560, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 8.01% (0.6744 => 0.7284, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 7.99% (3.1889 => 3.4436, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 7.95% (3.8646 => 4.1720, std.dev.: 0.0121) MultiSource/Applications/treecc/treecc: 7.95% (1.9270 => 2.0802, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.70% (1.3245 => 1.4265, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.64% (3.6692 => 3.9495, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 7.56% (8.4961 => 9.1385, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4113 => 0.4423, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.51% (0.3131 => 0.3366, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.49% (14.8535 => 15.9654, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.39% (1.2749 => 1.3691, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.28% (4.3801 => 4.6990, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.23% (4.4433 => 4.7647, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 7.09% (1.2292 => 1.3164, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.09% (0.6135 => 0.6570, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.01% (0.2140 => 0.2290, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.98% (1.1333 => 1.2124, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.88% (0.8818 => 0.9425, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.75% (0.2504 => 0.2673, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.56% (4.6629 => 4.9690, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 6.51% (0.6250 => 0.6657, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.46% (3.2742 => 3.4857, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.31% (0.4805 => 0.5108, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.20% (4.9865 => 5.2955, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (6.5754 => 6.9710, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (6.2785 => 6.6508, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.82% (1.5188 => 1.6072, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.3245 => 0.3433, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.72% (0.9108 => 0.9629, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.52% (3.7467 => 3.9537, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.40% (2.1007 => 2.2142, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9986, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/oourafft: 5.28% (0.2008 => 0.2114, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.59% (16.2614 => 16.8453, std.dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.59% (0.3511 => 0.3637, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.17% (14.5298 => 14.9906, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std.dev.: 0.0515) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7052, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.16% (10.7476 => 11.0875, std.dev.: 0.0192) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5867, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5831, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5856, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 1.02% (1.4298 => 1.4444, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.20% (1.3819 => 1.1857, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.19% (1.3813 => 1.1853, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: -13.70% (0.4657 => 0.4019, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.37% (22.5627 => 21.5768, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.13% (0.2238 => 0.1989, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2982, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2940, std.dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0230) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9523, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.71% (26.5159 => 26.0628, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2494, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7920, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8714, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2277, std.dev.: 0.0284) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4358, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 20:40:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 22:40:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120924034008.410052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4187?compare_to=4181&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4187, Order: 164481, Start Time: 2012-09-24 02:23:34, End Time: 2012-09-24 03:41:38 To: 4181, Order: 164476, Start Time: 2012-09-23 16:33:53, End Time: 2012-09-23 17:53:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (4 on baseline) New Passes: 1 (2 on baseline) Performance Regressions: 7 (153 on baseline) Performance Improvements: 15 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 19 (17 on baseline) Unchanged Tests: 926 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.3546 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2633 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 46.61% (3.7311 => 5.4700, std.dev.: 0.0089) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 37.48% (0.2759 => 0.3793, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: 21.23% (0.1140 => 0.1382, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (11.3096 => 11.6707, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.33% (27.7971 => 29.5572, std.dev.: 0.0993) SingleSource/Regression/C/uint64_to_float: 5.21% (0.5333 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 5.04% (3.8562 => 4.0507, std.dev.: 0.0709) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.14% (78.6679 => 80.3536, std.dev.: 0.1910) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -19.21% (0.0864 => 0.0698, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.20% (1.2640 => 1.1477, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.27% (3.9537 => 3.6663, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.12% (3.9431 => 3.6625, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -5.50% (0.3308 => 0.3126, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.4167 => 0.3969, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -4.28% (15.9711 => 15.2883, std.dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: -3.01% (20.5207 => 19.9021, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.36% (15.0696 => 14.8650, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -21.22% (2.0732 => 1.6333, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.48% (0.0994 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.70% (0.2196 => 0.1961, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.37% (0.9963 => 0.9528, std.dev.: 0.0092) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/lua/lua: -1.05% (26.2852 => 26.0097, std.dev.: 0.0420) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.19% (0.5786 => 0.5775, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.21% (16.1309 => 16.0965, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: -0.03% (14.9867 => 14.9822, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -35.23% (83.5767 => 54.1288, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: -0.36% (4.3684 => 4.3527, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2373 => 1.2378, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (7.5365 => 7.5124, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.33% (0.6489 => 0.7224, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 220.09% (0.0647 => 0.2071, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.41% (63.2438 => 54.1288, std.dev.: 0.0118) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.96% (3.4629 => 5.4700, std.dev.: 0.0089) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14267.50% (0.0720 => 10.3446, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.51% (0.2554 => 0.3793, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 47.47% (10.3673 => 15.2883, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 29.65% (0.1622 => 0.2103, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.08% (2.2022 => 2.5563, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.96% (7.0540 => 8.1801, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3473 => 0.3949, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.55% (0.3543 => 0.4023, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.40% (0.3516 => 0.3987, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3497 => 0.3965, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.32% (0.3543 => 0.4015, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.75% (0.3828 => 0.4316, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.68% (0.3927 => 0.4425, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.53% (0.3886 => 0.4373, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.83% (10.4361 => 11.6707, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.74% (1.7609 => 1.9677, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.03% (0.3282 => 0.3644, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5925 => 0.6502, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.62% (0.6030 => 0.6610, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.17% (0.1440 => 0.1572, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.63% (0.7326 => 0.7958, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.57% (9.4845 => 10.2971, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.53% (0.3177 => 0.3448, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.06% (0.4615 => 0.4987, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.99% (1.5415 => 1.6646, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.4879 => 0.5261, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.73% (0.1695 => 0.1826, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.72% (0.3109 => 0.3349, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.6675 => 0.7186, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.65% (0.3423 => 0.3685, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.65% (0.7835 => 0.8434, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.61% (5.7591 => 6.1973, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.61% (8.1363 => 8.7551, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.59% (0.2700 => 0.2905, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.56% (0.7115 => 0.7653, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.53% (0.7433 => 0.7993, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.52% (1.3050 => 1.4031, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.47% (0.5860 => 0.6298, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.43% (4.2646 => 4.5813, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.43% (0.8067 => 0.8666, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.40% (0.8172 => 0.8777, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 7.32% (3.3354 => 3.5794, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.31% (0.2107 => 0.2261, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.16% (0.5569 => 0.5968, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.16% (7.9617 => 8.5317, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.14% (0.9765 => 1.0462, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.06% (5.0018 => 5.3548, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.02% (4.9449 => 5.2922, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.00% (0.2758 => 0.2951, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3121 => 0.3339, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3422 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1940 => 0.2073, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 6.70% (0.3387 => 0.3614, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.66% (0.5105 => 0.5445, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.61% (1.5603 => 1.6634, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.60% (0.4103 => 0.4374, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.47% (1.1642 => 1.2395, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 6.46% (0.4289 => 0.4566, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.44% (21.9371 => 23.3497, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.42% (0.3441 => 0.3662, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 6.40% (0.4299 => 0.4574, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.34% (1.1861 => 1.2613, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.29% (0.6456 => 0.6862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.26% (0.3865 => 0.4107, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.21% (0.4203 => 0.4464, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.19% (3.8723 => 4.1120, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.18% (0.5020 => 0.5330, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.13% (0.4048 => 0.4296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.12% (0.3283 => 0.3484, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3826 => 0.4058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (2.0665 => 2.1916, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.03% (0.3136 => 0.3325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.00% (1.0722 => 1.1365, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.95% (0.4636 => 0.4912, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.91% (0.3162 => 0.3349, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3603 => 0.3815, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.84% (0.2603 => 0.2755, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.83% (2.0273 => 2.1455, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 5.73% (0.3684 => 0.3895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.55% (0.6450 => 0.6808, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.53% (0.3817 => 0.4028, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.48% (0.5981 => 0.6309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.41% (0.8921 => 0.9404, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.30% (2.2969 => 2.4187, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.91% (1.5859 => 1.6638, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (1.4186 => 1.4869, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.54% (1.1840 => 1.2377, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.4064 => 0.4243, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2842 => 1.3391, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.25% (2.2024 => 2.2960, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.8101 => 0.8398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.47% (0.3427 => 0.3546, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (14.3668 => 14.8650, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.53% (1.1194 => 1.1477, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.53% (17.1811 => 17.6153, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (3.8922 => 3.9639, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 7.22% (3.7781 => 4.0507, std.dev.: 0.0709) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2159, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7673, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (0.8275 => 0.8406, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2545, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8079, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: 1.03% (3.6994 => 3.7375, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.23% (5.2763 => 3.2591, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.92% (5.3855 => 3.6663, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.58% (5.3526 => 3.6625, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1512, std.dev.: 0.0406) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.37% (2.9384 => 2.6042, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -10.25% (22.1758 => 19.9021, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -9.25% (0.2161 => 0.1961, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2503, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5961, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0092) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1595, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5055, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1726, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5077, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0919, std.dev.: 0.0226) SingleSource/UnitTests/Vector/multiplies: -1.84% (2.5528 => 2.5058, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0126, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.44% (9.5636 => 9.4263, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2338, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.44% (0.5229 => 0.5775, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.39% (14.9895 => 16.0965, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 5.84% (14.1553 => 14.9822, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: 5.89% (4.1105 => 4.3527, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.04% (1.1048 => 1.2378, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.95% (7.1582 => 7.5124, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.10% (0.6222 => 0.7224, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.13% (0.2116 => 0.2071, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 23 21:03:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Sep 2012 23:03:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120924040359.9F4012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4188?compare_to=4184&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4188, Order: 164479, Start Time: 2012-09-24 01:14:09, End Time: 2012-09-24 03:58:17 To: 4184, Order: 164477, Start Time: 2012-09-23 21:08:09, End Time: 2012-09-23 23:52:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (136 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (757 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.41% (1.7421 => 1.7666, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.17% (1.0187 => 1.0306, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.43% (128.2956 => 131.4094, std.dev.: 0.2007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.82% (0.3488 => 0.3970, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.81% (0.3446 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.80% (0.3465 => 0.3943, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.75% (0.3469 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.76% (0.1063 => 0.1188, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 10.88% (1.5932 => 1.7666, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.21% (0.5826 => 0.6421, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5889 => 0.6489, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7171 => 0.7817, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.77% (0.1619 => 0.1761, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (2.7292 => 2.9569, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.31% (0.2875 => 0.3114, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.27% (1.6211 => 1.7552, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.11% (0.2738 => 0.2960, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 8.04% (0.2725 => 0.2944, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.3004 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.96% (0.2750 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.93% (0.4994 => 0.5390, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.92% (0.3195 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.92% (1.3152 => 1.4193, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.84% (3.5627 => 3.8419, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.76% (0.5000 => 0.5388, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.76% (0.2823 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.74% (0.2803 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2792 => 0.3008, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2729 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2813 => 0.3030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.69% (2.0673 => 2.2263, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2811 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.68% (0.4361 => 0.4696, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2780 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.62% (0.3096 => 0.3332, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3060 => 0.3293, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.60% (0.9909 => 1.0662, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.2911 => 0.3131, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.56% (0.3362 => 0.3616, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3258 => 0.3504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.53% (0.3267 => 0.3513, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.2736 => 0.2942, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.50% (0.5026 => 0.5403, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.47% (5.5417 => 5.9558, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.45% (0.2014 => 0.2164, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3317 => 0.3560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3348 => 0.3593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.3678 => 0.3946, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.27% (0.3124 => 0.3351, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.24% (1.0781 => 1.1562, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.5900 => 0.6327, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.12% (0.3625 => 0.3883, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.07% (0.3845 => 0.4117, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.02% (0.3477 => 0.3721, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.97% (0.3930 => 0.4204, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3726 => 0.3985, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.90% (0.2566 => 0.2743, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 6.78% (4.2109 => 4.4964, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 6.75% (0.4029 => 0.4301, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 6.71% (0.4146 => 0.4424, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.64% (2.1013 => 2.2409, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.64% (0.3690 => 0.3935, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4251 => 0.4532, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 6.57% (23.5202 => 25.0652, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 6.36% (1.8794 => 1.9989, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.33% (0.3981 => 0.4233, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.2866 => 0.3046, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 6.28% (0.9697 => 1.0306, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 6.17% (4.6177 => 4.9027, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.17% (4.4195 => 4.6921, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.09% (0.3890 => 0.4127, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.01% (2.1653 => 2.2955, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.97% (0.4139 => 0.4386, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.1968 => 0.2085, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.5012 => 0.5309, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.92% (0.6435 => 0.6816, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.89% (0.3903 => 0.4133, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.84% (0.5546 => 0.5870, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 5.83% (0.6634 => 0.7021, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 5.80% (1.4269 => 1.5097, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.67% (1.9694 => 2.0811, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.2068 => 0.2185, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.62% (0.4658 => 0.4920, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.54% (0.3084 => 0.3255, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.2737 => 0.2888, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (1.9966 => 2.1060, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 5.40% (0.7875 => 0.8300, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.2040 => 0.2148, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.28% (0.3336 => 0.3512, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.3271 => 0.3443, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.2969 => 0.3120, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.2103 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.2075 => 0.2177, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.78% (2.0346 => 2.1319, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3792 => 0.3959, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.40% (0.4253 => 0.4440, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 4.39% (0.2391 => 0.2496, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 4.35% (0.4847 => 0.5058, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.15% (0.7426 => 0.7734, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (0.5361 => 0.5572, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.87% (0.5584 => 0.5800, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 3.46% (0.3498 => 0.3619, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.41% (11.6398 => 12.0371, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.33% (4.6926 => 4.8489, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 2.29% (11.9555 => 12.2292, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6747, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1683, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8904, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6280, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5058, std.dev.: 0.0266) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4338, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5969, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5638, std.dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.56% (35.5013 => 32.8162, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.91% (0.2402 => 0.2260, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7929, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7595, std.dev.: 0.0678) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9573, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 00:19:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 02:19:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120924071942.ABFCD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4189?compare_to=4188&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4189, Order: 164481, Start Time: 2012-09-24 04:34:15, End Time: 2012-09-24 07:21:13 To: 4188, Order: 164479, Start Time: 2012-09-24 01:14:09, End Time: 2012-09-24 03:58:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (95 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (800 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.69% (2.0517 => 2.1069, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.88% (0.3488 => 0.3972, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 13.80% (0.3442 => 0.3917, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.48% (0.3650 => 0.4142, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.08% (0.3724 => 0.4211, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.23% (0.1063 => 0.1193, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 10.80% (1.5932 => 1.7653, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5826 => 0.6425, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.15% (0.5889 => 0.6487, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7171 => 0.7781, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.35% (0.2875 => 0.3115, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.31% (2.7292 => 2.9560, std.dev.: 0.0848) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.3004 => 0.3244, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3195 => 0.3449, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.93% (0.2725 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.93% (0.2738 => 0.2955, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.85% (0.2750 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2803 => 0.3022, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.81% (0.2729 => 0.2942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.79% (0.2823 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2813 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2792 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.73% (2.0673 => 2.2272, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/matrix: 7.73% (0.2780 => 0.2995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.62% (0.3096 => 0.3332, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.62% (0.3267 => 0.3516, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.58% (0.2811 => 0.3024, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 7.52% (0.3258 => 0.3503, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.50% (0.3362 => 0.3614, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.2911 => 0.3129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3060 => 0.3288, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3317 => 0.3561, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.27% (0.3124 => 0.3351, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.26% (5.5417 => 5.9441, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 7.26% (0.3678 => 0.3945, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3477 => 0.3728, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.17% (0.3348 => 0.3588, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.15% (1.0781 => 1.1552, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3625 => 0.3881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.03% (0.3726 => 0.3988, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3282 => 0.3512, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.94% (0.3845 => 0.4112, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.83% (0.4146 => 0.4429, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4251 => 0.4537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.69% (0.3690 => 0.3937, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (2.1013 => 2.2406, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 6.62% (23.5202 => 25.0771, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.3981 => 0.4234, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 6.12% (4.6177 => 4.9003, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (2.1653 => 2.2957, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.5012 => 0.5312, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.98% (0.6435 => 0.6820, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.95% (0.5900 => 0.6251, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 5.89% (0.6634 => 0.7025, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.71% (0.3084 => 0.3260, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.2068 => 0.2182, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 5.43% (0.5546 => 0.5847, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 5.33% (0.7875 => 0.8295, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.2103 => 0.2209, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (0.2691 => 0.2823, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3792 => 0.3958, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.35% (0.4847 => 0.5058, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.26% (0.4253 => 0.4434, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.05% (0.7426 => 0.7727, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (0.5361 => 0.5565, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.58% (0.5584 => 0.5784, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.37% (11.6398 => 12.0324, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.6926 => 4.8479, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6127, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6643, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8912, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std.dev.: 0.0378) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6265, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1960, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4316, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2784, std.dev.: 0.0164) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5154, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5527, std.dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9807, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8130, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/ary2: -6.24% (0.2402 => 0.2252, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7742, std.dev.: 0.0841) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9648, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 04:35:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 06:35:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120924113540.44A032A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/4190?compare_to=4185&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4190, Order: 164484, Start Time: 2012-09-24 10:19:47, End Time: 2012-09-24 11:37:11 To: 4185, Order: 164479, Start Time: 2012-09-24 01:01:30, End Time: 2012-09-24 02:12:28 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 4 (5 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (74 on baseline) Performance Improvements: 14 (46 on baseline) Existing Failures: 70 (69 on baseline) Unchanged Tests: 872 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7104 => 0.2291, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -91.60% (6.9550 => 0.5840, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/09-vor/vor: 20955.43% (0.1270 => 26.7404, std.dev.: 0.0364) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.95% (1.1024 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 1.11% (16.0910 => 16.2704, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.63% (0.9599 => 1.0523, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.39% (1.3800 => 1.4268, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel-2: 1.86% (3.0904 => 3.1480, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.82% (2.3915 => 2.4351, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.61% (22.4183 => 22.7785, std.dev.: 0.0574) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.52% (43.8017 => 44.4684, std.dev.: 0.1910) MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (58.9630 => 59.8556, std.dev.: 0.1587) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.32% (2.7032 => 2.7390, std.dev.: 0.0123) MultiSource/Benchmarks/llubenchmark/llu: 1.14% (1.9964 => 2.0192, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -54.55% (0.0594 => 0.0270, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.60% (0.3090 => 0.1650, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.21% (1.4401 => 1.1203, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -21.85% (1.4460 => 1.1301, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones/fhourstones: -12.50% (0.1576 => 0.1379, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -4.02% (15.0724 => 14.4672, std.dev.: 0.1456) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.67% (0.7838 => 0.7707, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -1.52% (1.3726 => 1.3517, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.21% (4.1442 => 4.0941, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -17.01% (0.5057 => 0.4197, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.66% (1.7282 => 1.4749, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -5.78% (9.2849 => 8.7478, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -4.52% (3.9983 => 3.8177, std.dev.: 0.0142) MultiSource/Applications/lua/lua: -1.88% (29.5895 => 29.0338, std.dev.: 0.1700) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.04% (1.0212 => 1.0004, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.44% (0.5770 => 0.5853, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 9.26% (0.1501 => 0.1640, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.83% (0.1333 => 0.1242, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.46% (0.2875 => 0.2917, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.46% (0.2181 => 0.2191, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.30% (0.2972 => 0.2981, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.81% (0.2101 => 0.2042, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 6.49% (0.0262 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 93.48% (0.0046 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.10% (0.0091 => 0.0090, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.06% (0.0079 => 0.0075, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.62% (0.0174 => 0.0189, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0389 => 0.0389, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.95% (0.0301 => 0.0259, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0283 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.53% (0.0326 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0180 => 0.0179, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -18.23% (0.0192 => 0.0157, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -4.23% (0.0260 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 25.00% (0.0100 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.44% (0.1461 => 0.1440, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: -2.84% (1.4986 => 1.4560, std.dev.: 0.0292) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.36% (0.1423 => 0.1485, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.27% (0.4238 => 0.4057, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.13% (0.1404 => 0.1448, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.48% (0.0601 => 0.0544, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.67% (0.0210 => 0.0196, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.05% (0.0572 => 0.0578, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1275 => 1.1270, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -38.89% (0.0018 => 0.0011, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.02% (0.0599 => 0.0545, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.78% (0.0229 => 0.0186, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.89% (0.7603 => 0.7671, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 7.05% (1.5937 => 1.7061, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2291, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -91.62% (6.9722 => 0.5840, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/09-vor/vor: 21517.14% (0.1237 => 26.7404, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.64% (4.1772 => 3.1480, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 82650.00% (0.0006 => 0.4965, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.15% (0.1159 => 0.1265, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 8.09% (2.1763 => 2.3523, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.03% (0.6410 => 0.6925, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.5309 => 0.5720, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.73% (1.0046 => 1.0722, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 6.27% (15.3105 => 16.2704, std.dev.: 0.0161) MultiSource/Applications/minisat/minisat: 6.27% (0.6173 => 0.6560, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 6.23% (1.1653 => 1.2379, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.92% (0.7639 => 0.8015, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.72% (0.3901 => 0.4085, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 4.70% (0.6915 => 0.7240, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.42% (0.6069 => 0.6337, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (1.5150 => 1.5819, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.2797 => 0.2920, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 4.37% (3.0225 => 3.1547, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.30% (0.2654 => 0.2768, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 4.26% (0.3217 => 0.3354, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (8.2186 => 8.5506, std.dev.: 0.0767) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.75% (3.0758 => 3.1912, std.dev.: 0.0236) MultiSource/Benchmarks/Bullet/bullet: 3.63% (29.3170 => 30.3800, std.dev.: 0.1294) MultiSource/Applications/siod/siod: 3.55% (2.0972 => 2.1716, std.dev.: 0.0167) MultiSource/Applications/SPASS/SPASS: 3.43% (13.3238 => 13.7809, std.dev.: 0.1501) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.38% (1.4408 => 1.4895, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.16% (0.8569 => 0.8840, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.0821 => 1.1150, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.99% (1.2021 => 1.2380, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.1827 => 1.2170, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (2.0317 => 2.0902, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8405 => 0.8642, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.75% (6.2546 => 6.4266, std.dev.: 0.0320) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.7256 => 15.1027, std.dev.: 0.1188) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.54% (1.0689 => 1.0961, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 2.46% (3.5980 => 3.6866, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1672 => 1.1949, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (6.4908 => 6.6388, std.dev.: 0.0471) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.7226 => 0.7388, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4880 => 0.4988, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 1.88% (1.3268 => 1.3517, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.55% (4.0318 => 4.0941, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.44% (4.2616 => 4.3228, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.27% (1.2742 => 1.2904, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.26% (8.2559 => 8.3596, std.dev.: 0.0400) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Bubblesort: 41.06% (0.0263 => 0.0371, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.02% (3.4629 => 4.2253, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std.dev.: 0.0620) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5544, std.dev.: 0.0816) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.54% (0.0917 => 0.1032, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1433 => 0.1581, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 8.78% (7.0025 => 7.6173, std.dev.: 0.0293) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.54% (0.3301 => 0.3517, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.76% (40.4792 => 42.8117, std.dev.: 0.3196) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.44% (0.7609 => 0.8023, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/bisort/bisort: 4.89% (0.6459 => 0.6775, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/fp-convert: 4.37% (15.2242 => 15.8893, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 3.90% (8.5113 => 8.8435, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8738, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8987, std.dev.: 0.0184) MultiSource/Applications/siod/siod: 2.78% (3.5520 => 3.6508, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.75% (2.6656 => 2.7390, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.6308 => 0.6472, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.42% (0.5587 => 0.5722, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.22% (4.6127 => 4.7150, std.dev.: 0.0331) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4500, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.97% (22.3381 => 22.7785, std.dev.: 0.0574) SingleSource/Benchmarks/Misc/whetstone: 1.47% (2.3453 => 2.3797, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4455 => 2.4802, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -54.31% (0.0591 => 0.0270, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.93% (0.2996 => 0.1650, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.04% (1.4189 => 1.1203, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.92% (1.4113 => 1.1301, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.66% (5.2665 => 4.1257, std.dev.: 0.1076) SingleSource/Benchmarks/Shootout-C++/ary3: -20.07% (1.7473 => 1.3966, std.dev.: 0.0336) MultiSource/Benchmarks/FreeBench/mason/mason: -16.13% (0.5004 => 0.4197, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.05% (1.7361 => 1.4749, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.74% (0.0917 => 0.0791, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1643, std.dev.: 0.0555) MultiSource/Applications/sgefa/sgefa: -11.32% (0.3746 => 0.3322, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -10.77% (0.1114 => 0.0994, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.65% (1.1647 => 1.0523, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.76% (1.4034 => 1.2805, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7478, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9406, std.dev.: 0.0279) MultiSource/Applications/lambda-0_1_3/lambda: -7.02% (7.6833 => 7.1438, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/fibo: -6.43% (4.6355 => 4.3373, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -6.03% (1.4441 => 1.3570, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -5.70% (3.4230 => 3.2280, std.dev.: 0.0215) MultiSource/Benchmarks/FreeBench/distray/distray: -5.44% (0.2664 => 0.2519, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1885, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.28% (0.4140 => 0.3963, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -4.10% (62.4126 => 59.8556, std.dev.: 0.1587) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.73% (1.2722 => 1.2248, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/misr: -3.68% (0.4296 => 0.4138, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.43% (3.7496 => 3.6211, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/methcall: -3.28% (9.2503 => 8.9466, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.84% (3.9413 => 3.8292, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.20% (45.4683 => 44.4684, std.dev.: 0.1910) MultiSource/Benchmarks/sim/sim: -1.88% (3.8907 => 3.8177, std.dev.: 0.0142) MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (92.7467 => 91.0425, std.dev.: 0.3528) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3569 => 2.3136, std.dev.: 0.0139) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3678, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2254, std.dev.: 0.0312) MultiSource/Applications/lua/lua: -1.66% (29.5232 => 29.0338, std.dev.: 0.1700) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3231, std.dev.: 0.0398) SingleSource/Benchmarks/Dhrystone/fldry: -1.21% (2.4971 => 2.4668, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.04% (1.8739 => 1.8545, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.24% (0.9980 => 1.0004, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.81% (0.6022 => 0.5853, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -1.56% (0.1666 => 0.1640, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -20.08% (0.1554 => 0.1242, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.38% (0.3083 => 0.2917, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.48% (0.2394 => 0.2191, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.11% (0.3175 => 0.2981, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -11.29% (0.2302 => 0.2042, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -37.86% (0.0449 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.95% (0.0301 => 0.0259, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -16.93% (0.0189 => 0.0157, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1429 => 0.1440, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: -3.06% (1.5019 => 1.4560, std.dev.: 0.0292) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.07% (0.1501 => 0.1485, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.74% (0.1344 => 0.1448, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.64% (0.0589 => 0.0544, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.52% (0.0232 => 0.0196, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.39% (0.0246 => 0.0186, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.72% (0.7541 => 0.7671, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 04:45:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 06:45:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120924114531.EAAE22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/4191?compare_to=4186&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4191, Order: 164484, Start Time: 2012-09-24 10:32:27, End Time: 2012-09-24 11:47:02 To: 4186, Order: 164481, Start Time: 2012-09-24 02:23:11, End Time: 2012-09-24 03:37:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (688 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.31% (3.7791 => 3.8665, std.dev.: 0.0196) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.08% (2.0176 => 2.4429, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.23% (0.1410 => 0.1653, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.40% (0.2243 => 0.2566, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.01% (0.5818 => 0.6517, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.81% (0.5748 => 0.6427, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.75% (0.1013 => 0.1132, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.51% (0.0964 => 0.1075, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 11.39% (1.3693 => 1.5253, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.36% (3.9660 => 4.4167, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.97% (0.7710 => 0.8556, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.90% (0.2596 => 0.2879, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 10.88% (0.4328 => 0.4799, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.85% (0.9199 => 1.0197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.76% (1.2193 => 1.3505, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.75% (1.4563 => 1.6129, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.70% (0.1327 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.64% (0.5265 => 0.5825, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.51% (0.2721 => 0.3007, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.46% (0.6959 => 0.7687, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.45% (0.3130 => 0.3457, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.43% (0.7038 => 0.7772, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 10.36% (0.4062 => 0.4483, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.10% (0.3485 => 0.3837, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.10% (13.8202 => 15.2158, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.03% (0.3578 => 0.3937, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.96% (0.3663 => 0.4028, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.93% (0.3899 => 0.4286, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.88% (1.1364 => 1.2487, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-2: 9.86% (0.3601 => 0.3956, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.85% (0.6283 => 0.6902, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.82% (0.3789 => 0.4161, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3623 => 0.3978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.74% (0.4003 => 0.4393, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.73% (0.3914 => 0.4295, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 9.72% (0.3293 => 0.3613, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.70% (0.1062 => 0.1165, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.66% (0.3022 => 0.3314, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3580 => 0.3925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.62% (0.3940 => 0.4319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.55% (1.9828 => 2.1721, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.52% (0.3489 => 0.3821, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.49% (0.2655 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.49% (0.4016 => 0.4397, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2765 => 0.3026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.43% (0.4379 => 0.4792, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.42% (0.3756 => 0.4110, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.41% (0.5577 => 0.6102, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.2966 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2127 => 0.2326, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3149 => 0.3443, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.33% (0.1157 => 0.1265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.32% (0.2995 => 0.3274, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.24% (0.3246 => 0.3546, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.23% (0.3868 => 0.4225, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.19% (1.0313 => 1.1261, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.07% (0.4390 => 0.4788, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 9.01% (0.3453 => 0.3764, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.99% (0.2914 => 0.3176, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 8.92% (1.1061 => 1.2048, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 8.91% (0.3534 => 0.3849, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.90% (7.2180 => 7.8605, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 8.89% (0.7506 => 0.8173, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 8.75% (16.6129 => 18.0668, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.72% (0.4791 => 0.5209, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.66% (0.3220 => 0.3499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.66% (0.5637 => 0.6125, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 8.63% (0.8310 => 0.9027, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6576 => 0.7138, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2023 => 0.2195, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.35% (0.7460 => 0.8083, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 8.34% (0.2925 => 0.3169, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 8.19% (1.0594 => 1.1462, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2945 => 0.3186, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.14% (3.1889 => 3.4486, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 8.14% (3.8646 => 4.1793, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 8.14% (2.1791 => 2.3564, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.11% (0.8698 => 0.9403, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 8.03% (1.9270 => 2.0818, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.97% (0.1657 => 0.1789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.89% (1.3245 => 1.4290, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 7.87% (0.6744 => 0.7275, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.71% (0.4113 => 0.4430, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.70% (0.3755 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.67% (3.6692 => 3.9508, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 7.55% (8.4961 => 9.1374, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: 7.51% (0.3131 => 0.3366, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.50% (14.8535 => 15.9676, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.45% (4.3801 => 4.7063, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 7.33% (1.2749 => 1.3683, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.31% (4.4433 => 4.7679, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.2140 => 0.2295, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.17% (0.6135 => 0.6575, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.04% (1.1333 => 1.2131, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.97% (0.8818 => 0.9433, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 6.75% (4.6629 => 4.9778, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.61% (1.2292 => 1.3105, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.42% (3.2742 => 3.4845, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.10% (0.6250 => 0.6631, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.08% (0.4805 => 0.5097, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.06% (4.9865 => 5.2889, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.03% (0.2321 => 0.2461, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.96% (6.5754 => 6.9670, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (6.2785 => 6.6497, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.88% (1.5188 => 1.6081, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.72% (0.9108 => 0.9629, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.51% (3.7467 => 3.9531, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (13.2842 => 13.9883, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.30% (2.1007 => 2.2120, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 5.23% (0.2008 => 0.2113, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.66% (16.2614 => 16.8572, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.50% (0.3511 => 0.3634, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.5298 => 14.9931, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.81% (0.3139 => 0.3290, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1000, std.dev.: 0.0087) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 2.48% (3.7731 => 3.8665, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5839, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5862, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.64% (0.2670 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.12% (1.3813 => 1.1863, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.05% (1.3819 => 1.1878, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: -13.83% (0.4657 => 0.4013, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.5627 => 21.5489, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.35% (0.2238 => 0.1984, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2941, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.27% (0.9996 => 0.9569, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.34% (1.7688 => 1.7098, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9514, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2419, std.dev.: 0.0140) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0496, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6615 => 0.6506, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7916, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8591, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std.dev.: 0.0234) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2602, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 04:49:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 06:49:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120924114942.718392A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/4192?compare_to=4187&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4192, Order: 164484, Start Time: 2012-09-24 10:32:38, End Time: 2012-09-24 11:51:13 To: 4187, Order: 164481, Start Time: 2012-09-24 02:23:34, End Time: 2012-09-24 03:41:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 1 (152 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 947 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (1.2927 => 1.3154, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -6.17% (4.0507 => 3.8009, std.dev.: 0.0604) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5775 => 0.5768, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -0.15% (16.0965 => 16.0721, std.dev.: 0.0211) MultiSource/Applications/kimwitu++/kc: -0.37% (14.9822 => 14.9270, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -0.18% (54.1288 => 54.0322, std.dev.: 0.0868) MultiSource/Benchmarks/MallocBench/gs/gs: -0.40% (4.3527 => 4.3354, std.dev.: 0.0310) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.22% (1.2378 => 1.2351, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.5124 => 7.5097, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7224 => 0.7216, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2071 => 0.2070, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.57% (63.2438 => 54.0322, std.dev.: 0.0868) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.05% (3.4629 => 5.4731, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14245.14% (0.0720 => 10.3285, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.96% (0.2554 => 0.3779, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 47.22% (10.3673 => 15.2627, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.42% (2.2022 => 2.5638, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.52% (7.0540 => 8.1487, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: 14.66% (0.1432 => 0.1642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.83% (0.3543 => 0.4033, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3497 => 0.3974, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.60% (0.3543 => 0.4025, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.54% (0.3516 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.51% (0.3561 => 0.4042, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.09% (0.1566 => 0.1771, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 12.83% (0.3927 => 0.4431, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.83% (0.3828 => 0.4319, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.61% (0.3886 => 0.4376, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.23% (0.0834 => 0.0936, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 11.72% (10.4361 => 11.6594, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.68% (1.7609 => 1.9665, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.54% (0.1584 => 0.1751, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 9.38% (0.1440 => 0.1575, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5925 => 0.6450, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 8.41% (9.4845 => 10.2817, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.34% (0.3177 => 0.3442, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.88% (1.5415 => 1.6630, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.65% (0.4615 => 0.4968, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.60% (4.2646 => 4.5887, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 7.60% (5.7591 => 6.1966, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 7.52% (0.7115 => 0.7650, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 7.51% (0.3423 => 0.3680, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.43% (8.1363 => 8.7407, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.43% (1.3050 => 1.4019, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.39% (0.6675 => 0.7168, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.33% (0.3109 => 0.3337, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.33% (0.8172 => 0.8771, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2700 => 0.2897, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 7.19% (3.3354 => 3.5751, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.10% (0.7433 => 0.7961, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.10% (0.5860 => 0.6276, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.95% (5.0018 => 5.3496, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.94% (4.9449 => 5.2881, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.90% (0.5569 => 0.5953, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.81% (0.9765 => 1.0430, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.81% (0.8067 => 0.8616, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.78% (7.9617 => 8.5012, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.75% (0.7835 => 0.8364, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 6.73% (0.3387 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.2758 => 0.2943, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.63% (0.3121 => 0.3328, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 6.58% (1.5603 => 1.6630, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.58% (0.5105 => 0.5441, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.46% (1.1642 => 1.2394, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3441 => 0.3652, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (1.1861 => 1.2586, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 6.05% (21.9371 => 23.2635, std.dev.: 0.0430) MultiSource/Applications/lua/lua: 6.02% (3.8723 => 4.1053, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.02% (0.5020 => 0.5322, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.96% (0.3307 => 0.3504, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2891 => 0.3062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.6456 => 0.6837, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 5.89% (0.4299 => 0.4552, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 5.88% (2.0273 => 2.1466, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.3180 => 0.3367, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.87% (0.2725 => 0.2885, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4289 => 0.4539, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2831 => 0.2996, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.81% (1.0722 => 1.1345, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.79% (0.3817 => 0.4038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3865 => 0.4086, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.71% (0.4203 => 0.4443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.69% (0.3232 => 0.3416, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2603 => 0.2751, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.68% (0.4103 => 0.4336, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.65% (0.3826 => 0.4042, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2905 => 0.3069, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3650 => 0.3855, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.45% (0.3136 => 0.3307, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3283 => 0.3462, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2756 => 0.2906, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.4048 => 0.4268, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3684 => 0.3883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 5.37% (0.3052 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (2.0665 => 2.1771, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.32% (0.6450 => 0.6793, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4636 => 0.4882, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.3098 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.28% (0.3162 => 0.3329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.27% (0.3603 => 0.3793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.26% (0.2871 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.24% (0.4620 => 0.4862, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.22% (0.2872 => 0.3022, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.20% (0.5981 => 0.6292, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2877 => 0.3026, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.14% (0.2802 => 0.2946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.12% (0.3379 => 0.3552, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 5.10% (0.8921 => 0.9376, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 4.90% (2.2969 => 2.4094, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.79% (1.5859 => 1.6618, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.69% (1.4186 => 1.4852, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.1840 => 1.2363, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.11% (2.2024 => 2.2929, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.4064 => 0.4221, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2842 => 1.3328, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 3.55% (0.3131 => 0.3242, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.41% (0.3427 => 0.3544, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.39% (0.8101 => 0.8376, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (14.3668 => 14.8273, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.71% (1.1194 => 1.1497, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.67% (17.1811 => 17.6397, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (3.8922 => 3.9547, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4510, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.58% (3.6395 => 3.7699, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (1.7254 => 1.7645, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2549, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8069, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5746, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2595, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.91% (5.3855 => 3.6672, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.62% (5.3526 => 3.6600, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1800, std.dev.: 0.0315) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.29% (2.9384 => 2.6068, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.20% (22.1758 => 19.9138, std.dev.: 0.0481) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3773, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -9.25% (0.2161 => 0.1961, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2967, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.95% (0.9957 => 0.9564, std.dev.: 0.0136) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0218) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5093, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -3.01% (1.2373 => 1.2000, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1738, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5019, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0885, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0045, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6831, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.31% (0.5229 => 0.5768, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 7.22% (14.9895 => 16.0721, std.dev.: 0.0211) MultiSource/Applications/kimwitu++/kc: 5.45% (14.1553 => 14.9270, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 5.47% (4.1105 => 4.3354, std.dev.: 0.0310) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.79% (1.1048 => 1.2351, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.91% (7.1582 => 7.5097, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.98% (0.6222 => 0.7216, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (0.2116 => 0.2070, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 06:05:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 08:05:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120924130528.85C992A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/4193?compare_to=4190&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4193, Order: 164485, Start Time: 2012-09-24 11:53:05, End Time: 2012-09-24 13:07:00 To: 4190, Order: 164484, Start Time: 2012-09-24 10:19:47, End Time: 2012-09-24 11:37:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (5 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 1 (74 on baseline) Performance Improvements: 2 (52 on baseline) Existing Failures: 74 (69 on baseline) Unchanged Tests: 893 (760 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 12.76% (0.1379 => 0.1555, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (0.7813 => 0.7694, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.82% (22.7785 => 22.3640, std.dev.: 0.1099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.99% (1.0004 => 1.0103, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.5853 => 0.5853, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 1.22% (0.1640 => 0.1660, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.43% (0.1242 => 0.1297, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.37% (0.2917 => 0.2848, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.23% (0.2191 => 0.2196, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.95% (0.2981 => 0.2893, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.25% (0.2042 => 0.2088, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -13.26% (0.0279 => 0.0242, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -18.89% (0.0090 => 0.0073, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.33% (0.0075 => 0.0074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.28% (0.0189 => 0.0145, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.25% (0.0389 => 0.0318, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.13% (0.0259 => 0.0293, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.38% (0.0284 => 0.0246, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.54% (0.0321 => 0.0300, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0179 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -23.57% (0.0157 => 0.0120, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -40.00% (0.0125 => 0.0075, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1440 => 0.1437, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 0.13% (0.2291 => 0.2294, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.65% (1.4560 => 1.4800, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.29% (0.1485 => 0.1451, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.91% (0.5840 => 0.5893, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.01% (26.7404 => 26.7370, std.dev.: 0.2102) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.87% (0.4057 => 0.3981, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.66% (0.1448 => 0.1366, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.41% (0.0544 => 0.0568, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0196 => 0.0196, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0578 => 0.0581, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.87% (0.0047 => 0.0001, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1270 => 1.1311, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.09% (0.0011 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.55% (0.0545 => 0.0542, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.82% (0.0186 => 0.0151, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.33% (0.7671 => 0.7646, std.dev.: 0.0255) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 150.00% (0.0002 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 0.02% (1.7061 => 1.7065, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2294, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -91.55% (6.9722 => 0.5893, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 21514.39% (0.1237 => 26.7370, std.dev.: 0.2102) MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.70% (4.1772 => 3.1038, std.dev.: 0.1005) SingleSource/Benchmarks/Shootout-C++/except: 83050.00% (0.0006 => 0.4989, std.dev.: 0.0161) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.97% (0.1414 => 0.1555, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.85% (0.6410 => 0.6977, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.63% (0.1159 => 0.1259, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 7.95% (2.1763 => 2.3494, std.dev.: 0.0256) SingleSource/Benchmarks/Misc-C++/bigfib: 7.14% (0.5309 => 0.5688, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 6.49% (1.0046 => 1.0698, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 6.33% (0.6173 => 0.6564, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.03% (0.3582 => 0.3798, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (1.1653 => 1.2355, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 5.70% (15.3105 => 16.1825, std.dev.: 0.2590) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.5150 => 1.5978, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.00% (0.3901 => 0.4096, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.62% (0.2552 => 0.2670, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.6915 => 0.7230, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.2797 => 0.2920, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.32% (0.7639 => 0.7969, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 4.06% (3.0225 => 3.1453, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.94% (0.6069 => 0.6308, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.64% (1.1827 => 1.2257, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 3.52% (13.3238 => 13.7925, std.dev.: 0.0231) MultiSource/Applications/oggenc/oggenc: 3.45% (4.7455 => 4.9093, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.29% (3.0758 => 3.1771, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (6.2546 => 6.4504, std.dev.: 0.0340) MultiSource/Applications/siod/siod: 3.01% (2.0972 => 2.1604, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.96% (1.4408 => 1.4835, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.88% (29.3170 => 30.1620, std.dev.: 0.2893) MultiSource/Applications/Burg/burg: 2.88% (1.1440 => 1.1769, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.0317 => 2.0875, std.dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.7256 => 15.1203, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.7226 => 0.7418, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 2.56% (3.5980 => 3.6901, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8405 => 0.8613, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.1672 => 1.1948, std.dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 2.31% (1.0821 => 1.1071, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4880 => 0.4986, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.16% (1.3268 => 1.3555, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 1.98% (1.8798 => 1.9170, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.95% (4.2616 => 4.3446, std.dev.: 0.0248) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (6.4908 => 6.6098, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.75% (0.5937 => 0.6041, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (4.3380 => 4.4040, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.19% (1.2742 => 1.2894, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (8.2559 => 8.3479, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.89% (1.6538 => 2.3300, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.37% (0.0766 => 0.0922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 14.67% (1.7426 => 1.9983, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.25% (4.0101 => 4.5415, std.dev.: 0.0174) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.12% (0.0917 => 0.1019, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.80% (1.0063 => 1.1049, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (4.2129 => 4.6181, std.dev.: 0.1073) SingleSource/Benchmarks/Shootout/lists: 8.86% (7.0025 => 7.6231, std.dev.: 0.0756) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.61% (0.2694 => 0.2926, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 7.19% (0.1433 => 0.1536, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (0.3301 => 0.3511, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.99% (0.8498 => 0.9007, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.05% (40.4792 => 42.5229, std.dev.: 0.0874) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.17% (0.7609 => 0.7926, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8224, std.dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.15% (3.5520 => 3.6638, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8982, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: 2.40% (8.5113 => 8.7152, std.dev.: 0.0700) SingleSource/Benchmarks/Misc/whetstone: 2.35% (2.3453 => 2.4004, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.20% (4.6127 => 4.7142, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4501, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.4184 => 1.4339, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.53% (0.2996 => 0.1602, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.86% (1.4189 => 1.1371, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.47% (1.4113 => 1.1365, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.05% (0.2080 => 0.1975, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -4.37% (8.9977 => 8.6048, std.dev.: 0.1453) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -19.93% (1.7473 => 1.3990, std.dev.: 0.0709) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.66% (5.2665 => 4.2836, std.dev.: 0.2184) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.21% (15.8312 => 13.1062, std.dev.: 0.7245) MultiSource/Benchmarks/FreeBench/mason/mason: -15.51% (0.5004 => 0.4228, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.33% (1.7361 => 1.4699, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.43% (0.0917 => 0.0803, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.91% (3.6023 => 3.1733, std.dev.: 0.0834) MultiSource/Applications/sgefa/sgefa: -11.05% (0.3746 => 0.3332, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.70% (1.1647 => 1.0517, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7472, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9513, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -6.91% (7.6833 => 7.1525, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.6254 => 3.3796, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3294, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.57% (2.0027 => 1.8712, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: -6.25% (1.4441 => 1.3539, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7922, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: -5.88% (3.4230 => 3.2217, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: -5.78% (0.2664 => 0.2510, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1856, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.76% (0.4140 => 0.3943, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.65% (1.2959 => 1.2356, std.dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: -4.11% (62.4126 => 59.8490, std.dev.: 0.4207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.68% (61.1734 => 58.9204, std.dev.: 0.7568) SingleSource/Benchmarks/McGill/misr: -3.42% (0.4296 => 0.4149, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.28% (3.7496 => 3.6265, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9781, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8285, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.39% (1.1683 => 1.1404, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -2.20% (92.7467 => 90.7101, std.dev.: 0.1283) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.12% (2.3569 => 2.3070, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -1.85% (3.4876 => 3.4232, std.dev.: 0.0120) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3653, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2262, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.57% (2.4457 => 2.4072, std.dev.: 0.0120) MultiSource/Applications/lua/lua: -1.54% (29.5232 => 29.0672, std.dev.: 0.0914) SingleSource/Benchmarks/Dhrystone/fldry: -1.50% (2.4971 => 2.4597, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3080, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.05% (1.8739 => 1.8543, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.23% (0.9980 => 1.0103, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -2.81% (0.6022 => 0.5853, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -0.36% (0.1666 => 0.1660, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.54% (0.1554 => 0.1297, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.62% (0.3083 => 0.2848, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.27% (0.2394 => 0.2196, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.88% (0.3175 => 0.2893, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.30% (0.2302 => 0.2088, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -46.10% (0.0449 => 0.0242, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -18.89% (0.0090 => 0.0073, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.17% (0.0240 => 0.0074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.48% (0.0192 => 0.0145, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.46% (0.0390 => 0.0318, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.66% (0.0301 => 0.0293, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.38% (0.0284 => 0.0246, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.41% (0.0324 => 0.0300, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -36.51% (0.0189 => 0.0120, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -76.92% (0.0325 => 0.0075, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.46% (1.5019 => 1.4800, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.33% (0.1501 => 0.1451, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.64% (0.4264 => 0.3981, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.64% (0.1344 => 0.1366, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.57% (0.0589 => 0.0568, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.52% (0.0232 => 0.0196, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.08% (0.0639 => 0.0581, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1350 => 1.1311, std.dev.: 0.0211) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.91% (0.0637 => 0.0542, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.62% (0.0246 => 0.0151, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.39% (0.7541 => 0.7646, std.dev.: 0.0255) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 06:14:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 08:14:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120924131454.EE31E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/4194?compare_to=4189&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4194, Order: 164484, Start Time: 2012-09-24 10:32:30, End Time: 2012-09-24 13:16:26 To: 4189, Order: 164481, Start Time: 2012-09-24 04:34:15, End Time: 2012-09-24 07:21:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 12.94% (0.3724 => 0.4206, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.23% (0.1063 => 0.1193, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.91% (1.5932 => 1.7670, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 9.37% (0.5826 => 0.6372, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.34% (0.5889 => 0.6439, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.29% (1.3152 => 1.4242, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1620 => 0.1753, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.04% (2.7292 => 2.9487, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.01% (3.5627 => 3.8481, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.83% (0.2875 => 0.3100, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (1.6211 => 1.7473, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.73% (0.4361 => 0.4698, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.71% (0.7171 => 0.7724, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.63% (0.4994 => 0.5375, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.52% (0.5000 => 0.5376, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 7.49% (0.3004 => 0.3229, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.2738 => 0.2942, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.45% (0.2014 => 0.2164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.41% (0.2714 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.39% (0.3195 => 0.3431, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3362 => 0.3606, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 7.25% (0.2813 => 0.3017, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.25% (5.5417 => 5.9433, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2750 => 0.2949, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.23% (0.2823 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2803 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.19% (0.3060 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.18% (0.2729 => 0.2925, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.18% (1.0781 => 1.1555, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 7.12% (0.2780 => 0.2978, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.11% (2.0673 => 2.2143, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.1421 => 0.1522, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2792 => 0.2990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.08% (0.2811 => 0.3010, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.07% (0.3930 => 0.4208, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 7.05% (0.2566 => 0.2747, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3096 => 0.3314, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3267 => 0.3497, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.03% (0.9909 => 1.0606, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.03% (0.3258 => 0.3487, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.94% (0.2911 => 0.3113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3678 => 0.3930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3317 => 0.3540, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.2736 => 0.2919, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3477 => 0.3709, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3124 => 0.3332, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.58% (0.1549 => 0.1651, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.56% (4.2109 => 4.4872, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.54% (0.3625 => 0.3862, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.54% (0.4146 => 0.4417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.53% (0.5026 => 0.5354, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.51% (0.3348 => 0.3566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3282 => 0.3495, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.45% (0.4029 => 0.4289, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.45% (2.1013 => 2.2368, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 6.44% (0.3726 => 0.3966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.40% (0.3690 => 0.3926, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4251 => 0.4521, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.22% (0.3890 => 0.4132, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.2866 => 0.3044, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.14% (0.3845 => 0.4081, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.5900 => 0.6261, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 6.04% (4.6177 => 4.8967, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.02% (0.3903 => 0.4138, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.98% (4.4195 => 4.6839, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 5.98% (23.5202 => 24.9271, std.dev.: 0.0521) MultiSource/Applications/JM/ldecod/ldecod: 5.97% (2.1653 => 2.2946, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 5.97% (0.9697 => 1.0276, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.97% (0.4139 => 0.4386, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.3981 => 0.4215, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.87% (1.8794 => 1.9898, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 5.75% (0.5012 => 0.5300, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.73% (1.4269 => 1.5086, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (1.9694 => 2.0821, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 5.68% (0.6634 => 0.7011, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (0.4658 => 0.4921, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.63% (0.6435 => 0.6797, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.58% (1.9966 => 2.1080, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.54% (0.5546 => 0.5853, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.3084 => 0.3248, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.25% (0.2969 => 0.3125, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.22% (0.2068 => 0.2176, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.19% (0.3336 => 0.3509, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 5.12% (0.7875 => 0.8278, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.2737 => 0.2877, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.2103 => 0.2208, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.67% (2.0346 => 2.1297, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (0.2691 => 0.2811, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3792 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.19% (0.4847 => 0.5050, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.07% (0.7426 => 0.7728, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (0.5361 => 0.5565, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.46% (0.3498 => 0.3619, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.6926 => 4.8543, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.42% (0.5584 => 0.5775, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.28% (11.6398 => 12.0220, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 2.09% (11.9555 => 12.2053, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8979, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1632, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6283, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std.dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.83% (3.1722 => 3.2304, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.61% (41.7953 => 42.4679, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2828, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5948, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4665, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5543, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: -10.32% (0.2402 => 0.2154, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7978, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7940, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7756, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.11% (17.2379 => 16.8740, std.dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5725, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9703, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 06:28:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 08:28:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120924132843.6586A2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/4195?compare_to=4191&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4195, Order: 164485, Start Time: 2012-09-24 12:15:55, End Time: 2012-09-24 13:30:14 To: 4191, Order: 164484, Start Time: 2012-09-24 10:32:27, End Time: 2012-09-24 11:47:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.02% (2.0176 => 2.4418, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.95% (0.1410 => 0.1649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.36% (0.2243 => 0.2565, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.82% (0.0819 => 0.0924, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.01% (0.5818 => 0.6517, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.85% (0.5748 => 0.6429, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.33% (1.3693 => 1.5245, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.22% (3.9660 => 4.4111, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.21% (0.1588 => 0.1766, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.17% (0.7061 => 0.7850, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.16% (0.9199 => 1.0226, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.94% (0.2596 => 0.2880, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.86% (0.4328 => 0.4798, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.70% (0.7710 => 0.8535, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.66% (1.4563 => 1.6116, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.66% (1.2193 => 1.3493, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.54% (0.3130 => 0.3460, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.47% (0.2721 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.40% (0.6959 => 0.7683, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (0.7038 => 0.7766, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186) SingleSource/Benchmarks/Shootout-C++/hash: 10.32% (0.4062 => 0.4481, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 10.25% (0.2781 => 0.3066, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.17% (0.1327 => 0.1462, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.06% (0.3578 => 0.3938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.05% (0.3899 => 0.4291, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 10.05% (13.8202 => 15.2087, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.00% (0.6283 => 0.6911, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.99% (0.3485 => 0.3833, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.91% (0.3601 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.88% (0.3663 => 0.4025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.88% (1.1364 => 1.2487, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/exceptions-4: 9.87% (0.3646 => 0.4006, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.87% (0.3789 => 0.4163, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3650 => 0.4010, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3623 => 0.3977, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.73% (0.3022 => 0.3316, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.71% (0.3914 => 0.4294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.69% (0.4003 => 0.4391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.67% (0.3940 => 0.4321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.66% (0.3293 => 0.3611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0034) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4016 => 0.4400, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.56% (0.5577 => 0.6110, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.49% (1.9828 => 2.1710, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.47% (0.3580 => 0.3919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.45% (0.2655 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.43% (0.3489 => 0.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.42% (0.3756 => 0.4110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 9.34% (0.2761 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.28% (0.3868 => 0.4227, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.27% (0.4379 => 0.4785, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.21% (0.3246 => 0.3545, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 9.20% (1.0313 => 1.1262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.18% (0.2995 => 0.3270, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.08% (0.1157 => 0.1262, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.97% (0.4390 => 0.4784, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 8.97% (0.3534 => 0.3851, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 8.96% (1.1061 => 1.2052, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.93% (7.2180 => 7.8627, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/sieve: 8.92% (0.3453 => 0.3761, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.79% (0.2914 => 0.3170, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.75% (0.4791 => 0.5210, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.73% (0.5637 => 0.6129, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.70% (0.7506 => 0.8159, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 8.58% (0.8310 => 0.9023, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.58% (16.6129 => 18.0382, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2023 => 0.2195, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6576 => 0.7129, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.35% (0.3220 => 0.3489, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.27% (0.7460 => 0.8077, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.2925 => 0.3165, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.17% (0.8698 => 0.9409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.15% (0.2945 => 0.3185, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.11% (1.0594 => 1.1453, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.08% (3.1889 => 3.4467, std.dev.: 0.0064) MultiSource/Applications/siod/siod: 8.04% (2.1791 => 2.3544, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1865 => 0.2015, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 8.01% (3.8646 => 4.1743, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 7.98% (1.9270 => 2.0808, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 7.89% (0.6744 => 0.7276, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.66% (1.3245 => 1.4259, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.62% (0.3755 => 0.4041, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.55% (3.6692 => 3.9464, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 7.54% (0.3131 => 0.3367, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.48% (8.4961 => 9.1314, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 7.39% (14.8535 => 15.9510, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 7.37% (1.2749 => 1.3689, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.32% (4.3801 => 4.7007, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.1569 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.25% (4.4433 => 4.7654, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.12% (0.6135 => 0.6572, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.01% (0.2140 => 0.2290, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.96% (1.1333 => 1.2122, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.77% (0.8818 => 0.9415, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.75% (4.6629 => 4.9775, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2504 => 0.2671, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.59% (1.2292 => 1.3102, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.25% (3.2742 => 3.4787, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.18% (0.4805 => 0.5102, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.10% (0.6250 => 0.6631, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.02% (4.9865 => 5.2865, std.dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 5.92% (6.5754 => 6.9648, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.84% (6.2785 => 6.6453, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.75% (1.5188 => 1.6061, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.61% (0.9108 => 0.9619, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.47% (3.7467 => 3.9516, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.32% (2.1007 => 2.2124, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.32% (13.2842 => 13.9903, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 5.13% (0.2008 => 0.2111, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.60% (16.2614 => 16.8475, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.50% (0.3511 => 0.3634, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.16% (14.5298 => 14.9891, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5136, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std.dev.: 0.0523) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4126, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7043, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0703, std.dev.: 0.0581) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5902, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5836, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5911, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.08% (1.3813 => 1.1868, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.05% (1.3819 => 1.1877, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: -13.76% (0.4657 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.47% (22.5627 => 21.5551, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2857, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.64% (1.3780 => 1.3003, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.80% (0.9996 => 0.9516, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7087, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9561, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2432, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6615 => 0.6506, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1018, std.dev.: 0.0296) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7904, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8694, std.dev.: 0.0130) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2247, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4347, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2618, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 06:36:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 08:36:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120924133637.A1ACC2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/4196?compare_to=4192&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4196, Order: 164485, Start Time: 2012-09-24 12:20:10, End Time: 2012-09-24 13:38:08 To: 4192, Order: 164484, Start Time: 2012-09-24 10:32:38, End Time: 2012-09-24 11:51:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 0 (153 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 948 (688 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.51% (1.3154 => 1.2955, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5768 => 0.5766, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.10% (16.0721 => 16.0556, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: -0.10% (14.9270 => 14.9125, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 0.05% (54.0322 => 54.0596, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3354 => 4.3330, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.2351 => 1.2357, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.5097 => 7.5171, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.7216 => 0.7225, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2070 => 0.2071, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.52% (63.2438 => 54.0596, std.dev.: 0.0047) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.97% (3.4629 => 5.4702, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14244.58% (0.0720 => 10.3281, std.dev.: 0.0036) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.92% (0.2554 => 0.3778, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 47.20% (10.3673 => 15.2605, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.44% (2.2022 => 2.5642, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.50% (7.0540 => 8.1472, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 14.66% (0.1432 => 0.1642, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3497 => 0.3976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.59% (0.3516 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.58% (0.3543 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.56% (0.3561 => 0.4044, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.08% (0.3694 => 0.4177, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.03% (0.1566 => 0.1770, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3828 => 0.4322, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.69% (0.3886 => 0.4379, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.71% (1.7609 => 1.9671, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 11.58% (10.4361 => 11.6442, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/oourafft: 11.46% (0.3282 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 9.03% (0.1440 => 0.1570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 8.46% (9.4845 => 10.2869, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.37% (0.3177 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.97% (0.4879 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.5415 => 1.6627, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.80% (0.4615 => 0.4975, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7326 => 0.7895, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.57% (5.7591 => 6.1953, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.53% (0.7115 => 0.7651, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 7.51% (0.3423 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.50% (8.1363 => 8.7467, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6675 => 0.7172, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.43% (0.3109 => 0.3340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.36% (1.3050 => 1.4010, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.28% (0.7433 => 0.7974, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.28% (3.3354 => 3.5781, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.8172 => 0.8764, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.22% (0.5860 => 0.6283, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.22% (4.2646 => 4.5724, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.96% (4.9449 => 5.2890, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.96% (5.0018 => 5.3497, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.89% (0.1625 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.88% (0.8067 => 0.8622, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.88% (0.7835 => 0.8374, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (7.9617 => 8.5038, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.5569 => 0.5948, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.78% (0.9765 => 1.0427, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2758 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.3121 => 0.3331, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.70% (1.5603 => 1.6649, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.62% (0.1555 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.55% (0.3387 => 0.3609, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.48% (0.5105 => 0.5436, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.44% (0.1940 => 0.2065, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.39% (1.1642 => 1.2386, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2891 => 0.3071, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.12% (1.1861 => 1.2587, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 6.07% (0.6456 => 0.6848, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.04% (21.9371 => 23.2623, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.99% (0.3441 => 0.3647, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4299 => 0.4556, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.96% (0.5020 => 0.5319, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.94% (3.8723 => 4.1022, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.93% (0.4048 => 0.4288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.92% (0.4289 => 0.4543, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.90% (0.4203 => 0.4451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.90% (0.2831 => 0.2998, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.3180 => 0.3367, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.4103 => 0.4343, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.84% (1.0722 => 1.1348, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.82% (0.2905 => 0.3074, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.79% (0.3817 => 0.4038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3865 => 0.4086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3650 => 0.3858, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2603 => 0.2751, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3826 => 0.4043, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.66% (2.0273 => 2.1421, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3232 => 0.3415, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2756 => 0.2909, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3603 => 0.3801, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.3098 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.48% (0.2793 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2871 => 0.3028, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (2.0665 => 2.1790, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.41% (0.3162 => 0.3333, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.37% (0.4636 => 0.4885, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (0.4620 => 0.4868, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.36% (0.2872 => 0.3026, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2802 => 0.2952, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.35% (0.2877 => 0.3031, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.30% (0.3379 => 0.3558, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.22% (0.5981 => 0.6293, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.6450 => 0.6781, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.11% (0.8921 => 0.9377, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.99% (2.2969 => 2.4115, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.78% (1.5859 => 1.6617, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.60% (1.4186 => 1.4839, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.45% (1.1840 => 1.2367, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.2024 => 2.2928, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.01% (0.4064 => 0.4227, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.2842 => 1.3344, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.3131 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.41% (0.8101 => 0.8377, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.3427 => 0.3540, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (14.3668 => 14.8221, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.72% (1.1194 => 1.1498, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.57% (17.1811 => 17.6225, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.49% (3.8922 => 3.9500, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.67% (3.6395 => 3.7729, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.59% (9.1159 => 9.2607, std.dev.: 0.0283) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8075, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.17% (5.2763 => 3.2624, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.90% (5.3855 => 3.6674, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.61% (5.3526 => 3.6605, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.62% (54.1659 => 46.2482, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/mason/mason: -13.81% (0.0811 => 0.0699) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.24% (2.9384 => 2.6082, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.14% (22.1758 => 19.9262, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -9.21% (0.2161 => 0.1962, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3067, std.dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.10% (0.9957 => 0.9549, std.dev.: 0.0151) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1603, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5058, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.39% (12.4730 => 12.1744, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -2.20% (1.2373 => 1.2101, std.dev.: 0.0056) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9910, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.01% (8.6802 => 8.5053, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2325, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.27% (0.5229 => 0.5766, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.11% (14.9895 => 16.0556, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 5.35% (14.1553 => 14.9125, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 5.41% (4.1105 => 4.3330, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.85% (1.1048 => 1.2357, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.01% (7.1582 => 7.5171, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.12% (0.6222 => 0.7225, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.13% (0.2116 => 0.2071, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 09:27:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 11:27:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120924162740.716452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4197?compare_to=4194&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4197, Order: 164485, Start Time: 2012-09-24 13:45:21, End Time: 2012-09-24 16:29:11 To: 4194, Order: 164484, Start Time: 2012-09-24 10:32:30, End Time: 2012-09-24 13:16:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.54% (0.2085 => 0.2263, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.39% (124.6861 => 130.1632, std.dev.: 0.7823) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3643 => 0.4118, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.14% (0.1063 => 0.1192, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 10.78% (1.5932 => 1.7650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.34% (0.5889 => 0.6439, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5826 => 0.6367, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.89% (0.1619 => 0.1763, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.04% (1.3152 => 1.4210, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.97% (0.2875 => 0.3104, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.96% (2.7292 => 2.9465, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (3.5627 => 3.8443, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (1.6211 => 1.7474, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7171 => 0.7720, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.52% (0.4361 => 0.4689, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 7.49% (0.3004 => 0.3229, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.49% (0.4994 => 0.5368, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (0.3195 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2725 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.35% (0.2803 => 0.3009, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2738 => 0.2939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.33% (0.2729 => 0.2929) SingleSource/Benchmarks/Shootout-C++/objinst: 7.30% (0.2823 => 0.3029, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.28% (0.5000 => 0.5364, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 7.26% (5.5417 => 5.9442, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2750 => 0.2949, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.21% (1.0781 => 1.1558, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 7.18% (0.2813 => 0.3015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.17% (2.0673 => 2.2156, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 7.09% (0.9909 => 1.0612, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2792 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.08% (0.2811 => 0.3010, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 7.07% (0.3096 => 0.3315, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.04% (0.2911 => 0.3116, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.03% (0.3258 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.01% (0.2780 => 0.2975, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3060 => 0.3274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.96% (0.3362 => 0.3596, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3267 => 0.3494, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (0.3930 => 0.4199, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3317 => 0.3541, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.3678 => 0.3926, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 6.67% (4.2109 => 4.4916, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3124 => 0.3332) SingleSource/Benchmarks/Shootout-C++/lists: 6.57% (0.3348 => 0.3568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3726 => 0.3970, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.51% (2.1013 => 2.2380, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 6.50% (0.3477 => 0.3703, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.48% (0.3625 => 0.3860, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.46% (0.3282 => 0.3494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.2736 => 0.2911, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (0.5026 => 0.5347, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 6.33% (0.4029 => 0.4284, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.31% (0.2566 => 0.2728, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.2866 => 0.3045, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.22% (0.4146 => 0.4404, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4251 => 0.4514, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3690 => 0.3916, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.09% (0.3890 => 0.4127, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.5900 => 0.6259, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (4.4195 => 4.6854, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.02% (0.4139 => 0.4388, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.3981 => 0.4219, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 5.97% (23.5202 => 24.9251, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 5.96% (4.6177 => 4.8931, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: 5.94% (0.9697 => 1.0273, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.86% (2.1653 => 2.2922, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.1968 => 0.2083, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 5.82% (1.8794 => 1.9887, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 5.78% (1.4269 => 1.5094, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.77% (0.3845 => 0.4067, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.77% (0.5012 => 0.5301, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.76% (0.3903 => 0.4128, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 5.58% (0.6634 => 0.7004, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.54% (1.9694 => 2.0786, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (1.9966 => 2.1066, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.6435 => 0.6789, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (0.4658 => 0.4910, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.41% (0.5546 => 0.5846, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 5.38% (0.7875 => 0.8299, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.25% (0.3084 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.3271 => 0.3442, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.19% (0.2737 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.15% (0.2969 => 0.3122, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.13% (0.2068 => 0.2174, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (0.2040 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.95% (0.2103 => 0.2207, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.92% (0.3336 => 0.3500, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 4.59% (2.0346 => 2.1280, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (0.2691 => 0.2813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3792 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.04% (0.4847 => 0.5043, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (0.5361 => 0.5563, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.72% (0.7426 => 0.7702, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.66% (0.3498 => 0.3626, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.46% (0.5584 => 0.5777, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.34% (0.4253 => 0.4395, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.19% (11.6398 => 12.0114, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.6926 => 4.8424, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.97% (11.9555 => 12.1915, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6786, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 5.16% (1.8057 => 1.8988, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1711, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6353, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2081, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5059, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4323, std.dev.: 0.0118) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2201, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5993, std.dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4511, std.dev.: 0.0455) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5692, std.dev.: 0.0183) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7902, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7454, std.dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5775, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9612, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 11:52:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 13:52:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120924185235.32F5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4198?compare_to=4193&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4198, Order: 164539, Start Time: 2012-09-24 17:38:07, End Time: 2012-09-24 18:54:07 To: 4193, Order: 164485, Start Time: 2012-09-24 11:53:05, End Time: 2012-09-24 13:07:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (5 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 3 (75 on baseline) Performance Improvements: 1 (48 on baseline) Existing Failures: 74 (69 on baseline) Unchanged Tests: 892 (763 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.54% (0.1894 => 0.1999, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.11% (2.6723 => 2.7288, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.06% (3.6265 => 3.6650, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -4.76% (4.2836 => 4.0795, std.dev.: 0.0267) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.64% (1.0103 => 1.0168, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 0.55% (0.5853 => 0.5885, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: -0.72% (0.1660 => 0.1648, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.62% (0.1297 => 0.1331, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.67% (0.2848 => 0.2924, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.55% (0.2196 => 0.2118, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.10% (0.2893 => 0.2896, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.43% (0.2088 => 0.2079, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -15.70% (0.0242 => 0.0204, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 23.29% (0.0073 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.35% (0.0074 => 0.0075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 33.10% (0.0145 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.57% (0.0318 => 0.0313, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.48% (0.0293 => 0.0233, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 15.04% (0.0246 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.00% (0.0300 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0180 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 60.00% (0.0120 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 30.67% (0.0075 => 0.0098, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1437 => 0.1438, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: -0.61% (0.2294 => 0.2280, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.46% (1.4800 => 1.5016, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1451 => 0.1450, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 1.29% (0.5893 => 0.5969, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.02% (26.7370 => 26.7412, std.dev.: 0.0985) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.18% (0.3981 => 0.4028, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1366 => 0.1389, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.23% (0.0568 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.29% (0.0196 => 0.0168, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.95% (0.0581 => 0.0633, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 4500.00% (0.0001 => 0.0046, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1311 => 1.1274, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0012 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.95% (0.0542 => 0.0558, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.26% (0.0151 => 0.0168, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.7646 => 0.7651, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: 66.67% (0.0003 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.10% (1.7065 => 1.7048, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2280, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -91.44% (6.9722 => 0.5969, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 21517.78% (0.1237 => 26.7412, std.dev.: 0.0985) MultiSource/Benchmarks/Prolangs-C++/city/city: -82.38% (0.0261 => 0.0046, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.71% (4.1772 => 3.1031, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/except: 81983.33% (0.0006 => 0.4925, std.dev.: 0.0052) SingleSource/Regression/C++/EH/ctor_dtor_count: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.10% (0.1414 => 0.1571, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.32% (0.1159 => 0.1267, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.95% (0.6410 => 0.6984, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 8.90% (2.1763 => 2.3699, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/bigfib: 6.97% (0.5309 => 0.5679, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.64% (1.0046 => 1.0713, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 6.58% (0.6173 => 0.6579, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.92% (0.3901 => 0.4132, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 5.82% (15.3105 => 16.2022, std.dev.: 0.1285) MultiSource/Applications/SIBsim4/SIBsim4: 5.72% (1.1653 => 1.2320, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.53% (0.3582 => 0.3780, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.37% (1.5150 => 1.5964, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.6915 => 0.7277, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.05% (0.2552 => 0.2681, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.59% (3.0225 => 3.1612, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.25% (0.7639 => 0.7964, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.4248 => 0.4422, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.07% (0.2654 => 0.2762, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.77% (0.6069 => 0.6298, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 3.73% (2.0972 => 2.1754, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 3.59% (13.3238 => 13.8027, std.dev.: 0.0941) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (8.2186 => 8.4995, std.dev.: 0.0328) MultiSource/Applications/oggenc/oggenc: 3.31% (4.7455 => 4.9026, std.dev.: 0.0470) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.17% (1.1672 => 1.2042, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.17% (29.3170 => 30.2462, std.dev.: 0.0865) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.17% (3.0758 => 3.1732, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.05% (1.2021 => 1.2388, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.05% (6.2546 => 6.4455, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.03% (1.4408 => 1.4844, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (12.6413 => 13.0220, std.dev.: 0.1006) MultiSource/Applications/Burg/burg: 2.88% (1.1440 => 1.1769, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.68% (0.8569 => 0.8799, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.0317 => 2.0846, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.54% (0.4562 => 0.4678, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.44% (1.8798 => 1.9256, std.dev.: 0.0178) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.0821 => 1.1083, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.1827 => 1.2103, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7722 => 0.7897, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4880 => 0.4989, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.2616 => 4.3427, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (4.0318 => 4.0929, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: 1.20% (3.8796 => 3.9262, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (4.3380 => 4.3886, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5560, std.dev.: 0.0297) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1433 => 0.1583, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.64% (0.8498 => 0.9317, std.dev.: 0.0202) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.32% (0.2694 => 0.2945, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.88% (1.0063 => 1.0957, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6127, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (0.3301 => 0.3533, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.23% (40.4792 => 43.0006, std.dev.: 0.5008) SingleSource/Benchmarks/Misc/dt: 4.56% (0.9851 => 1.0300, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.04% (2.8964 => 3.0135, std.dev.: 0.0343) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8326, std.dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.86% (0.7609 => 0.7903, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8716, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.83% (4.6127 => 4.7431, std.dev.: 0.0179) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8925, std.dev.: 0.0308) MultiSource/Applications/siod/siod: 2.65% (3.5520 => 3.6461, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/ReedSolomon: 2.42% (8.5113 => 8.7173, std.dev.: 0.0617) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.37% (2.6656 => 2.7288, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.36% (0.6308 => 0.6457, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4492, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.4455 => 2.4873, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.34% (1.2726 => 1.2897, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.16% (0.2996 => 0.1643, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.98% (1.4189 => 1.1354, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.64% (1.4113 => 1.1341, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.32% (0.3497 => 0.2052, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.54% (5.2665 => 4.0795, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/ary3: -20.39% (1.7473 => 1.3911, std.dev.: 0.0711) MultiSource/Benchmarks/FreeBench/mason/mason: -15.81% (0.5004 => 0.4213, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.22% (1.7361 => 1.4719, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -10.89% (0.3746 => 0.3338, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0519, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -8.40% (9.5474 => 8.7456, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9514, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -7.01% (7.6833 => 7.1446, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.82% (3.6254 => 3.3781, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3337, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8730, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -5.98% (1.4441 => 1.3578, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: -5.93% (0.2664 => 0.2506, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -5.68% (3.4230 => 3.2287, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/fib2: -5.18% (4.4195 => 4.1904, std.dev.: 0.0667) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -4.17% (62.4126 => 59.8125, std.dev.: 0.0585) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.90% (1.2722 => 1.2226, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.82% (1.1683 => 1.1237, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.28% (2.4457 => 2.3656, std.dev.: 0.0286) SingleSource/Benchmarks/McGill/misr: -3.17% (0.4296 => 0.4160, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -3.08% (8.5323 => 8.2692, std.dev.: 0.0968) SingleSource/Benchmarks/Shootout-C++/methcall: -3.06% (9.2503 => 8.9668, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8288, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (9.3855 => 9.1665, std.dev.: 0.0476) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.26% (3.7496 => 3.6650, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.8006, std.dev.: 0.4615) MultiSource/Benchmarks/sim/sim: -1.99% (3.8907 => 3.8133, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0088) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3630, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0067) MultiSource/Applications/lua/lua: -1.73% (29.5232 => 29.0114, std.dev.: 0.1235) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3073, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists: -1.39% (16.5617 => 16.3313, std.dev.: 0.0307) SingleSource/Benchmarks/Dhrystone/fldry: -1.08% (2.4971 => 2.4701, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: -1.03% (3.8200 => 3.7808, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.88% (0.9980 => 1.0168, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -2.27% (0.6022 => 0.5885, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: -1.08% (0.1666 => 0.1648, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.35% (0.1554 => 0.1331, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.16% (0.3083 => 0.2924, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.53% (0.2394 => 0.2118, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.79% (0.3175 => 0.2896, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.69% (0.2302 => 0.2079, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -54.57% (0.0449 => 0.0204, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.74% (0.0390 => 0.0313, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.59% (0.0301 => 0.0233, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -69.85% (0.0325 => 0.0098, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1429 => 0.1438, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -0.02% (1.5019 => 1.5016, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.40% (0.1501 => 0.1450, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.53% (0.4264 => 0.4028, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.35% (0.1344 => 0.1389, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.0589 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.59% (0.0232 => 0.0168, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.94% (0.0639 => 0.0633, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.67% (1.1350 => 1.1274, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.40% (0.0637 => 0.0558, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (0.0246 => 0.0168, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 10.97% (1.5363 => 1.7048, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 12:02:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 14:02:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120924190255.409652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4199?compare_to=4195&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4199, Order: 164539, Start Time: 2012-09-24 17:50:00, End Time: 2012-09-24 19:04:20 To: 4195, Order: 164485, Start Time: 2012-09-24 12:15:55, End Time: 2012-09-24 13:30:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.07% (0.9516 => 0.9618, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.61% (2.0176 => 2.4536, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.09% (0.1410 => 0.1651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 14.22% (0.2243 => 0.2562, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921) SingleSource/UnitTests/ObjC++/property-reference-object: 12.22% (0.5818 => 0.6529, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.97% (0.5748 => 0.6436, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.82% (1.3693 => 1.5312, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.55% (0.1013 => 0.1130) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1588 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.29% (3.9660 => 4.4139, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.28% (0.4328 => 0.4816, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.23% (0.7061 => 0.7854, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.2596 => 0.2875, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.75% (1.4563 => 1.6128, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.69% (1.2193 => 1.3497, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.68% (0.4062 => 0.4496, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.66% (0.7710 => 0.8532, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.65% (0.9199 => 1.0179, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.60% (0.7038 => 0.7784, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.43% (0.6959 => 0.7685, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.2721 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.32% (0.1327 => 0.1464, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.30% (0.3485 => 0.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.29% (0.3130 => 0.3452, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.23% (0.3899 => 0.4298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.13% (13.8202 => 15.2197, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.01% (0.4016 => 0.4418, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.01% (0.3578 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.99% (0.3623 => 0.3985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 9.97% (0.2607 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2760 => 0.3035, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.6283 => 0.6908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.93% (1.1364 => 1.2492, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3601 => 0.3957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.89% (1.9828 => 2.1788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3663 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.84% (0.4003 => 0.4397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.84% (0.2765 => 0.3037, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1986 => 0.2181, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.82% (0.3789 => 0.4161, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.81% (0.2937 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.78% (0.2761 => 0.3031, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.75% (0.3940 => 0.4324, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.73% (0.3914 => 0.4295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.69% (0.3868 => 0.4243, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.56% (0.3534 => 0.3872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.53% (0.2696 => 0.2953, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.47% (0.5577 => 0.6105, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.46% (0.3192 => 0.3494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.33% (0.1157 => 0.1265, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3453 => 0.3773, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.25% (0.4379 => 0.4784, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.21% (0.2127 => 0.2323, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.15% (1.0313 => 1.1257, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.09% (0.4390 => 0.4789, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.06% (0.3246 => 0.3540, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.02% (0.2995 => 0.3265, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.95% (0.4791 => 0.5220, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.89% (7.2180 => 7.8595, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: 8.80% (1.1061 => 1.2034, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 8.72% (16.6129 => 18.0613, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.68% (0.2914 => 0.3167, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.64% (0.6576 => 0.7144, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 8.58% (0.8310 => 0.9023, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 8.58% (0.7506 => 0.8150, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5637 => 0.6114, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.45% (0.3220 => 0.3492, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 8.32% (1.0594 => 1.1475, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.29% (0.8698 => 0.9419, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.20% (0.7460 => 0.8072, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 8.17% (3.1889 => 3.4493, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.2925 => 0.3163, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.12% (3.8646 => 4.1784, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 8.11% (1.9270 => 2.0833, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 8.10% (2.1791 => 2.3555, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1865 => 0.2015, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.96% (0.3755 => 0.4054, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.95% (0.6744 => 0.7280, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.73% (3.6692 => 3.9527, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.67% (8.4961 => 9.1481, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.58% (1.3245 => 1.4249, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.54% (0.3131 => 0.3367, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.50% (14.8535 => 15.9671, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.45% (4.4433 => 4.7742, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 7.41% (1.2749 => 1.3694, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.32% (4.3801 => 4.7009, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.29% (0.2140 => 0.2296, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.17% (0.6135 => 0.6575, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.94% (0.8818 => 0.9430, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.94% (1.1333 => 1.2119, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.85% (1.2292 => 1.3134, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2504 => 0.2671, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 6.59% (4.6629 => 4.9704, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.6250 => 0.6647, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.27% (3.2742 => 3.4794, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.10% (4.9865 => 5.2907, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.08% (0.4805 => 0.5097, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (6.5754 => 6.9710, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (6.2785 => 6.6459, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.79% (1.5188 => 1.6067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.3245 => 0.3430, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.65% (0.9108 => 0.9623, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.46% (3.7467 => 3.9514, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (13.2842 => 13.9974, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (2.1007 => 2.2108, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.2008 => 0.2112, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.90% (0.3511 => 0.3648, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.69% (16.2614 => 16.8613, std.dev.: 0.0256) MultiSource/Applications/ClamAV/clamscan: 3.17% (14.5298 => 14.9907, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2557, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (3.1736 => 3.4112, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7049, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.96% (10.7476 => 11.0656, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5839, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5838, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5975, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6861, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (8.8259 => 8.9146, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.53% (0.2670 => 0.1401, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.16% (1.3819 => 1.1862, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.08% (1.3813 => 1.1868, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -13.76% (0.4657 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.31% (22.5627 => 21.5906, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.22% (0.2238 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2948, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.54% (1.3780 => 1.3016, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8006, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.78% (0.9996 => 0.9618, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.34% (1.7688 => 1.7097, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9537, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.24% (1.9762 => 1.9319, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std.dev.: 0.0069) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0602, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7916, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -1.36% (1.2308 => 1.2140, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8710, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2294, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 12:06:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 14:06:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120924190638.141402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4200?compare_to=4196&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4200, Order: 164539, Start Time: 2012-09-24 17:49:58, End Time: 2012-09-24 19:08:06 To: 4196, Order: 164485, Start Time: 2012-09-24 12:20:10, End Time: 2012-09-24 13:38:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 2 (153 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 946 (688 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (54.5154 => 55.7532, std.dev.: 0.4205) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.11% (0.9549 => 0.9655, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.01% (15.2605 => 14.8006, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5766 => 0.5767, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 0.11% (16.0556 => 16.0726, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 0.02% (14.9125 => 14.9158, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -0.08% (54.0596 => 54.0138, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3330 => 4.3356, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2357 => 1.2362, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.5171 => 7.5217, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.14% (0.7225 => 0.7215, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2071 => 0.2071, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.59% (63.2438 => 54.0138, std.dev.: 0.0150) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.23% (3.4629 => 5.4794, std.dev.: 0.0046) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14241.11% (0.0720 => 10.3256, std.dev.: 0.0042) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.51% (0.2554 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 42.76% (10.3673 => 14.8006, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 30.09% (0.1622 => 0.2110, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.77% (2.2022 => 2.5495, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.25% (7.0540 => 8.1297, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.85% (0.3473 => 0.3954, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.63% (0.3543 => 0.4026, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3497 => 0.3971, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.51% (0.3561 => 0.4042, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.15% (0.1566 => 0.1772, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3694 => 0.4178, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.68% (0.3927 => 0.4425, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 12.51% (0.3886 => 0.4372, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.70% (1.7609 => 1.9669, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.55% (10.4361 => 11.6417, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 10.66% (0.3282 => 0.3632, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.48% (0.1584 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.96% (0.1440 => 0.1569, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.76% (0.5925 => 0.6444, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.46% (9.4845 => 10.2873, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.22% (0.1655 => 0.1791, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.4879 => 0.5275, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.98% (1.5415 => 1.6645, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 7.93% (3.3354 => 3.5998, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 7.81% (5.7591 => 6.2087, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2271 => 0.2447, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.73% (0.7115 => 0.7665, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.69% (0.4615 => 0.4970, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (8.1363 => 8.7620, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7326 => 0.7883, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.60% (0.3423 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.51% (0.6675 => 0.7176, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.49% (0.3109 => 0.3342, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.49% (0.5860 => 0.6299, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.41% (1.3050 => 1.4017, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.40% (0.8172 => 0.8777, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.33% (0.2700 => 0.2898, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7433 => 0.7978, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1510 => 0.1619, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (4.2646 => 4.5681, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.11% (4.9449 => 5.2963, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.09% (5.0018 => 5.3562, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5569 => 0.5963, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.03% (0.2758 => 0.2952, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.03% (0.9765 => 1.0451, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 6.96% (0.7835 => 0.8380, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.92% (0.8067 => 0.8625, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.91% (7.9617 => 8.5119, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.88% (0.2107 => 0.2252, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.3121 => 0.3333, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.61% (0.3387 => 0.3611, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.52% (0.5105 => 0.5438, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.46% (1.1642 => 1.2394, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 6.40% (1.5603 => 1.6601, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 6.34% (0.3422 => 0.3639, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.31% (21.9371 => 23.3219, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.28% (0.3441 => 0.3657, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.16% (0.5020 => 0.5329, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.12% (1.1861 => 1.2587, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.07% (0.6456 => 0.6848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.02% (3.8723 => 4.1054, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.98% (0.2891 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.4103 => 0.4347, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.89% (0.3650 => 0.3865, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4289 => 0.4539, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.82% (0.3180 => 0.3365, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.81% (0.4203 => 0.4447, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.78% (1.0722 => 1.1342, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 5.69% (0.3232 => 0.3416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.69% (0.3865 => 0.4085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2831 => 0.2992, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2603 => 0.2751, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.67% (2.0273 => 2.1422, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.61% (0.3817 => 0.4031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2756 => 0.2909, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.49% (0.3826 => 0.4036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.4048 => 0.4270, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.47% (0.2725 => 0.2874, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.46% (0.4636 => 0.4889, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.45% (0.3136 => 0.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3283 => 0.3462, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6450 => 0.6800, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.38% (0.3603 => 0.3797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.37% (0.3052 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.34% (2.0665 => 2.1769, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2871 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.33% (0.2872 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.33% (0.3098 => 0.3263, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.28% (0.5981 => 0.6297, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.28% (0.3162 => 0.3329, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.26% (0.2793 => 0.2940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.26% (0.8921 => 0.9390, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2877 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.25% (0.2802 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.17% (0.4620 => 0.4859, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.16% (0.3684 => 0.3874, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 5.00% (2.2969 => 2.4118, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.93% (1.5859 => 1.6641, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.91% (0.3379 => 0.3545, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.4186 => 1.4849, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.35% (1.1840 => 1.2355, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.26% (2.2024 => 2.2963, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.4064 => 0.4222, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.80% (1.2842 => 1.3330, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.54% (0.8101 => 0.8388, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 3.51% (0.3131 => 0.3241, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.41% (0.3427 => 0.3544, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (14.3668 => 14.8370, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.93% (17.1811 => 17.6841, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.43% (1.1194 => 1.1466, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.63% (3.8922 => 3.9558, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.57% (5.3999 => 13.3147, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3853, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7671, std.dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (0.8275 => 0.8406, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2505, std.dev.: 0.0276) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8076, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5753, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.28% (5.2763 => 3.2563, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.25% (5.3855 => 3.6485, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.94% (5.3526 => 3.6428, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1411, std.dev.: 0.0242) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.46% (2.9384 => 2.6018, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -10.27% (22.1758 => 19.8975, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.34% (1.6925 => 1.4160, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.30% (0.2161 => 0.1960, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2979, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5971, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4969, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.03% (0.9957 => 0.9655, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -2.47% (1.2373 => 1.2068, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1705, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9895, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0893, std.dev.: 0.0161) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5073, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.75% (8.6802 => 8.5281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.29% (0.5229 => 0.5767, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 7.23% (14.9895 => 16.0726, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 5.37% (14.1553 => 14.9158, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 5.48% (4.1105 => 4.3356, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.89% (1.1048 => 1.2362, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.08% (7.1582 => 7.5217, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.96% (0.6222 => 0.7215, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.13% (0.2116 => 0.2071, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 13:24:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 15:24:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120924202444.29B742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4201?compare_to=4198&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4201, Order: 164545, Start Time: 2012-09-24 19:10:27, End Time: 2012-09-24 20:26:16 To: 4198, Order: 164539, Start Time: 2012-09-24 17:38:07, End Time: 2012-09-24 18:54:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (5 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 19 (80 on baseline) Performance Improvements: 0 (49 on baseline) Existing Failures: 74 (69 on baseline) Unchanged Tests: 877 (757 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.93% (1.2847 => 1.3223, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 2.75% (0.9336 => 0.9593, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5684 => 0.5833, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.7410 => 0.7598, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.1083 => 1.1344, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2103 => 1.2369, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8555 => 0.8738, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 2.08% (16.2022 => 16.5384, std.dev.: 0.0689) MultiSource/Applications/minisat/minisat: 1.70% (0.6579 => 0.6691, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.51% (3.6702 => 3.7257, std.dev.: 0.0150) MultiSource/Benchmarks/PAQ8p/paq8p: 1.35% (2.3699 => 2.4020, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.5964 => 1.6168, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.09% (30.2462 => 30.5747, std.dev.: 0.0448) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 9.03% (3.0536 => 3.3292, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.74% (4.4097 => 4.5304, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.78% (2.3656 => 2.4078, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 1.53% (8.7173 => 8.8507, std.dev.: 0.0256) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.42% (4.0795 => 4.1373, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/em3d/em3d: 1.20% (4.6837 => 4.7400, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: - (1.0168 => 1.0168, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.5885 => 0.5882, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -2.85% (0.1648 => 0.1601, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.15% (0.1331 => 0.1329, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.37% (0.2924 => 0.2884, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.2118 => 0.2217, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (0.2896 => 0.3000, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.77% (0.2079 => 0.2095, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 9.80% (0.0204 => 0.0224, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -10.00% (0.0090 => 0.0081, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -34.67% (0.0075 => 0.0049, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.55% (0.0193 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.10% (0.0313 => 0.0354, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.75% (0.0233 => 0.0293, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0283 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0327 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0179 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.56% (0.0192 => 0.0189, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.19% (0.0253 => 0.0250, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -23.47% (0.0098 => 0.0075, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1438 => 0.1446, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 0.09% (0.2280 => 0.2282, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: -1.06% (1.5016 => 1.4857, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1450 => 0.1449, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.01% (0.5969 => 0.5909, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.45% (26.7412 => 26.8606, std.dev.: 0.0767) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4028 => 0.4060, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.02% (0.1389 => 0.1417, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.57% (0.0561 => 0.0541, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.74% (0.0168 => 0.0181, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.90% (0.0633 => 0.0602, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: -97.83% (0.0046 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.35% (1.1274 => 1.1235, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0016 => 0.0012, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.33% (0.0558 => 0.0571, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0168 => 0.0168, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7651 => 0.7654, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.10% (1.7048 => 1.7065, std.dev.: 0.0141) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2282, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: -91.52% (6.9722 => 0.5909, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 21614.31% (0.1237 => 26.8606, std.dev.: 0.0767) MultiSource/Benchmarks/Prolangs-C++/city/city: -99.62% (0.0261 => 0.0001, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.65% (4.1772 => 3.1059, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 25.00% (0.0004 => 0.0005, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.56% (0.0745 => 0.0928, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 10.37% (2.1763 => 2.4020, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.01% (0.1159 => 0.1275, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.69% (0.1414 => 0.1551, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.83% (0.6410 => 0.6976, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 8.39% (0.6173 => 0.6691, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 8.04% (0.5309 => 0.5736, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 8.02% (15.3105 => 16.5384, std.dev.: 0.0689) MultiSource/Applications/SIBsim4/SIBsim4: 7.30% (1.1653 => 1.2504, std.dev.: 0.0096) MultiSource/Applications/lemon/lemon: 7.19% (1.0046 => 1.0768, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.72% (1.5150 => 1.6168, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.64% (0.3901 => 0.4160, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.39% (0.3582 => 0.3811, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 6.23% (0.6915 => 0.7346, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.2797 => 0.2962, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 5.67% (3.0225 => 3.1938, std.dev.: 0.0215) MultiSource/Applications/siod/siod: 5.45% (2.0972 => 2.2114, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.15% (0.7226 => 0.7598, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.04% (0.3217 => 0.3379, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.92% (0.7639 => 0.8015, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 4.87% (13.3238 => 13.9730, std.dev.: 0.0705) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.0821 => 1.1344, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 4.72% (4.7455 => 4.9693, std.dev.: 0.0746) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.1827 => 1.2369, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4248 => 0.4440, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1672 => 1.2179, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 4.29% (29.3170 => 30.5747, std.dev.: 0.0448) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (1.0689 => 1.1138, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: 4.12% (1.1440 => 1.1911, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (8.2186 => 8.5514, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 3.96% (0.8405 => 0.8738, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.96% (0.2654 => 0.2759, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.91% (1.8798 => 1.9533, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (12.6413 => 13.1203, std.dev.: 0.0653) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.2742 => 1.3223, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.63% (0.8569 => 0.8880, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 3.63% (14.7256 => 15.2595, std.dev.: 0.1264) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.57% (6.2546 => 6.4779, std.dev.: 0.0207) MultiSource/Benchmarks/sim/sim: 3.57% (0.3084 => 0.3194, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 3.55% (3.5980 => 3.7257, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.50% (0.5636 => 0.5833, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.27% (1.2021 => 1.2414, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.22% (0.5963 => 0.6155, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 3.03% (1.3268 => 1.3670, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (4.2616 => 4.3737, std.dev.: 0.0192) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.7722 => 0.7917, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.40% (4.3380 => 4.4419, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.2815 => 4.3661, std.dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 1.78% (0.9425 => 0.9593, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.77% (0.0263 => 0.0386, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.88% (0.0766 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 14.73% (1.7426 => 1.9993, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (4.0101 => 4.5524, std.dev.: 0.0594) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.35% (0.2857 => 0.3124, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.54% (7.0025 => 7.6008, std.dev.: 0.0155) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.20% (0.2694 => 0.2915, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.81% (1.0063 => 1.0849, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.54% (4.2129 => 4.5304, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.10% (0.7609 => 0.8073, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3301 => 0.3493, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.49% (0.9851 => 1.0293, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8489, std.dev.: 0.0572) SingleSource/Benchmarks/Misc/ReedSolomon: 3.99% (8.5113 => 8.8507, std.dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (6.6312 => 6.8728, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: 3.52% (3.2159 => 3.3292, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.91% (14.4877 => 14.9087, std.dev.: 0.0332) MultiSource/Applications/siod/siod: 2.85% (3.5520 => 3.6534, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.79% (2.6656 => 2.7400, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/em3d/em3d: 2.12% (4.6414 => 4.7400, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/dry: 2.09% (2.4013 => 2.4514, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.71% (4.6127 => 4.6916, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.16% (2.9152 => 2.9490, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.08% (27.1724 => 27.4659, std.dev.: 0.0752) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.13% (0.2996 => 0.1674, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.62% (1.4189 => 1.1263, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.78% (1.4113 => 1.1322, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.44% (5.2665 => 4.1373, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary3: -20.31% (1.7473 => 1.3925, std.dev.: 0.0288) MultiSource/Benchmarks/FreeBench/mason/mason: -16.71% (0.5004 => 0.4168, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.17% (1.7361 => 1.4728, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: -11.56% (0.3746 => 0.3313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.62% (1.1647 => 1.0527, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7513, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.57% (3.2007 => 2.9585, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3771, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: -6.79% (7.6833 => 7.1615, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/fibo: -6.43% (4.6355 => 4.3373, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.41% (2.0027 => 1.8743, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -6.16% (1.4441 => 1.3552, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.54% (3.6023 => 3.4028, std.dev.: 0.0658) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (3.4230 => 3.2400, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1896, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.98% (0.4140 => 0.3934, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.69% (1.2959 => 1.2351, std.dev.: 0.0181) MultiSource/Benchmarks/mafft/pairlocalalign: -4.18% (62.4126 => 59.8030, std.dev.: 0.2057) MultiSource/Benchmarks/FreeBench/distray/distray: -4.02% (0.2664 => 0.2557, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.79% (1.2722 => 1.2240, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.50% (1.1683 => 1.1274, std.dev.: 0.0120) SingleSource/Benchmarks/McGill/misr: -3.35% (0.4296 => 0.4152, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.08% (3.7496 => 3.6340, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9786, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std.dev.: 0.0069) MultiSource/Applications/aha/aha: -2.06% (3.4286 => 3.3580, std.dev.: 0.0118) MultiSource/Benchmarks/PAQ8p/paq8p: -1.99% (92.7467 => 90.8972, std.dev.: 0.2288) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4198, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -1.68% (3.8907 => 3.8255, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -1.61% (1.0926 => 1.0750, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2345, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.55% (2.4457 => 2.4078, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.49% (1.4021 => 1.3812, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3159, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: -1.34% (16.5617 => 16.3400, std.dev.: 0.0670) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.31% (61.1734 => 60.3698, std.dev.: 0.0604) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.88% (0.9980 => 1.0168, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -2.32% (0.6022 => 0.5882, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -3.90% (0.1666 => 0.1601, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.48% (0.1554 => 0.1329, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (0.3083 => 0.2884, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.39% (0.2394 => 0.2217, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.51% (0.3175 => 0.3000, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.99% (0.2302 => 0.2095, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -50.11% (0.0449 => 0.0224, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -10.00% (0.0090 => 0.0081, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -79.58% (0.0240 => 0.0049, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.23% (0.0390 => 0.0354, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.66% (0.0301 => 0.0293, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -76.92% (0.0325 => 0.0075, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1429 => 0.1446, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.08% (1.5019 => 1.4857, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.46% (0.1501 => 0.1449, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.43% (0.1344 => 0.1417, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.15% (0.0589 => 0.0541, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.98% (0.0232 => 0.0181, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.79% (0.0639 => 0.0602, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.01% (1.1350 => 1.1235, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.36% (0.0637 => 0.0571, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (0.0246 => 0.0168, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0141) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 13:32:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 15:32:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120924203216.E49692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4202?compare_to=4197&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4202, Order: 164539, Start Time: 2012-09-24 17:50:01, End Time: 2012-09-24 20:33:47 To: 4197, Order: 164485, Start Time: 2012-09-24 13:45:21, End Time: 2012-09-24 16:29:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (761 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.16% (113.7618 => 118.4908, std.dev.: 0.1116) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.29% (0.3469 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3442 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.98% (0.1063 => 0.1201, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.49% (0.3724 => 0.4189, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.00% (1.5932 => 1.7684, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5889 => 0.6424, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5826 => 0.6349, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.95% (2.7292 => 2.9461, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.83% (1.3152 => 1.4182, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.81% (3.5627 => 3.8408, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (1.6211 => 1.7476, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.51% (0.4994 => 0.5369, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 7.42% (0.7171 => 0.7703, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.40% (0.5000 => 0.5370, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2875 => 0.3083, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (0.2014 => 0.2159, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.11% (5.5417 => 5.9356, std.dev.: 0.0112) MultiSource/Applications/d/make_dparser: 7.06% (1.0781 => 1.1542, std.dev.: 0.0117) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.3004 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.01% (0.2725 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (0.3930 => 0.4205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.91% (0.2823 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.87% (0.2750 => 0.2939, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.86% (0.2813 => 0.3006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.83% (0.2738 => 0.2925, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.78% (0.2729 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (2.0673 => 2.2068, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 6.67% (0.9909 => 1.0570, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.66% (0.2792 => 0.2978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2803 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3096 => 0.3301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.62% (0.2780 => 0.2964, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2811 => 0.2997, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.61% (0.5026 => 0.5358, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.2911 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3267 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.50% (0.3890 => 0.4143, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.48% (0.3258 => 0.3469, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.47% (0.3678 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.44% (0.3060 => 0.3257, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.2068 => 0.2201, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.42% (4.2109 => 4.4812, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.40% (0.3362 => 0.3577, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.39% (2.1013 => 2.2356, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3317 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.35% (0.2566 => 0.2729, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.32% (0.2736 => 0.2909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.32% (0.3625 => 0.3854, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.5900 => 0.6272, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 6.25% (0.4029 => 0.4281, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.24% (0.3124 => 0.3319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.2866 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.13% (0.3477 => 0.3690, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.12% (0.3726 => 0.3954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.06% (0.3348 => 0.3551, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.03% (0.3282 => 0.3480, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.93% (0.9697 => 1.0272, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 5.92% (4.6177 => 4.8909, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 5.91% (23.5202 => 24.9094, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.89% (4.4195 => 4.6796, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 5.89% (0.4146 => 0.4390, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.87% (2.1653 => 2.2925, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 5.86% (0.6634 => 0.7023, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 5.86% (0.4251 => 0.4500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3690 => 0.3906, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.85% (0.4139 => 0.4381, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.2103 => 0.2225, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.76% (1.4269 => 1.5091, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.3903 => 0.4127, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 5.68% (1.8794 => 1.9862, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (0.4658 => 0.4918, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.53% (0.6435 => 0.6791, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.3981 => 0.4201, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.48% (1.9694 => 2.0774, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.46% (0.3845 => 0.4055, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.3084 => 0.3252, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (1.9966 => 2.1049, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 5.41% (0.5546 => 0.5846, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 5.33% (0.5012 => 0.5279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.3271 => 0.3443, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.17% (0.7875 => 0.8282, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2737 => 0.2878, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.00% (0.2040 => 0.2142, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.92% (0.2969 => 0.3115, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.86% (0.3336 => 0.3498, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.58% (2.0346 => 2.1277, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 4.38% (0.2691 => 0.2809, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 4.04% (0.4847 => 0.5043, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3792 => 0.3938, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.82% (0.7426 => 0.7710, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (0.5361 => 0.5563, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.24% (0.5584 => 0.5765, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.23% (0.3498 => 0.3611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.17% (4.6926 => 4.8415, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.15% (0.4253 => 0.4387, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (11.6398 => 12.0022, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 1.96% (11.9555 => 12.1900, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6630, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 4.98% (15.4430 => 16.2116, std.dev.: 0.0605) SingleSource/Benchmarks/Misc/flops-2: 4.35% (1.8057 => 1.8843, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6322, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2133, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5070, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4382, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5994, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5695, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8079, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8019, std.dev.: 0.0072) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.64% (0.6293 => 0.6127, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -2.55% (17.2379 => 16.7977, std.dev.: 0.1019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (16.2163 => 15.9810, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 13:53:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 15:53:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120924205319.783A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4203?compare_to=4200&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4203, Order: 164545, Start Time: 2012-09-24 19:36:50, End Time: 2012-09-24 20:54:50 To: 4200, Order: 164539, Start Time: 2012-09-24 17:49:58, End Time: 2012-09-24 19:08:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 948 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.41% (14.8006 => 15.3051, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.57% (0.5767 => 0.5800, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 0.31% (16.0726 => 16.1218, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 0.53% (14.9158 => 14.9944, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 0.14% (54.0138 => 54.0908, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 0.36% (4.3356 => 4.3510, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.23% (1.2362 => 1.2390, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.5217 => 7.5224, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.36% (0.7215 => 0.7241, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (0.2071 => 0.2104, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.47% (63.2438 => 54.0908, std.dev.: 0.0154) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.74% (3.4629 => 5.4970, std.dev.: 0.0098) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14248.19% (0.0720 => 10.3307, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.94% (0.2554 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 47.63% (10.3673 => 15.3051, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 29.78% (0.1622 => 0.2105, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.34% (2.2022 => 2.5620, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.80% (7.0540 => 8.1685, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3473 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3543 => 0.3992, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3516 => 0.3957, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.05% (1.7609 => 1.9731, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 11.28% (10.4361 => 11.6137, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.66% (0.3282 => 0.3632, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.17% (0.1440 => 0.1572, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.82% (0.1655 => 0.1801, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (9.4845 => 10.3177, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.50% (0.3177 => 0.3447, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.50% (1.5415 => 1.6725, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.30% (0.4879 => 0.5284, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 8.14% (0.3109 => 0.3362, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 8.10% (0.7115 => 0.7691, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.98% (5.7591 => 6.2187, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.4615 => 0.4983, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.94% (0.7326 => 0.7908, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.6675 => 0.7202, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.89% (1.3050 => 1.4080, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3423 => 0.3693, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.88% (0.2271 => 0.2450, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.87% (0.7433 => 0.8018, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1695 => 0.1827, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.74% (8.1363 => 8.7663, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 7.71% (3.3354 => 3.5925, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2700 => 0.2907, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.61% (0.5860 => 0.6306, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.57% (4.2646 => 4.5876, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.44% (0.8172 => 0.8780, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.40% (0.2758 => 0.2962, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.34% (0.5569 => 0.5978, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.33% (0.9765 => 1.0481, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.25% (5.0018 => 5.3642, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2107 => 0.2258, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.14% (4.9449 => 5.2978, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: 7.11% (0.7835 => 0.8392, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.07% (0.8067 => 0.8637, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.02% (0.3121 => 0.3340, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.99% (0.5105 => 0.5462, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.94% (0.3387 => 0.3622, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.91% (7.9617 => 8.5122, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.91% (0.1940 => 0.2074, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.77% (1.1642 => 1.2430, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 6.63% (1.5603 => 1.6638, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.1861 => 1.2637, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.49% (0.5020 => 0.5346, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.42% (0.3441 => 0.3662, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.40% (0.4299 => 0.4574, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.38% (3.8723 => 4.1195, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.35% (1.0722 => 1.1403, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.32% (0.6456 => 0.6864, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.17% (0.4103 => 0.4356, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.16% (2.0273 => 2.1522, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2891 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.05% (0.3865 => 0.4099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.04% (0.2831 => 0.3002, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2603 => 0.2760, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.99% (0.4289 => 0.4546, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.99% (21.9371 => 23.2511, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.97% (0.3650 => 0.3868, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.92% (0.4203 => 0.4452, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.78% (0.4048 => 0.4282, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.75% (0.6450 => 0.6821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2872 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3826 => 0.4044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.67% (0.4620 => 0.4882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (2.0665 => 2.1834, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.64% (0.3052 => 0.3224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.62% (0.2756 => 0.2911, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.62% (0.8921 => 0.9422, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.61% (0.2871 => 0.3032, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.57% (2.2969 => 2.4248, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.57% (0.5981 => 0.6314, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.57% (0.3162 => 0.3338, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.54% (0.4636 => 0.4893, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2802 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3603 => 0.3800, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.46% (0.2877 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.3684 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.27% (1.5859 => 1.6694, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.08% (1.4186 => 1.4906, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3817 => 0.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.84% (2.2024 => 2.3091, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.1840 => 1.2412, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.4064 => 0.4234, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.05% (1.2842 => 1.3362, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.64% (0.8101 => 0.8396, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (14.3668 => 14.8854, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.15% (17.1811 => 17.7220, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.44% (1.1194 => 1.1467, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.14% (3.8922 => 3.9756, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3826, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.40% (3.6395 => 3.7632, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2497, std.dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8080, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2620, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.05% (5.3855 => 3.6592, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.71% (5.3526 => 3.6553, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1641, std.dev.: 0.0241) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.32% (2.9384 => 2.6058, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.12% (22.1758 => 19.9321, std.dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -9.21% (0.2161 => 0.1962, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.17% (19.9488 => 18.3196, std.dev.: 0.0547) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1616, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.54% (0.9957 => 0.9605, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5098, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1713, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9864, std.dev.: 0.0258) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5050, std.dev.: 0.0118) SingleSource/Benchmarks/McGill/chomp: -1.92% (1.2373 => 1.2136, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0933, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2286, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.92% (0.5229 => 0.5800, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.55% (14.9895 => 16.1218, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 5.93% (14.1553 => 14.9944, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 5.85% (4.1105 => 4.3510, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.15% (1.1048 => 1.2390, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.09% (7.1582 => 7.5224, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.38% (0.6222 => 0.7241, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.57% (0.2116 => 0.2104, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 15:40:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 17:40:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120924224030.451CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4204?compare_to=4203&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4204, Order: 164553, Start Time: 2012-09-24 21:24:07, End Time: 2012-09-24 22:42:00 To: 4203, Order: 164545, Start Time: 2012-09-24 19:36:50, End Time: 2012-09-24 20:54:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 0 (155 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 949 (687 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5800 => 0.5792, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.22% (16.1218 => 16.1572, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 0.13% (14.9944 => 15.0133, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 0.07% (54.0908 => 54.1281, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.3510 => 4.3548, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2390 => 1.2398, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.5224 => 7.5332, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.7241 => 0.7247, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.10% (0.2104 => 0.2102, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.41% (63.2438 => 54.1281, std.dev.: 0.0169) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 59.09% (3.4629 => 5.5093, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14243.47% (0.0720 => 10.3273, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.98% (0.2554 => 0.3805, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 48.42% (10.3673 => 15.3873, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 30.39% (0.1622 => 0.2115, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.25% (2.2022 => 2.5600, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.70% (7.0540 => 8.1612, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.66% (0.1432 => 0.1642) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.73% (0.1566 => 0.1781, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.85% (1.7609 => 1.9695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3561 => 0.3975, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 11.60% (10.4361 => 11.6470, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 9.03% (0.1440 => 0.1570, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (9.4845 => 10.3367, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.78% (5.7591 => 6.2646, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.75% (0.3177 => 0.3455, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 8.56% (0.3423 => 0.3716, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.51% (0.4879 => 0.5294, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.35% (1.5415 => 1.6702, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 8.34% (0.7433 => 0.8053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.31% (0.7115 => 0.7706, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.22% (0.6675 => 0.7224, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.10% (0.2271 => 0.2455, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 8.06% (3.3354 => 3.6041, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 7.98% (0.3109 => 0.3357, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.93% (0.4615 => 0.4981, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.88% (0.1625 => 0.1753, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.85% (0.1695 => 0.1828, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.84% (1.3050 => 1.4073, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (8.1363 => 8.7571, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.61% (0.5860 => 0.6306, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (4.2646 => 4.5868, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.49% (0.8172 => 0.8784, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.48% (0.2700 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.39% (0.8067 => 0.8663, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.30% (0.9765 => 1.0478, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5569 => 0.5974, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 7.24% (0.7835 => 0.8402, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.23% (0.3387 => 0.3632, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.15% (5.0018 => 5.3596, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.15% (0.3121 => 0.3344, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.14% (0.2758 => 0.2955, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.09% (4.9449 => 5.2954, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.05% (0.5105 => 0.5465, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.96% (0.1940 => 0.2075, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.90% (1.1642 => 1.2445, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.84% (1.5603 => 1.6671, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.84% (0.3422 => 0.3656, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (7.9617 => 8.5036, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.69% (1.1861 => 1.2654, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.66% (0.3441 => 0.3670, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 6.61% (1.0722 => 1.1431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.54% (0.6456 => 0.6878, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 6.53% (3.8723 => 4.1252, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5020 => 0.5345, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.43% (0.4103 => 0.4367, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2891 => 0.3075, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.35% (0.4203 => 0.4470, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.27% (0.4289 => 0.4558, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.23% (0.2905 => 0.3086, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.23% (2.0273 => 2.1536, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.22% (0.2603 => 0.2765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.21% (0.3865 => 0.4105, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.19% (0.4299 => 0.4565, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.18% (0.4048 => 0.4298, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.14% (0.3650 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.07% (21.9371 => 23.2678, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.03% (0.3136 => 0.3325, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3603 => 0.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3162 => 0.3352, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.97% (0.4636 => 0.4913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.96% (2.2969 => 2.4337, std.dev.: 0.0179) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 5.90% (0.3052 => 0.3232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.88% (2.0665 => 2.1880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.87% (0.3098 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.87% (0.8921 => 0.9445, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.6450 => 0.6827, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2756 => 0.2917, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4620 => 0.4889, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.81% (0.2872 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.76% (0.2793 => 0.2954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.73% (0.3684 => 0.3895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.70% (0.2877 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2802 => 0.2960, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5981 => 0.6310, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.47% (1.5859 => 1.6727, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.12% (1.4186 => 1.4913, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.1840 => 1.2438, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.86% (2.2024 => 2.3094, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2842 => 1.3398, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.00% (0.3427 => 0.3564, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.8101 => 0.8424, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (14.3668 => 14.9143, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3817 => 0.3962, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.21% (17.1811 => 17.7323, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.40% (1.1194 => 1.1463, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.07% (3.8922 => 3.9728, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 148.01% (4.3953 => 10.9006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (3.6395 => 3.7658, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.24% (0.4162 => 0.4297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2811, std.dev.: 0.0295) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8068, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5745, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1294, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2643, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.14% (5.3855 => 3.6544, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.78% (5.3526 => 3.6515, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1920, std.dev.: 0.0192) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.25% (2.9384 => 2.6079, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.07% (22.1758 => 19.9431, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.12% (0.2161 => 0.1964, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3001, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7114, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9957 => 0.9518, std.dev.: 0.0081) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5069, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.52% (1.2373 => 1.2061, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1708, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9852, std.dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5093, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0876, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5087, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.77% (0.5229 => 0.5792, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.79% (14.9895 => 16.1572, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 6.06% (14.1553 => 15.0133, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 5.94% (4.1105 => 4.3548, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.22% (1.1048 => 1.2398, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.24% (7.1582 => 7.5332, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.47% (0.6222 => 0.7247, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.66% (0.2116 => 0.2102, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 16:44:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 18:44:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120924234446.9BE7B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4205?compare_to=4202&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4205, Order: 164551, Start Time: 2012-09-24 21:02:37, End Time: 2012-09-24 23:46:16 To: 4202, Order: 164539, Start Time: 2012-09-24 17:50:01, End Time: 2012-09-24 20:33:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (761 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.59% (10.7570 => 10.9279, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.13% (1.5982 => 1.6163, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3446 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3469 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.90% (0.3496 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.85% (0.3442 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.79% (0.3460 => 0.3868, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.76% (0.1063 => 0.1188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.53% (0.3643 => 0.4063, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3650 => 0.4066, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.90% (1.5932 => 1.7669, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5826 => 0.6354, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.98% (0.5889 => 0.6418, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.58% (1.3152 => 1.4149, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7171 => 0.7707, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.43% (0.4994 => 0.5365, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2738 => 0.2941, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.41% (0.2875 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.38% (0.4361 => 0.4683, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2750 => 0.2953, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.38% (3.5627 => 3.8256, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.32% (2.7292 => 2.9289, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (1.6211 => 1.7396, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 7.29% (0.3004 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3195 => 0.3424, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.07% (0.2714 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.05% (0.2823 => 0.3022, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.04% (1.0781 => 1.1540, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.04% (0.5000 => 0.5352, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.04% (0.2813 => 0.3011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.04% (0.2729 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.96% (0.2803 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.95% (0.2792 => 0.2986, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 6.94% (0.9909 => 1.0597, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.2780 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.93% (2.0673 => 2.2105, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2811 => 0.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3096 => 0.3306, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.76% (5.5417 => 5.9161, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (0.3930 => 0.4194, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3267 => 0.3486, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3258 => 0.3476, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.67% (0.3060 => 0.3264, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.2911 => 0.3105, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.66% (0.3678 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.57% (0.3362 => 0.3583, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.55% (0.5026 => 0.5355, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3317 => 0.3533, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.50% (0.3124 => 0.3327, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.41% (4.2109 => 4.4807, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.40% (0.3625 => 0.3857, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 6.36% (0.3348 => 0.3561, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.36% (0.3726 => 0.3963, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.36% (2.1013 => 2.2349, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 6.33% (0.4029 => 0.4284, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.29% (0.5900 => 0.6271, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3282 => 0.3487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.24% (0.2566 => 0.2726, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.2736 => 0.2906, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 6.21% (0.3477 => 0.3693, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4146 => 0.4400, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (4.4195 => 4.6874, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (0.3890 => 0.4125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (0.4251 => 0.4507, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.2866 => 0.3038, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.93% (0.3690 => 0.3909, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.89% (4.6177 => 4.8896, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.82% (0.6634 => 0.7020, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 5.80% (23.5202 => 24.8849, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 5.69% (1.8794 => 1.9863, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.3845 => 0.4063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.65% (0.3981 => 0.4206, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.59% (0.3903 => 0.4121, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.2068 => 0.2183, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.53% (0.4139 => 0.4368, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.53% (2.1653 => 2.2850, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 5.49% (1.4269 => 1.5052, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.3084 => 0.3252, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 5.45% (0.5012 => 0.5285, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (0.4658 => 0.4910, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.2040 => 0.2150, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.38% (0.6435 => 0.6781, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.36% (0.5546 => 0.5843, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.28% (0.9697 => 1.0209, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.2737 => 0.2881, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.20% (1.9694 => 2.0718, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.3271 => 0.3441, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 5.13% (0.7875 => 0.8279, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (1.9966 => 2.0969, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 5.01% (0.3336 => 0.3503, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.95% (0.2103 => 0.2207, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.2969 => 0.3114, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 4.88% (2.0346 => 2.1338, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.81% (0.4847 => 0.5080, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.42% (0.2691 => 0.2810, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.39% (0.2391 => 0.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.04% (0.7426 => 0.7726, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.84% (0.5361 => 0.5567, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.64% (0.5584 => 0.5787, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.32% (11.6398 => 12.0259, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 3.29% (0.3498 => 0.3613, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.6926 => 4.8359, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.75% (0.4253 => 0.4370, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.74% (0.3792 => 0.3896, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.95% (11.9555 => 12.1887, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 5.25% (1.8057 => 1.9005, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1726, std.dev.: 0.1000) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6357, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2076, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5057, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4500, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2830, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6088, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5426, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/ary2: -10.41% (0.2402 => 0.2152, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8107, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/tsp/tsp: -7.14% (2.1113 => 1.9606, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7983, std.dev.: 0.0117) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.67% (0.6293 => 0.6125, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8309, std.dev.: 0.0409) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5724, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9690, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 16:46:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 18:46:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120924234612.3402E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4206?compare_to=4201&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4206, Order: 164560, Start Time: 2012-09-24 22:32:01, End Time: 2012-09-24 23:47:44 To: 4201, Order: 164545, Start Time: 2012-09-24 19:10:27, End Time: 2012-09-24 20:26:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 1 (10 on baseline) Performance Regressions: 11 (83 on baseline) Performance Improvements: 7 (45 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 878 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/city/city: 38500.00% (0.0001 => 0.0386, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.35% (0.5408 => 0.5589, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.65% (1.1263 => 1.1449, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 1.44% (6.6528 => 6.7486, std.dev.: 0.0194) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (1.2504 => 1.2667, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 3.52% (0.6612 => 0.6845, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.40% (14.2651 => 14.7501, std.dev.: 0.0848) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.93% (1.3812 => 1.4217, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.4078 => 2.4767, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.66% (1.1274 => 1.1461, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: 1.40% (2.3676 => 2.4007, std.dev.: 0.0124) MultiSource/Benchmarks/BitBench/five11/five11: 1.08% (5.1852 => 5.2412, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.74% (0.4677 => 0.4549, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.04% (0.7598 => 0.7443, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (2.4020 => 2.3567, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: -1.47% (1.1344 => 1.1177, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.34% (1.2179 => 1.2016, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.17% (1.3223 => 1.3068, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: -3.95% (2.5255 => 2.4258, std.dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.44% (1.0168 => 1.0123, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 0.56% (0.5882 => 0.5915, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 1.06% (0.1601 => 0.1618, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.30% (0.1329 => 0.1333, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.78% (0.2884 => 0.2993, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.61% (0.2217 => 0.2137, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.07% (0.3000 => 0.3002, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.29% (0.2095 => 0.2068, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: 26.79% (0.0224 => 0.0284, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -65.91% (0.0088 => 0.0030, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-11-VaListArg: 6.17% (0.0081 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 55.10% (0.0049 => 0.0076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.11% (0.0190 => 0.0167, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.73% (0.0354 => 0.0392, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.07% (0.0293 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.67% (0.0324 => 0.0270, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0178 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0250 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 32.00% (0.0075 => 0.0099, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1446 => 0.1442, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -0.13% (0.2282 => 0.2279, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.71% (1.4857 => 1.4009, std.dev.: 0.0760) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.04% (0.1449 => 0.1464, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.15% (0.5909 => 0.5900, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.61% (26.8606 => 26.6956, std.dev.: 0.1428) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.72% (0.4060 => 0.3990, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.07% (0.1417 => 0.1418, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.48% (0.0541 => 0.0549, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.66% (0.0181 => 0.0178, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.63% (0.0602 => 0.0660, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.76% (1.1235 => 1.1320, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.45% (0.0571 => 0.0557, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (0.0168 => 0.0159, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7654 => 0.7662, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7065 => 1.7064, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2279, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -91.54% (6.9722 => 0.5900, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 21480.92% (0.1237 => 26.6956, std.dev.: 0.1428) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.95% (1.1116 => 0.0006) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.98% (4.1772 => 3.0920, std.dev.: 0.0626) SingleSource/Benchmarks/Shootout-C++/except: 82666.67% (0.0006 => 0.4966, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.71% (0.1159 => 0.1260, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (1.1653 => 1.2667, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6410 => 0.6959, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 8.29% (2.1763 => 2.3567, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.5309 => 0.5748, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 7.42% (0.6173 => 0.6631, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 7.39% (15.3105 => 16.4420, std.dev.: 0.2835) MultiSource/Applications/lemon/lemon: 7.26% (1.0046 => 1.0775, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.42% (0.3582 => 0.3812, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.19% (0.2797 => 0.2970, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.33% (0.3901 => 0.4109, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.26% (1.5150 => 1.5947, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.11% (0.6069 => 0.6379, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 5.08% (4.7455 => 4.9867, std.dev.: 0.0380) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.6915 => 0.7252, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 4.87% (3.0225 => 3.1697, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.2552 => 0.2675, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.53% (3.0758 => 3.2151, std.dev.: 0.0500) MultiSource/Applications/JM/lencod/lencod: 4.53% (14.7256 => 15.3925, std.dev.: 0.0776) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.4248 => 0.4435, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.1827 => 1.2317, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (6.4908 => 6.7486, std.dev.: 0.0194) MultiSource/Applications/SPASS/SPASS: 3.92% (13.3238 => 13.8459, std.dev.: 0.1585) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2654 => 0.2757, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 3.82% (2.0972 => 2.1774, std.dev.: 0.0197) MultiSource/Benchmarks/Bullet/bullet: 3.76% (29.3170 => 30.4196, std.dev.: 0.1416) MultiSource/Applications/lua/lua: 3.70% (3.5980 => 3.7312, std.dev.: 0.0221) MultiSource/Benchmarks/McCat/09-vor/vor: 3.70% (0.3026 => 0.3138, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.59% (0.3062 => 0.3172, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (12.6413 => 13.0806, std.dev.: 0.0772) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.38% (1.2021 => 1.2427, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.2186 => 8.4947, std.dev.: 0.0565) MultiSource/Applications/Burg/burg: 3.36% (1.1440 => 1.1824, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4880 => 0.5041, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0821 => 1.1177, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (6.2546 => 6.4601, std.dev.: 0.0215) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.24% (0.8569 => 0.8847, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 3.05% (1.8798 => 1.9371, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8405 => 0.8658, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.7226 => 0.7443, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.1672 => 1.2016, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (4.2616 => 4.3708, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.2742 => 1.3068, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.52% (1.3268 => 1.3602, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.90% (0.5963 => 0.6076, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (4.0318 => 4.1048, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (4.3380 => 4.4066, std.dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.89% (0.0261 => 0.0386, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 16.19% (1.7426 => 2.0248, std.dev.: 0.0175) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.80% (4.0101 => 4.5634, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/queens: 10.96% (1.6261 => 1.8044, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.50% (0.2694 => 0.2977, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 9.06% (7.0025 => 7.6368, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.55% (0.8498 => 0.9140, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.39% (0.3301 => 0.3545, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.98% (1.0063 => 1.0765, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/bisort/bisort: 5.98% (0.6459 => 0.6845, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (2.5984 => 2.7375, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.40% (40.4792 => 42.2601, std.dev.: 0.4074) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.36% (0.7609 => 0.7941, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 4.02% (8.5113 => 8.8534, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 3.84% (15.2242 => 15.8082, std.dev.: 0.0731) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.27% (0.5876 => 0.6068, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 3.07% (3.5520 => 3.6609, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.97% (14.4877 => 14.9186, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.81% (2.6656 => 2.7404, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8096, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.60% (0.5587 => 0.5732, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 2.36% (2.3453 => 2.4007, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4013 => 2.4508, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (2.4455 => 2.4887, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.69% (4.6127 => 4.6905, std.dev.: 0.0287) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4396, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.4457 => 2.4767, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/em3d/em3d: 1.22% (4.6414 => 4.6979, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.05% (4.0659 => 4.1087, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -57.02% (0.0591 => 0.0254, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.83% (0.2996 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.39% (1.4113 => 1.1377, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.31% (1.4189 => 1.1449, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -5.72% (8.9977 => 8.4831, std.dev.: 0.1581) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.53% (5.2665 => 4.2377, std.dev.: 0.0627) SingleSource/Benchmarks/Shootout-C++/ary3: -19.25% (1.7473 => 1.4109, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/mason/mason: -16.67% (0.5004 => 0.4170, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.12% (1.7361 => 1.4736, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0195) MultiSource/Applications/sgefa/sgefa: -10.95% (0.3746 => 0.3336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.58% (1.1647 => 1.0531, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -8.47% (9.5474 => 8.7385, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.17% (3.2007 => 2.9391, std.dev.: 0.0358) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.83% (15.8312 => 14.7501, std.dev.: 0.0848) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3787, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -6.56% (7.6833 => 7.1795, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.32% (4.6355 => 4.3425, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/distray/distray: -6.04% (0.2664 => 0.2503, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -5.88% (1.4441 => 1.3592, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.05% (0.4140 => 0.3931, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -4.90% (4.4195 => 4.2029, std.dev.: 0.0311) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -4.86% (3.4230 => 3.2568, std.dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: -4.08% (62.4126 => 59.8631, std.dev.: 0.0513) SingleSource/Benchmarks/Shootout-C++/methcall: -3.73% (9.2503 => 8.9053, std.dev.: 0.0476) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (2.5166 => 2.4258, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8202, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.56% (3.7496 => 3.6535, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/neural/neural: -2.49% (1.0926 => 1.0654, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4183, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -1.96% (92.7467 => 90.9254, std.dev.: 0.2587) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.90% (1.1683 => 1.1461, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3639, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3132, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2328, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.56% (1.0686 => 1.0519, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3311, std.dev.: 0.0825) SingleSource/Benchmarks/Dhrystone/fldry: -1.20% (2.4971 => 2.4672, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: -1.19% (16.5617 => 16.3644, std.dev.: 0.0564) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.43% (0.9980 => 1.0123, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: -1.78% (0.6022 => 0.5915, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: -2.88% (0.1666 => 0.1618, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.22% (0.1554 => 0.1333, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.92% (0.3083 => 0.2993, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.74% (0.2394 => 0.2137, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (0.3175 => 0.3002, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.17% (0.2302 => 0.2068, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -36.75% (0.0449 => 0.0284, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-11-VaListArg: -4.44% (0.0090 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.02% (0.0192 => 0.0167, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.67% (0.0324 => 0.0270, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -69.54% (0.0325 => 0.0099, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.91% (0.1429 => 0.1442, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.72% (1.5019 => 1.4009, std.dev.: 0.0760) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.47% (0.1501 => 0.1464, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.43% (0.4264 => 0.3990, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.51% (0.1344 => 0.1418, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.79% (0.0589 => 0.0549, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.29% (0.0639 => 0.0660, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1350 => 1.1320, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.56% (0.0637 => 0.0557, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.37% (0.0246 => 0.0159, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7064, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 17:25:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 19:25:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925002505.425C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4207?compare_to=4199&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4207, Order: 164561, Start Time: 2012-09-24 23:12:05, End Time: 2012-09-25 00:26:34 To: 4199, Order: 164539, Start Time: 2012-09-24 17:50:00, End Time: 2012-09-24 19:04:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.85% (54.9496 => 56.5150, std.dev.: 0.0331) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.34% (2.0176 => 2.4482, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.16% (0.1410 => 0.1652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.87% (0.0819 => 0.0949, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 14.36% (0.2243 => 0.2565, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.39% (0.5818 => 0.6539, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.14% (0.5748 => 0.6446, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.02% (0.7061 => 0.7910, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.89% (0.1413 => 0.1581, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.66% (0.1072 => 0.1197, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.55% (0.1013 => 0.1130, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 11.51% (0.4328 => 0.4826, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.34% (1.3693 => 1.5246, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.27% (0.1588 => 0.1767, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.24% (3.9660 => 4.4119, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.22% (0.7710 => 0.8575, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.13% (0.4062 => 0.4514, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.94% (0.2596 => 0.2880, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.87% (0.2761 => 0.3061, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.85% (0.9199 => 1.0197, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.80% (0.7038 => 0.7798, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 10.78% (0.2690 => 0.2980, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.77% (1.4563 => 1.6131, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.70% (0.1327 => 0.1469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.64% (1.2193 => 1.3490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.63% (0.2607 => 0.2884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.60% (0.5265 => 0.5823, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.55% (0.2655 => 0.2935, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.53% (0.6959 => 0.7692, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 10.52% (0.2937 => 0.3246, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.49% (0.3899 => 0.4308, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.46% (0.2628 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.45% (1.9828 => 2.1901, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.42% (0.2765 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.40% (0.2760 => 0.3047, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.35% (0.3130 => 0.3454, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.26% (0.4016 => 0.4428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.23% (0.4390 => 0.4839, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.20% (0.2696 => 0.2971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.11% (0.3580 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.09% (0.3756 => 0.4135, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.07% (1.1364 => 1.2508, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.06% (0.6283 => 0.6915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.06% (0.3868 => 0.4257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.03% (0.3149 => 0.3465, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 10.01% (13.8202 => 15.2042, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 9.85% (0.3453 => 0.3793, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.68% (0.1157 => 0.1269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3192 => 0.3500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.54% (0.3534 => 0.3871, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.50% (0.1589 => 0.1740, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.49% (0.5577 => 0.6106, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.37% (0.2945 => 0.3221, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.37% (1.0313 => 1.1279, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.29% (0.4379 => 0.4786, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 9.28% (0.2995 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.18% (0.3246 => 0.3544, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.97% (1.1061 => 1.2053, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 8.86% (16.6129 => 18.0848, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3220 => 0.3505, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.83% (7.2180 => 7.8555, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.79% (0.2914 => 0.3170, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.77% (0.4791 => 0.5211, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.75% (0.5637 => 0.6130, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 8.74% (0.8310 => 0.9036, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.68% (0.3650 => 0.3967, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3663 => 0.3981, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.61% (0.3914 => 0.4251, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.59% (0.4003 => 0.4347, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.58% (0.8698 => 0.9444, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.55% (0.7506 => 0.8148, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.53% (0.1865 => 0.2024, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2023 => 0.2194, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.40% (0.7460 => 0.8087, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.39% (0.3755 => 0.4070, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.37% (3.8646 => 4.1880, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 8.33% (1.0594 => 1.1476, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 8.28% (3.1889 => 3.4531, std.dev.: 0.0119) MultiSource/Applications/siod/siod: 8.23% (2.1791 => 2.3584, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.2925 => 0.3165, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.14% (1.9270 => 2.0838, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 8.05% (0.6744 => 0.7287, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.94% (0.6576 => 0.7098, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.93% (3.6692 => 3.9601, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.71% (1.3245 => 1.4266, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 7.63% (0.3131 => 0.3370, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.61% (8.4961 => 9.1429, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.59% (14.8535 => 15.9805, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.42% (4.4433 => 4.7731, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 7.42% (1.2749 => 1.3695, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.40% (4.3801 => 4.7041, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.38% (0.2140 => 0.2298, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.1569 => 0.1683, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.26% (1.2292 => 1.3184, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.22% (0.6135 => 0.6578, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (1.1333 => 1.2138, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.98% (4.6629 => 4.9883, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.76% (0.8818 => 0.9414, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.75% (0.2504 => 0.2673, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.69% (0.6250 => 0.6668, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.53% (3.2742 => 3.4880, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.15% (4.9865 => 5.2933, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.4805 => 0.5100, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 6.06% (6.5754 => 6.9738, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.86% (0.3245 => 0.3435, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.81% (1.5188 => 1.6070, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.74% (0.9108 => 0.9631, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.71% (6.2785 => 6.6373, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (13.2842 => 14.0321, std.dev.: 0.0186) MultiSource/Applications/lua/lua: 5.54% (3.7467 => 3.9544, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.38% (2.1007 => 2.2138, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.78% (16.2614 => 16.8763, std.dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.5298 => 14.9964, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0029, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7053, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0780, std.dev.: 0.0140) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5917, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5849, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9228, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.49% (0.2670 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.77% (0.4657 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.96% (1.3819 => 1.1890, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.93% (1.3813 => 1.1889, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.21% (22.5627 => 21.6123, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.04% (0.0997 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -11.13% (0.2238 => 0.1989, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2840, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.48% (1.3780 => 1.3025, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.74% (0.9996 => 0.9522, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.37% (1.7688 => 1.7092, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9533, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2454, std.dev.: 0.0077) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0606, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6615 => 0.6506, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7913, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -1.21% (1.2308 => 1.2159, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2229, std.dev.: 0.0146) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 17:27:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 19:27:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925002722.844442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4208?compare_to=4204&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4208, Order: 164561, Start Time: 2012-09-24 23:10:56, End Time: 2012-09-25 00:28:53 To: 4204, Order: 164553, Start Time: 2012-09-24 21:24:07, End Time: 2012-09-24 22:42:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 3 (155 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 946 (687 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.05% (0.3933 => 0.4171, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (2.1880 => 2.2109, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.13% (78.6834 => 80.3624, std.dev.: 0.6242) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5792 => 0.5794, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.22% (16.1572 => 16.1220, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 0.38% (15.0133 => 15.0697, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 0.13% (54.1281 => 54.1992, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.3548 => 4.3543, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2398 => 1.2402, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.44% (7.5332 => 7.5666, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.55% (0.7247 => 0.7287, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.43% (0.2102 => 0.2072, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.30% (63.2438 => 54.1992, std.dev.: 0.0089) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.98% (3.4629 => 5.5052, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14239.44% (0.0720 => 10.3244, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.63% (0.2554 => 0.3796, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 47.08% (10.3673 => 15.2478, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 29.96% (0.1622 => 0.2108, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.12% (2.2022 => 2.5573, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.75% (7.0540 => 8.1649, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3473 => 0.3929, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.07% (0.0834 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3543 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3543 => 0.3993, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 12.66% (0.3561 => 0.4012, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3516 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.99% (0.3828 => 0.4287, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (1.7609 => 1.9697, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 11.27% (10.4361 => 11.6120, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.66% (0.3282 => 0.3632, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.97% (0.1625 => 0.1787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5925 => 0.6453, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 8.89% (0.1440 => 0.1568, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.75% (0.3177 => 0.3455, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 8.70% (9.4845 => 10.3100, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7326 => 0.7963, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.57% (0.4879 => 0.5297, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.44% (1.5415 => 1.6716, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.18% (0.7433 => 0.8041, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 8.16% (5.7591 => 6.2288, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5860 => 0.6334, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.03% (0.6675 => 0.7211, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.00% (0.4615 => 0.4984, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.96% (0.1695 => 0.1830, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.94% (0.7115 => 0.7680, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.93% (8.1363 => 8.7817, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3423 => 0.3692, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.84% (1.3050 => 1.4073, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.81% (3.3354 => 3.5960, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.79% (0.2271 => 0.2448, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.77% (0.7835 => 0.8444, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 7.75% (0.3109 => 0.3350, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.63% (0.3422 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.59% (0.2107 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.56% (0.2700 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.53% (0.3826 => 0.4114, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.49% (4.2646 => 4.5841, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.8172 => 0.8782, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.32% (5.0018 => 5.3680, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4289 => 0.4603, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.31% (0.9765 => 1.0479, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5569 => 0.5975, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.28% (4.9449 => 5.3049, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.26% (0.4203 => 0.4508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.25% (0.2758 => 0.2958, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.25% (0.4636 => 0.4972, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.17% (0.2872 => 0.3078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.12% (0.4103 => 0.4395, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.12% (0.8067 => 0.8641, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.11% (0.1940 => 0.2078, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.08% (0.6456 => 0.6913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.06% (0.3865 => 0.4138, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.04% (7.9617 => 8.5219, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.99% (2.0665 => 2.2109, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3121 => 0.3339, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3098 => 0.3313, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.93% (0.2871 => 0.3070, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.91% (0.5020 => 0.5367, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.88% (0.3603 => 0.3851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 6.88% (0.3387 => 0.3620, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.86% (0.3307 => 0.3534, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.85% (1.5603 => 1.6672, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.4048 => 0.4324, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2877 => 0.3073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5105 => 0.5450, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.73% (1.1642 => 1.2425, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.63% (0.3441 => 0.3669, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.1861 => 1.2632, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.49% (3.8723 => 4.1238, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4620 => 0.4918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.43% (0.3684 => 0.3921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.28% (0.4299 => 0.4569, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.28% (1.0722 => 1.1395, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.3180 => 0.3379, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.09% (21.9371 => 23.2735, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2603 => 0.2761, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.04% (2.0273 => 2.1497, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.6450 => 0.6827, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.63% (0.5981 => 0.6318, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 5.63% (2.2969 => 2.4263, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.8921 => 0.9415, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.4064 => 0.4278, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (1.5859 => 1.6675, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.90% (1.4186 => 1.4881, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.87% (0.3817 => 0.4003, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.87% (1.2842 => 1.3467, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.67% (1.1840 => 1.2393, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.64% (2.2024 => 2.3045, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.73% (0.8101 => 0.8403, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (14.3668 => 14.8881, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.62% (0.3427 => 0.3551, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.16% (17.1811 => 17.7248, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.85% (1.1194 => 1.1513, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (3.8922 => 3.9702, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.57% (5.3999 => 13.3147, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2143, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7627, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8080, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2385, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2679, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.95% (5.3855 => 3.6648, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.76% (5.3526 => 3.6527, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1878, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/mason/mason: -13.69% (0.0811 => 0.0700, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.26% (2.9384 => 2.6076, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -9.95% (22.1758 => 19.9690, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.86% (1.5373 => 1.3704, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/mason/mason: -9.07% (0.2161 => 0.1965) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2570, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.78% (1.5660 => 1.4912, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.39% (0.9957 => 0.9520, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1615, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -3.20% (1.2373 => 1.1977, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5071, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1735, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9865, std.dev.: 0.0172) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5039, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/salsa20: -2.01% (10.2830 => 10.0768, std.dev.: 0.0162) SingleSource/UnitTests/Vector/multiplies: -1.83% (2.5528 => 2.5060, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4198, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2322, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.81% (0.5229 => 0.5794, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.56% (14.9895 => 16.1220, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 6.46% (14.1553 => 15.0697, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.93% (4.1105 => 4.3543, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.26% (1.1048 => 1.2402, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.71% (7.1582 => 7.5666, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.12% (0.6222 => 0.7287, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.08% (0.2116 => 0.2072, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 18:23:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 20:23:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925012341.4CED42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4209?compare_to=4206&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4209, Order: 164571, Start Time: 2012-09-25 00:04:18, End Time: 2012-09-25 01:25:13 To: 4206, Order: 164560, Start Time: 2012-09-24 22:32:01, End Time: 2012-09-24 23:47:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (66 on baseline) Performance Improvements: 5 (45 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 888 (776 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.38% (0.2832 => 0.2956, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.28% (20.6070 => 22.7246, std.dev.: 0.0835) SingleSource/Benchmarks/Misc/mandel-2: 1.85% (3.0920 => 3.1493, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.3592 => 1.3734, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/lencod/lencod: -1.78% (15.3925 => 15.1187, std.dev.: 0.0876) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -9.94% (0.2977 => 0.2681, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.31% (1.4217 => 1.3178, std.dev.: 0.0269) MultiSource/Applications/SPASS/SPASS: -3.10% (8.5474 => 8.2826, std.dev.: 0.0841) SingleSource/Benchmarks/Shootout-C++/hash: -1.98% (0.6582 => 0.6452, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.44% (1.0123 => 1.0168, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.57% (0.5915 => 0.5822, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: 2.29% (0.1618 => 0.1655, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.00% (0.1333 => 0.1293, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.15% (0.2993 => 0.2839, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.19% (0.2137 => 0.2141, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.47% (0.3002 => 0.2988, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.77% (0.2068 => 0.2084, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 186.67% (0.0030 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 3.49% (0.0086 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.63% (0.0076 => 0.0074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 15.57% (0.0167 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.66% (0.0392 => 0.0311, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0302 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0285 => 0.0283, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.37% (0.0270 => 0.0325, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0180 => 0.0179, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -7.18% (0.0195 => 0.0181, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0251 => 0.0253, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -25.25% (0.0099 => 0.0074, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1442 => 0.1446, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 0.09% (0.2279 => 0.2281, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.36% (1.4009 => 1.4340, std.dev.: 0.0388) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.85% (0.1464 => 0.1535, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.02% (0.5900 => 0.5899, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.38% (26.6956 => 26.5941, std.dev.: 0.3069) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.48% (0.3990 => 0.4009, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.17% (0.1418 => 0.1373, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.28% (0.0549 => 0.0567, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.25% (0.0178 => 0.0182, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.03% (0.0660 => 0.0574, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1320 => 1.1245, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.90% (0.0557 => 0.0562, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.66% (0.0159 => 0.0150, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.7662 => 0.7650, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7064 => 1.7063, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2281, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -91.54% (6.9722 => 0.5899, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 21398.87% (0.1237 => 26.5941, std.dev.: 0.3069) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.61% (4.1772 => 3.1493, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0147) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.40% (0.1159 => 0.1268, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.34% (0.1414 => 0.1546, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.27% (0.6410 => 0.7004, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.56% (2.1763 => 2.3626, std.dev.: 0.0335) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.5309 => 0.5698, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 7.19% (15.3105 => 16.4106, std.dev.: 0.1393) MultiSource/Applications/minisat/minisat: 6.93% (0.6173 => 0.6601, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.92% (0.3582 => 0.3830, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 6.86% (1.1653 => 1.2452, std.dev.: 0.0127) MultiSource/Applications/lemon/lemon: 6.67% (1.0046 => 1.0716, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (1.5150 => 1.6100, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.72% (0.2552 => 0.2698, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.43% (0.3901 => 0.4113, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 5.12% (0.6915 => 0.7269, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.76% (0.2797 => 0.2930, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.58% (0.7639 => 0.7989, std.dev.: 0.0124) MultiSource/Applications/d/make_dparser: 4.27% (3.0225 => 3.1516, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.4248 => 0.4414, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.84% (0.2654 => 0.2756, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (1.1672 => 1.2116, std.dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: 3.63% (13.3238 => 13.8074, std.dev.: 0.1497) MultiSource/Benchmarks/Bullet/bullet: 3.58% (29.3170 => 30.3675, std.dev.: 0.1250) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.40% (0.5937 => 0.6139, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 3.33% (0.8405 => 0.8685, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (1.1827 => 1.2220, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 3.32% (1.3268 => 1.3708, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (12.6413 => 13.0458, std.dev.: 0.1356) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.15% (6.2546 => 6.4515, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.14% (1.2021 => 1.2399, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.11% (1.4408 => 1.4856, std.dev.: 0.0121) MultiSource/Applications/siod/siod: 3.02% (2.0972 => 2.1605, std.dev.: 0.0245) MultiSource/Applications/lua/lua: 2.93% (3.5980 => 3.7035, std.dev.: 0.0126) MultiSource/Applications/Burg/burg: 2.86% (1.1440 => 1.1767, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.7256 => 15.1187, std.dev.: 0.0876) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.0317 => 2.0857, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.41% (0.7226 => 0.7400, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.24% (4.0318 => 4.1220, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: 2.17% (1.8798 => 1.9206, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7722 => 0.7868, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (8.2559 => 8.3929, std.dev.: 0.0373) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0312) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5473, std.dev.: 0.0421) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.21% (0.0917 => 0.1029, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.96% (0.2857 => 0.3113, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 8.73% (7.0025 => 7.6138, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.22% (1.0063 => 1.0890, std.dev.: 0.0153) MultiSource/Benchmarks/nbench/nbench: 7.33% (21.1721 => 22.7246, std.dev.: 0.0835) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.33% (0.3301 => 0.3543, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 5.91% (0.6459 => 0.6841, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.41% (40.4792 => 42.6680, std.dev.: 0.4045) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8212, std.dev.: 0.0715) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.98% (14.4877 => 14.9199, std.dev.: 0.0271) MultiSource/Applications/siod/siod: 2.91% (3.5520 => 3.6552, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.70% (0.5587 => 0.5738, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8091, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.42% (0.5876 => 0.6018, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.28% (0.6308 => 0.6452, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.96% (2.6656 => 2.7179, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (2.4455 => 2.4892, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.6127 => 4.6943, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.01% (0.0591 => 0.0325, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.39% (0.2996 => 0.1666, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.17% (1.4113 => 1.1266, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.49% (1.4189 => 1.1424, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.35% (0.3497 => 0.2086, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.20% (5.2665 => 4.1499, std.dev.: 0.1719) SingleSource/Benchmarks/Shootout-C++/ary3: -17.23% (1.7473 => 1.4462, std.dev.: 0.0499) MultiSource/Benchmarks/FreeBench/mason/mason: -15.19% (0.5004 => 0.4244, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.08% (1.7361 => 1.4743, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.30% (0.0917 => 0.0795, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: -12.54% (3.6023 => 3.1507, std.dev.: 0.1324) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -10.50% (0.1114 => 0.0997, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0519, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.49% (1.4034 => 1.2842, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -8.30% (9.5474 => 8.7548, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.97% (3.2007 => 2.9457, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: -7.15% (7.6833 => 7.1342, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.6254 => 3.3796, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3333, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.01% (1.4021 => 1.3178, std.dev.: 0.0269) MultiSource/Applications/SIBsim4/SIBsim4: -5.90% (3.4230 => 3.2211, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1857, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: -4.92% (0.2664 => 0.2533, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -4.90% (1.4441 => 1.3734, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -4.90% (2.5166 => 2.3934, std.dev.: 0.0288) MultiSource/Benchmarks/mafft/pairlocalalign: -4.18% (62.4126 => 59.8011, std.dev.: 0.1468) SingleSource/Benchmarks/McGill/misr: -4.07% (0.4296 => 0.4121, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.80% (1.2722 => 1.2239, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9419, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.08% (3.9413 => 3.8200, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -2.93% (8.5323 => 8.2826, std.dev.: 0.0841) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.59% (3.7496 => 3.6523, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.37% (1.1683 => 1.1406, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -1.99% (1.0926 => 1.0709, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3618, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4198, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -1.71% (3.8907 => 3.8243, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2278, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3060, std.dev.: 0.0462) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.88% (0.9980 => 1.0168, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -3.32% (0.6022 => 0.5822, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: -0.66% (0.1666 => 0.1655, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.80% (0.1554 => 0.1293, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.91% (0.3083 => 0.2839, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.57% (0.2394 => 0.2141, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.89% (0.3175 => 0.2988, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.47% (0.2302 => 0.2084, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.17% (0.0240 => 0.0074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.26% (0.0390 => 0.0311, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -4.23% (0.0189 => 0.0181, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -77.23% (0.0325 => 0.0074, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1429 => 0.1446, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.52% (1.5019 => 1.4340, std.dev.: 0.0388) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.27% (0.1501 => 0.1535, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.98% (0.4264 => 0.4009, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.16% (0.1344 => 0.1373, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0589 => 0.0567, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.55% (0.0232 => 0.0182, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0639 => 0.0574, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.93% (1.1350 => 1.1245, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.77% (0.0637 => 0.0562, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.02% (0.0246 => 0.0150, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 19:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 21:08:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925020831.712592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4210?compare_to=4207&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4210, Order: 164577, Start Time: 2012-09-25 00:55:20, End Time: 2012-09-25 02:10:02 To: 4207, Order: 164561, Start Time: 2012-09-24 23:12:05, End Time: 2012-09-25 00:26:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.98% (2.0176 => 2.4610, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.02% (0.1410 => 0.1650, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 14.31% (0.2243 => 0.2564, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.58% (0.5818 => 0.6550, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.40% (0.5748 => 0.6461, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.11% (0.7061 => 0.7916, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.81% (0.4328 => 0.4839, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.75% (0.1013 => 0.1132, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.65% (0.2781 => 0.3105, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.54% (0.2782 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 11.49% (1.3693 => 1.5266, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.23% (3.9660 => 4.4114, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.22% (0.3022 => 0.3361, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.13% (0.4062 => 0.4514, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 11.12% (0.2607 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.02% (0.7710 => 0.8560, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.00% (0.0964 => 0.1070, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.98% (0.2760 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.97% (0.2690 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.96% (0.2655 => 0.2946, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: 10.96% (0.2628 => 0.2916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.94% (0.2761 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.93% (0.2937 => 0.3258, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.86% (0.2596 => 0.2878, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.86% (0.2966 => 0.3288, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.85% (0.2765 => 0.3065, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.85% (1.4563 => 1.6143, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.80% (0.3899 => 0.4320, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.75% (1.9828 => 2.1960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.71% (0.2726 => 0.3018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.66% (0.4016 => 0.4444, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.65% (0.9199 => 1.0179, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3489 => 0.3857, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.55% (1.2193 => 1.3479, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 10.51% (0.3149 => 0.3480, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.51% (0.3293 => 0.3639, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.46% (0.2696 => 0.2978, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.40% (0.2721 => 0.3004, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.40% (0.1327 => 0.1465, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (0.7038 => 0.7766, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 10.34% (0.2988 => 0.3297, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.33% (0.5265 => 0.5809, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.30% (0.3756 => 0.4143, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.30% (0.6959 => 0.7676, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 10.19% (0.3453 => 0.3805, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.12% (0.6283 => 0.6919, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 10.12% (0.3192 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.10% (0.3130 => 0.3446, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.93% (1.1364 => 1.2492, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 9.83% (13.8202 => 15.1790, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 9.76% (0.3534 => 0.3879, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.64% (0.3578 => 0.3923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.58% (0.2945 => 0.3227, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3601 => 0.3942, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3650 => 0.3992, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 9.32% (0.4003 => 0.4376, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.27% (0.5577 => 0.6094, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3789 => 0.4140, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 9.25% (0.1589 => 0.1736, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.18% (0.4379 => 0.4781, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 9.12% (0.2995 => 0.3268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.08% (1.0313 => 1.1249, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.08% (0.1157 => 0.1262, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.03% (0.3246 => 0.3539, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2127 => 0.2318, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.88% (16.6129 => 18.0876, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 8.80% (1.1061 => 1.2034, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.78% (7.2180 => 7.8517, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.66% (0.4791 => 0.5206, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 8.62% (0.8310 => 0.9026, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.57% (0.5637 => 0.6120, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 8.57% (0.7506 => 0.8149, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.51% (0.8698 => 0.9438, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.35% (0.2023 => 0.2192, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 8.32% (0.3220 => 0.3488, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.24% (0.7460 => 0.8075, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.2925 => 0.3163, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.09% (3.8646 => 4.1773, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 8.08% (0.6744 => 0.7289, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 8.08% (1.0594 => 1.1450, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 8.07% (1.9270 => 2.0825, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 8.06% (3.1889 => 3.4459, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.96% (2.1791 => 2.3525, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.94% (3.6692 => 3.9606, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.2140 => 0.2305, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.63% (0.6576 => 0.7078, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.58% (1.3245 => 1.4249, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.58% (14.8535 => 15.9790, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.55% (8.4961 => 9.1373, std.dev.: 0.0161) MultiSource/Benchmarks/sim/sim: 7.44% (0.3131 => 0.3364, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.44% (1.2292 => 1.3206, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 7.37% (1.2749 => 1.3688, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.35% (4.3801 => 4.7020, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.31% (4.4433 => 4.7679, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.99% (0.6135 => 0.6564, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.94% (0.8818 => 0.9430, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.91% (1.1333 => 1.2116, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 6.75% (0.6250 => 0.6672, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.63% (0.2504 => 0.2670, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.61% (4.6629 => 4.9711, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.54% (3.2742 => 3.4883, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.4805 => 0.5100, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.09% (4.9865 => 5.2904, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 6.04% (6.5754 => 6.9727, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.86% (6.2785 => 6.6462, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.79% (1.5188 => 1.6068, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.73% (0.3245 => 0.3431, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.69% (0.9108 => 0.9626, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.48% (3.7467 => 3.9519, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (13.2842 => 14.0055, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.42% (2.1007 => 2.2145, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/oourafft: 5.13% (0.2008 => 0.2111, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3511 => 0.3664, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 3.69% (16.2614 => 16.8608, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 3.31% (14.5298 => 15.0102, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 25.12% (1.8175 => 2.2741, std.dev.: 0.0362) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3798, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.92% (2.8606 => 3.0013, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.3458 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7060, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.57% (10.7476 => 11.1311, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5966, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6002, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.42% (0.2670 => 0.1404, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.03% (1.3819 => 1.1880, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.97% (1.3813 => 1.1884, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.33% (22.5627 => 21.5849, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2918, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.48% (1.3780 => 1.2887, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.84% (0.9996 => 0.9512, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0144) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9535, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2463, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7920, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1159, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -1.17% (1.2308 => 1.2164, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2292, std.dev.: 0.0301) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4313, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 19:14:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 21:14:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925021458.4B28F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4211?compare_to=4208&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4211, Order: 164578, Start Time: 2012-09-25 00:58:18, End Time: 2012-09-25 02:16:29 To: 4208, Order: 164561, Start Time: 2012-09-24 23:10:56, End Time: 2012-09-25 00:28:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 1 (151 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 947 (692 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.10% (55.2228 => 56.3805, std.dev.: 0.0616) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.92% (0.7963 => 0.7810, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.33% (0.5794 => 0.5775, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -0.22% (16.1220 => 16.0867, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: -0.43% (15.0697 => 15.0055, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -0.37% (54.1992 => 53.9973, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: -0.23% (4.3543 => 4.3444, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2402 => 1.2393, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.68% (7.5666 => 7.5153, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.48% (0.7287 => 0.7252, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.10% (0.2072 => 0.2070, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.62% (63.2438 => 53.9973, std.dev.: 0.0076) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.43% (3.4629 => 5.4863, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14244.58% (0.0720 => 10.3281, std.dev.: 0.0029) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.45% (0.2554 => 0.3766, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 45.68% (10.3673 => 15.1029, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/distray/distray: 30.21% (0.1056 => 0.1375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 28.98% (0.1622 => 0.2092, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.47% (2.2022 => 2.5649, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.56% (7.0540 => 8.1515, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.92% (1.7609 => 1.9708, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 11.23% (0.3694 => 0.4109, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 10.82% (10.4361 => 11.5655, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.60% (0.3282 => 0.3630, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.00% (0.3177 => 0.3463, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 8.46% (9.4845 => 10.2867, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.30% (0.4879 => 0.5284, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.16% (1.5415 => 1.6673, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.99% (5.7591 => 6.2192, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 7.83% (0.7115 => 0.7672, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 7.76% (0.7433 => 0.8010, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 7.75% (0.3109 => 0.3350, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.71% (0.4615 => 0.4971, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2271 => 0.2446, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.62% (1.3050 => 1.4044, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.61% (0.5569 => 0.5993, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 7.60% (0.3423 => 0.3683, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.60% (0.6675 => 0.7182, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.57% (3.3354 => 3.5880, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.55% (0.1510 => 0.1624) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.45% (0.1625 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.42% (0.5860 => 0.6295, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.41% (0.5925 => 0.6364, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.6030 => 0.6476, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (4.2646 => 4.5784, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (8.1363 => 8.7302, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2700 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.8172 => 0.8768, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.18% (0.9765 => 1.0466, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.06% (5.0018 => 5.3550, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 7.05% (0.7835 => 0.8387, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.99% (4.9449 => 5.2904, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.93% (0.2107 => 0.2253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2758 => 0.2949, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.91% (0.1940 => 0.2074, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3422 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.82% (0.8067 => 0.8617, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 6.76% (0.3387 => 0.3616, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.71% (7.9617 => 8.4956, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.70% (0.3121 => 0.3330, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.64% (0.4203 => 0.4482, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.62% (0.5105 => 0.5443, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.61% (0.7326 => 0.7810, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 6.61% (1.1642 => 1.2411, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.52% (0.3865 => 0.4117, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.51% (0.5020 => 0.5347, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.46% (0.6456 => 0.6873, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.46% (0.4103 => 0.4368, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4636 => 0.4935, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.44% (1.5603 => 1.6608, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.30% (0.4048 => 0.4303, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.29% (3.8723 => 4.1160, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (1.1861 => 1.2604, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.2831 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3650 => 0.3878, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.22% (0.3603 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.18% (1.0722 => 1.1385, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.14% (2.0665 => 2.1934, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.10% (0.3098 => 0.3287, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 6.09% (0.4299 => 0.4561, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3826 => 0.4056, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.01% (0.3180 => 0.3371, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3283 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2603 => 0.2759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.95% (0.3162 => 0.3350, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.86% (2.0273 => 2.1462, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 5.85% (21.9371 => 23.2215, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4620 => 0.4889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.75% (0.3684 => 0.3896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.54% (2.2969 => 2.4241, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.50% (0.6450 => 0.6805, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 5.47% (0.8921 => 0.9409, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.43% (0.5981 => 0.6306, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.20% (1.5859 => 1.6684, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.4186 => 1.4866, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.64% (2.2024 => 2.3045, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.1840 => 1.2380, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.4064 => 0.4243, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.23% (1.2842 => 1.3385, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.06% (0.3131 => 0.3258, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.74% (0.3427 => 0.3555, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.8101 => 0.8394, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (14.3668 => 14.8531, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.84% (1.1194 => 1.1512, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 2.72% (17.1811 => 17.6479, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (3.8922 => 3.9667, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.28% (1.1145 => 1.3851, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (3.6395 => 3.7753, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2484, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8083, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5793, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2616, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.02% (5.3855 => 3.6613, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.65% (5.3526 => 3.6585, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1398, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.45% (2.9384 => 2.6021, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9202, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.30% (0.2161 => 0.1960, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2837, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7115, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -5.09% (1.5835 => 1.5029, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7975, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.30% (0.9957 => 0.9529, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1648, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.45% (12.4730 => 12.1679, std.dev.: 0.0030) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.95% (8.6802 => 8.5106, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0920, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0081, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std.dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2240, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.44% (0.5229 => 0.5775, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 7.32% (14.9895 => 16.0867, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: 6.01% (14.1553 => 15.0055, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 5.69% (4.1105 => 4.3444, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.17% (1.1048 => 1.2393, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.99% (7.1582 => 7.5153, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.55% (0.6222 => 0.7252, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (0.2116 => 0.2070, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 19:55:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 21:55:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925025548.C45F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4212?compare_to=4209&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4212, Order: 164580, Start Time: 2012-09-25 01:41:13, End Time: 2012-09-25 02:57:20 To: 4209, Order: 164571, Start Time: 2012-09-25 00:04:18, End Time: 2012-09-25 01:25:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 14 (92 on baseline) Performance Improvements: 1 (49 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 882 (746 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.83% (0.0951 => 0.1073, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.23% (0.2732 => 0.2875, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.33% (0.2907 => 0.3033, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 2.86% (0.5698 => 0.5861, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (0.7989 => 0.8181, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.64% (0.9467 => 0.9622, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.50% (1.0937 => 1.1101, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.50% (1.2220 => 1.2403, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.43% (1.9206 => 1.9481, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 14.35% (3.1507 => 3.6027, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.93% (0.7693 => 0.7995, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.53% (4.1499 => 4.2550, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout/hash: 1.58% (4.2918 => 4.3597, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 1.32% (2.3934 => 2.4250, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.52% (2.3863 => 2.3501, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.15% (1.0168 => 1.0183, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.61% (0.5822 => 0.5916, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -1.75% (0.1655 => 0.1626, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.86% (0.1293 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.16% (0.2839 => 0.3014, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.43% (0.2141 => 0.2193, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (0.2988 => 0.3066, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.82% (0.2084 => 0.2101, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 1.07% (0.0280 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -63.95% (0.0086 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -21.35% (0.0089 => 0.0070, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.70% (0.0074 => 0.0076, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0193 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 25.72% (0.0311 => 0.0391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0300 => 0.0303, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0283 => 0.0287) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -24.62% (0.0325 => 0.0245, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: -39.11% (0.0179 => 0.0109, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 5.52% (0.0181 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -17.79% (0.0253 => 0.0208, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: 68.92% (0.0074 => 0.0125, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.69% (0.1446 => 0.1436, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 0.44% (0.2281 => 0.2291, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.78% (1.4340 => 1.4595, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.04% (0.1535 => 0.1519, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.05% (0.5899 => 0.5896, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.68% (26.5941 => 26.7741, std.dev.: 0.2097) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.30% (0.4009 => 0.3997, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.89% (0.1373 => 0.1399, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.53% (0.0567 => 0.0547, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.55% (0.0182 => 0.0181, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.01% (0.0574 => 0.0597, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1245 => 1.1225, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.31% (0.0562 => 0.0575, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.33% (0.0150 => 0.0133, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7650 => 0.7682, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.08% (1.7063 => 1.7077, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2291, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -91.54% (6.9722 => 0.5896, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: 21544.38% (0.1237 => 26.7741, std.dev.: 0.2097) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.80% (4.1772 => 3.0996, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/except: 82750.00% (0.0006 => 0.4971, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.03% (0.0745 => 0.0924, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.89% (0.1414 => 0.1568, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 10.40% (0.5309 => 0.5861, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 8.72% (2.1763 => 2.3660, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.66% (0.6410 => 0.6965, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 7.57% (0.6173 => 0.6640, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.21% (1.0046 => 1.0770, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.10% (0.7639 => 0.8181, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 6.78% (15.3105 => 16.3480, std.dev.: 0.0422) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (1.1653 => 1.2414, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.11% (0.3582 => 0.3801, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.09% (0.6915 => 0.7336, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.2797 => 0.2967, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.05% (0.3901 => 0.4137, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.78% (1.5150 => 1.6026, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.36% (0.6069 => 0.6394, std.dev.: 0.0080) MultiSource/Applications/d/make_dparser: 5.07% (3.0225 => 3.1758, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.06% (0.4248 => 0.4463, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.95% (3.0758 => 3.2281, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.87% (1.1827 => 1.2403, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.2552 => 0.2673, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.63% (1.4408 => 1.5075, std.dev.: 0.0220) MultiSource/Applications/siod/siod: 4.47% (2.0972 => 2.1909, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2654 => 0.2772, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.36% (2.0317 => 2.1202, std.dev.: 0.0259) MultiSource/Applications/SPASS/SPASS: 4.22% (13.3238 => 13.8862, std.dev.: 0.1084) MultiSource/Benchmarks/Bullet/bullet: 4.20% (29.3170 => 30.5482, std.dev.: 0.3901) MultiSource/Applications/oggenc/oggenc: 4.17% (4.7455 => 4.9434, std.dev.: 0.0351) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3062 => 0.3187, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 3.93% (3.5980 => 3.7395, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.2662 => 0.2765, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.3418 => 0.3550, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.85% (1.0689 => 1.1101, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.84% (1.3268 => 1.3778, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8405 => 0.8728, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 3.67% (8.2186 => 8.5204, std.dev.: 0.1064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.67% (1.1672 => 1.2100, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4880 => 0.5058, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.63% (1.8798 => 1.9481, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 3.62% (1.1440 => 1.1854, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 3.59% (0.3847 => 0.3985, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 3.51% (14.7256 => 15.2418, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.39% (1.2021 => 1.2429, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.2952 => 0.3052, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 3.32% (0.3520 => 0.3637, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.24% (0.8569 => 0.8847, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 3.24% (0.3084 => 0.3184, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.20% (6.2546 => 6.4548, std.dev.: 0.0291) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0821 => 1.1131, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.7226 => 0.7433, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (12.6413 => 13.0024, std.dev.: 0.0858) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.39% (1.2742 => 1.3046, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.31% (0.5937 => 0.6074, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4562 => 0.4667, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.09% (0.9425 => 0.9622, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (4.0318 => 4.1157, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9029 => 0.9202, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.5963 => 0.6077, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (4.2616 => 4.3368, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.65% (8.2559 => 8.3925, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (4.3380 => 4.4068, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.21% (4.2815 => 4.3331, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.53% (0.0263 => 0.0388, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout/ary3: 16.10% (1.7426 => 2.0231, std.dev.: 0.0152) SingleSource/Benchmarks/Stanford/Puzzle: 14.24% (0.1433 => 0.1637, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5574, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 11.27% (1.6261 => 1.8093, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 9.13% (7.0025 => 7.6417, std.dev.: 0.0637) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.79% (0.2857 => 0.3108, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.99% (1.0063 => 1.0867, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.02% (40.4792 => 42.9161, std.dev.: 0.3933) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (0.3301 => 0.3475, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.07% (0.7609 => 0.7995, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 4.27% (0.9851 => 1.0272, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.19% (4.2129 => 4.3896, std.dev.: 0.0623) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8484, std.dev.: 0.0307) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5419, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.27% (3.5520 => 3.6683, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.88% (14.4877 => 14.9054, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.75% (6.6312 => 6.8137, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.63% (2.6656 => 2.7358, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/ReedSolomon: 2.58% (8.5113 => 8.7311, std.dev.: 0.0753) SingleSource/Benchmarks/Dhrystone/dry: 2.16% (2.4013 => 2.4531, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4455 => 2.4838, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.53% (4.6127 => 4.6835, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout/hash: 1.35% (4.3016 => 4.3597, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.4184 => 1.4339, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.04% (27.1724 => 27.4563, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.56% (0.2996 => 0.1661, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.71% (1.4189 => 1.1250, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.74% (1.4113 => 1.1327, std.dev.: 0.0244) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: -19.77% (1.7473 => 1.4019, std.dev.: 0.0330) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.21% (5.2665 => 4.2550, std.dev.: 0.0280) MultiSource/Benchmarks/FreeBench/mason/mason: -16.83% (0.5004 => 0.4162, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.19% (1.7361 => 1.4723, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.85% (0.0917 => 0.0790, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: -12.17% (8.1594 => 7.1666, std.dev.: 0.0289) MultiSource/Applications/sgefa/sgefa: -11.11% (0.3746 => 0.3330, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7492, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9406, std.dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: -6.99% (7.6833 => 7.1459, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.6254 => 3.3796, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.59% (2.0027 => 1.8708, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.46% (4.6355 => 4.3362, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.4441 => 1.3557, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (3.4230 => 3.2297, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4140 => 0.3936, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -4.70% (4.4195 => 4.2116, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/distray/distray: -4.65% (0.2664 => 0.2540, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -4.14% (62.4126 => 59.8265, std.dev.: 0.2044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2225, std.dev.: 0.0130) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.90% (1.2959 => 1.2454, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (2.5166 => 2.4250, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -3.42% (9.2503 => 8.9339, std.dev.: 0.0328) SingleSource/Benchmarks/McGill/misr: -3.40% (0.4296 => 0.4150, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.03% (3.9413 => 3.8217, std.dev.: 0.0271) MultiSource/Benchmarks/FreeBench/neural/neural: -2.56% (1.0926 => 1.0646, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.43% (61.1734 => 59.6883, std.dev.: 0.3646) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.00% (3.7496 => 3.6745, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.96% (2.3569 => 2.3108, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.93% (1.0686 => 1.0480, std.dev.: 0.0019) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3628, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -1.82% (3.8907 => 3.8198, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (92.7467 => 91.0737, std.dev.: 0.1436) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2268, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8473, std.dev.: 0.0091) MultiSource/Applications/lua/lua: -1.41% (29.5232 => 29.1055, std.dev.: 0.1272) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4644, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3350, std.dev.: 0.0292) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.03% (0.9980 => 1.0183, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -1.76% (0.6022 => 0.5916, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -2.40% (0.1666 => 0.1626, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.41% (0.1554 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (0.3083 => 0.3014, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.40% (0.2394 => 0.2193, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.43% (0.3175 => 0.3066, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.73% (0.2302 => 0.2101, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -36.97% (0.0449 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -65.17% (0.0089 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -22.22% (0.0090 => 0.0070, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -24.38% (0.0324 => 0.0245, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: -38.42% (0.0177 => 0.0109, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.47% (0.0249 => 0.0208, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1429 => 0.1436, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -2.82% (1.5019 => 1.4595, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.20% (0.1501 => 0.1519, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.26% (0.4264 => 0.3997, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1344 => 0.1399, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.98% (0.0232 => 0.0181, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0639 => 0.0597, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.10% (1.1350 => 1.1225, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0637 => 0.0575, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.93% (0.0246 => 0.0133, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.87% (0.7541 => 0.7682, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.16% (1.5363 => 1.7077, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 19:57:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 21:57:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120925025749.E9EC22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4213?compare_to=4205&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4213, Order: 164571, Start Time: 2012-09-25 00:15:10, End Time: 2012-09-25 02:59:21 To: 4205, Order: 164551, Start Time: 2012-09-24 21:02:37, End Time: 2012-09-24 23:46:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 14 (140 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 956 (753 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.25% (1.0209 => 1.0337, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.25% (5.9161 => 5.9900, std.dev.: 0.0135) MultiSource/Applications/lua/lua: 1.24% (1.5052 => 1.5238, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.21% (2.2850 => 2.3127, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (2.9289 => 2.9638, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.12% (1.7396 => 1.7590, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 1.11% (4.4807 => 4.5305, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.10% (4.8896 => 4.9432, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (2.0969 => 2.1186, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.02% (2.0718 => 2.0930, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (3.8256 => 3.8642, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.2161 => 0.2310, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.50% (122.5347 => 128.0449, std.dev.: 1.3981) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.25% (2.0802 => 2.1063, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.32% (0.1063 => 0.1194, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 11.17% (1.5932 => 1.7711, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.22% (0.5889 => 0.6491, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.96% (0.5826 => 0.6406, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.45% (0.1619 => 0.1772, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 9.20% (0.1218 => 0.1330, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.12% (0.1107 => 0.1208, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.01% (0.1421 => 0.1549, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.60% (2.7292 => 2.9638, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.57% (1.3152 => 1.4279, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.51% (1.6211 => 1.7590, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (3.5627 => 3.8642, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.32% (0.3930 => 0.4257, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7171 => 0.7765, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (0.4361 => 0.4722, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1620 => 0.1753, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.09% (5.5417 => 5.9900, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.01% (0.4994 => 0.5394, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.00% (0.2875 => 0.3105, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.3004 => 0.3244, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.96% (0.2738 => 0.2956, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.96% (0.5000 => 0.5398, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.85% (0.2014 => 0.2172, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.82% (1.0781 => 1.1624, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 7.75% (0.2750 => 0.2963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.74% (0.2714 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2813 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.62% (0.5026 => 0.5409, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2792 => 0.3004, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 7.59% (4.2109 => 4.5305, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2803 => 0.3014, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.51% (0.2729 => 0.2934, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.2823 => 0.3035, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.48% (0.2780 => 0.2988, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.47% (0.2866 => 0.3080, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.45% (2.0673 => 2.2214, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 7.35% (2.1013 => 2.2558, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 7.33% (0.2811 => 0.3017, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.33% (0.9909 => 1.0635, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3348 => 0.3593, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2911 => 0.3123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.27% (0.3096 => 0.3321, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.25% (0.6634 => 0.7115, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.20% (0.3625 => 0.3886, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.17% (0.3124 => 0.3348, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.16% (0.2736 => 0.2932, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.16% (0.3267 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.09% (0.2566 => 0.2748, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.07% (4.4195 => 4.7319, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 7.05% (4.6177 => 4.9432, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (0.4139 => 0.4430, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3317 => 0.3550, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.00% (0.3726 => 0.3987, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.99% (0.3362 => 0.3597, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.96% (0.3678 => 0.3934, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.1505 => 0.1609, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.90% (0.3477 => 0.3717, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.1462 => 0.1562, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (0.3890 => 0.4156, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 6.81% (2.1653 => 2.3127, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 6.79% (1.4269 => 1.5238, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.1549 => 0.1654, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.73% (0.3282 => 0.3503, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.73% (0.4029 => 0.4300, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.70% (1.8794 => 2.0053, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.61% (0.3903 => 0.4161, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.61% (0.1968 => 0.2098, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.60% (0.9697 => 1.0337, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.58% (0.4146 => 0.4419, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 6.58% (0.2691 => 0.2868, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4251 => 0.4530, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.50% (0.3690 => 0.3930, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.3845 => 0.4093, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.38% (0.3981 => 0.4235, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 6.36% (0.2075 => 0.2207, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (1.9694 => 2.0930, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.23% (0.4658 => 0.4948, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (0.2040 => 0.2167, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.6435 => 0.6829, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.11% (0.3271 => 0.3471, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 6.11% (0.5546 => 0.5885, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.11% (1.9966 => 2.1186, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.96% (0.7875 => 0.8344, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.5012 => 0.5309, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 5.91% (23.5202 => 24.9101, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 5.91% (2.0346 => 2.1548, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.3084 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.76% (0.2969 => 0.3140, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 5.67% (0.3336 => 0.3525, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 5.65% (0.2391 => 0.2526, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.56% (0.2103 => 0.2220, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 4.91% (0.4847 => 0.5085, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.86% (0.7426 => 0.7787, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.59% (0.5361 => 0.5607, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.42% (0.5584 => 0.5831, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.12% (11.6398 => 12.1197, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3792 => 0.3948, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.3498 => 0.3640, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.73% (4.6926 => 4.8678, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.94% (0.4253 => 0.4378, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.76% (11.9555 => 12.2851, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.86% (0.2122 => 0.2310, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 4.81% (15.4430 => 16.1857, std.dev.: 0.0559) SingleSource/Benchmarks/Misc/flops-2: 4.37% (1.8057 => 1.8846, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6326, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2122, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5020, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4441, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2893, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5793, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5760, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0087) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (17.2379 => 16.8378, std.dev.: 0.0475) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5691, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9552, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 20:51:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 22:51:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925035138.1690B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4214?compare_to=4210&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4214, Order: 164583, Start Time: 2012-09-25 02:38:50, End Time: 2012-09-25 03:53:09 To: 4210, Order: 164577, Start Time: 2012-09-25 00:55:20, End Time: 2012-09-25 02:10:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (6.6462 => 6.5747, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.03% (3.9606 => 3.9199, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -1.02% (1.3206 => 1.3071, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.93% (2.0176 => 2.4399, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.42% (0.2243 => 0.2544, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.01% (1.3693 => 1.5201, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 10.95% (0.5818 => 0.6455, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.91% (0.1072 => 0.1189, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.82% (0.7061 => 0.7825, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 10.77% (0.5748 => 0.6367, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.63% (0.4328 => 0.4788, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.25% (0.2781 => 0.3066, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.23% (3.9660 => 4.3718, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 10.14% (0.4062 => 0.4474, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.03% (0.9199 => 1.0122, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.03% (1.4563 => 1.6024, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.92% (1.2193 => 1.3403, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.92% (0.2782 => 0.3058, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.91% (0.7710 => 0.8474, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.85% (0.2721 => 0.2989, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.69% (0.7038 => 0.7720, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.69% (0.5265 => 0.5775, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.64% (0.3485 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.59% (0.3899 => 0.4273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2726 => 0.2986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.49% (0.2760 => 0.3022, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.46% (0.3022 => 0.3308, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.38% (0.3293 => 0.3602, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.37% (0.6959 => 0.7611, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 9.37% (0.2690 => 0.2942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2765 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.35% (1.9828 => 2.1681, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2607 => 0.2850, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.31% (0.2966 => 0.3242, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.30% (0.2937 => 0.3210, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 9.27% (0.3149 => 0.3441) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.26% (1.1364 => 1.2416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.23% (0.3130 => 0.3419, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.23% (0.6283 => 0.6863, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.21% (0.4016 => 0.4386, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.21% (13.8202 => 15.0930, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.20% (0.3489 => 0.3810, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.16% (0.3580 => 0.3908, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.16% (0.3756 => 0.4100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.05% (0.3868 => 0.4218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.93% (0.3192 => 0.3477, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.70% (0.5577 => 0.6062, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 8.69% (0.3453 => 0.3753, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 8.66% (0.3534 => 0.3840, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.54% (0.4390 => 0.4765, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 8.48% (0.2995 => 0.3249, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.44% (0.3246 => 0.3520, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.29% (1.0313 => 1.1168, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.20% (0.4379 => 0.4738, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.06% (0.2914 => 0.3149, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.02% (0.5637 => 0.6089, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.98% (16.6129 => 17.9389, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 7.98% (0.2945 => 0.3180, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.96% (1.1061 => 1.1941, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.7460 => 0.8044, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 7.82% (0.8310 => 0.8960, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.80% (0.6576 => 0.7089, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (7.2180 => 7.7806, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.70% (0.4791 => 0.5160, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.3220 => 0.3467, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.60% (0.3646 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.58% (0.8698 => 0.9357, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3601 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.51% (0.3650 => 0.3924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.48% (0.3663 => 0.3937, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.36% (3.8646 => 4.1492, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 7.35% (1.0594 => 1.1373, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.27% (0.3755 => 0.4028, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.27% (0.6744 => 0.7234, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.26% (3.1889 => 3.4203, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.15% (2.1791 => 2.3349, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 7.13% (1.9270 => 2.0644, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 6.83% (0.3131 => 0.3345, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.83% (3.6692 => 3.9199, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.82% (1.3245 => 1.4148, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (1.2749 => 1.3618, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.58% (14.8535 => 15.8304, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 6.57% (8.4961 => 9.0544, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.40% (4.4433 => 4.7278, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.40% (4.3801 => 4.6603, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 6.34% (1.2292 => 1.3071, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.33% (0.8818 => 0.9376, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.23% (0.6135 => 0.6517, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 6.10% (4.6629 => 4.9473, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2504 => 0.2655, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (1.1333 => 1.2016, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.78% (3.2742 => 3.4633, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.74% (0.6250 => 0.6609, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.47% (4.9865 => 5.2591, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.37% (0.4805 => 0.5063, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (6.5754 => 6.9163, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.14% (1.5188 => 1.5968, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.91% (0.2321 => 0.2435, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.91% (0.9108 => 0.9555, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.87% (0.3245 => 0.3403, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (6.2785 => 6.5747, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.66% (2.1007 => 2.1986, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8978, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 4.62% (3.7467 => 3.9197, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3511 => 0.3645, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.17% (16.2614 => 16.7770, std.dev.: 0.0224) MultiSource/Applications/ClamAV/clamscan: 2.50% (14.5298 => 14.8929, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.28% (1.8175 => 2.2407, std.dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0803, std.dev.: 0.0423) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5832, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6002, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9174, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.68% (0.2670 => 0.1397, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -16.27% (0.0707 => 0.0592, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.61% (0.4657 => 0.3930, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.57% (1.3813 => 1.1800, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.52% (1.3819 => 1.1813, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.97% (22.5627 => 21.4411, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2786, std.dev.: 0.0360) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.51% (1.3780 => 1.3021, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9657, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.28% (0.9996 => 0.9568, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7089, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0496, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7909, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2174, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4336, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -1.02% (1.2308 => 1.2182, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 21:01:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Sep 2012 23:01:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925040148.3B9342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4215?compare_to=4211&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4215, Order: 164583, Start Time: 2012-09-25 02:45:23, End Time: 2012-09-25 04:03:18 To: 4211, Order: 164578, Start Time: 2012-09-25 00:58:18, End Time: 2012-09-25 02:16:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 1 (148 on baseline) Performance Improvements: 4 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 944 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.03% (1.1986 => 1.2110, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.22% (3.6585 => 3.6137, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (15.1029 => 14.9215, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.17% (3.6613 => 3.6186, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (2.1934 => 2.1712, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.35% (0.5775 => 0.5755, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -0.30% (16.0867 => 16.0379, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: -0.27% (15.0055 => 14.9650, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: -0.05% (53.9973 => 53.9729, std.dev.: 0.0213) MultiSource/Benchmarks/MallocBench/gs/gs: -0.25% (4.3444 => 4.3334, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.36% (1.2393 => 1.2348, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (7.5153 => 7.4963, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.68% (0.7252 => 0.7203, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2070 => 0.2070, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.66% (63.2438 => 53.9729, std.dev.: 0.0213) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.99% (3.4629 => 5.4710, std.dev.: 0.0068) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14242.36% (0.0720 => 10.3265, std.dev.: 0.0043) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.02% (0.2554 => 0.3755, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 43.93% (10.3673 => 14.9215, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/distray/distray: 30.21% (0.1056 => 0.1375, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 29.53% (0.1622 => 0.2101, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.58% (2.2022 => 2.5454, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.01% (7.0540 => 8.1127, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.37% (1.7609 => 1.9787, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 11.00% (0.3473 => 0.3855, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.77% (10.4361 => 11.5597, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.3927 => 0.4327, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 9.96% (0.3282 => 0.3609, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 8.40% (0.1440 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1655 => 0.1793, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.25% (9.4845 => 10.2669, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.03% (0.3177 => 0.3432, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.78% (1.5415 => 1.6614, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.59% (0.7115 => 0.7655, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.54% (5.7591 => 6.1931, std.dev.: 0.0123) MultiSource/Applications/sgefa/sgefa: 7.53% (0.3109 => 0.3343, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.51% (0.5569 => 0.5987, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.39% (0.6675 => 0.7168, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.37% (0.7433 => 0.7981, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.29% (1.3050 => 1.4001, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.27% (0.2271 => 0.2436, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.18% (0.2758 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1510 => 0.1618, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.10% (0.3423 => 0.3666, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.07% (4.2646 => 4.5659, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.03% (0.5860 => 0.6272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 6.99% (0.5925 => 0.6339, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.96% (3.3354 => 3.5675, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.87% (8.1363 => 8.6955, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.75% (0.9765 => 1.0424, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.63% (0.8067 => 0.8602, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 6.59% (0.7835 => 0.8351, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.57% (4.9449 => 5.2700, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.55% (5.0018 => 5.3295, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.52% (0.8172 => 0.8705, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.50% (0.2107 => 0.2244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.49% (0.3422 => 0.3644, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.35% (0.5105 => 0.5429, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 6.29% (0.3387 => 0.3600, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.28% (7.9617 => 8.4619, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 6.15% (1.5603 => 1.6563, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.09% (0.7326 => 0.7772, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.07% (1.1642 => 1.2349, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.5020 => 0.5323, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (1.1861 => 1.2567, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.89% (0.4636 => 0.4909, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.88% (1.0722 => 1.1352, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4289 => 0.4541, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.87% (0.3307 => 0.3501, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.84% (0.3441 => 0.3642, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 5.82% (0.6456 => 0.6832, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.76% (0.2603 => 0.2753, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.76% (3.8723 => 4.0953, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.68% (0.4103 => 0.4336, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 5.63% (21.9371 => 23.1712, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4299 => 0.4537, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3650 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2891 => 0.3050, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.49% (0.3826 => 0.4036, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.47% (0.4203 => 0.4433, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.47% (2.0273 => 2.1382, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3865 => 0.4076, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.3136 => 0.3304, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.32% (0.3232 => 0.3404, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.31% (0.4048 => 0.4263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.30% (0.2831 => 0.2981, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.28% (0.8921 => 0.9392, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.27% (0.2905 => 0.3058, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.24% (0.6450 => 0.6788, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3283 => 0.3455, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.22% (0.3162 => 0.3327, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2725 => 0.2867, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.12% (0.2871 => 0.3018, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.12% (2.2969 => 2.4145, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.08% (0.5981 => 0.6285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2756 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.07% (2.0665 => 2.1712, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.06% (0.4620 => 0.4854, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5859 => 1.6661, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.05% (0.3603 => 0.3785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.3098 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.02% (0.3684 => 0.3869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.3052 => 0.3205, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.98% (0.2872 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.91% (0.2793 => 0.2930, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 4.85% (0.3379 => 0.3543, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.83% (0.2877 => 0.3016, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2802 => 0.2937, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.58% (2.2024 => 2.3033, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 4.53% (1.1840 => 1.2376, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (1.4186 => 1.4826, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.4064 => 0.4213, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.59% (1.2842 => 1.3303, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.35% (0.8101 => 0.8372, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.15% (0.3427 => 0.3535, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (14.3668 => 14.7870, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.8922 => 4.0011, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.62% (17.1811 => 17.6311, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.56% (1.1194 => 1.1481, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3822, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.1396 => 1.2156, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7671, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2507, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8075, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5800, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.19% (5.2763 => 3.2615, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.81% (5.3855 => 3.6186, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.49% (5.3526 => 3.6137, std.dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1270, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/mason/mason: -14.18% (0.0811 => 0.0696, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.47% (2.9384 => 2.6015, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9201, std.dev.: 0.0181) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.25% (0.2161 => 0.1961, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2935, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0127) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.12% (0.9957 => 0.9547, std.dev.: 0.0144) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1647, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5037, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.83% (1.3677 => 1.3290, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1735, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/McGill/chomp: -2.13% (1.2373 => 1.2110, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0002, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0870, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.58% (8.6802 => 8.5428, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.06% (0.5229 => 0.5755, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 6.99% (14.9895 => 16.0379, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 5.72% (14.1553 => 14.9650, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 5.42% (4.1105 => 4.3334, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.77% (1.1048 => 1.2348, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.72% (7.1582 => 7.4963, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.77% (0.6222 => 0.7203, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (0.2116 => 0.2070, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 22:34:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 00:34:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925053441.541282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4216?compare_to=4214&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4216, Order: 164585, Start Time: 2012-09-25 04:21:52, End Time: 2012-09-25 05:36:12 To: 4214, Order: 164583, Start Time: 2012-09-25 02:38:50, End Time: 2012-09-25 03:53:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (175 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (688 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.19% (4.9473 => 5.0060, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.18% (78.0396 => 79.7439, std.dev.: 0.6356) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.39% (2.0176 => 2.4491, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.51% (0.2243 => 0.2546, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.39% (0.1413 => 0.1574, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.35% (1.3693 => 1.5247, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.08% (0.1588 => 0.1764, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.95% (0.5818 => 0.6455, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 10.84% (0.4328 => 0.4797, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.74% (0.7061 => 0.7819, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.68% (3.9660 => 4.3895, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.50% (0.9199 => 1.0165, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.35% (1.4563 => 1.6070, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.29% (1.2193 => 1.3448, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.2721 => 0.3001, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.24% (0.4062 => 0.4478, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 10.19% (0.7038 => 0.7755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.03% (0.7710 => 0.8483, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.00% (0.3130 => 0.3443, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.97% (0.5265 => 0.5790, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.93% (0.3899 => 0.4286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.89% (0.3022 => 0.3321, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.87% (0.6959 => 0.7646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.71% (1.1364 => 1.2467, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.69% (0.4016 => 0.4405, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.67% (0.2607 => 0.2859, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.66% (13.8202 => 15.1559, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.6283 => 0.6890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.64% (0.4390 => 0.4813, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.61% (1.9828 => 2.1734, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.57% (0.3293 => 0.3608, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.54% (0.3489 => 0.3822, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2726 => 0.2985, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.44% (0.3580 => 0.3918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.38% (0.3868 => 0.4231, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.35% (0.3756 => 0.4107, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3149 => 0.3443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.18% (0.3192 => 0.3485, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.12% (0.3453 => 0.3768, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.02% (0.5577 => 0.6080, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.91% (0.2995 => 0.3262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.89% (0.3534 => 0.3848, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.83% (1.0313 => 1.1224, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.65% (0.2127 => 0.2311, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.61% (0.4379 => 0.4756, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.50% (0.4791 => 0.5198, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.48% (16.6129 => 18.0213, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.41% (0.5637 => 0.6111, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 8.41% (1.1061 => 1.1991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.39% (0.8310 => 0.9007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.27% (0.6576 => 0.7120, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.2914 => 0.3155, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.23% (0.7460 => 0.8074, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 8.22% (0.2945 => 0.3187, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.16% (0.8698 => 0.9408, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (7.2180 => 7.8054, std.dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 8.02% (1.0594 => 1.1444, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 7.99% (0.7506 => 0.8106, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3220 => 0.3474, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.82% (3.1889 => 3.4383, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 7.78% (0.6744 => 0.7269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.72% (0.3755 => 0.4045, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 7.61% (2.1791 => 2.3449, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.58% (3.8646 => 4.1574, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 7.57% (1.9270 => 2.0729, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3578 => 0.3847, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.45% (0.3663 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3650 => 0.3921, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.39% (0.4003 => 0.4299, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.36% (4.6629 => 5.0060, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.32% (3.6692 => 3.9379, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 7.31% (1.2749 => 1.3681, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 7.25% (0.3131 => 0.3358, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.23% (1.3245 => 1.4202, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 7.18% (14.8535 => 15.9196, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 7.15% (8.4961 => 9.1033, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.10% (0.2140 => 0.2292, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.08% (0.4113 => 0.4404, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.99% (0.8818 => 0.9434, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.87% (4.3801 => 4.6809, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.85% (0.6135 => 0.6555, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.76% (4.4433 => 4.7435, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.1333 => 1.2076, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.53% (1.2292 => 1.3095, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.41% (3.2742 => 3.4842, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6250 => 0.6640, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.4805 => 0.5091, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.85% (4.9865 => 5.2782, std.dev.: 0.0170) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (6.5754 => 6.9453, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.61% (1.5188 => 1.6040, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (0.9108 => 0.9616, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.22% (2.1007 => 2.2103, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.2008 => 0.2112, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.18% (0.3245 => 0.3413, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.17% (6.2785 => 6.6029, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.07% (13.2842 => 13.9583, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 5.00% (3.7467 => 3.9339, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.27% (0.3511 => 0.3661, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.56% (16.2614 => 16.8408, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.94% (14.5298 => 14.9571, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std.dev.: 0.0480) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.54% (3.1736 => 3.4130, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.06% (1.2998 => 1.3786, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7060, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1017, std.dev.: 0.0565) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.05% (7.4271 => 7.5795, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5834, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.26% (8.8259 => 8.9370, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6007, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.45% (0.2670 => 0.1403, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.74% (0.4657 => 0.3924, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.24% (1.3813 => 1.1846, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.19% (1.3819 => 1.1858, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.60% (22.5627 => 21.5254, std.dev.: 0.0220) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.26% (0.2238 => 0.1986, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2712, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.61% (1.3780 => 1.2869, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.35% (0.9996 => 0.9561, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.36% (3.0263 => 2.9549, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2468, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0663, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6615 => 0.6506, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7910, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -1.45% (1.2308 => 1.2129, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std.dev.: 0.0161) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.10% (6.6320 => 6.5591, std.dev.: 0.0102) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4319, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2619, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Sep 24 23:25:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 01:25:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925062511.1D2AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4217?compare_to=4212&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4217, Order: 164586, Start Time: 2012-09-25 05:09:13, End Time: 2012-09-25 06:26:43 To: 4212, Order: 164580, Start Time: 2012-09-25 01:41:13, End Time: 2012-09-25 02:57:20 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (70 on baseline) Performance Improvements: 1 (48 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 892 (769 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.64% (0.7545 => 0.7895, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.70% (0.7600 => 0.7805, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.25% (1.1327 => 1.1469, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.95% (2.3819 => 2.7619, std.dev.: 0.1239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -10.35% (3.6027 => 3.2298, std.dev.: 0.0675) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.05% (1.0183 => 1.0178, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -0.42% (0.5916 => 0.5891, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: 2.46% (0.1626 => 0.1666, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.60% (0.1330 => 0.1322, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.26% (0.3014 => 0.2976, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.87% (0.2193 => 0.2174, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.09% (0.3066 => 0.3002, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (0.2101 => 0.2069, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -0.71% (0.0283 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 183.87% (0.0031 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -32.86% (0.0070 => 0.0047, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.63% (0.0076 => 0.0078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0193 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -23.79% (0.0391 => 0.0298, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.32% (0.0303 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.05% (0.0287 => 0.0284, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 31.84% (0.0245 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.92% (0.0109 => 0.0110, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: -36.13% (0.0191 => 0.0122, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 22.12% (0.0208 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -0.80% (0.0125 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1436 => 0.1439, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 0.44% (0.2291 => 0.2301, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -3.32% (1.4595 => 1.4110, std.dev.: 0.0490) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.15% (0.1519 => 0.1456, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.25% (0.5896 => 0.5911, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -7.36% (26.7741 => 24.8048, std.dev.: 0.9187) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.13% (0.3997 => 0.4002, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1399 => 0.1403, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.29% (0.0547 => 0.0565, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.55% (0.0181 => 0.0180, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.68% (0.0597 => 0.0587, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1225 => 1.1256, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -26.67% (0.0015 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.87% (0.0575 => 0.0570, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.30% (0.0133 => 0.0160, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7682 => 0.7653, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.09% (1.7077 => 1.7061, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.83% (0.0121 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2301, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -91.52% (6.9722 => 0.5911, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/09-vor/vor: 19952.38% (0.1237 => 24.8048, std.dev.: 0.9187) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.95% (4.1772 => 3.0933, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/except: 82133.33% (0.0006 => 0.4934, std.dev.: 0.0015) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6410 => 0.6959, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 8.55% (2.1763 => 2.3623, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.49% (0.1414 => 0.1534, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 8.06% (0.5309 => 0.5737, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 7.81% (0.6173 => 0.6655, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: 6.91% (1.0046 => 1.0740, std.dev.: 0.0183) MultiSource/Applications/SIBsim4/SIBsim4: 6.66% (1.1653 => 1.2429, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.59% (0.3582 => 0.3818, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.35% (1.5150 => 1.6112, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.15% (0.2552 => 0.2709, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.12% (0.6915 => 0.7269, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.80% (0.7639 => 0.8006, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.61% (0.2797 => 0.2926, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 4.59% (3.0225 => 3.1613, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.56% (0.2654 => 0.2775, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.50% (1.1440 => 1.1955, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1672 => 1.2177, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.20% (1.1827 => 1.2324, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.19% (0.6069 => 0.6323, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4248 => 0.4423, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.05% (13.3238 => 13.8635, std.dev.: 0.0795) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.86% (1.2021 => 1.2485, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.73% (1.0821 => 1.1225, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.2546 => 6.4787, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/09-vor/vor: 3.57% (0.3026 => 0.3134, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.53% (4.7455 => 4.9128, std.dev.: 0.0622) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (8.2186 => 8.5022, std.dev.: 0.1051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (1.4408 => 1.4898, std.dev.: 0.0124) MultiSource/Applications/treecc/treecc: 3.38% (1.8798 => 1.9433, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.0689 => 1.1038, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 3.24% (0.3084 => 0.3184, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 3.14% (1.3268 => 1.3685, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 3.06% (14.7256 => 15.1763, std.dev.: 0.0692) MultiSource/Applications/lua/lua: 3.03% (3.5980 => 3.7069, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (12.6413 => 13.0199, std.dev.: 0.0806) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.4908 => 6.6598, std.dev.: 0.0345) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4562 => 0.4667, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.4880 => 0.4991, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.0318 => 4.1218, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (4.2616 => 4.3558, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.2815 => 4.3549, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 51.34% (0.0261 => 0.0395, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/matrix: 21.83% (3.4629 => 4.2188, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.13% (2.3580 => 2.7619, std.dev.: 0.1239) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.54% (4.0101 => 4.5529, std.dev.: 0.0223) SingleSource/Benchmarks/McGill/queens: 10.75% (1.6261 => 1.8009, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.91% (1.0063 => 1.0960, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 8.65% (0.1433 => 0.1557, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6025, std.dev.: 0.0282) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.8498 => 0.9154, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.47% (40.4792 => 43.0993, std.dev.: 0.5023) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.25% (4.2129 => 4.4761, std.dev.: 0.0834) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 4.47% (0.9851 => 1.0291, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8451, std.dev.: 0.0597) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.94% (3.5520 => 3.6563, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ReedSolomon: 2.91% (8.5113 => 8.7594, std.dev.: 0.0759) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8920, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8088, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 2.00% (2.4013 => 2.4493, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.88% (2.6656 => 2.7157, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.73% (4.6127 => 4.6925, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (2.4455 => 2.4875, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.86% (0.2996 => 0.1652, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.91% (1.4189 => 1.1364, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.73% (1.4113 => 1.1469, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.61% (0.3497 => 0.2042, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.80% (0.0311 => 0.0209, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.69% (5.2665 => 4.1770, std.dev.: 0.0719) SingleSource/Benchmarks/Shootout-C++/ary3: -20.27% (1.7473 => 1.3931, std.dev.: 0.0528) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.22% (15.8312 => 13.2630, std.dev.: 0.6874) MultiSource/Benchmarks/FreeBench/mason/mason: -15.57% (0.5004 => 0.4225, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.40% (1.7361 => 1.4688, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -11.08% (0.3746 => 0.3331, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.39% (1.1647 => 1.0437, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.34% (3.6023 => 3.2298, std.dev.: 0.0675) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -8.33% (9.5474 => 8.7518, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9406, std.dev.: 0.0251) MultiSource/Applications/lambda-0_1_3/lambda: -7.16% (7.6833 => 7.1332, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.4441 => 1.3423, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3762, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (4.6355 => 4.3250, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8721, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.24% (2.9728 => 2.7874, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -5.78% (3.4230 => 3.2251, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/distray/distray: -5.59% (0.2664 => 0.2515, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1859, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (2.5166 => 2.3954, std.dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -4.25% (62.4126 => 59.7631, std.dev.: 0.1014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.01% (0.4140 => 0.3974, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.83% (1.2722 => 1.2235, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/misr: -3.70% (0.4296 => 0.4137, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.03% (3.9413 => 3.8217, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/methcall: -2.99% (9.2503 => 8.9733, std.dev.: 0.0448) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.90% (1.1683 => 1.1344, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.14% (3.7496 => 3.6695, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -1.97% (3.8907 => 3.8139, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3673, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2236, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: -1.70% (3.4876 => 3.4284, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4628, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5617 => 16.3563, std.dev.: 0.0657) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.98% (0.9980 => 1.0178, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.18% (0.6022 => 0.5891, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: - (0.1666 => 0.1666, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.93% (0.1554 => 0.1322, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.47% (0.3083 => 0.2976, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.19% (0.2394 => 0.2174, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (0.3175 => 0.3002, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.12% (0.2302 => 0.2069, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -37.42% (0.0449 => 0.0281, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -47.78% (0.0090 => 0.0047, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -67.50% (0.0240 => 0.0078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -23.59% (0.0390 => 0.0298, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -37.85% (0.0177 => 0.0110, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: -35.45% (0.0189 => 0.0122, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1429 => 0.1439, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -6.05% (1.5019 => 1.4110, std.dev.: 0.0490) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.00% (0.1501 => 0.1456, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.14% (0.4264 => 0.4002, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.39% (0.1344 => 0.1403, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.07% (0.0589 => 0.0565, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.41% (0.0232 => 0.0180, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1350 => 1.1256, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.52% (0.0637 => 0.0570, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.96% (0.0246 => 0.0160, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 00:19:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 02:19:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925071959.811C22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4218?compare_to=4216&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4218, Order: 164587, Start Time: 2012-09-25 06:04:53, End Time: 2012-09-25 07:21:29 To: 4216, Order: 164585, Start Time: 2012-09-25 04:21:52, End Time: 2012-09-25 05:36:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (693 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.44% (2.0176 => 2.4502, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.31% (0.0819 => 0.0928, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.62% (0.5748 => 0.6416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.56% (0.7061 => 0.7877, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.54% (0.1413 => 0.1576) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4328 => 0.4821, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.34% (1.3693 => 1.5246, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 11.25% (0.2781 => 0.3094, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.81% (3.9660 => 4.3948, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 10.81% (0.4062 => 0.4501, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 10.54% (0.7038 => 0.7780, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.52% (1.4563 => 1.6095, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.52% (0.2596 => 0.2869, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.52% (0.3899 => 0.4309, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.43% (0.9199 => 1.0158, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hello: 10.40% (0.2607 => 0.2878, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.36% (0.3485 => 0.3846, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.2721 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.33% (1.2193 => 1.3452, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.32% (0.7710 => 0.8506, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.32% (0.1327 => 0.1464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.27% (0.2628 => 0.2898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.25% (1.9828 => 2.1861, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.21% (0.4016 => 0.4426, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.19% (0.6959 => 0.7668, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3293 => 0.3626, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.10% (0.3130 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.06% (0.3580 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.99% (0.5265 => 0.5791, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 9.98% (0.3868 => 0.4254, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.87% (0.6283 => 0.6903, std.dev.: 0.0151) MultiSource/Applications/SPASS/SPASS: 9.83% (13.8202 => 15.1781, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.79% (1.1364 => 1.2477, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.76% (0.3453 => 0.3790, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.74% (0.3192 => 0.3503, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 9.51% (0.3534 => 0.3870, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.07% (0.5577 => 0.6083, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 9.05% (0.2995 => 0.3266, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2127 => 0.2319, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.97% (1.0313 => 1.1238, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.78% (0.3246 => 0.3531, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.72% (0.4379 => 0.4761, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.63% (16.6129 => 18.0473, std.dev.: 0.0182) MultiSource/Applications/Burg/burg: 8.55% (1.1061 => 1.2007, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.50% (0.6576 => 0.7135, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.50% (0.8698 => 0.9437, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.50% (0.4791 => 0.5198, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.49% (0.7460 => 0.8093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5637 => 0.6114, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 8.42% (0.8310 => 0.9010, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.34% (0.7506 => 0.8132, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.34% (0.2914 => 0.3157, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.32% (7.2180 => 7.8185, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.20% (0.3755 => 0.4063, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.07% (0.3220 => 0.3480, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 8.00% (1.0594 => 1.1441, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.97% (3.1889 => 3.4429, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 7.90% (0.6744 => 0.7277, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 7.86% (3.8646 => 4.1683, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3650 => 0.3932, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.71% (1.9270 => 2.0756, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 7.62% (0.2925 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.61% (2.1791 => 2.3450, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.44% (1.3245 => 1.4230, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.40% (3.6692 => 3.9409, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 7.37% (1.2749 => 1.3689, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 7.31% (14.8535 => 15.9398, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 7.25% (4.6629 => 5.0010, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 7.22% (0.3131 => 0.3357, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1569 => 0.1682, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 7.20% (8.4961 => 9.1077, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.17% (0.4113 => 0.4408, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.02% (0.8818 => 0.9437, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.01% (0.6135 => 0.6565, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3152, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.97% (4.3801 => 4.6853, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.2140 => 0.2288, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.90% (4.4433 => 4.7500, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.75% (0.2504 => 0.2673, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.74% (0.6250 => 0.6671, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.70% (1.1333 => 1.2092, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.45% (3.2742 => 3.4853, std.dev.: 0.0510) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (6.5754 => 6.9515, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.64% (0.9108 => 0.9622, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.43% (0.2008 => 0.2117, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.32% (2.1007 => 2.2124, std.dev.: 0.0328) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.29% (6.2785 => 6.6107, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (13.2842 => 13.9797, std.dev.: 0.0113) MultiSource/Applications/lua/lua: 5.20% (3.7467 => 3.9414, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.27% (0.3511 => 0.3661, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.57% (16.2614 => 16.8420, std.dev.: 0.0165) MultiSource/Applications/ClamAV/clamscan: 3.05% (14.5298 => 14.9724, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2793, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3789, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0476) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7062, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0752, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 1.91% (7.4271 => 7.5686, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.25% (5.5130 => 5.5819, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5921, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.38% (0.2670 => 0.1405, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.44% (0.4657 => 0.3938, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.14% (1.3813 => 1.1860, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.10% (1.3819 => 1.1870, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.32% (22.5627 => 21.5869, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3041, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std.dev.: 0.0246) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.96% (0.9996 => 0.9600, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2465, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.65% (26.5159 => 26.0797, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7917, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8591, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2221, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -1.09% (4.4810 => 4.4320, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 00:43:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 02:43:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925074317.D2EDE2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4219?compare_to=4215&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4219, Order: 164588, Start Time: 2012-09-25 06:23:55, End Time: 2012-09-25 07:44:48 To: 4215, Order: 164583, Start Time: 2012-09-25 02:45:23, End Time: 2012-09-25 04:03:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 2 (146 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 947 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.20% (3.6137 => 3.6569, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.14% (3.6186 => 3.6599, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.56% (0.5755 => 0.5787, std.dev.: 0.0208) MultiSource/Applications/SPASS/SPASS: 0.08% (16.0379 => 16.0501, std.dev.: 0.3469) MultiSource/Applications/kimwitu++/kc: -0.07% (14.9650 => 14.9549, std.dev.: 0.0466) MultiSource/Benchmarks/Bullet/bullet: 0.07% (53.9729 => 54.0098, std.dev.: 0.0763) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.3334 => 4.3341, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.33% (1.2348 => 1.2389, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.56% (7.4963 => 7.5381, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.49% (0.7203 => 0.7238, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (0.2070 => 0.2101, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.60% (63.2438 => 54.0098, std.dev.: 0.0763) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.15% (3.4629 => 5.4765, std.dev.: 0.0035) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14238.75% (0.0720 => 10.3239, std.dev.: 0.1367) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.63% (0.2554 => 0.3796, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 44.93% (10.3673 => 15.0255, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 31.94% (0.1622 => 0.2140, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.76% (2.2022 => 2.5493, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.63% (7.0540 => 8.1565, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (1.7609 => 1.9774, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.95% (10.4361 => 11.5791, std.dev.: 0.2184) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.23% (0.1625 => 0.1775, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1117 => 0.1218, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 8.96% (0.1440 => 0.1569) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.91% (0.3177 => 0.3460, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 8.51% (0.7835 => 0.8502, std.dev.: 0.0196) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.40% (9.4845 => 10.2811, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.10% (0.4879 => 0.5274, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.91% (0.1555 => 0.1678, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.90% (0.2758 => 0.2976, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 7.82% (0.3109 => 0.3352, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: 7.81% (0.7115 => 0.7671, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.80% (1.5415 => 1.6617, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.73% (0.8172 => 0.8804, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.70% (0.5860 => 0.6311, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 7.58% (5.7591 => 6.1956, std.dev.: 0.1151) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (8.1363 => 8.7517, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.56% (0.4615 => 0.4964, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 7.54% (0.3423 => 0.3681, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.37% (0.7433 => 0.7981, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.36% (0.6675 => 0.7166, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.35% (1.3050 => 1.4009, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.31% (0.2271 => 0.2437, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 7.22% (3.3354 => 3.5763, std.dev.: 0.0849) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1510 => 0.1619, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.19% (0.2700 => 0.2894, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.09% (0.8067 => 0.8639, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.03% (0.9765 => 1.0451, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.4103 => 0.4391, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (4.2646 => 4.5616, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.91% (7.9617 => 8.5119, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.88% (4.9449 => 5.2853, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5569 => 0.5951, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.83% (5.0018 => 5.3435, std.dev.: 0.0120) MultiSource/Applications/hbd/hbd: 6.72% (1.5603 => 1.6651, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.69% (0.2107 => 0.2248, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.60% (0.3121 => 0.3327, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4636 => 0.4939, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5105 => 0.5435, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 6.44% (0.3387 => 0.3605, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2891 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.43% (0.2831 => 0.3013, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 6.37% (0.2905 => 0.3090, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3650 => 0.3881, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3865 => 0.4109, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.30% (21.9371 => 23.3198, std.dev.: 0.3993) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4289 => 0.4559, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.22% (0.3826 => 0.4064, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.16% (0.4203 => 0.4462, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.08% (0.5020 => 0.5325, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.04% (1.1861 => 1.2577, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.02% (2.0665 => 2.1910, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.02% (0.3441 => 0.3648, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.00% (3.8723 => 4.1045, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 5.95% (0.4299 => 0.4555, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.4048 => 0.4289, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.94% (1.0722 => 1.1359, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/matrix: 5.94% (0.3098 => 0.3282, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.91% (0.3162 => 0.3349, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.88% (0.2872 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2756 => 0.2918, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.85% (0.2871 => 0.3039, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.83% (0.3603 => 0.3813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.82% (0.3283 => 0.3474, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.82% (0.3232 => 0.3420, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.80% (0.3052 => 0.3229, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.79% (0.3180 => 0.3364, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2802 => 0.2964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.73% (0.3684 => 0.3895, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.72% (0.2603 => 0.2752, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4620 => 0.4883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.67% (0.2877 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.8921 => 0.9415, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.6450 => 0.6804, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.20% (0.5981 => 0.6292, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.77% (1.5859 => 1.6616, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.1840 => 1.2394, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.52% (1.4186 => 1.4827, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.35% (2.2024 => 2.2983, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.4064 => 0.4239, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.2842 => 1.3379, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/objinst: 4.09% (0.3131 => 0.3259, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.88% (0.3817 => 0.3965, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.8101 => 0.8373, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.09% (0.3427 => 0.3533, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7979, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.49% (1.1194 => 1.1473, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (3.8922 => 3.9619, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.64% (3.6395 => 3.7718, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2482, std.dev.: 0.0205) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8063, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2652, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.04% (5.3855 => 3.6599, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.68% (5.3526 => 3.6569, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1187, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/mason/mason: -14.06% (0.0811 => 0.0697, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.37% (2.9384 => 2.6042, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.23% (22.1758 => 19.9064, std.dev.: 0.4678) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -9.07% (0.2161 => 0.1965, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2994, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.03% (1.6805 => 1.5959, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9957 => 0.9518, std.dev.: 0.0139) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0388) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5119, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1694, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.16% (8.6802 => 8.4931, std.dev.: 0.0064) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -2.01% (1.2373 => 1.2124, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std.dev.: 0.0297) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0061, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.67% (0.5229 => 0.5787, std.dev.: 0.0208) MultiSource/Applications/SPASS/SPASS: 7.08% (14.9895 => 16.0501, std.dev.: 0.3469) MultiSource/Applications/kimwitu++/kc: 5.65% (14.1553 => 14.9549, std.dev.: 0.0466) MultiSource/Benchmarks/MallocBench/gs/gs: 5.44% (4.1105 => 4.3341, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.14% (1.1048 => 1.2389, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.31% (7.1582 => 7.5381, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.33% (0.6222 => 0.7238, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.71% (0.2116 => 0.2101, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 02:03:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 04:03:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925090345.98B8C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4220?compare_to=4218&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4220, Order: 164589, Start Time: 2012-09-25 07:50:46, End Time: 2012-09-25 09:05:16 To: 4218, Order: 164587, Start Time: 2012-09-25 06:04:53, End Time: 2012-09-25 07:21:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.67% (2.0176 => 2.4347, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.73% (0.2243 => 0.2551, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.98% (0.5748 => 0.6494, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.81% (0.5818 => 0.6563, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.33% (0.0819 => 0.0920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.25% (0.7061 => 0.7926, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.58% (0.4328 => 0.4829, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.54% (0.2781 => 0.3102, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.21% (0.2782 => 0.3094, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.20% (0.4062 => 0.4517, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 11.13% (1.3693 => 1.5217, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.00% (0.2655 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.78% (0.2607 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2760 => 0.3057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (0.2628 => 0.2910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.67% (0.2690 => 0.2977, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.67% (3.9660 => 4.3890, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.60% (1.9828 => 2.1930, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.60% (0.2765 => 0.3058, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2726 => 0.3013, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.52% (0.2966 => 0.3278, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.49% (0.7710 => 0.8519, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.49% (1.4563 => 1.6091, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.45% (0.2937 => 0.3244, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.43% (0.4016 => 0.4435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.31% (0.2696 => 0.2974, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.28% (0.9199 => 1.0145, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 10.27% (0.3107 => 0.3426, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.26% (0.3489 => 0.3847, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.25% (0.2721 => 0.3000, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.18% (1.2193 => 1.3434, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.17% (0.3756 => 0.4138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.16% (0.3149 => 0.3469, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.10% (0.7038 => 0.7749, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 10.07% (0.2988 => 0.3289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.03% (0.3580 => 0.3939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.90% (0.5265 => 0.5786, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.89% (0.6959 => 0.7647, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 9.88% (0.3453 => 0.3794, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4390 => 0.4819, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 9.68% (0.3534 => 0.3876, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.61% (13.8202 => 15.1487, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.50% (1.1364 => 1.2444, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.31% (0.6283 => 0.6868, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.88% (0.5577 => 0.6072, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.75% (0.3246 => 0.3530, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.75% (1.0313 => 1.1215, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.72% (0.4379 => 0.4761, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.65% (0.2127 => 0.2311, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 8.60% (16.6129 => 18.0418, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 8.45% (0.2995 => 0.3248, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.44% (0.6576 => 0.7131) MultiSource/Applications/Burg/burg: 8.42% (1.1061 => 1.1992, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.36% (0.3755 => 0.4069, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.34% (7.2180 => 7.8197, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.27% (0.8698 => 0.9417, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3578 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.20% (0.2914 => 0.3153, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.17% (0.3646 => 0.3944, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.15% (0.7506 => 0.8118, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.11% (0.7460 => 0.8065, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.07% (0.5637 => 0.6092, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 8.06% (0.3623 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.04% (0.3220 => 0.3479, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.4791 => 0.5174, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.99% (0.8310 => 0.8974, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.73% (0.6744 => 0.7265, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 7.67% (3.1889 => 3.4334, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 7.66% (3.8646 => 4.1606, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.59% (1.0594 => 1.1398, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 7.47% (1.9270 => 2.0710, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3398, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 7.22% (1.2292 => 1.3180, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.20% (3.6692 => 3.9333, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.16% (1.3245 => 1.4193, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 6.95% (0.4113 => 0.4399, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 6.94% (1.2749 => 1.3634, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 6.89% (14.8535 => 15.8775, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.87% (0.2140 => 0.2287, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.87% (0.3131 => 0.3346, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.87% (4.3801 => 4.6808, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 6.81% (4.6629 => 4.9806, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (8.4961 => 9.0727, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.77% (4.4433 => 4.7443, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.76% (0.8818 => 0.9414, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1569 => 0.1675, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.75% (0.6135 => 0.6549, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 6.67% (0.6250 => 0.6667, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.47% (1.1333 => 1.2066, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.90% (3.2742 => 3.4674, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.89% (0.4805 => 0.5088, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.75% (4.9865 => 5.2732, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.64% (0.3245 => 0.3428, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.46% (1.5188 => 1.6017, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (6.5754 => 6.9338, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.28% (6.2785 => 6.6097, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.15% (0.9108 => 0.9577, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (13.2842 => 13.9642, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 5.01% (3.7467 => 3.9345, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.96% (2.1007 => 2.2049, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.90% (0.3511 => 0.3648, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.30% (16.2614 => 16.7981, std.dev.: 0.0290) MultiSource/Applications/ClamAV/clamscan: 2.79% (14.5298 => 14.9357, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std.dev.: 0.0510) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7039, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0811, std.dev.: 0.0354) SingleSource/Regression/C/uint64_to_float: 2.95% (0.5449 => 0.5610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.03% (7.4271 => 7.5779, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0512, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5838, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5959, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.16% (0.4657 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.04% (1.3813 => 1.1874, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.93% (1.3819 => 1.1894, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.5627 => 21.5300, std.dev.: 0.0261) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.24% (0.0997 => 0.0865, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -11.26% (0.2238 => 0.1986, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.91% (20.3410 => 18.3245, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.60% (0.9996 => 0.9636, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0244) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9538, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2491, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6615 => 0.6506, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1075, std.dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2219, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 02:53:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 04:53:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925095317.364152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4221?compare_to=4217&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4221, Order: 164592, Start Time: 2012-09-25 08:34:13, End Time: 2012-09-25 09:54:49 To: 4217, Order: 164586, Start Time: 2012-09-25 05:09:13, End Time: 2012-09-25 06:26:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (77 on baseline) Performance Improvements: 2 (46 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 890 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9008 => 0.9251, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.25% (1.3192 => 1.3753, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.52% (2.3820 => 2.4421, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: 1.73% (2.3954 => 2.4368, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.31% (21.9490 => 22.2362, std.dev.: 0.1033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -14.15% (2.7619 => 2.3712, std.dev.: 0.1235) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.13% (1.0960 => 1.0836, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.32% (1.0178 => 1.0145, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: -0.83% (0.5891 => 0.5842, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: -0.48% (0.1666 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.19% (0.1322 => 0.1293, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (0.2976 => 0.2945, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.2174 => 0.2242, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.33% (0.3002 => 0.3012, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.2069 => 0.2121, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0281 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -36.17% (0.0047 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.41% (0.0078 => 0.0073, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0191 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 30.87% (0.0298 => 0.0390, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.35% (0.0299 => 0.0280, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0323 => 0.0326, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 62.73% (0.0110 => 0.0179, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -5.74% (0.0122 => 0.0115, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.18% (0.0254 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -31.45% (0.0124 => 0.0085, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1439 => 0.1438, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: -0.43% (0.2301 => 0.2291, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.02% (1.4110 => 1.5101, std.dev.: 0.0117) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.50% (0.1456 => 0.1507, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.32% (0.5911 => 0.5892, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.08% (24.8048 => 26.8088, std.dev.: 0.0569) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.80% (0.4002 => 0.4074, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.27% (0.1403 => 0.1329, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.72% (0.0565 => 0.0544, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.56% (0.0180 => 0.0199, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.10% (0.0587 => 0.0658, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.57% (1.1256 => 1.1320, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0011 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.23% (0.0570 => 0.0577, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.75% (0.0160 => 0.0138, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7653 => 0.7654, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.03% (1.7061 => 1.7066, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2291, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -91.55% (6.9722 => 0.5892, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 21572.43% (0.1237 => 26.8088, std.dev.: 0.0569) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.30% (4.1772 => 3.1204, std.dev.: 0.7620) SingleSource/Benchmarks/Shootout-C++/except: 81083.33% (0.0006 => 0.4871, std.dev.: 0.0093) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.89% (0.0745 => 0.0923, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (0.1414 => 0.1552, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.47% (0.6410 => 0.6953, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 8.42% (2.1763 => 2.3595, std.dev.: 0.0305) SingleSource/Benchmarks/Misc-C++/bigfib: 8.19% (0.5309 => 0.5744, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.88% (0.6173 => 0.6598, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 6.78% (1.0046 => 1.0727, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 6.59% (1.1653 => 1.2421, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 6.34% (15.3105 => 16.2817, std.dev.: 0.0757) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.2552 => 0.2713, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.22% (1.5150 => 1.6092, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (0.6915 => 0.7307, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.64% (0.3901 => 0.4121, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.03% (0.3582 => 0.3762, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.97% (0.7639 => 0.8019, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.76% (0.2797 => 0.2930, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.75% (1.1672 => 1.2227, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 4.61% (2.0972 => 2.1939, std.dev.: 0.0204) MultiSource/Applications/d/make_dparser: 4.51% (3.0225 => 3.1587, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.21% (0.4248 => 0.4427, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 4.16% (13.3238 => 13.8778, std.dev.: 0.1170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.94% (0.6069 => 0.6308, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.85% (0.2886 => 0.2997, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (6.2546 => 6.4928, std.dev.: 0.0424) MultiSource/Applications/treecc/treecc: 3.80% (1.8798 => 1.9512, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.4408 => 1.4948, std.dev.: 0.0139) MultiSource/Applications/Burg/burg: 3.65% (1.1440 => 1.1857, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 3.56% (0.8405 => 0.8704, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (3.0758 => 3.1847, std.dev.: 0.0348) MultiSource/Benchmarks/Bullet/bullet: 3.52% (29.3170 => 30.3504, std.dev.: 0.1840) MultiSource/Applications/hbd/hbd: 3.49% (1.3268 => 1.3731, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (8.2186 => 8.4995, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.34% (0.8569 => 0.8855, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.28% (0.5937 => 0.6132, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (12.6413 => 13.0525, std.dev.: 0.1376) MultiSource/Applications/oggenc/oggenc: 3.23% (4.7455 => 4.8987, std.dev.: 0.0518) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.0821 => 1.1170, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.7226 => 0.7457, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 3.16% (3.5980 => 3.7116, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (3.8796 => 3.9980, std.dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.00% (2.0317 => 2.0927, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 2.98% (14.7256 => 15.1638, std.dev.: 0.0829) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (4.0318 => 4.1396, std.dev.: 0.0345) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.48% (4.2616 => 4.3674, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9029 => 0.9251, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.34% (4.3380 => 4.4394, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4880 => 0.4990, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.20% (6.4908 => 6.6337, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (8.2559 => 8.4262, std.dev.: 0.0659) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.00% (1.2742 => 1.2997, std.dev.: 0.0097) MultiSource/Applications/spiff/spiff: 1.52% (0.7738 => 0.7856, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.26% (4.0101 => 4.5420, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0135) SingleSource/Benchmarks/Stanford/Puzzle: 9.42% (0.1433 => 0.1568, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6014, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.68% (1.0063 => 1.0836, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (0.3301 => 0.3540, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.12% (40.4792 => 42.5522, std.dev.: 0.4476) MultiSource/Benchmarks/Olden/bisort/bisort: 5.11% (0.6459 => 0.6789, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/dt: 4.60% (0.9851 => 1.0304, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 4.55% (15.2242 => 15.9162, std.dev.: 0.0318) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8860, std.dev.: 0.0283) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8094, std.dev.: 0.0243) MultiSource/Applications/siod/siod: 2.54% (3.5520 => 3.6422, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.52% (2.6656 => 2.7329, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7150, std.dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.86% (0.5876 => 0.5985, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 1.81% (2.4013 => 2.4447, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (2.4455 => 2.4832, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.03% (27.1724 => 27.4518, std.dev.: 0.0383) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.69% (0.2996 => 0.1657, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.35% (1.4189 => 1.1301, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.09% (1.4113 => 1.1277, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.31% (5.2665 => 4.1440, std.dev.: 0.0493) SingleSource/Benchmarks/Shootout-C++/ary3: -19.80% (1.7473 => 1.4014, std.dev.: 0.0554) MultiSource/Benchmarks/FreeBench/mason/mason: -16.83% (0.5004 => 0.4162, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.39% (1.7361 => 1.4689, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.00% (15.8312 => 13.4569, std.dev.: 0.6155) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1576, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -10.76% (0.3746 => 0.3343, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.64% (1.1647 => 1.0524, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.79% (1.4034 => 1.2801, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -8.30% (9.5474 => 8.7549, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.28% (3.2007 => 2.9358, std.dev.: 0.0516) MultiSource/Applications/lambda-0_1_3/lambda: -7.10% (7.6833 => 7.1377, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3762, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3311, std.dev.: 0.0362) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.53% (2.0027 => 1.8720, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.86% (3.4230 => 3.2223, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/distray/distray: -5.44% (0.2664 => 0.2519, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -5.30% (1.4441 => 1.3676, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1881, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.81% (45.4683 => 43.2828, std.dev.: 0.6571) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.73% (0.4140 => 0.3944, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7908, std.dev.: 0.0213) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.85% (1.2722 => 1.2232, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/methcall: -3.21% (9.2503 => 8.9538, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bh/bh: -3.17% (2.5166 => 2.4368, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.12% (3.7496 => 3.6327, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8209, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.27% (1.1683 => 1.1418, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.09% (1.0686 => 1.0463, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4228, std.dev.: 0.0232) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3664, std.dev.: 0.0219) MultiSource/Benchmarks/PAQ8p/paq8p: -1.75% (92.7467 => 91.1209, std.dev.: 0.5317) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.68% (61.1734 => 60.1474, std.dev.: 0.3978) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2387, std.dev.: 0.0220) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -1.27% (2.4971 => 2.4655, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.65% (0.9980 => 1.0145, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: -2.99% (0.6022 => 0.5842, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: -0.48% (0.1666 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.80% (0.1554 => 0.1293, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (0.3083 => 0.2945, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.35% (0.2394 => 0.2242, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.13% (0.3175 => 0.3012, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.86% (0.2302 => 0.2121, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -37.42% (0.0449 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.58% (0.0240 => 0.0073, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.98% (0.0301 => 0.0280, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -39.15% (0.0189 => 0.0115, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -73.85% (0.0325 => 0.0085, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1429 => 0.1438, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 0.55% (1.5019 => 1.5101, std.dev.: 0.0117) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.40% (0.1501 => 0.1507, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.46% (0.4264 => 0.4074, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.12% (0.1344 => 0.1329, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.64% (0.0589 => 0.0544, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0232 => 0.0199, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.97% (0.0639 => 0.0658, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1350 => 1.1320, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.42% (0.0637 => 0.0577, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.90% (0.0246 => 0.0138, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7066, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 03:47:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 05:47:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925104700.CB6552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4222?compare_to=4220&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4222, Order: 164592, Start Time: 2012-09-25 09:34:08, End Time: 2012-09-25 10:48:32 To: 4220, Order: 164589, Start Time: 2012-09-25 07:50:46, End Time: 2012-09-25 09:05:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.76% (54.4100 => 56.4578, std.dev.: 0.1331) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.09% (2.0176 => 2.4431, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 12.48% (0.5818 => 0.6544, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5748 => 0.6456, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.74% (0.7061 => 0.7890, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.39% (0.1413 => 0.1574, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 11.09% (0.4328 => 0.4808, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 10.97% (0.2781 => 0.3086, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.95% (1.3693 => 1.5192, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.71% (0.1588 => 0.1758, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.66% (3.9660 => 4.3886, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.49% (0.4062 => 0.4488, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.39% (0.3899 => 0.4304, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.25% (0.2596 => 0.2862, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.19% (1.9828 => 2.1849, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.18% (1.2193 => 1.3434, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.15% (1.4563 => 1.6041, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.14% (0.3756 => 0.4137, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.10% (0.9199 => 1.0128, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (0.2765 => 0.3043, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.04% (0.7710 => 0.8484, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.03% (0.3489 => 0.3839, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.01% (0.5265 => 0.5792, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.92% (0.2761 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.89% (0.4016 => 0.4413, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.85% (0.3107 => 0.3413, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.83% (0.7038 => 0.7730, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 9.80% (0.3868 => 0.4247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.77% (0.3192 => 0.3504, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.73% (0.6959 => 0.7636, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.58% (0.3130 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.52% (0.6283 => 0.6881, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.42% (1.1364 => 1.2435, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.41% (0.3453 => 0.3778, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.39% (13.8202 => 15.1183, std.dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.29% (0.4390 => 0.4798, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 9.22% (0.3534 => 0.3860, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.96% (0.3246 => 0.3537, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.80% (0.5577 => 0.6068, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2127 => 0.2310, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.56% (0.4379 => 0.4754, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 8.54% (1.0313 => 1.1194, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 8.41% (0.2995 => 0.3247, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 8.38% (16.6129 => 18.0052, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.30% (0.5637 => 0.6105, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 8.30% (0.7506 => 0.8129, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 8.30% (1.1061 => 1.1979, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.29% (0.4791 => 0.5188, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (7.2180 => 7.8104, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 8.19% (0.3578 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.17% (0.2914 => 0.3152, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.12% (0.8310 => 0.8985, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.08% (0.3650 => 0.3945, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.05% (0.8698 => 0.9398, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3914 => 0.4228, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3755 => 0.4056, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3663 => 0.3956, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.97% (0.6576 => 0.7100, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 7.94% (0.4003 => 0.4321, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3623 => 0.3910, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3220 => 0.3474, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.7460 => 0.8044, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2023 => 0.2181, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 7.79% (0.3940 => 0.4247, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.76% (0.6744 => 0.7267, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.67% (1.0594 => 1.1407, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.59% (3.1889 => 3.4309, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.47% (1.9270 => 2.0709, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 7.46% (3.8646 => 4.1528, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.32% (2.1791 => 2.3386, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.16% (1.3245 => 1.4194, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.11% (3.6692 => 3.9302, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 7.05% (14.8535 => 15.9001, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 7.01% (1.2292 => 1.3154, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.97% (1.2749 => 1.3637, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 6.93% (0.3131 => 0.3348, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (8.4961 => 9.0775, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 6.83% (0.4113 => 0.4394, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.79% (4.3801 => 4.6773, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.78% (4.4433 => 4.7445, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.67% (0.6135 => 0.6544, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.50% (0.2140 => 0.2279, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.36% (4.6629 => 4.9594, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (1.1333 => 1.2045, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.26% (0.8818 => 0.9370, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6250 => 0.6640, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.4805 => 0.5095, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.89% (3.2742 => 3.4671, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.67% (4.9865 => 5.2690, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.45% (1.5188 => 1.6016, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.40% (6.5754 => 6.9306, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.39% (0.3245 => 0.3420, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.27% (0.9108 => 0.9588, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.08% (13.2842 => 13.9596, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (6.2785 => 6.5970, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.90% (3.7467 => 3.9303, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.90% (2.1007 => 2.2036, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.32% (16.2614 => 16.8009, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 2.86% (14.5298 => 14.9447, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std.dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7071, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.18% (10.7476 => 11.0889, std.dev.: 0.0221) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5907, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5159, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5830, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5963, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.57% (0.2670 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.29% (0.4657 => 0.3945, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.42% (1.3813 => 1.1821, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.27% (1.3819 => 1.1847, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.76% (22.5627 => 21.4886, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.04% (0.2238 => 0.1991, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3030, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.16% (1.3780 => 1.2931, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.43% (0.9996 => 0.9553, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1583, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9509, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.24% (1.9762 => 1.9319, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.65% (26.5159 => 26.0777, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.62% (0.6615 => 0.6508) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7920, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2162, std.dev.: 0.0442) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4329, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 04:23:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 06:23:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925112314.CD3E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4223?compare_to=4219&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4223, Order: 164593, Start Time: 2012-09-25 10:06:13, End Time: 2012-09-25 11:24:45 To: 4219, Order: 164588, Start Time: 2012-09-25 06:23:55, End Time: 2012-09-25 07:44:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 0 (150 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 21 (17 on baseline) Unchanged Tests: 949 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.47% (0.5787 => 0.5814, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 0.68% (16.0501 => 16.1592, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 0.84% (14.9549 => 15.0809, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.19% (54.0098 => 54.6516, std.dev.: 0.0323) MultiSource/Benchmarks/MallocBench/gs/gs: 0.60% (4.3341 => 4.3601, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.2389 => 1.2409, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.59% (7.5381 => 7.5823, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.62% (0.7238 => 0.7283, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.19% (0.2101 => 0.2105, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.59% (63.2438 => 54.6516, std.dev.: 0.0323) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 59.09% (3.4629 => 5.5090, std.dev.: 0.0229) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14240.56% (0.0720 => 10.3252, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.65% (0.2554 => 0.3771, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 46.13% (10.3673 => 15.1493, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 28.98% (0.1622 => 0.2092, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.99% (2.2022 => 2.5544, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.41% (7.0540 => 8.1408, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.79% (0.1566 => 0.1782, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (1.7609 => 1.9785, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.53% (10.4361 => 11.6396, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.01% (9.4845 => 10.3388, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.81% (1.5415 => 1.6773, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.64% (0.8172 => 0.8878, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.59% (0.3177 => 0.3450, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.38% (0.2758 => 0.2989, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 8.36% (0.3109 => 0.3369, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 8.32% (0.7115 => 0.7707, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.31% (0.6675 => 0.7230, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.26% (0.7433 => 0.8047, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.10% (0.4615 => 0.4989, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 8.09% (0.3423 => 0.3700, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.06% (0.1625 => 0.1756, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.01% (1.3050 => 1.4095, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.86% (0.3422 => 0.3691, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 7.85% (5.7591 => 6.2113, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.83% (0.5569 => 0.6005, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.79% (0.2271 => 0.2448, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.8067 => 0.8693, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.74% (0.4636 => 0.4995, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.74% (4.2646 => 4.5947, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 7.73% (0.1695 => 0.1826, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.71% (3.3354 => 3.5927, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (8.1363 => 8.7627, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.70% (0.5860 => 0.6311, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7326 => 0.7888, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.59% (0.2700 => 0.2905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.56% (0.4103 => 0.4413, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 7.44% (0.7835 => 0.8418, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 7.42% (1.5603 => 1.6760, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.38% (4.9449 => 5.3097, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.37% (0.5105 => 0.5481, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6456 => 0.6931, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.33% (5.0018 => 5.3685, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.30% (0.9765 => 1.0478, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.27% (0.3121 => 0.3348, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2891 => 0.3101, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.26% (0.2107 => 0.2260, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2905 => 0.3114, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.18% (0.4289 => 0.4597, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.17% (0.3136 => 0.3361, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.16% (1.1642 => 1.2475, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 7.10% (0.2831 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.08% (0.3603 => 0.3858, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (7.9617 => 8.5228, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.04% (0.4203 => 0.4499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.04% (0.3865 => 0.4137, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.96% (0.1940 => 0.2075, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2877 => 0.3077, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.92% (2.0665 => 2.2096, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.90% (0.3232 => 0.3455, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2756 => 0.2946, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 6.82% (0.3387 => 0.3618, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists1: 6.81% (0.3684 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.75% (0.5020 => 0.5359, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2871 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (1.1861 => 1.2658, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4620 => 0.4927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.59% (1.0722 => 1.1429, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 6.57% (3.8723 => 4.1267, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/random: 6.57% (0.2802 => 0.2986, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.4299 => 0.4577, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.42% (21.9371 => 23.3461, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.42% (0.2603 => 0.2770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.24% (0.8921 => 0.9478, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 6.24% (2.0273 => 2.1538, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.3180 => 0.3377, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.97% (2.2969 => 2.4341, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.77% (0.6450 => 0.6822, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.62% (1.5859 => 1.6751, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.52% (0.5981 => 0.6311, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.4186 => 1.4963, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.4064 => 0.4274, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.15% (1.1840 => 1.2450, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.07% (2.2024 => 2.3140, std.dev.: 0.0186) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.2842 => 1.3481, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.8101 => 0.8430, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.82% (0.3817 => 0.3963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.62% (0.3427 => 0.3551, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (14.3668 => 14.8819, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 3.11% (17.1811 => 17.7148, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.05% (1.1194 => 1.1535, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (3.8922 => 3.9878, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7716, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2499, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8073, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.97% (5.2763 => 3.2730, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.37% (5.3855 => 3.6422, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.99% (5.3526 => 3.6405, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0920, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.34% (2.9384 => 2.6051, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -9.89% (22.1758 => 19.9828, std.dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -9.21% (0.2161 => 0.1962, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2774, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1616, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.46% (0.9957 => 0.9612, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1706, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9925, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5101, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0971, std.dev.: 0.0256) SingleSource/UnitTests/Vector/multiplies: -1.76% (2.5528 => 2.5079, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2223, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.19% (0.5229 => 0.5814, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 7.80% (14.9895 => 16.1592, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 6.54% (14.1553 => 15.0809, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 6.07% (4.1105 => 4.3601, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.32% (1.1048 => 1.2409, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.92% (7.1582 => 7.5823, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.05% (0.6222 => 0.7283, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.52% (0.2116 => 0.2105, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 04:33:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 06:33:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925113333.069952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4224?compare_to=4221&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4224, Order: 164593, Start Time: 2012-09-25 10:10:55, End Time: 2012-09-25 11:35:04 To: 4221, Order: 164592, Start Time: 2012-09-25 08:34:13, End Time: 2012-09-25 09:54:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (76 on baseline) Performance Improvements: 6 (46 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 881 (765 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.85% (0.2754 => 0.2860, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.0927 => 2.1439, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 15.38% (3.0337 => 3.5003, std.dev.: 0.1258) SingleSource/Benchmarks/Shootout-C++/ary3: 4.87% (1.4014 => 1.4696, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.68% (0.7617 => 0.7897, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: 2.49% (1.3921 => 1.4268, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.89% (4.6388 => 4.7263, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.71% (42.5522 => 43.2802, std.dev.: 0.2404) MultiSource/Applications/SIBsim4/SIBsim4: 1.67% (3.2223 => 3.2761, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.37% (1.2761 => 1.2936, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.58% (0.7856 => 0.7653, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: -2.09% (3.9980 => 3.9145, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.98% (1.2227 => 1.1985, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.95% (4.3776 => 4.2921, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.42% (4.1396 => 4.0808, std.dev.: 0.0161) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (6.4928 => 6.4226, std.dev.: 0.0259) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.84% (1.0145 => 1.0060, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 0.07% (0.5842 => 0.5846, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.30% (0.1658 => 0.1663, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.17% (0.1293 => 0.1321, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.94% (0.2945 => 0.2888, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.07% (0.2242 => 0.2218, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.56% (0.3012 => 0.2995, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.64% (0.2121 => 0.2065, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -19.93% (0.0281 => 0.0225, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -12.64% (0.0087 => 0.0076, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0030 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.85% (0.0073 => 0.0078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0193 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.86% (0.0280 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.74% (0.0326 => 0.0291, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0179 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 66.09% (0.0115 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0251 => 0.0252, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -12.94% (0.0085 => 0.0074, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.92% (0.1438 => 0.1396, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 0.09% (0.2291 => 0.2293, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -10.62% (1.5101 => 1.3498, std.dev.: 0.0816) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.33% (0.1507 => 0.1512, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.58% (0.5892 => 0.5926, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -6.04% (26.8088 => 25.1897, std.dev.: 0.9015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.42% (0.4074 => 0.4091, std.dev.: 0.0680) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.20% (0.1329 => 0.1438, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.50% (0.0544 => 0.0612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.07% (0.0199 => 0.0173, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.46% (0.0658 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1320 => 1.1328, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.67% (0.0015 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.0577 => 0.0539, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.78% (0.0138 => 0.0186, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.7654 => 0.7667, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.05% (1.7066 => 1.7057, std.dev.: 0.0051) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.05% (0.0121 => 0.0104, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2293, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -91.50% (6.9722 => 0.5926, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 20263.54% (0.1237 => 25.1897, std.dev.: 0.9015) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.61% (4.1772 => 3.1076, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/except: 83283.33% (0.0006 => 0.5003, std.dev.: 0.0173) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.63% (0.1414 => 0.1536, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.58% (0.6410 => 0.6960, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 8.44% (0.5309 => 0.5757, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 8.37% (2.1763 => 2.3585, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 7.47% (1.0046 => 1.0796, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 6.47% (15.3105 => 16.3017, std.dev.: 0.1194) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (1.1653 => 1.2386, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.11% (0.3582 => 0.3801, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.67% (0.3901 => 0.4122, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 5.61% (0.6173 => 0.6519, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.52% (2.0317 => 2.1439, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.37% (0.2552 => 0.2689, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 5.35% (0.6915 => 0.7285, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.20% (0.7639 => 0.8036, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 5.03% (3.0225 => 3.1745, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.5150 => 1.5860, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4248 => 0.4440, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.47% (0.2797 => 0.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.41% (0.3062 => 0.3197, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.37% (0.6069 => 0.6334, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 4.17% (2.0972 => 2.1847, std.dev.: 0.0125) MultiSource/Applications/hbd/hbd: 4.16% (1.3268 => 1.3820, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (3.0758 => 3.1997, std.dev.: 0.0412) MultiSource/Applications/SPASS/SPASS: 3.83% (13.3238 => 13.8346, std.dev.: 0.0720) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.63% (0.8569 => 0.8880, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 3.58% (0.2877 => 0.2980, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.50% (4.7455 => 4.9118, std.dev.: 0.0514) MultiSource/Applications/Burg/burg: 3.49% (1.1440 => 1.1839, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4880 => 0.5039, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0821 => 1.1165, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.17% (1.2021 => 1.2402, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 3.06% (29.3170 => 30.2152, std.dev.: 0.2434) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.2186 => 8.4697, std.dev.: 0.0718) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8405 => 0.8652, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 2.91% (3.5980 => 3.7027, std.dev.: 0.0156) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.69% (6.2546 => 6.4226, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1672 => 1.1985, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 2.62% (1.8798 => 1.9291, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.7256 => 15.0928, std.dev.: 0.0988) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (4.2616 => 4.3596, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (12.6413 => 12.9237, std.dev.: 0.0579) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.5963 => 0.6094, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.4908 => 6.6283, std.dev.: 0.0383) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.41% (4.3380 => 4.3993, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.2559 => 8.3571, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (4.0318 => 4.0808, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.52% (1.6538 => 2.3405, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.21% (3.4629 => 4.2321, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.69% (3.0256 => 3.5003, std.dev.: 0.1258) SingleSource/Benchmarks/Shootout/ary3: 15.44% (1.7426 => 2.0116, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.38% (4.0101 => 4.5466, std.dev.: 0.0120) SingleSource/Benchmarks/Stanford/Puzzle: 12.49% (0.1433 => 0.1612, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8059, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6342, std.dev.: 0.0307) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.44% (0.2857 => 0.3098, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.18% (1.0063 => 1.0886, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.30% (0.3301 => 0.3542, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.92% (40.4792 => 43.2802, std.dev.: 0.2404) SingleSource/Benchmarks/Misc/dt: 4.66% (0.9851 => 1.0310, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5422, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8206, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.78% (0.7609 => 0.7897, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.96% (3.5520 => 3.6572, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 2.90% (14.4877 => 14.9075, std.dev.: 0.0625) SingleSource/Benchmarks/Shootout-C++/hash: 2.81% (0.6308 => 0.6485, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8098, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.55% (2.6656 => 2.7336, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.46% (4.6127 => 4.7263, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: 2.32% (2.4013 => 2.4569, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.65% (1.2726 => 1.2936, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4455 => 2.4852, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.07% (1.4117 => 1.4268, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (4.6414 => 4.6903, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.19% (0.2996 => 0.1642, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.26% (1.4113 => 1.1254, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.24% (1.4189 => 1.1317, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.04% (0.3497 => 0.2062, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.26% (5.2665 => 4.1994, std.dev.: 0.0580) SingleSource/Benchmarks/Shootout-C++/ary3: -15.89% (1.7473 => 1.4696, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/mason/mason: -15.61% (0.5004 => 0.4223, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.13% (1.7361 => 1.4735, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -12.39% (0.3746 => 0.3282, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1629, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -8.33% (9.5474 => 8.7521, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.46% (3.2007 => 2.9619, std.dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: -6.92% (7.6833 => 7.1514, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.6254 => 3.3793, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.75% (3.6023 => 3.3593, std.dev.: 0.0852) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.45% (2.0027 => 1.8736, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -6.37% (4.6355 => 4.3402, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/distray/distray: -6.19% (0.2664 => 0.2499, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -5.91% (1.4441 => 1.3587, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/fib2: -5.00% (4.4195 => 4.1984, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.78% (0.4140 => 0.3942, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -4.29% (3.4230 => 3.2761, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -4.14% (62.4126 => 59.8275, std.dev.: 0.1645) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (2.5166 => 2.4251, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/misr: -3.63% (0.4296 => 0.4140, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2323, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: -3.13% (9.2503 => 8.9608, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8211, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.54% (1.1683 => 1.1386, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.34% (3.7496 => 3.6618, std.dev.: 0.0156) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6897, std.dev.: 0.7524) MultiSource/Applications/aha/aha: -1.96% (3.4286 => 3.3615, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3122, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -1.80% (3.4876 => 3.4247, std.dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2202, std.dev.: 0.0173) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8231, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: -1.65% (1.0926 => 1.0746, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3311, std.dev.: 0.0766) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.01% (1.8739 => 1.8549, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.80% (0.9980 => 1.0060, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -2.92% (0.6022 => 0.5846, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -0.18% (0.1666 => 0.1663, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.99% (0.1554 => 0.1321, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.33% (0.3083 => 0.2888, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.35% (0.2394 => 0.2218, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.67% (0.3175 => 0.2995, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.30% (0.2302 => 0.2065, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -49.89% (0.0449 => 0.0225, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -14.61% (0.0089 => 0.0076, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -67.50% (0.0240 => 0.0078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.19% (0.0324 => 0.0291, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -77.23% (0.0325 => 0.0074, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.31% (0.1429 => 0.1396, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -10.13% (1.5019 => 1.3498, std.dev.: 0.0816) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1501 => 0.1512, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4264 => 0.4091, std.dev.: 0.0680) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.43% (0.0232 => 0.0173, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0639 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1350 => 1.1328, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.38% (0.0637 => 0.0539, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.39% (0.0246 => 0.0186, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.67% (0.7541 => 0.7667, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.03% (1.5363 => 1.7057, std.dev.: 0.0051) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.57% (0.0070 => 0.0104, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 05:30:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 07:30:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925123018.1C15F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4225?compare_to=4222&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4225, Order: 164598, Start Time: 2012-09-25 11:17:28, End Time: 2012-09-25 12:31:49 To: 4222, Order: 164592, Start Time: 2012-09-25 09:34:08, End Time: 2012-09-25 10:48:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.64% (42.0574 => 42.7476, std.dev.: 0.0571) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.10% (1.2264 => 1.2129, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.09% (2.0176 => 2.4432, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954) MultiSource/Benchmarks/McCat/08-main/main: 13.51% (0.2243 => 0.2546, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.39% (0.5818 => 0.6539, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.28% (0.5748 => 0.6454, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.92% (0.7061 => 0.7903, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.97% (0.2781 => 0.3086, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 10.95% (0.4328 => 0.4802, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.75% (1.3693 => 1.5165, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.66% (3.9660 => 4.3889, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.36% (0.4062 => 0.4483, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.36% (0.2596 => 0.2865, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.7038 => 0.7762, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.16% (0.9199 => 1.0134, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.07% (1.4563 => 1.6029, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.04% (0.2760 => 0.3037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.02% (0.1327 => 0.1460, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.02% (1.2193 => 1.3415, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.01% (0.7710 => 0.8482, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.98% (1.9828 => 2.1806, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3489 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.97% (0.5265 => 0.5790, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.82% (0.2761 => 0.3032, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.81% (0.2721 => 0.2988, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.78% (0.3293 => 0.3615, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.74% (0.4016 => 0.4407, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.73% (0.6959 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.72% (0.3580 => 0.3928, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.69% (0.3868 => 0.4243, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.61% (0.2696 => 0.2955, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.46% (0.3149 => 0.3447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.31% (13.8202 => 15.1075, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.25% (1.1364 => 1.2415, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.15% (0.3453 => 0.3769, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.14% (0.6283 => 0.6857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.05% (0.3534 => 0.3854, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.95% (0.4390 => 0.4783, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.70% (16.6129 => 18.0581, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.66% (0.5577 => 0.6060, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.65% (0.2127 => 0.2311, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.63% (0.3246 => 0.3526, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.53% (1.0313 => 1.1193, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.45% (1.1061 => 1.1996, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4379 => 0.4748, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 8.31% (0.2995 => 0.3244, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.15% (0.7506 => 0.8118, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.12% (7.2180 => 7.8040, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.07% (0.5637 => 0.6092, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.06% (0.2914 => 0.3149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 8.03% (0.8310 => 0.8977, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.93% (0.8698 => 0.9388, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.87% (0.4791 => 0.5168, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.83% (0.3755 => 0.4049, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3220 => 0.3472, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.73% (0.7460 => 0.8037, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.67% (0.6744 => 0.7261, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 7.56% (3.8646 => 4.1568, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.50% (3.1889 => 3.4280, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 7.48% (1.0594 => 1.1386, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.44% (1.9270 => 2.0704, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.38% (2.1791 => 2.3400, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.37% (0.4003 => 0.4298, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3914 => 0.4200, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.30% (0.3601 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.26% (0.3663 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4189, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3153, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.95% (3.6692 => 3.9241, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (1.2749 => 1.3621, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 6.82% (14.8535 => 15.8659, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.65% (4.4433 => 4.7387, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.64% (4.3801 => 4.6709, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.59% (8.4961 => 9.0564, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.59% (0.2140 => 0.2281, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.54% (0.6135 => 0.6536, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.37% (1.1333 => 1.2055, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.28% (4.6629 => 4.9557, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 6.16% (0.6250 => 0.6635, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2504 => 0.2658, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.10% (0.8818 => 0.9356, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.04% (3.2742 => 3.4720, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.40% (4.9865 => 5.2558, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.31% (1.5188 => 1.5995, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.28% (6.5754 => 6.9224, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.04% (6.2785 => 6.5950, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.98% (0.9108 => 0.9562, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.91% (3.7467 => 3.9306, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (13.2842 => 13.9254, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.81% (2.1007 => 2.2018, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3511 => 0.3646, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.31% (16.2614 => 16.7992, std.dev.: 0.0180) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9104, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std.dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.74% (1.1560 => 1.2570, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7054, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.18% (10.7476 => 11.0894, std.dev.: 0.0202) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5828, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.64% (0.2670 => 0.1398, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.85% (0.4657 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.41% (1.3819 => 1.1827, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.37% (1.3813 => 1.1828, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.89% (22.5627 => 21.4600, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.26% (0.2238 => 0.1986, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2712, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.25% (1.3780 => 1.2919, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9996 => 0.9551, std.dev.: 0.0061) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9521, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2413, std.dev.: 0.0150) MultiSource/Applications/lua/lua: -1.75% (26.5159 => 26.0506, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6615 => 0.6506, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7908, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -1.45% (1.2308 => 1.2129, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2098, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 05:49:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 07:49:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120925124909.401FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4226?compare_to=4213&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4226, Order: 164593, Start Time: 2012-09-25 10:06:34, End Time: 2012-09-25 12:50:41 To: 4213, Order: 164571, Start Time: 2012-09-25 00:15:10, End Time: 2012-09-25 02:59:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (134 on baseline) Performance Improvements: 18 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.24% (0.4060 => 0.4760, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: 1.74% (2.4850 => 2.5283, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.65% (54.0902 => 54.9838, std.dev.: 0.0319) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.46% (0.7115 => 0.7011, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.31% (2.1548 => 2.1265, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -1.26% (2.3127 => 2.2835, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -1.25% (4.9432 => 4.8812, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: -1.25% (4.5305 => 4.4739, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -1.23% (1.5238 => 1.5051, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -1.23% (1.7711 => 1.7494, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -1.20% (2.2558 => 2.2287, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (2.9638 => 2.9282, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: -1.16% (1.1624 => 1.1489, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.16% (1.7590 => 1.7386, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -1.13% (5.9900 => 5.9223, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.13% (2.1186 => 2.0947, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: -1.09% (2.0053 => 1.9834, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.07% (1.4279 => 1.4126, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.06% (3.8642 => 3.8231, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (2.0930 => 2.0714, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.02% (4.7319 => 4.6838, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.03% (0.3442 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.98% (0.3465 => 0.3880, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 11.96% (0.3446 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.90% (0.3496 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3469 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.76% (0.3460 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.45% (0.3650 => 0.4068, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3643 => 0.4057, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 9.80% (1.5932 => 1.7494, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5826 => 0.6332, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.5889 => 0.6396, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.14% (0.2875 => 0.3109, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.92% (0.3004 => 0.3242, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.82% (0.3195 => 0.3445, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.79% (0.2823 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.76% (0.2911 => 0.3137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.71% (0.2738 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2750 => 0.2961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2729 => 0.2938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.62% (2.0673 => 2.2248, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2813 => 0.3027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.60% (0.2803 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.2780 => 0.2990, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.54% (0.4361 => 0.4690, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2792 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.44% (0.2811 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.41% (1.3152 => 1.4126, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.38% (0.9909 => 1.0640, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 7.36% (0.3096 => 0.3324, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.36% (0.5000 => 0.5368, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (3.5627 => 3.8231, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.29% (2.7292 => 2.9282, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3267 => 0.3505, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7171 => 0.7691, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (1.6211 => 1.7386, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.21% (0.4994 => 0.5354, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3258 => 0.3492, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3060 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3282 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3317 => 0.3550, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.3362 => 0.3598, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.96% (0.3348 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.95% (0.3124 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3678 => 0.3933, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 6.93% (23.5202 => 25.1504, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/sieve: 6.87% (0.3726 => 0.3982, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 6.87% (5.5417 => 5.9223, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.87% (0.3845 => 0.4109, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3477 => 0.3713, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.3625 => 0.3871, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.61% (0.1968 => 0.2098, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.57% (1.0781 => 1.1489, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.53% (0.5900 => 0.6285, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4146 => 0.4416, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (0.5026 => 0.5353, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.48% (0.3690 => 0.3929, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4251 => 0.4526, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.3981 => 0.4234, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (0.3930 => 0.4178, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.29% (0.2736 => 0.2908, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 6.25% (4.2109 => 4.4739, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 6.09% (0.5012 => 0.5317, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.06% (2.1013 => 2.2287, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.04% (0.2566 => 0.2721, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.98% (4.4195 => 4.6838, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.90% (0.2866 => 0.3035, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.84% (0.6435 => 0.6811, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.83% (0.9697 => 1.0262, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 5.71% (4.6177 => 4.8812, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 5.68% (0.6634 => 0.7011, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.68% (0.4139 => 0.4374, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.66% (0.4029 => 0.4257, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.2068 => 0.2183, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.55% (0.2737 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.53% (1.8794 => 1.9834, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.3903 => 0.4117, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.48% (1.4269 => 1.5051, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (0.3890 => 0.4103, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.46% (2.1653 => 2.2835, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.29% (0.3084 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.18% (1.9694 => 2.0714, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.15% (0.4658 => 0.4898, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 5.14% (0.5546 => 0.5831, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.14% (0.3271 => 0.3439, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 5.10% (0.3336 => 0.3506, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 5.08% (0.7875 => 0.8275, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.91% (1.9966 => 2.0947, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.85% (0.2969 => 0.3113, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.80% (0.2103 => 0.2204, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.52% (2.0346 => 2.1265, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (0.2691 => 0.2805, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.22% (0.2391 => 0.2492, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.02% (0.4847 => 0.5042, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (0.7426 => 0.7714, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.69% (0.5361 => 0.5559, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 3.52% (0.3498 => 0.3621, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.41% (0.4253 => 0.4398, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.40% (0.5584 => 0.5774, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.29% (11.6398 => 12.0222, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.24% (4.6926 => 4.8448, std.dev.: 0.0166) MultiSource/Applications/kimwitu++/kc: 2.20% (11.9555 => 12.2182, std.dev.: 0.0157) SingleSource/UnitTests/Vector/constpool: 2.10% (2.4764 => 2.5283, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.60% (3.3903 => 3.6141, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6725, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std.dev.: 0.1465) SingleSource/Benchmarks/Misc/flops-2: 4.44% (1.8057 => 1.8858, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6321, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1951, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5014, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4418, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.49% (2.0820 => 2.1130, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2843, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5917, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4489, std.dev.: 0.0593) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5818, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8020, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.12% (2.1113 => 1.9609, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7960, std.dev.: 0.0115) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.98% (17.2379 => 16.7236, std.dev.: 0.0490) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.75% (0.6293 => 0.6120, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0433, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 06:06:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 08:06:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925130642.508352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4227?compare_to=4224&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4227, Order: 164598, Start Time: 2012-09-25 11:50:58, End Time: 2012-09-25 13:08:14 To: 4224, Order: 164593, Start Time: 2012-09-25 10:10:55, End Time: 2012-09-25 11:35:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (72 on baseline) Performance Improvements: 2 (44 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 890 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 46.08% (0.0293 => 0.0428, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 33.11% (0.0305 => 0.0406, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.8912 => 0.9431, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (21.4651 => 22.5746, std.dev.: 0.0649) SingleSource/Benchmarks/Misc/whetstone: 2.14% (2.3476 => 2.3979, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (3.5003 => 3.3063, std.dev.: 0.0292) MultiSource/Applications/SIBsim4/SIBsim4: -1.02% (3.2761 => 3.2426, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.56% (1.0060 => 1.0217, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.5846 => 0.5859, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1663 => 0.1644, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.08% (0.1321 => 0.1322, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.52% (0.2888 => 0.2873, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.34% (0.2218 => 0.2144, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.2995 => 0.2994, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.68% (0.2065 => 0.2079, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 20.00% (0.0225 => 0.0270, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: 11.84% (0.0076 => 0.0085, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0030 => 0.0029, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.69% (0.0078 => 0.0072, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.06% (0.0192 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.57% (0.0302 => 0.0258, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.23% (0.0284 => 0.0272, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.62% (0.0291 => 0.0263, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -46.07% (0.0178 => 0.0096, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/test1: -1.57% (0.0191 => 0.0188, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -2.78% (0.0252 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 29.73% (0.0074 => 0.0096, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.30% (0.1396 => 0.1442, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 0.22% (0.2293 => 0.2298, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 9.51% (1.3498 => 1.4781, std.dev.: 0.0319) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.38% (0.1512 => 0.1476, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.47% (0.5926 => 0.5898, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.25% (25.1897 => 26.7634, std.dev.: 0.0426) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.76% (0.4091 => 0.4060, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.53% (0.1438 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.15% (0.0612 => 0.0556, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.81% (0.0173 => 0.0209, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.30% (0.0661 => 0.0659, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.15% (1.1328 => 1.1198, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 68.75% (0.0016 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.24% (0.0539 => 0.0578, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.45% (0.0186 => 0.0198, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7667 => 0.7673, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.05% (1.7057 => 1.7065, std.dev.: 0.0072) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.35% (0.0104 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2298, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -91.54% (6.9722 => 0.5898, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 21535.73% (0.1237 => 26.7634, std.dev.: 0.0426) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.37% (4.1772 => 3.1176, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 8.75% (2.1763 => 2.3668, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.71% (0.1159 => 0.1260, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6410 => 0.6968, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 7.57% (0.5309 => 0.5711, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.87% (0.3582 => 0.3828, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.76% (0.6173 => 0.6590, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 6.67% (0.6915 => 0.7376, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 6.53% (15.3105 => 16.3099, std.dev.: 0.2318) MultiSource/Applications/lemon/lemon: 6.33% (1.0046 => 1.0682, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (1.1653 => 1.2385, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.5150 => 1.5874, std.dev.: 0.0184) MultiSource/Applications/d/make_dparser: 4.72% (3.0225 => 3.1653, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.58% (0.2797 => 0.2925, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (0.7639 => 0.7975, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 4.32% (1.1440 => 1.1934, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (1.0689 => 1.1138, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 4.02% (13.3238 => 13.8599, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.88% (1.2021 => 1.2488, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2654 => 0.2757, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3217 => 0.3340, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 3.79% (2.0972 => 2.1766, std.dev.: 0.0186) MultiSource/Applications/oggenc/oggenc: 3.65% (4.7455 => 4.9187, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (12.6413 => 13.0999, std.dev.: 0.0831) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.56% (0.3062 => 0.3171, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 3.56% (3.5980 => 3.7260, std.dev.: 0.0341) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2546 => 6.4758, std.dev.: 0.0324) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (1.1672 => 1.2083, std.dev.: 0.0126) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.0821 => 1.1195, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.42% (29.3170 => 30.3182, std.dev.: 0.1229) MultiSource/Benchmarks/mafft/pairlocalalign: 3.25% (8.2186 => 8.4859, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/football/football: 3.21% (0.8405 => 0.8675, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.04% (1.8798 => 1.9370, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.7226 => 0.7445, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.1827 => 1.2183, std.dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 2.93% (14.7256 => 15.1573, std.dev.: 0.0424) MultiSource/Applications/hbd/hbd: 2.37% (1.3268 => 1.3582, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (6.4908 => 6.6209, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.3380 => 4.4094, std.dev.: 0.0197) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.87% (0.0263 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 41.51% (1.6538 => 2.3403, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 15.05% (1.7426 => 2.0049, std.dev.: 0.0307) SingleSource/Benchmarks/Stanford/Puzzle: 14.52% (0.1433 => 0.1641, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.70% (4.0101 => 4.5596, std.dev.: 0.0120) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.98% (0.8498 => 0.9431, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.31% (0.2857 => 0.3123, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.28% (3.0256 => 3.3063, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/lists: 9.15% (7.0025 => 7.6433, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/mst/mst: 8.12% (0.1417 => 0.1532, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.06% (1.0063 => 1.0874, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (0.3301 => 0.3522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.53% (40.4792 => 43.1210, std.dev.: 0.1900) SingleSource/Benchmarks/Misc/dt: 4.05% (0.9851 => 1.0250, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8292, std.dev.: 0.0293) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.82% (2.6656 => 2.7674, std.dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.76% (3.4080 => 3.5362, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.58% (0.5587 => 0.5787, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 2.86% (14.4877 => 14.9022, std.dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (6.6312 => 6.8111, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 2.45% (8.5113 => 8.7202, std.dev.: 0.0680) SingleSource/Benchmarks/Misc/whetstone: 2.24% (2.3453 => 2.3979, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.6127 => 4.7090, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (2.4013 => 2.4495, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (2.4455 => 2.4916, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.06% (22.3381 => 22.5746, std.dev.: 0.0649) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.76% (0.2996 => 0.1655, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.56% (1.4189 => 1.1272, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.07% (1.4113 => 1.1281, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.64% (5.2665 => 4.1796, std.dev.: 0.0473) SingleSource/Benchmarks/Shootout-C++/ary3: -20.34% (1.7473 => 1.3919, std.dev.: 0.0376) MultiSource/Benchmarks/FreeBench/mason/mason: -17.01% (0.5004 => 0.4153, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.18% (1.7361 => 1.4725, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.72% (15.8312 => 13.6596, std.dev.: 0.6083) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1606, std.dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: -10.92% (0.3746 => 0.3337, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.66% (1.1647 => 1.0522, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.76% (1.4034 => 1.2804, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -8.44% (9.5474 => 8.7420, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9389, std.dev.: 0.0263) MultiSource/Applications/lambda-0_1_3/lambda: -7.10% (7.6833 => 7.1381, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3755, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/fibo: -6.46% (4.6355 => 4.3362, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/richards_benchmark: -6.16% (1.4441 => 1.3552, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0172) MultiSource/Applications/SIBsim4/SIBsim4: -5.27% (3.4230 => 3.2426, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1868, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/distray/distray: -4.88% (0.2664 => 0.2534, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: -4.33% (0.4296 => 0.4110, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.23% (0.4140 => 0.3965, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8252, std.dev.: 0.1951) MultiSource/Applications/SPASS/SPASS: -4.08% (8.5323 => 8.1843, std.dev.: 0.0925) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9440, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.12% (3.7496 => 3.6327, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.96% (3.9413 => 3.8248, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (2.5166 => 2.4487, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -2.24% (92.7467 => 90.6659, std.dev.: 0.4596) SingleSource/Benchmarks/Shootout-C++/hash2: -2.01% (3.4876 => 3.4174, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: -1.88% (3.8907 => 3.8177, std.dev.: 0.0071) MultiSource/Applications/aha/aha: -1.84% (3.4286 => 3.3654, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2311, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3147, std.dev.: 0.0304) SingleSource/Benchmarks/Dhrystone/fldry: -1.11% (2.4971 => 2.4694, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.37% (0.9980 => 1.0217, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: -2.71% (0.6022 => 0.5859, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -1.32% (0.1666 => 0.1644, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.93% (0.1554 => 0.1322, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (0.3083 => 0.2873, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.44% (0.2394 => 0.2144, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.70% (0.3175 => 0.2994, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.69% (0.2302 => 0.2079, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -39.87% (0.0449 => 0.0270, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -4.49% (0.0089 => 0.0085, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -70.00% (0.0240 => 0.0072, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.06% (0.0192 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.29% (0.0301 => 0.0258, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.23% (0.0284 => 0.0272, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.83% (0.0324 => 0.0263, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -45.76% (0.0177 => 0.0096, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -70.46% (0.0325 => 0.0096, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.91% (0.1429 => 0.1442, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.58% (1.5019 => 1.4781, std.dev.: 0.0319) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.67% (0.1501 => 0.1476, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.36% (0.1344 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.0589 => 0.0556, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.91% (0.0232 => 0.0209, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.13% (0.0639 => 0.0659, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.34% (1.1350 => 1.1198, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.26% (0.0637 => 0.0578, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.51% (0.0246 => 0.0198, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.75% (0.7541 => 0.7673, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0072) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 06:10:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 08:10:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925131043.5941F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4228?compare_to=4223&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4228, Order: 164598, Start Time: 2012-09-25 11:53:51, End Time: 2012-09-25 13:12:15 To: 4223, Order: 164593, Start Time: 2012-09-25 10:06:13, End Time: 2012-09-25 11:24:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 1 (3 on baseline) Performance Regressions: 4 (154 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (16 on baseline) Unchanged Tests: 944 (687 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/kimwitu++/kc: 23.75% (15.0809 => 18.6626, std.dev.: 0.0167) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 2.05% (0.6503 => 0.6636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 1.96% (0.6393 => 0.6518, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 1.84% (15.1493 => 15.4277, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.69% (79.0688 => 80.4060, std.dev.: 0.0954) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.33% (1.2278 => 1.2115, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.24% (0.5814 => 0.5800, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -0.08% (16.1592 => 16.1459, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: -0.24% (54.6516 => 54.5195, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 0.08% (4.3601 => 4.3635, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2409 => 1.2425, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.40% (7.5823 => 7.5518, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.52% (0.7283 => 0.7321, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.66% (0.2105 => 0.2070, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.79% (63.2438 => 54.5195, std.dev.: 0.0200) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.84% (14.1553 => 18.6626, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.72% (3.4629 => 5.4962, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14239.03% (0.0720 => 10.3241, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.81% (10.3673 => 15.4277, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 48.32% (0.2554 => 0.3788, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 27.62% (0.1622 => 0.2070, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.68% (2.2022 => 2.5476, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.01% (0.1432 => 0.1647, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.77% (7.0540 => 8.0960, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.92% (0.1566 => 0.1784, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.55% (0.0834 => 0.0947, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.04% (1.7609 => 1.9906, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3473 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3543 => 0.3998, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.73% (0.3497 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3543 => 0.3993, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.66% (0.3516 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.55% (0.3561 => 0.4008, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.97% (0.3886 => 0.4351, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 11.10% (10.4361 => 11.5941, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/oourafft: 10.27% (0.3282 => 0.3619, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 10.05% (0.6030 => 0.6636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.01% (0.5925 => 0.6518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.65% (0.7326 => 0.8033, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.10% (0.3177 => 0.3466, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.98% (9.4845 => 10.3359, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 8.68% (0.1440 => 0.1565, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.61% (0.8172 => 0.8876, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.61% (0.4879 => 0.5299, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.5415 => 1.6723, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.43% (0.3121 => 0.3384, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 8.39% (0.7115 => 0.7712, std.dev.: 0.0138) MultiSource/Applications/sgefa/sgefa: 8.27% (0.3109 => 0.3366, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.23% (0.2758 => 0.2985, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.21% (0.4615 => 0.4994, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.18% (0.8067 => 0.8727, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.15% (0.2271 => 0.2456, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 8.14% (0.7433 => 0.8038, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 8.09% (0.3423 => 0.3700, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6675 => 0.7212, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.99% (1.3050 => 1.4093, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 7.96% (0.1695 => 0.1830, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.95% (0.3422 => 0.3694, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.88% (0.1625 => 0.1753, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (4.2646 => 4.5970, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (8.1363 => 8.7668, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.73% (0.5860 => 0.6313, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 7.73% (3.3354 => 3.5931, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 7.70% (5.7591 => 6.2024, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.61% (0.4636 => 0.4989, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.61% (0.2891 => 0.3111, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.54% (0.9765 => 1.0501, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.49% (4.9449 => 5.3154, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.47% (5.0018 => 5.3756, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.46% (0.3136 => 0.3370, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5569 => 0.5984, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.45% (0.2725 => 0.2928, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.44% (0.2700 => 0.2901, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.43% (0.4103 => 0.4408, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.43% (0.7835 => 0.8417, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4289 => 0.4603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.23% (0.3650 => 0.3914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.22% (0.2756 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.22% (0.3865 => 0.4144, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.16% (0.3826 => 0.4100, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.15% (2.0665 => 2.2142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.14% (0.2872 => 0.3077, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.14% (0.4203 => 0.4503, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (7.9617 => 8.5296, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.11% (0.1940 => 0.2078, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 7.11% (0.2714 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.11% (0.6456 => 0.6915, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.11% (0.3307 => 0.3542, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.3098 => 0.3318, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2871 => 0.3074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.03% (0.5105 => 0.5464, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2802 => 0.2999) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.3232 => 0.3457, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.95% (1.5603 => 1.6688, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.95% (0.5020 => 0.5369, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.95% (0.3684 => 0.3940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.94% (0.3603 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4299 => 0.4594, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2877 => 0.3074, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 6.79% (1.1642 => 1.2432, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4620 => 0.4932, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 6.70% (0.3387 => 0.3614, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.68% (0.3441 => 0.3671, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 6.68% (3.8723 => 4.1309, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.61% (1.1861 => 1.2645, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 6.58% (21.9371 => 23.3811, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: 6.57% (1.0722 => 1.1426, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.49% (0.2603 => 0.2772, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.29% (0.3180 => 0.3380, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 6.26% (2.0273 => 2.1543, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 6.21% (0.8921 => 0.9475, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.98% (0.6450 => 0.6836, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.77% (0.1906 => 0.2016, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.75% (2.2969 => 2.4290, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.68% (0.5981 => 0.6321, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2266 => 0.2392, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.42% (1.5859 => 1.6719, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (0.4064 => 0.4281, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (1.4186 => 1.4930, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 5.19% (1.2842 => 1.3508, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 5.16% (1.1840 => 1.2451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.08% (0.3817 => 0.4011, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.88% (2.2024 => 2.3099, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.00% (0.8101 => 0.8425, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.3427 => 0.3549, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (14.3668 => 14.8650, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.31% (1.1194 => 1.1565, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.19% (17.1811 => 17.7288, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.8922 => 3.9935, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.04% (3.1578 => 3.3800, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7640, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2562, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8073, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.83% (5.2763 => 3.2803, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.59% (5.3855 => 3.6305, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.25% (5.3526 => 3.6263, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1285, std.dev.: 0.0320) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.39% (2.9384 => 2.6038, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -9.75% (22.1758 => 20.0142, std.dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4274, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.25% (0.2161 => 0.1961, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.19% (19.9488 => 18.3145, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.77% (1.8329 => 1.7088, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5961, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.93% (0.9957 => 0.9566, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4963, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3296, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1712, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.13% (8.1563 => 7.9825, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/chomp: -2.09% (1.2373 => 1.2115, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5141, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0923, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2299, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.92% (0.5229 => 0.5800, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.71% (14.9895 => 16.1459, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 6.15% (4.1105 => 4.3635, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.46% (1.1048 => 1.2425, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.50% (7.1582 => 7.5518, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.66% (0.6222 => 0.7321, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (0.2116 => 0.2070, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 07:30:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 09:30:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925143054.3E11B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4229?compare_to=4225&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4229, Order: 164601, Start Time: 2012-09-25 13:18:02, End Time: 2012-09-25 14:32:25 To: 4225, Order: 164598, Start Time: 2012-09-25 11:17:28, End Time: 2012-09-25 12:31:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.85% (54.8848 => 56.4494, std.dev.: 0.0329) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.18% (2.0176 => 2.4450, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 12.41% (0.5818 => 0.6540, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.32% (0.7061 => 0.7931, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 12.23% (0.5748 => 0.6451, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.57% (0.1072 => 0.1196, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.00% (0.4328 => 0.4804, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 10.71% (1.3693 => 1.5159, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.65% (3.9660 => 4.3885, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.32% (0.4062 => 0.4481, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.30% (0.7710 => 0.8504, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.24% (0.7038 => 0.7759, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.24% (0.9199 => 1.0141, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.21% (0.3899 => 0.4297, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.19% (0.3485 => 0.3840, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.18% (1.4563 => 1.6045, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.10% (1.2193 => 1.3425, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 10.07% (0.2690 => 0.2961, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.02% (1.9828 => 2.1815, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.88% (0.5265 => 0.5785, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.86% (0.3489 => 0.3833, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.85% (0.2721 => 0.2989, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.84% (0.4016 => 0.4411, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.82% (0.2761 => 0.3032, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.81% (0.6959 => 0.7642, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 9.81% (0.2937 => 0.3225, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.72% (0.3756 => 0.4121, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.69% (0.3580 => 0.3927, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.3868 => 0.4237, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 9.50% (0.3149 => 0.3448, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 9.27% (13.8202 => 15.1012, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.26% (1.1364 => 1.2416, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 9.24% (0.3453 => 0.3772, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.20% (0.6283 => 0.6861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.11% (0.3534 => 0.3856, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.97% (0.4390 => 0.4784, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.75% (0.5577 => 0.6065, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.58% (1.0313 => 1.1198, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 8.56% (16.6129 => 18.0344, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4379 => 0.4752, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.48% (0.2995 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 8.34% (0.7506 => 0.8132, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.29% (1.1061 => 1.1978, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.24% (0.2914 => 0.3154, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.15% (7.2180 => 7.8061, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.12% (0.5637 => 0.6095, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.97% (0.8698 => 0.9391, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.97% (0.8310 => 0.8972, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3220 => 0.3476, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.94% (0.6576 => 0.7098, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.86% (0.3755 => 0.4050, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.86% (0.7460 => 0.8046, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.81% (0.4791 => 0.5165, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 7.62% (3.8646 => 4.1591, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.52% (0.6744 => 0.7251, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.50% (1.9270 => 2.0716, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 7.48% (1.0594 => 1.1386, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3578 => 0.3845, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.39% (3.1889 => 3.4245, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3398, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 7.33% (0.3601 => 0.3865, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.32% (1.3245 => 1.4214, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.26% (0.3663 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 7.16% (0.3940 => 0.4222, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.04% (3.6692 => 3.9275, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.84% (4.3801 => 4.6797, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.83% (0.3131 => 0.3345, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.82% (14.8535 => 15.8667, std.dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 6.77% (1.2292 => 1.3124, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 6.71% (1.2749 => 1.3605, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.66% (4.4433 => 4.7392, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.2140 => 0.2282, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.60% (0.6135 => 0.6540, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.58% (8.4961 => 9.0549, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2059, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.35% (0.2504 => 0.2663, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.25% (4.6629 => 4.9543, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.10% (0.8818 => 0.9356, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.6250 => 0.6627, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.90% (3.2742 => 3.4674, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.4805 => 0.5082, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.52% (4.9865 => 5.2616, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.37% (1.5188 => 1.6003, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.28% (6.5754 => 6.9226, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (6.2785 => 6.5938, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.00% (0.9108 => 0.9563, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.89% (2.1007 => 2.2035, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.86% (3.7467 => 3.9288, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.81% (13.2842 => 13.9227, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.76% (0.3511 => 0.3643, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.33% (16.2614 => 16.8032, std.dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9093, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.11% (1.0895 => 1.3631, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2557, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4133, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7054, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0972, std.dev.: 0.0201) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5947, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5834, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9268, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5920, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.64% (0.2670 => 0.1398, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.45% (1.3819 => 1.1822, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.38% (1.3813 => 1.1827, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.94% (22.5627 => 21.4488, std.dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2803, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.66% (1.3780 => 1.3000, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.65% (0.9996 => 0.9531, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.77% (26.5159 => 26.0467, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2486, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7918, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2204, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.19% (4.4810 => 4.4279, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0310 => 1.0203, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 07:36:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 09:36:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925143616.602362A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4230?compare_to=4227&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4230, Order: 164601, Start Time: 2012-09-25 13:24:03, End Time: 2012-09-25 14:37:40 To: 4227, Order: 164598, Start Time: 2012-09-25 11:50:58, End Time: 2012-09-25 13:08:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 4 (79 on baseline) Performance Improvements: 6 (50 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 887 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.94% (1.3582 => 1.3846, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.15% (2.8747 => 3.0515, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bisort/bisort: 1.69% (0.6682 => 0.6795, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.29% (4.4976 => 4.5555, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -1.78% (1.1138 => 1.0940, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.52% (2.1090 => 2.0770, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.69% (45.0597 => 42.9458, std.dev.: 0.7841) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.83% (0.9431 => 0.9070, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.81% (2.7674 => 2.7173, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.17% (2.4487 => 2.4200, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.61% (1.0217 => 1.0052, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.27% (0.5859 => 0.5843, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 0.36% (0.1644 => 0.1650, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.83% (0.1322 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (0.2873 => 0.2906, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.66% (0.2144 => 0.2201, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (0.2994 => 0.2961, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.24% (0.2079 => 0.2074, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 2.96% (0.0270 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 2.35% (0.0085 => 0.0087, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 206.90% (0.0029 => 0.0089) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.39% (0.0072 => 0.0053, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.56% (0.0117 => 0.0114, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.50% (0.0258 => 0.0218, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.68% (0.0272 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 23.19% (0.0263 => 0.0324, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 1.04% (0.0096 => 0.0097, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: -19.68% (0.0188 => 0.0151, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 4.08% (0.0245 => 0.0255, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: 28.13% (0.0096 => 0.0123, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1442 => 0.1440, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -0.70% (0.2298 => 0.2282, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 0.47% (1.4781 => 1.4850, std.dev.: 0.0153) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.03% (0.1476 => 0.1506, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.37% (0.5898 => 0.5876, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.57% (26.7634 => 26.6101, std.dev.: 0.3091) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4060 => 0.4028, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.10% (0.1416 => 0.1358, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.44% (0.0556 => 0.0548, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.78% (0.0209 => 0.0219, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.46% (0.0659 => 0.0662, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.13% (1.1198 => 1.1324, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -51.85% (0.0027 => 0.0013, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.88% (0.0578 => 0.0544, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.75% (0.0198 => 0.0149, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.22% (0.7673 => 0.7656, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.52% (1.7065 => 1.6977, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2282, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -91.57% (6.9722 => 0.5876, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 21411.80% (0.1237 => 26.6101, std.dev.: 0.3091) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.76% (4.1772 => 3.0178, std.dev.: 0.0630) SingleSource/Benchmarks/Shootout-C++/except: 82133.33% (0.0006 => 0.4934, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.64% (0.6410 => 0.6964, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 7.81% (2.1763 => 2.3462, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.12% (0.3582 => 0.3837, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 6.99% (0.5309 => 0.5680, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (1.1653 => 1.2398, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.39% (1.0046 => 1.0688, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 5.90% (15.3105 => 16.2132, std.dev.: 0.0329) MultiSource/Applications/lambda-0_1_3/lambda: 5.70% (0.6915 => 0.7309, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 5.57% (0.6173 => 0.6517, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.54% (0.3901 => 0.4117, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.50% (1.5150 => 1.5984, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.98% (0.2552 => 0.2679, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.63% (0.2654 => 0.2777, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.37% (3.0225 => 3.1547, std.dev.: 0.0422) MultiSource/Applications/hbd/hbd: 4.36% (1.3268 => 1.3846, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.32% (0.7639 => 0.7969, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.93% (0.2797 => 0.2907, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.6069 => 0.6305, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 3.71% (13.3238 => 13.8187, std.dev.: 0.1161) MultiSource/Benchmarks/McCat/18-imp/imp: 3.64% (0.3217 => 0.3334, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (8.2186 => 8.5142, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 3.46% (4.7455 => 4.9096, std.dev.: 0.0514) MultiSource/Applications/siod/siod: 3.40% (2.0972 => 2.1685, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.1827 => 1.2223, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.31% (1.1672 => 1.2058, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (0.8405 => 0.8680, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.18% (6.2546 => 6.4534, std.dev.: 0.0273) MultiSource/Applications/lua/lua: 3.14% (3.5980 => 3.7110, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 3.11% (29.3170 => 30.2296, std.dev.: 0.0984) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.11% (1.2021 => 1.2395, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.10% (3.0758 => 3.1711, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.01% (1.4408 => 1.4842, std.dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0821 => 1.1145, std.dev.: 0.0102) MultiSource/Applications/Burg/burg: 2.95% (1.1440 => 1.1778, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.85% (0.8569 => 0.8813, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.80% (1.8798 => 1.9325, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (12.6413 => 12.9872, std.dev.: 0.0590) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5636 => 0.5790, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.7256 => 15.1203, std.dev.: 0.0852) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.56% (0.5937 => 0.6089, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.7226 => 0.7402, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.35% (1.0689 => 1.0940, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.0317 => 2.0770, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (4.3380 => 4.4307, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.05% (0.4880 => 0.4980, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (4.2616 => 4.3364, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.60% (8.2559 => 8.3879, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (4.0318 => 4.0933, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.17% (0.0261 => 0.0405, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5462, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.96% (0.1433 => 0.1590, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.39% (7.0025 => 7.5897, std.dev.: 0.0592) MultiSource/Benchmarks/Olden/mst/mst: 7.48% (0.1417 => 0.1523, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (0.3301 => 0.3531, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.89% (1.0063 => 1.0756, std.dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.73% (0.8498 => 0.9070, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.36% (40.4792 => 42.6490, std.dev.: 0.2736) MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.35% (2.8964 => 3.0515, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bisort/bisort: 5.20% (0.6459 => 0.6795, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.02% (4.2129 => 4.4245, std.dev.: 0.0587) SingleSource/Benchmarks/Shootout-C++/hash: 4.61% (0.6308 => 0.6599, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/dt: 4.57% (0.9851 => 1.0301, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.49% (15.2242 => 15.9079, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.94% (14.4877 => 14.9135, std.dev.: 0.0375) MultiSource/Applications/siod/siod: 2.86% (3.5520 => 3.6536, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8094, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.94% (2.6656 => 2.7173, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: 1.55% (2.4013 => 2.4385, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4455 => 2.4806, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4346, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.06% (0.2996 => 0.1676, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.65% (1.4189 => 1.1401, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.23% (1.4113 => 1.1399, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.04% (0.3497 => 0.2062, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.43% (5.2665 => 4.1378, std.dev.: 0.2246) MultiSource/Benchmarks/FreeBench/mason/mason: -16.43% (0.5004 => 0.4182, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.79% (15.8312 => 13.3318, std.dev.: 0.8067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.24% (1.7361 => 1.4715, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1572, std.dev.: 0.0507) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.20% (3.6023 => 3.1989, std.dev.: 0.1468) MultiSource/Applications/sgefa/sgefa: -10.86% (0.3746 => 0.3339, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.63% (1.1647 => 1.0525, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7530, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.15% (3.2007 => 2.9399, std.dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: -7.05% (7.6833 => 7.1415, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.94% (3.6254 => 3.3739, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3284, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.60% (2.0027 => 1.8706, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.74% (3.4230 => 3.2266, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.55% (45.4683 => 42.9458, std.dev.: 0.7841) SingleSource/Benchmarks/Misc/richards_benchmark: -5.32% (1.4441 => 1.3673, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1849, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/distray/distray: -5.26% (0.2664 => 0.2524, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.46% (1.2959 => 1.2381, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.35% (0.4140 => 0.3960, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -4.24% (62.4126 => 59.7633, std.dev.: 0.0246) MultiSource/Benchmarks/Olden/bh/bh: -3.84% (2.5166 => 2.4200, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.67% (2.4457 => 2.3559, std.dev.: 0.0336) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.64% (1.2722 => 1.2259, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.58% (3.7496 => 3.6154, std.dev.: 0.0304) SingleSource/Benchmarks/McGill/misr: -3.56% (0.4296 => 0.4143, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (9.2503 => 8.9378, std.dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8209, std.dev.: 0.0268) MultiSource/Benchmarks/PAQ8p/paq8p: -2.41% (92.7467 => 90.5135, std.dev.: 0.2044) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4182, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3569 => 2.3135, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -1.83% (3.4286 => 3.3658, std.dev.: 0.0137) MultiSource/Benchmarks/sim/sim: -1.80% (3.8907 => 3.8208, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.61% (61.1734 => 60.1863, std.dev.: 0.3764) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2353, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4617, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3073, std.dev.: 0.0695) MultiSource/Applications/lua/lua: -1.30% (29.5232 => 29.1407, std.dev.: 0.0796) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.72% (0.9980 => 1.0052, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -2.97% (0.6022 => 0.5843, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -0.96% (0.1666 => 0.1650, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.22% (0.1554 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (0.3083 => 0.2906, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.06% (0.2394 => 0.2201, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.74% (0.3175 => 0.2961, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.90% (0.2302 => 0.2074, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -38.08% (0.0449 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -77.92% (0.0240 => 0.0053, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -40.62% (0.0192 => 0.0114, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.57% (0.0301 => 0.0218, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -45.20% (0.0177 => 0.0097, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: -20.11% (0.0189 => 0.0151, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: -62.15% (0.0325 => 0.0123, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1429 => 0.1440, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -1.13% (1.5019 => 1.4850, std.dev.: 0.0153) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.33% (0.1501 => 0.1506, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.53% (0.4264 => 0.4028, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.04% (0.1344 => 0.1358, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.96% (0.0589 => 0.0548, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.60% (0.0232 => 0.0219, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.60% (0.0639 => 0.0662, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1350 => 1.1324, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.60% (0.0637 => 0.0544, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.43% (0.0246 => 0.0149, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.52% (0.7541 => 0.7656, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 10.51% (1.5363 => 1.6977, std.dev.: 0.0059) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 07:58:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 09:58:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925145839.7B40C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4231?compare_to=4228&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4231, Order: 164601, Start Time: 2012-09-25 13:41:13, End Time: 2012-09-25 15:00:10 To: 4228, Order: 164598, Start Time: 2012-09-25 11:53:51, End Time: 2012-09-25 13:12:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (3 on baseline) Performance Regressions: 3 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (16 on baseline) Unchanged Tests: 947 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.85% (0.4078 => 0.4765, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.7961 => 56.6560, std.dev.: 0.0636) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.40% (29.2485 => 29.6588, std.dev.: 0.0928) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.59% (0.5800 => 0.5834, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 0.05% (16.1459 => 16.1544, std.dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: 0.05% (54.5195 => 54.5489, std.dev.: 0.0362) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.3635 => 4.3561, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2425 => 1.2428, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.5518 => 7.5558, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.25% (0.7321 => 0.7339, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0359 => 0.0358, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (0.2070 => 0.2096, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.75% (63.2438 => 54.5489, std.dev.: 0.0362) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.93% (14.1553 => 18.6745, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.57% (3.4629 => 5.4910, std.dev.: 0.0071) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14240.28% (0.0720 => 10.3250, std.dev.: 0.0076) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.89% (10.3673 => 15.4362, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: 48.28% (0.2554 => 0.3787, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 31.06% (0.1056 => 0.1384, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 27.68% (0.1622 => 0.2071, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.69% (2.2022 => 2.5477, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.94% (0.1432 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.79% (7.0540 => 8.0973, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.98% (0.1566 => 0.1785, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3473 => 0.3928, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.03% (1.7609 => 1.9904, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 12.88% (0.3516 => 0.3969, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3543 => 0.3999, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.84% (0.3497 => 0.3946, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 12.66% (0.3561 => 0.4012, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3694 => 0.4157, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3828 => 0.4299, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.28% (10.4361 => 11.6138, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.24% (0.1584 => 0.1762, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 10.30% (0.3282 => 0.3620, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5925 => 0.6523, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.03% (0.6030 => 0.6635, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.23% (0.8172 => 0.8926, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.22% (0.3177 => 0.3470, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.11% (9.4845 => 10.3485, std.dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7326 => 0.7990, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.87% (1.5415 => 1.6782, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 8.68% (0.1440 => 0.1565, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.3121 => 0.3391, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.65% (0.4879 => 0.5301, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.47% (0.7835 => 0.8499, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 8.46% (0.7433 => 0.8062, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 8.46% (0.3109 => 0.3372, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.8067 => 0.8744, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 8.39% (0.7115 => 0.7712, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 8.33% (0.3423 => 0.3708, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 8.21% (0.3422 => 0.3703, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.19% (0.2758 => 0.2984, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.17% (0.4615 => 0.4992, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.16% (1.3050 => 1.4115, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.15% (0.6675 => 0.7219, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.10% (0.2271 => 0.2455, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.3162 => 0.3417, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.06% (0.1625 => 0.1756, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 8.02% (0.1695 => 0.1831, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.81% (0.4289 => 0.4624, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (4.2646 => 4.5974, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.78% (8.1363 => 8.7695, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.77% (3.3354 => 3.5945, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.77% (0.4636 => 0.4996, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.75% (0.2891 => 0.3115, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.3136 => 0.3378, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.72% (5.7591 => 6.2035, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.68% (0.4103 => 0.4418, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.65% (0.5860 => 0.6308, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.58% (0.9765 => 1.0505, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.57% (5.0018 => 5.3804, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.52% (4.9449 => 5.3170, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/fibo: 7.52% (0.2725 => 0.2930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.49% (0.2871 => 0.3086, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.42% (0.5569 => 0.5982, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.40% (0.2107 => 0.2263, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.37% (0.2700 => 0.2899, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (2.0665 => 2.2187, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4203 => 0.4512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.35% (0.3865 => 0.4149, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3283 => 0.3522, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.25% (0.5105 => 0.5475, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.24% (0.2872 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.24% (0.3052 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.4299 => 0.4610, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.23% (0.3650 => 0.3914, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: 7.23% (1.5603 => 1.6731, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 7.17% (0.6456 => 0.6919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (7.9617 => 8.5300, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.14% (0.3307 => 0.3543, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.3232 => 0.3462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4048 => 0.4336, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3603 => 0.3859, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.07% (0.5020 => 0.5375, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 7.03% (0.3684 => 0.3943, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3826 => 0.4093, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 6.88% (0.1555 => 0.1662, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1940 => 0.2073, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4620 => 0.4935, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.81% (1.1642 => 1.2435, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3379 => 0.3607, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.73% (0.3387 => 0.3615, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.73% (1.1861 => 1.2659, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.63% (21.9371 => 23.3905, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 6.62% (3.8723 => 4.1288, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 6.57% (0.3180 => 0.3389, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.57% (0.3441 => 0.3667, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 6.56% (1.0722 => 1.1425, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.45% (0.2603 => 0.2771, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 6.31% (2.0273 => 2.1552, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 6.30% (0.8921 => 0.9483, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.6450 => 0.6830, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 5.71% (2.2969 => 2.4281, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.70% (0.5981 => 0.6322, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 5.61% (1.2842 => 1.3563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.49% (1.5859 => 1.6729, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 5.24% (1.1840 => 1.2461, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.16% (1.4186 => 1.4918, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.13% (0.3817 => 0.4013, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.06% (2.2024 => 2.3139, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.8101 => 0.8442, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (14.3668 => 14.8780, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.37% (1.1194 => 1.1571, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.06% (17.1811 => 17.7071, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.8922 => 3.9943, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.35% (0.2944 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4496, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3823, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.71% (1.1396 => 1.2161, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7687, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (0.8275 => 0.8406, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2503, std.dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8079, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5858, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1300, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.84% (5.2763 => 3.2798, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.57% (5.3855 => 3.6313, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.25% (5.3526 => 3.6264, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1089, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.33% (2.9384 => 2.6054, std.dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: -9.48% (22.1758 => 20.0734, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.13% (1.6925 => 1.4195, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3795, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -9.16% (0.2161 => 0.1963, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2649, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.75% (0.9957 => 0.9584, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4974, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: -2.80% (1.2373 => 1.2027, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1720, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9946, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5098, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0915, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2338, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.57% (0.5229 => 0.5834, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 7.77% (14.9895 => 16.1544, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: 5.97% (4.1105 => 4.3561, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.49% (1.1048 => 1.2428, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.55% (7.1582 => 7.5558, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.95% (0.6222 => 0.7339, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.95% (0.2116 => 0.2096, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 09:02:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 11:02:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120925160211.84D392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4232?compare_to=4226&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4232, Order: 164601, Start Time: 2012-09-25 13:19:30, End Time: 2012-09-25 16:03:44 To: 4226, Order: 164593, Start Time: 2012-09-25 10:06:34, End Time: 2012-09-25 12:50:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (134 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.47% (0.7691 => 0.7804, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.32% (127.5677 => 129.2500, std.dev.: 0.5766) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.99% (0.3488 => 0.3941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.97% (0.3446 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.96% (0.3465 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3469 => 0.3916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.47% (0.3650 => 0.4105, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.43% (0.3643 => 0.4096, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.72% (0.1063 => 0.1177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.35% (0.5826 => 0.6429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.17% (0.5889 => 0.6488, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.92% (1.5932 => 1.7513, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.97% (0.2875 => 0.3133, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 8.83% (0.7171 => 0.7804, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.82% (0.3004 => 0.3269, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 8.73% (0.2714 => 0.2951, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.73% (0.1421 => 0.1545, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.62% (0.2725 => 0.2960, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.62% (0.1218 => 0.1323, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.58% (0.2738 => 0.2973, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.58% (0.3195 => 0.3469, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.56% (0.2792 => 0.3031, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.52% (0.2911 => 0.3159, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.50% (0.2813 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.47% (0.2750 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.46% (0.2729 => 0.2960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.43% (0.2823 => 0.3061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.38% (0.2803 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.32% (2.0673 => 2.2394, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 8.31% (0.2780 => 0.3011, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.31% (0.9909 => 1.0732, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 8.25% (0.2811 => 0.3043, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.3096 => 0.3351, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.16% (2.7292 => 2.9518, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (3.5627 => 3.8478, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.95% (1.6211 => 1.7499, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3060 => 0.3303, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.90% (0.3267 => 0.3525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.89% (0.3258 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.87% (0.4361 => 0.4704, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (1.3152 => 1.4184, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.77% (0.3282 => 0.3537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.72% (0.3317 => 0.3573, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3348 => 0.3606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3124 => 0.3364, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.64% (0.3362 => 0.3619, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.61% (0.3678 => 0.3958, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.3625 => 0.3898, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.42% (5.5417 => 5.9530, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.42% (0.3477 => 0.3735, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.38% (0.3930 => 0.4220, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.37% (0.1968 => 0.2113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.35% (0.3726 => 0.4000, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 7.35% (1.0781 => 1.1573, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4146 => 0.4449, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.24% (0.3690 => 0.3957, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.20% (0.5000 => 0.5360, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.13% (0.4994 => 0.5350, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.08% (0.2866 => 0.3069, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.01% (0.3981 => 0.4260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.99% (0.4251 => 0.4548, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.89% (0.3845 => 0.4110, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 6.89% (4.2109 => 4.5010, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: 6.88% (0.4029 => 0.4306, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.86% (0.5026 => 0.5371, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.73% (0.2736 => 0.2920, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.66% (0.5012 => 0.5346, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.65% (0.1549 => 0.1652, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (2.1013 => 2.2407, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 6.61% (23.5202 => 25.0757, std.dev.: 0.0149) MultiSource/Applications/JM/lencod/lencod: 6.44% (4.6177 => 4.9152, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.38% (0.4139 => 0.4403, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.31% (0.4658 => 0.4952, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.5900 => 0.6272, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.27% (0.2566 => 0.2727, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.2068 => 0.2197, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.20% (4.4195 => 4.6937, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 6.15% (2.1653 => 2.2985, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 6.15% (0.6634 => 0.7042, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 6.11% (1.8794 => 1.9943, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.3271 => 0.3470, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.03% (0.6435 => 0.6823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.03% (0.2737 => 0.2902, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.99% (0.3890 => 0.4123, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.93% (1.4269 => 1.5115, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.87% (0.3903 => 0.4132, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0788, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.54% (0.3084 => 0.3255, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.54% (0.2040 => 0.2153, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 5.52% (0.7875 => 0.8310, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 5.52% (0.5546 => 0.5852, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.47% (0.9697 => 1.0227, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.41% (1.9966 => 2.1046, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (0.2691 => 0.2835, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.25% (0.2969 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.80% (0.2103 => 0.2204, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.73% (2.0346 => 2.1308, std.dev.: 0.0133) MultiSource/Applications/lemon/lemon: 4.39% (0.2391 => 0.2496, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (0.4847 => 0.5054, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.3498 => 0.3641, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.04% (0.4253 => 0.4425, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.84% (0.7426 => 0.7711, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3792 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (11.6398 => 12.0386, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.6926 => 4.8430, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.17% (0.5584 => 0.5761, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.59% (11.9555 => 12.2647, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.40% (0.2162 => 0.3576, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.2122 => 0.2266, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6619, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6427, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2052, std.dev.: 0.0413) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4509, std.dev.: 0.0165) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2849, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5158, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5948, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5598, std.dev.: 0.0145) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7889, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.70% (0.2402 => 0.2241, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8070, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -3.20% (17.2379 => 16.6862, std.dev.: 0.0894) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5822, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0435, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 10:28:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 12:28:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925172842.2C1392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4233?compare_to=4230&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4233, Order: 164605, Start Time: 2012-09-25 16:09:17, End Time: 2012-09-25 17:30:14 To: 4230, Order: 164601, Start Time: 2012-09-25 13:24:03, End Time: 2012-09-25 14:37:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 12 (73 on baseline) Performance Improvements: 1 (49 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 884 (765 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.51% (0.5429 => 0.5728, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.40% (0.4411 => 0.4605, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.96% (0.3105 => 0.3228, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.67% (0.6517 => 0.6626, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 1.38% (3.8933 => 3.9469, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.0940 => 1.1080, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 9.12% (3.0089 => 3.2833, std.dev.: 0.0170) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.30% (1.2381 => 1.2913, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/lists1: 1.95% (0.5785 => 0.5898, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.29% (60.1863 => 60.9600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.07% (5.8670 => 5.9297, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.05% (4.6571 => 4.7059, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -1.35% (1.3673 => 1.3489, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.38% (1.0052 => 1.0090, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.5843 => 0.5869, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -0.67% (0.1650 => 0.1639, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.35% (0.1333 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.76% (0.2906 => 0.2928, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.95% (0.2201 => 0.2136, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.71% (0.2961 => 0.2982, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.82% (0.2074 => 0.2057, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -30.22% (0.0278 => 0.0194, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: 1.15% (0.0087 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.29% (0.0089 => 0.0030, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 41.51% (0.0053 => 0.0075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.00% (0.0114 => 0.0171, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0389 => 0.0385, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.83% (0.0218 => 0.0222, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.53% (0.0282 => 0.0210, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.96% (0.0324 => 0.0282, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 23.71% (0.0097 => 0.0120, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -11.92% (0.0151 => 0.0133, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -3.53% (0.0255 => 0.0246, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -9.76% (0.0123 => 0.0111, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1440 => 0.1444, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 0.18% (0.2282 => 0.2286, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.43% (1.4850 => 1.5062, std.dev.: 0.0073) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.59% (0.1506 => 0.1467, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.05% (0.5876 => 0.5873, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.10% (26.6101 => 26.6357, std.dev.: 0.2718) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.94% (0.4028 => 0.4066, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.60% (0.1358 => 0.1434, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.09% (0.0548 => 0.0542, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.66% (0.0219 => 0.0165, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.57% (0.0662 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1324 => 1.1265, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0013 => 0.0016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.88% (0.0544 => 0.0576, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (0.0149 => 0.0152, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7656 => 0.7653, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.56% (1.6977 => 1.7072, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2286, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -91.58% (6.9722 => 0.5873, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/09-vor/vor: 21432.50% (0.1237 => 26.6357, std.dev.: 0.2718) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.81% (4.1772 => 3.0991, std.dev.: 0.0496) SingleSource/Benchmarks/Shootout-C++/except: 82966.67% (0.0006 => 0.4984, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 9.24% (2.1763 => 2.3774, std.dev.: 0.0577) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.47% (0.6410 => 0.6953, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 7.85% (0.5309 => 0.5726, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.68% (0.3582 => 0.3857, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 7.34% (0.6173 => 0.6626, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 6.79% (1.0046 => 1.0728, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 6.43% (1.1653 => 1.2402, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 6.13% (15.3105 => 16.2492, std.dev.: 0.2076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.76% (1.5150 => 1.6023, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.38% (0.3901 => 0.4111, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.2797 => 0.2935, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 4.84% (0.6915 => 0.7250, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 4.82% (3.0225 => 3.1683, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.78% (0.4248 => 0.4451, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.76% (0.6069 => 0.6358, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.63% (0.7639 => 0.7993, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.60% (0.2654 => 0.2776, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1672 => 1.2196, std.dev.: 0.0134) MultiSource/Applications/SPASS/SPASS: 4.21% (13.3238 => 13.8846, std.dev.: 0.0258) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3217 => 0.3348, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.07% (3.0758 => 3.2009, std.dev.: 0.0164) MultiSource/Applications/siod/siod: 4.03% (2.0972 => 2.1818, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 3.75% (4.7455 => 4.9233, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.68% (1.4408 => 1.4938, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.0689 => 1.1080, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.57% (1.2021 => 1.2450, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.1827 => 1.2245, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0821 => 1.1198, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.48% (1.1440 => 1.1838, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.44% (0.8569 => 0.8864, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 3.38% (29.3170 => 30.3085, std.dev.: 0.2765) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (2.0317 => 2.0994, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (6.2546 => 6.4553, std.dev.: 0.0730) MultiSource/Applications/treecc/treecc: 2.77% (1.8798 => 1.9319, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.7226 => 0.7416, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.7256 => 15.0959, std.dev.: 0.0516) MultiSource/Applications/hbd/hbd: 2.49% (1.3268 => 1.3598, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 2.36% (3.5980 => 3.6829, std.dev.: 0.0167) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (6.4908 => 6.6136, std.dev.: 0.0271) MultiSource/Benchmarks/MallocBench/gs/gs: 1.73% (3.8796 => 3.9469, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.2742 => 1.2960, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 44.06% (0.0261 => 0.0376, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2291, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9995, std.dev.: 0.0071) SingleSource/Benchmarks/Stanford/Puzzle: 14.52% (0.1433 => 0.1641, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5495, std.dev.: 0.0201) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 11.44% (1.6261 => 1.8122, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 8.70% (7.0025 => 7.6118, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.40% (1.0063 => 1.0808, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/bisort/bisort: 6.66% (0.6459 => 0.6889, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.8498 => 0.8980, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.10% (40.4792 => 42.5426, std.dev.: 0.5498) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (0.3301 => 0.3458, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 3.17% (8.5113 => 8.7812, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/fp-convert: 3.11% (15.2242 => 15.6978, std.dev.: 0.1069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.86% (0.5587 => 0.5747, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8955, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8093, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.52% (2.6656 => 2.7327, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 2.48% (3.5520 => 3.6401, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/heapsort: 2.10% (3.2159 => 3.2833, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.02% (4.6127 => 4.7059, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (2.4013 => 2.4435, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.03% (27.1724 => 27.4526, std.dev.: 0.1024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.01% (0.0591 => 0.0325, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.09% (0.2996 => 0.1675, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.03% (1.4189 => 1.1347, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.48% (1.4113 => 1.1364, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.32% (5.2665 => 4.1435, std.dev.: 0.0530) SingleSource/Benchmarks/Shootout-C++/ary3: -19.24% (1.7473 => 1.4111, std.dev.: 0.0541) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.47% (15.8312 => 13.0649, std.dev.: 0.7840) MultiSource/Benchmarks/FreeBench/mason/mason: -15.31% (0.5004 => 0.4238, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.75% (1.7361 => 1.4801, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/17-bintr/bintr: -14.07% (0.0917 => 0.0788, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1607, std.dev.: 0.0145) MultiSource/Applications/sgefa/sgefa: -11.19% (0.3746 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.53% (3.6023 => 3.2230, std.dev.: 0.1335) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.63% (1.1647 => 1.0525, std.dev.: 0.0402) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7526, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9394, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -6.90% (7.6833 => 7.1530, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3754, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -6.59% (1.4441 => 1.3489, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: -6.49% (0.2664 => 0.2491, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3354, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.44% (2.0027 => 1.8738, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.70% (3.4230 => 3.2278, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/fib2: -4.93% (4.4195 => 4.2014, std.dev.: 0.0374) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.18% (62.4126 => 59.8019, std.dev.: 0.3199) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.91% (0.4140 => 0.3978, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -3.83% (2.5166 => 2.4202, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.54% (45.4683 => 43.8604, std.dev.: 0.5854) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (9.2503 => 8.9321, std.dev.: 0.0232) MultiSource/Applications/SPASS/SPASS: -3.25% (8.5323 => 8.2553, std.dev.: 0.0727) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8203, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: -2.96% (92.7467 => 90.0054, std.dev.: 0.9617) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.72% (3.7496 => 3.6476, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.14% (1.1683 => 1.1433, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.14% (2.4457 => 2.3934, std.dev.: 0.0183) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3633, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: -1.84% (1.0926 => 1.0725, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3138, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: -1.67% (3.8907 => 3.8257, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2288, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/hash2: -1.61% (3.4876 => 3.4313, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3142, std.dev.: 0.0172) SingleSource/Benchmarks/Dhrystone/fldry: -1.15% (2.4971 => 2.4685, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.10% (0.9980 => 1.0090, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -2.54% (0.6022 => 0.5869, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -1.62% (0.1666 => 0.1639, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.38% (0.1554 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.03% (0.3083 => 0.2928, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.78% (0.2394 => 0.2136, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.08% (0.3175 => 0.2982, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.64% (0.2302 => 0.2057, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -56.79% (0.0449 => 0.0194, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.94% (0.0192 => 0.0171, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.25% (0.0301 => 0.0222, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -26.06% (0.0284 => 0.0210, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.96% (0.0324 => 0.0282, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -32.20% (0.0177 => 0.0120, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -29.63% (0.0189 => 0.0133, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -65.85% (0.0325 => 0.0111, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1429 => 0.1444, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 0.29% (1.5019 => 1.5062, std.dev.: 0.0073) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.27% (0.1501 => 0.1467, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.64% (0.4264 => 0.4066, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1344 => 0.1434, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.98% (0.0589 => 0.0542, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.88% (0.0232 => 0.0165, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.36% (0.0639 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.75% (1.1350 => 1.1265, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.58% (0.0637 => 0.0576, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.21% (0.0246 => 0.0152, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.12% (1.5363 => 1.7072, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 10:35:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 12:35:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925173502.52AF72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4234?compare_to=4229&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4234, Order: 164605, Start Time: 2012-09-25 16:22:02, End Time: 2012-09-25 17:36:30 To: 4229, Order: 164601, Start Time: 2012-09-25 13:18:02, End Time: 2012-09-25 14:32:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.58% (3.7866 => 3.8465, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.87% (2.0176 => 2.4387, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.38% (0.0826 => 0.0953, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.78% (0.2243 => 0.2552, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 13.34% (0.5818 => 0.6594, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 13.15% (0.5748 => 0.6504, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 12.87% (0.7061 => 0.7970, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.76% (0.4328 => 0.4837, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.76% (0.2781 => 0.3108, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.50% (0.2782 => 0.3102, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 11.35% (0.1013 => 0.1128, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.10% (1.3693 => 1.5213, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.08% (0.4062 => 0.4512, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 11.05% (0.2760 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 11.05% (0.2607 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 11.04% (0.2726 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.96% (0.2655 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.96% (0.2628 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.92% (0.3022 => 0.3352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.90% (0.2937 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.89% (0.2690 => 0.2983, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.87% (1.9828 => 2.1983, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.85% (0.2765 => 0.3065, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.85% (3.9660 => 4.3963, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.3899 => 0.4321, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.76% (0.2966 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.72% (0.3107 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 10.71% (0.2988 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.63% (0.3489 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.63% (0.2596 => 0.2872, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.60% (0.9199 => 1.0174, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.54% (0.3149 => 0.3481, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.53% (0.2696 => 0.2980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 10.53% (0.3192 => 0.3528, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.51% (0.7710 => 0.8520, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.43% (1.2193 => 1.3465, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 10.40% (0.7038 => 0.7770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.39% (0.3580 => 0.3952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.38% (0.4016 => 0.4433, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.37% (1.4563 => 1.6073, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.32% (0.1327 => 0.1464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.28% (0.3756 => 0.4142, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.28% (0.5265 => 0.5806, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 10.08% (0.3453 => 0.3801, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.00% (0.6959 => 0.7655, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.73% (0.4390 => 0.4817, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 9.70% (0.1062 => 0.1165, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.60% (1.1364 => 1.2455, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.53% (0.6283 => 0.6882, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.52% (13.8202 => 15.1355, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 9.44% (0.2945 => 0.3223, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.16% (0.1157 => 0.1263, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.13% (0.4379 => 0.4779, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.07% (0.5577 => 0.6083, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.91% (0.2995 => 0.3262, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.88% (1.0313 => 1.1229, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.81% (0.3246 => 0.3532, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.79% (0.2127 => 0.2314, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.70% (16.6129 => 18.0588, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.60% (0.5637 => 0.6122, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.53% (0.6576 => 0.7137, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.51% (0.2914 => 0.3162, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.42% (7.2180 => 7.8257, std.dev.: 0.0096) MultiSource/Applications/Burg/burg: 8.35% (1.1061 => 1.1985, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 8.34% (0.8310 => 0.9003, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.28% (0.7460 => 0.8078, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.26% (0.7506 => 0.8126, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.22% (0.8698 => 0.9413, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1865 => 0.2015, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.02% (0.4791 => 0.5175, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.01% (0.3220 => 0.3478, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.96% (3.8646 => 4.1721, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 7.90% (0.6744 => 0.7277, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.79% (0.2925 => 0.3153, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.74% (3.1889 => 3.4357, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.67% (1.0594 => 1.1407, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.67% (0.3623 => 0.3901, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.67% (1.9270 => 2.0748, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 7.66% (2.1791 => 2.3461, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3663 => 0.3943, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.64% (0.3940 => 0.4241, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.62% (1.2292 => 1.3229, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.37% (1.3245 => 1.4221, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.27% (0.4113 => 0.4412, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.27% (3.6692 => 3.9359, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 7.15% (0.3131 => 0.3355, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.14% (14.8535 => 15.9134, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.00% (4.3801 => 4.6869, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 6.99% (1.2749 => 1.3640, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.98% (8.4961 => 9.0892, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.95% (4.4433 => 4.7523, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.2140 => 0.2288, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.88% (0.6135 => 0.6557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1569 => 0.1675, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.69% (0.8818 => 0.9408, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.1333 => 1.2074, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.50% (4.6629 => 4.9658, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 6.45% (0.6250 => 0.6653, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.4805 => 0.5107, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.15% (3.2742 => 3.4754, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.73% (0.3245 => 0.3431, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (6.5754 => 6.9459, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.63% (1.5188 => 1.6043, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.58% (4.9865 => 5.2646, std.dev.: 0.0242) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2321 => 0.2450, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.50% (0.9108 => 0.9609, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (6.2785 => 6.6111, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 5.21% (3.7467 => 3.9420, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.08% (13.2842 => 13.9596, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.01% (2.1007 => 2.2059, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.39% (0.3511 => 0.3665, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.45% (16.2614 => 16.8222, std.dev.: 0.0232) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9419, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.00% (1.8175 => 2.2537, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7036, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.11% (10.7476 => 11.0823, std.dev.: 0.0067) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5859, std.dev.: 0.0079) MultiSource/Benchmarks/llubenchmark/llu: 1.95% (3.7731 => 3.8465, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5844, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.38% (0.2670 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.46% (0.4657 => 0.3937, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.99% (1.3813 => 1.1880, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.93% (1.3819 => 1.1894, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.67% (22.5627 => 21.5090, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -11.17% (0.2238 => 0.1988, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3031, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9996 => 0.9555, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1578, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9546, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2451, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.65% (26.5159 => 26.0788, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.62% (0.6615 => 0.6508) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7916, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2250, std.dev.: 0.0128) MultiSource/Applications/viterbi/viterbi: -1.07% (4.4810 => 4.4331, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 10:39:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 12:39:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925173933.6ABC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4235?compare_to=4231&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4235, Order: 164605, Start Time: 2012-09-25 16:22:21, End Time: 2012-09-25 17:40:58 To: 4231, Order: 164601, Start Time: 2012-09-25 13:41:13, End Time: 2012-09-25 15:00:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (3 on baseline) Performance Regressions: 0 (152 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (16 on baseline) Unchanged Tests: 948 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.46% (0.8499 => 0.8375, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -1.12% (11.6138 => 11.4841, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.70% (0.5834 => 0.5793, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: -0.32% (16.1544 => 16.1019, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -0.58% (54.5489 => 54.2346, std.dev.: 0.0365) MultiSource/Benchmarks/MallocBench/gs/gs: -0.26% (4.3561 => 4.3448, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.2428 => 1.2417, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.5558 => 7.5514, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.61% (0.7339 => 0.7294, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0358 => 0.0359, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.14% (0.2096 => 0.2099, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.25% (63.2438 => 54.2346, std.dev.: 0.0365) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.15% (14.1553 => 18.5650, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.47% (3.4629 => 5.4875, std.dev.: 0.0036) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14243.19% (0.0720 => 10.3271, std.dev.: 0.0060) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.48% (10.3673 => 15.2901, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: 47.06% (0.2554 => 0.3756, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 28.36% (0.1622 => 0.2082, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.03% (2.2022 => 2.5332, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.70% (7.0540 => 8.0910, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.56% (1.7609 => 1.9821, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.04% (10.4361 => 11.4841, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/oourafft: 9.93% (0.3282 => 0.3608, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.6030 => 0.6588, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.72% (0.3177 => 0.3454, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.4879 => 0.5304, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.69% (9.4845 => 10.3087, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.65% (1.5415 => 1.6749, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.47% (0.8172 => 0.8864, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 8.46% (0.7326 => 0.7946, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.11% (0.7115 => 0.7692, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.11% (0.3121 => 0.3374, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 7.97% (5.7591 => 6.2181, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.82% (0.3109 => 0.3352, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.80% (0.4615 => 0.4975, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.79% (0.6675 => 0.7195, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.72% (0.2758 => 0.2971, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.67% (0.7433 => 0.8003, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.65% (0.3423 => 0.3685, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (8.1363 => 8.7587, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.64% (1.3050 => 1.4047, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.59% (0.4636 => 0.4988, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 7.57% (3.3354 => 3.5878, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.53% (0.2271 => 0.2442, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.53% (0.1940 => 0.2086, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.47% (4.2646 => 4.5830, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.42% (0.5569 => 0.5982, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.37% (0.5860 => 0.6292, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.32% (0.9765 => 1.0480, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.8067 => 0.8650, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.02% (5.0018 => 5.3528, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.00% (7.9617 => 8.5187, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.99% (4.9449 => 5.2904, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.98% (0.2107 => 0.2254, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.95% (0.4289 => 0.4587, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3098 => 0.3313, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.4103 => 0.4387, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.90% (0.5105 => 0.5457, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.89% (0.7835 => 0.8375, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 6.79% (0.3387 => 0.3617, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.75% (0.6456 => 0.6892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.70% (0.3865 => 0.4124, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3650 => 0.3894, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.67% (0.5020 => 0.5355, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.67% (1.5603 => 1.6644, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.65% (0.3307 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.59% (0.4203 => 0.4480, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.49% (2.0665 => 2.2007, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.48% (0.2793 => 0.2974, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 6.48% (1.1642 => 1.2396, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.45% (0.3441 => 0.3663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.45% (0.4048 => 0.4309, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3232 => 0.3440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3684 => 0.3920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.38% (0.3826 => 0.4070, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 6.36% (0.3603 => 0.3832, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 6.35% (1.0722 => 1.1403, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.33% (1.1861 => 1.2612, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.30% (0.2603 => 0.2767, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3379 => 0.3591, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 6.27% (2.0273 => 2.1544, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 6.26% (0.4299 => 0.4568, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4620 => 0.4906, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.10% (3.8723 => 4.1085, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.91% (21.9371 => 23.2331, std.dev.: 0.0245) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.6450 => 0.6820, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.72% (0.8921 => 0.9431, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.40% (2.2969 => 2.4210, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.23% (1.5859 => 1.6689, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.13% (0.5981 => 0.6288, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.03% (0.2266 => 0.2380, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.93% (1.4186 => 1.4886, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.86% (1.1840 => 1.2415, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.4064 => 0.4259, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.78% (1.2842 => 1.3456, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.68% (2.2024 => 2.3055, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.65% (0.3427 => 0.3552, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (0.8101 => 0.8389, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (14.3668 => 14.8658, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (1.1194 => 1.1537, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.96% (17.1811 => 17.6904, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.8922 => 3.9941, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (3.1578 => 3.3837, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (3.6395 => 3.7620, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2550, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8075, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5838, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.81% (5.2763 => 3.2815, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.83% (5.3855 => 3.6174, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.40% (5.3526 => 3.6183, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0887, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/mason/mason: -13.81% (0.0811 => 0.0699, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.39% (2.9384 => 2.6036, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -9.94% (22.1758 => 19.9713, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3764, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -9.16% (0.2161 => 0.1963, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3034, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.61% (1.8329 => 1.7117, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0155) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.69% (0.9957 => 0.9590, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1638, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -3.55% (1.2373 => 1.1934, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4967, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.44% (12.4730 => 12.1692, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9945, std.dev.: 0.0202) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5159, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0930, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.07% (1.0313 => 1.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2339, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.79% (0.5229 => 0.5793, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 7.42% (14.9895 => 16.1019, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 5.70% (4.1105 => 4.3448, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.39% (1.1048 => 1.2417, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.49% (7.1582 => 7.5514, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.23% (0.6222 => 0.7294, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.80% (0.2116 => 0.2099, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 12:07:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 14:07:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925190709.14A382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4236?compare_to=4233&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4236, Order: 164611, Start Time: 2012-09-25 17:47:23, End Time: 2012-09-25 19:08:42 To: 4233, Order: 164605, Start Time: 2012-09-25 16:09:17, End Time: 2012-09-25 17:30:14 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 9 (67 on baseline) Performance Improvements: 1 (49 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 887 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.7406 => 0.7946, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2245 => 1.2514, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 2.15% (0.7599 => 0.7762, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 1.73% (3.9469 => 4.0153, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.55% (8.3444 => 8.4740, std.dev.: 0.0315) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.21% (13.0649 => 14.7914, std.dev.: 0.0425) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.33% (21.2813 => 22.2019, std.dev.: 0.0779) MultiSource/Applications/minisat/minisat: 1.59% (6.2109 => 6.3094, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.38% (2.5452 => 2.5803, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.03% (1.4801 => 1.4648, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.35% (1.0090 => 1.0125, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.01% (0.5869 => 0.5928, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -2.07% (0.1639 => 0.1605, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.83% (0.1315 => 0.1291, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (0.2928 => 0.2930, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.87% (0.2136 => 0.2176, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.64% (0.2982 => 0.3031, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.17% (0.2057 => 0.2081, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 44.33% (0.0194 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 196.67% (0.0030 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.33% (0.0075 => 0.0076, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.53% (0.0171 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.30% (0.0385 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.13% (0.0222 => 0.0280, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.67% (0.0210 => 0.0266, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.18% (0.0282 => 0.0322, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 50.83% (0.0120 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -11.28% (0.0133 => 0.0118, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 2.44% (0.0246 => 0.0252, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 11.71% (0.0111 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1444 => 0.1438, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 0.22% (0.2286 => 0.2291, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -7.89% (1.5062 => 1.3874, std.dev.: 0.0649) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.09% (0.1467 => 0.1527, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.20% (0.5873 => 0.5861, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -2.80% (26.6357 => 25.8898, std.dev.: 0.4533) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.02% (0.4066 => 0.4067, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.70% (0.1434 => 0.1444, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.24% (0.0542 => 0.0565, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.79% (0.0165 => 0.0229, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.81% (0.0592 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.04% (1.1265 => 1.1382, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0016 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.03% (0.0576 => 0.0628, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.13% (0.0152 => 0.0175, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.7653 => 0.7687, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.05% (1.7072 => 1.7064, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2291, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -91.59% (6.9722 => 0.5861, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/09-vor/vor: 20829.51% (0.1237 => 25.8898, std.dev.: 0.4533) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.10% (4.1772 => 3.0450, std.dev.: 0.0861) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.13% (0.0745 => 0.0895, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.53% (0.6410 => 0.6957, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 8.19% (2.1763 => 2.3545, std.dev.: 0.0400) SingleSource/Benchmarks/Misc-C++/bigfib: 7.99% (0.5309 => 0.5733, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 7.40% (0.6173 => 0.6630, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.69% (1.0046 => 1.0718, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.59% (0.3901 => 0.4158, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 6.51% (1.1653 => 1.2412, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.39% (0.3582 => 0.3811, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.01% (0.7639 => 0.8098, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 5.81% (0.6915 => 0.7317, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.81% (1.1827 => 1.2514, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 5.74% (15.3105 => 16.1896, std.dev.: 0.2269) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.66% (1.5150 => 1.6007, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.54% (0.6069 => 0.6405, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2797 => 0.2939, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.2552 => 0.2678, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.75% (1.0821 => 1.1335, std.dev.: 0.0087) MultiSource/Applications/d/make_dparser: 4.68% (3.0225 => 3.1639, std.dev.: 0.0200) MultiSource/Benchmarks/sim/sim: 4.54% (0.3084 => 0.3224, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3217 => 0.3358, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.93% (1.1672 => 1.2131, std.dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 3.84% (13.3238 => 13.8359, std.dev.: 0.1548) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.84% (0.5963 => 0.6192, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.78% (4.7455 => 4.9251, std.dev.: 0.0697) MultiSource/Applications/Burg/burg: 3.73% (1.1440 => 1.1867, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/09-vor/vor: 3.54% (0.3026 => 0.3133, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.53% (0.2886 => 0.2988, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.7226 => 0.7480, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (3.8796 => 4.0153, std.dev.: 0.0175) MultiSource/Applications/hbd/hbd: 3.48% (1.3268 => 1.3730, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 3.44% (29.3170 => 30.3262, std.dev.: 0.2602) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (8.2186 => 8.4979, std.dev.: 0.0569) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.31% (6.2546 => 6.4616, std.dev.: 0.0702) MultiSource/Applications/lua/lua: 3.27% (3.5980 => 3.7157, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 2.92% (14.7256 => 15.1561, std.dev.: 0.0672) SingleSource/Benchmarks/Shootout-C++/hash2: 2.83% (0.3847 => 0.3956, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.78% (1.2021 => 1.2355, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (8.2559 => 8.4740, std.dev.: 0.0315) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.4908 => 6.6622, std.dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.53% (0.5937 => 0.6087, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std.dev.: 0.0239) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.42% (4.0101 => 4.5482, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/queens: 10.61% (1.6261 => 1.7987, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.98% (1.0063 => 1.0967, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.5995, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.11% (40.4792 => 42.5461, std.dev.: 0.2017) SingleSource/Benchmarks/Misc/dt: 4.47% (0.9851 => 1.0291, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8459, std.dev.: 0.0475) SingleSource/Benchmarks/Misc/ReedSolomon: 4.01% (8.5113 => 8.8529, std.dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5388, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.45% (0.5587 => 0.5780, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.91% (14.4877 => 14.9087, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (6.6312 => 6.8153, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 2.77% (3.5520 => 3.6503, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.64% (2.6656 => 2.7360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.40% (0.5876 => 0.6017, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 1.90% (2.4013 => 2.4469, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (2.4455 => 2.4883, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: 1.64% (1.4184 => 1.4417, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.07% (27.1724 => 27.4634, std.dev.: 0.1036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.52% (0.0591 => 0.0322, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.69% (0.2996 => 0.1657, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.85% (1.4189 => 1.1231, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.71% (1.4113 => 1.1472, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.13% (5.2665 => 4.1538, std.dev.: 0.0773) SingleSource/Benchmarks/Shootout-C++/ary3: -16.97% (1.7473 => 1.4508, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/mason/mason: -16.73% (0.5004 => 0.4167, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.63% (1.7361 => 1.4648, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.98% (0.0917 => 0.0798, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -11.96% (0.3746 => 0.3298, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.39% (1.1647 => 1.0437, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -8.42% (9.5474 => 8.7439, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -7.19% (1.4441 => 1.3403, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.11% (3.2007 => 2.9730, std.dev.: 0.0271) MultiSource/Applications/lambda-0_1_3/lambda: -7.03% (7.6833 => 7.1432, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3773, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/fibo: -6.66% (4.6355 => 4.3266, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.57% (15.8312 => 14.7914, std.dev.: 0.0425) MultiSource/Benchmarks/FreeBench/distray/distray: -6.53% (0.2664 => 0.2490, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8721, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.91% (2.9728 => 2.7970, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: -5.66% (3.4230 => 3.2291, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1845, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.49% (0.4564 => 0.4359, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.20% (0.4140 => 0.3966, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -4.18% (62.4126 => 59.8025, std.dev.: 0.0789) MultiSource/Benchmarks/Olden/bh/bh: -3.80% (2.5166 => 2.4210, std.dev.: 0.0289) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.77% (1.2722 => 1.2242, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.49% (3.7496 => 3.6189, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/methcall: -3.32% (9.2503 => 8.9432, std.dev.: 0.0289) SingleSource/Benchmarks/McGill/misr: -3.31% (0.4296 => 0.4154, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8206, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.32% (2.4457 => 2.3890, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.10% (45.4683 => 44.5122, std.dev.: 0.3602) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4195, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3633, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.90% (1.0686 => 1.0483, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.81% (1.1683 => 1.1471, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -1.75% (3.8907 => 3.8227, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2259, std.dev.: 0.0309) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3098, std.dev.: 0.0486) SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (2.4971 => 2.4635, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.20% (16.5617 => 16.3624, std.dev.: 0.0631) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.45% (0.9980 => 1.0125, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.56% (0.6022 => 0.5928, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -3.66% (0.1666 => 0.1605, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.92% (0.1554 => 0.1291, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.96% (0.3083 => 0.2930, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.11% (0.2394 => 0.2176, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.54% (0.3175 => 0.3031, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.60% (0.2302 => 0.2081, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.98% (0.0301 => 0.0280, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.34% (0.0284 => 0.0266, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -37.57% (0.0189 => 0.0118, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1429 => 0.1438, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -7.62% (1.5019 => 1.3874, std.dev.: 0.0649) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.73% (0.1501 => 0.1527, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.62% (0.4264 => 0.4067, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.44% (0.1344 => 0.1444, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.07% (0.0589 => 0.0565, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.29% (0.0232 => 0.0229, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.66% (0.0639 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1350 => 1.1382, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.41% (0.0637 => 0.0628, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.86% (0.0246 => 0.0175, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.94% (0.7541 => 0.7687, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7064, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 12:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 14:15:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120925191514.154C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4237?compare_to=4232&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4237, Order: 164605, Start Time: 2012-09-25 16:32:32, End Time: 2012-09-25 19:16:45 To: 4232, Order: 164601, Start Time: 2012-09-25 13:19:30, End Time: 2012-09-25 16:03:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3446 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.21% (0.3488 => 0.3914, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 12.17% (0.3442 => 0.3861, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3460 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3643 => 0.4072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.00% (1.5932 => 1.7525, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 9.89% (0.5826 => 0.6402, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.5889 => 0.6462, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7171 => 0.7765, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.87% (0.4361 => 0.4704, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.76% (0.2875 => 0.3098, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.73% (1.3152 => 1.4169, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.60% (0.1421 => 0.1529, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.59% (2.7292 => 2.9364, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2729 => 0.2936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.57% (0.2813 => 0.3026, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (1.6211 => 1.7437, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.53% (3.5627 => 3.8311, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.49% (0.2738 => 0.2943, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.44% (0.9909 => 1.0646, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 7.42% (0.3004 => 0.3227, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.41% (0.2714 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.39% (0.3195 => 0.3431, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2750 => 0.2952, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.5000 => 0.5366, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.32% (0.2911 => 0.3124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.31% (0.2803 => 0.3008, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.30% (0.2823 => 0.3029, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27% (0.2736 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2792 => 0.2995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.26% (2.0673 => 2.2174, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 7.23% (5.5417 => 5.9421, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.13% (0.4994 => 0.5350, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.12% (0.2780 => 0.2978, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2811 => 0.3011, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3096 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.3258 => 0.3485, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94% (0.5026 => 0.5375, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.93% (0.3678 => 0.3933, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.90% (0.3060 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3267 => 0.3491, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.81% (0.3362 => 0.3591, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.71% (1.0781 => 1.1504, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 6.70% (0.2566 => 0.2738, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.69% (4.2109 => 4.4927, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/lists: 6.69% (0.3348 => 0.3572, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3124 => 0.3333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.66% (0.3317 => 0.3538, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.57% (0.3625 => 0.3863, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (0.3930 => 0.4188, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3477 => 0.3705, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3282 => 0.3497, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (0.3726 => 0.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.45% (0.3690 => 0.3928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.44% (0.4146 => 0.4413, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 6.44% (0.6634 => 0.7061, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 6.40% (23.5202 => 25.0263, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.5900 => 0.6275, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 6.30% (2.1013 => 2.2336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.2866 => 0.3045, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (0.2691 => 0.2857, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.16% (0.4251 => 0.4513, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.3981 => 0.4225, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.97% (4.6177 => 4.8932, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.96% (4.4195 => 4.6829, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 5.91% (0.3336 => 0.3533, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 5.87% (1.4269 => 1.5106, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.86% (0.3890 => 0.4118, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.84% (0.3903 => 0.4131, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.83% (0.3845 => 0.4069, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 5.81% (2.1653 => 2.2911, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.80% (0.4139 => 0.4379, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 5.79% (1.8794 => 1.9883, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 5.73% (0.5546 => 0.5864, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.6435 => 0.6800, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.66% (0.2737 => 0.2892, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.64% (0.9697 => 1.0244, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.5012 => 0.5293, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.3084 => 0.3256, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.45% (0.4658 => 0.4912, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.2040 => 0.2150, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.23% (0.2391 => 0.2516, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.3271 => 0.3441, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.14% (0.2103 => 0.2211, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.13% (0.7875 => 0.8279, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.12% (0.2969 => 0.3121, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (1.9694 => 2.0702, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 5.07% (2.0346 => 2.1377, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (1.9966 => 2.0960, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.49% (0.4253 => 0.4444, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.35% (0.4847 => 0.5058, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.11% (0.7426 => 0.7731, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.05% (0.5361 => 0.5578, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (0.5584 => 0.5793, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 3.49% (0.3498 => 0.3620, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.31% (11.6398 => 12.0253, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (4.6926 => 4.8439, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.95% (0.3792 => 0.3904, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.29% (11.9555 => 12.2298, std.dev.: 0.0111) SingleSource/UnitTests/Vector/constpool: 1.99% (2.4764 => 2.5256, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8969, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std.dev.: 0.1439) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6396, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1997, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5048, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2279, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4570, std.dev.: 0.0219) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5659, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8024, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8058, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8017, std.dev.: 0.0745) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.18% (0.6293 => 0.6156, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 12:18:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 14:18:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925191810.D91C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4238?compare_to=4234&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4238, Order: 164611, Start Time: 2012-09-25 18:05:19, End Time: 2012-09-25 19:19:41 To: 4234, Order: 164605, Start Time: 2012-09-25 16:22:02, End Time: 2012-09-25 17:36:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.65% (2.0176 => 2.4544, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.71% (0.0826 => 0.0964, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.22% (0.2243 => 0.2562, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.50% (0.5818 => 0.6545, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937) SingleSource/UnitTests/ObjC++/Hello: 12.28% (0.5748 => 0.6454, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.89% (0.1413 => 0.1581, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.60% (0.7061 => 0.7880, std.dev.: 0.0069) SingleSource/Regression/C++/ofstream_ctor: 11.51% (0.2781 => 0.3101, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.32% (1.3693 => 1.5243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.30% (0.4328 => 0.4817, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.21% (0.1588 => 0.1766, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.16% (3.9660 => 4.4087, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.71% (0.2596 => 0.2874, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.62% (0.3899 => 0.4313, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.62% (1.4563 => 1.6109, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.57% (0.9199 => 1.0171, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.55% (0.1327 => 0.1467, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.54% (0.7038 => 0.7780, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.49% (0.4062 => 0.4488, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.40% (0.6959 => 0.7683, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.39% (1.2193 => 1.3460, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.30% (0.7710 => 0.8504, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.24% (1.9828 => 2.1858, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (0.2765 => 0.3048, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.20% (0.5265 => 0.5802, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.16% (0.3130 => 0.3448, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4016 => 0.4424, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.12% (0.3489 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.09% (0.3756 => 0.4135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.05% (0.4390 => 0.4831, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.03% (0.3580 => 0.3939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.86% (0.1075 => 0.1181, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.82% (13.8202 => 15.1779, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.79% (1.1364 => 1.2477, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: 9.77% (0.3868 => 0.4246, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.68% (0.6283 => 0.6891, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3534 => 0.3866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.25% (0.1589 => 0.1736, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.25% (0.1157 => 0.1264, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.14% (0.5577 => 0.6087, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.07% (0.4379 => 0.4776, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.06% (0.3246 => 0.3540, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.03% (16.6129 => 18.1137, std.dev.: 0.0142) MultiSource/Applications/lemon/lemon: 9.03% (1.0313 => 1.1244, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.85% (0.2995 => 0.3260, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.67% (1.1061 => 1.2020, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.52% (7.2180 => 7.8333, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 8.51% (0.7506 => 0.8145, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 8.50% (0.3578 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.47% (0.4003 => 0.4342, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5637 => 0.6114, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.44% (0.8310 => 0.9011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.4791 => 0.5194, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.35% (0.3220 => 0.3489, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.34% (0.3755 => 0.4068, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.17% (0.8698 => 0.9409, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.15% (0.7460 => 0.8068, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.11% (0.2023 => 0.2187, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1865 => 0.2015, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 8.00% (1.0594 => 1.1442, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.00% (3.8646 => 4.1737, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 7.99% (0.6744 => 0.7283, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.93% (0.2925 => 0.3157, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.89% (2.1791 => 2.3511, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.83% (1.9270 => 2.0778, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 7.81% (3.1889 => 3.4380, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.63% (0.3131 => 0.3370, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.54% (3.6692 => 3.9460, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.48% (0.1657 => 0.1781, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.48% (1.3245 => 1.4236, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.47% (0.6576 => 0.7067, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.36% (14.8535 => 15.9460, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/05-eks/eks: 7.34% (0.4113 => 0.4415, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 7.27% (1.2749 => 1.3676, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 7.22% (8.4961 => 9.1097, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1569 => 0.1682, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (4.4433 => 4.7604, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.11% (4.3801 => 4.6916, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.06% (0.6135 => 0.6568, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.97% (1.2292 => 1.3149, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.2140 => 0.2288, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.85% (4.6629 => 4.9824, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.79% (1.1333 => 1.2102, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.70% (0.8818 => 0.9409, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.6250 => 0.6650, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.32% (3.2742 => 3.4811, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.02% (4.9865 => 5.2868, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.87% (0.4805 => 0.5087, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 5.82% (6.5754 => 6.9582, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.77% (1.5188 => 1.6065, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.76% (6.2785 => 6.6400, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.9108 => 0.9617, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.42% (0.3245 => 0.3421, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.34% (2.1007 => 2.2128, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.31% (13.2842 => 13.9891, std.dev.: 0.0178) MultiSource/Applications/lua/lua: 5.28% (3.7467 => 3.9444, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.2008 => 0.2112, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.16% (0.3511 => 0.3657, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.48% (16.2614 => 16.8271, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.5298 => 14.9578, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 25.79% (1.8175 => 2.2863, std.dev.: 0.0386) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0057, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7045, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.52% (1.9199 => 1.9875, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.95% (10.7476 => 11.0649, std.dev.: 0.0872) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5843, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5823, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5922, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.45% (0.2670 => 0.1403, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.84% (0.0707 => 0.0595, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.01% (0.4657 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.26% (1.3819 => 1.1848, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.18% (1.3813 => 1.1854, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.46% (22.5627 => 21.5572, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2618, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.43% (1.3780 => 1.2894, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.64% (0.9996 => 0.9632, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9508, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.25% (1.9762 => 1.9318, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1044, std.dev.: 0.0229) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7923, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2214, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 12:27:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 14:27:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925192709.BCE6B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4239?compare_to=4235&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4239, Order: 164611, Start Time: 2012-09-25 18:10:06, End Time: 2012-09-25 19:28:41 To: 4235, Order: 164605, Start Time: 2012-09-25 16:22:21, End Time: 2012-09-25 17:40:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (3 on baseline) Performance Regressions: 4 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (16 on baseline) Unchanged Tests: 946 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.77% (11.4841 => 11.6868, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.40% (2.5332 => 2.5687, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (3.6183 => 3.6661, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (3.6174 => 3.6636, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.05% (0.5793 => 0.5790, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -0.11% (16.1019 => 16.0843, std.dev.: 0.0131) MultiSource/Benchmarks/Bullet/bullet: -0.04% (54.2346 => 54.2106, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/gs/gs: -0.25% (4.3448 => 4.3341, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.31% (1.2417 => 1.2378, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.38% (7.5514 => 7.5226, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.25% (0.7294 => 0.7276, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0359 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.38% (0.2099 => 0.2070, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.28% (63.2438 => 54.2106, std.dev.: 0.0182) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.81% (14.1553 => 18.5169, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.48% (3.4629 => 5.4881, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14239.58% (0.0720 => 10.3245, std.dev.: 0.0119) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.74% (10.3673 => 15.3170, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 47.69% (0.2554 => 0.3772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 32.98% (0.1622 => 0.2157, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.64% (2.2022 => 2.5687, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.76% (7.0540 => 8.1660, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 14.94% (0.1432 => 0.1646, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.45% (1.7609 => 1.9801, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 11.98% (10.4361 => 11.6868, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 10.69% (0.3282 => 0.3633, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1625 => 0.1778, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 9.05% (9.4845 => 10.3433, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 9.03% (0.1440 => 0.1570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.91% (0.3177 => 0.3460, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.63% (0.4879 => 0.5300, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.17% (0.4615 => 0.4992, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.11% (0.3121 => 0.3374, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.02% (1.5415 => 1.6652, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.97% (0.1906 => 0.2058, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.96% (5.7591 => 6.2174, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 7.91% (0.3109 => 0.3355, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 7.81% (0.7115 => 0.7671, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.65% (1.3050 => 1.4048, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1337 => 0.1439, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.6675 => 0.7183, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.54% (0.3423 => 0.3681, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.54% (8.1363 => 8.7494, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 7.49% (3.3354 => 3.5852, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.49% (0.2271 => 0.2441, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.8172 => 0.8779, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.42% (0.5569 => 0.5982, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.2700 => 0.2900, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.29% (4.2646 => 4.5755, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.26% (7.9617 => 8.5394, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 7.21% (0.7433 => 0.7969, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.17% (5.0018 => 5.3604, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.13% (0.5860 => 0.6278, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.07% (4.9449 => 5.2944, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.07% (0.9765 => 1.0455, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3422 => 0.3657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.80% (0.1940 => 0.2072, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.74% (0.2107 => 0.2249, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.2758 => 0.2943, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.8067 => 0.8607, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.68% (0.5105 => 0.5446, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 6.64% (0.3387 => 0.3612, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.64% (0.3162 => 0.3372, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.62% (0.7835 => 0.8354, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4636 => 0.4938, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.4299 => 0.4578, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 6.46% (1.5603 => 1.6611, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4289 => 0.4564, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.40% (0.4203 => 0.4472, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.39% (0.4103 => 0.4365, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.37% (0.6456 => 0.6867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.34% (0.3865 => 0.4110, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.32% (21.9371 => 23.3229, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.5020 => 0.5336, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.24% (1.1861 => 1.2601, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.21% (1.1642 => 1.2365, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2603 => 0.2763, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.14% (0.3650 => 0.3874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.13% (0.3603 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.11% (0.2831 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.4048 => 0.4293, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (2.0665 => 2.1915, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 6.05% (3.8723 => 4.1065, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3441 => 0.3649, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.02% (1.0722 => 1.1368, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4620 => 0.4891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.85% (0.3232 => 0.3421, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3684 => 0.3897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.60% (0.3180 => 0.3358, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 5.57% (0.8921 => 0.9418, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.56% (2.0273 => 2.1400, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.47% (0.6450 => 0.6803, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.22% (0.5981 => 0.6293, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.09% (1.5859 => 1.6666, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 5.07% (2.2969 => 2.4134, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.88% (1.1840 => 1.2418, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.4186 => 1.4875, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.56% (2.2024 => 2.3029, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 4.44% (0.3131 => 0.3270, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.4064 => 0.4241, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.13% (1.2842 => 1.3373, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3817 => 0.3967, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (14.3668 => 14.8739, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.39% (0.8101 => 0.8376, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.18% (0.3427 => 0.3536, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.10% (1.1194 => 1.1541, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.82% (17.1811 => 17.6648, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (3.8922 => 3.9738, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7695, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2507, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8076, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1322, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.97% (5.2763 => 3.2730, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.97% (5.3855 => 3.6636, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.51% (5.3526 => 3.6661, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1279, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/mason/mason: -13.69% (0.0811 => 0.0700, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.33% (2.9384 => 2.6056, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -10.20% (22.1758 => 19.9133, std.dev.: 0.0428) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.30% (0.2161 => 0.1960, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2536, std.dev.: 0.1051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7111, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1610, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.71% (0.9957 => 0.9588, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5054, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.69% (1.2373 => 1.2040, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1695, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.93% (8.6802 => 8.5131, std.dev.: 0.0192) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0144, std.dev.: 0.0155) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6837, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.68% (10.2830 => 10.1098, std.dev.: 0.0263) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.73% (0.5229 => 0.5790, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 7.30% (14.9895 => 16.0843, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 5.44% (4.1105 => 4.3341, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.04% (1.1048 => 1.2378, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.09% (7.1582 => 7.5226, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.94% (0.6222 => 0.7276, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (0.2116 => 0.2070, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 14:01:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 16:01:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925210129.233A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4240?compare_to=4238&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4240, Order: 164624, Start Time: 2012-09-25 19:48:41, End Time: 2012-09-25 21:03:00 To: 4238, Order: 164611, Start Time: 2012-09-25 18:05:19, End Time: 2012-09-25 19:19:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 3 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 965 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.86% (3.7605 => 3.8304, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.16% (55.7233 => 56.3684, std.dev.: 0.0666) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.13% (4.9824 => 4.9263, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.6400 => 6.5673, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -1.00% (2.4544 => 2.4298, std.dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.43% (2.0176 => 2.4298, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.96% (0.1410 => 0.1635, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.29% (0.2243 => 0.2541, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 12.03% (0.5818 => 0.6518, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.88% (0.5748 => 0.6431, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.06% (0.7061 => 0.7842, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.63% (0.4328 => 0.4788, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.50% (3.9660 => 4.3825, std.dev.: 0.0112) MultiSource/Applications/hbd/hbd: 10.44% (1.3693 => 1.5122, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 10.28% (0.2781 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.07% (0.9199 => 1.0125, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.03% (1.4563 => 1.6023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.95% (0.4062 => 0.4466, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.86% (0.3022 => 0.3320, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.82% (1.2193 => 1.3390, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.7710 => 0.8466, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.80% (0.5265 => 0.5781, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.73% (0.3485 => 0.3824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.63% (0.2721 => 0.2983, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.62% (0.3899 => 0.4274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.57% (0.2760 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.53% (0.6959 => 0.7622, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2726 => 0.2985, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.49% (0.7038 => 0.7706, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.47% (0.3293 => 0.3605, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.46% (0.3130 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.45% (0.2655 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.44% (0.2966 => 0.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2765 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.34% (0.3489 => 0.3815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.34% (1.9828 => 2.1680, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.30% (0.2937 => 0.3210, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.24% (0.3756 => 0.4103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.24% (0.4016 => 0.4387, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.20% (1.1364 => 1.2409, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 9.18% (0.3149 => 0.3438, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 9.16% (13.8202 => 15.0859, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.13% (0.3580 => 0.3907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.13% (0.2761 => 0.3013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.05% (0.3868 => 0.4218, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.04% (0.2988 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.02% (0.6283 => 0.6850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.87% (0.3192 => 0.3475, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.77% (0.3453 => 0.3756, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 8.72% (0.3534 => 0.3842, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.68% (0.5577 => 0.6061, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.56% (0.3246 => 0.3524, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.36% (1.0313 => 1.1175, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.25% (0.2995 => 0.3242, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.18% (0.5637 => 0.6098, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.13% (0.4379 => 0.4735, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 8.12% (0.3646 => 0.3942, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.10% (1.1061 => 1.1957, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2945 => 0.3183, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.05% (0.3601 => 0.3891, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.05% (0.3789 => 0.4094, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3914 => 0.4228, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.01% (7.2180 => 7.7961, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.97% (16.6129 => 17.9375, std.dev.: 0.0219) SingleSource/UnitTests/ObjC/synchronized: 7.94% (0.3663 => 0.3954, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3623 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.85% (0.7506 => 0.8095, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.70% (0.3220 => 0.3468, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.4791 => 0.5157, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.61% (0.7460 => 0.8028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.59% (0.3755 => 0.4040, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.47% (0.8698 => 0.9348, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.41% (0.2023 => 0.2173, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.37% (0.6744 => 0.7241, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.35% (1.9270 => 2.0686, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 7.33% (1.0594 => 1.1371, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 7.23% (3.1889 => 3.4194, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 7.19% (3.8646 => 4.1426, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.19% (0.6576 => 0.7049, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.12% (2.1791 => 2.3342, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.3245 => 1.4164, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.76% (3.6692 => 3.9172, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 6.71% (0.3131 => 0.3341, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.62% (1.2749 => 1.3593, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 6.61% (14.8535 => 15.8357, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.44% (1.2292 => 1.3083, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.43% (4.3801 => 4.6619, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.33% (4.4433 => 4.7246, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 6.33% (8.4961 => 9.0339, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.29% (0.6135 => 0.6521, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.4113 => 0.4367, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.07% (1.1333 => 1.2021, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2504 => 0.2653, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.79% (0.8818 => 0.9329, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 5.71% (0.6250 => 0.6607, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 5.65% (4.6629 => 4.9263, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.4805 => 0.5072, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.48% (3.2742 => 3.4536, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.33% (4.9865 => 5.2525, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.14% (1.5188 => 1.5969, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.05% (6.5754 => 6.9072, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.88% (13.2842 => 13.9327, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.86% (0.9108 => 0.9551, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.81% (0.3245 => 0.3401, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.80% (3.7467 => 3.9264, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.65% (2.1007 => 2.1983, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5673, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.53% (0.3511 => 0.3635, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7733, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 2.57% (14.5298 => 14.9025, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std.dev.: 0.0455) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0799, std.dev.: 0.0466) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.04% (7.4271 => 7.5785, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.52% (3.7731 => 3.8304, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5845, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.12% (8.8259 => 8.9245, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.07% (1.4298 => 1.4451, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5877, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.57% (0.2670 => 0.1400, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -16.27% (0.0707 => 0.0592, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.25% (0.4657 => 0.3947, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.75% (1.3813 => 1.1775, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.70% (1.3819 => 1.1788, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.12% (22.5627 => 21.4067, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.22% (0.2238 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2867, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.01% (1.3780 => 1.2952, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.66% (0.9996 => 0.9630, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9558, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2484, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.60% (26.5159 => 26.0921, std.dev.: 0.0237) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7936, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std.dev.: 0.0180) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2314, std.dev.: 0.0235) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 14:14:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 16:14:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120925211412.E9F8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4241?compare_to=4239&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4241, Order: 164624, Start Time: 2012-09-25 19:57:35, End Time: 2012-09-25 21:15:45 To: 4239, Order: 164611, Start Time: 2012-09-25 18:10:06, End Time: 2012-09-25 19:28:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (3 on baseline) Performance Regressions: 0 (146 on baseline) Performance Improvements: 6 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (16 on baseline) Unchanged Tests: 944 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.71% (11.6868 => 11.4866, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (3.6661 => 3.6061, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.46% (3.6636 => 3.6102, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.22% (2.5687 => 2.5374, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (8.5394 => 8.4409, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.05% (8.1660 => 8.0806, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5790 => 0.5790, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -0.33% (16.0843 => 16.0318, std.dev.: 0.0124) MultiSource/Benchmarks/Bullet/bullet: -0.24% (54.2106 => 54.0822, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: -0.03% (4.3341 => 4.3328, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.36% (1.2378 => 1.2334, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (7.5226 => 7.5075, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.7276 => 0.7272, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0357 => 0.0356, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.29% (0.2070 => 0.2076, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0005 => 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0009 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0003 => 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.49% (63.2438 => 54.0822, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -99.98% (4.2280 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.99% (3.2416 => 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.93% (14.1553 => 18.5329, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.06% (3.4629 => 5.4733, std.dev.: 0.0176) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14244.72% (0.0720 => 10.3282, std.dev.: 0.0067) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.56% (10.3673 => 15.2976, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: 47.26% (0.2554 => 0.3761, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 30.21% (0.1056 => 0.1375, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 29.35% (0.1622 => 0.2098, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.22% (2.2022 => 2.5374, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.55% (7.0540 => 8.0806, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 13.48% (0.1432 => 0.1625, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.03% (0.1566 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.49% (0.3543 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.40% (1.7609 => 1.9617, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.16% (0.1584 => 0.1745, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 10.07% (10.4361 => 11.4866, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/oourafft: 9.81% (0.3282 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.27% (9.4845 => 10.2692, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: 8.22% (0.1655 => 0.1791, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.04% (1.3050 => 1.4099, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7326 => 0.7900, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.77% (0.4879 => 0.5258, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.75% (1.5415 => 1.6609, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.57% (0.7433 => 0.7996, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 7.55% (0.7115 => 0.7652, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5860 => 0.6300, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.49% (5.7591 => 6.1904, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.37% (0.6675 => 0.7167, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.37% (0.4615 => 0.4955, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.37% (0.3109 => 0.3338, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.31% (0.2271 => 0.2437, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.31% (3.3354 => 3.5792, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.3423 => 0.3671, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5569 => 0.5971, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (4.2646 => 4.5703, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 7.16% (0.3422 => 0.3667, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1510 => 0.1618, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (8.1363 => 8.7169, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.08% (0.1625 => 0.1740, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.81% (5.0018 => 5.3423, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.80% (0.9765 => 1.0429, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 6.76% (0.4289 => 0.4579, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.8172 => 0.8723, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.74% (0.3441 => 0.3673, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.64% (0.2107 => 0.2247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.64% (0.2758 => 0.2941, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.62% (0.8067 => 0.8601, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.60% (0.4636 => 0.4942, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.59% (0.7835 => 0.8351, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.54% (4.9449 => 5.2685, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.54% (0.4203 => 0.4478, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3121 => 0.3323, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.47% (0.3650 => 0.3886, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.3098 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.39% (0.3865 => 0.4112, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.6456 => 0.6866, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.33% (2.0665 => 2.1973, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.33% (0.3162 => 0.3362, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 6.30% (0.3603 => 0.3830, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.27% (0.5105 => 0.5425, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2877 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.22% (0.5020 => 0.5332, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.20% (0.3387 => 0.3597, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.15% (1.5603 => 1.6563, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 6.15% (0.4048 => 0.4297, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 6.14% (1.1642 => 1.2357, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4620 => 0.4902, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4299 => 0.4559, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.02% (7.9617 => 8.4409, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.00% (0.3684 => 0.3905, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.00% (1.0722 => 1.1365, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 6.00% (3.8723 => 4.1045, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (1.1861 => 1.2567, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.72% (0.2603 => 0.2752, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.63% (21.9371 => 23.1725, std.dev.: 0.0086) MultiSource/Applications/treecc/treecc: 5.58% (2.0273 => 2.1404, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.3180 => 0.3357, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (0.8921 => 0.9407, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.16% (0.6450 => 0.6783, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5981 => 0.6276, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.75% (1.5859 => 1.6613, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4064 => 0.4250, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.4186 => 1.4829, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.1840 => 1.2370, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.36% (1.2842 => 1.3402, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.28% (2.2024 => 2.2966, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.75% (0.3817 => 0.3960, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.32% (0.8101 => 0.8370, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8271, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.09% (0.3427 => 0.3533, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.85% (1.1194 => 1.1513, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6033, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.8922 => 3.9588, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (3.1578 => 3.3825, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7695, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2502, std.dev.: 0.0123) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8075, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.35% (5.2763 => 3.2529, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.96% (5.3855 => 3.6102, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.63% (5.3526 => 3.6061, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0834, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/mason/mason: -14.18% (0.0811 => 0.0696, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.40% (2.9384 => 2.6034, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.36% (22.1758 => 19.8781, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.21% (0.2161 => 0.1962, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3059, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.56% (3.2827 => 3.1657, std.dev.: 0.0445) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5071, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1703, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9889, std.dev.: 0.0107) SingleSource/Benchmarks/McGill/chomp: -2.02% (1.2373 => 1.2123, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5099, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0915, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.73% (0.5229 => 0.5790, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 6.95% (14.9895 => 16.0318, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: 5.41% (4.1105 => 4.3328, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.64% (1.1048 => 1.2334, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.88% (7.1582 => 7.5075, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.88% (0.6222 => 0.7272, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.89% (0.2116 => 0.2076, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 400.00% (0.0001 => 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 15:28:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 17:28:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120925222844.4C3322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4242?compare_to=4237&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4242, Order: 164623, Start Time: 2012-09-25 19:46:05, End Time: 2012-09-25 22:30:16 To: 4237, Order: 164605, Start Time: 2012-09-25 16:32:32, End Time: 2012-09-25 19:16:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (765 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.21% (54.1444 => 54.8021, std.dev.: 0.0403) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.13% (1.7525 => 1.7327, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 12.14% (0.3469 => 0.3890, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3496 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.03% (0.3465 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.03% (0.3442 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.98% (0.3488 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.94% (0.3460 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.67% (0.3650 => 0.4076, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3724 => 0.4147, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5826 => 0.6353, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5889 => 0.6417, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.76% (1.5932 => 1.7327, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.21% (0.7171 => 0.7760, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.91% (0.1619 => 0.1747, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.63% (0.2738 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2875 => 0.3089, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.3004 => 0.3222, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (1.6211 => 1.7366, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.04% (0.2911 => 0.3116, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 6.99% (0.9909 => 1.0602, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.98% (0.3195 => 0.3418, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.95% (2.7292 => 2.9190, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 6.94% (0.2823 => 0.3019, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.1505 => 0.1609, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.91% (0.4994 => 0.5339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (3.5627 => 3.8086, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (0.4361 => 0.4661, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.88% (0.2792 => 0.2984, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.87% (0.2750 => 0.2939, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.81% (1.3152 => 1.4047, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 6.80% (0.2780 => 0.2969, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.79% (2.0673 => 2.2077, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.78% (0.5026 => 0.5367, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 6.75% (0.2813 => 0.3003, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.74% (0.2803 => 0.2992, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.73% (0.3625 => 0.3869, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2811 => 0.2999, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.66% (5.5417 => 5.9108, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3096 => 0.3301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3258 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3267 => 0.3482, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3124 => 0.3329, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3282 => 0.3497, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3362 => 0.3581, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.50% (0.3060 => 0.3259, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.45% (1.0781 => 1.1476, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash: 6.42% (0.4146 => 0.4412, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.36% (0.2014 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.31% (0.3678 => 0.3910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3317 => 0.3526, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.24% (0.3348 => 0.3557, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.20% (4.2109 => 4.4721, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists1: 6.15% (0.3477 => 0.3691, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.07% (0.3726 => 0.3952, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.06% (0.4029 => 0.4273, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.2068 => 0.2193, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (0.5000 => 0.5302, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.03% (0.3845 => 0.4077, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.03% (0.2736 => 0.2901, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.88% (0.4251 => 0.4501, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (4.4195 => 4.6782, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 5.71% (0.6634 => 0.7013, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 5.68% (23.5202 => 24.8560, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.3981 => 0.4205, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.61% (0.2566 => 0.2710, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.5900 => 0.6223, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.47% (2.1013 => 2.2163, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.46% (1.8794 => 1.9821, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.37% (0.3890 => 0.4099, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.36% (0.6435 => 0.6780, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.3903 => 0.4112, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 5.33% (0.5012 => 0.5279, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.25% (1.4269 => 1.5018, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.20% (4.6177 => 4.8579, std.dev.: 0.0111) MultiSource/Applications/Burg/burg: 5.12% (0.5546 => 0.5830, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (2.1653 => 2.2761, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.2737 => 0.2877, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.07% (0.3271 => 0.3437, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.05% (0.4139 => 0.4348, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.00% (0.4658 => 0.4891, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.3084 => 0.3236, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (1.9966 => 2.0920, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 4.77% (0.2391 => 0.2505, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 4.77% (0.3336 => 0.3495, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.74% (0.9697 => 1.0157, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.66% (0.7875 => 0.8242, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.2969 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.57% (1.9694 => 2.0595, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 4.48% (2.0346 => 2.1257, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 3.71% (0.4847 => 0.5027, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.66% (0.7426 => 0.7698, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.41% (0.5361 => 0.5544, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.17% (0.5584 => 0.5761, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.08% (11.6398 => 11.9988, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.3498 => 0.3603, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (4.6926 => 4.8333, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3792 => 0.3898, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.59% (0.4253 => 0.4363, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.98% (11.9555 => 12.1920, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.41% (0.2162 => 0.3533, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6664, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8972, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1646, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6317, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.91% (46.6247 => 47.5137, std.dev.: 0.0209) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4593, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std.dev.: 0.0405) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5893, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5854, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary2: -10.03% (0.2402 => 0.2161, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9735, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7938, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7985, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.75% (0.6293 => 0.6120, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8285, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5726, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 15:33:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 17:33:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120925223331.427EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4243?compare_to=4236&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4243, Order: 164630, Start Time: 2012-09-25 21:19:21, End Time: 2012-09-25 22:35:04 To: 4236, Order: 164611, Start Time: 2012-09-25 17:47:23, End Time: 2012-09-25 19:08:42 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (75 on baseline) Performance Improvements: 6 (48 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 883 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 12.32% (0.0990 => 0.1112, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.17% (0.3139 => 0.3270, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.85% (1.1231 => 1.1551, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 5.45% (4.3352 => 4.5716, std.dev.: 0.0427) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.05% (0.7548 => 0.7854, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.31% (1.4194 => 1.4522, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (2.4626 => 2.5024, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.02% (5.8683 => 5.9284, std.dev.: 0.0147) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -2.79% (4.0153 => 3.9032, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.20% (1.2514 => 1.2239, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.47% (0.8098 => 0.7979, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.05% (8.4740 => 8.3846, std.dev.: 0.0279) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -3.80% (1.4508 => 1.3957, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.39% (2.9730 => 2.9316, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.85% (1.0125 => 1.0039, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -0.73% (0.5928 => 0.5885, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -1.00% (0.1605 => 0.1589, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.10% (0.1291 => 0.1251, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (0.2930 => 0.2927, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.38% (0.2176 => 0.2146, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.42% (0.3031 => 0.2988, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.62% (0.2081 => 0.2068, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: - (0.0280 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -9.09% (0.0088 => 0.0080, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -17.98% (0.0089 => 0.0073, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.32% (0.0076 => 0.0077, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.81% (0.0189 => 0.0144, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.64% (0.0280 => 0.0267, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.14% (0.0266 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.55% (0.0322 => 0.0327, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.55% (0.0181 => 0.0180, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 64.41% (0.0118 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -0.79% (0.0252 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -36.29% (0.0124 => 0.0079, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1438 => 0.1444, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 0.09% (0.2291 => 0.2293, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 3.65% (1.3874 => 1.4380, std.dev.: 0.0385) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.08% (0.1527 => 0.1480, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.48% (0.5861 => 0.6065, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 2.80% (25.8898 => 26.6160, std.dev.: 0.0973) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.40% (0.4067 => 0.4010, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.1444 => 0.1378, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.26% (0.0565 => 0.0524, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.48% (0.0229 => 0.0205, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.91% (0.0656 => 0.0591, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1382 => 1.1280, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.69% (0.0628 => 0.0542, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.00% (0.0175 => 0.0154, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7687 => 0.7650, std.dev.: 0.0353) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7064 => 1.7061, std.dev.: 0.0202) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2293, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -91.30% (6.9722 => 0.6065, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 21416.57% (0.1237 => 26.6160, std.dev.: 0.0973) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.45% (4.1772 => 3.0725, std.dev.: 0.0673) SingleSource/Benchmarks/Shootout-C++/except: 82283.33% (0.0006 => 0.4943, std.dev.: 0.0056) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.00% (2.1763 => 2.3939, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6410 => 0.6968, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.5309 => 0.5720, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.84% (0.3582 => 0.3827, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 6.77% (1.1653 => 1.2442, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 6.77% (1.0046 => 1.0726, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: 6.64% (0.6173 => 0.6583, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.61% (1.5150 => 1.6152, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 5.59% (15.3105 => 16.1660, std.dev.: 0.0748) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.15% (0.6915 => 0.7271, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.97% (0.3901 => 0.4095, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.2886 => 0.3019, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 4.60% (1.0821 => 1.1319, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3217 => 0.3364, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.46% (3.0225 => 3.1572, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.45% (0.7639 => 0.7979, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.28% (13.3238 => 13.8934, std.dev.: 0.0394) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.15% (0.6069 => 0.6321, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.99% (0.7226 => 0.7514, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 3.88% (4.7455 => 4.9295, std.dev.: 0.0437) MultiSource/Applications/hbd/hbd: 3.65% (1.3268 => 1.3752, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.57% (12.6413 => 13.0921, std.dev.: 0.1323) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (8.2186 => 8.5113, std.dev.: 0.0439) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (6.2546 => 6.4728, std.dev.: 0.0297) MultiSource/Applications/Burg/burg: 3.49% (1.1440 => 1.1839, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.1827 => 1.2239, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 3.35% (2.0972 => 2.1674, std.dev.: 0.0199) MultiSource/Applications/lua/lua: 3.26% (3.5980 => 3.7154, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.24% (1.2021 => 1.2411, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 3.08% (29.3170 => 30.2214, std.dev.: 0.2426) MultiSource/Applications/JM/lencod/lencod: 3.07% (14.7256 => 15.1778, std.dev.: 0.0868) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8405 => 0.8658, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (0.7722 => 0.7954, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.95% (0.8569 => 0.8822, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 2.85% (1.8798 => 1.9333, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.0689 => 1.0985, std.dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (6.4908 => 6.6519, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.56% (8.2559 => 8.3846, std.dev.: 0.0279) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.3380 => 4.4056, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.95% (1.6538 => 2.3310, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.93% (0.0766 => 0.0888, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.65% (1.7426 => 1.9979, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5474, std.dev.: 0.0222) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.5998, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.51% (4.2129 => 4.5716, std.dev.: 0.0427) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.18% (1.0063 => 1.0886, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/mst/mst: 7.27% (0.1417 => 0.1520, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.19% (40.4792 => 42.5797, std.dev.: 0.4201) MultiSource/Benchmarks/Olden/bisort/bisort: 4.83% (0.6459 => 0.6771, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (2.4042 => 2.5024, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/dt: 3.94% (0.9851 => 1.0239, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 3.79% (15.2242 => 15.8010, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.22% (0.7609 => 0.7854, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8864, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.74% (2.6656 => 2.7386, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8102, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.40% (8.5113 => 8.7157, std.dev.: 0.0736) SingleSource/Benchmarks/Dhrystone/dry: 1.94% (2.4013 => 2.4479, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.82% (4.6127 => 4.6968, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.38% (1.4324 => 1.4522, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4346, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.00% (27.1724 => 27.4452, std.dev.: 0.0343) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.35% (0.0591 => 0.0323, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.89% (0.2996 => 0.1651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.82% (1.4113 => 1.1316, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.59% (1.4189 => 1.1551, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.21% (0.3497 => 0.2091, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.29% (5.2665 => 4.1452, std.dev.: 0.0544) SingleSource/Benchmarks/Shootout-C++/ary3: -20.12% (1.7473 => 1.3957, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/mason/mason: -15.01% (0.5004 => 0.4253, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.75% (1.7361 => 1.4800, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: -13.75% (0.3746 => 0.3231, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.63% (0.0917 => 0.0792, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.90% (1.4034 => 1.2785, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.41% (3.2007 => 2.9316, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7488, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.04% (15.8312 => 14.7173, std.dev.: 0.1173) MultiSource/Applications/lambda-0_1_3/lambda: -6.87% (7.6833 => 7.1551, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3770, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3314, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -6.32% (1.4441 => 1.3528, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.64% (3.4230 => 3.2300, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/distray/distray: -5.63% (0.2664 => 0.2514, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1843, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.21% (0.4564 => 0.4326, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.90% (1.2959 => 1.2324, std.dev.: 0.0193) MultiSource/Benchmarks/mafft/pairlocalalign: -4.08% (62.4126 => 59.8676, std.dev.: 0.0561) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.86% (1.2722 => 1.2231, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.66% (3.7496 => 3.6125, std.dev.: 0.0218) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (2.5166 => 2.4271, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.07% (9.2503 => 8.9665, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8209, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.34% (1.8739 => 1.8300, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.27% (1.1683 => 1.1418, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -2.02% (3.4286 => 3.3595, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.01% (2.4457 => 2.3965, std.dev.: 0.0164) MultiSource/Benchmarks/sim/sim: -1.86% (3.8907 => 3.8185, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -1.72% (3.4876 => 3.4275, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.66% (92.7467 => 91.2116, std.dev.: 0.4569) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -1.59% (29.5232 => 29.0552, std.dev.: 0.1379) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2424, std.dev.: 0.0310) SingleSource/Benchmarks/Dhrystone/fldry: -1.43% (2.4971 => 2.4615, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3078, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.59% (0.9980 => 1.0039, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -2.27% (0.6022 => 0.5885, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -4.62% (0.1666 => 0.1589, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -19.50% (0.1554 => 0.1251, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.06% (0.3083 => 0.2927, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.36% (0.2394 => 0.2146, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.89% (0.3175 => 0.2988, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.17% (0.2302 => 0.2068, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -10.11% (0.0089 => 0.0080, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -18.89% (0.0090 => 0.0073, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -67.92% (0.0240 => 0.0077, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.00% (0.0192 => 0.0144, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.30% (0.0301 => 0.0267, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -75.69% (0.0325 => 0.0079, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1429 => 0.1444, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -4.25% (1.5019 => 1.4380, std.dev.: 0.0385) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.40% (0.1501 => 0.1480, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.96% (0.4264 => 0.4010, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.53% (0.1344 => 0.1378, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.04% (0.0589 => 0.0524, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.0232 => 0.0205, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.51% (0.0639 => 0.0591, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.62% (1.1350 => 1.1280, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.91% (0.0637 => 0.0542, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.40% (0.0246 => 0.0154, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0353) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0202) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 15:47:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 17:47:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120925224719.7A9852A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/4244?compare_to=4240&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4244, Order: 164631, Start Time: 2012-09-25 21:34:21, End Time: 2012-09-25 22:48:50 To: 4240, Order: 164624, Start Time: 2012-09-25 19:48:41, End Time: 2012-09-25 21:03:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.10% (78.8955 => 80.5500, std.dev.: 0.5703) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.91% (2.0176 => 2.4395, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.78% (0.2243 => 0.2552, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.20% (0.5818 => 0.6528, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 12.04% (0.5748 => 0.6440, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.71% (0.7061 => 0.7888, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.20% (0.4062 => 0.4517, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 11.09% (0.4328 => 0.4808, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.70% (1.3693 => 1.5158, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.67% (3.9660 => 4.3893, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.58% (0.1588 => 0.1756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.36% (1.4563 => 1.6072, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.25% (1.9828 => 2.1860, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.13% (0.7710 => 0.8491, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.09% (0.3489 => 0.3841, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.09% (1.2193 => 1.3423, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.07% (0.9199 => 1.0125, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3293 => 0.3624, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2721 => 0.2993, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.93% (0.5265 => 0.5788, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.83% (0.7038 => 0.7730, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.81% (0.4016 => 0.4410, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.79% (0.1072 => 0.1177, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4390 => 0.4819, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3580 => 0.3929, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.74% (0.6959 => 0.7637, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 9.59% (0.3868 => 0.4239, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 9.43% (13.8202 => 15.1240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.40% (1.1364 => 1.2432, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.38% (0.3453 => 0.3777, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.17% (0.6283 => 0.6859, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.80% (0.5577 => 0.6068, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1276 => 0.1387, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.54% (1.0313 => 1.1194, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.46% (16.6129 => 18.0181, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.45% (0.4379 => 0.4749, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.3646 => 0.3948, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.27% (7.2180 => 7.8152, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 8.27% (1.1061 => 1.1976, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1589 => 0.1718, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.11% (0.2995 => 0.3238, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.11% (0.3650 => 0.3946, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.11% (0.5637 => 0.6094, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.03% (0.7506 => 0.8109, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.01% (0.1435 => 0.1550, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.01% (0.8698 => 0.9395, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3755 => 0.4055, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.98% (0.3220 => 0.3477, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.93% (0.2914 => 0.3145, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.91% (0.8310 => 0.8967, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.87% (0.4791 => 0.5168, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.69% (0.7460 => 0.8034, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.49% (1.0594 => 1.1387, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: 7.47% (3.1889 => 3.4270, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 7.46% (0.6744 => 0.7247, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.42% (3.8646 => 4.1514, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3398, std.dev.: 0.0151) MultiSource/Applications/treecc/treecc: 7.37% (1.9270 => 2.0690, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.33% (0.6576 => 0.7058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.04% (1.3245 => 1.4178, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.02% (3.6692 => 3.9269, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 6.90% (1.2292 => 1.3140, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.80% (14.8535 => 15.8635, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 6.77% (0.3131 => 0.3343, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1569 => 0.1675, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.71% (1.2749 => 1.3604, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.64% (4.3801 => 4.6708, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 6.59% (8.4961 => 9.0558, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.56% (4.4433 => 4.7347, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.47% (0.6135 => 0.6532, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (1.1333 => 1.2048, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.22% (0.6250 => 0.6639, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.89% (0.8818 => 0.9337, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.83% (4.6629 => 4.9349, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.72% (4.9865 => 5.2718, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.68% (0.4805 => 0.5078, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.63% (3.2742 => 3.4584, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 5.39% (6.5754 => 6.9300, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.22% (6.2785 => 6.6062, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.07% (1.5188 => 1.5958, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.04% (13.2842 => 13.9536, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 4.91% (3.7467 => 3.9306, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.83% (0.9108 => 0.9548, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.73% (2.1007 => 2.2000, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.87% (0.3511 => 0.3647, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.21% (16.2614 => 16.7826, std.dev.: 0.0219) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9259, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std.dev.: 0.0465) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7043, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.58% (10.7476 => 11.1320, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5837, std.dev.: 0.0035) MultiSource/Benchmarks/llubenchmark/llu: 2.08% (3.7731 => 3.8516, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.22% (0.4657 => 0.3948, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.61% (1.3813 => 1.1795, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.55% (1.3819 => 1.1809, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.74% (22.5627 => 21.4937, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -11.26% (0.2238 => 0.1986, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2945, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.03% (1.3780 => 1.2949, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.22% (2.6470 => 2.5087, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.86% (0.9996 => 0.9610, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9532, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2388, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0602, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7928, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4357, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 18:41:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 20:41:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926014118.3C6172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4245?compare_to=4243&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4245, Order: 164651, Start Time: 2012-09-26 00:27:40, End Time: 2012-09-26 01:42:51 To: 4243, Order: 164630, Start Time: 2012-09-25 21:19:21, End Time: 2012-09-25 22:35:04 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (73 on baseline) Performance Improvements: 2 (46 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 889 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 1.08% (16.1660 => 16.3413, std.dev.: 0.0322) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.61% (0.5904 => 0.6117, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.48% (42.8517 => 44.3417, std.dev.: 0.3429) SingleSource/Benchmarks/Shootout-C++/lists1: 3.41% (0.5805 => 0.6003, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 1.46% (6.2564 => 6.3477, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.40% (1.8300 => 1.8557, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.99% (1.0421 => 1.0214, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.73% (1.4522 => 1.4271, std.dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.58% (1.0039 => 0.9981, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: -1.10% (0.5885 => 0.5820, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: -0.44% (0.1589 => 0.1582, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.80% (0.1251 => 0.1286, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (0.2927 => 0.2933, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.03% (0.2146 => 0.2211, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.33% (0.2988 => 0.2998, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.64% (0.2068 => 0.2102, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 0.71% (0.0280 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -48.75% (0.0080 => 0.0041, std.dev.: 0.0023) SingleSource/UnitTests/2003-08-11-VaListArg: 23.29% (0.0073 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.60% (0.0077 => 0.0075, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.72% (0.0144 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.87% (0.0267 => 0.0272, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.94% (0.0327 => 0.0252, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -43.89% (0.0180 => 0.0101, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -25.26% (0.0194 => 0.0145, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0250 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 49.37% (0.0079 => 0.0118, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.16% (0.1444 => 0.1384, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: -1.79% (0.2293 => 0.2252, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 2.81% (1.4380 => 1.4784, std.dev.: 0.0277) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.74% (0.1480 => 0.1491, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -3.03% (0.6065 => 0.5881, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 0.49% (26.6160 => 26.7453, std.dev.: 0.1606) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.30% (0.4010 => 0.4062, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.79% (0.1378 => 0.1444, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0524 => 0.0532, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.32% (0.0205 => 0.0190, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.92% (0.0591 => 0.0626, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1280 => 1.1235, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.79% (0.0542 => 0.0633, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.55% (0.0154 => 0.0161, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.7650 => 0.7657, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.20% (1.7061 => 1.7095, std.dev.: 0.0104) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.66% (6.7458 => 0.2252, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -91.57% (6.9722 => 0.5881, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 21521.10% (0.1237 => 26.7453, std.dev.: 0.1606) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.66% (4.1772 => 3.0637, std.dev.: 0.0513) SingleSource/Benchmarks/Shootout-C++/except: 82583.33% (0.0006 => 0.4961, std.dev.: 0.0081) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.43% (0.0745 => 0.0927, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.58% (2.1763 => 2.4066, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.75% (0.1159 => 0.1272, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.14% (0.6410 => 0.6996, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 7.93% (0.5309 => 0.5730, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.45% (1.0046 => 1.0794, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 6.73% (15.3105 => 16.3413, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.2552 => 0.2720, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 6.57% (1.1653 => 1.2419, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.56% (0.3582 => 0.3817, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (1.5150 => 1.6118, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 6.29% (0.6173 => 0.6561, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.20% (0.3901 => 0.4104, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.04% (0.2797 => 0.2938, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.66% (0.6915 => 0.7237, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 4.58% (3.0225 => 3.1609, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.7639 => 0.7986, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.53% (0.6069 => 0.6344, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.35% (1.1672 => 1.2180, std.dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 4.32% (4.7455 => 4.9503, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.19% (1.2021 => 1.2525, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.14% (0.2654 => 0.2764, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3217 => 0.3350, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 4.08% (13.3238 => 13.8668, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4248 => 0.4417, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.3062 => 0.3182, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (12.6413 => 13.1306, std.dev.: 0.1349) MultiSource/Applications/siod/siod: 3.84% (2.0972 => 2.1778, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.80% (1.1827 => 1.2277, std.dev.: 0.0090) MultiSource/Applications/Burg/burg: 3.71% (1.1440 => 1.1864, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2546 => 6.4862, std.dev.: 0.0609) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (3.0758 => 3.1852, std.dev.: 0.0131) MultiSource/Benchmarks/sim/sim: 3.53% (0.3084 => 0.3193, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.42% (14.7256 => 15.2292, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 3.37% (1.3268 => 1.3715, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.33% (29.3170 => 30.2946, std.dev.: 0.2713) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (8.2186 => 8.4912, std.dev.: 0.0545) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0821 => 1.1174, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.0689 => 1.1016, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.05% (0.8569 => 0.8830, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (2.0317 => 2.0912, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 2.90% (3.5980 => 3.7022, std.dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.4908 => 6.6681, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 2.28% (1.8798 => 1.9227, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (8.2559 => 8.4141, std.dev.: 0.0575) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (4.2815 => 4.3478, std.dev.: 0.0242) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.05% (0.0263 => 0.0392, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 22.16% (3.4629 => 4.2304, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/ary3: 15.21% (1.7426 => 2.0076, std.dev.: 0.0382) SingleSource/Benchmarks/Stanford/Puzzle: 13.75% (0.1433 => 0.1630, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.28% (4.0101 => 4.5426, std.dev.: 0.0485) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.67% (0.0917 => 0.1024, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 10.97% (1.6261 => 1.8045, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 9.22% (7.0025 => 7.6480, std.dev.: 0.0554) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (0.3301 => 0.3539, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.45% (40.4792 => 42.2786, std.dev.: 0.2246) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8580, std.dev.: 0.0412) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.10% (0.5876 => 0.6117, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5369, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8922, std.dev.: 0.0517) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8098, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.67% (3.5520 => 3.6467, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 2.37% (8.5113 => 8.7132, std.dev.: 0.0781) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.26% (2.6656 => 2.7258, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7148, std.dev.: 0.0370) MultiSource/Applications/minisat/minisat: 1.98% (6.2244 => 6.3477, std.dev.: 0.0263) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (2.4455 => 2.4849, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.63% (0.2996 => 0.1659, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.83% (1.4189 => 1.1376, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.09% (1.4113 => 1.1419, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.18% (5.2665 => 4.2038, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/ary3: -19.86% (1.7473 => 1.4002, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/mason/mason: -17.15% (0.5004 => 0.4146, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.19% (1.7361 => 1.4723, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/sieve: -12.11% (8.1594 => 7.1710, std.dev.: 0.0271) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.70% (15.8312 => 13.9787, std.dev.: 0.3607) MultiSource/Applications/sgefa/sgefa: -11.32% (0.3746 => 0.3322, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.66% (1.1647 => 1.0522, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.54% (3.2007 => 2.9275, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/flops: -8.42% (9.5474 => 8.7439, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -6.93% (7.6833 => 7.1506, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3357, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8733, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/distray/distray: -6.34% (0.2664 => 0.2495, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -5.78% (1.4441 => 1.3607, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: -5.44% (3.4230 => 3.2368, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/fib2: -4.91% (4.4195 => 4.2023, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: -4.91% (2.5166 => 2.3931, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.49% (0.4564 => 0.4359, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7927, std.dev.: 0.1721) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.2959 => 1.2494, std.dev.: 0.0124) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.57% (1.2722 => 1.2268, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -3.38% (0.4296 => 0.4151, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8205, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6385, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.87% (0.4140 => 0.4021, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.48% (45.4683 => 44.3417, std.dev.: 0.3429) SingleSource/Benchmarks/Shootout-C++/methcall: -2.40% (9.2503 => 9.0286, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/neural/neural: -2.27% (1.0926 => 1.0678, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.14% (1.1683 => 1.1433, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -1.97% (3.4286 => 3.3610, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: -1.79% (3.8907 => 3.8209, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2242, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: -1.63% (3.4876 => 3.4306, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.51% (61.1734 => 60.2485, std.dev.: 0.3257) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.28% (25.6658 => 25.3367, std.dev.: 0.0697) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.01% (0.9980 => 0.9981, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: -3.35% (0.6022 => 0.5820, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.1666 => 0.1582, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -17.25% (0.1554 => 0.1286, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.87% (0.3083 => 0.2933, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.64% (0.2394 => 0.2211, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.57% (0.3175 => 0.2998, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.69% (0.2302 => 0.2102, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -37.19% (0.0449 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -53.93% (0.0089 => 0.0041, std.dev.: 0.0023) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.63% (0.0301 => 0.0272, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.22% (0.0324 => 0.0252, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -42.94% (0.0177 => 0.0101, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -23.28% (0.0189 => 0.0145, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -63.69% (0.0325 => 0.0118, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -3.15% (0.1429 => 0.1384, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -1.56% (1.5019 => 1.4784, std.dev.: 0.0277) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.67% (0.1501 => 0.1491, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.74% (0.4264 => 0.4062, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.44% (0.1344 => 0.1444, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.68% (0.0589 => 0.0532, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.10% (0.0232 => 0.0190, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0639 => 0.0626, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.01% (1.1350 => 1.1235, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.63% (0.0637 => 0.0633, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.55% (0.0246 => 0.0161, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.27% (1.5363 => 1.7095, std.dev.: 0.0104) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 20:22:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 22:22:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120926032241.BE8892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4246?compare_to=4242&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4246, Order: 164651, Start Time: 2012-09-26 00:39:52, End Time: 2012-09-26 03:24:13 To: 4242, Order: 164623, Start Time: 2012-09-25 19:46:05, End Time: 2012-09-25 22:30:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.10% (0.3488 => 0.3910, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.91% (0.3460 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.90% (0.3496 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3446 => 0.3856, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3469 => 0.3879, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 11.48% (0.3650 => 0.4069, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3643 => 0.4059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.22% (0.3724 => 0.4142, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.16% (1.5932 => 1.7391, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.36% (0.5826 => 0.6313, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.5889 => 0.6371, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (1.3152 => 1.4156, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7171 => 0.7713, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (1.6211 => 1.7418, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.41% (2.7292 => 2.9314, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.36% (0.4361 => 0.4682, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.20% (0.2875 => 0.3082, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (3.5627 => 3.8184, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.05% (0.2738 => 0.2931, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.00% (0.2714 => 0.2904, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.99% (0.3004 => 0.3214, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.96% (0.2729 => 0.2919, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.94% (0.5000 => 0.5347, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.89% (0.3195 => 0.3415, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.80% (0.2750 => 0.2937, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.79% (0.2813 => 0.3004, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.77% (0.2792 => 0.2981, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.75% (0.4994 => 0.5331, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 6.72% (5.5417 => 5.9143, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.70% (2.0673 => 2.2058, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 6.70% (0.2823 => 0.3012, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2803 => 0.2990, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.65% (0.5026 => 0.5360, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.60% (1.0781 => 1.1493, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 6.59% (0.2566 => 0.2735, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.2780 => 0.2963, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.53% (0.3845 => 0.4096, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.51% (0.9909 => 1.0554, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.47% (0.2811 => 0.2993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.43% (0.3096 => 0.3295, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3267 => 0.3476, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.38% (0.3258 => 0.3466, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.31% (0.3362 => 0.3574, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.27% (0.3060 => 0.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3317 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.23% (23.5202 => 24.9853, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.15% (0.3282 => 0.3484, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.12% (0.3348 => 0.3553, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.12% (0.3678 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.11% (0.3124 => 0.3315, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3625 => 0.3846, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.06% (4.2109 => 4.4660, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (4.4195 => 4.6857, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.97% (0.3903 => 0.4136, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.97% (0.2866 => 0.3037, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.95% (0.3477 => 0.3684, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.93% (0.3690 => 0.3909, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 5.85% (0.3726 => 0.3944, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.83% (2.1013 => 2.2238, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.5900 => 0.6242, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 5.74% (0.4146 => 0.4384, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 5.71% (0.6634 => 0.7013, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.2736 => 0.2892, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.67% (0.4251 => 0.4492, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.46% (0.4139 => 0.4365, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.42% (1.4269 => 1.5043, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 5.42% (1.8794 => 1.9813, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.3981 => 0.4196, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.40% (0.3890 => 0.4100, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.39% (4.6177 => 4.8667, std.dev.: 0.0167) MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (0.2691 => 0.2835, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.21% (0.5012 => 0.5273, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (2.1653 => 2.2774, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.02% (0.6435 => 0.6758, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.91% (1.9694 => 2.0661, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.88% (0.2068 => 0.2169, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (0.4658 => 0.4884, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: 4.81% (0.5546 => 0.5813, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.80% (1.9966 => 2.0925, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.79% (0.2737 => 0.2868, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.77% (0.3084 => 0.3231, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 4.56% (0.9697 => 1.0139, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.3271 => 0.3420, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.50% (0.3336 => 0.3486, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.50% (0.7875 => 0.8229, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.45% (2.0346 => 2.1251, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.14% (0.2969 => 0.3092, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 3.78% (0.4847 => 0.5030, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.36% (0.4253 => 0.4396, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (0.7426 => 0.7674, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (0.5361 => 0.5533, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (11.6398 => 11.9765, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (4.6926 => 4.8238, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (0.5584 => 0.5739, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3792 => 0.3895, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.74% (11.9555 => 12.1639, std.dev.: 0.0166) SingleSource/UnitTests/Vector/constpool: 1.42% (2.4764 => 2.5115, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6654, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1679, std.dev.: 0.1377) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6442, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1961, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5010, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4431, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5924, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5796, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7849, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.76% (11.2080 => 10.7867, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7648, std.dev.: 0.1039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 20:34:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 22:34:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926033458.AADB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4247?compare_to=4245&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4247, Order: 164654, Start Time: 2012-09-26 02:21:52, End Time: 2012-09-26 03:36:31 To: 4245, Order: 164651, Start Time: 2012-09-26 00:27:40, End Time: 2012-09-26 01:42:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (74 on baseline) Performance Improvements: 2 (45 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 890 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.72% (0.8223 => 0.9269, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.66% (3.0397 => 3.3030, std.dev.: 0.0972) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (4.3308 => 4.4838, std.dev.: 0.0348) SingleSource/Benchmarks/Misc/ReedSolomon: 1.63% (8.7132 => 8.8552, std.dev.: 0.0394) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.3931 => 2.4254, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.35% (2.0596 => 1.9906, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.01% (4.2038 => 4.1191, std.dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.47% (0.9981 => 1.0028, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: 1.43% (0.5820 => 0.5903, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 3.03% (0.1582 => 0.1630, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.49% (0.1286 => 0.1318, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.52% (0.2933 => 0.3007, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.81% (0.2211 => 0.2171, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.77% (0.2998 => 0.2975, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.05% (0.2102 => 0.2101, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel: -0.35% (0.0282 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 75.61% (0.0041 => 0.0072, std.dev.: 0.0008) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.33% (0.0075 => 0.0076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0194 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.57% (0.0383 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.29% (0.0272 => 0.0300, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.57% (0.0252 => 0.0261, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 47.52% (0.0101 => 0.0149, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 33.10% (0.0145 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.58% (0.0253 => 0.0249, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -36.44% (0.0118 => 0.0075, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.83% (0.1384 => 0.1437, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.35% (0.2252 => 0.2305, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.72% (1.4784 => 1.5038, std.dev.: 0.0191) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.55% (0.1491 => 0.1529, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.63% (0.5881 => 0.5918, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 0.21% (26.7453 => 26.8014, std.dev.: 0.0770) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4062 => 0.4057, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.46% (0.1444 => 0.1394, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.96% (0.0532 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.26% (0.0190 => 0.0180, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.39% (0.0626 => 0.0666, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1235 => 1.1238, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.53% (0.0633 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (0.0161 => 0.0157, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7657 => 0.7657, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.20% (1.7095 => 1.7061, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.58% (6.7458 => 0.2305, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -91.51% (6.9722 => 0.5918, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/09-vor/vor: 21566.45% (0.1237 => 26.8014, std.dev.: 0.0770) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.12% (4.1772 => 3.0863, std.dev.: 0.0759) SingleSource/Benchmarks/Shootout-C++/except: 82200.00% (0.0006 => 0.4938, std.dev.: 0.0019) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 8.99% (2.1763 => 2.3720, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.99% (0.6410 => 0.6986, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.71% (0.1159 => 0.1260, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.5309 => 0.5720, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 7.10% (0.6173 => 0.6611, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 6.86% (1.0046 => 1.0735, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.57% (1.1653 => 1.2419, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.20% (1.5150 => 1.6090, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.97% (0.3582 => 0.3796, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 5.95% (15.3105 => 16.2215, std.dev.: 0.0647) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.6915 => 0.7308, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.64% (0.6069 => 0.6411, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.56% (0.3901 => 0.4118, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.37% (0.2552 => 0.2689, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.18% (3.0225 => 3.1790, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.17% (0.7639 => 0.8034, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.2797 => 0.2934, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.52% (0.2654 => 0.2774, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 4.47% (4.7455 => 4.9574, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3217 => 0.3357, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.21% (0.4248 => 0.4427, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 3.95% (13.3238 => 13.8499, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.74% (1.2021 => 1.2471, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (8.2186 => 8.5222, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.69% (0.8569 => 0.8885, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.65% (1.0821 => 1.1216, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 3.61% (2.0972 => 2.1730, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2546 => 6.4761, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.52% (3.0758 => 3.1840, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.46% (1.4408 => 1.4907, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 3.40% (29.3170 => 30.3136, std.dev.: 0.0773) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.0689 => 1.1050, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 3.24% (1.3268 => 1.3698, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.1827 => 1.2202, std.dev.: 0.0143) MultiSource/Applications/treecc/treecc: 3.17% (1.8798 => 1.9394, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (1.1672 => 1.2041, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/football/football: 3.15% (0.8405 => 0.8670, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 3.14% (14.7256 => 15.1882, std.dev.: 0.0881) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (12.6413 => 13.0369, std.dev.: 0.0717) MultiSource/Applications/lua/lua: 2.81% (3.5980 => 3.6992, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.73% (0.4880 => 0.5013, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.4908 => 6.6406, std.dev.: 0.0429) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.25% (4.3380 => 4.4358, std.dev.: 0.0290) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.80% (4.2616 => 4.3384, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (4.0318 => 4.0945, std.dev.: 0.0207) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: 39.08% (0.0261 => 0.0363, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9990, std.dev.: 0.0139) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.26% (4.0101 => 4.5417, std.dev.: 0.0444) SingleSource/Benchmarks/McGill/queens: 11.13% (1.6261 => 1.8071, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.17% (3.0256 => 3.3030, std.dev.: 0.0972) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.08% (1.0063 => 1.0977, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.07% (0.8498 => 0.9269, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.93% (0.2857 => 0.3112, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.33% (7.0025 => 7.5856, std.dev.: 0.0374) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.42% (0.3301 => 0.3546, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.43% (4.2129 => 4.4838, std.dev.: 0.0348) MultiSource/Benchmarks/Olden/bisort/bisort: 4.77% (0.6459 => 0.6767, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8448, std.dev.: 0.0576) SingleSource/Benchmarks/Misc/ReedSolomon: 4.04% (8.5113 => 8.8552, std.dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5395, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.91% (2.6656 => 2.7431, std.dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: 2.85% (14.4877 => 14.9002, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8093, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 2.55% (3.5520 => 3.6424, std.dev.: 0.0251) SingleSource/Benchmarks/Dhrystone/dry: 1.91% (2.4013 => 2.4472, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 1.28% (1.4184 => 1.4366, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4455 => 2.4734, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.79% (0.2996 => 0.1654, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.15% (1.4189 => 1.1330, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.10% (1.4113 => 1.1276, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.55% (0.3497 => 0.2114, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.79% (5.2665 => 4.1191, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: -19.85% (1.7473 => 1.4004, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.08% (15.8312 => 13.2852, std.dev.: 0.7470) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.30% (1.7361 => 1.4704, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: -15.23% (0.5004 => 0.4242, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -11.24% (0.3746 => 0.3325, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.99% (1.1647 => 1.0484, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.00% (1.4034 => 1.2771, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: -8.44% (9.5474 => 8.7419, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.17% (3.2007 => 2.9392, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -6.99% (7.6833 => 7.1463, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.6254 => 3.3791, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3328, std.dev.: 0.0259) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3512, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: -5.83% (3.4230 => 3.2234, std.dev.: 0.0250) MultiSource/Benchmarks/FreeBench/distray/distray: -5.67% (0.2664 => 0.2513, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1856, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -4.19% (62.4126 => 59.7964, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (2.5166 => 2.4254, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: -3.59% (9.2503 => 8.9179, std.dev.: 0.0779) SingleSource/Benchmarks/McGill/misr: -3.19% (0.4296 => 0.4159, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.06% (3.7496 => 3.6349, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8212, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.73% (0.4140 => 0.4027, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.71% (1.1683 => 1.1366, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.14% (2.4457 => 2.3933, std.dev.: 0.0160) MultiSource/Benchmarks/PAQ8p/paq8p: -1.99% (92.7467 => 90.9045, std.dev.: 0.5432) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3635, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -1.89% (1.0926 => 1.0719, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2238, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: -1.71% (3.4876 => 3.4280, std.dev.: 0.0123) MultiSource/Benchmarks/llubenchmark/llu: -1.42% (2.0192 => 1.9906, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3063, std.dev.: 0.0158) SingleSource/Benchmarks/Dhrystone/fldry: -1.27% (2.4971 => 2.4655, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.48% (0.9980 => 1.0028, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: -1.98% (0.6022 => 0.5903, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -2.16% (0.1666 => 0.1630, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.19% (0.1554 => 0.1318, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (0.3083 => 0.3007, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.31% (0.2394 => 0.2171, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.30% (0.3175 => 0.2975, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.73% (0.2302 => 0.2101, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel: -37.42% (0.0449 => 0.0281, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -19.10% (0.0089 => 0.0072, std.dev.: 0.0008) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.44% (0.0324 => 0.0261, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -15.82% (0.0177 => 0.0149, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -76.92% (0.0325 => 0.0075, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 0.13% (1.5019 => 1.5038, std.dev.: 0.0191) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.87% (0.1501 => 0.1529, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.72% (0.1344 => 0.1394, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.68% (0.0589 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.41% (0.0232 => 0.0180, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.23% (0.0639 => 0.0666, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.99% (1.1350 => 1.1238, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.09% (0.0637 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.18% (0.0246 => 0.0157, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 20:53:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 22:53:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926035331.9BB202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4248?compare_to=4244&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4248, Order: 164654, Start Time: 2012-09-26 02:34:00, End Time: 2012-09-26 03:48:28 To: 4244, Order: 164631, Start Time: 2012-09-25 21:34:21, End Time: 2012-09-25 22:48:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (172 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (693 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.68% (2.0176 => 2.4349, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956) MultiSource/Benchmarks/McCat/08-main/main: 13.78% (0.2243 => 0.2552, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.10% (0.5818 => 0.6522, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.90% (0.5748 => 0.6432, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.64% (0.7061 => 0.7883, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 11.21% (0.4328 => 0.4813, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.04% (0.2781 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.78% (3.9660 => 4.3935, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.68% (1.3693 => 1.5156, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.60% (0.2782 => 0.3077, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.54% (0.1072 => 0.1185, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.54% (0.4062 => 0.4490, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 10.40% (0.2760 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.33% (0.3485 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.32% (1.4563 => 1.6066, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.24% (0.9199 => 1.0141, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.20% (0.2607 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.14% (1.2193 => 1.3429, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.13% (0.2596 => 0.2859, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.10% (1.9828 => 2.1831, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.03% (0.5265 => 0.5793, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.03% (0.7710 => 0.8483, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.00% (0.7038 => 0.7742, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2721 => 0.2993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3489 => 0.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.94% (0.4016 => 0.4415, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.91% (0.4390 => 0.4825, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.87% (0.2937 => 0.3227, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.85% (0.2761 => 0.3033, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.80% (0.6959 => 0.7641, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.80% (0.3756 => 0.4124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.64% (0.3868 => 0.4241, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.64% (13.8202 => 15.1524, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.48% (1.1364 => 1.2441, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.33% (0.6283 => 0.6869, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.75% (0.5577 => 0.6065, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.65% (0.3663 => 0.3980, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 8.65% (1.0313 => 1.1205, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 8.63% (0.3789 => 0.4116, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.40% (16.6129 => 18.0081, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.36% (7.2180 => 7.8214, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 8.35% (0.2995 => 0.3245) SingleSource/UnitTests/ObjC/parameter-passing: 8.34% (0.4003 => 0.4337, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.31% (1.1061 => 1.1980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.28% (0.3755 => 0.4066, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.10% (0.7506 => 0.8114, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 8.06% (0.8310 => 0.8980, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.01% (0.8698 => 0.9395, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.00% (0.5637 => 0.6088, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.95% (0.4791 => 0.5172, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3220 => 0.3473, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.72% (0.7460 => 0.8036, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.71% (0.6744 => 0.7264, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.68% (0.6576 => 0.7081, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 7.66% (3.1889 => 3.4333, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 7.65% (1.0594 => 1.1404, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.59% (0.2925 => 0.3147, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.58% (3.8646 => 4.1576, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.49% (1.9270 => 2.0714, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.43% (2.1791 => 2.3409, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.12% (1.3245 => 1.4188, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.12% (3.6692 => 3.9303, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.98% (14.8535 => 15.8897, std.dev.: 0.0099) MultiSource/Benchmarks/sim/sim: 6.90% (0.3131 => 0.3347, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (1.2749 => 1.3628, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.86% (1.2292 => 1.3135, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (8.4961 => 9.0774, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.70% (4.3801 => 4.6734, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.66% (4.4433 => 4.7391, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.6135 => 0.6534, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.38% (1.1333 => 1.2056, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.22% (0.6250 => 0.6639, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.18% (4.6629 => 4.9512, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.14% (0.8818 => 0.9359, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.97% (4.9865 => 5.2844, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.91% (0.4805 => 0.5089, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.72% (3.2742 => 3.4615, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.49% (6.5754 => 6.9363, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.45% (0.3245 => 0.3422, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (6.2785 => 6.6122, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.28% (1.5188 => 1.5990, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (13.2842 => 13.9795, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.03% (0.9108 => 0.9566, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.96% (3.7467 => 3.9326, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.86% (2.1007 => 2.2027, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.40% (16.2614 => 16.8139, std.dev.: 0.0136) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9279, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std.dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.00% (1.2998 => 1.3778, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.36% (10.7476 => 11.1085, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-6: 3.26% (1.9199 => 1.9824, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.08% (7.4271 => 7.5813, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.72% (3.7731 => 3.8379, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5826, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5870, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4443, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.01% (8.8259 => 8.9148, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.57% (0.2670 => 0.1400, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.90% (0.4657 => 0.3963, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.49% (1.3819 => 1.1816, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.31% (1.3813 => 1.1837, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.5627 => 21.5364, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.38% (20.3410 => 18.2302, std.dev.: 0.0519) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.94% (1.3780 => 1.2961, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.81% (0.9996 => 0.9615, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9523, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0084) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7905, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1270, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2200, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -1.08% (1.2308 => 1.2175, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 20:54:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Sep 2012 22:54:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926035454.C29DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4249?compare_to=4241&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4249, Order: 164654, Start Time: 2012-09-26 02:37:19, End Time: 2012-09-26 03:56:27 To: 4241, Order: 164624, Start Time: 2012-09-25 19:57:35, End Time: 2012-09-25 21:15:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 3 (4 on baseline) Performance Regressions: 3 (149 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 947 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++-EH/spirit: 1988620.00% (0.0005 => 9.9436, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 483133.33% (0.0009 => 4.3491, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1088933.33% (0.0003 => 3.2671, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 26.99% (1.6348 => 2.0761, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.90% (78.0238 => 80.2866, std.dev.: 0.2755) SingleSource/Benchmarks/McGill/chomp: 1.43% (1.2123 => 1.2296, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.78% (0.5790 => 0.5745, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: -0.38% (16.0318 => 15.9714, std.dev.: 0.0176) MultiSource/Benchmarks/Bullet/bullet: 0.31% (54.0822 => 54.2517, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: -0.31% (4.3328 => 4.3193, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.08% (1.2334 => 1.2324, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.21% (7.5075 => 7.4917, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.51% (0.7272 => 0.7235, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0356 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.24% (0.2076 => 0.2071, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.22% (63.2438 => 54.2517, std.dev.: 0.0200) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.17% (14.1553 => 18.4261, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.56% (3.4629 => 5.4563, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14236.81% (0.0720 => 10.3225, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943500.00% (0.0001 => 9.9436, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.79% (0.2554 => 0.3749, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 46.39% (10.3673 => 15.1762, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: 30.70% (0.1622 => 0.2120, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: 30.21% (0.1056 => 0.1375, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.66% (2.2022 => 2.5470, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.75% (7.0540 => 8.0947, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.36% (1.7609 => 1.9610, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 10.84% (10.4361 => 11.5669, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.93% (0.3282 => 0.3608, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.03% (0.3177 => 0.3432, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 7.96% (9.4845 => 10.2395, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.93% (0.4879 => 0.5266, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.55% (1.5415 => 1.6579, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.53% (0.3121 => 0.3356, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 7.45% (0.7115 => 0.7645) MultiSource/Applications/oggenc/oggenc: 7.44% (5.7591 => 6.1875, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 7.17% (0.3109 => 0.3332, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.17% (0.7433 => 0.7966, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.3423 => 0.3664, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.03% (0.6675 => 0.7144, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.02% (0.4615 => 0.4939, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3960, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.89% (3.3354 => 3.5652, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.83% (0.8172 => 0.8730, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (8.1363 => 8.6918, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.81% (0.5860 => 0.6259, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.76% (4.2646 => 4.5529, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.63% (0.7326 => 0.7812, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.49% (0.9765 => 1.0399, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.48% (4.9449 => 5.2652, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.43% (0.5569 => 0.5927, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.41% (5.0018 => 5.3226, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 6.40% (0.3422 => 0.3641, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.37% (0.8067 => 0.8581, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.34% (0.4636 => 0.4930, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2758 => 0.2928, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 6.15% (0.7835 => 0.8317, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.09% (0.5105 => 0.5416, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.02% (0.3387 => 0.3591, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.96% (21.9371 => 23.2445, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.96% (0.5020 => 0.5319, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.94% (1.5603 => 1.6530, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (7.9617 => 8.4322, std.dev.: 0.0105) MultiSource/Applications/Burg/burg: 5.86% (1.1642 => 1.2324, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 5.78% (0.6456 => 0.6829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.78% (0.2891 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.73% (0.4203 => 0.4444, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.72% (1.1861 => 1.2540, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/moments: 5.71% (0.4048 => 0.4279, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3441 => 0.3637, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.67% (0.3283 => 0.3469, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.63% (0.4103 => 0.4334, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.62% (1.0722 => 1.1325, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 5.61% (0.2905 => 0.3068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3865 => 0.4081, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.58% (3.8723 => 4.0882, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 5.57% (0.4289 => 0.4528, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3650 => 0.3852, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.3232 => 0.3410) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2872 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2871 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3603 => 0.3799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.3098 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.41% (2.0665 => 2.1782, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 5.35% (0.4620 => 0.4867, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.34% (0.3052 => 0.3215, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2756 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.31% (0.3162 => 0.3330, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.28% (0.3180 => 0.3348, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3826 => 0.4028, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.23% (2.0273 => 2.1334, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 5.13% (0.3684 => 0.3873, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.10% (0.2802 => 0.2945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.09% (0.3379 => 0.3551, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.05% (0.2793 => 0.2934, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.01% (0.2877 => 0.3021, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.94% (0.8921 => 0.9362, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.81% (0.6450 => 0.6760, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.77% (2.2969 => 2.4064, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5981 => 0.6266, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.57% (1.5859 => 1.6583, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.21% (2.2024 => 2.2951, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.07% (1.4186 => 1.4763, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.4064 => 0.4229, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.1840 => 1.2310, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.2842 => 1.3298, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 3.19% (0.3131 => 0.3231, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.8101 => 0.8354, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (14.3668 => 14.7837, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.78% (1.1194 => 1.1505, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.33% (17.1811 => 17.5813, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.8922 => 3.9517, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.64% (0.5413 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.58% (3.6395 => 3.7698, std.dev.: 0.0132) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3491, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.50% (9.1159 => 9.2523, std.dev.: 0.0470) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8071, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5868, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2605, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.73% (5.3855 => 3.6229, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.35% (5.3526 => 3.6211, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0675, std.dev.: 0.0299) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.37% (2.9384 => 2.6043, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8614, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -9.30% (0.2161 => 0.1960, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3126, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5961, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.39% (0.9957 => 0.9520, std.dev.: 0.0096) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1618, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1719, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4982, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9981, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0901, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2327, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.87% (0.5229 => 0.5745, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 6.55% (14.9895 => 15.9714, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (4.1105 => 4.3193, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.55% (1.1048 => 1.2324, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.66% (7.1582 => 7.4917, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.28% (0.6222 => 0.7235, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.13% (0.2116 => 0.2071, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 22:06:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 00:06:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926050619.C3E842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4250?compare_to=4247&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4250, Order: 164656, Start Time: 2012-09-26 03:52:33, End Time: 2012-09-26 05:07:53 To: 4247, Order: 164654, Start Time: 2012-09-26 02:21:52, End Time: 2012-09-26 03:36:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 9 (77 on baseline) Performance Improvements: 2 (49 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 886 (761 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.69% (0.7572 => 0.8003, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.76% (1.3315 => 1.3949, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.73% (40.9670 => 42.9050, std.dev.: 0.1751) SingleSource/Benchmarks/Misc/mandel-2: 2.33% (3.0863 => 3.1582, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.78% (1.2170 => 1.2387, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.74% (1.2733 => 1.2954, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.57% (1.4176 => 1.4398, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.39% (2.3933 => 2.4266, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.20% (4.6573 => 4.7130, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.52% (0.7708 => 0.7591, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: -1.38% (1.3698 => 1.3509, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.31% (1.0028 => 1.0059, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: -0.03% (0.5903 => 0.5901, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 0.37% (0.1630 => 0.1636, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.90% (0.1318 => 0.1343, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.53% (0.3007 => 0.3023, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.2171 => 0.2245, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (0.2975 => 0.3053, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.76% (0.2101 => 0.2138, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -8.54% (0.0281 => 0.0257, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: 19.44% (0.0072 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.32% (0.0076 => 0.0077, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.37% (0.0194 => 0.0170, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0389 => 0.0392, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0300 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0283 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 26.44% (0.0261 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -9.40% (0.0149 => 0.0135, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -27.98% (0.0193 => 0.0139, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -4.82% (0.0249 => 0.0237, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 66.67% (0.0075 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.83% (0.1437 => 0.1382, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: -0.48% (0.2305 => 0.2294, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.45% (1.5038 => 1.4820, std.dev.: 0.0257) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.58% (0.1529 => 0.1459, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.07% (0.5918 => 0.5922, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.38% (26.8014 => 26.7004, std.dev.: 0.1114) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.12% (0.4057 => 0.4062, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.79% (0.1394 => 0.1383, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.0585 => 0.0551, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.0180 => 0.0195, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.96% (0.0666 => 0.0613, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.05% (1.1238 => 1.1356, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0016 => 0.0016, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.18% (0.0560 => 0.0561, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.74% (0.0157 => 0.0137, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7657 => 0.7654, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7061 => 1.7059, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2294, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -91.51% (6.9722 => 0.5922, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 21484.80% (0.1237 => 26.7004, std.dev.: 0.1114) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.39% (4.1772 => 3.1582, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.03% (0.0745 => 0.0924, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 9.63% (0.5309 => 0.5820, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.71% (0.1159 => 0.1260, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.70% (0.1414 => 0.1537, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 8.64% (2.1763 => 2.3643, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.60% (0.6410 => 0.6961, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.34% (1.0046 => 1.0783, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (1.1653 => 1.2456, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 6.87% (15.3105 => 16.3630, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.84% (0.3582 => 0.3827, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.72% (1.5150 => 1.6168, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 6.07% (0.6173 => 0.6548, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.2552 => 0.2694, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.32% (0.6915 => 0.7283, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.10% (0.3901 => 0.4100, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.90% (0.2654 => 0.2784, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.82% (3.0225 => 3.1683, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.73% (0.6069 => 0.6356, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.57% (0.4248 => 0.4442, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 4.45% (0.3217 => 0.3360, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (1.4408 => 1.5032, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (6.2546 => 6.4995, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 3.83% (13.3238 => 13.8338, std.dev.: 0.0471) SingleSource/Benchmarks/Shootout-C++/hash: 3.78% (0.3520 => 0.3653, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.78% (1.2021 => 1.2475, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.76% (4.7455 => 4.9237, std.dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 3.72% (8.2186 => 8.5242, std.dev.: 0.0779) MultiSource/Applications/siod/siod: 3.68% (2.0972 => 2.1743, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.63% (3.0758 => 3.1875, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (12.6413 => 13.0977, std.dev.: 0.1058) MultiSource/Applications/Burg/burg: 3.55% (1.1440 => 1.1846, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.40% (2.0317 => 2.1008, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 3.24% (3.5980 => 3.7147, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (1.1672 => 1.2040, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.07% (0.8569 => 0.8832, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.0689 => 1.1009, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.97% (0.4880 => 0.5025, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.7256 => 15.1456, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/hash2: 2.70% (0.3847 => 0.3951, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.38% (0.7784 => 0.7969, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5636 => 0.5767, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.21% (0.5963 => 0.6095, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 2.19% (1.8798 => 1.9210, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (8.2559 => 8.4097, std.dev.: 0.0564) MultiSource/Applications/hbd/hbd: 1.82% (1.3268 => 1.3509, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.70% (0.5937 => 0.6038, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (4.0318 => 4.0996, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.07% (4.2815 => 4.3274, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 44.06% (0.0261 => 0.0376, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2289, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/ary3: 15.37% (1.7426 => 2.0104, std.dev.: 0.0577) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.30% (4.0101 => 4.5436, std.dev.: 0.0225) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.10% (0.0917 => 0.1028, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.24% (0.1417 => 0.1548, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 8.99% (7.0025 => 7.6320, std.dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.65% (1.0063 => 1.0933, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.99% (40.4792 => 42.9050, std.dev.: 0.1751) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.18% (0.7609 => 0.8003, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8450, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/dt: 4.05% (0.9851 => 1.0250, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 3.18% (8.5113 => 8.7816, std.dev.: 0.0294) MultiSource/Applications/siod/siod: 2.92% (3.5520 => 3.6556, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 2.79% (0.6308 => 0.6484, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8887, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (6.6312 => 6.8118, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.43% (2.6656 => 2.7303, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.17% (4.6127 => 4.7130, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4013 => 2.4507, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.79% (1.2726 => 1.2954, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (2.4455 => 2.4876, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (2.4042 => 2.4407, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.73% (0.2996 => 0.1656, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.69% (1.4113 => 1.1334, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.52% (1.4189 => 1.1420, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: -1.90% (0.7738 => 0.7591, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.29% (0.3497 => 0.2123, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.25% (5.2665 => 4.1474, std.dev.: 0.1028) SingleSource/Benchmarks/Shootout-C++/ary3: -19.88% (1.7473 => 1.3999, std.dev.: 0.0732) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.14% (15.8312 => 12.8016, std.dev.: 0.7041) MultiSource/Benchmarks/FreeBench/mason/mason: -16.81% (0.5004 => 0.4163, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.74% (1.7361 => 1.4802, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/sieve: -12.36% (8.1594 => 7.1506, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.21% (0.0917 => 0.0805, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.64% (1.1647 => 1.0524, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -8.43% (9.5474 => 8.7427, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.11% (3.2007 => 2.9410, std.dev.: 0.0375) MultiSource/Applications/lambda-0_1_3/lambda: -7.06% (7.6833 => 7.1410, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3734, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/distray/distray: -6.64% (0.2664 => 0.2487, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3342, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3513, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: -5.77% (3.4230 => 3.2254, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.73% (2.9728 => 2.8026, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1865, std.dev.: 0.0421) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.52% (0.4140 => 0.3953, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -4.17% (62.4126 => 59.8113, std.dev.: 0.1528) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (2.5166 => 2.4256, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/misr: -2.98% (0.4296 => 0.4168, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.98% (3.9413 => 3.8240, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/methcall: -2.96% (9.2503 => 8.9763, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.81% (3.7496 => 3.6442, std.dev.: 0.0147) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.63% (1.2722 => 1.2387, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.47% (1.2959 => 1.2639, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -2.34% (1.0926 => 1.0670, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.11% (45.4683 => 44.5107, std.dev.: 0.3461) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.06% (1.1683 => 1.1442, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -1.96% (92.7467 => 90.9293, std.dev.: 0.1100) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4195, std.dev.: 0.0139) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3630, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3138, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2262, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3156, std.dev.: 0.0332) SingleSource/Benchmarks/Dhrystone/fldry: -1.22% (2.4971 => 2.4667, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -1.10% (2.8599 => 2.8283, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.79% (0.9980 => 1.0059, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: -2.01% (0.6022 => 0.5901, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -1.80% (0.1666 => 0.1636, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.58% (0.1554 => 0.1343, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.95% (0.3083 => 0.3023, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.22% (0.2394 => 0.2245, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.84% (0.3175 => 0.3053, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.12% (0.2302 => 0.2138, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -42.76% (0.0449 => 0.0257, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -3.37% (0.0089 => 0.0086, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -67.92% (0.0240 => 0.0077, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.46% (0.0192 => 0.0170, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0324 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -23.73% (0.0177 => 0.0135, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -26.46% (0.0189 => 0.0139, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -4.82% (0.0249 => 0.0237, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.29% (0.1429 => 0.1382, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -1.32% (1.5019 => 1.4820, std.dev.: 0.0257) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.80% (0.1501 => 0.1459, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.74% (0.4264 => 0.4062, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.90% (0.1344 => 0.1383, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.45% (0.0589 => 0.0551, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.95% (0.0232 => 0.0195, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.07% (0.0639 => 0.0613, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1350 => 1.1356, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.93% (0.0637 => 0.0561, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.31% (0.0246 => 0.0137, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.04% (1.5363 => 1.7059, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 22:43:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 00:43:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926054335.8E7F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4251?compare_to=4249&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4251, Order: 164656, Start Time: 2012-09-26 04:25:20, End Time: 2012-09-26 05:44:25 To: 4249, Order: 164654, Start Time: 2012-09-26 02:37:19, End Time: 2012-09-26 03:56:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 8 (153 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 943 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.55% (15.1762 => 15.8660, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (11.5669 => 11.7126, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.17% (1.9610 => 1.9840, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.07% (3.9517 => 3.9940, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (8.4322 => 8.5221, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.57% (55.6726 => 56.5485, std.dev.: 0.0649) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (1.2903 => 1.3083, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 1.24% (3.7947 => 3.8417, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.37% (80.2866 => 78.3855, std.dev.: 0.2926) SingleSource/Benchmarks/McGill/chomp: -2.15% (1.2296 => 1.2032, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.77% (0.5745 => 0.5789, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 0.91% (15.9714 => 16.1165, std.dev.: 0.0188) MultiSource/Benchmarks/Bullet/bullet: 0.25% (54.2517 => 54.3858, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 0.47% (4.3193 => 4.3394, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.55% (1.2324 => 1.2392, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (7.4917 => 7.5068, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.37% (0.7235 => 0.7262, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0358 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2071 => 0.2070, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.01% (63.2438 => 54.3858, std.dev.: 0.0152) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.12% (14.1553 => 18.5611, std.dev.: 0.0299) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.23% (3.4629 => 5.4795, std.dev.: 0.0047) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14243.61% (0.0720 => 10.3274, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9942400.00% (0.0001 => 9.9425, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 53.04% (10.3673 => 15.8660, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/08-main/main: 47.30% (0.2554 => 0.3762, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.29% (2.2022 => 2.5609, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.27% (7.0540 => 8.1309, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.94% (0.1432 => 0.1646, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.67% (1.7609 => 1.9840, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.23% (10.4361 => 11.7126, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.46% (0.3282 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.91% (0.3177 => 0.3460, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.85% (9.4845 => 10.3239, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 8.68% (0.1440 => 0.1565, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.44% (0.4879 => 0.5291, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.39% (0.3121 => 0.3383, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 8.28% (5.7591 => 6.2358, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.5415 => 1.6680, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 8.20% (0.3109 => 0.3364, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 8.03% (0.7115 => 0.7686, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 7.98% (0.7433 => 0.8026, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.6675 => 0.7206, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.80% (0.4615 => 0.4975, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.79% (1.3050 => 1.4067, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 7.62% (0.3423 => 0.3684, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.60% (4.2646 => 4.5889, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.55% (3.3354 => 3.5873, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (8.1363 => 8.7413, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 7.43% (0.1695 => 0.1821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.37% (0.5860 => 0.6292, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.29% (0.7326 => 0.7860, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.25% (0.9765 => 1.0473, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.24% (0.8067 => 0.8651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.20% (4.9449 => 5.3010, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (5.0018 => 5.3588, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.04% (0.5569 => 0.5961, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.04% (7.9617 => 8.5221, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2107 => 0.2255, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.5105 => 0.5461, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.93% (0.8172 => 0.8738, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.88% (0.7835 => 0.8374, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 6.81% (1.5603 => 1.6665, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2758 => 0.2945, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.76% (0.3387 => 0.3616) MultiSource/Benchmarks/McCat/05-eks/eks: 6.75% (0.4299 => 0.4589, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.67% (0.5020 => 0.5355, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.48% (1.1642 => 1.2396, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.45% (21.9371 => 23.3516, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.44% (1.1861 => 1.2625, std.dev.: 0.0101) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 6.38% (0.6456 => 0.6868, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.35% (1.0722 => 1.1403, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.4103 => 0.4360, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3441 => 0.3656, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.22% (0.2603 => 0.2765, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 6.20% (3.8723 => 4.1125, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4289 => 0.4552, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2891 => 0.3067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.03% (0.3865 => 0.4098, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.02% (0.2905 => 0.3080, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.02% (0.4203 => 0.4456, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.95% (2.0273 => 2.1480, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 5.94% (0.3180 => 0.3369, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.83% (0.4048 => 0.4284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.83% (0.3603 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.82% (0.8921 => 0.9440, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.80% (2.0665 => 2.1864, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4620 => 0.4887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3162 => 0.3344, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2872 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.66% (0.6450 => 0.6815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.64% (0.3283 => 0.3468, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3232 => 0.3414, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.59% (0.3684 => 0.3890, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.56% (0.2877 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.48% (0.2793 => 0.2946, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.47% (2.2969 => 2.4225, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2802 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.43% (0.2266 => 0.2389, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.35% (1.5859 => 1.6707, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.32% (0.5981 => 0.6299, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.93% (1.4186 => 1.4886, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 4.91% (1.1840 => 1.2421, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.72% (2.2024 => 2.3063, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.4064 => 0.4243, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2842 => 1.3381, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.3131 => 0.3249, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.70% (0.8101 => 0.8401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (14.3668 => 14.8453, std.dev.: 0.0257) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.87% (17.1811 => 17.6744, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.72% (1.1194 => 1.1498, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.8922 => 3.9940, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (3.1578 => 3.3798, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.41% (3.6395 => 3.7635, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (4.2280 => 4.3340, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 1.68% (3.7781 => 3.8417, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2567, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8073, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5837, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2683, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.65% (5.3855 => 3.6274, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.30% (5.3526 => 3.6235, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1100, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/mason/mason: -13.69% (0.0811 => 0.0700) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.49% (2.9384 => 2.6009, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.00% (22.1758 => 19.9580, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.30% (0.2161 => 0.1960, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2882, std.dev.: 0.0843) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5711, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5971, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.99% (0.9957 => 0.9560, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5053, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: -2.76% (1.2373 => 1.2032, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1731, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5004, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9965, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0966, std.dev.: 0.0146) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5086, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2304, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.71% (0.5229 => 0.5789, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 7.52% (14.9895 => 16.1165, std.dev.: 0.0188) MultiSource/Benchmarks/MallocBench/gs/gs: 5.57% (4.1105 => 4.3394, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.17% (1.1048 => 1.2392, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.87% (7.1582 => 7.5068, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.71% (0.6222 => 0.7262, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (0.2116 => 0.2070, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 23:35:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 01:35:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120926063529.963222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4252?compare_to=4246&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4252, Order: 164656, Start Time: 2012-09-26 03:53:05, End Time: 2012-09-26 06:37:02 To: 4246, Order: 164651, Start Time: 2012-09-26 00:39:52, End Time: 2012-09-26 03:24:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (134 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 965 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.98% (1.7391 => 1.7736, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.53% (1.0554 => 1.0716, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.26% (1.0139 => 1.0267, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.41% (54.0315 => 54.7937, std.dev.: 0.0430) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.36% (1.5949 => 1.6166, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-4: 12.47% (0.3465 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3488 => 0.3920, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3460 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.33% (0.3496 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.31% (0.3469 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.95% (0.1063 => 0.1190, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 11.32% (1.5932 => 1.7736, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 9.84% (0.5826 => 0.6399, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.75% (0.5889 => 0.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.91% (0.2738 => 0.2982, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.59% (0.2875 => 0.3122, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.58% (0.7171 => 0.7786, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.56% (0.3004 => 0.3261, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1218 => 0.1321, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 8.38% (0.2803 => 0.3038, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (0.2725 => 0.2951, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2714 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.26% (0.3195 => 0.3459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.22% (0.2750 => 0.2976, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2823 => 0.3054, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.18% (0.3362 => 0.3637, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.17% (0.2729 => 0.2952, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.14% (0.9909 => 1.0716, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.13% (0.2792 => 0.3019, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.07% (0.2911 => 0.3146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.07% (0.2813 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.06% (0.2780 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.02% (2.0673 => 2.2331, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.95% (1.3152 => 1.4198, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wc: 7.95% (0.3096 => 0.3342, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.93% (0.2811 => 0.3034, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3060 => 0.3301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.87% (0.3267 => 0.3524, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.75% (2.7292 => 2.9406, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: 7.72% (0.3317 => 0.3573, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.72% (1.6211 => 1.7462, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 7.70% (0.3258 => 0.3509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3124 => 0.3364, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.57% (0.4146 => 0.4460, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.52% (0.4361 => 0.4689, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.51% (3.5627 => 3.8303, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 7.49% (1.0781 => 1.1589, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.48% (0.5000 => 0.5374, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 7.45% (0.3678 => 0.3952, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3282 => 0.3525, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.39% (0.3625 => 0.3893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3348 => 0.3594, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 7.33% (0.3477 => 0.3732, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.29% (0.4994 => 0.5358, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.25% (0.3726 => 0.3996, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.96% (0.4251 => 0.4547, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.94% (0.3690 => 0.3946, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.87% (5.5417 => 5.9224, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 6.83% (23.5202 => 25.1264, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.72% (0.2068 => 0.2207, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.3845 => 0.4100, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (0.3930 => 0.4190, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.56% (0.3981 => 0.4242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.53% (0.5900 => 0.6285, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 6.49% (4.2109 => 4.4843, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.32% (0.2736 => 0.2909, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (0.5026 => 0.5338, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (4.4195 => 4.6938, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 6.19% (0.5012 => 0.5322, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 6.18% (4.6177 => 4.9031, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.16% (0.4029 => 0.4277, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.13% (2.1013 => 2.2301, std.dev.: 0.0162) MultiSource/Benchmarks/nbench/nbench: 6.08% (0.2566 => 0.2722, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.08% (0.6435 => 0.6826, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.2866 => 0.3039, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (2.1653 => 2.2957, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.89% (0.6634 => 0.7025, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 5.88% (0.9697 => 1.0267, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 5.87% (1.8794 => 1.9898, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.85% (0.4139 => 0.4381, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.80% (1.4269 => 1.5097, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.73% (0.3890 => 0.4113, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.3903 => 0.4126, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.67% (0.3084 => 0.3259, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.2737 => 0.2890, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.47% (1.9694 => 2.0771, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 5.46% (0.5546 => 0.5849, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.2040 => 0.2150, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.36% (1.9966 => 2.1036, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.28% (0.4658 => 0.4904, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 5.28% (0.3336 => 0.3512, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.3271 => 0.3443, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 5.14% (0.7875 => 0.8280, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.2103 => 0.2208, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.2969 => 0.3114, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 4.60% (2.0346 => 2.1281, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 4.43% (0.2391 => 0.2497, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.42% (0.2691 => 0.2810, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 4.23% (0.4847 => 0.5052, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (0.7426 => 0.7720, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.88% (0.5361 => 0.5569, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.79% (0.4253 => 0.4414, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.66% (0.3498 => 0.3626, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.38% (0.5584 => 0.5773, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.31% (11.6398 => 12.0245, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.6926 => 4.8444, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.06% (0.3792 => 0.3908, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.43% (11.9555 => 12.2464, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6749, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 5.15% (1.8057 => 1.8987, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6261, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1983, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5070, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4425, std.dev.: 0.0258) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2845, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5847, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5719, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7887, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8047, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8433, std.dev.: 0.0702) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Sep 25 23:38:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 01:38:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926063854.9DCF82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4253?compare_to=4250&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4253, Order: 164658, Start Time: 2012-09-26 05:23:54, End Time: 2012-09-26 06:40:28 To: 4250, Order: 164656, Start Time: 2012-09-26 03:52:33, End Time: 2012-09-26 05:07:53 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 9 (61 on baseline) Performance Improvements: 0 (45 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 888 (781 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.83% (0.2238 => 0.2346, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.48% (0.4349 => 0.4544, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 1.67% (1.3509 => 1.3734, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.96% (12.8016 => 14.4609, std.dev.: 0.3115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.33% (0.3225 => 0.3526, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.00% (4.1474 => 4.2719, std.dev.: 0.0373) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (2.4407 => 2.4802, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (3.2254 => 3.2695, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/hash: 1.28% (4.3171 => 4.3725, std.dev.: 0.0152) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.33% (1.0059 => 1.0193, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: -0.90% (0.5901 => 0.5848, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: -2.02% (0.1636 => 0.1603, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.72% (0.1343 => 0.1293, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.85% (0.3023 => 0.2967, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.83% (0.2245 => 0.2159, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.82% (0.3053 => 0.3028, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.84% (0.2138 => 0.2120, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -9.73% (0.0257 => 0.0232, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: 3.49% (0.0086 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.29% (0.0089 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.30% (0.0077 => 0.0076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.18% (0.0170 => 0.0134, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.02% (0.0392 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.07% (0.0303 => 0.0224, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.05% (0.0287 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.00% (0.0330 => 0.0297, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 34.81% (0.0135 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.58% (0.0139 => 0.0169, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -26.58% (0.0237 => 0.0174, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: -37.60% (0.0125 => 0.0078, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.60% (0.1382 => 0.1418, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 0.26% (0.2294 => 0.2300, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -5.07% (1.4820 => 1.4068, std.dev.: 0.0488) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1459 => 0.1456, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.71% (0.5922 => 0.5880, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.29% (26.7004 => 26.7788, std.dev.: 0.1269) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.17% (0.4062 => 0.4055, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.66% (0.1383 => 0.1406, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.26% (0.0551 => 0.0591, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.38% (0.0195 => 0.0165, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.06% (0.0613 => 0.0582, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.07% (1.1356 => 1.1235, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0016 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.36% (0.0561 => 0.0563, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.42% (0.0137 => 0.0191, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7654 => 0.7678, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.04% (1.7059 => 1.7053, std.dev.: 0.0154) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2300, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -91.57% (6.9722 => 0.5880, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 21548.18% (0.1237 => 26.7788, std.dev.: 0.1269) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.57% (4.1772 => 3.1091, std.dev.: 0.0628) SingleSource/Benchmarks/Shootout-C++/except: 82283.33% (0.0006 => 0.4943, std.dev.: 0.0023) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.33% (0.0745 => 0.0889, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.19% (0.1414 => 0.1544, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.17% (0.6410 => 0.6998, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.71% (0.1159 => 0.1260, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 8.31% (2.1763 => 2.3571, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 8.16% (0.5309 => 0.5742, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 7.54% (1.0046 => 1.0803, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 7.23% (1.1653 => 1.2495, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: 6.71% (0.6173 => 0.6587, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 6.15% (15.3105 => 16.2525, std.dev.: 0.2320) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.92% (0.3582 => 0.3794, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.5150 => 1.6046, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.68% (0.2552 => 0.2697, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 5.61% (0.6915 => 0.7303, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.22% (0.7639 => 0.8038, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.15% (0.3901 => 0.4102, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.83% (0.6069 => 0.6362, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4248 => 0.4439, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.28% (3.0225 => 3.1518, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.4408 => 1.4948, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.72% (2.0317 => 2.1073, std.dev.: 0.0198) MultiSource/Applications/oggenc/oggenc: 3.70% (4.7455 => 4.9213, std.dev.: 0.0630) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.66% (0.3062 => 0.3174, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 3.51% (13.3238 => 13.7921, std.dev.: 0.1294) MultiSource/Applications/hbd/hbd: 3.51% (1.3268 => 1.3734, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 3.36% (29.3170 => 30.3021, std.dev.: 0.0550) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (6.2546 => 6.4599, std.dev.: 0.0766) MultiSource/Applications/Burg/burg: 3.28% (1.1440 => 1.1815, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.2186 => 8.4844, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.3847 => 0.3957, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (0.4880 => 0.5017, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.1827 => 1.2159, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.7256 => 15.1108, std.dev.: 0.0992) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5520 => 0.5627, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 1.34% (0.9425 => 0.9551, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 51.34% (0.0261 => 0.0395, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.24% (3.0256 => 3.5171, std.dev.: 0.1058) SingleSource/Benchmarks/Shootout/ary3: 16.08% (1.7426 => 2.0228, std.dev.: 0.0147) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.59% (0.0917 => 0.1060, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5461, std.dev.: 0.0678) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6066, std.dev.: 0.0540) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (0.3301 => 0.3526, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8475, std.dev.: 0.0517) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.16% (2.4042 => 2.4802, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.14% (3.5520 => 3.6634, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5113 => 8.7607, std.dev.: 0.0554) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8949, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8088, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.31% (4.6127 => 4.7193, std.dev.: 0.0337) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4468, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.75% (0.5876 => 0.5979, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: 1.65% (4.3016 => 4.3725, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4396, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.02% (27.1724 => 27.4498, std.dev.: 0.0357) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.79% (0.2996 => 0.1654, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.75% (1.4189 => 1.1387, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.40% (1.4113 => 1.1375, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -19.38% (1.7473 => 1.4086, std.dev.: 0.0449) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.89% (5.2665 => 4.2719, std.dev.: 0.0373) MultiSource/Benchmarks/FreeBench/mason/mason: -16.01% (0.5004 => 0.4203, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.29% (1.7361 => 1.4707, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0263) MultiSource/Applications/sgefa/sgefa: -11.32% (0.3746 => 0.3322, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.71% (1.1647 => 1.0516, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.66% (15.8312 => 14.4609, std.dev.: 0.3115) SingleSource/Benchmarks/Misc/flops: -8.47% (9.5474 => 8.7388, std.dev.: 0.0401) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -7.10% (7.6833 => 7.1380, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3751, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.88% (3.2007 => 2.9804, std.dev.: 0.0217) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.71% (2.0027 => 1.8683, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3307, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -5.37% (1.4441 => 1.3666, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1883, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -4.48% (3.4230 => 3.2695, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (62.4126 => 59.7731, std.dev.: 0.0511) MultiSource/Benchmarks/Olden/bh/bh: -4.13% (2.5166 => 2.4126, std.dev.: 0.0163) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.06% (1.2959 => 1.2433, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (9.2503 => 8.9169, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.95% (3.9413 => 3.8251, std.dev.: 0.0272) SingleSource/Benchmarks/McGill/misr: -2.84% (0.4296 => 0.4174, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.26% (3.7496 => 3.6648, std.dev.: 0.0145) MultiSource/Benchmarks/PAQ8p/paq8p: -2.19% (92.7467 => 90.7177, std.dev.: 0.5798) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.15% (1.1683 => 1.1432, std.dev.: 0.0019) MultiSource/Applications/aha/aha: -1.97% (3.4286 => 3.3611, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.92% (2.3569 => 2.3116, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -1.86% (1.0926 => 1.0723, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4876 => 3.4245, std.dev.: 0.0195) MultiSource/Benchmarks/sim/sim: -1.77% (3.8907 => 3.8219, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2242, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3135, std.dev.: 0.0498) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4645, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.13% (0.9980 => 1.0193, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: -2.89% (0.6022 => 0.5848, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: -3.78% (0.1666 => 0.1603, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.80% (0.1554 => 0.1293, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (0.3083 => 0.2967, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.82% (0.2394 => 0.2159, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.63% (0.3175 => 0.3028, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.91% (0.2302 => 0.2120, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -48.33% (0.0449 => 0.0232, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.21% (0.0192 => 0.0134, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.58% (0.0301 => 0.0224, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.33% (0.0324 => 0.0297, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -10.58% (0.0189 => 0.0169, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -30.12% (0.0249 => 0.0174, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: -76.00% (0.0325 => 0.0078, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.77% (0.1429 => 0.1418, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -6.33% (1.5019 => 1.4068, std.dev.: 0.0488) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.00% (0.1501 => 0.1456, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.90% (0.4264 => 0.4055, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.61% (0.1344 => 0.1406, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.34% (0.0589 => 0.0591, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.88% (0.0232 => 0.0165, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.01% (1.1350 => 1.1235, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.62% (0.0637 => 0.0563, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.36% (0.0246 => 0.0191, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.82% (0.7541 => 0.7678, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.00% (1.5363 => 1.7053, std.dev.: 0.0154) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 00:31:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 02:31:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926073140.54ADC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4254?compare_to=4248&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4254, Order: 164659, Start Time: 2012-09-26 06:15:54, End Time: 2012-09-26 07:33:12 To: 4248, Order: 164654, Start Time: 2012-09-26 02:34:00, End Time: 2012-09-26 03:48:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.78% (2.0176 => 2.4369, std.dev.: 0.0502) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1410 => 0.1636, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 13.20% (0.2243 => 0.2539, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 12.56% (0.5818 => 0.6549, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 12.35% (0.5748 => 0.6458, std.dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference: 12.31% (0.7061 => 0.7930, std.dev.: 0.0130) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 10.95% (0.4328 => 0.4802, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.77% (1.3693 => 1.5168, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.54% (0.4062 => 0.4490, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.42% (3.9660 => 4.3792, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.40% (1.4563 => 1.6077, std.dev.: 0.0341) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.33% (0.3485 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.26% (1.9828 => 2.1863, std.dev.: 0.0648) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.19% (0.3022 => 0.3330, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.13% (0.3899 => 0.4294, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 10.05% (0.2628 => 0.2892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.04% (0.2937 => 0.3232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.3107 => 0.3419, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.02% (0.2596 => 0.2856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.99% (0.4016 => 0.4417, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.98% (0.9199 => 1.0117, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.87% (1.2193 => 1.3396, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.85% (0.3756 => 0.4126, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.83% (0.3489 => 0.3832, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.81% (0.2721 => 0.2988, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3580 => 0.3929, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.62% (0.7038 => 0.7715, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.5265 => 0.5771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.51% (0.6959 => 0.7621, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.39% (0.3130 => 0.3424, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 9.27% (0.3192 => 0.3488, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.24% (13.8202 => 15.0968, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.20% (0.6283 => 0.6861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.19% (1.1364 => 1.2408, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.86% (0.4390 => 0.4779, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.43% (0.5577 => 0.6047, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.40% (1.0313 => 1.1179, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.27% (0.2127 => 0.2303, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.25% (0.2995 => 0.3242, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 8.16% (16.6129 => 17.9681, std.dev.: 0.0188) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.15% (0.1435 => 0.1552, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.12% (7.2180 => 7.8039, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3755 => 0.4058, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 8.00% (1.1061 => 1.1946, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.4791 => 0.5174, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.96% (0.8698 => 0.9390, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 7.77% (0.8310 => 0.8956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.77% (0.5637 => 0.6075, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.62% (0.7506 => 0.8078, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 7.61% (0.3220 => 0.3465, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.60% (0.6576 => 0.7076, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.57% (0.7460 => 0.8025, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 7.47% (0.6744 => 0.7248, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 7.41% (3.1889 => 3.4253, std.dev.: 0.0090) MultiSource/Applications/treecc/treecc: 7.41% (1.9270 => 2.0697, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 7.35% (1.0594 => 1.1373, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 7.35% (2.1791 => 2.3392, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 7.33% (0.3601 => 0.3865, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.32% (0.3650 => 0.3917, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 7.27% (0.4003 => 0.4294, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 7.21% (3.8646 => 4.1431, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.92% (1.3245 => 1.4161, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.87% (3.6692 => 3.9214, std.dev.: 0.0884) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.79% (14.8535 => 15.8620, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 6.72% (1.2292 => 1.3118, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.69% (0.1569 => 0.1674, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.66% (1.2749 => 1.3598, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.60% (4.4433 => 4.7364, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 6.54% (8.4961 => 9.0521, std.dev.: 0.1984) MultiSource/Benchmarks/McCat/05-eks/eks: 6.39% (0.4113 => 0.4376, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.36% (0.6135 => 0.6525, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.22% (1.1333 => 1.2038, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 6.19% (4.6629 => 4.9516, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.08% (0.8818 => 0.9354, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/bigfib: 5.98% (0.6250 => 0.6624, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2504 => 0.2653, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.82% (4.9865 => 5.2769, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.66% (3.2742 => 3.4596, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.47% (0.4805 => 0.5068, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.20% (6.5754 => 6.9172, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.3245 => 0.3412, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.10% (1.5188 => 1.5962, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.94% (0.9108 => 0.9558, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.75% (3.7467 => 3.9247, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.62% (2.1007 => 2.1977, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (6.2785 => 6.5653, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.26% (16.2614 => 16.7923, std.dev.: 0.0262) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.5298 => 14.8915, std.dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.95% (0.4846 => 0.6976, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.06% (1.2998 => 1.3786, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7059, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0770, std.dev.: 0.0418) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5947, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0335) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5846, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5984, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1423, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.60% (1.3813 => 1.1796, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.57% (1.3819 => 1.1805, std.dev.: 0.0386) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.13% (0.2238 => 0.1989, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2919, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5155, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8006, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9533, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -1.66% (26.5159 => 26.0760, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2515, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7916, std.dev.: 0.1388) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2115, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -1.19% (1.2308 => 1.2161, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8722, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4354, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 00:33:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 02:33:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926073359.6F4182A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4255?compare_to=4251&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4255, Order: 164659, Start Time: 2012-09-26 06:14:02, End Time: 2012-09-26 07:35:32 To: 4251, Order: 164656, Start Time: 2012-09-26 04:25:20, End Time: 2012-09-26 05:44:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (138 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 951 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.78% (0.9560 => 0.9730, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.51% (11.7126 => 11.5363, std.dev.: 0.0404) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5789 => 0.5787, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 0.22% (16.1165 => 16.1519, std.dev.: 0.0163) MultiSource/Benchmarks/Bullet/bullet: -0.29% (54.3858 => 54.2307, std.dev.: 0.8600) MultiSource/Benchmarks/MallocBench/gs/gs: 0.25% (4.3394 => 4.3502, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2392 => 1.2406, std.dev.: 0.0284) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (7.5068 => 7.5262, std.dev.: 0.1960) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.07% (0.7262 => 0.7267, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0357 => 0.0358, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (0.2070 => 0.2121, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.25% (63.2438 => 54.2307, std.dev.: 0.8600) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.22% (14.1553 => 18.5740, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.60% (3.4629 => 5.4920, std.dev.: 0.0044) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14244.17% (0.0720 => 10.3278, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943100.00% (0.0001 => 9.9432, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 51.30% (10.3673 => 15.6855, std.dev.: 0.1337) MultiSource/Benchmarks/McCat/08-main/main: 48.32% (0.2554 => 0.3788, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 30.58% (0.1622 => 0.2118, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 30.40% (0.1056 => 0.1377, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.42% (2.2022 => 2.5418, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.97% (7.0540 => 8.1098, std.dev.: 0.1185) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.73% (0.1566 => 0.1781, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.94% (1.7609 => 1.9887, std.dev.: 0.0181) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.54% (10.4361 => 11.5363, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.63% (0.3177 => 0.3483, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1655 => 0.1803, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.82% (9.4845 => 10.3210, std.dev.: 0.0718) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5925 => 0.6446, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.55% (0.4879 => 0.5296, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.47% (1.5415 => 1.6720, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.24% (1.3050 => 1.4125, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 8.13% (5.7591 => 6.2271, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.07% (0.6675 => 0.7214, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.07% (0.3109 => 0.3360, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 8.04% (0.7115 => 0.7687, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.99% (0.7433 => 0.8027, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3423 => 0.3693, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7326 => 0.7893, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2271 => 0.2446, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.66% (4.2646 => 4.5914, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.61% (0.5860 => 0.6306, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 7.59% (3.3354 => 3.5886, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (8.1363 => 8.7452, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5569 => 0.5984, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.33% (0.9765 => 1.0481, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 7.30% (0.7835 => 0.8407, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.27% (7.9617 => 8.5407, std.dev.: 0.1413) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.17% (5.0018 => 5.3604, std.dev.: 0.1331) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 7.09% (0.3387 => 0.3627, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.08% (4.9449 => 5.2949, std.dev.: 0.1123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.07% (0.2758 => 0.2953, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.89% (0.8067 => 0.8623, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.88% (0.2107 => 0.2252, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.80% (0.1940 => 0.2072, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.76% (0.3121 => 0.3332, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.69% (0.5020 => 0.5356, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 6.67% (1.5603 => 1.6643, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: 6.58% (0.3422 => 0.3647, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 6.55% (1.1642 => 1.2405, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.53% (1.1861 => 1.2636, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.45% (0.3441 => 0.3663, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 6.43% (3.8723 => 4.1214, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.37% (0.4299 => 0.4573, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 6.37% (0.6456 => 0.6867, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4636 => 0.4931, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 6.32% (1.0722 => 1.1400, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.26% (0.2603 => 0.2766, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.23% (0.6450 => 0.6852, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.19% (2.0273 => 2.1527, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4289 => 0.4554, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.16% (0.2891 => 0.3069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.09% (0.4203 => 0.4459, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 6.08% (21.9371 => 23.2699, std.dev.: 0.0279) SingleSource/Regression/C++/ofstream_ctor: 6.02% (0.2905 => 0.3080, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.98% (0.3865 => 0.4096, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.91% (0.3180 => 0.3368, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.90% (0.8921 => 0.9447, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 5.83% (0.3603 => 0.3813, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2831 => 0.2996, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.82% (0.5981 => 0.6329, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 5.81% (0.4048 => 0.4283, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2872 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4620 => 0.4883, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.64% (0.2871 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.61% (2.2969 => 2.4257, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.3232 => 0.3413, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 5.60% (0.2877 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.54% (0.3684 => 0.3888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.44% (0.2793 => 0.2945, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2802 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.30% (1.5859 => 1.6700, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.93% (1.4186 => 1.4885, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.77% (2.2024 => 2.3074, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.09% (1.2842 => 1.3367, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.3131 => 0.3249, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.75% (0.3817 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.69% (0.8101 => 0.8400, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.65% (0.3427 => 0.3552, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.01% (17.1811 => 17.6985, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.8922 => 3.9842, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.37% (1.1145 => 1.3861, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3821, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7660, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (4.2280 => 4.3396, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.55% (9.1159 => 9.2574, std.dev.: 0.0200) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8074, std.dev.: 0.0187) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std.dev.: 0.0177) MultiSource/Benchmarks/llubenchmark/llu: 1.05% (3.7781 => 3.8178, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1294, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.92% (5.2763 => 3.2754, std.dev.: 0.0667) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.55% (5.3855 => 3.6323, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.13% (5.3526 => 3.6329, std.dev.: 0.0482) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1284, std.dev.: 0.0287) MultiSource/Benchmarks/FreeBench/mason/mason: -13.69% (0.0811 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.19% (2.9384 => 2.6096, std.dev.: 0.0753) MultiSource/Applications/ClamAV/clamscan: -9.92% (22.1758 => 19.9750, std.dev.: 0.0559) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.33% (0.0998 => 0.0865, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.56% (1.5373 => 1.3749, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: -9.07% (0.2161 => 0.1965, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2611, std.dev.: 0.1972) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7110, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0159) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5972, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1649) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4967, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -2.39% (12.4730 => 12.1752, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.38% (1.2373 => 1.2079, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.28% (0.9957 => 0.9730, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std.dev.: 0.0112) SingleSource/UnitTests/Vector/multiplies: -1.85% (2.5528 => 2.5056, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (8.1563 => 8.0173, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6833, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0471) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2294, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.67% (0.5229 => 0.5787, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 7.75% (14.9895 => 16.1519, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/gs/gs: 5.83% (4.1105 => 4.3502, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.29% (1.1048 => 1.2406, std.dev.: 0.0284) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.14% (7.1582 => 7.5262, std.dev.: 0.1960) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.80% (0.6222 => 0.7267, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.24% (0.2116 => 0.2121, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 01:11:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 03:11:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926081124.2EB042A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4256?compare_to=4253&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4256, Order: 164664, Start Time: 2012-09-26 06:57:40, End Time: 2012-09-26 08:12:57 To: 4253, Order: 164658, Start Time: 2012-09-26 05:23:54, End Time: 2012-09-26 06:40:28 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (64 on baseline) Performance Improvements: 3 (49 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 889 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 2.62% (0.7666 => 0.7867, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.6057 => 6.7370, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.95% (0.7561 => 0.7935, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (2.6356 => 2.7449, std.dev.: 0.0176) MultiSource/Applications/lua/lua: 1.75% (29.0539 => 29.5615, std.dev.: 0.0862) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.94% (0.4544 => 0.4365, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.88% (0.7472 => 0.7257, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.44% (1.4054 => 1.3852, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.26% (1.0193 => 1.0065, std.dev.: 0.0224) MultiSource/Applications/sqlite3/sqlite3: 1.21% (0.5848 => 0.5919, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 1.62% (0.1603 => 0.1629, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.85% (0.1293 => 0.1304, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.89% (0.2967 => 0.2911, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (0.2159 => 0.2188, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.28% (0.3028 => 0.2959, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (0.2120 => 0.2086, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 6.90% (0.0232 => 0.0248, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -6.74% (0.0089 => 0.0083, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 193.33% (0.0030 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.95% (0.0076 => 0.0073, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.40% (0.0134 => 0.0160, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0388 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.91% (0.0224 => 0.0235, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.11% (0.0297 => 0.0264, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -3.30% (0.0182 => 0.0176, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 13.02% (0.0169 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 45.98% (0.0174 => 0.0254, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -5.13% (0.0078 => 0.0074, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.76% (0.1418 => 0.1443, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -0.48% (0.2300 => 0.2289, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.58% (1.4068 => 1.4290, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.89% (0.1456 => 0.1469, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 0.51% (0.5880 => 0.5910, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -1.45% (26.7788 => 26.3908, std.dev.: 0.2827) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4055 => 0.4052, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.63% (0.1406 => 0.1369, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.46% (0.0591 => 0.0541, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.97% (0.0165 => 0.0193, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.57% (0.0582 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.1235 => 1.1290, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.12% (0.0563 => 0.0620, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.32% (0.0191 => 0.0156, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7678 => 0.7648, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.05% (1.7053 => 1.7061, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.26% (0.0121 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2289, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -91.52% (6.9722 => 0.5910, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 21234.52% (0.1237 => 26.3908, std.dev.: 0.2827) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.10% (4.1772 => 3.0871, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.33% (0.6410 => 0.7008, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 9.15% (2.1763 => 2.3755, std.dev.: 0.0232) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.49% (0.3582 => 0.3886, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 7.84% (1.0046 => 1.0834, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/bigfib: 7.42% (0.5309 => 0.5703, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: 7.26% (0.6173 => 0.6621, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 7.20% (1.1653 => 1.2492, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 7.06% (15.3105 => 16.3907, std.dev.: 0.1601) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.6915 => 0.7374, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.10% (0.7639 => 0.8105, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.69% (1.5150 => 1.6012, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.61% (0.3901 => 0.4120, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.39% (3.0758 => 3.2416, std.dev.: 0.0363) MultiSource/Applications/d/make_dparser: 4.69% (3.0225 => 3.1644, std.dev.: 0.0251) MultiSource/Benchmarks/McCat/18-imp/imp: 4.26% (0.3217 => 0.3354, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 3.99% (13.3238 => 13.8551, std.dev.: 0.1773) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2654 => 0.2757, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 3.84% (2.0972 => 2.1777, std.dev.: 0.0215) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (8.2186 => 8.5340, std.dev.: 0.0583) MultiSource/Applications/JM/lencod/lencod: 3.80% (14.7256 => 15.2850, std.dev.: 0.0877) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (6.4908 => 6.7370, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 3.79% (4.7455 => 4.9253, std.dev.: 0.0631) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.73% (1.2021 => 1.2469, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 3.52% (29.3170 => 30.3477, std.dev.: 0.1092) MultiSource/Applications/hbd/hbd: 3.41% (1.3268 => 1.3720, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.1827 => 1.2212, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (12.6413 => 13.0502, std.dev.: 0.0844) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1672 => 1.2028, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.03% (0.8569 => 0.8829, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8405 => 0.8653, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 2.92% (3.5980 => 3.7030, std.dev.: 0.0203) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (6.2546 => 6.4222, std.dev.: 0.0293) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.0821 => 1.1103, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 1.67% (0.7738 => 0.7867, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.49% (0.9425 => 0.9565, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (4.0318 => 4.0801, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/ary3: 14.79% (1.7426 => 2.0004, std.dev.: 0.0741) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.85% (4.0101 => 4.5656, std.dev.: 0.0225) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.42% (0.2857 => 0.3126, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.70% (1.0063 => 1.0938, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6097, std.dev.: 0.0429) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.51% (0.3301 => 0.3549, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (2.5984 => 2.7449, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.16% (40.4792 => 42.5682, std.dev.: 0.3585) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.28% (0.7609 => 0.7935, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8470, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.42% (0.5876 => 0.6077, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 3.09% (8.5113 => 8.7744, std.dev.: 0.0643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.04% (0.5587 => 0.5757, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8964, std.dev.: 0.0160) MultiSource/Applications/siod/siod: 2.69% (3.5520 => 3.6476, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (6.6312 => 6.8055, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 2.25% (2.4013 => 2.4553, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (2.4455 => 2.4881, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.83% (0.2996 => 0.1683, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: -35.24% (0.0403 => 0.0261, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.15% (1.4189 => 1.1330, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.83% (1.4113 => 1.1314, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.03% (0.4596 => 0.4365, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.72% (0.3497 => 0.2038, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -20.01% (1.7473 => 1.3976, std.dev.: 0.0427) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.00% (5.2665 => 4.2132, std.dev.: 0.0756) MultiSource/Benchmarks/FreeBench/mason/mason: -16.81% (0.5004 => 0.4163, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.15% (1.7361 => 1.4731, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std.dev.: 0.0342) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.32% (1.1647 => 1.0445, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.83% (1.4034 => 1.2795, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.49% (15.8312 => 14.4877, std.dev.: 0.1663) SingleSource/Benchmarks/Misc/flops: -8.46% (9.5474 => 8.7395, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (3.2007 => 2.9479, std.dev.: 0.0292) MultiSource/Applications/lambda-0_1_3/lambda: -7.00% (7.6833 => 7.1456, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.75% (3.6254 => 3.3807, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/fibo: -6.46% (4.6355 => 4.3361, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.44% (2.0027 => 1.8737, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -6.08% (0.2664 => 0.2502, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -6.01% (1.4441 => 1.3573, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (3.4230 => 3.2449, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout/fib2: -5.14% (4.4195 => 4.1924, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8253, std.dev.: 0.1918) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.65% (0.4140 => 0.3989, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -3.47% (2.5166 => 2.4292, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.31% (1.4021 => 1.3557, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/misr: -3.28% (0.4296 => 0.4155, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -3.02% (9.2503 => 8.9709, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.98% (3.9413 => 3.8239, std.dev.: 0.0294) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.97% (1.2722 => 1.2344, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.83% (3.7496 => 3.6434, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/neural/neural: -2.46% (1.0926 => 1.0657, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (92.7467 => 90.5693, std.dev.: 0.6897) MultiSource/Benchmarks/sim/sim: -2.08% (3.8907 => 3.8096, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.99% (1.1683 => 1.1450, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4224, std.dev.: 0.0120) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3653, std.dev.: 0.0232) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3141, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2320, std.dev.: 0.0345) MultiSource/Benchmarks/llubenchmark/llu: -1.40% (2.0192 => 1.9910, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3127, std.dev.: 0.0640) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.05% (1.8739 => 1.8542, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.85% (0.9980 => 1.0065, std.dev.: 0.0224) MultiSource/Applications/sqlite3/sqlite3: -1.71% (0.6022 => 0.5919, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: -2.22% (0.1666 => 0.1629, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.09% (0.1554 => 0.1304, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.58% (0.3083 => 0.2911, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.60% (0.2394 => 0.2188, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.80% (0.3175 => 0.2959, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.38% (0.2302 => 0.2086, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -44.77% (0.0449 => 0.0248, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -6.74% (0.0089 => 0.0083, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.58% (0.0240 => 0.0073, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.67% (0.0192 => 0.0160, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.93% (0.0301 => 0.0235, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.52% (0.0324 => 0.0264, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -77.23% (0.0325 => 0.0074, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1429 => 0.1443, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.85% (1.5019 => 1.4290, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.13% (0.1501 => 0.1469, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.97% (0.4264 => 0.4052, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.86% (0.1344 => 0.1369, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.15% (0.0589 => 0.0541, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.81% (0.0232 => 0.0193, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0639 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1350 => 1.1290, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.67% (0.0637 => 0.0620, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.59% (0.0246 => 0.0156, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 58.57% (0.0070 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 02:15:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 04:15:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926091533.4DABD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/4257?compare_to=4254&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4257, Order: 164668, Start Time: 2012-09-26 08:02:32, End Time: 2012-09-26 09:17:04 To: 4254, Order: 164659, Start Time: 2012-09-26 06:15:54, End Time: 2012-09-26 07:33:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.32% (2.0176 => 2.4276, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.34% (0.5818 => 0.6536, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 12.23% (0.5748 => 0.6451, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936) SingleSource/UnitTests/ObjC++/property-reference: 11.46% (0.7061 => 0.7870, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4328 => 0.4800, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 10.89% (1.3693 => 1.5184, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.79% (3.9660 => 4.3940, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.66% (1.4563 => 1.6116, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.48% (0.2596 => 0.2868, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.44% (0.7710 => 0.8515, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.32% (0.9199 => 1.0148, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 10.29% (0.4062 => 0.4480, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.14% (1.2193 => 1.3429, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.10% (0.3485 => 0.3837, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.02% (0.1327 => 0.1460, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.00% (0.7038 => 0.7742, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/random: 9.96% (0.2690 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.93% (0.2628 => 0.2889, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.93% (0.3899 => 0.4286, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.88% (0.5265 => 0.5785, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.85% (1.9828 => 2.1782, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.83% (0.6959 => 0.7643, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.74% (0.3489 => 0.3829, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.69% (0.3293 => 0.3612, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.69% (0.4016 => 0.4405, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.64% (0.3756 => 0.4118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.62% (0.3868 => 0.4240, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.58% (0.3580 => 0.3923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 9.52% (13.8202 => 15.1352, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/ary3: 9.50% (0.3149 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.43% (1.1364 => 1.2436, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.28% (0.6283 => 0.6866, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.18% (0.3453 => 0.3770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3192 => 0.3483, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.03% (0.3534 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.93% (0.5577 => 0.6075, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.88% (0.4390 => 0.4780, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: 8.87% (0.4003 => 0.4358, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.80% (0.3623 => 0.3942, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.76% (0.3789 => 0.4121, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.70% (0.4379 => 0.4760, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.59% (1.0313 => 1.1199, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.43% (0.1435 => 0.1556, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.39% (1.1061 => 1.1989, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.39% (0.2945 => 0.3192, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.38% (0.2995 => 0.3246, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.37% (7.2180 => 7.8220, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.25% (0.5637 => 0.6102, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 8.23% (16.6129 => 17.9803, std.dev.: 0.0200) MultiSource/Applications/spiff/spiff: 8.17% (0.7506 => 0.8119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.4791 => 0.5174, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.98% (0.8310 => 0.8973, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3220 => 0.3476, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.94% (0.8698 => 0.9389, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.82% (0.7460 => 0.8043, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.76% (0.2925 => 0.3152, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.75% (0.3755 => 0.4046, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 7.69% (3.1889 => 3.4340, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.60% (3.8646 => 4.1582, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 7.53% (0.6744 => 0.7252, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 7.53% (1.0594 => 1.1392, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.42% (2.1791 => 2.3407, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 7.36% (1.9270 => 2.0688, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.23% (1.3245 => 1.4202, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 7.03% (0.3131 => 0.3351, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.00% (3.6692 => 3.9261, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.92% (4.3801 => 4.6831, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.88% (0.4113 => 0.4396, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.84% (14.8535 => 15.8702, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (1.2749 => 1.3621, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 6.75% (8.4961 => 9.0697, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.73% (0.6135 => 0.6548, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.68% (4.4433 => 4.7400, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 6.62% (1.2292 => 1.3106, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.59% (0.8818 => 0.9399, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2060, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.40% (4.6629 => 4.9611, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.6250 => 0.6627, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.4805 => 0.5086, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.74% (3.2742 => 3.4623, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.53% (4.9865 => 5.2622, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.41% (1.5188 => 1.6009, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.39% (6.5754 => 6.9301, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.30% (0.3245 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.11% (0.9108 => 0.9573, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.09% (3.7467 => 3.9375, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2321 => 0.2439, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (13.2842 => 13.9357, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.90% (2.1007 => 2.2037, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (6.2785 => 6.5843, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 3.30% (16.2614 => 16.7987, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (0.3511 => 0.3624, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.65% (14.5298 => 14.9149, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5196, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4165, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.36% (1.2998 => 1.3825, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.2093 => 0.2216, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7047, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1119, std.dev.: 0.0547) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5920, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5828, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5927, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.72% (0.2670 => 0.1396, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.57% (1.3813 => 1.1801, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.54% (0.4657 => 0.3980, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.31% (1.3819 => 1.1842, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.91% (22.5627 => 21.4548, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.17% (0.2238 => 0.1988, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2694, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.51% (1.3780 => 1.2883, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9996 => 0.9551, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.78% (26.5159 => 26.0436, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7922, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2314, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4312, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 02:22:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 04:22:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926092252.6A0462A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4258?compare_to=4255&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4258, Order: 164668, Start Time: 2012-09-26 08:05:06, End Time: 2012-09-26 09:24:25 To: 4255, Order: 164659, Start Time: 2012-09-26 06:14:02, End Time: 2012-09-26 07:35:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (152 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 952 (692 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.84% (0.9730 => 0.9551, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.16% (0.5787 => 0.5778, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: -0.33% (16.1519 => 16.0992, std.dev.: 0.0355) MultiSource/Benchmarks/Bullet/bullet: 0.37% (54.2307 => 54.4294, std.dev.: 0.0717) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.3502 => 4.3428, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.15% (1.2406 => 1.2388, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.5262 => 7.5308, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.33% (0.7267 => 0.7291, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0358 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.31% (0.2121 => 0.2072, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.94% (63.2438 => 54.4294, std.dev.: 0.0717) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.39% (14.1553 => 18.5983, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.37% (3.4629 => 5.4843, std.dev.: 0.0032) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14241.11% (0.0720 => 10.3256, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9944100.00% (0.0001 => 9.9442, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.08% (10.3673 => 15.5592, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 49.53% (0.2554 => 0.3819, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 31.01% (0.1622 => 0.2125, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.95% (2.2022 => 2.5535, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.28% (7.0540 => 8.1319, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.73% (0.1566 => 0.1781, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.39% (1.7609 => 1.9790, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 10.88% (10.4361 => 11.5717, std.dev.: 0.0198) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.82% (0.1655 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (9.4845 => 10.3123, std.dev.: 0.0247) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5925 => 0.6442, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.53% (0.3177 => 0.3448, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.45% (1.5415 => 1.6717, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.44% (0.4879 => 0.5291, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.99% (0.7433 => 0.8027, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 7.98% (0.3109 => 0.3357, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.85% (0.6675 => 0.7199, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 7.83% (0.7115 => 0.7672, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4615 => 0.4972, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.71% (0.3423 => 0.3687, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.69% (1.3050 => 1.4054, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7326 => 0.7888, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.65% (0.5860 => 0.6308, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 7.60% (5.7591 => 6.1967, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.57% (4.2646 => 4.5874, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.57% (0.1625 => 0.1748, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.52% (0.2700 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.47% (8.1363 => 8.7444, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.37% (0.9765 => 1.0485, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 7.32% (3.3354 => 3.5795, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5569 => 0.5975, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.28% (0.8067 => 0.8654, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.18% (0.3121 => 0.3345, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.15% (4.9449 => 5.2983, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 7.12% (1.5603 => 1.6714, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.07% (0.2107 => 0.2256, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.07% (0.2758 => 0.2953, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.04% (5.0018 => 5.3538, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.8172 => 0.8744, std.dev.: 0.0089) MultiSource/Applications/spiff/spiff: 6.94% (0.7835 => 0.8379, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.78% (0.5105 => 0.5451, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 6.73% (0.3387 => 0.3615, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1940 => 0.2070, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.69% (0.5020 => 0.5356, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.63% (0.3441 => 0.3669, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.61% (7.9617 => 8.4879, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.53% (0.4103 => 0.4371, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 6.50% (1.1642 => 1.2399, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 6.44% (21.9371 => 23.3494, std.dev.: 0.0509) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.41% (0.3650 => 0.3884, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3307 => 0.3519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.38% (0.6456 => 0.6868, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.37% (0.2905 => 0.3090, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.36% (1.1861 => 1.2615, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 6.31% (3.8723 => 4.1166, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.29% (0.3865 => 0.4108, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.28% (0.4203 => 0.4467, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.27% (0.4289 => 0.4558, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 6.27% (1.0722 => 1.1394, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.2831 => 0.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.25% (0.4048 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.22% (0.3826 => 0.4064, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2603 => 0.2764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.16% (0.4299 => 0.4564, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.10% (0.3162 => 0.3355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.05% (2.0273 => 2.1499, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4636 => 0.4916, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (2.0665 => 2.1913, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.02% (0.2756 => 0.2922, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.99% (0.2871 => 0.3043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3684 => 0.3903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.91% (0.3180 => 0.3368, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 5.91% (0.3232 => 0.3423, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.90% (0.8921 => 0.9447, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3603 => 0.3815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4620 => 0.4891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.77% (0.2877 => 0.3043, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.75% (0.6450 => 0.6821, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.62% (2.2969 => 2.4261, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.45% (0.5981 => 0.6307, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.28% (1.5859 => 1.6697, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.03% (0.2266 => 0.2380, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (1.4186 => 1.4877, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 4.85% (1.1840 => 1.2414, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.78% (2.2024 => 2.3076, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4064 => 0.4250, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.35% (1.2842 => 1.3401, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.62% (0.3427 => 0.3551, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.53% (0.8101 => 0.8387, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8350, std.dev.: 0.0208) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.87% (17.1811 => 17.6739, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.80% (1.1194 => 1.1507, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.14% (3.8922 => 3.9753, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2159, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7654, std.dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.61% (4.2280 => 4.3384, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.65% (9.1159 => 9.2662, std.dev.: 0.0382) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.42% (11.6436 => 11.8086, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.87% (5.2763 => 3.2784, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.45% (5.3855 => 3.6378, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.14% (5.3526 => 3.6323, std.dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0787, std.dev.: 0.0241) MultiSource/Benchmarks/FreeBench/mason/mason: -13.69% (0.0811 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.40% (2.9384 => 2.6034, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -9.99% (22.1758 => 19.9596, std.dev.: 0.0378) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.44% (1.5373 => 1.3768, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.07% (0.2161 => 0.1965, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3114, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7098, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.03% (1.6805 => 1.5960, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.08% (0.9957 => 0.9551, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.51% (3.2827 => 3.1675, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4971, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1714, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -2.39% (1.2373 => 1.2077, std.dev.: 0.0112) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5074, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0792, std.dev.: 0.0186) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0110, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2194, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.50% (0.5229 => 0.5778, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 7.40% (14.9895 => 16.0992, std.dev.: 0.0355) MultiSource/Benchmarks/MallocBench/gs/gs: 5.65% (4.1105 => 4.3428, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.13% (1.1048 => 1.2388, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (7.1582 => 7.5308, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.18% (0.6222 => 0.7291, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.08% (0.2116 => 0.2072, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 02:56:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 04:56:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120926095609.EAEE02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4259?compare_to=4252&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4259, Order: 164662, Start Time: 2012-09-26 07:10:11, End Time: 2012-09-26 09:56:43 To: 4252, Order: 164656, Start Time: 2012-09-26 03:53:05, End Time: 2012-09-26 06:37:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 1 (13 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.34% (124.3528 => 130.9877, std.dev.: 0.3608) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -2.00% (1.7736 => 1.7381, std.dev.: 0.0127) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.10% (0.3488 => 0.3910, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 11.40% (0.3446 => 0.3839, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3465 => 0.3860, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 11.33% (0.3442 => 0.3832, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 11.33% (0.3460 => 0.3852, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/for-in: 11.33% (0.3496 => 0.3892, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 11.24% (0.3469 => 0.3859, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions: 11.01% (0.3643 => 0.4044, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 10.93% (0.3724 => 0.4131, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 10.88% (0.0947 => 0.1050, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5826 => 0.6358, std.dev.: 0.0203) MultiSource/Applications/oggenc/oggenc: 9.09% (1.5932 => 1.7381, std.dev.: 0.0127) SingleSource/UnitTests/ObjC++/property-reference-object: 9.03% (0.5889 => 0.6421, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1620 => 0.1757, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7171 => 0.7771, std.dev.: 0.0165) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.09% (0.4361 => 0.4714, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.1421 => 0.1534, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.87% (0.9909 => 1.0689, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.77% (0.4994 => 0.5382, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.76% (0.3362 => 0.3623, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.65% (1.6211 => 1.7451, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2875 => 0.3094, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.57% (1.3152 => 1.4148, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.2738 => 0.2942, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (0.3195 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.36% (0.2813 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.33% (0.2823 => 0.3030, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (3.5627 => 3.8233, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3258 => 0.3493, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.20% (0.2750 => 0.2948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.18% (0.2729 => 0.2925, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2803 => 0.3003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.2792 => 0.2991, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.03% (0.3060 => 0.3275, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.99% (2.0673 => 2.2118, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 6.98% (0.2780 => 0.2974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2811 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.94% (0.3096 => 0.3311, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (2.7292 => 2.9170, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (0.5000 => 0.5344, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.82% (5.5417 => 5.9198, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3267 => 0.3488, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.65% (0.5026 => 0.5360, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3317 => 0.3536, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3124 => 0.3330, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.56% (1.0781 => 1.1488, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.3678 => 0.3919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.51% (0.3348 => 0.3566, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 6.46% (0.4146 => 0.4414, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 6.44% (0.3477 => 0.3701, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (0.3930 => 0.4182, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.40% (0.3282 => 0.3492, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.33% (0.3726 => 0.3962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3690 => 0.3923, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.2866 => 0.3044, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 6.17% (23.5202 => 24.9723, std.dev.: 0.0268) MultiSource/Applications/ClamAV/clamscan: 6.14% (4.2109 => 4.4696, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.10% (0.2736 => 0.2903, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.07% (0.3903 => 0.4140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (0.4251 => 0.4508, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.98% (1.8794 => 1.9918, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 5.94% (0.9697 => 1.0273, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 5.91% (0.4029 => 0.4267, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.83% (0.5900 => 0.6244, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.82% (0.4139 => 0.4380, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (2.1013 => 2.2230, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.77% (0.2566 => 0.2714, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 5.76% (4.6177 => 4.8835, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.3981 => 0.4210, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (4.4195 => 4.6727, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.1968 => 0.2080, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 5.59% (1.4269 => 1.5067, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 5.57% (0.5012 => 0.5291, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 5.50% (0.6634 => 0.6999, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (0.3890 => 0.4104, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.6435 => 0.6789, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.50% (2.1653 => 2.2843, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 5.34% (0.5546 => 0.5842, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 5.31% (0.3336 => 0.3513, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.22% (0.2068 => 0.2176, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.19% (0.2737 => 0.2879, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.16% (0.3084 => 0.3243, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.98% (0.3271 => 0.3434, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 4.98% (0.2691 => 0.2825, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (1.9694 => 2.0674, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.95% (0.2040 => 0.2141, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.94% (1.9966 => 2.0953, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.92% (0.4658 => 0.4887, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 4.71% (2.0346 => 2.1305, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.58% (0.7875 => 0.8236, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.2969 => 0.3105, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.02% (0.4847 => 0.5042, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.97% (0.4253 => 0.4422, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.61% (0.7426 => 0.7694, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.41% (0.5361 => 0.5544, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.23% (11.6398 => 12.0160, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 3.06% (0.3498 => 0.3605, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.6926 => 4.8356, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.01% (0.5584 => 0.5752, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.96% (11.9555 => 12.1901, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6702, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1733, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8885, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2075, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4519, std.dev.: 0.0198) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.26% (1.0927 => 1.1065, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0186) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5882, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4691, std.dev.: 0.0625) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5577, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7901, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.50% (0.2402 => 0.2270, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5691, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 03:59:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 05:59:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926105907.AC5DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4260?compare_to=4257&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4260, Order: 164677, Start Time: 2012-09-26 09:46:02, End Time: 2012-09-26 11:00:40 To: 4257, Order: 164668, Start Time: 2012-09-26 08:02:32, End Time: 2012-09-26 09:17:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (174 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 23.17% (0.3924 => 0.4833, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.59% (2.0176 => 2.4331, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.38% (0.0826 => 0.0953, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.69% (0.2243 => 0.2550, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.48% (0.5818 => 0.6544, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5748 => 0.6456, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.58% (0.7061 => 0.7879, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.54% (0.1413 => 0.1576, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.45% (0.1013 => 0.1129, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 11.34% (0.4328 => 0.4819, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.84% (1.3693 => 1.5177, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.68% (3.9660 => 4.3895, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.1588 => 0.1757, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.60% (0.2782 => 0.3077, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 10.51% (0.4062 => 0.4489, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 10.40% (0.2607 => 0.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.36% (0.2596 => 0.2865, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.36% (0.3485 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.35% (0.5265 => 0.5810, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.33% (1.4563 => 1.6067, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.30% (0.7710 => 0.8504, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.28% (0.9199 => 1.0145, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.22% (0.2721 => 0.2999, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.17% (0.1327 => 0.1462, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.12% (1.9828 => 2.1835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.11% (1.2193 => 1.3426, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.05% (0.2628 => 0.2892, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.00% (0.3899 => 0.4289, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3293 => 0.3621, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 9.96% (0.2761 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.90% (0.3868 => 0.4251, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 9.89% (0.7038 => 0.7734, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.89% (0.4016 => 0.4413, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.83% (0.3489 => 0.3832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.74% (0.3756 => 0.4122, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.72% (0.3580 => 0.3928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.65% (0.6283 => 0.6889, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.64% (13.8202 => 15.1527, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.63% (0.6959 => 0.7629, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 9.53% (0.3453 => 0.3782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.43% (1.1364 => 1.2436, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.20% (0.4390 => 0.4794, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.08% (0.1157 => 0.1262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.84% (0.5577 => 0.6070, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 8.80% (0.3646 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3663 => 0.3981, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.66% (0.3914 => 0.4253, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.66% (1.0313 => 1.1206, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.65% (0.4379 => 0.4758, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.65% (0.2127 => 0.2311, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (7.2180 => 7.8369, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.56% (0.3246 => 0.3524, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.47% (0.6576 => 0.7133, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.45% (0.2995 => 0.3248, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.40% (0.3940 => 0.4271, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.37% (1.1061 => 1.1987, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 8.33% (16.6129 => 17.9960, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.31% (0.3755 => 0.4067, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.27% (0.4791 => 0.5187, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.24% (0.2914 => 0.3154, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 8.23% (0.7506 => 0.8124, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.09% (0.8698 => 0.9402, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 8.04% (0.8310 => 0.8978, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.02% (0.5637 => 0.6089, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.01% (0.3220 => 0.3478, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.99% (0.7460 => 0.8056, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.82% (3.1889 => 3.4383, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2023 => 0.2181, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.79% (0.2925 => 0.3153, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.76% (0.6744 => 0.7267, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 7.69% (3.8646 => 4.1618, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/em3d/em3d: 7.66% (0.1657 => 0.1784, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 7.62% (1.9270 => 2.0738, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 7.62% (1.0594 => 1.1401, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.41% (2.1791 => 2.3406, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.36% (1.3245 => 1.4220, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 7.25% (0.3131 => 0.3358, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.14% (3.6692 => 3.9311, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 7.08% (14.8535 => 15.9057, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.07% (0.1569 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.06% (0.6135 => 0.6568, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.03% (4.4433 => 4.7558, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 6.97% (1.2749 => 1.3637, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 6.90% (1.2292 => 1.3140, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.85% (8.4961 => 9.0777, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.82% (0.2140 => 0.2286, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.79% (4.3801 => 4.6777, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 6.72% (4.6629 => 4.9762, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.57% (0.8818 => 0.9397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.1333 => 1.2074, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.43% (0.6250 => 0.6652, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.93% (0.4805 => 0.5090, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.84% (4.9865 => 5.2775, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.70% (3.2742 => 3.4608, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (6.5754 => 6.9481, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.55% (0.3245 => 0.3425, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.31% (1.5188 => 1.5995, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (13.2842 => 13.9869, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.19% (3.7467 => 3.9411, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.17% (0.9108 => 0.9579, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (6.2785 => 6.5994, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.81% (2.1007 => 2.2018, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3511 => 0.3645, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.46% (16.2614 => 16.8237, std.dev.: 0.0187) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9431, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3824, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7048, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0809, std.dev.: 0.0227) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.05% (7.4271 => 7.5792, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5891, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (8.8259 => 8.9145, std.dev.: 0.0228) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.45% (0.2670 => 0.1403) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.60% (0.4657 => 0.3977, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.44% (1.3819 => 1.1823, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.42% (1.3813 => 1.1821, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.64% (22.5627 => 21.5168, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2844, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3035, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.24% (0.9996 => 0.9572, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9551, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9312, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std.dev.: 0.0075) MultiSource/Applications/lua/lua: -1.68% (26.5159 => 26.0713, std.dev.: 0.0555) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7927, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2305, std.dev.: 0.0350) SingleSource/Benchmarks/McGill/chomp: -1.12% (1.2308 => 1.2170, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5642, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 04:11:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 06:11:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926111103.501D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4261?compare_to=4258&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4261, Order: 164679, Start Time: 2012-09-26 09:53:19, End Time: 2012-09-26 11:12:36 To: 4258, Order: 164668, Start Time: 2012-09-26 08:05:06, End Time: 2012-09-26 09:24:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (153 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 952 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -5.27% (15.5592 => 14.7391, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.38% (0.5778 => 0.5756, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.29% (16.0992 => 16.0521, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -0.13% (54.4294 => 54.3610, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: -0.30% (4.3428 => 4.3299, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.27% (1.2388 => 1.2355, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (7.5308 => 7.5128, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.30% (0.7291 => 0.7269, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0359 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.14% (0.2072 => 0.2069, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.05% (63.2438 => 54.3610, std.dev.: 0.0183) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.86% (14.1553 => 18.5231, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.18% (3.4629 => 5.4777, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14236.11% (0.0720 => 10.3220, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943000.00% (0.0001 => 9.9431, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.61% (0.2554 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 42.17% (10.3673 => 14.7391, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/richards_benchmark: 30.52% (0.1622 => 0.2117, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.79% (2.2022 => 2.5499, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.21% (7.0540 => 8.1272, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.40% (1.7609 => 1.9793, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.36% (10.4361 => 11.6212, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.76% (0.3282 => 0.3635, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: 8.54% (0.1440 => 0.1563, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.4879 => 0.5290, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.40% (0.3177 => 0.3444, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.30% (9.4845 => 10.2715, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 8.24% (5.7591 => 6.2335, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.97% (1.5415 => 1.6643, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.59% (0.3109 => 0.3345, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.56% (0.7433 => 0.7995, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.54% (0.6675 => 0.7178, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.51% (0.7115 => 0.7649, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.4615 => 0.4961, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.38% (1.3050 => 1.4013, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.37% (0.7326 => 0.7866, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3423 => 0.3674, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (8.1363 => 8.7300, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 7.27% (3.3354 => 3.5780, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.27% (0.2271 => 0.2436, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1510 => 0.1619, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.19% (0.2700 => 0.2894, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.08% (0.5860 => 0.6275, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.07% (4.2646 => 4.5662, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.06% (0.8172 => 0.8749, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.88% (0.9765 => 1.0437, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.81% (5.0018 => 5.3422, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.5569 => 0.5946, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.76% (4.9449 => 5.2793, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.64% (0.2758 => 0.2941, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.62% (0.8067 => 0.8601, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.60% (0.2107 => 0.2246, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.57% (0.3121 => 0.3326, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.56% (0.5105 => 0.5440, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.53% (0.7835 => 0.8347, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.52% (7.9617 => 8.4806, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.46% (0.4103 => 0.4368, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 6.44% (0.3387 => 0.3605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2891 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.31% (0.5020 => 0.5337, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.30% (1.5603 => 1.6586, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 6.27% (0.2905 => 0.3087, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4289 => 0.4554, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.3136 => 0.3329, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.15% (0.2831 => 0.3005, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.14% (1.1642 => 1.2357, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.3650 => 0.3873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.11% (0.3865 => 0.4101, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.10% (2.0665 => 2.1925, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.09% (1.1861 => 1.2583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.07% (0.3098 => 0.3286, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6456 => 0.6847, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.05% (3.8723 => 4.1066, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.04% (0.4203 => 0.4457, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.96% (0.3441 => 0.3646, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2756 => 0.2920, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.93% (0.3826 => 0.4053, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.93% (0.4299 => 0.4554, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 5.93% (0.4048 => 0.4288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.92% (0.2872 => 0.3042, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.92% (0.2603 => 0.2757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.86% (0.3603 => 0.3814, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 5.84% (1.0722 => 1.1348, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.83% (21.9371 => 23.2161, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 5.82% (0.3283 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3162 => 0.3345, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.78% (0.2714 => 0.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3684 => 0.3897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2802 => 0.2964, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.77% (0.2877 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.3232 => 0.3418, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4636 => 0.4899, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4620 => 0.4879, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.3180 => 0.3357, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.52% (2.0273 => 2.1393, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.43% (0.8921 => 0.9405, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6450 => 0.6796, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 5.12% (2.2969 => 2.4145, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.5981 => 0.6281, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.67% (1.5859 => 1.6599, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.58% (1.4186 => 1.4836, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.1840 => 1.2363, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (0.4064 => 0.4238, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.27% (2.2024 => 2.2964, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.2842 => 1.3386, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.3131 => 0.3254, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.35% (0.8101 => 0.8372, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.09% (0.3427 => 0.3533, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8087, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.89% (1.1194 => 1.1518, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.76% (17.1811 => 17.6548, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.8922 => 3.9588, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3847, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7716, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3458, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.55% (9.1159 => 9.2568, std.dev.: 0.0261) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8077, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5842, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.06% (3.7781 => 3.8182, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.00% (5.2763 => 3.2713, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.24% (5.3855 => 3.6493, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.94% (5.3526 => 3.6431, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1355, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/mason/mason: -13.81% (0.0811 => 0.0699, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.35% (2.9384 => 2.6049, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.18% (22.1758 => 19.9181, std.dev.: 0.0390) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -9.25% (0.2161 => 0.1961, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2951, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0154) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.18% (0.9957 => 0.9640, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1717, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -2.21% (1.2373 => 1.2100, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5015, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9961, std.dev.: 0.0091) SingleSource/UnitTests/Vector/multiplies: -1.87% (2.5528 => 2.5050, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0960, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.05% (1.0313 => 1.0205, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.08% (0.5229 => 0.5756, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 7.09% (14.9895 => 16.0521, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (4.1105 => 4.3299, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.83% (1.1048 => 1.2355, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.95% (7.1582 => 7.5128, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.83% (0.6222 => 0.7269, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.22% (0.2116 => 0.2069, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 04:29:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 06:29:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926112934.E6D5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4262?compare_to=4256&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4262, Order: 164684, Start Time: 2012-09-26 10:12:06, End Time: 2012-09-26 11:31:09 To: 4256, Order: 164664, Start Time: 2012-09-26 06:57:40, End Time: 2012-09-26 08:12:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 7 (66 on baseline) Performance Improvements: 3 (46 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 887 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 41.38% (0.0261 => 0.0369, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.69% (0.5553 => 0.5758, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 2.22% (1.1103 => 1.1350, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (1.3852 => 1.4129, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (8.5340 => 8.6230, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.46% (1.9910 => 2.0201, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.44% (1.2582 => 1.2763, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.42% (3.2416 => 3.1631, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: -1.78% (0.7867 => 0.7727, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sgefa/sgefa: -4.65% (0.3485 => 0.3323, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.77% (1.0065 => 1.0142, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -2.04% (0.5919 => 0.5798, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -1.72% (0.1629 => 0.1601, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.53% (0.1304 => 0.1350, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (0.2911 => 0.2951, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.65% (0.2188 => 0.2152, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.34% (0.2959 => 0.2969, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.38% (0.2086 => 0.2094, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: -10.08% (0.0248 => 0.0223, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: -20.48% (0.0083 => 0.0066, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: -5.68% (0.0088 => 0.0083, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.74% (0.0073 => 0.0075, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.75% (0.0160 => 0.0190, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0384 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.74% (0.0235 => 0.0272, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.05% (0.0286 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.71% (0.0264 => 0.0287, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -30.68% (0.0176 => 0.0122, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -18.32% (0.0191 => 0.0156, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.57% (0.0254 => 0.0250, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 66.22% (0.0074 => 0.0123, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1443 => 0.1437, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -0.04% (0.2289 => 0.2288, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: -0.91% (1.4290 => 1.4160, std.dev.: 0.0400) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.88% (0.1469 => 0.1456, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.29% (0.5910 => 0.5927, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -7.49% (26.3908 => 24.4140, std.dev.: 1.3205) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.46% (0.4052 => 0.4192, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.61% (0.1369 => 0.1391, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.11% (0.0541 => 0.0547, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.18% (0.0193 => 0.0183, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.06% (0.0661 => 0.0668, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1290 => 1.1344, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0012 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.26% (0.0620 => 0.0544, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.97% (0.0156 => 0.0142, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7648 => 0.7644, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.02% (1.7061 => 1.7064, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.34% (0.0111 => 0.0064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2288, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -91.50% (6.9722 => 0.5927, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 19636.46% (0.1237 => 24.4140, std.dev.: 1.3205) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.87% (4.1772 => 3.0129, std.dev.: 0.0815) SingleSource/Benchmarks/Shootout-C++/except: 81983.33% (0.0006 => 0.4925, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 9.88% (2.1763 => 2.3914, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.66% (0.6410 => 0.6965, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: 7.90% (1.0046 => 1.0840, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.85% (0.1414 => 0.1525, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 7.38% (0.5309 => 0.5701, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 7.13% (15.3105 => 16.4028, std.dev.: 0.2219) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.07% (1.5150 => 1.6221, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.84% (0.3582 => 0.3827, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (1.1653 => 1.2340, std.dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: 5.84% (0.6915 => 0.7319, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3901 => 0.4123, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.2552 => 0.2696, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.14% (3.0225 => 3.1778, std.dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: 4.92% (8.2186 => 8.6230, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 4.89% (1.0821 => 1.1350, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (12.6413 => 13.2266, std.dev.: 0.0992) MultiSource/Benchmarks/Bullet/bullet: 4.53% (29.3170 => 30.6461, std.dev.: 0.1245) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.7639 => 0.7962, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.95% (0.4248 => 0.4416, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (6.2546 => 6.5006, std.dev.: 0.0336) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.81% (1.2021 => 1.2479, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.81% (0.6069 => 0.6300, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.71% (13.3238 => 13.8180, std.dev.: 0.1122) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.1827 => 1.2263, std.dev.: 0.0111) MultiSource/Applications/treecc/treecc: 3.67% (1.8798 => 1.9487, std.dev.: 0.0101) MultiSource/Applications/hbd/hbd: 3.32% (1.3268 => 1.3708, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 3.31% (3.5980 => 3.7170, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 3.30% (2.0972 => 2.1665, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8405 => 0.8655, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.84% (3.0758 => 3.1631, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.4408 => 1.4763, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.43% (0.5937 => 0.6081, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.0317 => 2.0794, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4880 => 0.4988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (1.3935 => 1.4129, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 1.15% (0.9425 => 0.9533, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.69% (4.0101 => 4.5589, std.dev.: 0.0236) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 13.12% (0.1433 => 0.1621, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.93% (0.2857 => 0.3112, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6105, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.39% (0.3301 => 0.3578, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.17% (1.0063 => 1.0885, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.80% (40.4792 => 42.8272, std.dev.: 0.0826) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.38% (0.7609 => 0.7942, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/fp-convert: 4.37% (15.2242 => 15.8899, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 4.01% (8.5113 => 8.8527, std.dev.: 0.0627) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.28% (3.5520 => 3.6686, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.76% (14.4877 => 14.8874, std.dev.: 0.0361) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8087, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.44% (2.6656 => 2.7306, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.43% (0.5876 => 0.6019, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 2.07% (2.4013 => 2.4509, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4455 => 2.4816, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.43% (38.9255 => 39.4827, std.dev.: 0.2020) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.08% (27.1724 => 27.4664, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (4.6414 => 4.6885, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.03% (0.2996 => 0.1677, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.32% (1.4189 => 1.1448, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.10% (1.4113 => 1.1417, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.26% (0.3497 => 0.2054, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.20% (5.2665 => 4.0975, std.dev.: 0.2313) SingleSource/Benchmarks/Shootout-C++/ary3: -20.47% (1.7473 => 1.3896, std.dev.: 0.0449) MultiSource/Benchmarks/FreeBench/mason/mason: -15.49% (0.5004 => 0.4229, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.17% (1.7361 => 1.4728, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.34% (8.1594 => 7.1528, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: -11.29% (0.3746 => 0.3323, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.64% (1.1647 => 1.0524, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7494, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9442, std.dev.: 0.0347) MultiSource/Applications/lambda-0_1_3/lambda: -7.11% (7.6833 => 7.1368, std.dev.: 0.0313) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3754, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/fibo: -6.67% (4.6355 => 4.3264, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -6.46% (1.4441 => 1.3508, std.dev.: 0.0278) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.44% (2.0027 => 1.8737, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.84% (3.4230 => 3.2231, std.dev.: 0.0350) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.64% (1.4021 => 1.3230, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1848, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.15% (0.4564 => 0.4329, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.33% (15.8312 => 15.1459, std.dev.: 0.2630) MultiSource/Benchmarks/mafft/pairlocalalign: -4.03% (62.4126 => 59.8972, std.dev.: 0.0878) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.86% (3.7496 => 3.6050, std.dev.: 0.0166) SingleSource/Benchmarks/McGill/misr: -3.75% (0.4296 => 0.4135, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.4140 => 0.3988, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.46% (2.5166 => 2.4294, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (9.2503 => 8.9489, std.dev.: 0.0481) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2323, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8205, std.dev.: 0.0274) MultiSource/Benchmarks/FreeBench/neural/neural: -2.21% (1.0926 => 1.0685, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.88% (1.1683 => 1.1463, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.84% (3.8907 => 3.8192, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: -1.80% (3.4876 => 3.4249, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3147, std.dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/fldry: -1.66% (2.4971 => 2.4556, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (92.7467 => 91.2135, std.dev.: 0.0890) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.57% (1.0686 => 1.0518, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (9.3855 => 9.2382, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.41% (25.6658 => 25.3049, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.62% (0.9980 => 1.0142, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -3.72% (0.6022 => 0.5798, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -3.90% (0.1666 => 0.1601, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.13% (0.1554 => 0.1350, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.28% (0.3083 => 0.2951, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.11% (0.2394 => 0.2152, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.49% (0.3175 => 0.2969, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.04% (0.2302 => 0.2094, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: -50.33% (0.0449 => 0.0223, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: -25.84% (0.0089 => 0.0066, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: -7.78% (0.0090 => 0.0083, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.63% (0.0301 => 0.0272, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.42% (0.0324 => 0.0287, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -31.07% (0.0177 => 0.0122, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -17.46% (0.0189 => 0.0156, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: -62.15% (0.0325 => 0.0123, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1429 => 0.1437, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.72% (1.5019 => 1.4160, std.dev.: 0.0400) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.00% (0.1501 => 0.1456, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.69% (0.4264 => 0.4192, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.50% (0.1344 => 0.1391, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.12% (0.0232 => 0.0183, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.54% (0.0639 => 0.0668, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1350 => 1.1344, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.60% (0.0637 => 0.0544, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.28% (0.0246 => 0.0142, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.37% (0.7541 => 0.7644, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7064, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.57% (0.0070 => 0.0064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 05:42:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 07:42:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926124226.475D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4263?compare_to=4260&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4263, Order: 164690, Start Time: 2012-09-26 11:29:29, End Time: 2012-09-26 12:43:58 To: 4260, Order: 164677, Start Time: 2012-09-26 09:46:02, End Time: 2012-09-26 11:00:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (696 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.05% (4.6155 => 4.5670, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.76% (2.0176 => 2.4365, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.74% (0.5818 => 0.6559, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.68% (0.5748 => 0.6477) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 11.83% (0.7061 => 0.7896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.23% (0.4328 => 0.4814, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.95% (1.3693 => 1.5193, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.78% (3.9660 => 4.3935, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.44% (0.2596 => 0.2867, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.41% (0.3899 => 0.4305, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 10.41% (0.2690 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.25% (1.9828 => 2.1861, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.25% (0.7710 => 0.8500, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.23% (1.2193 => 1.3440, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.22% (0.9199 => 1.0139, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.21% (0.2761 => 0.3043, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.20% (0.2628 => 0.2896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.11% (1.4563 => 1.6035, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.02% (0.7038 => 0.7743, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 10.01% (0.3868 => 0.4255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.98% (0.3756 => 0.4131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.97% (0.3580 => 0.3937, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.97% (0.5265 => 0.5790, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.3107 => 0.3416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.93% (0.4390 => 0.4826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.86% (0.4016 => 0.4412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3149 => 0.3459, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.69% (0.6959 => 0.7633, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.59% (0.3534 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 9.53% (0.3453 => 0.3782, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.52% (0.6283 => 0.6881, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.38% (13.8202 => 15.1170, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.36% (0.3130 => 0.3423, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.35% (1.1364 => 1.2426, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.99% (0.4003 => 0.4363, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.80% (0.5577 => 0.6068, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.61% (1.0313 => 1.1201, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.61% (0.4379 => 0.4756, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6576 => 0.7139, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 8.56% (0.1589 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (7.2180 => 7.8316, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 8.40% (16.6129 => 18.0081, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.35% (0.3246 => 0.3517, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 8.31% (0.2995 => 0.3244, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.22% (1.1061 => 1.1970, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.15% (0.7460 => 0.8068, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 8.14% (0.7506 => 0.8117, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.14% (0.8698 => 0.9406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.12% (0.3755 => 0.4060, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.08% (0.4791 => 0.5178, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.04% (0.3220 => 0.3479, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.93% (0.2925 => 0.3157, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.93% (0.8310 => 0.8969, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.93% (0.5637 => 0.6084, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.78% (0.6744 => 0.7269, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 7.70% (3.1889 => 3.4344, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 7.65% (3.8646 => 4.1603, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.52% (1.9270 => 2.0719, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 7.51% (1.0594 => 1.1390, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 7.43% (2.1791 => 2.3410, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.18% (3.6692 => 3.9328, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.11% (1.3245 => 1.4187, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 7.06% (1.2749 => 1.3649, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 7.06% (0.3131 => 0.3352, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.05% (14.8535 => 15.9011, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.2140 => 0.2289, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.95% (4.3801 => 4.6844, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.86% (4.4433 => 4.7479, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 6.83% (0.4113 => 0.4394, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.78% (8.4961 => 9.0722, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1569 => 0.1675, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.65% (0.6135 => 0.6543, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.55% (0.8818 => 0.9396, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.49% (4.6629 => 4.9656, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.45% (1.1333 => 1.2064, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 6.37% (0.6250 => 0.6648, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.35% (0.2504 => 0.2663, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.65% (4.9865 => 5.2682, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.61% (3.2742 => 3.4579, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.61% (0.3245 => 0.3427, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.58% (6.5754 => 6.9423, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.25% (6.2785 => 6.6083, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.24% (0.9108 => 0.9585, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (13.2842 => 13.9646, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.07% (1.5188 => 1.5958, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.06% (3.7467 => 3.9363, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.60% (2.1007 => 2.1974, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.87% (0.3511 => 0.3647, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.34% (16.2614 => 16.8040, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9550, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2514, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.81% (0.3139 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.11% (10.7476 => 11.0814, std.dev.: 0.0628) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5844, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5844, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5996, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.42% (0.2670 => 0.1404) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.28% (1.3813 => 1.1841, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.23% (1.3819 => 1.1852, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.84% (22.5627 => 21.4708, std.dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.13% (0.2238 => 0.1989, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.30% (20.3410 => 18.2467, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3050, std.dev.: 0.0097) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.82% (0.9996 => 0.9614, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1583, std.dev.: 0.0253) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0187) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.75% (26.5159 => 26.0506, std.dev.: 0.0437) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2470, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7925, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2181, std.dev.: 0.0246) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5627, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4343, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 05:59:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 07:59:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926125902.4C3372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4264?compare_to=4261&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4264, Order: 164691, Start Time: 2012-09-26 11:41:27, End Time: 2012-09-26 13:00:35 To: 4261, Order: 164679, Start Time: 2012-09-26 09:53:19, End Time: 2012-09-26 11:12:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (154 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 951 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.02% (14.7391 => 15.4788, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.55% (1.2100 => 1.2287, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.59% (0.5756 => 0.5790, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 0.35% (16.0521 => 16.1081, std.dev.: 0.0202) MultiSource/Benchmarks/Bullet/bullet: 0.24% (54.3610 => 54.4905, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 0.42% (4.3299 => 4.3482, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.39% (1.2355 => 1.2403, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.25% (7.5128 => 7.5316, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.40% (0.7269 => 0.7298, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0357 => 0.0355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.49% (0.2069 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.84% (63.2438 => 54.4905, std.dev.: 0.0215) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.54% (14.1553 => 18.6195, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.59% (3.4629 => 5.4917, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14249.03% (0.0720 => 10.3313, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9942800.00% (0.0001 => 9.9429, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.30% (10.3673 => 15.4788, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/08-main/main: 47.49% (0.2554 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 29.78% (0.1622 => 0.2105, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.79% (2.2022 => 2.5500, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.00% (7.0540 => 8.1124, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops: 14.87% (0.1432 => 0.1645, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.79% (0.1566 => 0.1782, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.68% (1.7609 => 1.9842, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.39% (10.4361 => 11.6249, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.24% (0.1584 => 0.1762, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.06% (0.3282 => 0.3645, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 8.94% (9.4845 => 10.3327, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1655 => 0.1803, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.84% (0.3177 => 0.3458, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5925 => 0.6449, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1440 => 0.1567, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.81% (0.4879 => 0.5309, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.29% (1.5415 => 1.6693, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.20% (5.7591 => 6.2314, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.18% (0.6675 => 0.7221, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.17% (0.3109 => 0.3363, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 8.14% (0.7115 => 0.7694, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4615 => 0.4986, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.03% (0.7433 => 0.8030, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.94% (0.7326 => 0.7908, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.94% (0.1625 => 0.1754, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.84% (1.3050 => 1.4073, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3423 => 0.3691, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2271 => 0.2447, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.74% (0.2700 => 0.2909, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 7.72% (3.3354 => 3.5929, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (8.1363 => 8.7616, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.66% (4.2646 => 4.5914, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.61% (0.7835 => 0.8431, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.5860 => 0.6293, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.21% (0.9765 => 1.0469, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.19% (5.0018 => 5.3612, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.18% (4.9449 => 5.2997, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.8172 => 0.8758, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.14% (0.8067 => 0.8643, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.13% (0.5569 => 0.5966, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.08% (0.3121 => 0.3342, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.07% (0.2758 => 0.2953, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2107 => 0.2255, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.00% (0.3387 => 0.3624, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.80% (7.9617 => 8.5030, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.75% (0.5020 => 0.5359, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.4103 => 0.4380, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.70% (1.5603 => 1.6649, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.69% (0.4289 => 0.4576, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.61% (1.1642 => 1.2412, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.60% (0.4636 => 0.4942, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.58% (0.6456 => 0.6881, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.53% (1.1861 => 1.2635, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.51% (0.4299 => 0.4579, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.42% (0.3865 => 0.4113, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 6.40% (1.0722 => 1.1408, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.34% (2.0665 => 2.1976, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.33% (0.3826 => 0.4068, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4203 => 0.4468, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.30% (0.2603 => 0.2767, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.29% (3.8723 => 4.1160, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 6.27% (21.9371 => 23.3115, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3441 => 0.3656, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.3232 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4620 => 0.4907, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.19% (0.3684 => 0.3912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3283 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.06% (2.0273 => 2.1501, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3162 => 0.3352, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.00% (0.3603 => 0.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.3180 => 0.3366, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.84% (0.8921 => 0.9442, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.71% (0.6450 => 0.6818, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 5.67% (2.2969 => 2.4272, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.38% (0.2266 => 0.2388, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.37% (0.5981 => 0.6302, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.28% (1.5859 => 1.6696, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.03% (1.4186 => 1.4900, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.89% (1.1840 => 1.2419, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.73% (2.2024 => 2.3066, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.4064 => 0.4256, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.51% (1.2842 => 1.3421, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.3427 => 0.3554, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.57% (0.8101 => 0.8390, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (14.3668 => 14.8754, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 2.90% (17.1811 => 17.6788, std.dev.: 0.0219) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.82% (1.1194 => 1.1510, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.8922 => 3.9854, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.36% (1.1145 => 1.3860, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3813, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.1396 => 1.2156, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.62% (3.6395 => 3.7714, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 3.62% (0.5413 => 0.5609, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3436, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (0.8275 => 0.8408, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.51% (9.1159 => 9.2532, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8078, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6823, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.84% (5.2763 => 3.2795, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.63% (5.3855 => 3.6284, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.26% (5.3526 => 3.6258, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1652, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.33% (2.9384 => 2.6056, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -9.92% (22.1758 => 19.9762, std.dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -9.21% (0.2161 => 0.1962, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3125, std.dev.: 0.1019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.90% (0.9957 => 0.9569, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1739, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.90% (2.5528 => 2.5043, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.77% (8.6802 => 8.5262, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0148, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.64% (10.2830 => 10.1144, std.dev.: 0.0094) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5790, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.73% (0.5229 => 0.5790, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 7.46% (14.9895 => 16.1081, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: 5.78% (4.1105 => 4.3482, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.26% (1.1048 => 1.2403, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.22% (7.1582 => 7.5316, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.29% (0.6222 => 0.7298, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 06:04:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 08:04:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926130419.F3D1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4265?compare_to=4262&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4265, Order: 164692, Start Time: 2012-09-26 11:47:11, End Time: 2012-09-26 13:05:54 To: 4262, Order: 164684, Start Time: 2012-09-26 10:12:06, End Time: 2012-09-26 11:31:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 19 (87 on baseline) Performance Improvements: 4 (50 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 874 (750 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 15.99% (0.0644 => 0.0747, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.58% (0.1926 => 0.2072, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.03% (3.9018 => 4.0200, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.89% (0.7754 => 0.7978, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (4.0731 => 4.1691, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.84% (1.4763 => 1.5035, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.73% (0.7962 => 0.8100, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.61% (2.0794 => 2.1128, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.1631 => 3.2125, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.0947 => 1.1115, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.49% (4.3504 => 4.4154, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.1417 => 1.1561, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.20% (1.2038 => 1.2183, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (8.3689 => 8.4624, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 30.10% (0.4229 => 0.5502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.38% (4.2914 => 4.5221, std.dev.: 0.0829) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.52% (21.7778 => 22.3258, std.dev.: 0.1885) SingleSource/Benchmarks/Misc/mandel-2: 2.20% (3.0129 => 3.0791, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.60% (1.5819 => 1.6072, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.89% (1.1350 => 1.1136, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.47% (15.1459 => 13.4088, std.dev.: 0.5991) MultiSource/Benchmarks/llubenchmark/llu: -1.52% (2.0201 => 1.9894, std.dev.: 0.0094) MultiSource/Applications/lua/lua: -1.30% (29.5043 => 29.1203, std.dev.: 0.0653) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.06% (1.0142 => 1.0148, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.24% (0.5798 => 0.5928, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 2.50% (0.1601 => 0.1641, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.33% (0.1350 => 0.1332, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (0.2951 => 0.2996, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.2152 => 0.2233, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (0.2969 => 0.3040, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.91% (0.2094 => 0.2113, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: -8.07% (0.0223 => 0.0205, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: 28.79% (0.0066 => 0.0085, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -61.45% (0.0083 => 0.0032, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0075 => 0.0075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0190 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.29% (0.0272 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0283 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.06% (0.0287 => 0.0261, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 16.39% (0.0122 => 0.0142, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 22.44% (0.0156 => 0.0191, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0250 => 0.0249, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 2.44% (0.0123 => 0.0126, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.77% (0.1437 => 0.1426, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 0.22% (0.2288 => 0.2293, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.96% (1.4160 => 1.5146, std.dev.: 0.0175) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.30% (0.1456 => 0.1475, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.12% (0.5927 => 0.5920, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.24% (24.4140 => 26.6700, std.dev.: 0.1587) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.48% (0.4192 => 0.4004, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.14% (0.1391 => 0.1393, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.84% (0.0547 => 0.0526, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.46% (0.0183 => 0.0193, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.02% (0.0668 => 0.0581, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1344 => 1.1269, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0016 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.74% (0.0544 => 0.0548, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.73% (0.0142 => 0.0197, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7644 => 0.7658, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7064 => 1.7062, std.dev.: 0.0049) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 26.56% (0.0064 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2293, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -91.51% (6.9722 => 0.5920, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 21460.23% (0.1237 => 26.6700, std.dev.: 0.1587) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.29% (4.1772 => 3.0791, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.89% (0.6410 => 0.7044, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.49% (0.1159 => 0.1269, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.35% (2.1763 => 2.3798, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 9.17% (0.5309 => 0.5796, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 8.09% (1.0046 => 1.0859, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.01% (1.5150 => 1.6364, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.41% (0.2552 => 0.2741, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.13% (0.6173 => 0.6613, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.95% (0.3582 => 0.3831, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.83% (15.3105 => 16.3555, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: 6.30% (1.1653 => 1.2387, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3901 => 0.4140, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.03% (0.7639 => 0.8100, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 5.71% (0.6915 => 0.7310, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 5.30% (3.0225 => 3.1828, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.22% (0.2106 => 0.2216, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.57% (0.7226 => 0.7556, std.dev.: 0.0122) MultiSource/Applications/SPASS/SPASS: 4.48% (13.3238 => 13.9211, std.dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.44% (3.0758 => 3.2125, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.38% (0.4248 => 0.4434, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.38% (1.1672 => 1.2183, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (1.4408 => 1.5035, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3062 => 0.3194, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 4.30% (2.0972 => 2.1874, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (12.6413 => 13.1843, std.dev.: 0.0762) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.28% (0.8569 => 0.8936, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.25% (1.1827 => 1.2330, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 4.13% (29.3170 => 30.5288, std.dev.: 0.2583) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.2952 => 0.3074, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.07% (0.2654 => 0.2762, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 4.01% (4.7455 => 4.9356, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.99% (2.0317 => 2.1128, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.99% (1.0689 => 1.1115, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.75% (8.2186 => 8.5267, std.dev.: 0.0444) MultiSource/Applications/Burg/burg: 3.66% (1.1440 => 1.1859, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 3.62% (3.8796 => 4.0200, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.61% (4.2616 => 4.4154, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.45% (1.2021 => 1.2436, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.41% (4.0318 => 4.1691, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.34% (6.2546 => 6.4636, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4880 => 0.5040, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 3.27% (1.8798 => 1.9413, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 3.27% (3.5980 => 3.7157, std.dev.: 0.0142) MultiSource/Applications/hbd/hbd: 3.17% (1.3268 => 1.3689, std.dev.: 0.0147) MultiSource/Applications/JM/lencod/lencod: 3.11% (14.7256 => 15.1841, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.98% (0.3418 => 0.3520, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0821 => 1.1136, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8405 => 0.8628, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.4908 => 6.6538, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.50% (8.2559 => 8.4624, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.7784 => 0.7978, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.5963 => 0.6108, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 45.59% (0.0261 => 0.0380, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.58% (0.0917 => 0.1069, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 14.67% (1.7426 => 1.9982, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.78% (4.0101 => 4.5627, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 10.73% (0.1417 => 0.1569, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/mason/mason: 9.95% (0.5004 => 0.5502, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.60% (7.0025 => 7.6046, std.dev.: 0.0301) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.34% (4.2129 => 4.5221, std.dev.: 0.0829) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.30% (0.8498 => 0.9118, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: 4.91% (0.6459 => 0.6776, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.77% (40.4792 => 42.4118, std.dev.: 0.3703) SingleSource/Benchmarks/Misc/dt: 4.64% (0.9851 => 1.0308, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5386, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 3.81% (15.2242 => 15.8046, std.dev.: 0.0367) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.53% (0.5587 => 0.5784, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 2.81% (3.5520 => 3.6517, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8928, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8097, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.46% (2.6656 => 2.7312, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/hash: 2.20% (0.6308 => 0.6447, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (2.4013 => 2.4505, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.98% (4.6127 => 4.7040, std.dev.: 0.0224) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4855, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.28% (2.9152 => 2.9524, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/em3d/em3d: 1.27% (4.6414 => 4.7004, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 1.01% (6.2244 => 6.2871, std.dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.73% (0.2996 => 0.1656, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.18% (1.4189 => 1.1467, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.08% (1.4113 => 1.1561, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.62% (5.2665 => 4.1278, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/ary3: -20.08% (1.7473 => 1.3964, std.dev.: 0.0327) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.30% (15.8312 => 13.4088, std.dev.: 0.5991) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.13% (1.7361 => 1.4734, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.52% (0.0917 => 0.0793, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1629, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.77% (3.6023 => 3.2142, std.dev.: 0.1440) MultiSource/Applications/sgefa/sgefa: -10.76% (0.3746 => 0.3343, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.94% (1.1647 => 1.0489, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7535, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9373, std.dev.: 0.0455) MultiSource/Applications/lambda-0_1_3/lambda: -6.88% (7.6833 => 7.1549, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3766, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.43% (4.6355 => 4.3375, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.88% (3.4230 => 3.2218, std.dev.: 0.0218) MultiSource/Benchmarks/FreeBench/distray/distray: -5.71% (0.2664 => 0.2512, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1871, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.23% (0.4564 => 0.4371, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8251, std.dev.: 0.0820) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.73% (1.2722 => 1.2247, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (2.5166 => 2.4252, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -3.08% (9.2503 => 8.9652, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.04% (3.9413 => 3.8213, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.46% (1.1683 => 1.1396, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -2.35% (0.4296 => 0.4195, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.35% (3.7496 => 3.6616, std.dev.: 0.0271) MultiSource/Applications/aha/aha: -1.98% (3.4286 => 3.3608, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.97% (2.4457 => 2.3974, std.dev.: 0.0181) MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (92.7467 => 90.9429, std.dev.: 0.5768) MultiSource/Benchmarks/sim/sim: -1.94% (3.8907 => 3.8151, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4216, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.51% (9.3855 => 9.2434, std.dev.: 0.0350) MultiSource/Benchmarks/llubenchmark/llu: -1.48% (2.0192 => 1.9894, std.dev.: 0.0094) MultiSource/Applications/lua/lua: -1.36% (29.5232 => 29.1203, std.dev.: 0.0653) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3156, std.dev.: 0.0245) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4639, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.12% (1.8739 => 1.8529, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.68% (0.9980 => 1.0148, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: -1.56% (0.6022 => 0.5928, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -1.50% (0.1666 => 0.1641, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.29% (0.1554 => 0.1332, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.82% (0.3083 => 0.2996, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.73% (0.2394 => 0.2233, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.25% (0.3175 => 0.3040, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.21% (0.2302 => 0.2113, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: -54.34% (0.0449 => 0.0205, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: -4.49% (0.0089 => 0.0085, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -64.44% (0.0090 => 0.0032, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.44% (0.0324 => 0.0261, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -19.77% (0.0177 => 0.0142, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -61.23% (0.0325 => 0.0126, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 0.85% (1.5019 => 1.5146, std.dev.: 0.0175) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.73% (0.1501 => 0.1475, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.10% (0.4264 => 0.4004, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1344 => 0.1393, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.70% (0.0589 => 0.0526, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.81% (0.0232 => 0.0193, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.08% (0.0639 => 0.0581, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1350 => 1.1269, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.92% (0.0246 => 0.0197, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.06% (1.5363 => 1.7062, std.dev.: 0.0049) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.71% (0.0070 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 06:09:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 08:09:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120926130929.3B5EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4266?compare_to=4259&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4266, Order: 164684, Start Time: 2012-09-26 10:27:00, End Time: 2012-09-26 13:11:02 To: 4259, Order: 164662, Start Time: 2012-09-26 07:10:11, End Time: 2012-09-26 09:56:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (135 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 2.45% (14.2817 => 14.6318, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.36% (2.8268 => 2.7883, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.01% (0.3488 => 0.3907, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.75% (0.3465 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3446 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.59% (0.3469 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.32% (0.3650 => 0.4063, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.09% (0.3724 => 0.4137, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.01% (0.1063 => 0.1180, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.75% (1.5932 => 1.7486, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5826 => 0.6365, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.05% (0.5889 => 0.6422, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.52% (0.1421 => 0.1542, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7171 => 0.7748, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (1.6211 => 1.7509, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (3.5627 => 3.8389, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.73% (0.4361 => 0.4698, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (1.3152 => 1.4156, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.63% (0.2738 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.34% (0.2875 => 0.3086, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.24% (0.5026 => 0.5390, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 7.23% (1.0781 => 1.1560, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.21% (2.7292 => 2.9259, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.18% (0.5000 => 0.5359, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.16% (0.2750 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 7.15% (5.5417 => 5.9379, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3195 => 0.3423, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.06% (0.3004 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.01% (0.2823 => 0.3021, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.00% (0.2729 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2792 => 0.2987, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.98% (0.9909 => 1.0601, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.97% (0.3930 => 0.4204, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.83% (0.4994 => 0.5335, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 6.83% (0.2813 => 0.3005, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.2866 => 0.3061, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.74% (2.0673 => 2.2067, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/random: 6.74% (0.2803 => 0.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.70% (0.2566 => 0.2738, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.2911 => 0.3106, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2780 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2811 => 0.2999, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.67% (0.3060 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3096 => 0.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3267 => 0.3484, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3258 => 0.3474, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.55% (4.2109 => 4.4868, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.2736 => 0.2913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3317 => 0.3531, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.43% (2.1013 => 2.2365, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.42% (0.3362 => 0.3578, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 6.42% (0.3348 => 0.3563, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.3678 => 0.3914, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3124 => 0.3322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.33% (0.3477 => 0.3697, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.26% (0.3625 => 0.3852, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.23% (4.4195 => 4.6947, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3726 => 0.3958, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3282 => 0.3485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4146 => 0.4401, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 6.12% (23.5202 => 24.9588, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 6.12% (4.6177 => 4.9001, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 6.06% (0.4029 => 0.4273, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.3271 => 0.3468, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.02% (0.3690 => 0.3912, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.00% (0.4251 => 0.4506, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.96% (0.3890 => 0.4122, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (0.3903 => 0.4135, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 5.92% (1.8794 => 1.9906, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 5.87% (1.4269 => 1.5106, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.87% (2.1653 => 2.2923, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 5.86% (0.6634 => 0.7023, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.75% (0.4658 => 0.4926, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.73% (0.2075 => 0.2194, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.3845 => 0.4065, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.68% (0.4139 => 0.4374, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.3981 => 0.4207, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.64% (0.2040 => 0.2155, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.58% (0.5900 => 0.6229, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 5.51% (0.5012 => 0.5288, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.49% (0.3336 => 0.3519, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.46% (0.2068 => 0.2181, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.44% (0.6435 => 0.6785, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.2737 => 0.2883, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.3084 => 0.3248, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.29% (0.9697 => 1.0210, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (1.9694 => 2.0733, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: 5.27% (0.5546 => 0.5838, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 5.24% (0.7875 => 0.8288, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.14% (1.9966 => 2.0993, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 5.03% (2.0346 => 2.1370, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.2969 => 0.3117, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.80% (0.2103 => 0.2204, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 4.60% (0.2391 => 0.2501, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.58% (0.4847 => 0.5069, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (0.7426 => 0.7732, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.97% (0.4253 => 0.4422, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (0.5361 => 0.5568, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.64% (0.5584 => 0.5787, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.3498 => 0.3616, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.31% (11.6398 => 12.0253, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.6926 => 4.8366, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 2.09% (11.9555 => 12.2048, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6728, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.99% (1.8057 => 1.8958, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1624, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6318, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2081, std.dev.: 0.0580) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5055, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4606, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5827, std.dev.: 0.0351) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5789, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7937, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/fldry: -3.08% (17.2379 => 16.7062, std.dev.: 0.1185) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 07:25:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 09:25:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926142555.C09542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4267?compare_to=4263&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4267, Order: 164692, Start Time: 2012-09-26 13:12:38, End Time: 2012-09-26 14:27:29 To: 4263, Order: 164690, Start Time: 2012-09-26 11:29:29, End Time: 2012-09-26 12:43:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.73% (2.0176 => 2.4358, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.60% (0.2243 => 0.2548, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.56% (0.5818 => 0.6549, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5748 => 0.6456, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.14% (0.7061 => 0.7918, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 11.29% (0.2781 => 0.3095, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.05% (1.3693 => 1.5206, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 11.04% (0.4328 => 0.4806, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.75% (3.9660 => 4.3923, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.73% (0.7710 => 0.8537, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 10.68% (0.4062 => 0.4496, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.40% (0.2596 => 0.2866, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.39% (0.3022 => 0.3336, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.39% (0.3485 => 0.3847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.35% (1.2193 => 1.3455, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.33% (0.9199 => 1.0149, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.32% (1.4563 => 1.6066, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.30% (1.9828 => 2.1870, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 10.30% (0.2690 => 0.2967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3293 => 0.3629, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.18% (0.3899 => 0.4296, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.07% (0.5265 => 0.5795, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.99% (0.4016 => 0.4417, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.92% (0.2761 => 0.3035, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.90% (0.7038 => 0.7735, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.78% (0.3149 => 0.3457, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4390 => 0.4819, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.76% (0.6959 => 0.7638, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 9.69% (0.3868 => 0.4243, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.52% (0.6283 => 0.6881, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.51% (13.8202 => 15.1350, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.41% (1.1364 => 1.2433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.38% (0.3453 => 0.3777, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 9.37% (0.3534 => 0.3865, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.82% (0.5577 => 0.6069, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.72% (0.4379 => 0.4761, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 8.71% (1.0313 => 1.1211, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 8.65% (0.2995 => 0.3254, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.47% (0.3246 => 0.3521, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.45% (7.2180 => 7.8276, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 8.43% (1.1061 => 1.1993, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.38% (0.7506 => 0.8135, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.37% (0.2914 => 0.3158, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.29% (0.4003 => 0.4335, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.21% (16.6129 => 17.9765, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.18% (0.4791 => 0.5183, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 8.16% (0.8310 => 0.8988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.14% (0.5637 => 0.6096, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.04% (0.8698 => 0.9397, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3755 => 0.4056, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.98% (0.6576 => 0.7101, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3220 => 0.3475, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2023 => 0.2181, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.79% (0.7460 => 0.8041, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.67% (3.8646 => 4.1611, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.65% (0.6744 => 0.7260, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.59% (1.0594 => 1.1398, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.58% (3.1889 => 3.4307, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.56% (1.9270 => 2.0726, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.42% (0.4113 => 0.4418, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.33% (2.1791 => 2.3389, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.30% (1.3245 => 1.4212, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.18% (3.6692 => 3.9328, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 7.11% (1.2749 => 1.3656, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 7.10% (14.8535 => 15.9080, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 7.06% (0.3131 => 0.3352, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.03% (4.3801 => 4.6881, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 6.94% (1.2292 => 1.3145, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.92% (4.4433 => 4.7509, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 6.92% (8.4961 => 9.0837, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1569 => 0.1676, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.78% (0.6135 => 0.6551, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.2140 => 0.2282, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.58% (0.8818 => 0.9398, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.43% (0.2504 => 0.2665) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2059, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 6.29% (4.6629 => 4.9564, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 6.16% (0.6250 => 0.6635, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.4805 => 0.5095, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.01% (3.2742 => 3.4711, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.3245 => 0.3430, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.54% (6.5754 => 6.9397, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.51% (0.9108 => 0.9610, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.50% (1.5188 => 1.6023, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.43% (4.9865 => 5.2573, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.2008 => 0.2115, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.12% (6.2785 => 6.6000, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 5.01% (3.7467 => 3.9344, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.98% (2.1007 => 2.2054, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (13.2842 => 13.9409, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 3.30% (16.2614 => 16.7988, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.30% (0.3511 => 0.3627, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9405, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4154, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7063, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.54% (1.9199 => 1.9879, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.20% (10.7476 => 11.0920, std.dev.: 0.0198) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5992, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5831, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1862, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5912, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9186, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6841, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.49% (0.2670 => 0.1402) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.05% (0.4657 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.30% (1.3819 => 1.1843, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.18% (1.3813 => 1.1854, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.97% (22.5627 => 21.4404, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.08% (0.2238 => 0.1990, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2872, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.86% (1.3780 => 1.2972, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5100, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.55% (0.9996 => 0.9541, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.34% (1.7688 => 1.7097, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9552, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.25% (1.9762 => 1.9318, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2404, std.dev.: 0.0074) MultiSource/Applications/lua/lua: -1.74% (26.5159 => 26.0537, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.62% (0.6615 => 0.6508, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7920, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std.dev.: 0.0075) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2095, std.dev.: 0.0178) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5635, std.dev.: 0.0103) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4355, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 07:47:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 09:47:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926144712.273E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4268?compare_to=4264&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4268, Order: 164692, Start Time: 2012-09-26 13:29:33, End Time: 2012-09-26 14:48:45 To: 4264, Order: 164691, Start Time: 2012-09-26 11:41:27, End Time: 2012-09-26 13:00:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (154 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 951 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (54.7364 => 56.4905, std.dev.: 0.0995) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (15.4788 => 15.1469, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5790 => 0.5793, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 0.15% (16.1081 => 16.1316, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -0.19% (54.4905 => 54.3852, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -0.05% (4.3482 => 4.3460, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2403 => 1.2396, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.5316 => 7.5341, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.7298 => 0.7302, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0355 => 0.0357, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.01% (63.2438 => 54.3852, std.dev.: 0.0011) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.38% (14.1553 => 18.5966, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.68% (3.4629 => 5.4950, std.dev.: 0.0075) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14243.33% (0.0720 => 10.3272, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943300.00% (0.0001 => 9.9434, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.89% (0.2554 => 0.3777, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 46.10% (10.3673 => 15.1469, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/distray/distray: 31.06% (0.1056 => 0.1384, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 29.65% (0.1622 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.46% (2.2022 => 2.5426, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 14.87% (0.1432 => 0.1645, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.70% (7.0540 => 8.0909, std.dev.: 0.0186) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.74% (1.7609 => 1.9852, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3473 => 0.3870, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 11.34% (10.4361 => 11.6196, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3543 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.21% (0.3516 => 0.3910, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (9.4845 => 10.3376, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.81% (0.3177 => 0.3457, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.81% (0.4879 => 0.5309, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 8.75% (0.1440 => 0.1566) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.59% (0.3109 => 0.3376, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.5415 => 1.6700, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.18% (0.6675 => 0.7221, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 8.08% (0.7115 => 0.7690, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 8.01% (5.7591 => 6.2204, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.00% (0.4615 => 0.4984, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 7.82% (0.7433 => 0.8014, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.79% (1.3050 => 1.4066, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.75% (0.1625 => 0.1751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.71% (0.7326 => 0.7891, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.65% (0.3423 => 0.3685, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (8.1363 => 8.7587, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.60% (3.3354 => 3.5889, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.50% (4.2646 => 4.5843, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.49% (0.5860 => 0.6299, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.49% (0.2271 => 0.2441, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2700 => 0.2897, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.28% (0.7835 => 0.8405, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.27% (5.0018 => 5.3656, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.25% (0.9765 => 1.0473, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.23% (4.9449 => 5.3026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.19% (0.3422 => 0.3668, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.08% (0.3121 => 0.3342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.03% (0.8067 => 0.8634, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.02% (0.2107 => 0.2255, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.8172 => 0.8744, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.98% (7.9617 => 8.5175, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 6.97% (0.3387 => 0.3623, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.96% (0.2758 => 0.2950, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.95% (0.5105 => 0.5460, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.95% (0.5569 => 0.5956, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 6.77% (0.4299 => 0.4590, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 6.74% (1.5603 => 1.6655, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.69% (0.5020 => 0.5356, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3650 => 0.3894, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.60% (1.1642 => 1.2410, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.56% (0.4103 => 0.4372, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4636 => 0.4939, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4289 => 0.4568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3307 => 0.3522, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.50% (0.2831 => 0.3015, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.45% (0.2603 => 0.2771, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.44% (3.8723 => 4.1218, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3865 => 0.4114, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.43% (0.6456 => 0.6871, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3283 => 0.3493, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.39% (1.1861 => 1.2619, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.35% (0.4203 => 0.4470, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.32% (0.4048 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.31% (0.3441 => 0.3658, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.27% (0.3684 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 6.26% (1.0722 => 1.1393, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.22% (0.3826 => 0.4064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.15% (2.0665 => 2.1935, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.3232 => 0.3430, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4620 => 0.4902, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3603 => 0.3822, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.02% (0.2793 => 0.2961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.99% (2.0273 => 2.1488, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.91% (0.3180 => 0.3368, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.85% (0.8921 => 0.9443, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.84% (21.9371 => 23.2188, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.71% (0.6450 => 0.6818, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.56% (2.2969 => 2.4246, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.42% (0.5981 => 0.6305, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.38% (1.5859 => 1.6712, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.30% (0.2266 => 0.2386, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.4186 => 1.4892, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.92% (1.1840 => 1.2423, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.85% (2.2024 => 2.3092, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2842 => 1.3425, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.64% (0.8101 => 0.8396, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (14.3668 => 14.8624, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.08% (17.1811 => 17.7101, std.dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.77% (1.1194 => 1.1504, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.8922 => 3.9911, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.65% (0.2944 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.04% (3.1578 => 3.3800, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.50% (3.6395 => 3.7669, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3543, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2553, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8082, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5856, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.81% (5.2763 => 3.2814, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.83% (5.3855 => 3.6172, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.52% (5.3526 => 3.6118, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1485, std.dev.: 0.0512) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.49% (2.9384 => 2.6007, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -9.95% (22.1758 => 19.9695, std.dev.: 0.0268) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -9.35% (0.2161 => 0.1959, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2679, std.dev.: 0.1113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7115, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.19% (0.9957 => 0.9540, std.dev.: 0.0097) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1656, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -3.31% (1.2373 => 1.1964, std.dev.: 0.0158) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5078, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1705, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.17% (8.6802 => 8.4922, std.dev.: 0.0117) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0969, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0194, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5793, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2279, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.79% (0.5229 => 0.5793, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.62% (14.9895 => 16.1316, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.73% (4.1105 => 4.3460, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.20% (1.1048 => 1.2396, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.25% (7.1582 => 7.5341, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.36% (0.6222 => 0.7302, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 08:43:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 10:43:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926154348.12DC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4269?compare_to=4265&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4269, Order: 164696, Start Time: 2012-09-26 14:27:38, End Time: 2012-09-26 15:45:22 To: 4265, Order: 164692, Start Time: 2012-09-26 11:47:11, End Time: 2012-09-26 13:05:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (63 on baseline) Performance Improvements: 8 (43 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 883 (781 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 3.22% (0.7629 => 0.7875, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (13.4088 => 14.5487, std.dev.: 0.3076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.21% (1.3333 => 1.4028, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (2.6200 => 2.7470, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (42.4118 => 43.3734, std.dev.: 0.2074) SingleSource/Benchmarks/Misc/ReedSolomon: 1.54% (8.7189 => 8.8533, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.83% (0.7978 => 0.7752, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: -2.72% (4.0200 => 3.9108, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.67% (1.2183 => 1.1858, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.90% (4.1691 => 4.0898, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.46% (0.7044 => 0.6941, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -1.43% (1.0859 => 1.0704, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.35% (4.4154 => 4.3556, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.29% (0.8936 => 0.8821, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.02% (1.0148 => 1.0044, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.50% (0.5928 => 0.5839, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1641 => 0.1639, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.88% (0.1332 => 0.1267, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.00% (0.2996 => 0.2906, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.64% (0.2233 => 0.2174, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.24% (0.3040 => 0.2972, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2113 => 0.2113, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 18.05% (0.0205 => 0.0242, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: 3.53% (0.0085 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 162.50% (0.0032 => 0.0084, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.67% (0.0075 => 0.0073, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.79% (0.0190 => 0.0122, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0388 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0300 => 0.0297, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -29.47% (0.0285 => 0.0201, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 21.07% (0.0261 => 0.0316, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 26.06% (0.0142 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.52% (0.0191 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.62% (0.0249 => 0.0235, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -42.06% (0.0126 => 0.0073, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.61% (0.1426 => 0.1403, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 0.26% (0.2293 => 0.2299, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.41% (1.5146 => 1.4933, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.68% (0.1475 => 0.1485, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.25% (0.5920 => 0.5905, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.29% (26.6700 => 26.7478, std.dev.: 0.1037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.45% (0.4004 => 0.4062, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.14% (0.1393 => 0.1395, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.08% (0.0526 => 0.0579, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.11% (0.0193 => 0.0199, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.79% (0.0581 => 0.0603, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1269 => 1.1242, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -13.33% (0.0015 => 0.0013, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.31% (0.0548 => 0.0599, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.29% (0.0197 => 0.0159, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7658 => 0.7651, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7062 => 1.7063, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.57% (0.0081 => 0.0109, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2299, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -91.53% (6.9722 => 0.5905, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 21523.12% (0.1237 => 26.7478, std.dev.: 0.1037) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.41% (4.1772 => 3.1159, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/except: 82016.67% (0.0006 => 0.4927, std.dev.: 0.0021) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.68% (0.0745 => 0.0914, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.85% (2.1763 => 2.3688, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 8.66% (0.5309 => 0.5769, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.28% (0.6410 => 0.6941, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 6.71% (0.6173 => 0.6587, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.62% (1.1653 => 1.2425, std.dev.: 0.0259) MultiSource/Applications/lemon/lemon: 6.55% (1.0046 => 1.0704, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.07% (0.2552 => 0.2707, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.92% (0.3582 => 0.3794, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 5.46% (15.3105 => 16.1472, std.dev.: 0.0828) MultiSource/Applications/lambda-0_1_3/lambda: 5.32% (0.6915 => 0.7283, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.15% (1.5150 => 1.5930, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.01% (0.2797 => 0.2937, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.78% (1.4408 => 1.5097, std.dev.: 0.0165) MultiSource/Applications/d/make_dparser: 4.78% (3.0225 => 3.1670, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.69% (0.7639 => 0.7997, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.42% (0.6069 => 0.6337, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2654 => 0.2757, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.65% (0.4248 => 0.4403, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.42% (1.2021 => 1.2432, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 3.18% (1.3268 => 1.3690, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.12% (29.3170 => 30.2328, std.dev.: 0.2168) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (8.2186 => 8.4696, std.dev.: 0.0479) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (12.6413 => 13.0230, std.dev.: 0.1066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.94% (0.8569 => 0.8821, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.0821 => 1.1099, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.54% (6.2546 => 6.4133, std.dev.: 0.0350) MultiSource/Applications/lua/lua: 2.47% (3.5980 => 3.6868, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (4.2616 => 4.3556, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.20% (1.0689 => 1.0924, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.77% (0.7738 => 0.7875, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.50% (8.2559 => 8.3795, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (4.0318 => 4.0898, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (0.7722 => 0.7832, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (4.2815 => 4.3330, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.83% (0.0263 => 0.0373, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.00% (4.0101 => 4.5316, std.dev.: 0.0342) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.21% (0.0917 => 0.1029, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: 9.91% (0.5004 => 0.5500, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Puzzle: 9.84% (0.1433 => 0.1574, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.70% (1.0063 => 1.0938, std.dev.: 0.0220) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 8.32% (7.0025 => 7.5850, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.25% (0.8498 => 0.9114, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.15% (40.4792 => 43.3734, std.dev.: 0.2074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (0.3301 => 0.3532, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.72% (2.5984 => 2.7470, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8510, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/ReedSolomon: 4.02% (8.5113 => 8.8533, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.5587 => 0.5778, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8937, std.dev.: 0.0700) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.71% (0.5876 => 0.6035, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8097, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6328, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.20% (4.6127 => 4.7144, std.dev.: 0.0390) SingleSource/Benchmarks/Dhrystone/dry: 1.79% (2.4013 => 2.4444, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.69% (0.2996 => 0.1657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.65% (1.4189 => 1.0975, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.83% (1.4113 => 1.1314, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.32% (5.2665 => 4.1437, std.dev.: 0.3577) SingleSource/Benchmarks/Shootout-C++/ary3: -20.06% (1.7473 => 1.3968, std.dev.: 0.0577) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.20% (1.7361 => 1.4722, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -10.76% (0.3746 => 0.3343, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.88% (3.6023 => 3.2463, std.dev.: 0.0913) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.69% (1.1647 => 1.0518, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7463, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9407, std.dev.: 0.0285) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.10% (15.8312 => 14.5487, std.dev.: 0.3076) MultiSource/Applications/lambda-0_1_3/lambda: -7.03% (7.6833 => 7.1432, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3764, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8714, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3318, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3510, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/distray/distray: -5.44% (0.2664 => 0.2519, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1851, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: -5.08% (3.4230 => 3.2491, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -4.19% (62.4126 => 59.8001, std.dev.: 0.0819) MultiSource/Benchmarks/Olden/bh/bh: -3.74% (2.5166 => 2.4226, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/misr: -3.65% (0.4296 => 0.4139, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (9.2503 => 8.9361, std.dev.: 0.0494) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.99% (3.9413 => 3.8234, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.62% (3.7496 => 3.6514, std.dev.: 0.0211) MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (92.7467 => 90.6170, std.dev.: 0.5509) MultiSource/Benchmarks/FreeBench/neural/neural: -2.26% (1.0926 => 1.0679, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (9.3855 => 9.1739, std.dev.: 0.0504) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4235, std.dev.: 0.0200) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3678, std.dev.: 0.0148) MultiSource/Applications/lua/lua: -1.62% (29.5232 => 29.0442, std.dev.: 0.0736) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.41% (1.8739 => 1.8474, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3062, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4628, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.64% (0.9980 => 1.0044, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -3.04% (0.6022 => 0.5839, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -1.62% (0.1666 => 0.1639, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -18.47% (0.1554 => 0.1267, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (0.3083 => 0.2906, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.19% (0.2394 => 0.2174, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.39% (0.3175 => 0.2972, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.21% (0.2302 => 0.2113, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -46.10% (0.0449 => 0.0242, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -6.67% (0.0090 => 0.0084, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.58% (0.0240 => 0.0073, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.46% (0.0192 => 0.0122, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -29.23% (0.0284 => 0.0201, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0324 => 0.0316, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.62% (0.0249 => 0.0235, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -77.54% (0.0325 => 0.0073, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.82% (0.1429 => 0.1403, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -0.57% (1.5019 => 1.4933, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.07% (0.1501 => 0.1485, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.74% (0.4264 => 0.4062, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.79% (0.1344 => 0.1395, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.0589 => 0.0579, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0232 => 0.0199, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.63% (0.0639 => 0.0603, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.95% (1.1350 => 1.1242, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.0637 => 0.0599, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.37% (0.0246 => 0.0159, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 55.71% (0.0070 => 0.0109, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 09:22:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 11:22:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120926162225.DA3D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4270?compare_to=4266&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4270, Order: 164692, Start Time: 2012-09-26 13:40:00, End Time: 2012-09-26 16:23:59 To: 4266, Order: 164684, Start Time: 2012-09-26 10:27:00, End Time: 2012-09-26 13:11:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (762 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.85% (0.6102 => 0.6215, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (2.0993 => 2.1319, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 11.91% (0.3460 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3465 => 0.3875, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.81% (0.3488 => 0.3900, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3446 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3496 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.70% (0.3469 => 0.3875, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.37% (0.3650 => 0.4065, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 11.28% (0.3643 => 0.4054, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.14% (0.3724 => 0.4139, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.59% (0.5889 => 0.6454, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.54% (0.5826 => 0.6382, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.11% (1.5932 => 1.7384, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7171 => 0.7765, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.22% (0.2738 => 0.2963, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.82% (0.9909 => 1.0684, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.72% (0.2875 => 0.3097, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (1.3152 => 1.4142, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.44% (1.6211 => 1.7417, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (0.3195 => 0.3432, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 7.32% (0.3004 => 0.3224, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (3.5627 => 3.8235, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/methcall: 7.29% (0.2813 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.27% (0.2750 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.23% (0.2823 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.22% (0.2729 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2803 => 0.3005, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.20% (2.0673 => 2.2161, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.18% (0.4361 => 0.4674, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2792 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2780 => 0.2979, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3096 => 0.3312, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2811 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.3845 => 0.4111, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.1505 => 0.1609, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.88% (0.4029 => 0.4306, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.86% (5.5417 => 5.9218, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3267 => 0.3491, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.80% (0.2736 => 0.2922, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.3625 => 0.3871, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (0.4994 => 0.5332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3258 => 0.3478, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.70% (0.3282 => 0.3502, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3317 => 0.3539, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.63% (0.3362 => 0.3585, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.63% (0.3124 => 0.3331, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.61% (2.7292 => 2.9095, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3477 => 0.3706, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 6.57% (0.3348 => 0.3568, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.3678 => 0.3919, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3726 => 0.3970, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.44% (0.5000 => 0.5322, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 6.42% (1.0781 => 1.1473, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (0.3930 => 0.4182, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4146 => 0.4407, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 6.23% (4.2109 => 4.4731, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 6.21% (23.5202 => 24.9803, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3690 => 0.3918, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 6.12% (0.2566 => 0.2723, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (0.4251 => 0.4508, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (2.1013 => 2.2243, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.83% (0.3981 => 0.4213, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.5012 => 0.5302, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 5.74% (0.6634 => 0.7015, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.69% (0.2866 => 0.3029, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.63% (0.4139 => 0.4372, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (0.3903 => 0.4122, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.59% (4.6177 => 4.8759, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 5.51% (1.8794 => 1.9829, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (0.3890 => 0.4104, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.46% (0.2068 => 0.2181, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.46% (4.4195 => 4.6609, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.46% (2.1653 => 2.2835, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.3084 => 0.3252, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.42% (1.4269 => 1.5043, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.41% (0.6435 => 0.6783, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.37% (0.5546 => 0.5844, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.2737 => 0.2881, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.17% (0.9697 => 1.0198, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.15% (0.4658 => 0.4898, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.01% (1.9694 => 2.0680, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.2040 => 0.2140, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 4.89% (0.3336 => 0.3499, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.2103 => 0.2205, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.78% (0.2969 => 0.3111, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.72% (1.9966 => 2.0909, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 4.56% (0.7875 => 0.8234, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 4.26% (2.0346 => 2.1213, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (0.2691 => 0.2796, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 3.84% (0.4847 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (0.7426 => 0.7701, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (0.5361 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.36% (0.4253 => 0.4396, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.09% (0.3498 => 0.3606, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.08% (0.5584 => 0.5756, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.06% (11.6398 => 11.9957, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (4.6926 => 4.8283, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 1.94% (11.9555 => 12.1871, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6816, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.77% (15.4430 => 16.1800, std.dev.: 0.1287) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6378, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.40% (2.0820 => 2.1319, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1951, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5094, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4508, std.dev.: 0.0128) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2899, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5939, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5760, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: -9.62% (0.2402 => 0.2171, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7878, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std.dev.: 0.0141) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -2.80% (17.2379 => 16.7546, std.dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0439, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 09:35:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 11:35:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926163519.256302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4271?compare_to=4268&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4271, Order: 164698, Start Time: 2012-09-26 15:17:55, End Time: 2012-09-26 16:36:52 To: 4268, Order: 164692, Start Time: 2012-09-26 13:29:33, End Time: 2012-09-26 14:48:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (153 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 951 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.10% (0.4029 => 0.4557, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (15.1469 => 15.5055, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5793 => 0.5786, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -0.18% (16.1316 => 16.1023, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: -0.18% (54.3852 => 54.2880, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 0.03% (4.3460 => 4.3472, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2396 => 1.2391, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.51% (7.5341 => 7.4955, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.58% (0.7302 => 0.7260, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0357 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.16% (63.2438 => 54.2880, std.dev.: 0.0061) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.29% (14.1553 => 18.5847, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.06% (3.4629 => 5.4733, std.dev.: 0.0108) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14255.14% (0.0720 => 10.3357, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943000.00% (0.0001 => 9.9431, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.56% (10.3673 => 15.5055, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: 48.00% (0.2554 => 0.3780, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 29.72% (0.1622 => 0.2104, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.04% (2.2022 => 2.5555, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.17% (7.0540 => 8.1240, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.79% (0.1566 => 0.1782) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.57% (1.7609 => 1.9823, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.40% (10.4361 => 11.6259, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3473 => 0.3865, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.82% (0.1655 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.73% (0.4879 => 0.5305, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.68% (9.4845 => 10.3074, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.66% (0.3177 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.31% (0.6030 => 0.6531, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.23% (0.7433 => 0.8045, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.19% (1.5415 => 1.6678, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.07% (0.3109 => 0.3360, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.04% (0.6675 => 0.7212, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 8.00% (5.7591 => 6.2201, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.87% (0.4615 => 0.4978, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.83% (0.7115 => 0.7672, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.71% (1.3050 => 1.4056, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.67% (0.1695 => 0.1825, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.62% (0.3423 => 0.3684, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (8.1363 => 8.7559, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.56% (0.2700 => 0.2904, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.52% (3.3354 => 3.5863, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.49% (4.2646 => 4.5841, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.35% (0.5860 => 0.6291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.16% (0.9765 => 1.0464, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.14% (0.8067 => 0.8643, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.14% (4.9449 => 5.2979, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (5.0018 => 5.3587, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.09% (0.8172 => 0.8751, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.03% (0.2758 => 0.2952, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.02% (0.5569 => 0.5960, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.96% (0.7835 => 0.8380, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.93% (0.5105 => 0.5459, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3121 => 0.3337, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.73% (0.5020 => 0.5358, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 6.70% (0.3387 => 0.3614, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.65% (7.9617 => 8.4911, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 6.59% (1.1642 => 1.2409, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 6.55% (0.3422 => 0.3646, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.51% (0.4299 => 0.4579, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.47% (1.5603 => 1.6612, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.37% (1.1861 => 1.2617, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.37% (1.0722 => 1.1405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.3441 => 0.3660, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.35% (3.8723 => 4.1181, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.24% (0.4103 => 0.4359, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.20% (0.3307 => 0.3512, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.6456 => 0.6855, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.18% (21.9371 => 23.2921, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2603 => 0.2762, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.10% (0.4636 => 0.4919, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.04% (0.4289 => 0.4548, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.01% (0.3180 => 0.3371, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.97% (0.3650 => 0.3868, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.92% (2.0273 => 2.1474, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2891 => 0.3062, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.88% (0.3826 => 0.4051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.4203 => 0.4450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.87% (0.3865 => 0.4092, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.73% (0.4048 => 0.4280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2831 => 0.2993, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 5.72% (0.8921 => 0.9431, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (2.0665 => 2.1820, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.3098 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.55% (0.6450 => 0.6808, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 5.55% (2.2969 => 2.4243, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3162 => 0.3337, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.50% (0.2871 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2872 => 0.3030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5981 => 0.6310, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3603 => 0.3801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.48% (0.3684 => 0.3886, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2756 => 0.2907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.41% (0.4620 => 0.4870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.38% (0.3232 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.37% (0.3052 => 0.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.36% (0.3283 => 0.3459, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.26% (0.2793 => 0.2940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.25% (0.2802 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.18% (0.3379 => 0.3554, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2877 => 0.3026, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (1.5859 => 1.6675, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.95% (1.4186 => 1.4888, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.1840 => 1.2412, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.56% (2.2024 => 2.3029, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2842 => 1.3351, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.85% (0.3427 => 0.3559, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.8101 => 0.8393, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (14.3668 => 14.8812, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.91% (17.1811 => 17.6809, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.72% (1.1194 => 1.1499, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.8922 => 3.9810, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3816, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.70% (3.6395 => 3.7743, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3477, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2557, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8080, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.89% (5.2763 => 3.2771, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.53% (5.3855 => 3.6338, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.24% (5.3526 => 3.6268, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1453, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.43% (2.9384 => 2.6025, std.dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: -10.04% (22.1758 => 19.9504, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.30% (0.2161 => 0.1960, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2917, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: -5.22% (1.5835 => 1.5009, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5970, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.13% (0.9957 => 0.9546, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4939, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.80% (1.3677 => 1.3294, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -2.44% (12.4730 => 12.1686, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -2.27% (1.2373 => 1.2092, std.dev.: 0.0094) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.01% (8.6802 => 8.5055, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/salsa20: -2.00% (10.2830 => 10.0775, std.dev.: 0.0288) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9948, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4248, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.33% (4.6441 => 4.5824, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.65% (0.5229 => 0.5786, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 7.42% (14.9895 => 16.1023, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 5.76% (4.1105 => 4.3472, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.16% (1.1048 => 1.2391, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.71% (7.1582 => 7.4955, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.68% (0.6222 => 0.7260, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 10:19:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 12:19:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926171934.E24E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4272?compare_to=4269&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4272, Order: 164699, Start Time: 2012-09-26 16:01:09, End Time: 2012-09-26 17:21:08 To: 4269, Order: 164696, Start Time: 2012-09-26 14:27:38, End Time: 2012-09-26 15:45:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 13 (77 on baseline) Performance Improvements: 1 (44 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 883 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.53% (0.0377 => 0.0477, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.40% (1.0975 => 1.1348, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4543 => 0.4690, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5619 => 0.5778, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1858 => 1.2127, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (4.3668 => 4.4364, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (0.7997 => 0.8109, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.22% (30.2328 => 30.6012, std.dev.: 0.1192) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 2.71% (8.2457 => 8.4694, std.dev.: 0.0805) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.49% (2.6795 => 2.7463, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 1.79% (6.2401 => 6.3518, std.dev.: 0.0393) SingleSource/Benchmarks/Shootout/hash: 1.48% (4.2923 => 4.3559, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.40% (1.2671 => 1.2849, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.31% (0.7875 => 0.7693, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.22% (1.0044 => 1.0022, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 1.01% (0.5839 => 0.5898, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -0.55% (0.1639 => 0.1630, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.47% (0.1267 => 0.1311, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.51% (0.2906 => 0.2862, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.74% (0.2174 => 0.2158, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.31% (0.2972 => 0.2933, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.66% (0.2113 => 0.2099, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 10.33% (0.0242 => 0.0267, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -61.90% (0.0084 => 0.0032, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.37% (0.0073 => 0.0074, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.43% (0.0122 => 0.0164, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0389 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.02% (0.0297 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.44% (0.0201 => 0.0226, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.58% (0.0316 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0179 => 0.0178, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -42.71% (0.0192 => 0.0110, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 7.23% (0.0235 => 0.0252, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 58.90% (0.0073 => 0.0116, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.78% (0.1403 => 0.1428, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -0.22% (0.2299 => 0.2294, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.60% (1.4933 => 1.5172, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.89% (0.1485 => 0.1513, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.80% (0.5905 => 0.5952, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 0.37% (26.7478 => 26.8466, std.dev.: 0.1463) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.48% (0.4062 => 0.4122, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.51% (0.1395 => 0.1416, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.52% (0.0579 => 0.0576, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.54% (0.0199 => 0.0184, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.79% (0.0603 => 0.0656, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1242 => 1.1218, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -7.69% (0.0013 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.0599 => 0.0558, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.66% (0.0159 => 0.0150, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.7651 => 0.7672, std.dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7063 => 1.7064, std.dev.: 0.0152) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.87% (0.0109 => 0.0059, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2294, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -91.46% (6.9722 => 0.5952, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 21602.99% (0.1237 => 26.8466, std.dev.: 0.1463) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.84% (4.1772 => 3.0979, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 81933.33% (0.0006 => 0.4922, std.dev.: 0.0056) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.03% (0.0745 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6410 => 0.7013, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.32% (0.1159 => 0.1267, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.46% (0.5309 => 0.5758, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 8.22% (2.1763 => 2.3551, std.dev.: 0.0253) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 7.13% (1.1653 => 1.2484, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 7.05% (0.6173 => 0.6608, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 6.94% (1.0046 => 1.0743, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 6.21% (15.3105 => 16.2606, std.dev.: 0.1198) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.15% (0.7639 => 0.8109, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3901 => 0.4140, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.2797 => 0.2968, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.5150 => 1.6035, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.81% (0.3582 => 0.3790, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (0.6915 => 0.7307, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.41% (3.0225 => 3.1861, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.4248 => 0.4475, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.2552 => 0.2683, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.70% (0.3062 => 0.3206, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 4.38% (29.3170 => 30.6012, std.dev.: 0.1192) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.35% (0.6069 => 0.6333, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 4.34% (4.7455 => 4.9516, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.14% (1.2021 => 1.2519, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.11% (0.2654 => 0.2763, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.90% (1.1672 => 1.2127, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.90% (1.1827 => 1.2288, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.70% (1.3268 => 1.3759, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 3.67% (13.3238 => 13.8132, std.dev.: 0.0971) MultiSource/Benchmarks/mafft/pairlocalalign: 3.62% (8.2186 => 8.5161, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 3.53% (14.7256 => 15.2451, std.dev.: 0.1020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (12.6413 => 13.0842, std.dev.: 0.0964) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.49% (0.8569 => 0.8868, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 3.44% (2.0972 => 2.1694, std.dev.: 0.0256) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.0821 => 1.1191, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash: 3.41% (0.3520 => 0.3640, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.35% (6.2546 => 6.4640, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.89% (0.4880 => 0.5021, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.81% (3.5980 => 3.6991, std.dev.: 0.0265) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.73% (1.0689 => 1.0981, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.7722 => 0.7929, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 2.55% (1.8798 => 1.9278, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.52% (0.5636 => 0.5778, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.27% (4.3380 => 4.4364, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 2.22% (0.8405 => 0.8592, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.01% (4.2616 => 4.3473, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.2742 => 1.2951, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (8.2559 => 8.3591, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.26% (3.4629 => 4.2339, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.67% (0.0917 => 0.1079, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 15.86% (1.7426 => 2.0189, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5576, std.dev.: 0.0667) SingleSource/Benchmarks/Stanford/Puzzle: 12.42% (0.1433 => 0.1611, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 9.16% (7.0025 => 7.6440, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/mason/mason: 8.03% (0.5004 => 0.5406, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.44% (1.0063 => 1.0812, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.58% (40.4792 => 42.7393, std.dev.: 0.3398) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8470, std.dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (2.4042 => 2.4950, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.51% (0.5587 => 0.5783, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.25% (0.5876 => 0.6067, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.03% (2.6656 => 2.7463, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 2.86% (14.4877 => 14.9025, std.dev.: 0.0410) MultiSource/Applications/siod/siod: 2.72% (3.5520 => 3.6485, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8095, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 2.60% (8.5113 => 8.7329, std.dev.: 0.0623) MultiSource/Applications/minisat/minisat: 2.05% (6.2244 => 6.3518, std.dev.: 0.0393) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4455 => 2.4859, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.45% (4.6127 => 4.6797, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/hash: 1.26% (4.3016 => 4.3559, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/power/power: 1.13% (1.4184 => 1.4344, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.08% (27.1724 => 27.4664, std.dev.: 0.0353) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.79% (0.2996 => 0.1654, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.02% (1.4189 => 1.1348, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.65% (1.4113 => 1.1340, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.61% (0.3497 => 0.2042, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.10% (5.2665 => 4.2604, std.dev.: 0.0765) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.07% (1.7361 => 1.4744, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1635, std.dev.: 0.0303) MultiSource/Applications/sgefa/sgefa: -11.72% (0.3746 => 0.3307, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.57% (15.8312 => 14.0001, std.dev.: 0.3361) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.65% (1.1647 => 1.0523, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -9.61% (0.1114 => 0.1007, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.61% (3.2007 => 2.9251, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7476, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -6.91% (7.6833 => 7.1522, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3749, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.42% (2.0027 => 1.8742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -6.40% (4.6355 => 4.3387, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -6.24% (1.4441 => 1.3540, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7925, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -5.58% (3.4230 => 3.2319, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.15% (0.4564 => 0.4329, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.86% (0.4140 => 0.3939, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -4.82% (4.4195 => 4.2067, std.dev.: 0.0316) MultiSource/Benchmarks/mafft/pairlocalalign: -4.08% (62.4126 => 59.8666, std.dev.: 0.1532) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (2.5166 => 2.4258, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.41% (3.7496 => 3.6219, std.dev.: 0.0192) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.40% (1.2722 => 1.2290, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -3.37% (92.7467 => 89.6205, std.dev.: 0.9017) SingleSource/Benchmarks/McGill/misr: -3.21% (0.4296 => 0.4158, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -3.12% (9.2503 => 8.9616, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.09% (1.2959 => 1.2558, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8206, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.95% (1.1683 => 1.1455, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3619, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: -1.91% (3.8907 => 3.8165, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.81% (2.3569 => 2.3143, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2290, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/hash2: -1.66% (3.4876 => 3.4297, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.5374 => 4.4686, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (25.6658 => 25.3316, std.dev.: 0.0550) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.42% (0.9980 => 1.0022, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -2.06% (0.6022 => 0.5898, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -2.16% (0.1666 => 0.1630, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.64% (0.1554 => 0.1311, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (0.3083 => 0.2862, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.86% (0.2394 => 0.2158, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.62% (0.3175 => 0.2933, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.82% (0.2302 => 0.2099, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -40.53% (0.0449 => 0.0267, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -64.44% (0.0090 => 0.0032, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.17% (0.0240 => 0.0074, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.58% (0.0192 => 0.0164, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.42% (0.0284 => 0.0226, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -41.80% (0.0189 => 0.0110, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -64.31% (0.0325 => 0.0116, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.02% (1.5019 => 1.5172, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.80% (0.1501 => 0.1513, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.33% (0.4264 => 0.4122, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.36% (0.1344 => 0.1416, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.21% (0.0589 => 0.0576, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.69% (0.0232 => 0.0184, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.66% (0.0639 => 0.0656, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.16% (1.1350 => 1.1218, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.40% (0.0637 => 0.0558, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.02% (0.0246 => 0.0150, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.74% (0.7541 => 0.7672, std.dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7064, std.dev.: 0.0152) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.71% (0.0070 => 0.0059, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 10:57:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 12:57:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926175759.A02B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4273?compare_to=4267&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4273, Order: 164701, Start Time: 2012-09-26 16:44:56, End Time: 2012-09-26 17:59:28 To: 4267, Order: 164692, Start Time: 2012-09-26 13:12:38, End Time: 2012-09-26 14:27:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (174 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (692 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.6553 => 56.4804, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.73% (2.0176 => 2.4358, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.69% (0.2243 => 0.2550, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.58% (0.5818 => 0.6550, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938) SingleSource/UnitTests/ObjC++/Hello: 12.44% (0.5748 => 0.6463, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 12.02% (0.7061 => 0.7910, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 11.18% (0.4328 => 0.4812, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.15% (0.2781 => 0.3091, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.98% (1.3693 => 1.5196, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.83% (3.9660 => 4.3955, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.70% (0.3485 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.64% (0.7710 => 0.8530, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 10.64% (0.4062 => 0.4494, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.49% (0.2765 => 0.3055, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.43% (0.2655 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.33% (1.2193 => 1.3453, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.26% (0.3899 => 0.4299, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.23% (0.9199 => 1.0140, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.19% (1.4563 => 1.6047, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.19% (1.9828 => 2.1848, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4016 => 0.4424, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.01% (0.2696 => 0.2966, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.00% (0.7038 => 0.7742, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 9.97% (0.3149 => 0.3463, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.95% (0.5265 => 0.5789, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3489 => 0.3836, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.92% (0.2721 => 0.2991, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.90% (0.3756 => 0.4128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.77% (0.3868 => 0.4246, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.76% (0.3453 => 0.3790, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.75% (0.4390 => 0.4818, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.70% (0.6959 => 0.7634, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 9.62% (13.8202 => 15.1496, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3192 => 0.3499, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.50% (1.1364 => 1.2444, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.49% (0.3130 => 0.3427, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.45% (0.6283 => 0.6877, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5577 => 0.6090, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.79% (0.2127 => 0.2314, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.75% (0.4379 => 0.4762, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.62% (1.0313 => 1.1202, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.44% (7.2180 => 7.8271, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.25% (1.1061 => 1.1974, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.24% (0.2914 => 0.3154, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.23% (0.8310 => 0.8994, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 8.18% (16.6129 => 17.9716, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.15% (0.3755 => 0.4061, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.14% (0.7506 => 0.8117, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.14% (0.6576 => 0.7111, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.08% (0.8698 => 0.9401) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.06% (0.4791 => 0.5177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.02% (0.5637 => 0.6089, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3220 => 0.3472, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.76% (0.2023 => 0.2180, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.75% (0.7460 => 0.8038, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 7.71% (1.0594 => 1.1411, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.71% (0.6744 => 0.7264, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 7.68% (3.1889 => 3.4338, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591) MultiSource/Benchmarks/McCat/09-vor/vor: 7.59% (0.2925 => 0.3147, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.46% (3.6692 => 3.9431, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 7.45% (3.8646 => 4.1525, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 7.44% (1.9270 => 2.0704, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 7.32% (0.4113 => 0.4414, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.31% (2.1791 => 2.3383, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.3245 => 1.4195, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.09% (14.8535 => 15.9067, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 7.04% (1.2749 => 1.3646, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.00% (4.3801 => 4.6867, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 6.99% (0.3131 => 0.3350, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.95% (4.4433 => 4.7520, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 6.92% (8.4961 => 9.0841, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.82% (0.8818 => 0.9419, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.78% (0.6135 => 0.6551, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.69% (0.1569 => 0.1674, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.59% (0.2140 => 0.2281, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.49% (1.1333 => 1.2069, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 6.32% (4.6629 => 4.9578, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.6250 => 0.6642, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.27% (0.2504 => 0.2661, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.99% (3.2742 => 3.4703, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.79% (0.4805 => 0.5083, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.59% (6.5754 => 6.9432, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.50% (0.9108 => 0.9609, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.46% (4.9865 => 5.2589, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.30% (1.5188 => 1.5993, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (6.2785 => 6.5983, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.2008 => 0.2110, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.08% (13.2842 => 13.9587, std.dev.: 0.0186) MultiSource/Applications/lua/lua: 4.91% (3.7467 => 3.9308, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.78% (2.1007 => 2.2011, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.45% (16.2614 => 16.8229, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.25% (0.3511 => 0.3625, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9421, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std.dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.06% (1.2998 => 1.3786, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.59% (0.2093 => 0.2210, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7076, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0789, std.dev.: 0.0244) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5960, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.18% (8.8259 => 8.9300, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5915, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.53% (0.2670 => 0.1401, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.84% (0.0707 => 0.0595, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.01% (0.4657 => 0.3958, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.33% (1.3819 => 1.1839, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.28% (1.3813 => 1.1840, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.91% (22.5627 => 21.4543, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.22% (0.2238 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2675, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.74% (0.9996 => 0.9522, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.47% (3.2729 => 3.1592, std.dev.: 0.0194) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7089, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9545, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.25% (1.9762 => 1.9318, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2420, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.62% (26.5159 => 26.0867, std.dev.: 0.0337) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7906, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2218, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4359, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 11:23:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 13:23:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926182319.51AF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4274?compare_to=4271&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4274, Order: 164701, Start Time: 2012-09-26 17:05:45, End Time: 2012-09-26 18:24:50 To: 4271, Order: 164698, Start Time: 2012-09-26 15:17:55, End Time: 2012-09-26 16:36:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (155 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 952 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -9.79% (0.4557 => 0.4111, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5786 => 0.5781, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.12% (16.1023 => 16.1219, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 0.00% (54.2880 => 54.2892, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.3472 => 4.3395, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2391 => 1.2391, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.4955 => 7.4905, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.18% (0.7260 => 0.7273, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.84% (0.0359 => 0.0356, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.16% (63.2438 => 54.2892, std.dev.: 0.0092) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.19% (14.1553 => 18.5698, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.10% (3.4629 => 5.4750, std.dev.: 0.0033) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14243.89% (0.0720 => 10.3276, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943400.00% (0.0001 => 9.9435, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.50% (10.3673 => 15.4986, std.dev.: 0.0203) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.2554 => 0.3783, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 29.72% (0.1622 => 0.2104, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.08% (2.2022 => 2.5563, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.11% (7.0540 => 8.1199, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.60% (0.1566 => 0.1779, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.60% (1.7609 => 1.9828, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 11.41% (10.4361 => 11.6265, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.42% (0.3886 => 0.4291, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 8.69% (9.4845 => 10.3088, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.65% (0.4879 => 0.5301, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.59% (0.3177 => 0.3450, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.12% (1.5415 => 1.6666, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 8.07% (0.3109 => 0.3360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.00% (5.7591 => 6.2197, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 7.88% (0.7115 => 0.7676, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6675 => 0.7201, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.3423 => 0.3689, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.76% (0.7433 => 0.8010, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.75% (1.3050 => 1.4062, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.71% (0.4615 => 0.4971, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.56% (0.2700 => 0.2904, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.53% (3.3354 => 3.5865, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.49% (4.2646 => 4.5842, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/em3d/em3d: 7.49% (0.1695 => 0.1822, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.47% (8.1363 => 8.7443, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.40% (0.7326 => 0.7868, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.34% (0.5860 => 0.6290, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.18% (0.9765 => 1.0466, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.12% (5.0018 => 5.3580, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.12% (4.9449 => 5.2969, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.09% (0.5020 => 0.5376, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.00% (0.5569 => 0.5959, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.98% (0.2107 => 0.2254, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.97% (0.8067 => 0.8629, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 6.95% (0.1555 => 0.1663, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3121 => 0.3337, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.5105 => 0.5458, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.8172 => 0.8736, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.89% (0.2758 => 0.2948, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.85% (0.7835 => 0.8372, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 6.70% (0.3387 => 0.3614, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.63% (7.9617 => 8.4896, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.57% (1.1642 => 1.2407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.55% (0.3422 => 0.3646, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.4299 => 0.4578, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.48% (1.5603 => 1.6614, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1861 => 1.2629, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.45% (0.3441 => 0.3663, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2905 => 0.3092, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 6.36% (1.0722 => 1.1404, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.29% (0.4103 => 0.4361, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.22% (3.8723 => 4.1133, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 6.18% (21.9371 => 23.2931, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4636 => 0.4921, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2603 => 0.2763, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.6456 => 0.6851, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.08% (0.4048 => 0.4294, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 6.02% (0.4289 => 0.4547, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.98% (0.2891 => 0.3064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4203 => 0.4453, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.91% (2.0273 => 2.1472, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.87% (0.3865 => 0.4092, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.81% (0.3650 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.76% (0.8921 => 0.9435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.72% (0.3826 => 0.4045, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.66% (2.2969 => 2.4270, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3162 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3098 => 0.3273, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.63% (0.6450 => 0.6813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (2.0665 => 2.1823, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2872 => 0.3032, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2756 => 0.2909, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2871 => 0.3030, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 5.54% (0.3684 => 0.3888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.52% (0.3603 => 0.3802, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.51% (0.3283 => 0.3464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4620 => 0.4874, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.48% (0.3232 => 0.3409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.44% (0.3052 => 0.3218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.37% (0.2793 => 0.2943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2802 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.28% (0.5981 => 0.6297, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.25% (1.5859 => 1.6691, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 5.18% (0.3379 => 0.3554, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.00% (1.4186 => 1.4896, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.78% (1.1840 => 1.2406, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (2.2024 => 2.3057, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.97% (1.2842 => 1.3352, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.55% (14.3668 => 14.8772, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.52% (0.8101 => 0.8386, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.92% (17.1811 => 17.6829, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.90% (1.1194 => 1.1519, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (3.8922 => 3.9816, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.24% (3.1578 => 3.3864, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7750, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3472, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.75% (9.1159 => 9.2754, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8070, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5804, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.94% (5.2763 => 3.2747, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.54% (5.3855 => 3.6330, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.25% (5.3526 => 3.6264, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1590, std.dev.: 0.0492) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.41% (2.9384 => 2.6032, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.00% (22.1758 => 19.9592, std.dev.: 0.0333) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.12% (0.2161 => 0.1964, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3027, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7111, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (0.9957 => 0.9515, std.dev.: 0.0123) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1649, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5067, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1699, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -2.24% (1.2373 => 1.2096, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5081, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0028, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0922, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5783, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2329, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.56% (0.5229 => 0.5781, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 7.55% (14.9895 => 16.1219, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 5.57% (4.1105 => 4.3395, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.16% (1.1048 => 1.2391, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.64% (7.1582 => 7.4905, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.89% (0.6222 => 0.7273, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 11:52:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 13:52:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926185226.1F3DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4275?compare_to=4272&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4275, Order: 164706, Start Time: 2012-09-26 17:37:35, End Time: 2012-09-26 18:53:59 To: 4272, Order: 164699, Start Time: 2012-09-26 16:01:09, End Time: 2012-09-26 17:21:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (78 on baseline) Performance Improvements: 1 (45 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 886 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.68% (0.5917 => 0.6194, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: 3.02% (8.8681 => 9.1360, std.dev.: 0.0891) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.1893 => 3.2714, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8592 => 0.8809, std.dev.: 0.0077) MultiSource/Applications/Burg/burg: 1.91% (1.1635 => 1.1857, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.0981 => 1.1138, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.1340 => 1.1493, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (4.3488 => 4.4344, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.66% (2.3900 => 2.4297, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 1.40% (89.6205 => 90.8764, std.dev.: 0.2977) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -1.86% (0.6067 => 0.5954, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.97% (1.0022 => 1.0219, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 0.25% (0.5898 => 0.5913, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -1.35% (0.1630 => 0.1608, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.05% (0.1311 => 0.1271, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.24% (0.2862 => 0.3012, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.13% (0.2158 => 0.2204, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.07% (0.2933 => 0.2931, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.00% (0.2099 => 0.2078, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 5.62% (0.0267 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -27.59% (0.0087 => 0.0063, std.dev.: 0.0012) SingleSource/UnitTests/2003-08-11-VaListArg: -6.25% (0.0032 => 0.0030, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0074 => 0.0074, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.29% (0.0164 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0389 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.73% (0.0303 => 0.0222, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.11% (0.0226 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.25% (0.0321 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -19.66% (0.0178 => 0.0143, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 76.36% (0.0110 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0252 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 5.17% (0.0116 => 0.0122, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1428 => 0.1423, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -2.01% (0.2294 => 0.2248, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: -1.25% (1.5172 => 1.4982, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.10% (0.1513 => 0.1451, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.18% (0.5952 => 0.5941, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.88% (26.8466 => 26.6100, std.dev.: 0.2402) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.77% (0.4122 => 0.4049, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.55% (0.1416 => 0.1438, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.26% (0.0576 => 0.0563, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.83% (0.0184 => 0.0226, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0656 => 0.0617, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.68% (1.1218 => 1.1294, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.97% (0.0558 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.00% (0.0150 => 0.0144, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7672 => 0.7651, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.15% (1.7064 => 1.7038, std.dev.: 0.0073) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 105.08% (0.0059 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.67% (6.7458 => 0.2248, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -91.48% (6.9722 => 0.5941, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/09-vor/vor: 21411.72% (0.1237 => 26.6100, std.dev.: 0.2402) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.48% (4.1772 => 3.1129, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/except: 81783.33% (0.0006 => 0.4913, std.dev.: 0.0156) SingleSource/Regression/C++/EH/ctor_dtor_count: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.45% (2.1763 => 2.3820, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.23% (0.1159 => 0.1266, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.27% (0.6410 => 0.6940, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 8.06% (0.5309 => 0.5737, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.04% (0.3582 => 0.3834, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 6.95% (1.0046 => 1.0744, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 6.72% (0.6173 => 0.6588, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.44% (15.3105 => 16.2963, std.dev.: 0.2246) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.36% (3.0758 => 3.2714, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.24% (1.5150 => 1.6096, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (1.1653 => 1.2355, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.02% (0.3901 => 0.4136, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 5.77% (0.6915 => 0.7314, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 5.25% (0.3217 => 0.3386, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.2552 => 0.2680, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.90% (0.7639 => 0.8013, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 4.81% (0.8405 => 0.8809, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 4.77% (3.0225 => 3.1666, std.dev.: 0.0158) MultiSource/Applications/oggenc/oggenc: 4.69% (4.7455 => 4.9683, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.48% (0.6069 => 0.6341, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.33% (0.5937 => 0.6194, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.28% (0.3062 => 0.3193, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.26% (0.2654 => 0.2767, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (1.0689 => 1.1138, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 4.11% (29.3170 => 30.5225, std.dev.: 0.2570) MultiSource/Applications/SPASS/SPASS: 4.09% (13.3238 => 13.8692, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.05% (0.7226 => 0.7519, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.02% (1.2021 => 1.2504, std.dev.: 0.0158) MultiSource/Applications/hbd/hbd: 3.96% (1.3268 => 1.3793, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 3.94% (2.0972 => 2.1799, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (8.2186 => 8.5339, std.dev.: 0.0624) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (12.6413 => 13.1148, std.dev.: 0.1095) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2797 => 0.2899, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.65% (1.1440 => 1.1857, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.2771 => 0.2872, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 3.57% (0.3084 => 0.3194, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 3.46% (3.5980 => 3.7225, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 3.24% (14.7256 => 15.2022, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.1672 => 1.2044, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (6.2546 => 6.4464, std.dev.: 0.0434) MultiSource/Applications/treecc/treecc: 2.80% (1.8798 => 1.9325, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 2.33% (6.4908 => 6.6422, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.07% (0.4880 => 0.4981, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.06% (0.9425 => 0.9525, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 15.29% (1.7426 => 2.0091, std.dev.: 0.0494) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.98% (4.0101 => 4.5709, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/mst/mst: 12.63% (0.1417 => 0.1596, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.01% (3.0256 => 3.3286, std.dev.: 0.0584) SingleSource/Benchmarks/Stanford/Puzzle: 9.49% (0.1433 => 0.1569, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: 9.11% (0.5004 => 0.5460, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 8.94% (21.1721 => 23.0659, std.dev.: 0.5788) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6080, std.dev.: 0.0521) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.17% (1.0063 => 1.0885, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.26% (4.2129 => 4.4344, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.82% (40.4792 => 42.4295, std.dev.: 0.6444) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8290, std.dev.: 0.0624) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (2.4042 => 2.4963, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.96% (14.4877 => 14.9161, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.6308 => 0.6480, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8091, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/ReedSolomon: 2.56% (8.5113 => 8.7288, std.dev.: 0.0620) SingleSource/Benchmarks/Dhrystone/dry: 2.18% (2.4013 => 2.4537, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 2.07% (3.5520 => 3.6254, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (2.4455 => 2.4925, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.61% (4.6127 => 4.6871, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.31% (4.0659 => 4.1190, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/power/power: 1.10% (1.4184 => 1.4340, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.05% (27.1724 => 27.4590, std.dev.: 0.0567) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.01% (0.0591 => 0.0325, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.29% (0.2996 => 0.1669, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.38% (1.4189 => 1.1297, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.56% (1.4113 => 1.1493, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.87% (5.2665 => 4.1673, std.dev.: 0.0503) SingleSource/Benchmarks/Shootout-C++/ary3: -16.36% (1.7473 => 1.4614, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.09% (1.7361 => 1.4742, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std.dev.: 0.0310) MultiSource/Applications/sgefa/sgefa: -11.53% (0.3746 => 0.3314, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.71% (1.1647 => 1.0516, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.01% (1.4034 => 1.2770, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7507, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.53% (3.2007 => 2.9598, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.26% (0.1405 => 0.1303, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -7.01% (7.6833 => 7.1448, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3762, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3309, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/distray/distray: -6.12% (0.2664 => 0.2501, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -5.96% (1.4441 => 1.3580, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: -5.86% (3.4230 => 3.2225, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1851, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.4140 => 0.3945, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -4.19% (62.4126 => 59.8004, std.dev.: 0.0212) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.90% (1.2722 => 1.2226, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -3.88% (9.2503 => 8.8911, std.dev.: 0.0411) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (2.5166 => 2.4275, std.dev.: 0.0147) SingleSource/Benchmarks/McGill/misr: -3.21% (0.4296 => 0.4158, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.97% (3.9413 => 3.8244, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.83% (3.7496 => 3.6435, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.79% (1.4021 => 1.3630, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: -2.09% (3.4876 => 3.4146, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: -2.02% (92.7467 => 90.8764, std.dev.: 0.2977) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.01% (1.1683 => 1.1448, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3650, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -1.84% (3.8907 => 3.8190, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4639, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: -1.06% (16.5617 => 16.3854, std.dev.: 0.0642) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.39% (0.9980 => 1.0219, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: -1.81% (0.6022 => 0.5913, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -3.48% (0.1666 => 0.1608, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -18.21% (0.1554 => 0.1271, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.30% (0.3083 => 0.3012, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.94% (0.2394 => 0.2204, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.69% (0.3175 => 0.2931, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.73% (0.2302 => 0.2078, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -37.19% (0.0449 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -29.21% (0.0089 => 0.0063, std.dev.: 0.0012) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.17% (0.0240 => 0.0074, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.25% (0.0301 => 0.0222, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -19.21% (0.0177 => 0.0143, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -62.46% (0.0325 => 0.0122, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1429 => 0.1423, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.25% (1.5019 => 1.4982, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.33% (0.1501 => 0.1451, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.04% (0.4264 => 0.4049, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.41% (0.0589 => 0.0563, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.59% (0.0232 => 0.0226, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.44% (0.0639 => 0.0617, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1350 => 1.1294, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.68% (0.0637 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.46% (0.0246 => 0.0144, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 10.90% (1.5363 => 1.7038, std.dev.: 0.0073) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 13:11:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 15:11:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120926201117.2884A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4276?compare_to=4274&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4276, Order: 164712, Start Time: 2012-09-26 18:53:41, End Time: 2012-09-26 20:12:50 To: 4274, Order: 164701, Start Time: 2012-09-26 17:05:45, End Time: 2012-09-26 18:24:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 952 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.22% (3.7637 => 3.8473, std.dev.: 0.0252) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.28% (0.5781 => 0.5797, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.08% (16.1219 => 16.1349, std.dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: -0.05% (54.2892 => 54.2619, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 0.20% (4.3395 => 4.3481, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2391 => 1.2406, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (7.4905 => 7.5217, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.21% (0.7273 => 0.7288, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0356 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0653 => 0.0652, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.20% (63.2438 => 54.2619, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.45% (14.1553 => 18.6070, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.49% (3.4629 => 5.4884, std.dev.: 0.0032) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14247.36% (0.0720 => 10.3301, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9943400.00% (0.0001 => 9.9435, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.15% (10.3673 => 15.4633, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 47.22% (0.2554 => 0.3760, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 29.84% (0.1622 => 0.2106, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.90% (2.2022 => 2.5523, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.01% (7.0540 => 8.1127, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 14.66% (0.1432 => 0.1642, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.98% (0.1566 => 0.1785, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.54% (1.7609 => 1.9817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.86% (0.3473 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.38% (10.4361 => 11.6237, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.36% (0.1584 => 0.1764, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.09% (0.3282 => 0.3646, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.22% (0.5925 => 0.6471, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.6030 => 0.6583, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.01% (9.4845 => 10.3393, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.4879 => 0.5318, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.78% (0.3177 => 0.3456, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 8.54% (0.1440 => 0.1563, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.36% (1.5415 => 1.6704, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 8.19% (0.7115 => 0.7698, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 8.12% (0.7326 => 0.7921, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 8.06% (0.7433 => 0.8032, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 8.04% (0.3109 => 0.3359, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.00% (0.4615 => 0.4984, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.92% (1.3050 => 1.4084, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.6675 => 0.7202, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.88% (0.2271 => 0.2450, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3423 => 0.3691, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 7.82% (3.3354 => 3.5962, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1695 => 0.1827, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.75% (0.1625 => 0.1751, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.72% (5.7591 => 6.2037, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.69% (4.2646 => 4.5924, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (8.1363 => 8.7593, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.56% (0.2700 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.54% (0.8067 => 0.8675, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.47% (5.0018 => 5.3752, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.46% (0.5860 => 0.6297, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.33% (0.9765 => 1.0481, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5569 => 0.5974, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.24% (4.9449 => 5.3030, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.8172 => 0.8761, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 7.10% (0.7835 => 0.8391, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.00% (0.2758 => 0.2951, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.99% (7.9617 => 8.5186, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.5105 => 0.5461, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3121 => 0.3338, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 6.93% (1.5603 => 1.6684, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1940 => 0.2073, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 6.85% (0.3387 => 0.3619, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.79% (0.5020 => 0.5361, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 6.77% (1.1642 => 1.2430, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.57% (1.0722 => 1.1426, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.56% (3.8723 => 4.1264, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4636 => 0.4940, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.56% (0.4103 => 0.4372, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.1861 => 1.2637, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 6.51% (0.4299 => 0.4579, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4289 => 0.4568, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 6.50% (0.1555 => 0.1656, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.44% (0.3307 => 0.3520, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.3441 => 0.3661, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.38% (0.2603 => 0.2769, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.32% (0.6456 => 0.6864, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.30% (0.2905 => 0.3088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.30% (0.2891 => 0.3073, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.21% (0.3865 => 0.4105, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 6.21% (2.0273 => 2.1531, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.19% (0.4203 => 0.4463, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.14% (0.3650 => 0.3874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.10% (21.9371 => 23.2751, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/strcat: 6.08% (0.2831 => 0.3003, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 6.07% (0.3180 => 0.3373, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.04% (0.3826 => 0.4057, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.03% (0.4048 => 0.4292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (2.0665 => 2.1905, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 5.89% (0.2871 => 0.3040, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.88% (0.6450 => 0.6829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3684 => 0.3900, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.85% (0.8921 => 0.9443, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.85% (0.3162 => 0.3347, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2877 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.80% (0.3603 => 0.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.79% (0.3283 => 0.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4620 => 0.4887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.69% (2.2969 => 2.4276, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.45% (1.5859 => 1.6724, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.45% (0.5981 => 0.6307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3379 => 0.3563, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.10% (1.4186 => 1.4910, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.02% (2.2024 => 2.3130, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.02% (1.1840 => 1.2434, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 4.35% (1.2842 => 1.3401, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.4064 => 0.4239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.88% (0.3817 => 0.3965, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (14.3668 => 14.9097, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.8101 => 0.8391, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 3.12% (17.1811 => 17.7166, std.dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.93% (1.1194 => 1.1522, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.8922 => 3.9891, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.38% (3.6395 => 3.7624, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3406, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7781 => 3.8473, std.dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (0.9540 => 0.9683, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.44% (11.6436 => 11.8112, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2424, std.dev.: 0.0387) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5839, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.82% (5.2763 => 3.2808, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.52% (5.3855 => 3.6343, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.16% (5.3526 => 3.6311, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1291, std.dev.: 0.0448) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.26% (2.9384 => 2.6075, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -9.85% (22.1758 => 19.9912, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -9.07% (0.2161 => 0.1965, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2997, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.55% (3.2827 => 3.1663, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.50% (0.9957 => 0.9609, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1698, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9919, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: -1.96% (1.2373 => 1.2131, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5172, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5067, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -1.74% (10.2830 => 10.1040, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6840, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4198, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5795, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.86% (0.5229 => 0.5797, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.64% (14.9895 => 16.1349, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 5.78% (4.1105 => 4.3481, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.29% (1.1048 => 1.2406, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.08% (7.1582 => 7.5217, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.13% (0.6222 => 0.7288, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 13:22:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 15:22:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926202248.218A92A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4277?compare_to=4275&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4277, Order: 164714, Start Time: 2012-09-26 19:10:11, End Time: 2012-09-26 20:24:22 To: 4275, Order: 164706, Start Time: 2012-09-26 17:37:35, End Time: 2012-09-26 18:53:59 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (71 on baseline) Performance Improvements: 6 (48 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 885 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (6.4464 => 6.5749, std.dev.: 0.0275) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (13.1950 => 14.5567, std.dev.: 0.1472) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.52% (21.5139 => 22.4867, std.dev.: 0.1345) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (2.5902 => 2.6832, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.06% (0.5954 => 0.6136, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 2.54% (0.4913 => 0.5038, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.54% (0.5827 => 0.5679, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.28% (0.6194 => 0.6053, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: -1.13% (4.9683 => 4.9121, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -4.83% (0.9680 => 0.9212, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary3: -3.16% (1.4614 => 1.4152, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.49% (2.4963 => 2.4590, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.42% (1.0219 => 1.0262, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -0.96% (0.5913 => 0.5856, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 0.81% (0.1608 => 0.1621, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.47% (0.1271 => 0.1277, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.52% (0.3012 => 0.2936, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.2204 => 0.2099, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.40% (0.2931 => 0.2972, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.34% (0.2078 => 0.2071, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -0.71% (0.0282 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 38.10% (0.0063 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 106.67% (0.0030 => 0.0062, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.35% (0.0074 => 0.0073, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.11% (0.0194 => 0.0122, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0389 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 35.59% (0.0222 => 0.0301) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0325 => 0.0323, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 21.68% (0.0143 => 0.0174, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.55% (0.0194 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0251 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -40.16% (0.0122 => 0.0073, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1423 => 0.1423, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.73% (0.2248 => 0.2287, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -1.27% (1.4982 => 1.4791, std.dev.: 0.0175) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.28% (0.1451 => 0.1455, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.57% (0.5941 => 0.5848, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 0.02% (26.6100 => 26.6155, std.dev.: 0.1409) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4049 => 0.4083, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.26% (0.1438 => 0.1348, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.51% (0.0563 => 0.0532, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.72% (0.0226 => 0.0195, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.59% (0.0617 => 0.0601, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1294 => 1.1332, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.44% (0.0569 => 0.0617, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.25% (0.0144 => 0.0189, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7651 => 0.7649, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.11% (1.7038 => 1.7056, std.dev.: 0.0081) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0121 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2287, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -91.61% (6.9722 => 0.5848, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 21416.17% (0.1237 => 26.6155, std.dev.: 0.1409) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.29% (4.1772 => 3.0789, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/except: 83866.67% (0.0006 => 0.5038, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.98% (2.1763 => 2.4152, std.dev.: 0.0166) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.90% (0.1414 => 0.1554, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.67% (0.6410 => 0.6966, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.63% (0.1159 => 0.1259, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 8.14% (0.5309 => 0.5741, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 6.77% (0.6173 => 0.6591, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.41% (1.0046 => 1.0690, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (1.1653 => 1.2397, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.3582 => 0.3808, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.2106 => 0.2236, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.90% (1.5150 => 1.6044, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.64% (0.3901 => 0.4121, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 5.56% (15.3105 => 16.1620, std.dev.: 0.1131) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.24% (0.7639 => 0.8039, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.16% (0.8569 => 0.9011, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.12% (6.2546 => 6.5749, std.dev.: 0.0275) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.6915 => 0.7254, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.63% (0.2654 => 0.2777, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 4.63% (0.3217 => 0.3366, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 4.44% (3.0225 => 3.1566, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.1827 => 1.2349, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.29% (0.2797 => 0.2917, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 3.99% (29.3170 => 30.4871, std.dev.: 0.1966) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.85% (1.2021 => 1.2484, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 3.70% (0.3084 => 0.3198, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.0689 => 1.1079, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (0.4248 => 0.4402, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 3.60% (13.3238 => 13.8032, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (12.6413 => 13.0917, std.dev.: 0.1197) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (8.2186 => 8.5103, std.dev.: 0.0611) MultiSource/Applications/oggenc/oggenc: 3.51% (4.7455 => 4.9121, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.2616 => 4.4050, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 3.36% (3.5980 => 3.7188, std.dev.: 0.0207) MultiSource/Applications/siod/siod: 3.30% (2.0972 => 2.1664, std.dev.: 0.0151) MultiSource/Applications/hbd/hbd: 3.26% (1.3268 => 1.3700, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.0821 => 1.1171, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.05% (0.4562 => 0.4701, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.78% (1.1440 => 1.1758, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8405 => 0.8635, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 2.16% (14.7256 => 15.0439, std.dev.: 0.0762) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (4.3380 => 4.4188, std.dev.: 0.0259) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (6.4908 => 6.6059, std.dev.: 0.0244) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 53.64% (0.0261 => 0.0401, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 21.89% (3.4629 => 4.2211, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9975, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5543, std.dev.: 0.0240) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 9.93% (0.5004 => 0.5501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.82% (7.0025 => 7.6198, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/Puzzle: 8.65% (0.1433 => 0.1557, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.40% (0.8498 => 0.9212, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.06% (1.0063 => 1.0874, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.91% (0.3301 => 0.3529, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.56% (40.4792 => 42.7296, std.dev.: 0.6482) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.42% (0.5876 => 0.6136, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8483, std.dev.: 0.0497) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.38% (0.5587 => 0.5776, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.72% (14.4877 => 14.8818, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8089, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 2.63% (8.5113 => 8.7352, std.dev.: 0.0664) MultiSource/Applications/siod/siod: 2.61% (3.5520 => 3.6447, std.dev.: 0.0126) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.28% (2.4042 => 2.4590, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: 1.91% (2.4013 => 2.4472, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.87% (2.4455 => 2.4913, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.76% (4.6127 => 4.6937, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/em3d/em3d: 1.40% (4.6414 => 4.7065, std.dev.: 0.0209) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.46% (0.2996 => 0.1634, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.34% (1.4189 => 1.1303, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.66% (1.4113 => 1.1479, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.15% (0.3497 => 0.2058, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.38% (5.2665 => 4.1404, std.dev.: 0.1020) SingleSource/Benchmarks/Shootout-C++/ary3: -19.01% (1.7473 => 1.4152, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.21% (1.7361 => 1.4720, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std.dev.: 0.0255) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.21% (0.0917 => 0.0805, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: -11.32% (0.3746 => 0.3322, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0520, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7482, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9426, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.05% (15.8312 => 14.5567, std.dev.: 0.1472) MultiSource/Applications/lambda-0_1_3/lambda: -6.99% (7.6833 => 7.1462, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3761, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3339, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.95% (3.4230 => 3.2195, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1862, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: -4.84% (0.2664 => 0.2535, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.44% (0.4140 => 0.3956, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7942, std.dev.: 0.0596) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.16% (0.4564 => 0.4374, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.47% (2.5166 => 2.4292, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8206, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.05% (3.7496 => 3.6353, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/methcall: -3.04% (9.2503 => 8.9694, std.dev.: 0.0280) SingleSource/Benchmarks/McGill/misr: -2.72% (0.4296 => 0.4179, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.18% (1.1683 => 1.1428, std.dev.: 0.0023) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3651, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3133, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4876 => 3.4244, std.dev.: 0.0220) MultiSource/Applications/lua/lua: -1.70% (29.5232 => 29.0214, std.dev.: 0.1405) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.61% (92.7467 => 91.2503, std.dev.: 0.3171) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2360, std.dev.: 0.0256) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.36% (1.8739 => 1.8485, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4637, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -1.09% (2.8599 => 2.8287, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists: -1.05% (16.5617 => 16.3872, std.dev.: 0.0266) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.83% (0.9980 => 1.0262, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.76% (0.6022 => 0.5856, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -2.70% (0.1666 => 0.1621, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -17.82% (0.1554 => 0.1277, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.77% (0.3083 => 0.2936, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: -12.32% (0.2394 => 0.2099, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.39% (0.3175 => 0.2972, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.03% (0.2302 => 0.2071, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -31.11% (0.0090 => 0.0062, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.58% (0.0240 => 0.0073, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.46% (0.0192 => 0.0122, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -1.69% (0.0177 => 0.0174, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -77.54% (0.0325 => 0.0073, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1429 => 0.1423, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.52% (1.5019 => 1.4791, std.dev.: 0.0175) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.06% (0.1501 => 0.1455, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.24% (0.4264 => 0.4083, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.30% (0.1344 => 0.1348, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.68% (0.0589 => 0.0532, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.95% (0.0232 => 0.0195, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0639 => 0.0601, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1350 => 1.1332, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.14% (0.0637 => 0.0617, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.17% (0.0246 => 0.0189, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.02% (1.5363 => 1.7056, std.dev.: 0.0081) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 74.29% (0.0070 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 14:29:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 16:29:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926212937.6B41F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4278?compare_to=4273&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4278, Order: 164720, Start Time: 2012-09-26 20:16:40, End Time: 2012-09-26 21:31:09 To: 4273, Order: 164701, Start Time: 2012-09-26 16:44:56, End Time: 2012-09-26 17:59:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (174 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.80% (0.4024 => 0.4177, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.50% (0.9522 => 0.9665, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.2127 => 1.2255, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.23% (2.0176 => 2.4460, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.02% (0.1410 => 0.1650, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 13.78% (0.2243 => 0.2552, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 12.72% (0.5818 => 0.6558, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 12.54% (0.5748 => 0.6469, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 12.51% (0.7061 => 0.7944, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 11.35% (0.1013 => 0.1128, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.27% (0.1588 => 0.1767, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.08% (3.9660 => 4.4055, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.63% (0.1072 => 0.1186, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.63% (0.2596 => 0.2872, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.56% (1.2193 => 1.3480, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 10.55% (1.3693 => 1.5137, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.49% (1.4563 => 1.6091, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 10.44% (0.4328 => 0.4780, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.41% (0.9199 => 1.0157, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.25% (0.2721 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.19% (0.7710 => 0.8496, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.16% (0.5265 => 0.5800, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 10.12% (0.7038 => 0.7750, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.07% (0.6959 => 0.7660, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.95% (0.4062 => 0.4466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.92% (0.2782 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.78% (0.3130 => 0.3436, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 9.76% (13.8202 => 15.1684, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.73% (0.3485 => 0.3824, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.64% (1.1364 => 1.2460, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.62% (0.3899 => 0.4274, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.6283 => 0.6886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.46% (0.3022 => 0.3308, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.2966 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.34% (0.2655 => 0.2903, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2607 => 0.2850, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3293 => 0.3599, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.29% (0.4016 => 0.4389, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.29% (0.3489 => 0.3813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.27% (0.3580 => 0.3912, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.27% (0.3756 => 0.4104, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.26% (1.9828 => 2.1665, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2628 => 0.2870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2760 => 0.3014, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.13% (0.2726 => 0.2975, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.11% (0.5577 => 0.6085, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2127 => 0.2320, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.07% (0.4379 => 0.4776, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.06% (0.2937 => 0.3203, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.06% (1.0313 => 1.1247, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.04% (0.2765 => 0.3015, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732) SingleSource/Benchmarks/Shootout-C++/moments: 9.00% (0.3868 => 0.4216, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.95% (0.2995 => 0.3263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.3107 => 0.3385, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.90% (0.2696 => 0.2936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.89% (0.3623 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.89% (0.3534 => 0.3848, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.83% (0.3149 => 0.3427, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.81% (0.3246 => 0.3532, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.80% (0.2988 => 0.3251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.73% (0.3940 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 8.66% (0.3453 => 0.3752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.55% (0.3192 => 0.3465, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.53% (1.1061 => 1.2005, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.52% (0.4791 => 0.5199, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (7.2180 => 7.8323, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 8.51% (0.8310 => 0.9017, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.50% (0.4390 => 0.4763, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.44% (0.2914 => 0.3160, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.40% (16.6129 => 18.0092, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.39% (0.6576 => 0.7128, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 8.38% (0.7506 => 0.8135, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.37% (0.5637 => 0.6109, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 8.17% (0.3220 => 0.3483, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.01% (0.2023 => 0.2185, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.99% (0.7460 => 0.8056, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 7.98% (1.0594 => 1.1439, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 7.95% (0.2945 => 0.3179, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.87% (3.1889 => 3.4399, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.86% (0.8698 => 0.9382, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 7.80% (2.1791 => 2.3491, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 7.79% (1.9270 => 2.0771, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 7.77% (0.6744 => 0.7268, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.76% (0.2925 => 0.3152, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.72% (3.8646 => 4.1628, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 7.44% (0.3131 => 0.3364) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.39% (1.3245 => 1.4224, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.38% (0.3755 => 0.4032, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.35% (3.6692 => 3.9390, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 7.29% (1.2749 => 1.3679, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.27% (0.4113 => 0.4412, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (8.4961 => 9.1108, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 7.18% (14.8535 => 15.9198, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.07% (0.1569 => 0.1680, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.07% (4.3801 => 4.6896, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.04% (4.4433 => 4.7561, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.88% (0.6135 => 0.6557, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.85% (0.8818 => 0.9422, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.78% (0.2140 => 0.2285, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.65% (1.1333 => 1.2087, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.51% (0.2504 => 0.2667, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.44% (1.2292 => 1.3084, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.39% (4.6629 => 4.9607, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.09% (3.2742 => 3.4736, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.06% (0.4805 => 0.5096, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 5.98% (0.6250 => 0.6624, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (6.5754 => 6.9567, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.79% (4.9865 => 5.2753, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.57% (1.5188 => 1.6034, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.57% (0.9108 => 0.9615, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (13.2842 => 14.0055, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.37% (6.2785 => 6.6159, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.3245 => 0.3418, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.24% (3.7467 => 3.9431, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.13% (0.2008 => 0.2111, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.08% (2.1007 => 2.2075, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 3.68% (16.2614 => 16.8592, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 3.08% (14.5298 => 14.9773, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4170, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7052, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.10% (10.7476 => 11.0806, std.dev.: 0.0652) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5841, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5844, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9184, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.49% (0.2670 => 0.1402, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.52% (0.4657 => 0.3981, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.28% (1.3819 => 1.1845, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.23% (1.3813 => 1.1848, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.56% (22.5627 => 21.5339, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.17% (0.2238 => 0.1988, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2807, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.31% (0.9996 => 0.9665, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9518, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.23% (1.9762 => 1.9322, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.79% (26.5159 => 26.0409, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2482, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7918, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2262, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8721, std.dev.: 0.0165) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4350, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2625, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 14:59:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 16:59:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926215919.A9FDD2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4279?compare_to=4277&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4279, Order: 164720, Start Time: 2012-09-26 20:40:46, End Time: 2012-09-26 22:00:17 To: 4277, Order: 164714, Start Time: 2012-09-26 19:10:11, End Time: 2012-09-26 20:24:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 9 (72 on baseline) Performance Improvements: 1 (51 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 887 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.4139 => 1.4521, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.5741 => 0.5854, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 1.46% (16.1620 => 16.3987, std.dev.: 0.0531) MultiSource/Applications/ClamAV/clamscan: 1.39% (14.4877 => 14.6891, std.dev.: 0.0727) MultiSource/Benchmarks/Bullet/bullet: 1.20% (30.4871 => 30.8528, std.dev.: 0.1173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.34% (60.2991 => 61.7093, std.dev.: 0.0742) SingleSource/Benchmarks/Shootout/ary3: 2.17% (1.9975 => 2.0408, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.54% (1.5888 => 1.6132, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.39% (1.2402 => 1.2575, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -5.33% (0.7020 => 0.6646, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.12% (1.0262 => 1.0274, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.31% (0.5856 => 0.5933, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 3.21% (0.1621 => 0.1673, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.1277 => 0.1353, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.55% (0.2936 => 0.3011, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.38% (0.2099 => 0.2254, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.85% (0.2972 => 0.3027, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.79% (0.2071 => 0.2108, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 1.43% (0.0280 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -29.89% (0.0087 => 0.0061, std.dev.: 0.0015) SingleSource/UnitTests/2003-08-11-VaListArg: 45.16% (0.0062 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.11% (0.0073 => 0.0076, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 62.30% (0.0122 => 0.0198, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.66% (0.0387 => 0.0338, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.70% (0.0284 => 0.0211, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.24% (0.0323 => 0.0277, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 5.17% (0.0174 => 0.0183, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 3.14% (0.0191 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.02% (0.0248 => 0.0253, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: 71.23% (0.0073 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.13% (0.1423 => 0.1350, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: -2.49% (0.2287 => 0.2230, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 0.47% (1.4791 => 1.4861, std.dev.: 0.0284) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.47% (0.1455 => 0.1491, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.92% (0.5848 => 0.5902, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.48% (26.6155 => 26.7438, std.dev.: 0.1661) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.47% (0.4083 => 0.4102, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.45% (0.1348 => 0.1408, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.40% (0.0532 => 0.0582, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.72% (0.0195 => 0.0178, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0601 => 0.0601, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1332 => 1.1287, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.51% (0.0617 => 0.0583, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.64% (0.0189 => 0.0167, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7649 => 0.7652, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.04% (1.7056 => 1.7062, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.82% (0.0122 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.69% (6.7458 => 0.2230, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -91.53% (6.9722 => 0.5902, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/09-vor/vor: 21519.89% (0.1237 => 26.7438, std.dev.: 0.1661) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.98% (4.1772 => 3.0920, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/except: 82733.33% (0.0006 => 0.4970, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.83% (0.0745 => 0.0930, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 10.39% (2.1763 => 2.4025, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/bigfib: 10.27% (0.5309 => 0.5854, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.95% (0.6410 => 0.7048, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.75% (0.1159 => 0.1272, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.45% (0.3582 => 0.3849, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 7.32% (0.6173 => 0.6625, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 7.32% (1.0046 => 1.0781, std.dev.: 0.0142) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.13% (0.2552 => 0.2734, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 7.11% (15.3105 => 16.3987, std.dev.: 0.0531) MultiSource/Applications/SIBsim4/SIBsim4: 7.04% (1.1653 => 1.2473, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.96% (1.5150 => 1.6204, std.dev.: 0.0139) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.6915 => 0.7330, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.7639 => 0.8072, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.51% (0.2797 => 0.2951, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.4248 => 0.4472, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 5.24% (29.3170 => 30.8528, std.dev.: 0.1173) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.03% (0.3062 => 0.3216, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.2654 => 0.2783, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 4.84% (4.7455 => 4.9754, std.dev.: 0.0869) MultiSource/Applications/SPASS/SPASS: 4.43% (13.3238 => 13.9137, std.dev.: 0.1731) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.36% (6.2546 => 6.5275, std.dev.: 0.0579) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.1827 => 1.2342, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.30% (1.2021 => 1.2538, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.21% (1.3935 => 1.4521, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 4.05% (1.3268 => 1.3806, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (1.1672 => 1.2144, std.dev.: 0.0181) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (8.2186 => 8.5430, std.dev.: 0.0777) MultiSource/Applications/siod/siod: 3.94% (2.0972 => 2.1798, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.2771 => 0.2877, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 3.81% (14.7256 => 15.2866, std.dev.: 0.1629) MultiSource/Benchmarks/nbench/nbench: 3.75% (1.0821 => 1.1227, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.51% (0.4562 => 0.4722, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.0689 => 1.1062, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.3520 => 0.3639, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.3847 => 0.3976, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (12.6413 => 13.0579, std.dev.: 0.1471) MultiSource/Applications/lua/lua: 3.28% (3.5980 => 3.7160, std.dev.: 0.0146) MultiSource/Benchmarks/sim/sim: 3.24% (0.3084 => 0.3184, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.23% (0.5937 => 0.6129, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.05% (0.4880 => 0.5029, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (4.2616 => 4.3818, std.dev.: 0.0318) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.60% (0.5963 => 0.6118, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (8.2559 => 8.4271, std.dev.: 0.0626) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.48% (1.6538 => 2.3398, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2291, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 17.11% (1.7426 => 2.0408, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Puzzle: 14.38% (0.1433 => 0.1639, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.74% (4.0101 => 4.5610, std.dev.: 0.0212) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: 9.17% (0.5004 => 0.5463, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6164, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.44% (1.0063 => 1.0812, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.38% (4.2129 => 4.4816, std.dev.: 0.1030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.53% (40.4792 => 42.7195, std.dev.: 0.3001) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.39% (15.2242 => 15.8933, std.dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.03% (14.4877 => 14.9271, std.dev.: 0.0377) SingleSource/Benchmarks/Misc/ReedSolomon: 3.03% (8.5113 => 8.7688, std.dev.: 0.0627) SingleSource/Benchmarks/Shootout-C++/hash: 2.84% (0.6308 => 0.6487, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (6.6312 => 6.8107, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.25% (2.6656 => 2.7257, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (2.4013 => 2.4496, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (2.4455 => 2.4914, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.4184 => 1.4388, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.37% (4.0659 => 4.1214, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.00% (27.1724 => 27.4454, std.dev.: 0.0211) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.76% (0.2996 => 0.1655, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.38% (1.4189 => 1.1439, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.59% (1.4113 => 1.1490, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.22% (5.2665 => 4.1488, std.dev.: 0.0891) SingleSource/Benchmarks/Shootout-C++/ary3: -19.57% (1.7473 => 1.4054, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.15% (1.7361 => 1.4731, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.74% (0.0917 => 0.0791, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.42% (15.8312 => 13.8652, std.dev.: 0.5318) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1601, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.87% (3.6023 => 3.2108, std.dev.: 0.1165) MultiSource/Applications/sgefa/sgefa: -10.86% (0.3746 => 0.3339, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.66% (1.1647 => 1.0522, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -9.52% (0.1114 => 0.1008, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.49% (1.4034 => 1.2842, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -8.40% (9.5474 => 8.7456, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.49% (3.2007 => 2.9609, std.dev.: 0.0235) MultiSource/Applications/lambda-0_1_3/lambda: -6.94% (7.6833 => 7.1497, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.82% (3.6254 => 3.3781, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (4.6355 => 4.3349, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8734, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3533, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.80% (3.4230 => 3.2243, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout/fib2: -5.19% (4.4195 => 4.1900, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/distray/distray: -4.95% (0.2664 => 0.2532, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.40% (0.4140 => 0.3958, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -4.10% (62.4126 => 59.8511, std.dev.: 0.0543) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (2.5166 => 2.4231, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/misr: -3.54% (0.4296 => 0.4144, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.47% (1.2722 => 1.2281, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -3.06% (9.2503 => 8.9670, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8210, std.dev.: 0.0128) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.96% (1.2959 => 1.2575, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6471, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.03% (1.1683 => 1.1446, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.94% (1.8739 => 1.8376, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3118, std.dev.: 0.0063) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3672, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: -1.67% (3.8907 => 3.8258, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: -1.65% (1.0926 => 1.0746, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3145, std.dev.: 0.0191) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4650, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (92.7467 => 91.5662, std.dev.: 0.2494) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.23% (2.4457 => 2.4157, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.08% (9.3855 => 9.2839, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/lists: -1.05% (16.5617 => 16.3876, std.dev.: 0.0604) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.95% (0.9980 => 1.0274, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.48% (0.6022 => 0.5933, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 0.42% (0.1666 => 0.1673, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.93% (0.1554 => 0.1353, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.34% (0.3083 => 0.3011, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.85% (0.2394 => 0.2254, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.66% (0.3175 => 0.3027, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.43% (0.2302 => 0.2108, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -36.75% (0.0449 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -31.46% (0.0089 => 0.0061, std.dev.: 0.0015) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.13% (0.0192 => 0.0198, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.33% (0.0390 => 0.0338, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.70% (0.0284 => 0.0211, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.51% (0.0324 => 0.0277, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 4.23% (0.0189 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.53% (0.1429 => 0.1350, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -1.05% (1.5019 => 1.4861, std.dev.: 0.0284) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.67% (0.1501 => 0.1491, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.80% (0.4264 => 0.4102, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.76% (0.1344 => 0.1408, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.19% (0.0589 => 0.0582, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0639 => 0.0601, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.48% (0.0637 => 0.0583, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.11% (0.0246 => 0.0167, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.06% (1.5363 => 1.7062, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 15:53:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 17:53:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120926225305.497C22A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4280?compare_to=4270&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4280, Order: 164720, Start Time: 2012-09-26 20:10:22, End Time: 2012-09-26 22:54:35 To: 4270, Order: 164692, Start Time: 2012-09-26 13:40:00, End Time: 2012-09-26 16:23:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 14 (137 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 954 (756 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.78% (1.7384 => 1.7694, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.61% (2.9095 => 2.9564, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.38% (4.6609 => 4.7254, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (2.2243 => 2.2544, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: 1.28% (2.4673 => 2.4988, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 1.23% (4.8759 => 4.9358, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.21% (0.8234 => 0.8334, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.20% (2.1213 => 2.1468, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 1.16% (4.4731 => 4.5250, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.13% (1.1473 => 1.1603, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.13% (2.0909 => 2.1145, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.03% (4.8283 => 4.8781, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 1.02% (1.5043 => 1.5197, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.58% (54.0245 => 54.8799, std.dev.: 0.0475) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (2.1319 => 2.0830, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.88% (0.6215 => 0.6098, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.96% (0.3465 => 0.3914, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.95% (0.3460 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 12.87% (0.3442 => 0.3885, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1063 => 0.1181, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.06% (1.5932 => 1.7694, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.51% (0.5826 => 0.6380, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.22% (0.5889 => 0.6432, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 9.03% (0.1218 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 9.02% (0.1619 => 0.1765, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 8.40% (0.2750 => 0.2981, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.39% (1.3152 => 1.4256, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.34% (3.5627 => 3.8597, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.33% (1.6211 => 1.7561, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.32% (2.7292 => 2.9564, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7171 => 0.7755, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.08% (0.5000 => 0.5404, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.00% (0.2875 => 0.3105, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 7.80% (5.5417 => 5.9741, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.79% (0.4994 => 0.5383, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.75% (0.2014 => 0.2170, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.73% (0.3195 => 0.3442, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.62% (1.0781 => 1.1603, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 7.62% (0.2823 => 0.3038, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2813 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.53% (0.1421 => 0.1528, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.2780 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.46% (4.2109 => 4.5250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.2738 => 0.2942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.43% (0.3096 => 0.3326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.40% (0.2729 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.38% (0.3267 => 0.3508, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.32% (0.5026 => 0.5394, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 7.32% (0.9909 => 1.0634, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2792 => 0.2996, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.30% (0.3930 => 0.4217, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.30% (2.0673 => 2.2182, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 7.29% (2.1013 => 2.2544, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 7.28% (0.2803 => 0.3007, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.22% (0.3060 => 0.3281, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3258 => 0.3492, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2911 => 0.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.13% (0.2736 => 0.2931, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2811 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3726 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.11% (0.3362 => 0.3601, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3625 => 0.3881, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: 6.99% (0.3348 => 0.3582, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 6.97% (23.5202 => 25.1600, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.92% (4.4195 => 4.7254, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.91% (0.3124 => 0.3340, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.89% (4.6177 => 4.9358, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3678 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.84% (0.3317 => 0.3544, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.84% (0.1549 => 0.1655, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.82% (0.2566 => 0.2741, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 6.77% (2.1653 => 2.3118, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3477 => 0.3711, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.71% (0.1505 => 0.1606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.70% (0.3282 => 0.3502, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.70% (0.4029 => 0.4299, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.2866 => 0.3058, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (0.4251 => 0.4534, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 6.66% (0.4146 => 0.4422, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.61% (0.5900 => 0.6290, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 6.59% (0.6634 => 0.7071, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (0.3890 => 0.4146, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.53% (0.3690 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.51% (0.2075 => 0.2210, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 6.50% (1.4269 => 1.5197, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.48% (0.2068 => 0.2202, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 6.42% (1.8794 => 2.0000, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.38% (0.3981 => 0.4235, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.33% (0.4139 => 0.4401, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.32% (0.2040 => 0.2169, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.28% (0.3903 => 0.4148, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 6.11% (0.5546 => 0.5885, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.06% (0.3845 => 0.4078, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.05% (0.6435 => 0.6824, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.01% (0.4658 => 0.4938, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (1.9694 => 2.0870, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.5012 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.3084 => 0.3267, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.91% (1.9966 => 2.1145, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.85% (0.2737 => 0.2897, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 5.85% (0.3336 => 0.3531, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.83% (0.7875 => 0.8334, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.3271 => 0.3460, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.65% (0.9697 => 1.0245, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 5.51% (2.0346 => 2.1468, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.39% (0.2969 => 0.3129, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.39% (0.2691 => 0.2836, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.37% (0.2103 => 0.2216, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 5.32% (0.4847 => 0.5105, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.23% (0.2391 => 0.2516, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.87% (0.7426 => 0.7788, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.74% (0.5361 => 0.5615, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.26% (0.4253 => 0.4434, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.97% (11.6398 => 12.1018, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.95% (4.6926 => 4.8781, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.80% (0.3498 => 0.3631, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3792 => 0.3928, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.65% (11.9555 => 12.2726, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6600, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8906, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1653, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 4.09% (14.0481 => 14.6232, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1943, std.dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5052, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4571, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2916, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.26% (1.0927 => 1.1065, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5148, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5859, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4645, std.dev.: 0.0779) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5627, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary2: -10.82% (0.2402 => 0.2142, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7906, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -3.82% (11.2080 => 10.7799, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8291, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5779, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 16:12:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 18:12:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120926231255.8C6282A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4281?compare_to=4278&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4281, Order: 164722, Start Time: 2012-09-26 22:00:00, End Time: 2012-09-26 23:14:28 To: 4278, Order: 164720, Start Time: 2012-09-26 20:16:40, End Time: 2012-09-26 21:31:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (174 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (692 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.5351 => 56.5951, std.dev.: 0.0787) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.44% (0.9665 => 0.9526, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.27% (2.0176 => 2.4468, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.00% (0.2243 => 0.2557, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 12.75% (0.5818 => 0.6560, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 12.53% (0.5748 => 0.6468, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.19% (0.7061 => 0.7922, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.02% (3.9660 => 4.4030, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.91% (0.1072 => 0.1189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4328 => 0.4800, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.79% (0.0964 => 0.1068, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.73% (0.2721 => 0.3013, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.67% (0.2596 => 0.2873, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 10.56% (1.3693 => 1.5139, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.49% (0.9199 => 1.0164, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.48% (1.4563 => 1.6089, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.42% (1.2193 => 1.3464, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.32% (0.1327 => 0.1464, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.31% (0.5265 => 0.5808, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.31% (0.7710 => 0.8505, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.20% (0.7038 => 0.7756, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.04% (0.6959 => 0.7658, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.03% (0.3899 => 0.4290, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.98% (0.1062 => 0.1168, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 9.97% (0.4062 => 0.4467, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.90% (0.3130 => 0.3440, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.90% (0.3485 => 0.3830, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.86% (13.8202 => 15.1832, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.71% (0.6283 => 0.6893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.70% (0.3022 => 0.3315, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 9.63% (0.2690 => 0.2949, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 9.60% (0.3293 => 0.3609, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.58% (1.1364 => 1.2453, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.54% (0.3489 => 0.3822, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.50% (0.3756 => 0.4113, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.48% (1.9828 => 2.1707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.44% (0.3580 => 0.3918, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.44% (0.2966 => 0.3246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.44% (0.4016 => 0.4395, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.43% (0.2726 => 0.2983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2765 => 0.3025, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.29% (1.0313 => 1.1271, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.25% (0.1589 => 0.1736, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.25% (0.1157 => 0.1264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.5577 => 0.6084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.07% (0.3868 => 0.4219, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.04% (0.3107 => 0.3388, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 9.00% (1.1061 => 1.2056, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2127 => 0.2318, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.97% (0.3534 => 0.3851, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.97% (0.3601 => 0.3924, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 8.96% (0.3149 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.94% (0.2988 => 0.3255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.91% (0.4379 => 0.4769, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.90% (0.3192 => 0.3476, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.89% (0.3453 => 0.3760, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.86% (0.4390 => 0.4779, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.81% (0.2995 => 0.3259, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3914 => 0.4259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.79% (0.6576 => 0.7154, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.74% (0.3663 => 0.3983, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (7.2180 => 7.8320, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 8.49% (16.6129 => 18.0240, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.47% (0.4791 => 0.5197, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.43% (0.7506 => 0.8139, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 8.41% (0.8310 => 0.9009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.32% (0.5637 => 0.6106, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 8.26% (0.3220 => 0.3486, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 8.18% (3.1889 => 3.4496, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.05% (0.2945 => 0.3182, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 8.01% (0.6744 => 0.7284, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.00% (0.7460 => 0.8057, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.95% (1.0594 => 1.1436, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 7.94% (2.1791 => 2.3522, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/gs/gs: 7.93% (3.8646 => 4.1710, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.90% (0.8698 => 0.9385, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.90% (0.2925 => 0.3156, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.86% (1.9270 => 2.0785, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.83% (0.1865 => 0.2011, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.62% (0.3755 => 0.4041, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.59% (1.3245 => 1.4250, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.47% (0.3131 => 0.3365, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.47% (14.8535 => 15.9627, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 7.44% (1.2749 => 1.3698, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.37% (3.6692 => 3.9397, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.22% (0.4113 => 0.4410, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 7.21% (8.4961 => 9.1090, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.18% (4.3801 => 4.6948, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.10% (4.4433 => 4.7586, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.06% (0.6135 => 0.6568, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.06% (0.2140 => 0.2291, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.77% (0.8818 => 0.9415, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.73% (1.1333 => 1.2096, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.47% (0.2504 => 0.2666, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.4805 => 0.5114, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 6.41% (1.2292 => 1.3080, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.33% (4.6629 => 4.9581, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.26% (4.9865 => 5.2986, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.18% (3.2742 => 3.4764, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6250 => 0.6629, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 6.04% (6.5754 => 6.9727, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.63% (0.9108 => 0.9621, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2321 => 0.2451, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.58% (1.5188 => 1.6036, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0077, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 5.40% (3.7467 => 3.9490, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (6.2785 => 6.6148, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (2.1007 => 2.2119, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.10% (0.3511 => 0.3655, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 3.65% (16.2614 => 16.8551, std.dev.: 0.0303) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9854, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5085, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4123, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7062, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0796, std.dev.: 0.0210) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5947, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5851, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5989, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.30% (0.2670 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.60% (0.4657 => 0.3977, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.16% (1.3819 => 1.1862, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.07% (1.3813 => 1.1869, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.5627 => 21.5642, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.26% (0.2238 => 0.1986, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2602, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.56% (1.3780 => 1.3014, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0034) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9309, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2461, std.dev.: 0.0073) MultiSource/Applications/lua/lua: -1.66% (26.5159 => 26.0756, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7912, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -1.31% (1.2308 => 1.2147, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2384, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 16:41:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 18:41:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120926234158.90ACC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4282?compare_to=4279&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4282, Order: 164726, Start Time: 2012-09-26 22:29:20, End Time: 2012-09-26 23:43:33 To: 4279, Order: 164720, Start Time: 2012-09-26 20:40:46, End Time: 2012-09-26 22:00:17 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (76 on baseline) Performance Improvements: 10 (43 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 882 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.7260 => 0.7454, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 16.15% (3.0387 => 3.5295, std.dev.: 0.1168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (2.4339 => 2.5102, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.22% (1.8376 => 1.8601, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 1.03% (1.3925 => 1.4068, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.54% (0.7948 => 0.7667, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.42% (1.4521 => 1.4025, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -2.75% (0.5854 => 0.5693, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.81% (2.1173 => 2.0789, std.dev.: 0.0133) MultiSource/Benchmarks/PAQ8p/paq8p: -1.74% (2.4025 => 2.3608, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: -1.37% (16.3987 => 16.1740, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (1.2538 => 1.2386, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.02% (1.6204 => 1.6039, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.42% (61.7093 => 60.2140, std.dev.: 0.4654) MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (91.5662 => 90.6203, std.dev.: 0.2150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.47% (1.0274 => 1.0226, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -1.70% (0.5933 => 0.5832, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -1.67% (0.1673 => 0.1645, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.06% (0.1353 => 0.1271, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.62% (0.3011 => 0.2902, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.33% (0.2254 => 0.2179, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (0.3027 => 0.2996, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (0.2108 => 0.2075, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -25.00% (0.0284 => 0.0213, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: 44.26% (0.0061 => 0.0088, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -6.67% (0.0090 => 0.0084, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.63% (0.0076 => 0.0074, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.09% (0.0198 => 0.0180, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.91% (0.0338 => 0.0385, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.31% (0.0305 => 0.0301, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 34.12% (0.0211 => 0.0283, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.97% (0.0277 => 0.0324, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: -2.73% (0.0183 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -4.06% (0.0197 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -22.40% (0.0125 => 0.0097, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.70% (0.1350 => 0.1400, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.14% (0.2230 => 0.2300, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -0.09% (1.4861 => 1.4848, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1491 => 0.1484, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.03% (0.5902 => 0.5900, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.63% (26.7438 => 26.5747, std.dev.: 0.2451) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.10% (0.4102 => 0.4057, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.57% (0.1408 => 0.1400, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.78% (0.0582 => 0.0604, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.62% (0.0178 => 0.0188, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.50% (0.0601 => 0.0616, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1287 => 1.1208, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.66% (0.0583 => 0.0550, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.37% (0.0167 => 0.0143, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7652 => 0.7648, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.03% (1.7062 => 1.7057, std.dev.: 0.0082) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2300, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -91.54% (6.9722 => 0.5900, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: 21383.19% (0.1237 => 26.5747, std.dev.: 0.2451) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.62% (4.1772 => 3.1068, std.dev.: 0.0452) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.89% (0.1414 => 0.1568, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.88% (0.6410 => 0.6979, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 8.48% (2.1763 => 2.3608, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3582 => 0.3873, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.5309 => 0.5693, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 6.72% (0.6173 => 0.6588, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 6.61% (1.0046 => 1.0710, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 6.55% (1.1653 => 1.2416, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (1.5150 => 1.6039, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 5.64% (15.3105 => 16.1740, std.dev.: 0.0469) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.12% (0.6915 => 0.7269, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.7639 => 0.7986, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.49% (0.3901 => 0.4076, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 4.39% (3.0225 => 3.1553, std.dev.: 0.0300) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3217 => 0.3349, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.05% (0.6069 => 0.6315, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.00% (0.4248 => 0.4418, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.95% (1.1827 => 1.2294, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 3.77% (0.3026 => 0.3140, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.74% (13.3238 => 13.8218, std.dev.: 0.1513) MultiSource/Applications/hbd/hbd: 3.71% (1.3268 => 1.3760, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3062 => 0.3173, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.60% (4.7455 => 4.9163, std.dev.: 0.0600) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (1.1672 => 1.2092, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 3.41% (29.3170 => 30.3174, std.dev.: 0.2107) MultiSource/Applications/lua/lua: 3.33% (3.5980 => 3.7178, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.7226 => 0.7454, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (6.2546 => 6.4501, std.dev.: 0.0303) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (8.2186 => 8.4744, std.dev.: 0.0681) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.04% (1.2021 => 1.2386, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (12.6413 => 13.0082, std.dev.: 0.0890) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8405 => 0.8644, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.7256 => 15.1441, std.dev.: 0.1150) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.70% (0.8569 => 0.8800, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.0821 => 1.1106, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.37% (0.4562 => 0.4670, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.32% (0.5937 => 0.6075, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.0317 => 2.0789, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4880 => 0.4990, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.0689 => 1.0918, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.5963 => 0.6089, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.83% (4.2616 => 4.3398, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.79% (0.5636 => 0.5737, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.2742 => 1.2960, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (4.0318 => 4.0998, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (4.2815 => 4.3480, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.3380 => 4.4019, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 21.91% (3.4629 => 4.2217, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/ary3: 15.16% (1.7426 => 2.0068, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5548, std.dev.: 0.0194) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/heapsort: 9.75% (3.2159 => 3.5295, std.dev.: 0.1168) MultiSource/Benchmarks/FreeBench/mason/mason: 9.59% (0.5004 => 0.5484, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 8.72% (7.0025 => 7.6128, std.dev.: 0.0295) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 8.30% (0.1433 => 0.1552, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.20% (1.0063 => 1.0788, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (0.3301 => 0.3538, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.04% (0.8498 => 0.9096, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.23% (40.4792 => 43.0021, std.dev.: 0.0894) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (2.4042 => 2.5102, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8455, std.dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 3.70% (0.6459 => 0.6698, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.10% (3.5520 => 3.6621, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/ReedSolomon: 3.08% (8.5113 => 8.7738, std.dev.: 0.0429) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8973, std.dev.: 0.0414) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.67% (6.6312 => 6.8080, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4835, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.35% (0.0591 => 0.0323, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.13% (0.2996 => 0.1644, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.36% (1.4189 => 1.1158, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.58% (1.4113 => 1.1209, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.18% (0.3497 => 0.2092, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.46% (5.2665 => 4.1362, std.dev.: 0.1746) SingleSource/Benchmarks/Shootout-C++/ary3: -19.86% (1.7473 => 1.4003, std.dev.: 0.0606) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.68% (1.7361 => 1.4813, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std.dev.: 0.0250) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.89% (0.0917 => 0.0808, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0520, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -9.61% (0.1114 => 0.1007, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -8.41% (9.5474 => 8.7446, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.30% (3.2007 => 2.9352, std.dev.: 0.0270) MultiSource/Applications/lambda-0_1_3/lambda: -6.93% (7.6833 => 7.1505, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3747, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3332, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -6.16% (1.4441 => 1.3552, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -5.88% (3.4230 => 3.2217, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1861, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: -4.70% (2.5166 => 2.3983, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.37% (45.4683 => 43.4825, std.dev.: 0.2617) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7896, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout-C++/methcall: -3.82% (9.2503 => 8.8974, std.dev.: 0.0547) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.72% (0.4140 => 0.3986, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.28% (3.7496 => 3.6265, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8207, std.dev.: 0.0276) SingleSource/Benchmarks/McGill/misr: -2.84% (0.4296 => 0.4174, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.81% (1.2722 => 1.2365, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.30% (1.1683 => 1.1414, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.30% (2.3569 => 2.3028, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (92.7467 => 90.6203, std.dev.: 0.2150) MultiSource/Benchmarks/sim/sim: -2.00% (3.8907 => 3.8130, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.4876 => 3.4242, std.dev.: 0.0063) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3678, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2237, std.dev.: 0.0379) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3096, std.dev.: 0.0658) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.46% (0.9980 => 1.0226, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -3.16% (0.6022 => 0.5832, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -1.26% (0.1666 => 0.1645, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -18.21% (0.1554 => 0.1271, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.87% (0.3083 => 0.2902, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.98% (0.2394 => 0.2179, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.64% (0.3175 => 0.2996, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.86% (0.2302 => 0.2075, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -52.56% (0.0449 => 0.0213, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: -6.67% (0.0090 => 0.0084, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -69.17% (0.0240 => 0.0074, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.25% (0.0192 => 0.0180, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -70.15% (0.0325 => 0.0097, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.03% (0.1429 => 0.1400, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -1.14% (1.5019 => 1.4848, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.13% (0.1501 => 0.1484, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.17% (0.1344 => 0.1400, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.55% (0.0589 => 0.0604, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.97% (0.0232 => 0.0188, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.60% (0.0639 => 0.0616, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.25% (1.1350 => 1.1208, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.87% (0.0246 => 0.0143, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.03% (1.5363 => 1.7057, std.dev.: 0.0082) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 18:11:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 20:11:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927011102.009A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4283?compare_to=4282&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4283, Order: 164735, Start Time: 2012-09-27 00:01:44, End Time: 2012-09-27 01:12:36 To: 4282, Order: 164726, Start Time: 2012-09-26 22:29:20, End Time: 2012-09-26 23:43:33 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 4 (10 on baseline) Performance Regressions: 14 (75 on baseline) Performance Improvements: 7 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 876 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: 2849.26% (0.2300 => 6.7833, std.dev.: 0.0504) MultiSource/Benchmarks/Bullet/bullet: 1078.08% (0.5900 => 6.9507, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/09-vor/vor: -99.55% (26.5747 => 0.1184, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 220400.00% (0.0005 => 1.1025, std.dev.: 0.0028) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 86.69% (0.0323 => 0.0603, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 83.70% (0.1644 => 0.3020, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 28.99% (1.1209 => 1.4458, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.67% (1.1158 => 1.4357, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 3.46% (14.5750 => 15.0797, std.dev.: 0.0947) MultiSource/Benchmarks/Bullet/bullet: 1.93% (30.3174 => 30.9026, std.dev.: 0.0641) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 39.42% (0.1512 => 0.2108, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 16.86% (1.4813 => 1.7310, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 6.22% (8.7446 => 9.2883, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.14% (3.2059 => 3.3707, std.dev.: 0.0578) MultiSource/Benchmarks/sim/sim: 4.80% (3.8130 => 3.9959, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 1.93% (29.2348 => 29.7979, std.dev.: 0.0921) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (16.3503 => 16.5390, std.dev.: 0.0700) MultiSource/Benchmarks/llubenchmark/llu: 1.06% (2.0023 => 2.0236, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -13.14% (3.5295 => 3.0656, std.dev.: 0.1448) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.76% (1.0520 => 0.9598, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/mason/mason: -6.53% (0.5484 => 0.5126, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.61% (14.1158 => 13.3234, std.dev.: 0.0555) MultiSource/Benchmarks/Olden/bisort/bisort: -3.61% (0.6698 => 0.6456, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: -1.56% (0.6559 => 0.6457, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (59.7896 => 58.9890, std.dev.: 0.1131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.84% (1.0226 => 1.0140, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.05% (0.5832 => 0.5893, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -6.99% (0.1645 => 0.1530, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.91% (0.1271 => 0.1308, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.65% (0.2902 => 0.2921, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.69% (0.2179 => 0.2194, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.60% (0.2996 => 0.2978, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.30% (0.2075 => 0.2102, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 3.29% (0.0213 => 0.0220, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -21.59% (0.0088 => 0.0069, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: 7.14% (0.0084 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.35% (0.0074 => 0.0075, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.78% (0.0180 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.78% (0.0385 => 0.0388, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.31% (0.0301 => 0.0276, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0283 => 0.0282, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -21.35% (0.0178 => 0.0140, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -38.62% (0.0189 => 0.0116, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 26.80% (0.0097 => 0.0123, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.36% (0.1400 => 0.1447, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.10% (1.4848 => 1.5011, std.dev.: 0.0101) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.45% (0.1484 => 0.1418, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4057 => 0.4054, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.21% (0.1400 => 0.1341, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.31% (0.0604 => 0.0584, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.06% (0.0188 => 0.0190, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.84% (0.0616 => 0.0580, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.70% (1.1208 => 1.1287, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0550 => 0.0550, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.80% (0.0143 => 0.0147, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7648 => 0.7654, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -6.18% (1.7057 => 1.6003, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.19% (4.1772 => 3.0833, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/except: 82216.67% (0.0006 => 0.4939, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: -50.00% (0.0004 => 0.0002, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.68% (0.0745 => 0.0914, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.44% (0.6410 => 0.6951, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.13% (2.1763 => 2.3532, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/bigfib: 7.53% (0.5309 => 0.5709, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (1.1653 => 1.2456, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 6.76% (1.0046 => 1.0725, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 6.35% (0.6173 => 0.6565, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.14% (0.3582 => 0.3802, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 5.44% (15.3105 => 16.1430, std.dev.: 0.1036) MultiSource/Benchmarks/Bullet/bullet: 5.41% (29.3170 => 30.9026, std.dev.: 0.0641) MultiSource/Applications/lambda-0_1_3/lambda: 5.25% (0.6915 => 0.7278, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.21% (0.2552 => 0.2685, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 4.84% (3.0225 => 3.1688, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.7639 => 0.7986, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.51% (0.3217 => 0.3362, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.5150 => 1.5828, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (12.6413 => 13.1914, std.dev.: 0.0983) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.3901 => 0.4067, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.24% (0.4248 => 0.4428, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.00% (0.2797 => 0.2909, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.92% (13.3238 => 13.8460, std.dev.: 0.0777) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.84% (0.6069 => 0.6302, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.81% (0.2654 => 0.2755, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.60% (1.3268 => 1.3746, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 3.60% (4.7455 => 4.9162, std.dev.: 0.0217) MultiSource/Applications/siod/siod: 3.58% (2.0972 => 2.1722, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.53% (1.2021 => 1.2445, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (8.2186 => 8.4990, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.36% (3.0758 => 3.1791, std.dev.: 0.0218) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0821 => 1.1175, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (1.4408 => 1.4879, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 3.25% (3.5980 => 3.7150, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.6079 => 15.0797, std.dev.: 0.0947) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.1827 => 1.2205, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.01% (0.8569 => 0.8827, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 2.97% (6.4908 => 6.6835, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/football/football: 2.87% (0.8405 => 0.8646, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.7256 => 15.1471, std.dev.: 0.0864) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.85% (0.4880 => 0.5019, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.0317 => 2.0869, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.7226 => 0.7418, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (4.0318 => 4.1375, std.dev.: 0.0406) MultiSource/Applications/treecc/treecc: 2.55% (1.8798 => 1.9277, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (1.4113 => 1.4458, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.30% (1.0689 => 1.0935, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.60% (4.3380 => 4.4076, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 50.95% (0.0263 => 0.0397, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 48.76% (0.1417 => 0.2108, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0013, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5541, std.dev.: 0.0096) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6036, std.dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.56% (1.0063 => 1.0924, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.66% (40.4792 => 42.7695, std.dev.: 0.2194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.48% (0.3301 => 0.3482, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.97% (4.2129 => 4.4221, std.dev.: 0.0421) SingleSource/Benchmarks/Misc/fp-convert: 4.35% (15.2242 => 15.8858, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 3.05% (8.5113 => 8.7712, std.dev.: 0.0535) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8954, std.dev.: 0.0543) MultiSource/Applications/siod/siod: 2.80% (3.5520 => 3.6515, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (6.6312 => 6.8107, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.70% (2.6656 => 2.7377, std.dev.: 0.0137) MultiSource/Benchmarks/sim/sim: 2.70% (3.8907 => 3.9959, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/mason/mason: 2.44% (0.5004 => 0.5126, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.36% (0.6308 => 0.6457, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 1.39% (1.4184 => 1.4381, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.4455 => 2.4716, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (4.6414 => 4.6881, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.82% (5.2665 => 4.1175, std.dev.: 0.1735) SingleSource/Benchmarks/Shootout-C++/ary3: -20.28% (1.7473 => 1.3930, std.dev.: 0.0791) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.1647 => 0.9598, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.84% (15.8312 => 13.3234, std.dev.: 0.0555) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0403) MultiSource/Applications/sgefa/sgefa: -11.13% (0.3746 => 0.3329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9374, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.98% (3.6254 => 3.3722, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: -6.57% (0.2664 => 0.2489, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3336, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.43% (3.6023 => 3.3707, std.dev.: 0.0578) MultiSource/Applications/lambda-0_1_3/lambda: -6.41% (7.6833 => 7.1907, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/richards_benchmark: -6.30% (1.4441 => 1.3531, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -5.49% (62.4126 => 58.9890, std.dev.: 0.1131) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1881, std.dev.: 0.0269) MultiSource/Applications/SIBsim4/SIBsim4: -5.23% (3.4230 => 3.2441, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.67% (45.4683 => 43.3471, std.dev.: 0.4992) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.98% (2.5166 => 2.4165, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.82% (1.2722 => 1.2236, std.dev.: 0.0176) SingleSource/Benchmarks/McGill/misr: -3.35% (0.4296 => 0.4152, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8204, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -3.02% (9.2503 => 8.9714, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6466, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2883, std.dev.: 0.0131) MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (92.7467 => 90.5654, std.dev.: 0.5483) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.21% (1.1683 => 1.1425, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -1.91% (3.4876 => 3.4209, std.dev.: 0.0228) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3569 => 2.3135, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -1.60% (3.4286 => 3.3739, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3171, std.dev.: 0.0436) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.29% (9.3855 => 9.2645, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.60% (0.9980 => 1.0140, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -2.14% (0.6022 => 0.5893, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -8.16% (0.1666 => 0.1530, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.83% (0.1554 => 0.1308, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.25% (0.3083 => 0.2921, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.35% (0.2394 => 0.2194, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.20% (0.3175 => 0.2978, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.69% (0.2302 => 0.2102, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -51.00% (0.0449 => 0.0220, std.dev.: 0.0029) SingleSource/UnitTests/2003-05-07-VarArgs: -22.47% (0.0089 => 0.0069, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.31% (0.0301 => 0.0276, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -20.90% (0.0177 => 0.0140, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -38.62% (0.0189 => 0.0116, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -62.15% (0.0325 => 0.0123, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1429 => 0.1447, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -0.05% (1.5019 => 1.5011, std.dev.: 0.0101) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.53% (0.1501 => 0.1418, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.92% (0.4264 => 0.4054, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.22% (0.1344 => 0.1341, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.85% (0.0589 => 0.0584, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.10% (0.0232 => 0.0190, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.23% (0.0639 => 0.0580, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.24% (0.0246 => 0.0147, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.17% (1.5363 => 1.6003, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 18:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 20:26:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927012659.4B58A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4284?compare_to=4281&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4284, Order: 164735, Start Time: 2012-09-27 00:13:47, End Time: 2012-09-27 01:28:32 To: 4281, Order: 164722, Start Time: 2012-09-26 22:00:00, End Time: 2012-09-26 23:14:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 13 (177 on baseline) Performance Improvements: 4 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 953 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 82.66% (0.1407 => 0.2570, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 76.35% (0.0351 => 0.0619, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.16% (1.1862 => 1.4728, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.68% (1.1869 => 1.4679, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/mason/mason: 23.45% (0.0597 => 0.0737, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 5.44% (0.2886 => 0.3043, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.02% (33.4434 => 34.7884, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.9854 => 15.4116, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (21.5642 => 21.9397, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.58% (0.0860 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 9.87% (0.1986 => 0.2182, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.01% (0.9526 => 1.0003, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: 2.18% (1.3564 => 1.3860, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2557 => 0.2407, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.07% (1.6089 => 1.5917, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -8.69% (2.2790 => 2.0809, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: -4.97% (0.5613 => 0.5334, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.77% (2.0176 => 2.4367, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 11.19% (0.7061 => 0.7851, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.54% (3.9660 => 4.3839, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 10.49% (0.4328 => 0.4782, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 10.17% (1.3693 => 1.5085, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 10.00% (0.2781 => 0.3059, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.96% (1.2193 => 1.3408, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.94% (0.2596 => 0.2854, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 9.92% (0.7038 => 0.7736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.89% (0.2721 => 0.2990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.75% (0.4062 => 0.4458, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.71% (0.9199 => 1.0092, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.56% (0.6959 => 0.7624, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.50% (0.3022 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (0.7710 => 0.8442, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.41% (0.3899 => 0.4266, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.41% (0.2690 => 0.2943, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.40% (13.8202 => 15.1188, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.39% (0.3130 => 0.3424) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.36% (1.1364 => 1.2428, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.31% (0.6283 => 0.6868, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.30% (1.4563 => 1.5917, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 9.28% (0.2607 => 0.2849, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.25% (0.1589 => 0.1736, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.23% (0.2655 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4390 => 0.4795, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.21% (0.3485 => 0.3806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.19% (0.3580 => 0.3909, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 9.17% (0.2726 => 0.2976, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.12% (0.2995 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.05% (0.3293 => 0.3591, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.02% (0.2937 => 0.3202, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.02% (0.2760 => 0.3009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.02% (0.3149 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.02% (0.2628 => 0.2865, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.98% (0.2761 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.96% (1.9828 => 2.1605, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.95% (0.3756 => 0.4092, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.94% (0.3489 => 0.3801, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.93% (0.2765 => 0.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.88% (0.3107 => 0.3383, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.87% (0.2966 => 0.3229, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.84% (0.4016 => 0.4371, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.83% (0.4791 => 0.5214, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 8.77% (0.2988 => 0.3250, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 8.74% (1.0313 => 1.1214, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.63% (0.3868 => 0.4202, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.57% (0.5577 => 0.6055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.55% (0.3192 => 0.3465, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.47% (0.4379 => 0.4750, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.43% (0.3453 => 0.3744, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.35% (0.3246 => 0.3517, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 8.30% (0.8310 => 0.9000, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.18% (3.6692 => 3.9695, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 8.18% (0.3534 => 0.3823, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (7.2180 => 7.7984, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.00% (0.5637 => 0.6088, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.96% (1.1061 => 1.1941, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.95% (0.7506 => 0.8103, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 7.92% (3.8646 => 4.1706, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 7.84% (0.2945 => 0.3176, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.70% (0.3220 => 0.3468, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.64% (16.6129 => 17.8821, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 7.64% (0.6744 => 0.7259, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.61% (0.2023 => 0.2177, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.54% (1.0594 => 1.1393, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.45% (0.7460 => 0.8016, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.40% (3.1889 => 3.4249, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.39% (0.6576 => 0.7062, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.38% (0.8698 => 0.9340, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3755 => 0.4030, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.29% (2.1791 => 2.3380, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.22% (1.3245 => 1.4201, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.13% (1.9270 => 2.0644, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.12% (0.3650 => 0.3910, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.05% (8.4961 => 9.0948, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.01% (14.8535 => 15.8942, std.dev.: 0.0244) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.96% (0.8818 => 0.9432, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 6.95% (0.3940 => 0.4214, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.92% (1.2749 => 1.3631, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.86% (4.3801 => 4.6805, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.81% (4.4433 => 4.7460, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.58% (1.3819 => 1.4728, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 6.55% (0.3131 => 0.3336, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3245 => 0.3457, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.1333 => 1.2070, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.49% (0.6135 => 0.6533, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 6.44% (0.2859 => 0.3043, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.28% (1.2292 => 1.3064, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (13.2842 => 14.1182, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.27% (1.3813 => 1.4679, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.20% (3.2742 => 3.4772, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.17% (6.5754 => 6.9810, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 6.12% (4.6629 => 4.9483, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 6.07% (14.5298 => 15.4116, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.97% (0.9108 => 0.9652, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.4805 => 0.5091, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.54% (0.6250 => 0.6596, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.45% (1.5188 => 1.6016, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.40% (4.9865 => 5.2560, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/oourafft: 5.38% (0.2008 => 0.2116, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.90% (2.1007 => 2.2036, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.82% (6.2785 => 6.5814, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 4.80% (3.7467 => 3.9267, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 4.49% (33.2944 => 34.7884, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.39% (0.3511 => 0.3665, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7562, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std.dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4116, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3790, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7256, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1077, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.00% (7.4271 => 7.5757, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5829, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1884, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2230, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3232, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9174, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.76% (22.5627 => 21.9397, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3041, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.07% (1.3780 => 1.2943, std.dev.: 0.0158) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9220, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: -2.72% (3.0263 => 2.9439, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2516, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2264, std.dev.: 0.0138) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2119, std.dev.: 0.0184) MultiSource/Benchmarks/Bullet/bullet: -1.11% (7.3305 => 7.2489, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2624, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 18:38:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 20:38:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927013807.A87102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4285?compare_to=4276&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4285, Order: 164735, Start Time: 2012-09-27 00:19:42, End Time: 2012-09-27 01:39:40 To: 4276, Order: 164712, Start Time: 2012-09-26 18:53:41, End Time: 2012-09-26 20:12:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 3 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 14 (150 on baseline) Performance Improvements: 5 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (18 on baseline) Unchanged Tests: 931 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: -19.68% (18.6070 => 14.9445, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: -32.28% (5.4884 => 3.7168, std.dev.: 0.0029) New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (9.9435 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 22.65% (0.0702 => 0.0861, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.66% (1.1522 => 1.2635, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.21% (3.6311 => 3.9291, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.09% (3.6343 => 3.9284, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 5.67% (0.3122 => 0.3299, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.57% (0.3962 => 0.4143, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.80% (19.9912 => 20.3514, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (14.9097 => 15.1380, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.72% (0.0859 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: 11.70% (0.1965 => 0.2195, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5226 => 56.5375, std.dev.: 0.2104) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.69% (0.9609 => 0.9964, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 2.19% (1.3564 => 1.3861, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 1.05% (3.6956 => 3.7345, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -26.97% (0.3760 => 0.2746, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -17.56% (0.1378 => 0.1136, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.36% (15.4633 => 14.6346, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -1.65% (11.6237 => 11.4317, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -4.95% (0.5611 => 0.5333, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.38% (0.5797 => 0.5775, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.06% (16.1349 => 16.1254, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 53.46% (54.2619 => 83.2683, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 0.40% (4.3481 => 4.3653, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2406 => 1.2393, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.5217 => 7.5241, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.24% (0.7288 => 0.6469, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.72% (0.0355 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (0.0652 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.66% (63.2438 => 83.2683, std.dev.: 0.0091) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14250.56% (0.0720 => 10.3324, std.dev.: 0.0070) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.16% (10.3673 => 14.6346, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 28.91% (0.1622 => 0.2091, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.29% (2.2022 => 2.5389, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.07% (7.0540 => 8.1171, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: 14.46% (0.1432 => 0.1639, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.87% (1.1194 => 1.2635, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.47% (1.7609 => 1.9804, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.86% (0.3473 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.12% (0.3886 => 0.4318, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.54% (0.1584 => 0.1751, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 10.48% (0.3282 => 0.3626, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.54% (10.4361 => 11.4317, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/power/power: 8.89% (0.1440 => 0.1568, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 8.84% (9.4845 => 10.3227, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.52% (0.2700 => 0.2930, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.38% (0.3307 => 0.3584, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.4879 => 0.5286, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.6030 => 0.6523, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.17% (0.3109 => 0.3363, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.15% (0.3177 => 0.3436, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.93% (0.7115 => 0.7679, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 7.84% (0.7433 => 0.8016, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.80% (0.4615 => 0.4975, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.79% (0.2271 => 0.2448, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.67% (0.1695 => 0.1825, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.66% (1.5415 => 1.6596, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6675 => 0.7185, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (8.1363 => 8.7561, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 7.54% (0.3423 => 0.3681, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.52% (0.2554 => 0.2746, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.46% (1.3050 => 1.4023, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.45% (3.3354 => 3.5839, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.40% (0.5105 => 0.5483, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.37% (0.5860 => 0.6292, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 7.37% (5.7591 => 6.1833, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (4.2646 => 4.5773, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference: 7.33% (0.7326 => 0.7863, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2107 => 0.2258, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.11% (4.9449 => 5.2965, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.8172 => 0.8748, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.04% (5.0018 => 5.3539, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.02% (0.5569 => 0.5960, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.88% (0.8067 => 0.8622, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 6.83% (0.7835 => 0.8370, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.82% (0.3121 => 0.3334, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.75% (0.1940 => 0.2071, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2758 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.73% (0.9765 => 1.0422, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.69% (0.3092 => 0.3299, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.65% (7.9617 => 8.4915, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.61% (1.1861 => 1.2645, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.58% (1.0722 => 1.1427, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.55% (1.1642 => 1.2405, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.53% (0.5020 => 0.5348, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 6.52% (0.3387 => 0.3608, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.4103 => 0.4366, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.3441 => 0.3661, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.29% (3.8723 => 4.1157, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 6.25% (0.3422 => 0.3636, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.23% (0.4299 => 0.4567, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.14% (21.9371 => 23.2836, std.dev.: 0.0244) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2603 => 0.2762, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.09% (1.5603 => 1.6554, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4636 => 0.4916, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.6456 => 0.6845, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.6450 => 0.6830, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 5.83% (2.0273 => 2.1454, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (0.4064 => 0.4300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.71% (0.2891 => 0.3056, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8921 => 0.9428, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.3650 => 0.3856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.64% (0.4203 => 0.4440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.60% (0.4289 => 0.4529, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.56% (0.3865 => 0.4080, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.55% (0.3098 => 0.3270, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 5.46% (2.2969 => 2.4224, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4620 => 0.4872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.44% (0.2831 => 0.2985, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.44% (0.3826 => 0.4034, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.43% (0.5981 => 0.6306, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.41% (0.2756 => 0.2905, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.37% (0.2905 => 0.3061, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (14.3668 => 15.1380, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.3136 => 0.3304, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3935 => 0.4143, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.27% (0.3684 => 0.3878, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 5.21% (0.4048 => 0.4259, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.20% (1.5859 => 1.6683, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary2: 5.15% (0.3379 => 0.3553, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.15% (0.3283 => 0.3452, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.14% (2.0665 => 2.1728, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.3232 => 0.3398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.09% (0.3162 => 0.3323, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 5.09% (0.2871 => 0.3017, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.08% (2.2024 => 2.3142, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.05% (0.3603 => 0.3785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (1.4186 => 1.4902, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.3052 => 0.3205, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.97% (0.2877 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.2802 => 0.2939, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.84% (1.1840 => 1.2413, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3817 => 0.3977, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.71% (1.2842 => 1.3319, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.3427 => 0.3549, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.54% (0.8101 => 0.8388, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.62% (17.1811 => 17.6312, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (3.8922 => 3.9790, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8965, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3821, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3499, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2518, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7992, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5806, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2642, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.06% (5.3855 => 3.9284, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.59% (5.3526 => 3.9291, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1842, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.13% (2.9384 => 2.6113, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.23% (22.1758 => 20.3514, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3088, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4794) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7115, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1643, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4927, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: -2.84% (1.2373 => 1.2022, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.94% (8.6802 => 8.5122, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0094, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2521, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1020, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8549, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.44% (0.5229 => 0.5775, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.58% (14.9895 => 16.1254, std.dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 5.58% (14.1553 => 14.9445, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 6.20% (4.1105 => 4.3653, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.17% (1.1048 => 1.2393, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.11% (7.1582 => 7.5241, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.33% (3.4629 => 3.7168, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.97% (0.6222 => 0.6469, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 19:38:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 21:38:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927023843.C998C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4286?compare_to=4283&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4286, Order: 164740, Start Time: 2012-09-27 01:28:30, End Time: 2012-09-27 02:40:18 To: 4283, Order: 164735, Start Time: 2012-09-27 00:01:44, End Time: 2012-09-27 01:12:36 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 13 (88 on baseline) Performance Improvements: 1 (35 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.51% (0.7582 => 0.8000, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (1.3892 => 1.4299, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.48% (15.1471 => 15.3720, std.dev.: 0.0333) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.0935 => 1.1091, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.31% (13.8460 => 14.0270, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.5828 => 1.6005, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.05% (1.9277 => 1.9479, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2456 => 1.2583, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 13.89% (0.0720 => 0.0820, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 4.09% (8.1011 => 8.4323, std.dev.: 0.0466) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.31% (1.3587 => 1.4037, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.68% (59.4198 => 61.0129, std.dev.: 0.1243) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.55% (1.2236 => 1.2426, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -31.02% (0.2108 => 0.1454, std.dev.: 0.0254) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.39% (1.0140 => 1.0100, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 0.24% (0.5893 => 0.5907, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -3.53% (0.1530 => 0.1476, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.53% (0.1308 => 0.1328, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.81% (0.2921 => 0.3003, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.73% (0.2194 => 0.2232, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.34% (0.2978 => 0.3018, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.05% (0.2102 => 0.2124, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 11.36% (0.0220 => 0.0245, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: 30.43% (0.0069 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.33% (0.0075 => 0.0076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.53% (0.0194 => 0.0160, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.29% (0.0388 => 0.0383, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.48% (0.0276 => 0.0225, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.42% (0.0282 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0325 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 32.14% (0.0140 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 35.34% (0.0116 => 0.0157, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0253 => 0.0254, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.63% (0.0123 => 0.0125, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1447 => 0.1449, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -6.56% (1.5011 => 1.4026, std.dev.: 0.0700) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.44% (0.1418 => 0.1481, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.29% (0.4054 => 0.4147, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.1341 => 0.1454, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.0584 => 0.0550, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.16% (0.0190 => 0.0184, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.21% (0.0580 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1287 => 1.1287, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -48.15% (0.0027 => 0.0014, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.91% (0.0550 => 0.0545, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.65% (0.0147 => 0.0195, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7654 => 0.7654, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.41% (1.6003 => 1.5938, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -66.67% (0.0003 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.16% (4.1772 => 3.1261, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0079) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 9.75% (2.1763 => 2.3885, std.dev.: 0.0257) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.62% (0.1414 => 0.1550, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.28% (0.6410 => 0.7005, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.34% (0.5309 => 0.5752, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 7.98% (1.1653 => 1.2583, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.86% (0.2552 => 0.2727, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.85% (1.0046 => 1.0734, std.dev.: 0.0143) MultiSource/Applications/minisat/minisat: 6.79% (0.6173 => 0.6592, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.78% (0.3582 => 0.3825, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.43% (15.3105 => 16.2955, std.dev.: 0.1906) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3901 => 0.4148, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 5.74% (3.0225 => 3.1960, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.64% (1.5150 => 1.6005, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.54% (0.2797 => 0.2952, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.42% (0.6915 => 0.7290, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 5.38% (0.3217 => 0.3390, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.28% (13.3238 => 14.0270, std.dev.: 0.0372) MultiSource/Benchmarks/Bullet/bullet: 5.15% (29.3170 => 30.8280, std.dev.: 0.1352) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (12.6413 => 13.2772, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.77% (0.7639 => 0.8003, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 4.69% (4.7455 => 4.9679, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.4248 => 0.4445, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.51% (0.6069 => 0.6343, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2654 => 0.2772, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.39% (14.7256 => 15.3720, std.dev.: 0.0333) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2877 => 0.2996, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.05% (1.1440 => 1.1903, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 3.99% (0.8405 => 0.8740, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 3.96% (14.6079 => 15.1868, std.dev.: 0.0229) MultiSource/Benchmarks/nbench/nbench: 3.79% (1.0821 => 1.1231, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.76% (1.0689 => 1.1091, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.76% (0.3062 => 0.3177, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.74% (6.4908 => 6.7335, std.dev.: 0.0674) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.71% (0.8569 => 0.8887, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: 3.62% (1.8798 => 1.9479, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.60% (0.2886 => 0.2990, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 3.60% (0.3084 => 0.3195, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.59% (3.0758 => 3.1862, std.dev.: 0.0425) MultiSource/Applications/hbd/hbd: 3.56% (1.3268 => 1.3741, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.54% (1.1827 => 1.2246, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (8.2186 => 8.5042, std.dev.: 0.0469) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.7226 => 0.7473, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 3.38% (3.5980 => 3.7195, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4880 => 0.5038, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.13% (1.2021 => 1.2397, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.4113 => 1.4554, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.11% (6.2546 => 6.4489, std.dev.: 0.0256) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.93% (4.3380 => 4.4650, std.dev.: 0.0248) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.7784 => 0.8000, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.61% (1.3935 => 1.4299, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.2742 => 1.3068, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (4.2616 => 4.3680, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (4.0318 => 4.1303, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.39% (1.4189 => 1.4528, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (3.8796 => 3.9697, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.80% (8.2559 => 8.4043, std.dev.: 0.0381) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 58.62% (0.0261 => 0.0414, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2287, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.67% (0.0766 => 0.0932, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.88% (1.7426 => 2.0019, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5640, std.dev.: 0.0183) SingleSource/Benchmarks/Stanford/Puzzle: 13.33% (0.1433 => 0.1624, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8069, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.92% (1.0063 => 1.1061, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/lists: 9.16% (7.0025 => 7.6441, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.56% (40.4792 => 42.7293, std.dev.: 0.5278) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 4.31% (15.2242 => 15.8807, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.97% (4.2129 => 4.3802, std.dev.: 0.0325) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 3.35% (8.5113 => 8.7967, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/hash: 3.34% (0.6308 => 0.6519, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 2.83% (3.8907 => 4.0010, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8866, std.dev.: 0.0702) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.73% (6.6312 => 6.8125, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.55% (3.5520 => 3.6424, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/mason/mason: 2.48% (0.5004 => 0.5128, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (2.4013 => 2.4495, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.75% (4.6127 => 4.6936, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4396, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.22% (4.6414 => 4.6978, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 1.11% (6.7458 => 6.8206, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.06% (1.6110 => 1.6280, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.61% (0.3497 => 0.2042, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.51% (5.2665 => 4.1336, std.dev.: 0.1253) SingleSource/Benchmarks/Shootout-C++/ary3: -19.68% (1.7473 => 1.4035, std.dev.: 0.0599) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.1647 => 0.9605, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.56% (15.8312 => 13.3671, std.dev.: 0.1044) SingleSource/Benchmarks/Shootout/sieve: -12.14% (8.1594 => 7.1689, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: -9.78% (0.1114 => 0.1005, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.70% (1.4034 => 1.2813, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.29% (3.2007 => 2.9353, std.dev.: 0.0693) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3768, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3326, std.dev.: 0.0384) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -6.44% (7.6833 => 7.1885, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/richards_benchmark: -6.37% (1.4441 => 1.3521, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7918, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9614, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout/fib2: -5.13% (4.4195 => 4.1927, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -5.02% (3.4230 => 3.2510, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -3.65% (9.2503 => 8.9127, std.dev.: 0.0586) SingleSource/Benchmarks/McGill/misr: -3.45% (0.4296 => 0.4148, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.16% (3.9413 => 3.8166, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.07% (0.4140 => 0.4013, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2918, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.49% (1.1683 => 1.1392, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.33% (1.2722 => 1.2426, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2240, std.dev.: 0.0145) MultiSource/Applications/aha/aha: -1.63% (3.4286 => 3.3728, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -1.61% (1.0926 => 1.0750, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3104, std.dev.: 0.0209) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4643, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.15% (2.8964 => 2.8630, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: -1.00% (3.8200 => 3.7817, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.20% (0.9980 => 1.0100, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: -1.91% (0.6022 => 0.5907, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -11.40% (0.1666 => 0.1476, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.54% (0.1554 => 0.1328, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.59% (0.3083 => 0.3003, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.77% (0.2394 => 0.2232, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.94% (0.3175 => 0.3018, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.73% (0.2302 => 0.2124, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -45.43% (0.0449 => 0.0245, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.67% (0.0192 => 0.0160, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.25% (0.0301 => 0.0225, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.16% (0.0324 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -16.93% (0.0189 => 0.0157, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.40% (0.1429 => 0.1449, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -6.61% (1.5019 => 1.4026, std.dev.: 0.0700) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.33% (0.1501 => 0.1481, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.74% (0.4264 => 0.4147, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.1344 => 0.1454, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.62% (0.0589 => 0.0550, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.69% (0.0232 => 0.0184, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 133.33% (0.0006 => 0.0014, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.73% (0.0246 => 0.0195, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.74% (1.5363 => 1.5938, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 20:03:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 22:03:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120927030311.DA92B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4287?compare_to=4280&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4287, Order: 164735, Start Time: 2012-09-27 00:20:44, End Time: 2012-09-27 03:04:45 To: 4280, Order: 164720, Start Time: 2012-09-26 20:10:22, End Time: 2012-09-26 22:54:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.51% (0.3446 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3460 => 0.3889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.39% (0.3496 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3469 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.00% (0.3650 => 0.4088, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.01% (0.1063 => 0.1180, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.75% (1.5932 => 1.7644, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.77% (0.5826 => 0.6337, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.63% (0.5889 => 0.6397, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.98% (0.4361 => 0.4709, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.96% (1.6211 => 1.7501, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.81% (3.5627 => 3.8411, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.71% (1.3152 => 1.4166, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.68% (2.7292 => 2.9387, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.1421 => 0.1530, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.62% (5.5417 => 5.9639, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.49% (0.4994 => 0.5368, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.36% (1.0781 => 1.1574, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7171 => 0.7697, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.5000 => 0.5366, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.27% (0.2875 => 0.3084, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.22% (0.3004 => 0.3221, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.2014 => 0.2158, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3195 => 0.3423, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.07% (0.3930 => 0.4208, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.98% (0.5026 => 0.5377, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 6.98% (0.9909 => 1.0601, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.94% (0.2866 => 0.3065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.90% (0.2738 => 0.2927, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 6.87% (0.2823 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.87% (0.2811 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.84% (0.2750 => 0.2938) SingleSource/Benchmarks/Shootout-C++/methcall: 6.83% (0.2813 => 0.3005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.81% (4.2109 => 4.4978, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.81% (0.2792 => 0.2982, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.78% (0.2729 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.1549 => 0.1654, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2803 => 0.2993, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.75% (0.4029 => 0.4301, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.70% (2.0673 => 2.2058, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2780 => 0.2966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.2911 => 0.3105, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.66% (0.3890 => 0.4149, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 6.63% (0.2566 => 0.2736, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.57% (0.3362 => 0.3583, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.56% (0.3096 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.2736 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.54% (0.3060 => 0.3260, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.52% (2.1013 => 2.2384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3267 => 0.3480, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.50% (0.6634 => 0.7065, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.49% (4.6177 => 4.9173, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary: 6.48% (0.3258 => 0.3469, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (4.4195 => 4.7057, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 6.47% (0.3678 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.3271 => 0.3482, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3317 => 0.3530, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.40% (0.4139 => 0.4404, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 6.39% (23.5202 => 25.0239, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/lists: 6.39% (0.3348 => 0.3562, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.37% (0.3282 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.34% (0.3625 => 0.3855, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3124 => 0.3322, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 6.33% (1.4269 => 1.5172, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.29% (2.1653 => 2.3016, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 6.27% (0.3477 => 0.3695, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.25% (0.3726 => 0.3959, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.23% (1.8794 => 1.9965, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4251 => 0.4511, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.09% (0.3845 => 0.4079, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (0.4658 => 0.4940, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.02% (0.3690 => 0.3912, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4146 => 0.4394, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.92% (0.3903 => 0.4134, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 5.91% (0.3336 => 0.3533, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.5900 => 0.6245, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.6435 => 0.6810, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 5.82% (0.5546 => 0.5869, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.77% (0.3084 => 0.3262, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.75% (0.2068 => 0.2187, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.3981 => 0.4210, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.74% (0.2040 => 0.2157, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.5012 => 0.5299, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.2737 => 0.2893, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.67% (1.9694 => 2.0810, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (1.9966 => 2.1074, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.50% (0.7875 => 0.8308, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 5.47% (2.0346 => 2.1458, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.42% (0.2103 => 0.2217, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (0.2691 => 0.2835, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 5.19% (0.2391 => 0.2515) MultiSource/Applications/hbd/hbd: 4.95% (0.9697 => 1.0177, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.2969 => 0.3114, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.81% (0.4847 => 0.5080, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.59% (0.7426 => 0.7767, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.53% (0.5361 => 0.5604, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.19% (0.5584 => 0.5818, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.92% (11.6398 => 12.0963, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (4.6926 => 4.8751, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.60% (0.3498 => 0.3624, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.60% (0.4253 => 0.4406, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.42% (11.9555 => 12.2452, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8980, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1626, std.dev.: 0.0721) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6365, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1888, std.dev.: 0.0104) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5052, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4401, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.41% (1.0927 => 1.1081, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5929, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5658, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7943, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/tsp/tsp: -7.33% (2.1113 => 1.9566, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7886, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7916, std.dev.: 0.0693) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 20:10:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 22:10:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927031018.7902F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4288?compare_to=4284&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4288, Order: 164740, Start Time: 2012-09-27 01:57:16, End Time: 2012-09-27 03:11:51 To: 4284, Order: 164735, Start Time: 2012-09-27 00:13:47, End Time: 2012-09-27 01:28:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.80% (2.0176 => 2.4372, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.89% (0.5748 => 0.6374, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 10.83% (0.7061 => 0.7826, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 10.67% (0.4328 => 0.4790, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.58% (3.9660 => 4.3857, std.dev.: 0.0102) MultiSource/Applications/hbd/hbd: 10.17% (1.3693 => 1.5086, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.02% (0.2596 => 0.2856, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.96% (0.2721 => 0.2992, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.91% (1.2193 => 1.3401, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.87% (0.4062 => 0.4463, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.85% (0.2781 => 0.3055, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.79% (0.7038 => 0.7727, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.62% (0.7710 => 0.8452, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.53% (0.9199 => 1.0076, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.51% (0.6959 => 0.7621, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.50% (0.3485 => 0.3816, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.43% (0.3022 => 0.3307, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.42% (0.3130 => 0.3425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.38% (0.5265 => 0.5759, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.37% (0.6283 => 0.6872, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.35% (1.1364 => 1.2427, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2607 => 0.2850, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.31% (0.3899 => 0.4262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.28% (0.2628 => 0.2872, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.25% (0.1589 => 0.1736, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.24% (0.2726 => 0.2978, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.24% (13.8202 => 15.0969, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.23% (1.4563 => 1.5907, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.18% (0.4390 => 0.4793, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.16% (0.2937 => 0.3206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.14% (0.3293 => 0.3594, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.12% (0.2995 => 0.3268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.09% (0.3489 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.08% (0.3580 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.08% (0.2765 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.08% (0.3107 => 0.3389, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.06% (0.4791 => 0.5225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.05% (1.9828 => 2.1623, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/except: 9.02% (0.2760 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.00% (0.2966 => 0.3233, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.00% (0.3756 => 0.4094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.96% (0.4016 => 0.4376, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.89% (0.3149 => 0.3429, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 8.83% (0.3192 => 0.3474, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.82% (1.0313 => 1.1223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.77% (0.2988 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.66% (0.3868 => 0.4203, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.64% (0.5577 => 0.6059, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4379 => 0.4752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.43% (0.3453 => 0.3744, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.38% (0.3246 => 0.3518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.35% (0.3534 => 0.3829, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 8.29% (0.8310 => 0.8999, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.27% (0.2127 => 0.2303, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.24% (0.2914 => 0.3154, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.14% (3.6692 => 3.9677, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 8.06% (1.1061 => 1.1952, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 7.97% (3.8646 => 4.1728, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (7.2180 => 7.7936, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 7.95% (0.2945 => 0.3179, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.84% (0.5637 => 0.6079, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.73% (0.3220 => 0.3469, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.66% (0.6576 => 0.7080, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.61% (16.6129 => 17.8779, std.dev.: 0.0205) MultiSource/Applications/minisat/minisat: 7.59% (0.6744 => 0.7256, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.57% (1.0594 => 1.1396, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 7.53% (3.1889 => 3.4289, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.52% (0.8698 => 0.9352, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.51% (0.7460 => 0.8020, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.47% (2.1791 => 2.3419, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3578 => 0.3845, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 7.44% (0.4113 => 0.4419, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3755 => 0.4033, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.26% (1.3245 => 1.4206, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1569 => 0.1682, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.15% (0.3623 => 0.3882, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.13% (1.9270 => 2.0643, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.06% (8.4961 => 9.0957, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 6.99% (14.8535 => 15.8911, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 6.95% (1.2749 => 1.3635, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.94% (0.8818 => 0.9430, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.83% (4.3801 => 4.6794, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.79% (4.4433 => 4.7452, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 6.68% (0.2859 => 0.3050, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 6.61% (0.3131 => 0.3338, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3245 => 0.3458, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.1333 => 1.2076, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.55% (0.6135 => 0.6537, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.2140 => 0.2276, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.35% (0.2504 => 0.2663, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (13.2842 => 14.1250, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.33% (1.3813 => 1.4687, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.31% (1.3819 => 1.4691, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 6.26% (6.5754 => 6.9869, std.dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 6.26% (1.2292 => 1.3061, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.13% (14.5298 => 15.4211, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.13% (3.2742 => 3.4750, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.04% (0.9108 => 0.9658, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.00% (4.6629 => 4.9429, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.6250 => 0.6612, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.4805 => 0.5077, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.54% (4.9865 => 5.2626, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.50% (1.5188 => 1.6024, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.38% (0.2008 => 0.2116, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.08% (2.1007 => 2.2074, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (6.2785 => 6.5842, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.84% (3.7467 => 3.9280, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: 4.52% (33.2944 => 34.8006, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.33% (0.3511 => 0.3663, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.02% (16.2614 => 16.7522, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.1736 => 3.4122, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7237, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.44% (10.7476 => 11.1169, std.dev.: 0.0625) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5890, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5849, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1861, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1414, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2253, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5921, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.72% (0.4657 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.60% (22.5627 => 21.9756, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3028, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.18% (1.3780 => 1.2928, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5112, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.35% (1.7688 => 1.7095, std.dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: -2.80% (3.0263 => 2.9417, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2432, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1375, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.09% (7.3305 => 7.2505, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2347, std.dev.: 0.0208) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 20:26:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 22:26:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927032653.A15712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4289?compare_to=4285&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4289, Order: 164740, Start Time: 2012-09-27 02:08:34, End Time: 2012-09-27 03:28:27 To: 4285, Order: 164735, Start Time: 2012-09-27 00:19:42, End Time: 2012-09-27 01:39:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (151 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.42% (0.5775 => 0.5799, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 0.07% (16.1254 => 16.1360, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: -0.06% (14.9445 => 14.9359, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 0.09% (83.2683 => 83.3442, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 0.03% (4.3653 => 4.3666, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2393 => 1.2396, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.5241 => 7.5209, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.08% (3.7168 => 3.7139, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6469 => 0.6465, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.00% (0.0675 => 0.0648) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.78% (63.2438 => 83.3442, std.dev.: 0.0101) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14231.11% (0.0720 => 10.3184, std.dev.: 0.0057) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.35% (10.3673 => 14.6538, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/richards_benchmark: 28.98% (0.1622 => 0.2092, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.54% (2.2022 => 2.5444, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.33% (7.0540 => 8.1357, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.60% (0.1566 => 0.1779, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.21% (1.1194 => 1.2673, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.78% (1.7609 => 1.9860, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.04% (0.3473 => 0.3891, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.12% (0.3886 => 0.4318, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.88% (0.3282 => 0.3639, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.56% (10.4361 => 11.4343, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/power/power: 8.96% (0.1440 => 0.1569, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.90% (9.4845 => 10.3287, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.73% (0.4879 => 0.5305, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.40% (0.3177 => 0.3444, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.37% (0.2700 => 0.2926, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.04% (0.3109 => 0.3359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3307 => 0.3572, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 7.88% (0.7115 => 0.7676, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.6030 => 0.6504, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.86% (0.7433 => 0.8017, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.84% (0.6675 => 0.7198, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.80% (0.4615 => 0.4975, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.79% (0.2271 => 0.2448, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.67% (1.5415 => 1.6597, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 7.65% (0.3423 => 0.3685, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.64% (8.1363 => 8.7582, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 7.64% (0.2554 => 0.2749, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1695 => 0.1824, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.54% (3.3354 => 3.5869, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.54% (1.3050 => 1.4034, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.51% (5.7591 => 6.1914, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.44% (4.2646 => 4.5818, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.36% (0.2107 => 0.2262, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.32% (0.1625 => 0.1744, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.29% (0.5105 => 0.5477, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.29% (0.5860 => 0.6287, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.20% (4.9449 => 5.3009, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.19% (5.0018 => 5.3613, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.8172 => 0.8755, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 7.02% (0.7326 => 0.7840, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.95% (0.5569 => 0.5956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.8067 => 0.8627, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.91% (7.9617 => 8.5118, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 6.85% (0.3387 => 0.3619, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.84% (0.7835 => 0.8371, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.3121 => 0.3333, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2758 => 0.2945, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.76% (0.9765 => 1.0425, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 6.74% (1.1642 => 1.2427, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.62% (1.0722 => 1.1432, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.57% (1.1861 => 1.2640, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.55% (0.5020 => 0.5349, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 6.53% (0.3092 => 0.3294, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.51% (0.3441 => 0.3665, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 6.38% (3.8723 => 4.1192, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4299 => 0.4572, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 6.31% (21.9371 => 23.3220, std.dev.: 0.0244) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.26% (0.2603 => 0.2766, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.3180 => 0.3379, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.10% (1.5603 => 1.6555, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 6.05% (0.3422 => 0.3629, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.02% (0.4636 => 0.4915, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.98% (2.0273 => 2.1485, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 5.96% (0.6456 => 0.6841, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.91% (0.6450 => 0.6831, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.4103 => 0.4339, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 5.67% (0.4289 => 0.4532, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.63% (0.8921 => 0.9423, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 5.56% (2.2969 => 2.4247, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.53% (0.2891 => 0.3051, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.51% (0.3650 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3865 => 0.4075, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.40% (0.2905 => 0.3062, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3826 => 0.4031, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (14.3668 => 15.1328, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.32% (0.5981 => 0.6299, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.32% (1.5859 => 1.6702, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.31% (0.4203 => 0.4426, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3684 => 0.3876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.19% (0.4620 => 0.4860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.19% (0.2831 => 0.2978, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3935 => 0.4138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.12% (1.4186 => 1.4912, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.10% (0.3136 => 0.3296, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.07% (2.2024 => 2.3141, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.4048 => 0.4252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.97% (0.2877 => 0.3020, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.96% (2.0665 => 2.1690, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.3232 => 0.3392, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.94% (0.2714 => 0.2848, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.93% (0.3283 => 0.3445, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3162 => 0.3318, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.91% (0.2871 => 0.3012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3603 => 0.3779, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.87% (0.2872 => 0.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2756 => 0.2890, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.81% (1.1840 => 1.2410, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.77% (0.2266 => 0.2374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.75% (0.3052 => 0.3197, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.71% (0.3379 => 0.3538, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.69% (0.2793 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.64% (0.2802 => 0.2932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3817 => 0.3972, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.62% (1.2842 => 1.3307, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (0.8101 => 0.8389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.19% (0.3131 => 0.3231, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.74% (17.1811 => 17.6524, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.8922 => 3.9882, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502) SingleSource/Benchmarks/Shootout-C++/hash2: 7.04% (3.1578 => 3.3800, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (3.6395 => 3.7766, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (4.2280 => 4.3627, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2563, std.dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5775, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.98% (5.2763 => 3.2723, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.03% (5.3855 => 3.9300, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.60% (5.3526 => 3.9287, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1788, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.08% (2.9384 => 2.6129, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: -8.03% (22.1758 => 20.3946, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3070, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5050, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.28% (1.2373 => 1.2091, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9868, std.dev.: 0.0224) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5103, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0921, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2527, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4228, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2325, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.90% (0.5229 => 0.5799, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 7.65% (14.9895 => 16.1360, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 5.51% (14.1553 => 14.9359, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 6.23% (4.1105 => 4.3666, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.20% (1.1048 => 1.2396, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.07% (7.1582 => 7.5209, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.25% (3.4629 => 3.7139, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.91% (0.6222 => 0.6465, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 21:06:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 23:06:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927040607.5A3CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4290?compare_to=4286&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4290, Order: 164751, Start Time: 2012-09-27 02:56:02, End Time: 2012-09-27 04:07:41 To: 4286, Order: 164740, Start Time: 2012-09-27 01:28:30, End Time: 2012-09-27 02:40:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (80 on baseline) Performance Improvements: 6 (43 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.77% (8.8035 => 9.0472, std.dev.: 0.0835) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.10% (1.2099 => 1.2232, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.76% (2.6796 => 2.7535, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 2.02% (1.3842 => 1.4121, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.85% (0.8000 => 0.7852, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.67% (1.4299 => 1.4060, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: -1.08% (2.3885 => 2.3628, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1091 => 1.0977, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -2.30% (4.3802 => 4.2793, std.dev.: 0.0376) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.71% (1.2426 => 1.2213, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.55% (1.0100 => 1.0257, std.dev.: 0.0167) MultiSource/Applications/sqlite3/sqlite3: -0.30% (0.5907 => 0.5889, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: 0.41% (0.1476 => 0.1482, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.17% (0.1328 => 0.1246, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.06% (0.3003 => 0.2911, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.22% (0.2232 => 0.2227, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (0.3018 => 0.3053, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.61% (0.2124 => 0.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 17.14% (0.0245 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -37.78% (0.0090 => 0.0056, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: -2.17% (0.0092 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.89% (0.0076 => 0.0082, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.50% (0.0160 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.39% (0.0383 => 0.0396, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.67% (0.0225 => 0.0285, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0286 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.60% (0.0331 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.16% (0.0185 => 0.0181, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 24.84% (0.0157 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.18% (0.0254 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -19.20% (0.0125 => 0.0101, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1449 => 0.1446, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 8.16% (1.4026 => 1.5171, std.dev.: 0.0206) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.57% (0.1481 => 0.1519, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.45% (0.4147 => 0.4004, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.14% (0.1454 => 0.1452, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.45% (0.0550 => 0.0580, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.96% (0.0184 => 0.0252, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.82% (0.0645 => 0.0601, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1287 => 1.1250, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.26% (0.0545 => 0.0590, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.15% (0.0195 => 0.0144, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7654 => 0.7652, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.23% (1.5938 => 1.5975, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.65% (4.1772 => 3.1058, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0062) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.68% (0.0745 => 0.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 9.40% (0.5309 => 0.5808, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 8.57% (2.1763 => 2.3628, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6410 => 0.6959, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 8.15% (1.1653 => 1.2603, std.dev.: 0.0161) MultiSource/Applications/lemon/lemon: 7.61% (1.0046 => 1.0810, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.54% (0.3582 => 0.3852, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.76% (0.6173 => 0.6590, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 5.63% (0.6915 => 0.7304, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.45% (0.7639 => 0.8055, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (1.5150 => 1.5966, std.dev.: 0.0098) MultiSource/Applications/d/make_dparser: 5.37% (3.0225 => 3.1848, std.dev.: 0.0317) MultiSource/Applications/kimwitu++/kc: 5.26% (15.3105 => 16.1155, std.dev.: 0.1659) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.2552 => 0.2683, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.84% (0.3901 => 0.4090, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.82% (0.3217 => 0.3372, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.80% (1.1672 => 1.2232, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.75% (1.4408 => 1.5092, std.dev.: 0.0184) MultiSource/Applications/oggenc/oggenc: 4.74% (4.7455 => 4.9704, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.71% (0.4880 => 0.5110, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (12.6413 => 13.2061, std.dev.: 0.1335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.43% (0.6069 => 0.6338, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.2797 => 0.2920, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 4.36% (13.3238 => 13.9050, std.dev.: 0.1846) MultiSource/Benchmarks/Bullet/bullet: 4.28% (29.3170 => 30.5713, std.dev.: 0.2349) MultiSource/Applications/siod/siod: 4.25% (2.0972 => 2.1863, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: 4.15% (1.3268 => 1.3819, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4248 => 0.4424, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.07% (0.2654 => 0.2762, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (3.0758 => 3.1983, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.97% (1.2021 => 1.2498, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.81% (0.2996 => 0.3110, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.78% (0.2886 => 0.2995, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.72% (0.3062 => 0.3176, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.70% (1.1827 => 1.2265, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (6.2546 => 6.4811, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (8.2186 => 8.5105, std.dev.: 0.0836) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0821 => 1.1198, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 3.47% (1.8798 => 1.9451, std.dev.: 0.0230) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.6079 => 15.1066, std.dev.: 0.0951) MultiSource/Applications/Burg/burg: 3.29% (1.1440 => 1.1816, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.22% (0.8569 => 0.8845, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (4.0318 => 4.1576, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8405 => 0.8659, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.7226 => 0.7443, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 2.90% (3.5980 => 3.7022, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.75% (0.5520 => 0.5672, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.69% (1.0689 => 1.0977, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.35% (1.4113 => 1.4445, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 2.30% (0.7738 => 0.7916, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (4.2616 => 4.3556, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.3380 => 4.4315, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.87% (1.4189 => 1.4455, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.2815 => 4.3512, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.55% (8.2559 => 8.3835, std.dev.: 0.0276) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.18% (1.6538 => 2.3349, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std.dev.: 0.0318) SingleSource/Benchmarks/Stanford/Puzzle: 13.75% (0.1433 => 0.1630, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.33% (4.0101 => 4.5446, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/queens: 10.51% (1.6261 => 1.7970, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6013, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.02% (1.0063 => 1.0769, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (0.3301 => 0.3478, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.23% (15.2242 => 15.8680, std.dev.: 0.0488) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5422, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.93% (0.8498 => 0.8832, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.30% (2.6656 => 2.7535, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.93% (14.4877 => 14.9119, std.dev.: 0.0480) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8104, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 2.68% (3.8907 => 3.9950, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 2.53% (3.5520 => 3.6417, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7146, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: 1.83% (2.4013 => 2.4453, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4464, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.09% (0.3497 => 0.2095, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0781, std.dev.: 0.1429) SingleSource/Benchmarks/Shootout-C++/ary3: -20.80% (1.7473 => 1.3839, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.1647 => 0.9603, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.83% (15.8312 => 13.1665, std.dev.: 0.1662) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.43% (0.0917 => 0.0803, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -11.48% (0.3746 => 0.3316, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.44% (3.2007 => 2.9626, std.dev.: 0.0340) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3769, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/distray/distray: -6.72% (0.2664 => 0.2485, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3280, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: -6.41% (7.6833 => 7.1906, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3532, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9375, std.dev.: 0.2280) MultiSource/Applications/SIBsim4/SIBsim4: -5.56% (3.4230 => 3.2327, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1854, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.22% (2.5166 => 2.4103, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/misr: -4.19% (0.4296 => 0.4116, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.00% (1.2722 => 1.2213, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -3.73% (9.2503 => 8.9055, std.dev.: 0.0505) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.19% (0.4140 => 0.4008, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.17% (2.4457 => 2.3682, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.16% (3.7496 => 3.6310, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8202, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.41% (1.1683 => 1.1402, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -1.97% (92.7467 => 90.9160, std.dev.: 0.2955) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3128, std.dev.: 0.0166) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3646, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2282, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.65% (2.8964 => 2.8485, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.44% (16.5617 => 16.3228, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4876 => 3.4373, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (2.4971 => 2.4635, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.78% (0.9980 => 1.0257, std.dev.: 0.0167) MultiSource/Applications/sqlite3/sqlite3: -2.21% (0.6022 => 0.5889, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: -11.04% (0.1666 => 0.1482, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -19.82% (0.1554 => 0.1246, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.58% (0.3083 => 0.2911, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.98% (0.2394 => 0.2227, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.84% (0.3175 => 0.3053, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.17% (0.2302 => 0.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -36.08% (0.0449 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -37.08% (0.0089 => 0.0056, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.83% (0.0240 => 0.0082, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.54% (0.0390 => 0.0396, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.32% (0.0301 => 0.0285, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -68.92% (0.0325 => 0.0101, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1429 => 0.1446, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.01% (1.5019 => 1.5171, std.dev.: 0.0206) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.20% (0.1501 => 0.1519, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.10% (0.4264 => 0.4004, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.1344 => 0.1452, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.53% (0.0589 => 0.0580, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.62% (0.0232 => 0.0252, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0639 => 0.0601, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.88% (1.1350 => 1.1250, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.38% (0.0637 => 0.0590, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.46% (0.0246 => 0.0144, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.98% (1.5363 => 1.5975, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 21:53:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Sep 2012 23:53:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927045341.E404F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4291?compare_to=4288&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4291, Order: 164751, Start Time: 2012-09-27 03:40:39, End Time: 2012-09-27 04:55:15 To: 4288, Order: 164740, Start Time: 2012-09-27 01:57:16, End Time: 2012-09-27 03:11:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (176 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.47% (0.3949 => 0.4323, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.19% (3.6838 => 3.7276, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.94% (2.0176 => 2.4401, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.40% (0.7061 => 0.7866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.40% (0.5818 => 0.6481, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.71% (3.9660 => 4.3908, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 10.65% (0.4328 => 0.4789, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.28% (0.2781 => 0.3067, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 10.27% (1.3693 => 1.5099, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.02% (0.4062 => 0.4469, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 9.99% (0.7038 => 0.7741, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.90% (1.2193 => 1.3400, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.90% (0.7710 => 0.8473, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.85% (0.9199 => 1.0105, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.76% (0.6959 => 0.7638, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.71% (0.5265 => 0.5776, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.61% (0.3485 => 0.3820, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.50% (13.8202 => 15.1325, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.49% (1.1364 => 1.2443, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.49% (0.3130 => 0.3427, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.41% (0.3899 => 0.4266, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.37% (1.4563 => 1.5927, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.36% (0.3022 => 0.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.34% (0.2655 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.28% (0.2726 => 0.2979, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.24% (0.2607 => 0.2848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.24% (0.2760 => 0.3015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.23% (0.3489 => 0.3811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.20% (0.6283 => 0.6861, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 9.14% (0.3293 => 0.3594, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.14% (0.2966 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.13% (0.2628 => 0.2868, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.11% (1.9828 => 2.1635, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.11% (0.3580 => 0.3906, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.09% (0.4390 => 0.4789, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.06% (0.2937 => 0.3203, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.05% (0.3756 => 0.4096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.01% (0.2765 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3149 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.3107 => 0.3385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.94% (0.4016 => 0.4375, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1589 => 0.1731, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.92% (1.0313 => 1.1233, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.91% (0.2995 => 0.3262, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.86% (0.2696 => 0.2935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.79% (0.3868 => 0.4208, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.72% (0.4791 => 0.5209, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.71% (0.5577 => 0.6063, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.67% (0.2988 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.62% (0.3192 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2127 => 0.2310, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3453 => 0.3750, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.40% (0.4379 => 0.4747, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.31% (1.1061 => 1.1980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 8.23% (0.3534 => 0.3825, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.23% (0.8310 => 0.8994, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.15% (7.2180 => 7.8065, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.11% (0.5637 => 0.6094, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.11% (3.6692 => 3.9666, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 7.98% (0.7506 => 0.8105, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 7.97% (3.8646 => 4.1726, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 7.91% (0.2945 => 0.3178, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3220 => 0.3473, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.80% (0.7460 => 0.8042, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3646 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3601 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.61% (0.2023 => 0.2177, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.60% (16.6129 => 17.8762, std.dev.: 0.0341) SingleSource/UnitTests/ObjC/exceptions: 7.59% (0.3914 => 0.4211, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.59% (3.1889 => 3.4308, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/synchronized: 7.56% (0.3663 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 7.49% (1.9270 => 2.0713, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 7.49% (1.0594 => 1.1387, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3623 => 0.3894, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.46% (0.6744 => 0.7247, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.43% (2.1791 => 2.3411, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.36% (0.8698 => 0.9338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.30% (0.3755 => 0.4029, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.19% (1.3245 => 1.4197, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.18% (1.2749 => 1.3664, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.06% (14.8535 => 15.9023, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.4113 => 0.4400, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.91% (8.4961 => 9.0836, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.86% (0.2859 => 0.3055, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.83% (0.8818 => 0.9420, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.77% (4.4433 => 4.7439, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.76% (4.3801 => 4.6760, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.73% (0.6135 => 0.6548, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (1.1333 => 1.2083, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.62% (13.2842 => 14.1630, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.59% (1.3819 => 1.4729, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.56% (4.6629 => 4.9687, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.50% (0.3245 => 0.3456, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.41% (1.3813 => 1.4698, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 6.34% (1.2292 => 1.3071, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.29% (14.5298 => 15.4434, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 6.13% (6.5754 => 6.9786, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.87% (3.2742 => 3.4663, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 5.71% (0.6250 => 0.6607, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.70% (0.4805 => 0.5079, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.62% (0.9108 => 0.9620, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.34% (4.9865 => 5.2528, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.25% (1.5188 => 1.5985, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.2008 => 0.2110, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.94% (3.7467 => 3.9316, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.93% (2.1007 => 2.2043, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (6.2785 => 6.5858, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 4.30% (33.2944 => 34.7272, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.67% (0.3511 => 0.3640, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7394, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2599, std.dev.: 0.0472) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.3458 => 0.3627) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7252, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1214, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5807, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5830, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2230, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5875, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.78% (0.2670 => 0.2569, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.59% (22.5627 => 21.9785, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2876, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.13% (1.3780 => 1.2935, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.33% (1.7688 => 1.7099, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9444, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2475, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1439, std.dev.: 0.0249) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: -1.15% (1.2308 => 1.2167, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2360, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 22:15:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 00:15:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927051534.928CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4292?compare_to=4289&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4292, Order: 164754, Start Time: 2012-09-27 03:57:25, End Time: 2012-09-27 05:17:07 To: 4289, Order: 164740, Start Time: 2012-09-27 02:08:34, End Time: 2012-09-27 03:28:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (78.8821 => 80.1740, std.dev.: 0.1430) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.48% (0.5799 => 0.5771, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -0.33% (16.1360 => 16.0829, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: -0.10% (14.9359 => 14.9209, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: -0.35% (83.3442 => 83.0556, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: -0.26% (4.3666 => 4.3554, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.40% (1.2396 => 1.2347, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (7.5209 => 7.5144, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.02% (3.7139 => 3.7133, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.14% (0.6465 => 0.6456, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.33% (63.2438 => 83.0556, std.dev.: 0.0114) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14237.36% (0.0720 => 10.3229, std.dev.: 0.0128) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.22% (10.3673 => 14.7446, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 29.96% (0.1622 => 0.2108, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.81% (7.0540 => 8.0988, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.75% (2.2022 => 2.5270, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.15% (0.1566 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.37% (1.1194 => 1.2579, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.84% (1.7609 => 1.9694, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1584 => 0.1744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.78% (0.3282 => 0.3603, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1440 => 0.1567, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.51% (10.4361 => 11.3243, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 8.50% (9.4845 => 10.2908, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.3177 => 0.3431, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.93% (0.4879 => 0.5266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3307 => 0.3569, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.74% (0.2700 => 0.2909, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.56% (0.7115 => 0.7653, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.52% (0.4615 => 0.4962, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7433 => 0.7990, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.49% (5.7591 => 6.1904, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.45% (8.1363 => 8.7427, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.44% (0.2271 => 0.2440, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.43% (0.6675 => 0.7171, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.43% (0.3109 => 0.3340, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2554 => 0.2743, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.34% (3.3354 => 3.5803, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3423 => 0.3674, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.24% (1.5415 => 1.6531, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (4.2646 => 4.5714, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.18% (0.5860 => 0.6281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.16% (1.3050 => 1.3985, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1510 => 0.1618, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.08% (0.1625 => 0.1740, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.07% (0.7326 => 0.7844, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.5105 => 0.5461, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.8172 => 0.8733, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.82% (0.8067 => 0.8617, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.79% (4.9449 => 5.2808, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.79% (0.2107 => 0.2250, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.5569 => 0.5946, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.73% (5.0018 => 5.3385, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1940 => 0.2070, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.67% (0.2758 => 0.2942, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 6.59% (0.7835 => 0.8351, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 6.55% (0.3387 => 0.3609, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.55% (1.1642 => 1.2404, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.50% (7.9617 => 8.4796, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.49% (0.9765 => 1.0399, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.38% (0.3121 => 0.3320, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.37% (0.5020 => 0.5340, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.32% (1.1861 => 1.2611, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.31% (0.3422 => 0.3638, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.31% (0.3092 => 0.3287, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 6.30% (1.0722 => 1.1398, std.dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.23% (0.4636 => 0.4925, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.21% (1.5603 => 1.6572, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.15% (3.8723 => 4.1105, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3441 => 0.3652, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.99% (21.9371 => 23.2522, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 5.85% (2.0273 => 2.1458, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.83% (0.4103 => 0.4342, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2891 => 0.3059, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.81% (0.6456 => 0.6831, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.80% (0.2603 => 0.2754, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.68% (0.4299 => 0.4543, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (0.4064 => 0.4294, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6450 => 0.6814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.64% (0.3865 => 0.4083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.62% (0.2831 => 0.2990, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 5.60% (0.4289 => 0.4529, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3650 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.51% (0.3826 => 0.4037, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4620 => 0.4873, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2905 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3283 => 0.3462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4203 => 0.4432, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.41% (0.8921 => 0.9404, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 5.39% (2.2969 => 2.4206, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.38% (0.3232 => 0.3406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.36% (0.3098 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.30% (0.2756 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.29% (0.2872 => 0.3024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.19% (0.4048 => 0.4258, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.18% (2.0665 => 2.1735, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.3052 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.16% (0.2714 => 0.2854, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.15% (0.3162 => 0.3325, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.13% (0.5981 => 0.6288, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 5.11% (0.3603 => 0.3787, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.09% (1.5859 => 1.6667, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2793 => 0.2933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2802 => 0.2942, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.99% (0.3684 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.99% (14.3668 => 15.0841, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.98% (0.3935 => 0.4131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.91% (0.3379 => 0.3545, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.90% (0.2877 => 0.3018, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.90% (1.4186 => 1.4881, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.76% (2.2024 => 2.3072, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.47% (1.1840 => 1.2369, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2842 => 1.3317, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.28% (0.8101 => 0.8367, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.47% (17.1811 => 17.6058, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.95% (3.8922 => 3.9682, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.19% (1.1145 => 1.3841, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.24% (3.1595 => 3.4513, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.67% (3.6395 => 3.7731, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (4.2280 => 4.3627, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.51% (9.1159 => 9.2534, std.dev.: 0.0392) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2586, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.27% (5.3855 => 3.9167, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.90% (5.3526 => 3.9126, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1107, std.dev.: 0.0448) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.29% (2.9384 => 2.6066, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -8.40% (22.1758 => 20.3121, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3795, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3038, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5970, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.50% (3.2827 => 3.1678, std.dev.: 0.0244) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4927, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.23% (1.2373 => 1.2097, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.20% (8.1563 => 7.9770, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0837, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.85% (8.6802 => 8.5195, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2523, std.dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6841, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2289, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.37% (0.5229 => 0.5771, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 7.29% (14.9895 => 16.0829, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 5.41% (14.1553 => 14.9209, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 5.96% (4.1105 => 4.3554, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.76% (1.1048 => 1.2347, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.98% (7.1582 => 7.5144, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.23% (3.4629 => 3.7133, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.6222 => 0.6456, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 23:16:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 01:16:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120927061622.BEEAD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4293?compare_to=4287&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4293, Order: 164751, Start Time: 2012-09-27 03:33:49, End Time: 2012-09-27 06:17:35 To: 4287, Order: 164735, Start Time: 2012-09-27 00:20:44, End Time: 2012-09-27 03:04:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (127 on baseline) Performance Improvements: 11 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 957 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.76% (124.5129 => 127.9441, std.dev.: 0.9255) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.17% (54.2159 => 54.8494, std.dev.: 0.0234) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.39% (2.5163 => 2.4311, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: -1.24% (1.1574 => 1.1431, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -1.22% (4.9173 => 4.8574, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: -1.19% (1.7644 => 1.7434, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -1.15% (1.5172 => 1.4997, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.12% (2.2384 => 2.2133, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (2.9387 => 2.9071, std.dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: -1.06% (5.9639 => 5.9006, std.dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: -1.05% (2.1458 => 2.1232, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.04% (2.0810 => 2.0594, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -1.02% (2.3016 => 2.2781, std.dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.11% (0.3446 => 0.3829, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.08% (0.3465 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.01% (0.3496 => 0.3881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3488 => 0.3871, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 10.92% (0.3442 => 0.3818, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.87% (0.3460 => 0.3836, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3469 => 0.3844, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.66% (0.3650 => 0.4039, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.65% (0.3643 => 0.4031, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3724 => 0.4111, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 9.43% (1.5932 => 1.7434, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5826 => 0.6286, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.62% (0.5889 => 0.6338, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.07% (1.6211 => 1.7357, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.94% (1.3152 => 1.4065, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.93% (0.4361 => 0.4663, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (3.5627 => 3.8040, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.61% (0.7171 => 0.7645, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2875 => 0.3064, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.52% (2.7292 => 2.9071, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3195 => 0.3403, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 6.48% (5.5417 => 5.9006, std.dev.: 0.0114) SingleSource/Regression/C++/ofstream_ctor: 6.39% (0.3004 => 0.3196, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2750 => 0.2925, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.30% (0.5000 => 0.5315, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2738 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.2014 => 0.2140, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2813 => 0.2987, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.18% (2.0673 => 2.1950, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2803 => 0.2975, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.09% (0.2823 => 0.2995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2792 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2729 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.2780 => 0.2948, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (0.3930 => 0.4167, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.03% (1.0781 => 1.1431, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 6.02% (0.9909 => 1.0506, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.01% (0.2911 => 0.3086, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.98% (0.2811 => 0.2979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3124 => 0.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.94% (0.3096 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3258 => 0.3451, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3625 => 0.3838, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 5.85% (23.5202 => 24.8967, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary2: 5.85% (0.3317 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.2736 => 0.2896, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.85% (4.2109 => 4.4571, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.83% (0.3362 => 0.3558, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3060 => 0.3238, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.80% (0.4139 => 0.4379, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.76% (0.3678 => 0.3890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3282 => 0.3471, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.69% (0.3690 => 0.3900, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 5.69% (0.2566 => 0.2712, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3348 => 0.3538, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.67% (0.3477 => 0.3674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.2866 => 0.3027, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 5.61% (0.3726 => 0.3935, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (4.4195 => 4.6657, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 5.54% (1.8794 => 1.9836, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (0.3890 => 0.4103, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.46% (0.4251 => 0.4483, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 5.35% (0.4146 => 0.4368, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.33% (2.1013 => 2.2133, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.3903 => 0.4111, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.28% (0.6634 => 0.6984, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.22% (0.5900 => 0.6208, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (2.1653 => 2.2781, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.19% (4.6177 => 4.8574, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.18% (0.3845 => 0.4044, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.10% (1.4269 => 1.4997, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.3981 => 0.4184, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.01% (0.5012 => 0.5263, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.00% (0.6435 => 0.6757, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.96% (0.3084 => 0.3237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.92% (0.4658 => 0.4887, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.88% (0.2068 => 0.2169, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 4.86% (0.3336 => 0.3498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.3271 => 0.3429, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.74% (0.5546 => 0.5809, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.71% (0.2737 => 0.2866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.2969 => 0.3106, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.61% (1.9966 => 2.0886, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.57% (1.9694 => 2.0594, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 4.45% (0.9697 => 1.0129, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 4.35% (2.0346 => 2.1232, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.32% (0.7875 => 0.8215, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (0.4847 => 0.5049, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (0.5361 => 0.5565, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (0.2691 => 0.2793, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.64% (0.7426 => 0.7696, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (0.5584 => 0.5776, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.12% (11.6398 => 12.0034, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.10% (0.4253 => 0.4385, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.3498 => 0.3600, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (4.6926 => 4.8270, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 1.64% (11.9555 => 12.1517, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6749, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1918, std.dev.: 0.0097) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5067, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4404, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.51% (7.1849 => 7.2931, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5385, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5974, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.83% (2.4764 => 2.4311, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5600, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7901, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8060, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7965, std.dev.: 0.0825) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Sep 26 23:37:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 01:37:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927063703.DA74C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4294?compare_to=4291&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4294, Order: 164757, Start Time: 2012-09-27 05:24:02, End Time: 2012-09-27 06:38:37 To: 4291, Order: 164751, Start Time: 2012-09-27 03:40:39, End Time: 2012-09-27 04:55:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.07% (2.0176 => 2.4428, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.38% (0.0826 => 0.0953) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.89% (0.1588 => 0.1761, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.69% (3.9660 => 4.3898, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 10.61% (0.4328 => 0.4787, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.30% (1.3693 => 1.5104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.21% (0.2596 => 0.2861, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.03% (1.2193 => 1.3416, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.92% (0.7038 => 0.7736, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.88% (0.5265 => 0.5785, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.83% (0.9199 => 1.0103, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.7710 => 0.8466, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.63% (0.6959 => 0.7629, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.61% (0.1072 => 0.1175, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.55% (13.8202 => 15.1401, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.53% (0.2782 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.52% (1.4563 => 1.5950, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash: 9.50% (0.4062 => 0.4448, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.43% (1.1364 => 1.2436, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.25% (0.6283 => 0.6864, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.10% (0.3022 => 0.3297, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.10% (0.3485 => 0.3802, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.08% (0.3899 => 0.4253, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.06% (0.2726 => 0.2973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2760 => 0.3008, std.dev.: 0.0081) MultiSource/Applications/lemon/lemon: 8.98% (1.0313 => 1.1239, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.96% (0.2690 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 8.96% (0.3293 => 0.3588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.92% (0.3149 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.92% (0.3756 => 0.4091, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 8.90% (0.2607 => 0.2839, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.90% (0.2765 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2655 => 0.2891, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.89% (0.3489 => 0.3799, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.82% (1.9828 => 2.1577, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 8.82% (0.2937 => 0.3196, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.75% (0.2628 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.75% (0.5577 => 0.6065, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.75% (0.4791 => 0.5210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.72% (0.3107 => 0.3378, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.72% (0.4016 => 0.4366, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2761 => 0.3001, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.69% (0.3580 => 0.3891, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.66% (0.2966 => 0.3223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.63% (0.2988 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2127 => 0.2310) SingleSource/Benchmarks/Shootout-C++/moments: 8.58% (0.3868 => 0.4200, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 8.58% (0.2995 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4379 => 0.4752, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.46% (0.2696 => 0.2924, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 8.36% (0.3192 => 0.3459, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.30% (0.6576 => 0.7122, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.29% (1.1061 => 1.1978, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 8.28% (0.3453 => 0.3739, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.28% (7.2180 => 7.8158, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.27% (0.4390 => 0.4753, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 8.26% (0.8310 => 0.8996, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3578 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.18% (0.5637 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.17% (3.6692 => 3.9691, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 8.15% (0.3534 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3220 => 0.3476, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.94% (0.3789 => 0.4090, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.90% (0.7506 => 0.8099, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3663 => 0.3952, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.88% (3.8646 => 4.1693, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.84% (0.7460 => 0.8045, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.82% (3.1889 => 3.4382, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.67% (0.2945 => 0.3171, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.62% (0.2925 => 0.3148, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.59% (1.0594 => 1.1398, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.59% (0.3940 => 0.4239, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 7.57% (16.6129 => 17.8698, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 7.56% (0.6744 => 0.7254, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.40% (14.8535 => 15.9528, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.38% (0.3755 => 0.4032, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.33% (1.9270 => 2.0682, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.29% (0.8698 => 0.9332, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.26% (2.1791 => 2.3373, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.20% (1.3245 => 1.4199, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.15% (0.4113 => 0.4407, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 7.06% (1.2749 => 1.3649, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 7.02% (8.4961 => 9.0929, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.95% (0.1569 => 0.1678, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.85% (0.6135 => 0.6555, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.84% (4.3801 => 4.6795, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.78% (0.8818 => 0.9416, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.78% (4.4433 => 4.7445, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 6.74% (0.3131 => 0.3342, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.68% (0.2859 => 0.3050, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.67% (1.1333 => 1.2089, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.2140 => 0.2282, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.62% (13.2842 => 14.1635, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.59% (1.3819 => 1.4730, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3245 => 0.3455, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.43% (1.3813 => 1.4701, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.38% (4.6629 => 4.9606, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.38% (6.5754 => 6.9946, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 6.34% (14.5298 => 15.4506, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.23% (0.2504 => 0.2660, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.04% (1.2292 => 1.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.89% (3.2742 => 3.4671, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.82% (0.2321 => 0.2456, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.58% (0.4805 => 0.5073, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 5.57% (0.6250 => 0.6598, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.51% (0.9108 => 0.9610, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.35% (4.9865 => 5.2535, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.32% (1.5188 => 1.5996, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.15% (6.2785 => 6.6017, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.2008 => 0.2110, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.00% (3.7467 => 3.9339, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.82% (2.1007 => 2.2020, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.41% (0.3511 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.25% (33.2944 => 34.7092, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7779, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std.dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.2619 => 11.7223, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1198, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5874, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5173, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5842, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2253, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5849, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.29% (0.4657 => 0.3945, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.59% (22.5627 => 21.9774, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2808, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0274) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2382, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1352, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2297, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2540, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4349, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2623, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5646, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 00:05:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 02:05:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927070551.AABA22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4295?compare_to=4292&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4295, Order: 164757, Start Time: 2012-09-27 05:46:03, End Time: 2012-09-27 07:07:24 To: 4292, Order: 164754, Start Time: 2012-09-27 03:57:25, End Time: 2012-09-27 05:17:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (716 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.26% (0.5771 => 0.5756, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: -0.17% (16.0829 => 16.0549, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 0.22% (14.9209 => 14.9540, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 0.13% (83.0556 => 83.1652, std.dev.: 1.2674) MultiSource/Benchmarks/MallocBench/gs/gs: 0.00% (4.3554 => 4.3556, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2347 => 1.2338, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (7.5144 => 7.5108, std.dev.: 0.1951) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.11% (3.7133 => 3.7174, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.6456 => 0.6464, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (0.0648 => 0.0660, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.50% (63.2438 => 83.1652, std.dev.: 1.2674) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14225.69% (0.0720 => 10.3145, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.52% (10.3673 => 14.5679, std.dev.: 0.1735) SingleSource/Benchmarks/Misc/richards_benchmark: 30.39% (0.1622 => 0.2115, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.26% (2.2022 => 2.5382, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.05% (7.0540 => 8.1153, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.34% (1.1194 => 1.2575, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.94% (1.7609 => 1.9711, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 9.84% (0.3282 => 0.3605) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.75% (0.3497 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.64% (0.3516 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3694 => 0.4046, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.45% (0.3927 => 0.4298, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.40% (0.3828 => 0.4188, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.19% (0.3886 => 0.4243, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1440 => 0.1567, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.62% (10.4361 => 11.3352, std.dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: 8.45% (9.4845 => 10.2859, std.dev.: 0.2303) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.09% (0.3177 => 0.3434, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3307 => 0.3568, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.4879 => 0.5264, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.86% (0.7433 => 0.8017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.2700 => 0.2908, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.56% (0.3109 => 0.3344, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.55% (0.7115 => 0.7652, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.53% (0.6030 => 0.6484, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.51% (0.6675 => 0.7176, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.47% (3.3354 => 3.5847, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 7.36% (0.3423 => 0.3675, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.30% (1.5415 => 1.6540, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.20% (8.1363 => 8.7219, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 7.18% (5.7591 => 6.1727, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.18% (0.2271 => 0.2434, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.17% (1.3050 => 1.3986, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.09% (0.5105 => 0.5467, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.08% (0.5860 => 0.6275, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (4.2646 => 4.5647, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.90% (0.5569 => 0.5953, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7326 => 0.7828, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.78% (0.8067 => 0.8614, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.65% (5.0018 => 5.3343, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.64% (0.2107 => 0.2247, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.57% (0.7835 => 0.8350, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.57% (4.9449 => 5.2697, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.56% (0.2758 => 0.2939, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.51% (0.9765 => 1.0401, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.48% (1.0722 => 1.1417, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.45% (0.5020 => 0.5344, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.42% (1.1642 => 1.2389, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3121 => 0.3321, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.3092 => 0.3289, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.28% (0.3441 => 0.3657, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.26% (0.3387 => 0.3599, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.26% (3.8723 => 4.1146, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (1.1861 => 1.2603, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.06% (7.9617 => 8.4444, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: 6.02% (0.3422 => 0.3628, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2603 => 0.2759, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.95% (0.4636 => 0.4912, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 5.94% (0.3180 => 0.3369, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.4064 => 0.4304, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.87% (21.9371 => 23.2257, std.dev.: 0.0168) MultiSource/Applications/hbd/hbd: 5.86% (1.5603 => 1.6517, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 5.84% (0.6456 => 0.6833, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.67% (2.0273 => 2.1422, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 5.63% (0.4299 => 0.4541, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.62% (0.4289 => 0.4530, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.62% (0.4203 => 0.4439, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.58% (0.2905 => 0.3067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2891 => 0.3052, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 5.52% (2.2969 => 2.4238, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.6450 => 0.6804, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.47% (0.2872 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3865 => 0.4074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.40% (0.2831 => 0.2984, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.38% (0.3603 => 0.3797, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.36% (0.3283 => 0.3459, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.35% (0.4620 => 0.4867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.34% (0.8921 => 0.9397, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.33% (0.3098 => 0.3263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.31% (0.4048 => 0.4263, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.27% (1.5859 => 1.6695, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2871 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.08% (0.2714 => 0.2852, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2756 => 0.2896, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.5981 => 0.6281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3935 => 0.4130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.95% (0.3052 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.90% (2.2024 => 2.3103, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.90% (1.4186 => 1.4881, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.2802 => 0.2939, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (14.3668 => 15.0637, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/methcall: 4.83% (0.2877 => 0.3016, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 4.62% (0.3379 => 0.3535, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.1840 => 1.2363, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.61% (1.2842 => 1.3305, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.35% (0.8101 => 0.8372, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.62% (17.1811 => 17.6309, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (3.8922 => 3.9738, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7688, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.10% (4.2280 => 4.3589, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2554, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5831, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.33% (5.2763 => 3.2538, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.66% (5.3855 => 3.8961, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.27% (5.3526 => 3.8931, std.dev.: 0.0610) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0975, std.dev.: 0.0380) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.14% (2.9384 => 2.6110, std.dev.: 0.0648) MultiSource/Applications/ClamAV/clamscan: -8.47% (22.1758 => 20.2967, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2986, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -2.61% (1.2373 => 1.2050, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2495, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.71% (10.2830 => 10.1074, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0187, std.dev.: 0.0109) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2251, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.08% (0.5229 => 0.5756, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 7.11% (14.9895 => 16.0549, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 5.64% (14.1553 => 14.9540, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 5.96% (4.1105 => 4.3556, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.68% (1.1048 => 1.2338, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.93% (7.1582 => 7.5108, std.dev.: 0.1951) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.35% (3.4629 => 3.7174, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.6222 => 0.6464, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.81% (0.2116 => 0.0660, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 00:14:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 02:14:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927071425.C98F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4296?compare_to=4290&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4296, Order: 164759, Start Time: 2012-09-27 06:04:44, End Time: 2012-09-27 07:16:00 To: 4290, Order: 164751, Start Time: 2012-09-27 02:56:02, End Time: 2012-09-27 04:07:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (93 on baseline) Performance Improvements: 1 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (759 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.51% (0.1978 => 0.2087, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.7852 => 0.8066, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (2.3628 => 2.4092, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (0.7857 => 0.8006, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.9290 => 4.0027, std.dev.: 0.0255) MultiSource/Benchmarks/mafft/pairlocalalign: 1.15% (8.5105 => 8.6083, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 4.10% (1.7488 => 1.8205, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.75% (4.2793 => 4.3968, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.10% (4.5007 => 4.5951, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/spiff/spiff: -1.10% (2.8664 => 2.8350, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.16% (1.0257 => 1.0273, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 0.76% (0.5889 => 0.5934, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 4.45% (0.1482 => 0.1548, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.85% (0.1246 => 0.1294, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.36% (0.2911 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.76% (0.2227 => 0.2244, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.66% (0.3053 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.53% (0.2137 => 0.2083, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -18.82% (0.0287 => 0.0233, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: 58.93% (0.0056 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.95% (0.0082 => 0.0064, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0196 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.76% (0.0396 => 0.0393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.32% (0.0285 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0286 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.30% (0.0329 => 0.0328, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.10% (0.0181 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -34.18% (0.0196 => 0.0129, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -14.74% (0.0251 => 0.0214, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: 21.78% (0.0101 => 0.0123, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1446 => 0.1453, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.39% (1.5171 => 1.5112, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -7.18% (0.1519 => 0.1410, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4004 => 0.4061, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.83% (0.1452 => 0.1440, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 66.67% (0.0003 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.0580 => 0.0569, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.78% (0.0252 => 0.0259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.99% (0.0601 => 0.0553, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1250 => 1.1272, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 68.75% (0.0016 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.59% (0.0590 => 0.0557, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.36% (0.0144 => 0.0205, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7652 => 0.7655, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.02% (1.5975 => 1.5978, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.93% (4.1772 => 3.0940, std.dev.: 0.0884) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0068) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0004 => 0.0004, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.70% (2.1763 => 2.4092, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.92% (0.1159 => 0.1274, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.91% (0.1414 => 0.1540, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.75% (0.6410 => 0.6971, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 7.95% (0.5309 => 0.5731, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 7.31% (0.6173 => 0.6624, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 7.00% (1.0046 => 1.0749, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 6.85% (1.1653 => 1.2451, std.dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: 6.48% (0.6915 => 0.7363, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (1.5150 => 1.6100, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.97% (15.3105 => 16.2243, std.dev.: 0.2922) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.89% (0.3582 => 0.3793, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3217 => 0.3403, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.46% (0.3901 => 0.4114, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 5.18% (3.0225 => 3.1792, std.dev.: 0.0333) MultiSource/Benchmarks/Bullet/bullet: 5.01% (29.3170 => 30.7845, std.dev.: 0.1018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.00% (0.4880 => 0.5124, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.88% (0.7639 => 0.8012, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 4.86% (1.1440 => 1.1996, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 4.79% (2.0972 => 2.1976, std.dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: 4.74% (8.2186 => 8.6083, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (12.6413 => 13.2386, std.dev.: 0.0868) MultiSource/Applications/SPASS/SPASS: 4.63% (13.3238 => 13.9404, std.dev.: 0.0584) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.59% (1.4408 => 1.5070, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.45% (0.6069 => 0.6339, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.31% (0.4248 => 0.4431, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.15% (1.3268 => 1.3818, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.14% (0.8569 => 0.8924, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.98% (1.0689 => 1.1114, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.97% (0.2797 => 0.2908, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.95% (1.2021 => 1.2496, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.81% (4.7455 => 4.9265, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.8405 => 0.8722, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.76% (0.3062 => 0.3177, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (6.4908 => 6.7321, std.dev.: 0.0349) MultiSource/Applications/ClamAV/clamscan: 3.68% (14.6079 => 15.1458, std.dev.: 0.0511) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.68% (3.0758 => 3.1890, std.dev.: 0.0183) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.68% (0.7722 => 0.8006, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.1827 => 1.2256, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.7784 => 0.8066, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 3.61% (3.5980 => 3.7280, std.dev.: 0.0415) MultiSource/Applications/treecc/treecc: 3.56% (1.8798 => 1.9467, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2546 => 6.4736, std.dev.: 0.0262) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0821 => 1.1198, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 3.45% (14.7256 => 15.2339, std.dev.: 0.0816) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (4.0318 => 4.1699, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.3418 => 0.3530, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (3.8796 => 4.0027, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (4.2616 => 4.3925, std.dev.: 0.0480) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.86% (2.0317 => 2.0898, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.3847 => 0.3950, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (0.4562 => 0.4683, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.57% (1.4113 => 1.4475, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5636 => 0.5772, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.2815 => 4.3811, std.dev.: 0.0290) MultiSource/Applications/spiff/spiff: 2.11% (0.7738 => 0.7901, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.2742 => 1.3008, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (8.2559 => 8.4144, std.dev.: 0.0342) MultiSource/Applications/hexxagon/hexxagon: 1.11% (0.9425 => 0.9530, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 59.39% (0.0261 => 0.0416, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 41.17% (1.6538 => 2.3347, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0464) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.50% (0.0766 => 0.0923, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0627) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.57% (4.0101 => 4.5542, std.dev.: 0.1354) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6041, std.dev.: 0.0636) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.83% (1.0063 => 1.0851, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.3301 => 0.3500, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 5.05% (1.7330 => 1.8205, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.37% (4.2129 => 4.3968, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8461, std.dev.: 0.0583) SingleSource/Benchmarks/Misc/dt: 4.03% (0.9851 => 1.0248, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (40.4792 => 42.0036, std.dev.: 0.4664) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.92% (14.4877 => 14.9101, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 2.70% (3.8907 => 3.9957, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8090, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/mason/mason: 2.54% (0.5004 => 0.5131, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 2.35% (3.5520 => 3.6353, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/ReedSolomon: 2.32% (8.5113 => 8.7090, std.dev.: 0.0607) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.28% (2.6656 => 2.7265, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/whetstone: 2.02% (2.3453 => 2.3927, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.27% (4.5374 => 4.5951, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.15% (38.9255 => 39.3719, std.dev.: 0.1319) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.04% (0.3497 => 0.2062, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0778, std.dev.: 0.0696) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.80% (1.1647 => 0.9574, std.dev.: 0.0295) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.05% (15.8312 => 13.2910, std.dev.: 0.1442) MultiSource/Applications/sgefa/sgefa: -12.60% (0.3746 => 0.3274, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0484) SingleSource/Benchmarks/Shootout-C++/moments: -10.86% (0.1114 => 0.0993, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9363, std.dev.: 0.0758) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3736, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3275, std.dev.: 0.0644) MultiSource/Benchmarks/FreeBench/distray/distray: -6.57% (0.2664 => 0.2489, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -6.44% (7.6833 => 7.1882, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3532, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: -6.13% (3.4230 => 3.2132, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: -5.52% (62.4126 => 58.9678, std.dev.: 0.0397) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1856, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.27% (2.5166 => 2.4092, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/methcall: -4.04% (9.2503 => 8.8763, std.dev.: 0.0695) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.31% (0.4140 => 0.4003, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/misr: -3.17% (0.4296 => 0.4160, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8204, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std.dev.: 0.0311) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.71% (3.7496 => 3.6481, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.17% (1.1683 => 1.1429, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -2.11% (1.0926 => 1.0696, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.07% (61.1734 => 59.9060, std.dev.: 0.4608) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3644, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3134, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.73% (92.7467 => 91.1405, std.dev.: 0.3232) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.44% (2.8964 => 2.8546, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3084, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.31% (1.8739 => 1.8494, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -1.28% (2.4971 => 2.4651, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: -1.18% (3.4876 => 3.4464, std.dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.94% (0.9980 => 1.0273, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: -1.46% (0.6022 => 0.5934, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -7.08% (0.1666 => 0.1548, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.73% (0.1554 => 0.1294, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.46% (0.3083 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.27% (0.2394 => 0.2244, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.47% (0.3175 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.51% (0.2302 => 0.2083, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -48.11% (0.0449 => 0.0233, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -73.33% (0.0240 => 0.0064, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -31.75% (0.0189 => 0.0129, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -14.06% (0.0249 => 0.0214, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -62.15% (0.0325 => 0.0123, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 0.62% (1.5019 => 1.5112, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -6.06% (0.1501 => 0.1410, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.76% (0.4264 => 0.4061, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.40% (0.0589 => 0.0569, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.64% (0.0232 => 0.0259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.46% (0.0639 => 0.0553, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.69% (1.1350 => 1.1272, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.56% (0.0637 => 0.0557, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.67% (0.0246 => 0.0205, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.00% (1.5363 => 1.5978, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 01:25:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 03:25:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927082533.0D8DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4297?compare_to=4294&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4297, Order: 164759, Start Time: 2012-09-27 07:12:14, End Time: 2012-09-27 08:27:06 To: 4294, Order: 164757, Start Time: 2012-09-27 05:24:02, End Time: 2012-09-27 06:38:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (54.9834 => 56.4583, std.dev.: 0.0712) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.26% (1.2264 => 1.2109, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.90% (2.0176 => 2.4393, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.96% (3.9660 => 4.4005, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.89% (0.1588 => 0.1761, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.88% (0.2721 => 0.3017, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 10.75% (0.7061 => 0.7820, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 10.65% (0.4328 => 0.4789, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.65% (0.7710 => 0.8531, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 10.64% (1.3693 => 1.5150, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.43% (0.2781 => 0.3071, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.25% (0.2596 => 0.2862, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.23% (1.2193 => 1.3440, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.17% (0.7038 => 0.7754, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.05% (0.5265 => 0.5794, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.99% (0.9199 => 1.0118, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.97% (0.3130 => 0.3442, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 9.90% (0.4062 => 0.4464, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.76% (0.6959 => 0.7638, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.3899 => 0.4279, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 9.67% (0.2607 => 0.2859, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.64% (1.1364 => 1.2459, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.63% (0.3022 => 0.3313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.56% (13.8202 => 15.1420, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.54% (1.4563 => 1.5953, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.50% (0.3485 => 0.3816, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.49% (0.2760 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.34% (0.2966 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.34% (0.4016 => 0.4391, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.34% (1.9828 => 2.1679, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.27% (0.3580 => 0.3912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.26% (0.3293 => 0.3598, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.26% (0.3489 => 0.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.25% (0.6283 => 0.6864, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.24% (0.2726 => 0.2978, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.24% (0.2761 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.09% (0.3453 => 0.3767, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.3756 => 0.4097, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 9.06% (1.0313 => 1.1247, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.05% (0.2995 => 0.3266, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.00% (0.5577 => 0.6079, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 8.92% (0.3107 => 0.3384, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 8.90% (0.2988 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.86% (0.3149 => 0.3428, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.84% (0.3868 => 0.4210, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 8.83% (0.3192 => 0.3474, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.63% (0.4379 => 0.4757, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.62% (0.4791 => 0.5204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3534 => 0.3835, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.50% (0.4390 => 0.4763, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.44% (7.2180 => 7.8271, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 8.44% (0.8310 => 0.9011, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 8.44% (1.1061 => 1.1994, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.38% (3.6692 => 3.9766, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.32% (0.5637 => 0.6106, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.32% (3.8646 => 4.1860, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.21% (0.7506 => 0.8122, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.20% (0.6576 => 0.7115, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.12% (0.2945 => 0.3184, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.11% (0.2023 => 0.2187, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.07% (0.7460 => 0.8062, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 8.06% (0.3623 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.01% (0.3220 => 0.3478, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.95% (16.6129 => 17.9330, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.88% (0.1865 => 0.2012, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.77% (0.6744 => 0.7268, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 7.76% (3.1889 => 3.4365, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 7.76% (0.2925 => 0.3152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.70% (0.3755 => 0.4044, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.66% (2.1791 => 2.3460, std.dev.: 0.0099) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.59% (1.0594 => 1.1398, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 7.59% (0.4113 => 0.4425, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.52% (1.9270 => 2.0720, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.50% (0.8698 => 0.9350, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.42% (1.3245 => 1.4228, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 7.41% (14.8535 => 15.9540, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 7.25% (1.2749 => 1.3673, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.24% (0.8818 => 0.9456, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.13% (4.4433 => 4.7600, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 7.11% (8.4961 => 9.1005, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.11% (4.3801 => 4.6916, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.99% (0.6135 => 0.6564, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.87% (1.1333 => 1.2112, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (1.3819 => 1.4766, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.84% (1.3813 => 1.4758, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 6.83% (4.6629 => 4.9814, std.dev.: 0.0117) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.75% (13.2842 => 14.1810, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.73% (0.2140 => 0.2284, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.65% (0.2859 => 0.3049, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3245 => 0.3459, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.54% (14.5298 => 15.4799, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 6.49% (1.2292 => 1.3090, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (6.5754 => 6.9922, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.08% (3.2742 => 3.4733, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.99% (0.9108 => 0.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.83% (0.4805 => 0.5085, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 5.82% (0.6250 => 0.6614, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.53% (0.2008 => 0.2119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.33% (1.5188 => 1.5998, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.31% (4.9865 => 5.2513, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (6.2785 => 6.6010, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 5.12% (3.7467 => 3.9384, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.03% (2.1007 => 2.2064, std.dev.: 0.0190) MultiSource/Benchmarks/Bullet/bullet: 4.21% (33.2944 => 34.6977, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.96% (0.3511 => 0.3650, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.20% (16.2614 => 16.7813, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std.dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (3.1736 => 3.4112, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7238, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.59% (10.7476 => 11.1336, std.dev.: 0.0567) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5887, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5823, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2267, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5846, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.10% (0.4657 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.65% (22.5627 => 21.9642, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2839, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.66% (1.3780 => 1.3000, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.31% (3.2729 => 3.1645, std.dev.: 0.0142) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9457, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2323, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -1.62% (1.2308 => 1.2109, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1487, std.dev.: 0.0309) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2230, std.dev.: 0.0291) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2633, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 01:40:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 03:40:53 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927084053.330322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4298?compare_to=4296&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4298, Order: 164760, Start Time: 2012-09-27 07:32:04, End Time: 2012-09-27 08:42:28 To: 4296, Order: 164759, Start Time: 2012-09-27 06:04:44, End Time: 2012-09-27 07:16:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (86 on baseline) Performance Improvements: 5 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (765 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 3.34% (8.7639 => 9.0567, std.dev.: 0.0266) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.22% (2.4032 => 2.4806, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/ReedSolomon: 1.69% (8.7090 => 8.8566, std.dev.: 0.0419) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.30% (2.8546 => 2.8918, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.21% (0.7901 => 0.7726, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: -1.83% (1.1996 => 1.1776, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.76% (0.8066 => 0.7924, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -4.49% (1.8205 => 1.7387, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.11% (4.5951 => 4.4983, std.dev.: 0.0305) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.58% (1.0273 => 1.0213, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 0.19% (0.5934 => 0.5945, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -0.84% (0.1548 => 0.1535, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.10% (0.1294 => 0.1347, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.33% (0.3038 => 0.3028, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.56% (0.2244 => 0.2209, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3033 => 0.3033, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (0.2083 => 0.2127, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 21.89% (0.0233 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 29.69% (0.0064 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0196 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.02% (0.0393 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0303 => 0.0305, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0286 => 0.0287, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.91% (0.0328 => 0.0325, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -0.55% (0.0183 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 51.94% (0.0129 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 17.29% (0.0214 => 0.0251, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -19.51% (0.0123 => 0.0099, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1453 => 0.1453, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -1.79% (1.5112 => 1.4841, std.dev.: 0.0271) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.77% (0.1410 => 0.1449, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.25% (0.4061 => 0.4051, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.99% (0.1440 => 0.1397, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.56% (0.0569 => 0.0526, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.65% (0.0259 => 0.0234, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.37% (0.0553 => 0.0638, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1272 => 1.1266, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.36% (0.0557 => 0.0598, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.95% (0.0205 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7655 => 0.7647, std.dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.08% (1.5978 => 1.5991, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.12% (4.1772 => 3.0442, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout-C++/except: 83316.67% (0.0006 => 0.5005, std.dev.: 0.0121) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.62% (0.1414 => 0.1550, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.23% (0.1159 => 0.1266, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 8.83% (0.5309 => 0.5778, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6410 => 0.6968, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 8.55% (2.1763 => 2.3624, std.dev.: 0.0370) MultiSource/Applications/lemon/lemon: 7.03% (1.0046 => 1.0752, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.85% (0.6173 => 0.6596, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 6.62% (1.1653 => 1.2425, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 5.99% (15.3105 => 16.2269, std.dev.: 0.0517) MultiSource/Applications/lambda-0_1_3/lambda: 5.71% (0.6915 => 0.7310, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.69% (1.5150 => 1.6012, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.58% (0.4248 => 0.4485, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.95% (0.3901 => 0.4094, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (12.6413 => 13.2551, std.dev.: 0.1700) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.84% (0.7639 => 0.8009, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 4.75% (3.0225 => 3.1661, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 4.64% (29.3170 => 30.6779, std.dev.: 0.3834) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.56% (1.1672 => 1.2204, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 4.51% (0.3217 => 0.3362, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.48% (2.0317 => 2.1227, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.43% (0.6069 => 0.6338, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.18% (0.4880 => 0.5084, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.07% (13.3238 => 13.8657, std.dev.: 0.0263) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (8.2186 => 8.5512, std.dev.: 0.0723) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.99% (0.2654 => 0.2760, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (1.4408 => 1.4976, std.dev.: 0.0183) MultiSource/Applications/siod/siod: 3.91% (2.0972 => 2.1792, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 3.88% (4.7455 => 4.9295, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.83% (0.7226 => 0.7503, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.78% (0.2886 => 0.2995, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.71% (3.0758 => 3.1898, std.dev.: 0.0435) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.59% (1.1827 => 1.2251, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (6.2546 => 6.4762, std.dev.: 0.0744) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.54% (1.4113 => 1.4613, std.dev.: 0.0093) MultiSource/Applications/hbd/hbd: 3.50% (1.3268 => 1.3732, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.42% (0.3008 => 0.3111, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.27% (1.2021 => 1.2414, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4562 => 0.4709, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.22% (14.6079 => 15.0784, std.dev.: 0.0166) MultiSource/Applications/lua/lua: 3.18% (3.5980 => 3.7125, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (6.4908 => 6.6920, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.08% (0.8569 => 0.8833, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.97% (1.4189 => 1.4611, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.0689 => 1.1003, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 2.94% (1.1440 => 1.1776, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 2.92% (14.7256 => 15.1553, std.dev.: 0.0259) MultiSource/Applications/treecc/treecc: 2.85% (1.8798 => 1.9333, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 2.65% (0.3847 => 0.3949, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (3.8796 => 3.9806, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.26% (4.2616 => 4.3580, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.18% (0.9029 => 0.9226, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (8.2559 => 8.4180, std.dev.: 0.0245) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7784 => 0.7924, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 1.24% (0.9425 => 0.9542, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.17% (0.0261 => 0.0405, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/ary3: 14.89% (1.7426 => 2.0020, std.dev.: 0.0229) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.74% (0.0917 => 0.1043, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.05% (4.0101 => 4.5333, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6065, std.dev.: 0.0270) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.36% (1.0063 => 1.0904, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3301 => 0.3503, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.20% (2.3580 => 2.4806, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.26% (40.4792 => 42.2051, std.dev.: 0.5605) SingleSource/Benchmarks/Misc/dt: 4.21% (0.9851 => 1.0266, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 4.06% (8.5113 => 8.8566, std.dev.: 0.0419) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.93% (0.8498 => 0.8832, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8217, std.dev.: 0.0586) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5382, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.11% (2.6656 => 2.7486, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8997, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 2.67% (3.5520 => 3.6468, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 2.64% (3.8907 => 3.9933, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (6.6312 => 6.8040, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.6308 => 0.6464, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (2.4013 => 2.4486, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.31% (4.6127 => 4.6732, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.18% (0.3497 => 0.2092, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.95% (5.2665 => 4.1630, std.dev.: 0.0665) SingleSource/Benchmarks/Shootout-C++/ary3: -20.51% (1.7473 => 1.3890, std.dev.: 0.0370) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.1647 => 0.9598, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.67% (15.8312 => 13.1922, std.dev.: 0.2285) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.78% (0.0917 => 0.0809, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -10.81% (0.3746 => 0.3341, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: -10.23% (0.1114 => 0.1000, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9374, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3759, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3288, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: -6.40% (7.6833 => 7.1917, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: -6.09% (3.4230 => 3.2144, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7919, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -6.00% (1.4441 => 1.3575, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9375, std.dev.: 0.0842) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1844, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.41% (45.4683 => 43.4648, std.dev.: 0.3491) MultiSource/Benchmarks/Olden/bh/bh: -4.27% (2.5166 => 2.4092, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -4.03% (1.8739 => 1.7984, std.dev.: 0.0264) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.88% (1.2722 => 1.2228, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.28% (3.7496 => 3.6268, std.dev.: 0.0475) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.17% (3.9413 => 3.8163, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -3.12% (9.2503 => 8.9613, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (92.7467 => 90.6149, std.dev.: 0.5227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.10% (61.1734 => 59.8889, std.dev.: 0.2251) MultiSource/Benchmarks/FreeBench/neural/neural: -2.01% (1.0926 => 1.0706, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4189, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3119, std.dev.: 0.0168) MultiSource/Applications/aha/aha: -1.80% (3.4286 => 3.3669, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2399, std.dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/fldry: -1.43% (2.4971 => 2.4615, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3071, std.dev.: 0.0188) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.33% (0.9980 => 1.0213, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.28% (0.6022 => 0.5945, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -7.86% (0.1666 => 0.1535, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.32% (0.1554 => 0.1347, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.78% (0.3083 => 0.3028, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.73% (0.2394 => 0.2209, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.47% (0.3175 => 0.3033, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.60% (0.2302 => 0.2127, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: -36.75% (0.0449 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -69.54% (0.0325 => 0.0099, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -1.19% (1.5019 => 1.4841, std.dev.: 0.0271) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.46% (0.1501 => 0.1449, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.00% (0.4264 => 0.4051, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1344 => 0.1397, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.70% (0.0589 => 0.0526, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.86% (0.0232 => 0.0234, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.16% (0.0639 => 0.0638, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1350 => 1.1266, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.12% (0.0637 => 0.0598, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.96% (0.0246 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7541 => 0.7647, std.dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.09% (1.5363 => 1.5991, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 01:55:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 03:55:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927085553.A26722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4299?compare_to=4295&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4299, Order: 164760, Start Time: 2012-09-27 07:37:09, End Time: 2012-09-27 08:57:27 To: 4295, Order: 164757, Start Time: 2012-09-27 05:46:03, End Time: 2012-09-27 07:07:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.27% (14.5679 => 14.8984, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 2.17% (1.2050 => 1.2312, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.07% (55.3384 => 56.4831, std.dev.: 0.0457) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (0.5756 => 0.5815, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 0.17% (16.0549 => 16.0818, std.dev.: 0.0292) MultiSource/Applications/kimwitu++/kc: -0.32% (14.9540 => 14.9057, std.dev.: 0.0165) MultiSource/Benchmarks/Bullet/bullet: 0.32% (83.1652 => 83.4341, std.dev.: 0.0894) MultiSource/Benchmarks/MallocBench/gs/gs: 0.07% (4.3556 => 4.3585, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2338 => 1.2332, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (7.5108 => 7.5187, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.22% (3.7174 => 3.7255, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6464 => 0.6459, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.94% (0.0660 => 0.0686, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.92% (63.2438 => 83.4341, std.dev.: 0.0894) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14232.22% (0.0720 => 10.3192, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.71% (10.3673 => 14.8984, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: 32.06% (0.1622 => 0.2142, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.99% (2.2022 => 2.5324, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.85% (7.0540 => 8.1017, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.03% (0.1566 => 0.1770, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.51% (1.1194 => 1.2594, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.02% (1.7609 => 1.9725, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3543 => 0.3907, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.60% (0.3282 => 0.3597, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 8.96% (0.1440 => 0.1569, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.81% (10.4361 => 11.3556, std.dev.: 0.0194) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 8.37% (9.4845 => 10.2782, std.dev.: 0.0135) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3423 => 0.3695, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.87% (0.4879 => 0.5263, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.80% (0.3307 => 0.3565, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.76% (0.5860 => 0.6315, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 7.75% (0.5925 => 0.6384, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.63% (0.7115 => 0.7658, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.48% (0.2700 => 0.2902, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.47% (0.7433 => 0.7988, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.44% (0.2271 => 0.2440, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.43% (1.5415 => 1.6560, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.41% (0.4615 => 0.4957, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 7.41% (3.3354 => 3.5825, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.37% (0.6675 => 0.7167, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.32% (4.2646 => 4.5769, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 7.32% (5.7591 => 6.1804, std.dev.: 0.0123) MultiSource/Applications/sgefa/sgefa: 7.27% (0.3109 => 0.3335, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.27% (0.5105 => 0.5476, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.26% (1.3050 => 1.3998, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.25% (8.1363 => 8.7263, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: 7.24% (0.2554 => 0.2739, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 7.19% (0.7835 => 0.8398, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.8172 => 0.8744, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7326 => 0.7835, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.88% (0.5569 => 0.5952, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.74% (0.2107 => 0.2249, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.70% (4.9449 => 5.2762, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.8067 => 0.8606, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.66% (5.0018 => 5.3350, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.50% (0.3121 => 0.3324, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 6.49% (1.1642 => 1.2398, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.45% (0.2758 => 0.2936, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.44% (0.1940 => 0.2065, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.3092 => 0.3289, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.34% (0.9765 => 1.0384, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 6.31% (1.0722 => 1.1399, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 6.29% (0.3387 => 0.3600, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (1.1861 => 1.2606, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 6.17% (3.8723 => 4.1112, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.16% (0.5020 => 0.5329, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.15% (7.9617 => 8.4510, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3441 => 0.3652, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 6.03% (1.5603 => 1.6544, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.92% (0.2603 => 0.2757, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.89% (0.6456 => 0.6836, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.84% (0.3422 => 0.3622, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.82% (0.4636 => 0.4906, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 5.79% (0.3180 => 0.3364, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.74% (21.9371 => 23.1956, std.dev.: 0.0229) MultiSource/Applications/treecc/treecc: 5.70% (2.0273 => 2.1429, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.53% (0.2891 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3865 => 0.4078, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.51% (0.2905 => 0.3065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.46% (0.4289 => 0.4523, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 5.43% (2.2969 => 2.4216, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.4103 => 0.4325, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.37% (0.8921 => 0.9400, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6450 => 0.6796, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.34% (0.3650 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.26% (0.4203 => 0.4424, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2725 => 0.2867, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3826 => 0.4025, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.13% (0.4620 => 0.4857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2756 => 0.2897, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.07% (0.3136 => 0.3295, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.05% (0.5981 => 0.6283, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 5.02% (0.2831 => 0.2973, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (2.0665 => 2.1699, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 4.98% (0.3052 => 0.3204, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.4186 => 1.4892, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.97% (1.5859 => 1.6647, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.94% (0.3098 => 0.3251, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3232 => 0.3391, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.92% (0.4048 => 0.4247, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.88% (0.2871 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.86% (0.3603 => 0.3778, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3935 => 0.4126, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.84% (0.3283 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2872 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.82% (2.2024 => 2.3085, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.81% (0.3162 => 0.3314, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (14.3668 => 15.0558, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2802 => 0.2936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3684 => 0.3859, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 4.55% (0.2877 => 0.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.44% (0.3379 => 0.3529, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.1840 => 1.2363, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2842 => 1.3281, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.37% (0.8101 => 0.8374, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.47% (17.1811 => 17.6058, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (3.8922 => 3.9617, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3821, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7686, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3469, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.56% (9.1159 => 9.2582, std.dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5828, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.39% (5.2763 => 3.2505, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.55% (5.3855 => 3.9016, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.12% (5.3526 => 3.9012, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1605, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.21% (2.9384 => 2.6090, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -8.43% (22.1758 => 20.3072, std.dev.: 0.0371) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.54% (1.5373 => 1.3753, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3006, std.dev.: 0.0857) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7110, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4968, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4983, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/salsa20: -2.05% (10.2830 => 10.0719, std.dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0074, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2547, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2245, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.21% (0.5229 => 0.5815, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 7.29% (14.9895 => 16.0818, std.dev.: 0.0292) MultiSource/Applications/kimwitu++/kc: 5.30% (14.1553 => 14.9057, std.dev.: 0.0165) MultiSource/Benchmarks/MallocBench/gs/gs: 6.03% (4.1105 => 4.3585, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.62% (1.1048 => 1.2332, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.04% (7.1582 => 7.5187, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.58% (3.4629 => 3.7255, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.81% (0.6222 => 0.6459, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 02:31:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 04:31:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120927093130.63BD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4300?compare_to=4293&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4300, Order: 164759, Start Time: 2012-09-27 06:46:47, End Time: 2012-09-27 09:33:04 To: 4293, Order: 164751, Start Time: 2012-09-27 03:33:49, End Time: 2012-09-27 06:17:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (777 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 10.91% (0.3446 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.91% (0.3465 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.89% (0.3442 => 0.3817, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3488 => 0.3867, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 10.78% (0.3496 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.75% (0.3469 => 0.3842, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3460 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.55% (0.3650 => 0.4035, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.43% (0.3643 => 0.4023, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.20% (0.3724 => 0.4104, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.72% (1.5932 => 1.7481, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.5889 => 0.6368, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5826 => 0.6291, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.1619 => 0.1737, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2738 => 0.2930, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.99% (0.4994 => 0.5343, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (1.6211 => 1.7341, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.96% (0.2875 => 0.3075, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.89% (0.3004 => 0.3211, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.87% (1.3152 => 1.4055, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.85% (0.9909 => 1.0588, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2803 => 0.2995, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 6.78% (0.7171 => 0.7657, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 6.76% (0.2750 => 0.2936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.73% (0.2823 => 0.3013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.68% (0.2813 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.2780 => 0.2965, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.64% (0.5000 => 0.5332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.60% (3.5627 => 3.7979, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.59% (0.2792 => 0.2976, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.54% (5.5417 => 5.9044, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3317 => 0.3533, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2811 => 0.2994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2729 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.2736 => 0.2913, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.44% (0.4361 => 0.4642, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.39% (0.2911 => 0.3097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.36% (0.3348 => 0.3561, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.36% (0.3930 => 0.4180, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.3096 => 0.3292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.32% (0.3258 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3267 => 0.3473, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.29% (2.7292 => 2.9008, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 6.23% (1.0781 => 1.1453, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.21% (0.3060 => 0.3250, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.08% (0.3124 => 0.3314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.07% (0.3726 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.2866 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.04% (0.3678 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.03% (0.3282 => 0.3480, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.01% (0.3362 => 0.3564, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.96% (0.2566 => 0.2719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.92% (0.3477 => 0.3683, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 5.87% (23.5202 => 24.9011, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.5900 => 0.6239, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.3845 => 0.4065, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (0.5026 => 0.5309, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 5.60% (0.4146 => 0.4378, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.58% (0.3690 => 0.3896, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.54% (4.2109 => 4.4440, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 5.53% (0.6634 => 0.7001, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 5.53% (0.4251 => 0.4486, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.48% (0.3981 => 0.4199, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (4.4195 => 4.6614, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.28% (2.1013 => 2.2122, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 5.23% (1.8794 => 1.9776, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.19% (0.4139 => 0.4354, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (0.3890 => 0.4091, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.16% (0.3336 => 0.3508, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.11% (0.4658 => 0.4896, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 5.09% (1.4269 => 1.4995, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.07% (0.3903 => 0.4101, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 5.01% (4.6177 => 4.8490, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.82% (0.2737 => 0.2869, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (2.1653 => 2.2689, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 4.73% (0.9697 => 1.0156, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 4.62% (0.5546 => 0.5802, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.3271 => 0.3420, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 4.50% (0.2691 => 0.2812, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (1.9966 => 2.0861, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (1.9694 => 2.0567, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.2969 => 0.3099, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.22% (0.7875 => 0.8207, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.05% (2.0346 => 2.1171, std.dev.: 0.0151) MultiSource/Benchmarks/PAQ8p/paq8p: 3.88% (0.4847 => 0.5035, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.09% (11.6398 => 12.0000, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.3498 => 0.3603, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.63% (11.9555 => 12.1506, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 8.77% (0.2122 => 0.2308, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6695, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.78% (15.4430 => 16.1814, std.dev.: 0.1272) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6435, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1998, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5061, std.dev.: 0.0253) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4343, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5301, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7942, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7902, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.13% (17.2379 => 16.8707, std.dev.: 0.0420) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0446, std.dev.: 0.0624) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 03:08:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 05:08:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927100847.BD4352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4301?compare_to=4298&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4301, Order: 164762, Start Time: 2012-09-27 08:58:54, End Time: 2012-09-27 10:10:22 To: 4298, Order: 164760, Start Time: 2012-09-27 07:32:04, End Time: 2012-09-27 08:42:28 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (91 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 896 (760 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.60% (1.7984 => 1.8632, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 1.74% (3.0442 => 3.0971, std.dev.: 0.0145) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.0210 => 1.0322, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.45% (0.4485 => 0.4375, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.42% (2.1227 => 2.0925, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.43% (1.0213 => 1.0169, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.10% (0.5945 => 0.5939, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 0.07% (0.1535 => 0.1536, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.67% (0.1347 => 0.1338, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (0.3028 => 0.3022, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.08% (0.2209 => 0.2255, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3033 => 0.3032, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.49% (0.2127 => 0.2074, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -3.52% (0.0284 => 0.0274, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0091 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.20% (0.0083 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.02% (0.0196 => 0.0198, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.20% (0.0389 => 0.0326, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0305 => 0.0306, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0287 => 0.0288, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.08% (0.0325 => 0.0302, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 1.65% (0.0182 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -43.37% (0.0196 => 0.0111, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 2.79% (0.0251 => 0.0258, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 29.29% (0.0099 => 0.0128, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.75% (0.1453 => 0.1413, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.47% (1.4841 => 1.5059, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.00% (0.1449 => 0.1420, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.54% (0.4051 => 0.4029, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.86% (0.1397 => 0.1409, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.40% (0.0526 => 0.0607, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.24% (0.0234 => 0.0196, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.23% (0.0638 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1266 => 1.1322, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 220.00% (0.0005 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.85% (0.0598 => 0.0633, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.50% (0.0160 => 0.0204, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.7647 => 0.7664, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.53% (1.5991 => 1.6076, std.dev.: 0.0084) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.86% (4.1772 => 3.0971, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0095) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: -50.00% (0.0004 => 0.0002, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.70% (0.0745 => 0.0929, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 8.55% (2.1763 => 2.3624, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.53% (0.6410 => 0.6957, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.35% (0.1414 => 0.1532, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 8.33% (0.5309 => 0.5751, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 7.16% (1.0046 => 1.0765, std.dev.: 0.0116) MultiSource/Applications/minisat/minisat: 6.80% (0.6173 => 0.6593, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 6.67% (1.1653 => 1.2430, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.14% (0.3582 => 0.3802, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.78% (15.3105 => 16.1957, std.dev.: 0.0450) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.2552 => 0.2696, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.54% (0.3901 => 0.4117, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 5.41% (0.6915 => 0.7289, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.5150 => 1.5931, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.84% (12.6413 => 13.2532, std.dev.: 0.0379) MultiSource/Benchmarks/Bullet/bullet: 4.84% (29.3170 => 30.7348, std.dev.: 0.2380) MultiSource/Applications/oggenc/oggenc: 4.78% (4.7455 => 4.9721, std.dev.: 0.0328) MultiSource/Applications/d/make_dparser: 4.76% (3.0225 => 3.1664, std.dev.: 0.0258) MultiSource/Benchmarks/McCat/18-imp/imp: 4.76% (0.3217 => 0.3370, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.65% (0.6069 => 0.6351, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.63% (0.7639 => 0.7993, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 4.49% (2.0972 => 2.1913, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 4.44% (13.3238 => 13.9148, std.dev.: 0.0667) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.2797 => 0.2916, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.18% (0.7226 => 0.7528, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.97% (1.2021 => 1.2498, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.92% (0.2654 => 0.2758, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.91% (1.1440 => 1.1887, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.79% (3.0758 => 3.1924, std.dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (8.2186 => 8.5273, std.dev.: 0.0642) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.58% (1.1672 => 1.2090, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (6.4908 => 6.7200, std.dev.: 0.0531) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.50% (0.8569 => 0.8869, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.48% (1.4408 => 1.4909, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.40% (0.3062 => 0.3166, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.36% (6.2546 => 6.4648, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.32% (4.0318 => 4.1656, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.30% (1.0821 => 1.1178, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4880 => 0.5038, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 3.11% (0.8405 => 0.8666, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5520 => 0.5690, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.05% (0.5937 => 0.6118, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (2.0317 => 2.0925, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.99% (0.4248 => 0.4375, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.0689 => 1.1008, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.88% (1.4189 => 1.4597, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.7256 => 15.1437, std.dev.: 0.1105) MultiSource/Applications/lua/lua: 2.77% (3.5980 => 3.6978, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.4113 => 1.4503, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.57% (1.2742 => 1.3070, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (4.2616 => 4.3703, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.54% (4.3380 => 4.4480, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.31% (4.2815 => 4.3802, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.15% (0.5963 => 0.6091, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9029 => 0.9212, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8796 => 3.9527, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (8.2559 => 8.4095, std.dev.: 0.0349) MultiSource/Applications/hexxagon/hexxagon: 1.39% (0.9425 => 0.9556, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.28% (1.3935 => 1.4113, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 44.83% (0.0261 => 0.0378, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.45% (0.0917 => 0.1077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.91% (1.7426 => 2.0024, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.82% (4.0101 => 4.5641, std.dev.: 0.0223) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 9.19% (7.0025 => 7.6462, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.79% (0.2857 => 0.3108, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.97% (1.0063 => 1.0865, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.95% (0.5876 => 0.6167, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8501, std.dev.: 0.0380) SingleSource/Benchmarks/Misc/ReedSolomon: 4.02% (8.5113 => 8.8536, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.92% (0.8498 => 0.8831, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: 3.86% (0.9851 => 1.0231, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.85% (14.4877 => 14.9013, std.dev.: 0.0594) MultiSource/Benchmarks/FreeBench/mason/mason: 2.72% (0.5004 => 0.5140, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8100, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.65% (3.5520 => 3.6462, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.39% (2.6656 => 2.7292, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/whetstone: 2.26% (2.3453 => 2.3983, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.24% (4.6127 => 4.7159, std.dev.: 0.0212) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (2.4013 => 2.4505, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/power/power: 1.42% (1.4184 => 1.4386, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.0194 => 1.0322, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4455 => 2.4743, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.15% (4.0659 => 4.1128, std.dev.: 0.0163) MultiSource/Benchmarks/BitBench/five11/five11: 1.07% (5.1938 => 5.2494, std.dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.03% (27.1724 => 27.4511, std.dev.: 0.0987) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.69% (0.3497 => 0.2039, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.48% (0.0311 => 0.0210, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.45% (5.2665 => 4.1369, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/ary3: -20.29% (1.7473 => 1.3928, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.1647 => 0.9608, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.76% (15.8312 => 13.1783, std.dev.: 0.2018) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1615, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.89% (0.0917 => 0.0808, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: -11.13% (0.3746 => 0.3329, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -9.96% (0.1114 => 0.1003, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.46% (3.2007 => 2.9618, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3748, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8721, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3336, std.dev.: 0.0482) MultiSource/Applications/lambda-0_1_3/lambda: -6.37% (7.6833 => 7.1936, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3533, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9439, std.dev.: 0.0769) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (3.4230 => 3.2405, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/fib2: -5.10% (4.4195 => 4.1943, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -4.20% (2.5166 => 2.4110, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: -4.05% (0.2664 => 0.2556, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.78% (1.2722 => 1.2241, std.dev.: 0.0127) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.69% (1.2959 => 1.2481, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.21% (0.4140 => 0.4007, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: -3.14% (0.4296 => 0.4161, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8202, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9785, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2916, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.44% (1.1683 => 1.1398, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9808, std.dev.: 0.3334) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3645, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.4876 => 3.4239, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2339, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.3569 => 2.3207, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3142, std.dev.: 0.0874) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.89% (0.9980 => 1.0169, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -1.38% (0.6022 => 0.5939, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: -7.80% (0.1666 => 0.1536, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.90% (0.1554 => 0.1338, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.98% (0.3083 => 0.3022, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.81% (0.2394 => 0.2255, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.50% (0.3175 => 0.3032, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.90% (0.2302 => 0.2074, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -38.98% (0.0449 => 0.0274, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.83% (0.0240 => 0.0082, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.13% (0.0192 => 0.0198, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.41% (0.0390 => 0.0326, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.66% (0.0301 => 0.0306, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.79% (0.0324 => 0.0302, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -41.27% (0.0189 => 0.0111, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 3.61% (0.0249 => 0.0258, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -60.62% (0.0325 => 0.0128, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.12% (0.1429 => 0.1413, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 0.27% (1.5019 => 1.5059, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.40% (0.1501 => 0.1420, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.51% (0.4264 => 0.4029, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.84% (0.1344 => 0.1409, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.06% (0.0589 => 0.0607, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.52% (0.0232 => 0.0196, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.36% (0.0639 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1350 => 1.1322, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.33% (0.0024 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.63% (0.0637 => 0.0633, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (0.0246 => 0.0204, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7541 => 0.7664, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.64% (1.5363 => 1.6076, std.dev.: 0.0084) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 03:09:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 05:09:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927100944.81A072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4302?compare_to=4297&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4302, Order: 164762, Start Time: 2012-09-27 08:56:18, End Time: 2012-09-27 10:11:15 To: 4297, Order: 164759, Start Time: 2012-09-27 07:12:14, End Time: 2012-09-27 08:27:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (179 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.98% (2.0176 => 2.4408, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.33% (0.7061 => 0.7861, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.10% (0.1072 => 0.1191, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.80% (3.9660 => 4.3943, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.79% (0.7710 => 0.8542, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.72% (1.3693 => 1.5161, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 10.70% (0.4328 => 0.4791, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.47% (0.1327 => 0.1466, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.37% (0.7038 => 0.7768, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.36% (0.2596 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.2721 => 0.3002, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.28% (0.5265 => 0.5806, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.27% (0.1276 => 0.1407, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.25% (0.2781 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.23% (0.6959 => 0.7671, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.15% (1.2193 => 1.3430, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.06% (0.9199 => 1.0124, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 10.02% (0.4062 => 0.4469, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.81% (1.4563 => 1.5991, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.74% (0.3130 => 0.3435, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.67% (0.3899 => 0.4276, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.64% (1.1364 => 1.2460, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.60% (0.3022 => 0.3312, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.57% (0.2655 => 0.2909, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 9.55% (13.8202 => 15.1394, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/fibo: 9.51% (0.2628 => 0.2878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.46% (0.4016 => 0.4396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2761 => 0.3022, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.44% (0.3485 => 0.3814, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.35% (1.9828 => 2.1681, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.29% (0.6283 => 0.6867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.28% (0.2760 => 0.3016, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.27% (0.4390 => 0.4797, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 9.26% (0.3293 => 0.3598, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.26% (0.3489 => 0.3812, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 9.24% (0.2726 => 0.2978, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.24% (0.2966 => 0.3240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.22% (0.3580 => 0.3910, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 9.17% (0.3107 => 0.3392, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.13% (0.3756 => 0.4099, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.12% (0.3453 => 0.3768, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.07% (0.5577 => 0.6083, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 9.05% (0.3868 => 0.4218, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 8.94% (1.0313 => 1.1235, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 8.91% (0.2995 => 0.3262, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 8.83% (0.3149 => 0.3427, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.80% (0.3192 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.70% (0.4791 => 0.5208, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.68% (0.4379 => 0.4759, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 8.64% (0.8310 => 0.9028, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2127 => 0.2310, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3534 => 0.3835, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (7.2180 => 7.8288, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: 8.44% (1.1061 => 1.1995, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 8.43% (0.7506 => 0.8139, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 8.38% (3.8646 => 4.1884, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.38% (3.6692 => 3.9766, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.37% (0.2914 => 0.3158, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.25% (0.5637 => 0.6102, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.20% (0.3646 => 0.3945, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.19% (0.7460 => 0.8071, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3789 => 0.4099, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.11% (0.3650 => 0.3946, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.11% (0.6576 => 0.7109, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.01% (0.2945 => 0.3181, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.01% (0.3220 => 0.3478, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.94% (16.6129 => 17.9326, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.88% (0.1865 => 0.2012, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.86% (0.2925 => 0.3155, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 7.86% (1.0594 => 1.1427, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 7.75% (3.1889 => 3.4360, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 7.74% (0.6744 => 0.7266, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 7.72% (2.1791 => 2.3473, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 7.52% (1.9270 => 2.0720, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.51% (1.3245 => 1.4240, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.50% (0.8818 => 0.9479, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.48% (0.3755 => 0.4036, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.40% (0.8698 => 0.9342, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.37% (14.8535 => 15.9478, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 7.29% (1.2749 => 1.3679, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.16% (4.3801 => 4.6937, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.09% (4.4433 => 4.7585, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 7.08% (8.4961 => 9.0979, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.93% (1.3819 => 1.4777, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.90% (1.3813 => 1.4766, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.89% (1.1333 => 1.2114, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.86% (0.6135 => 0.6556, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 6.86% (0.2859 => 0.3055, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.78% (0.3245 => 0.3465, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 6.77% (0.3131 => 0.3343, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.74% (13.2842 => 14.1801, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.68% (0.2140 => 0.2283, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2504 => 0.2671, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 6.64% (4.6629 => 4.9726, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 6.52% (1.2292 => 1.3093, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 6.44% (14.5298 => 15.4651, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 6.41% (6.5754 => 6.9966, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.12% (0.2321 => 0.2463, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (3.2742 => 3.4729, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 5.89% (0.6250 => 0.6618, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.85% (0.9108 => 0.9641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.83% (0.1819 => 0.1925, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.53% (0.2008 => 0.2119, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.37% (1.5188 => 1.6004, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.27% (4.9865 => 5.2493, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.18% (6.2785 => 6.6036, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 5.12% (3.7467 => 3.9387, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.88% (2.1007 => 2.2032, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.3511 => 0.3669, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 4.20% (33.2944 => 34.6941, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7594, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std.dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.2093 => 0.2217, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7242, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.55% (10.7476 => 11.1291, std.dev.: 0.0577) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5904, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0512, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5161, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5850, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9264, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5932, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.2986 => 2.3236, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.14% (0.4657 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.63% (22.5627 => 21.9687, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2838, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3019, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1569, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.76% (3.0263 => 2.9429, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2404, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std.dev.: 0.0165) SingleSource/Benchmarks/McGill/chomp: -1.28% (1.2308 => 1.2150, std.dev.: 0.0050) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1784, std.dev.: 0.0214) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2257, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2523, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 4.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 03:44:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 05:44:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927104454.2DD242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4303?compare_to=4299&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4303, Order: 164763, Start Time: 2012-09-27 09:26:28, End Time: 2012-09-27 10:46:27 To: 4299, Order: 164760, Start Time: 2012-09-27 07:37:09, End Time: 2012-09-27 08:57:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.60% (14.8984 => 15.1371, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -1.13% (0.5815 => 0.5749, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: -0.60% (16.0818 => 15.9846, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: -0.16% (14.9057 => 14.8823, std.dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: -0.19% (83.4341 => 83.2792, std.dev.: 0.0431) MultiSource/Benchmarks/MallocBench/gs/gs: -0.51% (4.3585 => 4.3362, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.32% (1.2332 => 1.2293, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (7.5187 => 7.5003, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.46% (3.7255 => 3.7082, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.6459 => 0.6452, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1433 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0686 => 0.0685, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.68% (63.2438 => 83.2792, std.dev.: 0.0431) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14227.50% (0.0720 => 10.3158, std.dev.: 0.0101) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.01% (10.3673 => 15.1371, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 30.39% (0.1622 => 0.2115, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.35% (2.2022 => 2.5183, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.35% (7.0540 => 8.0663, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.48% (1.1194 => 1.2591, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.72% (1.7609 => 1.9673, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3473 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3516 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3497 => 0.3826, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.37% (0.3543 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.30% (0.3561 => 0.3892, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.14% (0.3282 => 0.3582, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.12% (0.3828 => 0.4177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.3927 => 0.4284, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.96% (0.3886 => 0.4234, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.50% (10.4361 => 11.3233, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.10% (0.1655 => 0.1789, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 7.98% (9.4845 => 10.2409, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.59% (0.3307 => 0.3558, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.59% (0.3177 => 0.3418, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5925 => 0.6372, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.54% (0.4879 => 0.5247, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.6030 => 0.6481, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7433 => 0.7978, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 7.29% (0.7115 => 0.7634, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.17% (0.3109 => 0.3332, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.09% (0.6675 => 0.7148, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.08% (0.5860 => 0.6275, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.4615 => 0.4938, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 6.94% (5.7591 => 6.1585, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 6.92% (0.3423 => 0.3660, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.89% (8.1363 => 8.6966, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.83% (1.3050 => 1.3941, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.81% (3.3354 => 3.5625, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.5569 => 0.5948, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.80% (0.5105 => 0.5452, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.77% (1.5415 => 1.6458, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (4.2646 => 4.5519, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7326 => 0.7813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.8172 => 0.8704, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.40% (0.8067 => 0.8583, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.29% (5.0018 => 5.3166, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.16% (4.9449 => 5.2494, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.02% (0.9765 => 1.0353, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 6.01% (0.7835 => 0.8306, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 6.01% (1.0722 => 1.1366, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.00% (1.1642 => 1.2341, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 5.99% (0.3422 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.91% (0.4636 => 0.4910, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 5.89% (0.3092 => 0.3274, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.88% (1.1861 => 1.2559, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.88% (0.5020 => 0.5315, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 5.88% (0.3387 => 0.3586, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.84% (0.6456 => 0.6833, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (0.4064 => 0.4297, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (7.9617 => 8.4152, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3441 => 0.3637, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 5.69% (3.8723 => 4.0925, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 5.66% (21.9371 => 23.1790, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.65% (0.2603 => 0.2750, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.64% (0.2891 => 0.3054, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.60% (1.5603 => 1.6477, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.58% (0.4103 => 0.4332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.55% (0.4289 => 0.4527, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3650 => 0.3849, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3865 => 0.4075, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.40% (0.2905 => 0.3062, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.39% (2.0273 => 2.1365, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.33% (0.2831 => 0.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.33% (0.4203 => 0.4427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2756 => 0.2901, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3826 => 0.4027, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.23% (2.0665 => 2.1745, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/05-eks/eks: 5.21% (0.4299 => 0.4523, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.6450 => 0.6784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4620 => 0.4858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.13% (0.3136 => 0.3297, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 5.09% (2.2969 => 2.4137, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3162 => 0.3322, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2872 => 0.3017, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.3232 => 0.3395, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3603 => 0.3784, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8921 => 0.9369, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.3052 => 0.3205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.00% (0.3283 => 0.3447, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.99% (0.4048 => 0.4250, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.98% (0.3935 => 0.4131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.95% (0.2871 => 0.3013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.93% (0.2802 => 0.2940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.91% (0.3684 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.81% (1.5859 => 1.6622, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2877 => 0.3013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5981 => 0.6259, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 4.59% (0.3379 => 0.3534, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.56% (2.2024 => 2.3028, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (14.3668 => 15.0119, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.4186 => 1.4822, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 4.09% (1.1840 => 1.2324, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.2842 => 1.3291, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.8101 => 0.8371, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.23% (0.3131 => 0.3232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.3427 => 0.3531, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.16% (17.1811 => 17.5520, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (3.8922 => 3.9637, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.21% (1.1145 => 1.3843, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3813, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.65% (3.6395 => 3.7725, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.07% (4.2280 => 4.3579, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2629, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.44% (5.2763 => 3.2480, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.72% (5.3855 => 3.8925, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.28% (5.3526 => 3.8924, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1372, std.dev.: 0.0223) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.29% (2.9384 => 2.6067, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -8.74% (22.1758 => 20.2375, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3135, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7091, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: -5.11% (1.5835 => 1.5026, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1598, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5111, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9833, std.dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5082, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0826, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -1.74% (12.4730 => 12.2560, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -1.22% (1.2373 => 1.2222, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2339, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0313 => 1.0206, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.94% (0.5229 => 0.5749, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 6.64% (14.9895 => 15.9846, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: 5.14% (14.1553 => 14.8823, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: 5.49% (4.1105 => 4.3362, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.27% (1.1048 => 1.2293, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.78% (7.1582 => 7.5003, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.08% (3.4629 => 3.7082, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.70% (0.6222 => 0.6452, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 04:37:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 06:37:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927113713.3EF642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4304?compare_to=4301&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4304, Order: 164767, Start Time: 2012-09-27 10:27:46, End Time: 2012-09-27 11:38:48 To: 4301, Order: 164762, Start Time: 2012-09-27 08:58:54, End Time: 2012-09-27 10:10:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 4 (86 on baseline) Performance Improvements: 2 (44 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 895 (761 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.71% (0.0834 => 0.0940, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.43% (0.3381 => 0.3497, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (4.3197 => 4.4526, std.dev.: 0.0382) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (2.5371 => 2.5907, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.20% (4.9721 => 4.9126, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.35% (0.6167 => 0.6022, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.37% (1.0169 => 1.0207, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.5939 => 0.5940, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -1.76% (0.1536 => 0.1509, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.37% (0.1338 => 0.1343, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.30% (0.3022 => 0.3031, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.62% (0.2255 => 0.2196, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.66% (0.3032 => 0.3052, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.29% (0.2074 => 0.2080, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -28.10% (0.0274 => 0.0197, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.10% (0.0091 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.71% (0.0082 => 0.0056, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.52% (0.0198 => 0.0195, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.35% (0.0326 => 0.0363, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0306 => 0.0306, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.69% (0.0288 => 0.0286, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.27% (0.0302 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.62% (0.0185 => 0.0182, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 10.81% (0.0111 => 0.0123, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -3.49% (0.0258 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -33.59% (0.0128 => 0.0085, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.18% (0.1413 => 0.1458, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.49% (1.5059 => 1.4834, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.86% (0.1420 => 0.1489, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.50% (0.4029 => 0.4009, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.06% (0.1409 => 0.1380, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0607 => 0.0612, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.04% (0.0196 => 0.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.71% (0.0560 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1322 => 1.1251, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -26.67% (0.0015 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -68.75% (0.0016 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.74% (0.0633 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.37% (0.0204 => 0.0217, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7664 => 0.7651, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.35% (1.6076 => 1.6020, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.48% (0.0121 => 0.0118, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.67% (4.1772 => 3.1048, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/except: 82366.67% (0.0006 => 0.4948, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.47% (0.1414 => 0.1562, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 8.87% (0.5309 => 0.5780, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: 8.38% (2.1763 => 2.3587, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.21% (0.6410 => 0.6936, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 7.19% (0.6173 => 0.6617, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 6.76% (1.0046 => 1.0725, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 6.70% (1.1653 => 1.2434, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.03% (0.3582 => 0.3798, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.77% (0.3901 => 0.4126, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.63% (15.3105 => 16.1723, std.dev.: 0.2566) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.6915 => 0.7295, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.49% (0.2552 => 0.2692, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.05% (0.7639 => 0.8025, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.01% (0.4248 => 0.4461, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.98% (1.5150 => 1.5905, std.dev.: 0.0160) MultiSource/Benchmarks/Bullet/bullet: 4.96% (29.3170 => 30.7703, std.dev.: 0.0363) MultiSource/Benchmarks/McCat/18-imp/imp: 4.76% (0.3217 => 0.3370, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (12.6413 => 13.2338, std.dev.: 0.0814) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.48% (0.2654 => 0.2773, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.43% (3.0758 => 3.2122, std.dev.: 0.0330) MultiSource/Applications/d/make_dparser: 4.43% (3.0225 => 3.1563, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.32% (0.4880 => 0.5091, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.11% (0.3062 => 0.3188, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.02% (1.1827 => 1.2302, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 3.83% (13.3238 => 13.8347, std.dev.: 0.0454) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (6.2546 => 6.4925, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.79% (1.1672 => 1.2114, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.76% (0.3008 => 0.3121, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.72% (1.1440 => 1.1866, std.dev.: 0.0099) MultiSource/Applications/hbd/hbd: 3.72% (1.3268 => 1.3761, std.dev.: 0.0089) MultiSource/Applications/siod/siod: 3.67% (2.0972 => 2.1741, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 3.62% (0.8405 => 0.8709, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.52% (4.7455 => 4.9126, std.dev.: 0.0131) MultiSource/Applications/lua/lua: 3.43% (3.5980 => 3.7213, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.35% (0.5636 => 0.5825, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.34% (1.2021 => 1.2422, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.2186 => 8.4919, std.dev.: 0.0710) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.30% (1.4113 => 1.4579, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 3.23% (6.4908 => 6.7003, std.dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.6079 => 15.0774, std.dev.: 0.0199) MultiSource/Applications/JM/lencod/lencod: 3.04% (14.7256 => 15.1733, std.dev.: 0.0372) MultiSource/Applications/treecc/treecc: 2.96% (1.8798 => 1.9354, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.94% (0.8569 => 0.8821, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.88% (0.5937 => 0.6108, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.81% (0.4562 => 0.4690, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (4.0318 => 4.1413, std.dev.: 0.0316) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0821 => 1.1112, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.3847 => 0.3948, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.45% (1.0689 => 1.0951, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.37% (1.2742 => 1.3044, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (4.2815 => 4.3753, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.93% (8.2559 => 8.4150, std.dev.: 0.0593) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (4.3380 => 4.4185, std.dev.: 0.0306) MultiSource/Applications/hexxagon/hexxagon: 1.40% (0.9425 => 0.9557, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 50.96% (0.0261 => 0.0394, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.72% (0.0766 => 0.0940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2294, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0011, std.dev.: 0.0209) SingleSource/Benchmarks/Stanford/Puzzle: 14.24% (0.1433 => 0.1637, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5547, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: 8.40% (7.0025 => 7.5907, std.dev.: 0.0434) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.79% (1.0063 => 1.0847, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (4.2129 => 4.4526, std.dev.: 0.0382) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.85% (40.4792 => 42.4420, std.dev.: 0.5216) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: 4.13% (15.2242 => 15.8530, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/ReedSolomon: 4.09% (8.5113 => 8.8595, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.73% (3.4080 => 3.5352, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8912, std.dev.: 0.1041) MultiSource/Benchmarks/sim/sim: 2.73% (3.8907 => 3.9970, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8099, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 2.44% (0.6308 => 0.6462, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.18% (3.5520 => 3.6294, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.6127 => 4.6944, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/power/power: 1.42% (1.4184 => 1.4386, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.19% (2.4455 => 2.4745, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.12% (5.2665 => 4.1540, std.dev.: 0.1530) SingleSource/Benchmarks/Shootout-C++/ary3: -19.37% (1.7473 => 1.4088, std.dev.: 0.0321) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.37% (1.1647 => 0.9624, std.dev.: 0.0314) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.57% (15.8312 => 13.2072, std.dev.: 0.0907) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.20% (0.0917 => 0.0796, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0186) MultiSource/Applications/sgefa/sgefa: -11.19% (0.3746 => 0.3327, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.45% (3.2007 => 2.9621, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.90% (2.0027 => 1.8645, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.72% (3.6254 => 3.3817, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/distray/distray: -6.68% (0.2664 => 0.2486, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: -6.47% (7.6833 => 7.1865, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: -6.46% (4.6355 => 4.3362, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: -6.06% (3.4230 => 3.2157, std.dev.: 0.0427) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7967, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9480, std.dev.: 0.0959) SingleSource/Benchmarks/Misc/richards_benchmark: -5.53% (1.4441 => 1.3642, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1887, std.dev.: 0.0266) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.76% (0.4140 => 0.3943, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -4.34% (2.5166 => 2.4074, std.dev.: 0.0289) MultiSource/Applications/SPASS/SPASS: -3.90% (8.5323 => 8.1996, std.dev.: 0.0540) SingleSource/Benchmarks/Shootout-C++/methcall: -3.35% (9.2503 => 8.9404, std.dev.: 0.0310) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.33% (45.4683 => 43.9547, std.dev.: 0.3787) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2891, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.45% (3.7496 => 3.6577, std.dev.: 0.0355) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.39% (1.1683 => 1.1404, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.33% (2.4457 => 2.3887, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.32% (3.9413 => 3.8498, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.21% (0.6119 => 0.5984, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -2.20% (92.7467 => 90.7038, std.dev.: 0.2714) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3635, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4226, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3569 => 2.3183, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2400, std.dev.: 0.0219) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3165, std.dev.: 0.0542) SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (2.4971 => 2.4635, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.5617 => 16.3684, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.01% (1.8739 => 1.8550, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.27% (0.9980 => 1.0207, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -1.36% (0.6022 => 0.5940, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -9.42% (0.1666 => 0.1509, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.58% (0.1554 => 0.1343, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.69% (0.3083 => 0.3031, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.27% (0.2394 => 0.2196, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.87% (0.3175 => 0.3052, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.64% (0.2302 => 0.2080, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -56.12% (0.0449 => 0.0197, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -76.67% (0.0240 => 0.0056, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.92% (0.0390 => 0.0363, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.66% (0.0301 => 0.0306, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0324 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -34.92% (0.0189 => 0.0123, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -73.85% (0.0325 => 0.0085, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.23% (1.5019 => 1.4834, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.80% (0.1501 => 0.1489, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.98% (0.4264 => 0.4009, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.68% (0.1344 => 0.1380, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.33% (0.0232 => 0.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0639 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.87% (1.1350 => 1.1251, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.10% (0.0637 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.79% (0.0246 => 0.0217, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.28% (1.5363 => 1.6020, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 68.57% (0.0070 => 0.0118, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 04:53:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 06:53:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927115347.387842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4305?compare_to=4302&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4305, Order: 164767, Start Time: 2012-09-27 10:40:27, End Time: 2012-09-27 11:55:21 To: 4302, Order: 164762, Start Time: 2012-09-27 08:56:18, End Time: 2012-09-27 10:11:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (177 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (697 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.08% (5.4012 => 5.4595, std.dev.: 0.0145) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.81% (2.0176 => 2.4374, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.89% (0.1588 => 0.1761, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.59% (3.9660 => 4.3861, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 10.40% (0.5818 => 0.6423, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.40% (0.7061 => 0.7795, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.7038 => 0.7762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5748 => 0.6339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.14% (1.2193 => 1.3429, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 10.07% (0.4328 => 0.4764, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.00% (0.9199 => 1.0119, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.99% (0.7710 => 0.8480, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 9.98% (1.3693 => 1.5059, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.92% (0.2721 => 0.2991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.74% (0.3130 => 0.3435, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.70% (0.1072 => 0.1176, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.69% (0.5265 => 0.5775, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.69% (0.6959 => 0.7633, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.68% (1.4563 => 1.5973, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.63% (1.1364 => 1.2458, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.53% (13.8202 => 15.1369, std.dev.: 0.0072) SingleSource/Regression/C++/ofstream_ctor: 9.42% (0.2781 => 0.3043, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 9.31% (0.4062 => 0.4440, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.28% (0.6283 => 0.6866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2782 => 0.3040, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.3899 => 0.4256, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.09% (1.0313 => 1.1250, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.98% (0.3485 => 0.3798, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.93% (0.3022 => 0.3292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.88% (0.2690 => 0.2929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.88% (0.2760 => 0.3005, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.86% (0.2765 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.81% (0.2655 => 0.2889, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.79% (0.4016 => 0.4369, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.78% (0.2607 => 0.2836, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.78% (0.2995 => 0.3258, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.77% (0.4791 => 0.5211, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 8.73% (0.1478 => 0.1607, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.72% (0.4390 => 0.4773, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 8.71% (0.2628 => 0.2857, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.66% (0.2761 => 0.3000, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.63% (0.3580 => 0.3889, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.63% (1.9828 => 2.1539, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.63% (0.3489 => 0.3790, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.62% (0.5577 => 0.6058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.61% (0.2937 => 0.3190, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.56% (0.2966 => 0.3220, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 8.56% (0.3293 => 0.3575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.49% (0.2696 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.49% (0.3756 => 0.4075, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 8.47% (0.2726 => 0.2957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.47% (0.3246 => 0.3521, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 8.45% (0.8310 => 0.9012, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 8.43% (0.2988 => 0.3240, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4379 => 0.4748, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.35% (0.3149 => 0.3412, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.27% (0.3868 => 0.4188, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.27% (0.3107 => 0.3364, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.22% (0.3453 => 0.3737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (7.2180 => 7.8106, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 8.15% (1.1061 => 1.1963, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 8.15% (3.8646 => 4.1796, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.14% (3.6692 => 3.9679, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.03% (0.2914 => 0.3148, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (0.8818 => 0.9526, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.02% (0.7506 => 0.8108, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 7.99% (0.3192 => 0.3447, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.95% (0.5637 => 0.6085, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.88% (0.7460 => 0.8048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.87% (0.3534 => 0.3812, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 7.81% (3.1889 => 3.4378, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.78% (0.2945 => 0.3174, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.73% (0.3220 => 0.3469, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.64% (1.0594 => 1.1403, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 7.55% (16.6129 => 17.8666, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 7.54% (2.1791 => 2.3435, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 7.53% (0.6744 => 0.7252, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 7.43% (1.2749 => 1.3696, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 7.41% (1.9270 => 2.0697, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 7.40% (14.8535 => 15.9524, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3578 => 0.3842, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.35% (1.3245 => 1.4219, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.19% (0.3601 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.15% (0.3914 => 0.4194, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.15% (0.8698 => 0.9320, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4113 => 0.4406, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.07% (0.4003 => 0.4286, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.06% (8.4961 => 9.0958, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 6.96% (0.3131 => 0.3349, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.95% (0.3755 => 0.4016, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.88% (0.3940 => 0.4211, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.87% (4.3801 => 4.6808, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.85% (0.6135 => 0.6555, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1569 => 0.1675, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.75% (4.4433 => 4.7433, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.73% (1.1333 => 1.2096, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.71% (1.3813 => 1.4740, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.70% (1.3819 => 1.4745, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 6.69% (4.6629 => 4.9748, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (13.2842 => 14.1612, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.59% (0.2504 => 0.2669, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 6.58% (0.2859 => 0.3047, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.44% (14.5298 => 15.4648, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 6.31% (6.5754 => 6.9900, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3245 => 0.3448, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.13% (3.2742 => 3.4750, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.97% (1.2292 => 1.3026, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.83% (0.1819 => 0.1925, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.75% (0.9108 => 0.9632, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.58% (0.6250 => 0.6599, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.4805 => 0.5072, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.48% (0.2008 => 0.2118, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.30% (4.9865 => 5.2508, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.29% (6.2785 => 6.6108, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.22% (1.5188 => 1.5981, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.98% (2.1007 => 2.2054, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.96% (3.7467 => 3.9324, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.56% (0.3511 => 0.3671, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.16% (33.2944 => 34.6785, std.dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: 3.25% (16.2614 => 16.7897, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5124, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2619, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7246, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1112, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.04% (7.4271 => 7.5785, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5835, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2236, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5833, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.98% (0.4657 => 0.3913, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.55% (22.5627 => 21.9869, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2978, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std.dev.: 0.0215) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7939, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.75% (1.9762 => 1.9219, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9472, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1289, std.dev.: 0.0418) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8710, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2360, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -1.04% (1.2308 => 1.2180, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 05:34:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 07:34:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927123400.F12492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4306?compare_to=4303&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4306, Order: 164769, Start Time: 2012-09-27 11:15:38, End Time: 2012-09-27 12:35:35 To: 4303, Order: 164763, Start Time: 2012-09-27 09:26:28, End Time: 2012-09-27 10:46:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.2964 => 1.3119, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5749 => 0.5752, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: -0.01% (15.9846 => 15.9837, std.dev.: 0.0193) MultiSource/Applications/kimwitu++/kc: -0.01% (14.8823 => 14.8809, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 0.02% (83.2792 => 83.2931, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/gs/gs: 0.07% (4.3362 => 4.3391, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.14% (1.2293 => 1.2310, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.5003 => 7.5036, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.07% (3.7082 => 3.7055, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.02% (0.6452 => 0.6451, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.55% (0.0685 => 0.0647, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.70% (63.2438 => 83.2931, std.dev.: 0.0205) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14230.00% (0.0720 => 10.3176, std.dev.: 0.0092) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.99% (10.3673 => 15.1356, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/richards_benchmark: 30.33% (0.1622 => 0.2114, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.37% (7.0540 => 8.0675, std.dev.: 0.0325) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.30% (2.2022 => 2.5171, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.34% (0.1432 => 0.1623, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.40% (1.1194 => 1.2582, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.74% (1.7609 => 1.9677, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.85% (0.1584 => 0.1740, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3473 => 0.3809, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.51% (0.3543 => 0.3880, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3543 => 0.3880, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3516 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.38% (0.3497 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.38% (0.3561 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.31% (0.3694 => 0.4038, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.3927 => 0.4284, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3828 => 0.4175, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.83% (0.3886 => 0.4229, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 8.48% (10.4361 => 11.3213, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.10% (0.1655 => 0.1789, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.94% (9.4845 => 10.2379, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.71% (0.3307 => 0.3562, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.54% (0.4879 => 0.5247, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.6030 => 0.6481, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.36% (0.7433 => 0.7980, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 7.24% (0.7115 => 0.7630, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.22% (0.6675 => 0.7157, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.17% (0.3109 => 0.3332, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.02% (0.4615 => 0.4939, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.95% (1.5415 => 1.6487, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.93% (0.5860 => 0.6266, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 6.92% (0.3423 => 0.3660, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.91% (3.3354 => 3.5660, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (4.2646 => 4.5592, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 6.88% (5.7591 => 6.1553, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.86% (8.1363 => 8.6945, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.84% (1.3050 => 1.3942, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.82% (0.1510 => 0.1613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.74% (0.7326 => 0.7820, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.70% (0.5105 => 0.5447, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.65% (0.1625 => 0.1733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.53% (0.2758 => 0.2938, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5569 => 0.5923, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.31% (0.2107 => 0.2240, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.8172 => 0.8687, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.27% (0.8067 => 0.8573, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.16% (5.0018 => 5.3097, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 6.15% (0.7835 => 0.8317, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.14% (4.9449 => 5.2486, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2891 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 6.05% (0.3422 => 0.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.5020 => 0.5323, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.99% (0.9765 => 1.0350, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 5.99% (1.1642 => 1.2339, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: 5.95% (1.0722 => 1.1360, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.93% (0.3441 => 0.3645, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.84% (1.1861 => 1.2554, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.82% (0.3092 => 0.3272, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.81% (0.6456 => 0.6831, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.80% (0.4636 => 0.4905, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 5.79% (0.3387 => 0.3583, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.73% (0.4103 => 0.4338, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.68% (7.9617 => 8.4138, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.66% (0.4203 => 0.4441, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.64% (3.8723 => 4.0906, std.dev.: 0.0176) SingleSource/Regression/C++/ofstream_ctor: 5.61% (0.2905 => 0.3068, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.61% (0.2603 => 0.2749, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.61% (21.9371 => 23.1675, std.dev.: 0.0397) MultiSource/Applications/hbd/hbd: 5.58% (1.5603 => 1.6474, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 5.53% (0.4289 => 0.4526, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.51% (0.3865 => 0.4078, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.40% (0.3650 => 0.3847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.40% (0.2872 => 0.3027, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.36% (2.0273 => 2.1360, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.33% (0.2831 => 0.2982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3603 => 0.3795, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.33% (0.3098 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.30% (2.0665 => 2.1760, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3826 => 0.4028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.27% (0.2714 => 0.2857, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2756 => 0.2901, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3283 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.24% (0.4620 => 0.4862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.24% (0.4048 => 0.4260, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.21% (0.4299 => 0.4523, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2871 => 0.3020, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2793 => 0.2937, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.3052 => 0.3208, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 5.11% (2.2969 => 2.4143, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.10% (0.6450 => 0.6779, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.09% (0.3162 => 0.3323, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.08% (0.8921 => 0.9374, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.07% (0.3232 => 0.3396, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2802 => 0.2944, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.01% (0.2877 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3935 => 0.4127, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.80% (1.5859 => 1.6621, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.66% (0.5981 => 0.6260, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 4.62% (0.3379 => 0.3535, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.52% (2.2024 => 2.3019, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.4186 => 1.4820, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (14.3668 => 15.0042, std.dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 4.11% (1.1840 => 1.2327, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.52% (1.2842 => 1.3294, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 3.39% (0.3131 => 0.3237, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.98% (0.3427 => 0.3529, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.8101 => 0.8340, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.10% (17.1811 => 17.5416, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.59% (3.8922 => 3.9542, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.65% (0.2944 => 0.3287, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7601, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (4.2280 => 4.3587, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.62% (9.1159 => 9.2632, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.41% (5.2763 => 3.2498, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.68% (5.3855 => 3.8947, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.28% (5.3526 => 3.8922, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1779, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.30% (2.9384 => 2.6065, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: -8.72% (22.1758 => 20.2424, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2869, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1643, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -3.18% (1.2373 => 1.1980, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5097, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0835, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5133, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0066, std.dev.: 0.0142) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2521, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5090, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6827, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2321, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.00% (0.5229 => 0.5752, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 6.63% (14.9895 => 15.9837, std.dev.: 0.0193) MultiSource/Applications/kimwitu++/kc: 5.13% (14.1553 => 14.8809, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 5.56% (4.1105 => 4.3391, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.42% (1.1048 => 1.2310, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.83% (7.1582 => 7.5036, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.01% (3.4629 => 3.7055, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.6222 => 0.6451, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 05:44:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 07:44:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120927124410.0B3B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4307?compare_to=4300&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4307, Order: 164763, Start Time: 2012-09-27 10:02:03, End Time: 2012-09-27 12:45:43 To: 4300, Order: 164759, Start Time: 2012-09-27 06:46:47, End Time: 2012-09-27 09:33:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.22% (1.3533 => 1.3698, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.43% (0.3446 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3465 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.42% (0.3442 => 0.3835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.42% (0.3460 => 0.3855, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.38% (0.3488 => 0.3885, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 11.33% (0.3496 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.24% (0.3469 => 0.3859, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1063 => 0.1181, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.10% (0.3650 => 0.4055, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3643 => 0.4042, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.66% (0.3724 => 0.4121, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.01% (1.5932 => 1.7526, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.50% (0.5826 => 0.6321, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.5889 => 0.6383, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.52% (0.2738 => 0.2944, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.3004 => 0.3222, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.20% (1.6211 => 1.7378, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3195 => 0.3424, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (1.3152 => 1.4092, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2875 => 0.3080, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.99% (0.7171 => 0.7672, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.95% (0.2750 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.91% (0.2823 => 0.3018, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (0.4361 => 0.4661, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 6.86% (0.2813 => 0.3006, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.81% (0.2792 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.3625 => 0.3871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2803 => 0.2993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.74% (3.5627 => 3.8030, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2811 => 0.2999, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.64% (0.9909 => 1.0567, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.62% (2.0673 => 2.2041, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (0.4994 => 0.5324, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.56% (0.2729 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.52% (2.7292 => 2.9071, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 6.51% (5.5417 => 5.9025, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 6.46% (0.3096 => 0.3296, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3317 => 0.3531, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.44% (0.5000 => 0.5322, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.44% (0.3060 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3267 => 0.3476, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.39% (0.2911 => 0.3097, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.35% (0.3258 => 0.3465, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.33% (0.3348 => 0.3560, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (0.3930 => 0.4177, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3362 => 0.3573, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.23% (1.0781 => 1.1453, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.21% (0.3124 => 0.3318, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (0.2014 => 0.2139, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3726 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.17% (0.5026 => 0.5336, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 6.12% (0.3678 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.00% (0.3282 => 0.3479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.95% (0.3477 => 0.3684, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.93% (0.4029 => 0.4268, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.2736 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.90% (0.3845 => 0.4072, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 5.83% (0.4251 => 0.4499, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.80% (4.2109 => 4.4551, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 5.79% (23.5202 => 24.8816, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.73% (0.4139 => 0.4376, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.2866 => 0.3030, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3690 => 0.3901, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 5.70% (0.6634 => 0.7012, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4146 => 0.4382, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.68% (0.5900 => 0.6235, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.65% (0.2566 => 0.2711, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.58% (0.3981 => 0.4203, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 5.54% (1.8794 => 1.9836, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (0.3903 => 0.4114, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.40% (4.4195 => 4.6581, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (0.3890 => 0.4098, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 5.32% (2.1013 => 2.2131, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 5.25% (0.5012 => 0.5275, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.19% (0.6435 => 0.6769, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.09% (1.4269 => 1.4996, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2737 => 0.2876, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 5.02% (4.6177 => 4.8496, std.dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (2.1653 => 2.2737, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.96% (0.4658 => 0.4889, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 4.94% (0.2691 => 0.2824, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.90% (0.5546 => 0.5818, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.83% (0.3084 => 0.3233, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 4.74% (0.3336 => 0.3494, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.2969 => 0.3108, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.54% (0.9697 => 1.0137, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.46% (0.7875 => 0.8226, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.45% (1.9694 => 2.0571, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.38% (1.9966 => 2.0840, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 4.34% (2.0346 => 2.1228, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.95% (0.4253 => 0.4421, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 3.78% (0.4847 => 0.5030, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.65% (0.7426 => 0.7697, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (0.5361 => 0.5554, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.3498 => 0.3622, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.08% (0.5584 => 0.5756, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.97% (11.6398 => 11.9851, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.6926 => 4.8285, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 1.77% (11.9555 => 12.1677, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.2122 => 0.2281, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6132, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6810, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6382, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1965, std.dev.: 0.0505) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5054, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2261, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4432, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2819, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5872, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.17% (2.4764 => 2.4475, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5269, std.dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7950, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -5.45% (0.2402 => 0.2271, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7805, std.dev.: 0.0902) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5716, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 06:03:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 08:03:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927130329.C235F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4308?compare_to=4304&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4308, Order: 164769, Start Time: 2012-09-27 11:54:29, End Time: 2012-09-27 13:05:05 To: 4304, Order: 164767, Start Time: 2012-09-27 10:27:46, End Time: 2012-09-27 11:38:48 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 12 (101 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 887 (750 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.7730 => 0.8246, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.86% (0.4564 => 0.4740, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.21% (0.5577 => 0.5756, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9120 => 0.9332, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.3044 => 1.3263, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 5.67% (1.7345 => 1.8328, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 4.74% (8.1996 => 8.5882, std.dev.: 0.1304) SingleSource/Benchmarks/Misc-C++/bigfib: 3.40% (0.3589 => 0.3711, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.81% (2.8463 => 2.9263, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.61% (59.4970 => 61.0471, std.dev.: 0.2026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.59% (0.3943 => 0.4045, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.65% (21.9061 => 22.2665, std.dev.: 0.0817) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.20% (2.4355 => 2.3332, std.dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.39% (1.0847 => 1.0696, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.43% (1.0207 => 1.0163, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.5940 => 0.5948, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 1.79% (0.1509 => 0.1536, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.22% (0.1343 => 0.1346, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (0.3031 => 0.3020, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.09% (0.2196 => 0.2242, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.36% (0.3052 => 0.3041, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.19% (0.2080 => 0.2076, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel: 43.15% (0.0197 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 35.71% (0.0056 => 0.0076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0195 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.26% (0.0363 => 0.0393, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.65% (0.0306 => 0.0304, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.05% (0.0286 => 0.0289) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.30% (0.0330 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.55% (0.0182 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 60.16% (0.0123 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 50.59% (0.0085 => 0.0128, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1458 => 0.1456, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 2.08% (1.4834 => 1.5142, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.34% (0.1489 => 0.1469, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.65% (0.4009 => 0.4075, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1380 => 0.1372, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.47% (0.0612 => 0.0621, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.07% (0.0249 => 0.0204, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.56% (0.0648 => 0.0599, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1251 => 1.1270, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 145.45% (0.0011 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0005 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0644 => 0.0568, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.97% (0.0217 => 0.0256, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.7651 => 0.7658, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.07% (1.6020 => 1.6008, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -64.41% (0.0118 => 0.0042, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.68% (4.1772 => 3.1043, std.dev.: 0.0626) SingleSource/Benchmarks/Shootout-C++/except: 82966.67% (0.0006 => 0.4984, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.55% (0.1414 => 0.1549, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.32% (0.1159 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 8.37% (2.1763 => 2.3584, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.5309 => 0.5748, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.27% (0.6410 => 0.6940, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 7.13% (0.6173 => 0.6613, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.79% (0.7722 => 0.8246, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 6.75% (1.1653 => 1.2439, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 6.73% (1.0046 => 1.0722, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.59% (0.3582 => 0.3818, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.2552 => 0.2704, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 5.91% (15.3105 => 16.2157, std.dev.: 0.0719) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (1.5150 => 1.6043, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 5.51% (0.6915 => 0.7296, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.46% (0.3901 => 0.4114, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.20% (0.4248 => 0.4469, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 5.10% (29.3170 => 30.8110, std.dev.: 0.1061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.91% (0.6069 => 0.6367, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 4.87% (3.0225 => 3.1698, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.1672 => 1.2240, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 4.72% (0.3217 => 0.3369, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (12.6413 => 13.2346, std.dev.: 0.1165) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.67% (0.2654 => 0.2778, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.65% (0.3008 => 0.3148, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.56% (0.7639 => 0.7987, std.dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: 4.55% (13.3238 => 13.9297, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.33% (0.2797 => 0.2918, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.5520 => 0.5756, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (1.1827 => 1.2329, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: 4.15% (1.1440 => 1.1915, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.09% (1.2742 => 1.3263, std.dev.: 0.0070) MultiSource/Applications/hbd/hbd: 4.09% (1.3268 => 1.3810, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5740 => 0.5966, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.87% (3.0758 => 3.1948, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (6.2546 => 6.4906, std.dev.: 0.0705) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.71% (0.5937 => 0.6157, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.69% (0.3062 => 0.3175, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 3.68% (0.8405 => 0.8714, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.60% (0.2886 => 0.2990, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.57% (4.7455 => 4.9148, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.56% (1.4113 => 1.4616, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (8.2186 => 8.5095, std.dev.: 0.0251) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.54% (1.0689 => 1.1067, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 3.52% (14.6079 => 15.1220, std.dev.: 0.0225) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.0821 => 1.1201, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.49% (1.2021 => 1.2441, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.44% (4.0318 => 4.1706, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.3418 => 0.3535, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.40% (0.2996 => 0.3098, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3026 => 0.3129, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.39% (0.5636 => 0.5827, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 3.37% (0.3084 => 0.3188, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (3.8796 => 4.0098, std.dev.: 0.0376) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9029 => 0.9332, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 3.32% (14.7256 => 15.2142, std.dev.: 0.0250) MultiSource/Applications/JM/ldecod/ldecod: 3.27% (6.4908 => 6.7029, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.13% (0.4596 => 0.4740, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 3.06% (3.5980 => 3.7082, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.04% (1.4408 => 1.4846, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.03% (0.4880 => 0.5028, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 3.01% (2.0972 => 2.1603, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.0317 => 2.0920, std.dev.: 0.0126) MultiSource/Applications/treecc/treecc: 2.91% (1.8798 => 1.9345, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.83% (0.5963 => 0.6132, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.74% (1.4189 => 1.4578, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.3847 => 0.3950, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4562 => 0.4672, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.2815 => 4.3808, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (8.2559 => 8.4421, std.dev.: 0.0644) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 39.08% (0.0261 => 0.0363, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.98% (0.0766 => 0.0942, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0166) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0481) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.35% (4.0101 => 4.5456, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0091) SingleSource/Benchmarks/Stanford/Puzzle: 10.26% (0.1433 => 0.1580, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 9.06% (7.0025 => 7.6370, std.dev.: 0.0553) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.09% (0.2857 => 0.3088, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (0.3301 => 0.3522, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.29% (1.0063 => 1.0696, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: 5.76% (1.7330 => 1.8328, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (4.2129 => 4.4008, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5383, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7901, std.dev.: 0.0646) SingleSource/Benchmarks/Misc-C++/bigfib: 3.34% (0.3591 => 0.3711, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.89% (0.5876 => 0.6046, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 2.82% (3.8907 => 4.0006, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8859, std.dev.: 0.0467) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8093, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/mason/mason: 2.64% (0.5004 => 0.5136, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 2.31% (3.5520 => 3.6342, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash: 2.30% (0.6308 => 0.6453, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.88% (4.6127 => 4.6995, std.dev.: 0.0182) SingleSource/Benchmarks/Dhrystone/dry: 1.82% (2.4013 => 2.4450, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: 1.19% (1.4184 => 1.4353, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.06% (2.4455 => 2.4715, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.69% (0.3497 => 0.2039, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.51% (5.2665 => 4.0811, std.dev.: 0.0558) SingleSource/Benchmarks/Shootout-C++/ary3: -19.86% (1.7473 => 1.4003, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.46% (15.8312 => 13.0676, std.dev.: 0.1282) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.35% (1.1647 => 0.9626, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std.dev.: 0.0670) MultiSource/Applications/sgefa/sgefa: -10.84% (0.3746 => 0.3340, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9383, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3762, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -6.66% (4.6355 => 4.3267, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8713, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -6.45% (7.6833 => 7.1879, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/richards_benchmark: -6.32% (1.4441 => 1.3529, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -6.23% (3.4230 => 3.2096, std.dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9331, std.dev.: 0.1037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.43% (1.4021 => 1.3260, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1887, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.97% (45.4683 => 43.2070, std.dev.: 0.6844) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -4.20% (2.5166 => 2.4109, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.57% (1.2959 => 1.2496, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: -3.54% (0.4296 => 0.4144, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (9.2503 => 8.9354, std.dev.: 0.0390) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.87% (3.9413 => 3.8281, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.42% (3.7496 => 3.6589, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.18% (1.1683 => 1.1428, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (92.7467 => 90.7649, std.dev.: 0.4092) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4234, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.81% (2.3569 => 2.3142, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2341, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.49% (2.4457 => 2.4092, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3079, std.dev.: 0.0727) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4639, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.83% (0.9980 => 1.0163, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: -1.23% (0.6022 => 0.5948, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -7.80% (0.1666 => 0.1536, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.38% (0.1554 => 0.1346, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.04% (0.3083 => 0.3020, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.35% (0.2394 => 0.2242, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.22% (0.3175 => 0.3041, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.82% (0.2302 => 0.2076, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel: -37.19% (0.0449 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.33% (0.0240 => 0.0076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 4.23% (0.0189 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -60.62% (0.0325 => 0.0128, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.89% (0.1429 => 0.1456, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.82% (1.5019 => 1.5142, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.13% (0.1501 => 0.1469, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.43% (0.4264 => 0.4075, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.08% (0.1344 => 0.1372, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 100.00% (0.0001 => 0.0002, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.43% (0.0589 => 0.0621, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.07% (0.0232 => 0.0204, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.26% (0.0639 => 0.0599, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0024 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.83% (0.0637 => 0.0568, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (0.0246 => 0.0256, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.20% (1.5363 => 1.6008, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.00% (0.0070 => 0.0042, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 06:37:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 08:37:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927133713.0B1D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4309?compare_to=4305&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4309, Order: 164769, Start Time: 2012-09-27 12:24:11, End Time: 2012-09-27 13:38:47 To: 4305, Order: 164767, Start Time: 2012-09-27 10:40:27, End Time: 2012-09-27 11:55:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (179 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (693 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.73% (3.9088 => 3.7629, std.dev.: 0.0539) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.70% (2.0176 => 2.4353, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.38% (0.1410 => 0.1641, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.96% (0.1588 => 0.1762, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.65% (3.9660 => 4.3885, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 10.43% (0.5818 => 0.6425, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.40% (0.7061 => 0.7795, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 10.26% (0.5748 => 0.6338, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.19% (0.4328 => 0.4769, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.06% (0.7038 => 0.7746, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.05% (1.2193 => 1.3419, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2721 => 0.2993, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.94% (1.3693 => 1.5054, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.94% (0.3130 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.89% (0.9199 => 1.0109, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1072 => 0.1178, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.84% (0.5265 => 0.5783, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.76% (0.6959 => 0.7638, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.64% (1.1364 => 1.2460, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.57% (0.1327 => 0.1454, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.54% (1.4563 => 1.5953, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.52% (0.7710 => 0.8444, std.dev.: 0.0076) SingleSource/Regression/C++/ofstream_ctor: 9.49% (0.2781 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.34% (0.6283 => 0.6870, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.34% (13.8202 => 15.1112, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash: 9.31% (0.4062 => 0.4440, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2782 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.3899 => 0.4256, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.00% (0.3022 => 0.3294, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.96% (1.0313 => 1.1237, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.95% (0.3485 => 0.3797, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 8.95% (0.2995 => 0.3263, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.92% (0.2690 => 0.2930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.90% (0.2765 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.89% (0.5577 => 0.6073, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.87% (0.4791 => 0.5216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.84% (0.2760 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.84% (0.4016 => 0.4371, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.84% (0.4390 => 0.4778, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 8.79% (0.2628 => 0.2859, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.78% (0.2607 => 0.2836, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.76% (0.2761 => 0.3003, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.74% (0.3580 => 0.3893, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2655 => 0.2887, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.71% (0.3489 => 0.3793, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.63% (0.3756 => 0.4080, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.62% (0.3293 => 0.3577, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.62% (1.9828 => 2.1537, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 8.55% (0.2726 => 0.2959, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.2937 => 0.3188, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.53% (0.2988 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.53% (0.2696 => 0.2926, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.50% (0.2966 => 0.3218, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4379 => 0.4748, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 8.41% (0.8310 => 0.9009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.38% (0.3868 => 0.4192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.30% (0.3107 => 0.3365, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.28% (0.3453 => 0.3739, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.21% (0.7506 => 0.8122, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.19% (7.2180 => 7.8091, std.dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.17% (0.2914 => 0.3152, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 8.16% (0.3149 => 0.3406, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.16% (3.6692 => 3.9686, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 8.13% (3.8646 => 4.1788, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 8.07% (1.1061 => 1.1954, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 8.05% (0.3192 => 0.3449, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.01% (0.3534 => 0.3817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.98% (0.5637 => 0.6087, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3220 => 0.3474, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.7460 => 0.8044, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.82% (3.1889 => 3.4383, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 7.74% (1.0594 => 1.1414, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.73% (0.8818 => 0.9500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.64% (0.2945 => 0.3170, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.61% (0.6744 => 0.7257, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.51% (0.2023 => 0.2175, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.48% (14.8535 => 15.9648, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 7.48% (16.6129 => 17.8553, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: 7.47% (1.2749 => 1.3701, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.41% (2.1791 => 2.3406, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.35% (1.3245 => 1.4219, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 7.35% (1.9270 => 2.0687, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.27% (0.4113 => 0.4412, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.19% (0.8698 => 0.9323, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.13% (0.3663 => 0.3924, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 7.10% (0.3914 => 0.4192, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.10% (8.4961 => 9.0990, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-4: 7.08% (0.3646 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.07% (0.4003 => 0.4286, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 6.99% (0.3131 => 0.3350, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.95% (0.3755 => 0.4016, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.93% (1.3819 => 1.4776, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.92% (4.4433 => 4.7509, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 6.88% (0.3940 => 0.4211, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.86% (0.6135 => 0.6556, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.82% (4.3801 => 4.6789, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.81% (1.3813 => 1.4754, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.75% (1.1333 => 1.2098, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.71% (4.6629 => 4.9758, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (13.2842 => 14.1644, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.51% (0.2504 => 0.2667, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.51% (0.2859 => 0.3045, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.46% (14.5298 => 15.4681, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (6.5754 => 6.9921, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.05% (3.2742 => 3.4724, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 5.96% (1.2292 => 1.3025, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.80% (0.9108 => 0.9636, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.70% (0.4805 => 0.5079, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.58% (0.6250 => 0.6599, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.48% (0.2008 => 0.2118, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.32% (4.9865 => 5.2516, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.19% (1.5188 => 1.5977, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.03% (3.7467 => 3.9351, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.98% (6.2785 => 6.5912, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.97% (2.1007 => 2.2051, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.61% (0.3511 => 0.3673, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.16% (33.2944 => 34.6781, std.dev.: 0.0181) MultiSource/Applications/sqlite3/sqlite3: 3.29% (16.2614 => 16.7959, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5068, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.40% (1.2998 => 1.3830, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7245, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1081, std.dev.: 0.0675) SingleSource/Benchmarks/Misc/flops-6: 3.27% (1.9199 => 1.9827, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5911, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5826, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2232, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9177, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5827, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.74% (22.5627 => 21.9445, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2848, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2939, std.dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0122) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.29% (1.7688 => 1.7106, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: -2.78% (3.0263 => 2.9423, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2440, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.69% (0.6615 => 0.6503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1399, std.dev.: 0.0231) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2238, std.dev.: 0.0283) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2596, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2523, std.dev.: 0.0148) SingleSource/Benchmarks/McGill/chomp: -1.01% (1.2308 => 1.2184, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 07:30:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 09:30:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927143006.4414D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4310?compare_to=4308&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4310, Order: 164771, Start Time: 2012-09-27 13:20:50, End Time: 2012-09-27 14:31:40 To: 4308, Order: 164769, Start Time: 2012-09-27 11:54:29, End Time: 2012-09-27 13:05:05 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (88 on baseline) Performance Improvements: 3 (39 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.09% (8.6202 => 9.1448, std.dev.: 0.0692) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5748 => 0.5864, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 7.37% (3.0168 => 3.2392, std.dev.: 0.0791) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.04% (0.7596 => 0.7979, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.69% (1.3260 => 1.3749, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (41.9151 => 43.0344, std.dev.: 0.1825) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.29% (2.6727 => 2.7338, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 1.73% (8.7165 => 8.8675, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.38% (0.5756 => 0.5619, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -3.77% (0.3711 => 0.3571, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.27% (2.9263 => 2.8598, std.dev.: 0.0180) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.27% (1.0163 => 1.0190, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: -0.89% (0.5948 => 0.5895, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -0.65% (0.1536 => 0.1526, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.11% (0.1346 => 0.1361, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.45% (0.3020 => 0.2946, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.2242 => 0.2226, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.23% (0.3041 => 0.3034, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.30% (0.2076 => 0.2103, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -0.35% (0.0282 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0091 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.89% (0.0076 => 0.0082, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.54% (0.0195 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.85% (0.0393 => 0.0370, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.32% (0.0304 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.42% (0.0289 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.52% (0.0329 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -49.18% (0.0183 => 0.0093, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -27.41% (0.0197 => 0.0143, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 1.19% (0.0252 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -3.13% (0.0128 => 0.0124, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1456 => 0.1450, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -0.54% (1.5142 => 1.5060, std.dev.: 0.0152) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.11% (0.1469 => 0.1500, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.47% (0.4075 => 0.4094, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.15% (0.1372 => 0.1429, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.45% (0.0621 => 0.0630, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0204 => 0.0238, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.01% (0.0599 => 0.0647, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1270 => 1.1259, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 200.00% (0.0008 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.35% (0.0568 => 0.0570, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.45% (0.0256 => 0.0155, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.7658 => 0.7668, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.23% (1.6008 => 1.5971, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 185.71% (0.0042 => 0.0120, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.06% (4.1772 => 3.0470, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/except: 82666.67% (0.0006 => 0.4966, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.43% (0.0745 => 0.0927, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.45% (0.5309 => 0.5864, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.01% (0.1159 => 0.1275, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 10.00% (2.1763 => 2.3940, std.dev.: 0.0189) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.48% (0.1414 => 0.1548, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.22% (0.6410 => 0.7001, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 7.43% (1.0046 => 1.0792, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 7.17% (1.1653 => 1.2488, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.04% (0.3582 => 0.3834, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.92% (0.6173 => 0.6600, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 6.34% (15.3105 => 16.2809, std.dev.: 0.1052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.30% (1.5150 => 1.6105, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.85% (0.6069 => 0.6424, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (12.6413 => 13.3456, std.dev.: 0.0557) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (0.7639 => 0.8057, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 5.44% (0.6915 => 0.7291, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.20% (0.2886 => 0.3036, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.10% (0.3901 => 0.4100, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.4248 => 0.4457, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 4.92% (29.3170 => 30.7586, std.dev.: 0.0571) MultiSource/Applications/d/make_dparser: 4.88% (3.0225 => 3.1701, std.dev.: 0.0493) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.86% (0.2797 => 0.2933, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.86% (0.2552 => 0.2676, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.3217 => 0.3373, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.43% (1.2021 => 1.2553, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.37% (0.2654 => 0.2770, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1672 => 1.2179, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.32% (3.0758 => 3.2087, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: 4.32% (13.3238 => 13.8993, std.dev.: 0.1165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (6.2546 => 6.5214, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.10% (0.4880 => 0.5080, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.02% (1.4408 => 1.4987, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.7722 => 0.8031, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.97% (2.0317 => 2.1123, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 3.88% (1.1440 => 1.1884, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.87% (0.2996 => 0.3112, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.79% (1.1827 => 1.2275, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 3.76% (1.0821 => 1.1228, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (8.2186 => 8.5232, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.71% (1.4113 => 1.4636, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 3.68% (1.3268 => 1.3756, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.55% (0.8569 => 0.8873, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.3418 => 0.3536, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (6.4908 => 6.7127, std.dev.: 0.0454) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.0689 => 1.1050, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 3.28% (14.7256 => 15.2082, std.dev.: 0.1226) MultiSource/Applications/lua/lua: 3.23% (3.5980 => 3.7142, std.dev.: 0.0377) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.6079 => 15.0793, std.dev.: 0.1232) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.20% (4.0318 => 4.1608, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.7226 => 0.7454, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 3.08% (0.8405 => 0.8664, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (4.2815 => 4.3941, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.54% (0.4562 => 0.4678, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.4189 => 1.4545, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.45% (4.3380 => 4.4441, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.5963 => 0.6093, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (1.3935 => 1.4168, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 45.98% (0.0261 => 0.0381, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2294, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.41% (0.0766 => 0.0930, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.67% (0.0917 => 0.1079, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 14.97% (21.1721 => 24.3406, std.dev.: 0.9652) SingleSource/Benchmarks/Shootout/ary3: 14.94% (1.7426 => 2.0030, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.75% (4.0101 => 4.5613, std.dev.: 0.1110) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8059, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6241, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.99% (1.0063 => 1.0766, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.31% (40.4792 => 43.0344, std.dev.: 0.1825) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (0.3301 => 0.3501, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.86% (0.7609 => 0.7979, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.37% (0.8498 => 0.8869, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 4.19% (8.5113 => 8.8675, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 3.91% (15.2242 => 15.8196, std.dev.: 0.0572) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 2.82% (3.8907 => 4.0006, std.dev.: 0.0120) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8863, std.dev.: 0.0368) MultiSource/Applications/siod/siod: 2.72% (3.5520 => 3.6487, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (6.6312 => 6.8108, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/mason/mason: 2.64% (0.5004 => 0.5136, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.56% (2.6656 => 2.7338, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 2.49% (0.6459 => 0.6620, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: 1.70% (2.4013 => 2.4422, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (4.6414 => 4.6936, std.dev.: 0.0166) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.02% (27.1724 => 27.4490, std.dev.: 0.0774) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.12% (0.3497 => 0.2059, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.21% (5.2665 => 4.0966, std.dev.: 0.1614) SingleSource/Benchmarks/Shootout-C++/ary3: -20.32% (1.7473 => 1.3922, std.dev.: 0.0245) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.45% (1.1647 => 0.9615, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.01% (15.8312 => 13.2971, std.dev.: 0.2147) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: -12.04% (0.3746 => 0.3295, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -10.68% (0.1114 => 0.0995, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9362, std.dev.: 0.0710) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2877, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.66% (3.6254 => 3.3839, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3321, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: -6.32% (7.6833 => 7.1977, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3548, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.88% (3.4230 => 3.2218, std.dev.: 0.0344) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9577, std.dev.: 0.1761) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1890, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.15% (1.2959 => 1.2421, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/misr: -3.93% (0.4296 => 0.4127, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.64% (1.2722 => 1.2259, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9494, std.dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8209, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.49% (2.4457 => 2.3848, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.29% (1.0686 => 1.0441, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.23% (1.1683 => 1.1423, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.94% (1.4021 => 1.3749, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0106) MultiSource/Benchmarks/PAQ8p/paq8p: -1.86% (92.7467 => 91.0224, std.dev.: 0.0931) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4233, std.dev.: 0.0099) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3662, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2241, std.dev.: 0.0596) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3066, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.33% (1.8739 => 1.8490, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.24% (1.7361 => 1.7146, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.10% (0.9980 => 1.0190, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: -2.11% (0.6022 => 0.5895, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -8.40% (0.1666 => 0.1526, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.42% (0.1554 => 0.1361, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.44% (0.3083 => 0.2946, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.02% (0.2394 => 0.2226, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.44% (0.3175 => 0.3034, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.64% (0.2302 => 0.2103, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -37.42% (0.0449 => 0.0281, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.83% (0.0240 => 0.0082, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.13% (0.0390 => 0.0370, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -47.46% (0.0177 => 0.0093, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -24.34% (0.0189 => 0.0143, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.47% (0.1429 => 0.1450, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 0.27% (1.5019 => 1.5060, std.dev.: 0.0152) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1501 => 0.1500, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.99% (0.4264 => 0.4094, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.32% (0.1344 => 0.1429, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.96% (0.0589 => 0.0630, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.59% (0.0232 => 0.0238, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.80% (1.1350 => 1.1259, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.52% (0.0637 => 0.0570, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.99% (0.0246 => 0.0155, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.68% (0.7541 => 0.7668, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.96% (1.5363 => 1.5971, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 07:46:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 09:46:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927144633.34B512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4311?compare_to=4306&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4311, Order: 164771, Start Time: 2012-09-27 13:28:12, End Time: 2012-09-27 14:48:07 To: 4306, Order: 164769, Start Time: 2012-09-27 11:15:38, End Time: 2012-09-27 12:35:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5752 => 0.5753, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.13% (15.9837 => 16.0044, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 0.02% (14.8809 => 14.8839, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 0.16% (83.2931 => 83.4281, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 0.01% (4.3391 => 4.3397, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2310 => 1.2307, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.5036 => 7.5139, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.29% (3.7055 => 3.7164, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.20% (0.6451 => 0.6464, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.92% (63.2438 => 83.4281, std.dev.: 0.0173) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14236.39% (0.0720 => 10.3222, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.82% (10.3673 => 15.1179, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: 30.21% (0.1622 => 0.2112, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.54% (7.0540 => 8.0800, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.42% (2.2022 => 2.5198, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.34% (0.1432 => 0.1623, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.96% (0.1566 => 0.1769, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.80% (1.1194 => 1.2627, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.95% (1.7609 => 1.9713, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 9.41% (0.3282 => 0.3591, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 8.54% (0.1440 => 0.1563, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.38% (10.4361 => 11.3103, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.05% (9.4845 => 10.2481, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3307 => 0.3568, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.67% (0.4879 => 0.5253, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.38% (0.7115 => 0.7640, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.32% (0.7433 => 0.7977, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.4615 => 0.4952, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 7.30% (0.3109 => 0.3336, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.6675 => 0.7156, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.19% (0.3423 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.04% (8.1363 => 8.7087, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.96% (0.2700 => 0.2888, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.94% (1.3050 => 1.3956, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.91% (5.7591 => 6.1570, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.86% (1.5415 => 1.6473, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (4.2646 => 4.5556, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 6.82% (3.3354 => 3.5629, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.80% (0.5105 => 0.5452, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.79% (0.5860 => 0.6258, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1510 => 0.1612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.8172 => 0.8723, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.45% (0.2107 => 0.2243, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 6.43% (0.7835 => 0.8339, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.40% (0.3422 => 0.3641, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.35% (4.9449 => 5.2587, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.33% (5.0018 => 5.3183, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.30% (0.5569 => 0.5920, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.30% (0.8067 => 0.8575, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4636 => 0.4926, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3121 => 0.3315, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.20% (0.5020 => 0.5331, std.dev.: 0.0107) MultiSource/Applications/hbd/hbd: 6.14% (1.5603 => 1.6561, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.08% (0.3092 => 0.3280, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.06% (0.9765 => 1.0357, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.05% (0.2891 => 0.3066, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.01% (1.1642 => 1.2342, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.97% (0.4289 => 0.4545, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.6456 => 0.6837, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.89% (1.0722 => 1.1354, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.89% (1.1861 => 1.2560, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.4103 => 0.4343, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.84% (7.9617 => 8.4265, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.84% (0.3650 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.82% (0.3387 => 0.3584, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.75% (0.3441 => 0.3639, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.71% (21.9371 => 23.1904, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.69% (0.4203 => 0.4442, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.67% (3.8723 => 4.0919, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.67% (0.3865 => 0.4084, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.63% (2.0665 => 2.1829, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.62% (0.2756 => 0.2911, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.62% (0.3826 => 0.4041, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.62% (0.2831 => 0.2990, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.61% (0.3136 => 0.3312, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.60% (0.3180 => 0.3358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3232 => 0.3411, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.54% (0.2872 => 0.3031, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4620 => 0.4875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.3098 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.3283 => 0.3463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3603 => 0.3800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2714 => 0.2862, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.44% (0.3052 => 0.3218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2802 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.41% (0.4048 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.41% (0.3162 => 0.3333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2871 => 0.3026, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4299 => 0.4531, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.34% (2.0273 => 2.1356, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2793 => 0.2941, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6450 => 0.6789, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.24% (0.3684 => 0.3877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (0.3935 => 0.4137, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.10% (0.8921 => 0.9376, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.00% (0.3379 => 0.3548, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.85% (2.2969 => 2.4082, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.79% (1.5859 => 1.6618, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.73% (0.5981 => 0.6264, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.51% (2.2024 => 2.3017, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.4186 => 1.4817, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (14.3668 => 15.0056, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 4.15% (1.1840 => 1.2331, std.dev.: 0.0126) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2842 => 1.3332, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.3131 => 0.3243, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.8101 => 0.8350, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.08% (17.1811 => 17.5391, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (3.8922 => 3.9614, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.71% (1.1396 => 1.2161, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7612, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3469, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.59% (9.1159 => 9.2604, std.dev.: 0.0366) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2568, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.50% (5.3855 => 3.9046, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.17% (5.3526 => 3.8983, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1119, std.dev.: 0.0345) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.20% (2.9384 => 2.6093, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -8.63% (22.1758 => 20.2618, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2613, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1600, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5121, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.38% (1.2373 => 1.2078, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9854, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.08% (8.6802 => 8.4996, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0925, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2519, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5144, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.02% (0.5229 => 0.5753, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.77% (14.9895 => 16.0044, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 5.15% (14.1553 => 14.8839, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 5.58% (4.1105 => 4.3397, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1048 => 1.2307, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.97% (7.1582 => 7.5139, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.32% (3.4629 => 3.7164, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.6222 => 0.6464, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 08:20:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 10:20:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927152046.1121D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4312?compare_to=4309&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4312, Order: 164771, Start Time: 2012-09-27 14:07:31, End Time: 2012-09-27 15:22:20 To: 4309, Order: 164769, Start Time: 2012-09-27 12:24:11, End Time: 2012-09-27 13:38:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.04% (79.4087 => 80.2360, std.dev.: 0.3011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.54% (2.0176 => 2.4522, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.93% (0.5818 => 0.6454, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.81% (3.9660 => 4.3948, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: 10.80% (0.5748 => 0.6369, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.49% (0.7061 => 0.7802, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 10.28% (0.4328 => 0.4773, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.25% (1.3693 => 1.5096, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.14% (1.2193 => 1.3429, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.05% (0.2596 => 0.2857, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.90% (0.7038 => 0.7735, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.88% (0.9199 => 1.0108, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.78% (0.3130 => 0.3436, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.76% (0.6959 => 0.7638, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.74% (0.2781 => 0.3052, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.71% (0.7710 => 0.8459, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.68% (1.1364 => 1.2464, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 9.68% (0.4062 => 0.4455, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.67% (0.5265 => 0.5774, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.61% (1.4563 => 1.5962, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 9.59% (13.8202 => 15.1460, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.57% (0.6283 => 0.6884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.53% (0.2782 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.04% (0.3485 => 0.3800, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.04% (1.0313 => 1.1245, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.03% (0.3899 => 0.4251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.00% (0.3022 => 0.3294, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.98% (0.5577 => 0.6078, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.97% (0.3580 => 0.3901, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.95% (0.2995 => 0.3263, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.94% (0.3489 => 0.3801, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.91% (0.4791 => 0.5218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.90% (0.2765 => 0.3011, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.88% (0.4390 => 0.4780, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 8.87% (0.2761 => 0.3006, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.86% (0.2607 => 0.2838, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.84% (0.4016 => 0.4371, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.83% (0.2628 => 0.2860, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.81% (0.2655 => 0.2889, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 8.81% (0.2690 => 0.2927, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.78% (1.9828 => 2.1569, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.73% (0.2760 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.72% (0.3293 => 0.3580, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.68% (0.2937 => 0.3192, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.66% (0.2966 => 0.3223, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.62% (0.2726 => 0.2961, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.57% (0.3756 => 0.4078, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.56% (0.3246 => 0.3524, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6576 => 0.7138, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4379 => 0.4753, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.49% (0.2696 => 0.2925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.49% (0.3453 => 0.3746, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.48% (0.8310 => 0.9015, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.40% (0.3107 => 0.3368, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.37% (0.2988 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.35% (0.3149 => 0.3412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.32% (0.3868 => 0.4190, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.30% (1.1061 => 1.1979, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (7.2180 => 7.8164, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 8.27% (3.8646 => 4.1843, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.27% (3.6692 => 3.9726, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 8.15% (0.7506 => 0.8118, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 8.15% (0.3192 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.14% (0.5637 => 0.6096, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.01% (0.3220 => 0.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.98% (0.3534 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.90% (0.7460 => 0.8049, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3578 => 0.3858, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.80% (0.8818 => 0.9506, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.79% (1.0594 => 1.1419, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.77% (3.1889 => 3.4366, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 7.76% (0.6744 => 0.7267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.74% (0.2945 => 0.3173, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.73% (0.3789 => 0.4082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.58% (16.6129 => 17.8725, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 7.54% (14.8535 => 15.9733, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.53% (0.3650 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3623 => 0.3895, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4113 => 0.4420, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.38% (1.9270 => 2.0693, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3398, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.36% (1.3245 => 1.4220, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (1.2749 => 1.3685, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.32% (0.8698 => 0.9335, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.27% (0.2243 => 0.2406, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.07% (0.1569 => 0.1680, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.06% (8.4961 => 9.0962, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.04% (1.3819 => 1.4792, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.01% (0.6135 => 0.6565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.00% (0.3755 => 0.4018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.00% (4.4433 => 4.7544, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.93% (4.3801 => 4.6838, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 6.93% (0.3131 => 0.3348, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4764, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.71% (13.2842 => 14.1760, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.66% (1.1333 => 1.2088, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.54% (0.2859 => 0.3046, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.48% (14.5298 => 15.4719, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 6.47% (4.6629 => 4.9646, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.47% (0.2504 => 0.2666, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.2140 => 0.2278, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.42% (6.5754 => 6.9977, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3245 => 0.3453, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.14% (3.2742 => 3.4753, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.95% (1.2292 => 1.3023, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.83% (0.9108 => 0.9639, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.4805 => 0.5082, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.58% (0.6250 => 0.6599, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.2008 => 0.2120, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.42% (4.9865 => 5.2566, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.31% (1.5188 => 1.5994, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.00% (6.2785 => 6.5925, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 4.96% (3.7467 => 3.9326, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.90% (2.1007 => 2.2036, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.16% (0.3511 => 0.3657, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.15% (33.2944 => 34.6759, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 3.16% (16.2614 => 16.7747, std.dev.: 0.0190) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2543, std.dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4164, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.87% (0.3139 => 0.3292, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7249, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1033, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5858, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5841, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2247, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5849, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.59% (22.5627 => 21.9790, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2709, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.01% (1.3780 => 1.2952, std.dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.63% (0.6615 => 0.6507, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2541, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -1.52% (1.2308 => 1.2121, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std.dev.: 0.0105) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1715, std.dev.: 0.0482) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2304, std.dev.: 0.0104) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4348, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.01% (7.3305 => 7.2564, std.dev.: 0.0146) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 08:56:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 10:56:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120927155652.531A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4313?compare_to=4307&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4313, Order: 164769, Start Time: 2012-09-27 13:14:37, End Time: 2012-09-27 15:58:27 To: 4307, Order: 164763, Start Time: 2012-09-27 10:02:03, End Time: 2012-09-27 12:45:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.87% (68.8507 => 74.9579, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.23% (127.0094 => 129.8449, std.dev.: 0.9412) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.61% (0.3488 => 0.3893, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3465 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.33% (0.3460 => 0.3852, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 11.30% (0.3442 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.27% (0.3496 => 0.3890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.98% (0.3643 => 0.4043, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3724 => 0.4127, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.95% (1.5932 => 1.7518, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.55% (0.5826 => 0.6324, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.5889 => 0.6383, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.27% (0.2875 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.23% (1.3152 => 1.4103, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.16% (1.6211 => 1.7372, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.13% (0.4994 => 0.5350, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.07% (0.3195 => 0.3421, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.06% (0.7171 => 0.7677, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.94% (0.2738 => 0.2928, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 6.91% (0.2750 => 0.2940, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.91% (0.2823 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.86% (0.2813 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.86% (0.5000 => 0.5343, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.86% (0.4361 => 0.4660, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.81% (0.2792 => 0.2982, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2811 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.71% (3.5627 => 3.8019, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.71% (2.0673 => 2.2060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2803 => 0.2991, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.69% (0.9909 => 1.0572, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2780 => 0.2966, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.67% (0.2729 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.58% (2.7292 => 2.9089, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 6.56% (0.3096 => 0.3299, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.56% (5.5417 => 5.9050, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.54% (0.3625 => 0.3862, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.53% (0.2911 => 0.3101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.46% (0.3267 => 0.3478, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3317 => 0.3531, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.38% (0.3258 => 0.3466, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.37% (0.3060 => 0.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.36% (0.3348 => 0.3561, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.3282 => 0.3489, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.22% (0.3362 => 0.3571, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.21% (0.4029 => 0.4279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.20% (0.3678 => 0.3906, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.18% (0.3930 => 0.4173, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.13% (1.0781 => 1.1442, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.11% (0.3124 => 0.3315, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.09% (0.3726 => 0.3953, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.2736 => 0.2900, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.98% (0.3477 => 0.3685, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.96% (0.3845 => 0.4074, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (0.5026 => 0.5323, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.89% (4.2109 => 4.4590, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.81% (0.4251 => 0.4498, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 5.81% (23.5202 => 24.8856, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4146 => 0.4382, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.69% (0.3690 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.3981 => 0.4205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.2866 => 0.3026, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.56% (0.4139 => 0.4369, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.50% (1.8794 => 1.9827, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.49% (0.2566 => 0.2707, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (4.4195 => 4.6573, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 5.36% (2.1013 => 2.2139, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.29% (0.5900 => 0.6212, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (0.3903 => 0.4109, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (0.3890 => 0.4095, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.22% (0.2068 => 0.2176, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 5.19% (0.5012 => 0.5272, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.06% (4.6177 => 4.8515, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.03% (0.6435 => 0.6759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.98% (0.3271 => 0.3434, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 4.96% (0.6634 => 0.6963, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 4.92% (1.4269 => 1.4971, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.92% (0.4658 => 0.4887, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.90% (0.3084 => 0.3235, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.89% (0.5546 => 0.5817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.85% (0.2969 => 0.3113, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (2.1653 => 2.2687, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.75% (0.2737 => 0.2867, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.72% (0.9697 => 1.0155, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.56% (0.7875 => 0.8234, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.56% (0.3336 => 0.3488, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.45% (1.9694 => 2.0570, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.38% (1.9966 => 2.0840, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (0.2691 => 0.2803, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 4.15% (2.0346 => 2.1191, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.88% (0.4253 => 0.4418, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 3.71% (0.4847 => 0.5027, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (0.7426 => 0.7684, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.43% (0.5361 => 0.5545, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.04% (0.5584 => 0.5754, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.3498 => 0.3598, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (4.6926 => 4.8254, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.81% (11.6398 => 11.9674, std.dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: 1.59% (11.9555 => 12.1460, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.2122 => 0.2250, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std.dev.: 0.0470) SingleSource/Benchmarks/Misc/flops-2: 4.63% (1.8057 => 1.8893, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6448, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0503) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5057, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4495, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.27% (7.1849 => 7.2765, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5930, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4425, std.dev.: 0.0492) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5491, std.dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7999, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7935, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.25% (17.2379 => 16.8508, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5721, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 09:24:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 11:24:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927162401.685B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4314?compare_to=4310&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4314, Order: 164774, Start Time: 2012-09-27 15:14:48, End Time: 2012-09-27 16:25:36 To: 4310, Order: 164771, Start Time: 2012-09-27 13:20:50, End Time: 2012-09-27 14:31:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (82 on baseline) Performance Improvements: 4 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 894 (768 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.18% (1.2679 => 1.2955, std.dev.: 0.0101) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.18% (1.2421 => 1.2568, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.12% (1.5970 => 1.6149, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.92% (9.1448 => 8.8774, std.dev.: 0.0880) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.28% (4.3941 => 4.3377, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.5214 => 6.4458, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.58% (2.4312 => 2.2712, std.dev.: 0.0380) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.17% (1.0190 => 1.0173, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 0.25% (0.5895 => 0.5910, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -0.20% (0.1526 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.65% (0.1361 => 0.1325, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.64% (0.2946 => 0.2965, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.85% (0.2226 => 0.2245, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.23% (0.3034 => 0.3027, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.57% (0.2103 => 0.2136, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -0.36% (0.0281 => 0.0280, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.63% (0.0082 => 0.0070, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.68% (0.0370 => 0.0391, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.33% (0.0300 => 0.0224, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0282 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 51.61% (0.0093 => 0.0141, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -4.90% (0.0143 => 0.0136, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -0.39% (0.0255 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -19.35% (0.0124 => 0.0100, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1450 => 0.1454, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.27% (1.5060 => 1.4869, std.dev.: 0.0151) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.40% (0.1500 => 0.1479, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.02% (0.4094 => 0.4093, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.41% (0.1429 => 0.1366, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.33% (0.0630 => 0.0546, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.56% (0.0238 => 0.0220, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.75% (0.0647 => 0.0571, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1259 => 1.1275, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.46% (0.0570 => 0.0584, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.74% (0.0155 => 0.0198, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7668 => 0.7647, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.03% (1.5971 => 1.5966, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.64% (4.1772 => 3.0642, std.dev.: 0.0641) SingleSource/Benchmarks/Shootout-C++/except: 82000.00% (0.0006 => 0.4926, std.dev.: 0.0058) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 9.81% (0.5309 => 0.5830, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6410 => 0.6983, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.70% (0.1414 => 0.1537, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.30% (2.1763 => 2.3570, std.dev.: 0.0334) MultiSource/Applications/minisat/minisat: 7.13% (0.6173 => 0.6613, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 6.69% (1.1653 => 1.2433, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 6.63% (1.0046 => 1.0712, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.2552 => 0.2720, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.56% (0.3582 => 0.3817, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.78% (15.3105 => 16.1953, std.dev.: 0.1401) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.6915 => 0.7308, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (1.5150 => 1.6006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.43% (0.3901 => 0.4113, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.7639 => 0.8018, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: 4.93% (29.3170 => 30.7616, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.83% (0.2797 => 0.2932, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.81% (12.6413 => 13.2498, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3217 => 0.3367, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.64% (0.4248 => 0.4445, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 4.57% (3.0225 => 3.1606, std.dev.: 0.0465) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.2347 => 0.2454, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.50% (1.3268 => 1.3865, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.50% (0.6069 => 0.6342, std.dev.: 0.0090) MultiSource/Applications/Burg/burg: 4.42% (1.1440 => 1.1946, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.39% (0.4880 => 0.5094, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 4.37% (13.3238 => 13.9055, std.dev.: 0.1849) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.18% (0.2654 => 0.2765, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.3418 => 0.3557, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.2771 => 0.2883, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.99% (1.1672 => 1.2138, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 3.84% (4.7455 => 4.9278, std.dev.: 0.0297) MultiSource/Applications/ClamAV/clamscan: 3.50% (14.6079 => 15.1192, std.dev.: 0.0320) MultiSource/Applications/sgefa/sgefa: 3.48% (0.2877 => 0.2977, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.42% (1.2021 => 1.2432, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (0.8405 => 0.8688, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (8.2186 => 8.4927, std.dev.: 0.0165) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (6.4908 => 6.7068, std.dev.: 0.0314) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.29% (0.8569 => 0.8851, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.22% (1.0821 => 1.1169, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.06% (6.2546 => 6.4458, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 2.98% (14.7256 => 15.1637, std.dev.: 0.0697) MultiSource/Applications/treecc/treecc: 2.81% (1.8798 => 1.9326, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 2.72% (3.5980 => 3.6959, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.4113 => 1.4487, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.58% (4.0318 => 4.1357, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.30% (0.7226 => 0.7392, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.99% (1.3935 => 1.4212, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.95% (4.2616 => 4.3446, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.4189 => 1.4436, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 1.56% (0.9425 => 0.9572, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (4.3380 => 4.4051, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.2815 => 4.3377, std.dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 14.98% (1.7426 => 2.0037, std.dev.: 0.0243) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.18% (0.0917 => 0.1047, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.28% (4.0101 => 4.5425, std.dev.: 0.0190) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6217, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.12% (1.0063 => 1.0880, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (0.3301 => 0.3464, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.75% (40.4792 => 42.4025, std.dev.: 0.4735) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.60% (0.8498 => 0.8889, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8541, std.dev.: 0.0614) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: 3.86% (0.9851 => 1.0231, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.36% (0.5587 => 0.5775, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.98% (8.5113 => 8.7648, std.dev.: 0.0535) MultiSource/Benchmarks/sim/sim: 2.87% (3.8907 => 4.0022, std.dev.: 0.0332) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8908, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8093, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/mason/mason: 2.50% (0.5004 => 0.5129, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.22% (0.6308 => 0.6448, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.13% (0.5876 => 0.6001, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 1.82% (2.4013 => 2.4451, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.19% (38.9255 => 39.3872, std.dev.: 0.1704) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.01% (27.1724 => 27.4460, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.44% (0.3497 => 0.2048, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -17.50% (5.2665 => 4.3449, std.dev.: 0.1446) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.33% (1.1647 => 0.9628, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.30% (15.8312 => 13.4083, std.dev.: 0.0870) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.98% (0.0917 => 0.0798, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: -10.77% (0.1114 => 0.0994, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.44% (3.2007 => 2.9307, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3774, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (4.6355 => 4.3251, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.53% (2.0027 => 1.8719, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -6.48% (7.6833 => 7.1857, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3526, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: -5.74% (3.4230 => 3.2266, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/distray/distray: -5.67% (0.2664 => 0.2513, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -5.62% (62.4126 => 58.9048, std.dev.: 0.0615) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1887, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/misr: -4.66% (0.4296 => 0.4096, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.33% (2.5166 => 2.4076, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.27% (45.4683 => 43.5256, std.dev.: 0.7426) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.07% (1.2722 => 1.2204, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.84% (0.4140 => 0.3981, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.48% (3.7496 => 3.6191, std.dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/methcall: -3.28% (9.2503 => 8.9470, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.9413 => 3.8204, std.dev.: 0.0283) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.02% (1.2959 => 1.2568, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0192) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.66% (2.8964 => 2.8195, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.17% (1.1683 => 1.1429, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.92% (2.3569 => 2.3117, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (92.7467 => 90.9789, std.dev.: 0.2705) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3647, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2203, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.61% (1.0926 => 1.0750, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -1.52% (2.4971 => 2.4591, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3078, std.dev.: 0.0119) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.93% (0.9980 => 1.0173, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -1.86% (0.6022 => 0.5910, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -8.58% (0.1666 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.74% (0.1554 => 0.1325, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.83% (0.3083 => 0.2965, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.22% (0.2394 => 0.2245, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.66% (0.3175 => 0.3027, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.21% (0.2302 => 0.2136, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -70.83% (0.0240 => 0.0070, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.58% (0.0301 => 0.0224, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -20.34% (0.0177 => 0.0141, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -28.04% (0.0189 => 0.0136, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -69.23% (0.0325 => 0.0100, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.75% (0.1429 => 0.1454, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.00% (1.5019 => 1.4869, std.dev.: 0.0151) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.47% (0.1501 => 0.1479, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.01% (0.4264 => 0.4093, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.64% (0.1344 => 0.1366, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.30% (0.0589 => 0.0546, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.17% (0.0232 => 0.0220, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1350 => 1.1275, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.32% (0.0637 => 0.0584, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.51% (0.0246 => 0.0198, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7541 => 0.7647, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.93% (1.5363 => 1.5966, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 09:46:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 11:46:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927164650.0E04E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4315?compare_to=4311&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4315, Order: 164774, Start Time: 2012-09-27 15:28:28, End Time: 2012-09-27 16:48:24 To: 4311, Order: 164771, Start Time: 2012-09-27 13:28:12, End Time: 2012-09-27 14:48:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.38% (55.1256 => 56.4355, std.dev.: 0.1252) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.59% (0.5753 => 0.5787, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 0.00% (16.0044 => 16.0046, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 0.26% (14.8839 => 14.9221, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 0.00% (83.4281 => 83.4308, std.dev.: 0.0348) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.3397 => 4.3434, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.23% (1.2307 => 1.2335, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (7.5139 => 7.5153, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.7164 => 3.7181, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.19% (0.6464 => 0.6476, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (0.0648 => 0.0685, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.92% (63.2438 => 83.4308, std.dev.: 0.0348) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14231.67% (0.0720 => 10.3188, std.dev.: 0.0054) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.13% (10.3673 => 15.1499, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 30.27% (0.1622 => 0.2113, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.59% (2.2022 => 2.5235, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.54% (7.0540 => 8.0796, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.84% (0.1566 => 0.1767, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2586, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.77% (1.7609 => 1.9681, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.60% (0.3927 => 0.4304, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.75% (0.1440 => 0.1566, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.57% (10.4361 => 11.3300, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.13% (0.3307 => 0.3576, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: 8.10% (0.1655 => 0.1789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.01% (9.4845 => 10.2438, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.58% (0.4879 => 0.5249, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.43% (0.7433 => 0.7985, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.42% (0.7115 => 0.7643, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.30% (0.3109 => 0.3336, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.25% (0.6675 => 0.7159, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.3423 => 0.3671, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.20% (0.5860 => 0.6282, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.03% (1.5415 => 1.6498, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (8.1363 => 8.7043, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.94% (4.2646 => 4.5605, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.90% (1.3050 => 1.3950, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.8172 => 0.8735, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 6.89% (5.7591 => 6.1558, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.89% (0.1510 => 0.1614, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.88% (0.5105 => 0.5456, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.85% (3.3354 => 3.5638, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.54% (0.5569 => 0.5933, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 6.49% (0.3422 => 0.3644, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.45% (0.2107 => 0.2243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.36% (0.8067 => 0.8580, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (5.0018 => 5.3177, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.30% (4.9449 => 5.2564, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 6.29% (0.7835 => 0.8328, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.28% (0.4636 => 0.4927, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3121 => 0.3315, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3650 => 0.3876, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.18% (0.5020 => 0.5330, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.16% (1.1642 => 1.2359, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 6.16% (0.4289 => 0.4553, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (0.9765 => 1.0364, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.6456 => 0.6851, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.03% (0.4064 => 0.4309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.02% (0.4103 => 0.4350, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3092 => 0.3278, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.99% (0.3136 => 0.3324, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.98% (1.5603 => 1.6536, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (1.1861 => 1.2570, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.94% (2.0665 => 2.1892, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 5.93% (1.0722 => 1.1358, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.92% (0.3865 => 0.4094, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (7.9617 => 8.4320, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 5.90% (0.3387 => 0.3587, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.87% (0.2725 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.86% (0.2831 => 0.2997, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 5.86% (3.8723 => 4.0992, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.81% (0.3441 => 0.3641, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.81% (0.4203 => 0.4447, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.80% (0.3826 => 0.4048, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.76% (0.2603 => 0.2753, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2872 => 0.3037, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.73% (0.3052 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2756 => 0.2914, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.73% (21.9371 => 23.1939, std.dev.: 0.0224) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.64% (0.2871 => 0.3033, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.63% (0.3603 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.63% (0.4620 => 0.4880, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3232 => 0.3412, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.4048 => 0.4272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 5.51% (0.3684 => 0.3887, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.50% (0.3162 => 0.3336, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.3283 => 0.3463, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.42% (0.2877 => 0.3033, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.42% (2.0273 => 2.1371, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.41% (0.2793 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2802 => 0.2952, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3935 => 0.4144, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.24% (0.6450 => 0.6788, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.16% (2.2969 => 2.4155, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 5.15% (0.3379 => 0.3553, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.11% (0.8921 => 0.9377, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.81% (1.5859 => 1.6622, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.78% (0.5981 => 0.6267, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.60% (1.4186 => 1.4839, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.57% (14.3668 => 15.0229, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.45% (2.2024 => 2.3005, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.1840 => 1.2329, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.2842 => 1.3341, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.20% (0.8101 => 0.8360, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.06% (0.3427 => 0.3532, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.15% (17.1811 => 17.5501, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (3.8922 => 3.9577, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7682, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3483, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2544, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.43% (5.2763 => 3.2484, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.67% (5.3855 => 3.8952, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.24% (5.3526 => 3.8948, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1328, std.dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.24% (2.9384 => 2.6082, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -8.67% (22.1758 => 20.2533, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2833, std.dev.: 0.2974) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5039, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -2.19% (1.2373 => 1.2102, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.15% (8.1563 => 7.9809, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5162, std.dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2522, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2276, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.67% (0.5229 => 0.5787, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.77% (14.9895 => 16.0046, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 5.42% (14.1553 => 14.9221, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 5.67% (4.1105 => 4.3434, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.65% (1.1048 => 1.2335, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.99% (7.1582 => 7.5153, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.37% (3.4629 => 3.7181, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.6222 => 0.6476, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 12:09:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 14:09:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120927190935.152BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4316?compare_to=4313&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4316, Order: 164776, Start Time: 2012-09-27 16:27:12, End Time: 2012-09-27 19:11:09 To: 4313, Order: 164769, Start Time: 2012-09-27 13:14:37, End Time: 2012-09-27 15:58:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (762 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.76% (112.0297 => 118.4791, std.dev.: 0.0511) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3446 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.95% (0.3465 => 0.3879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.93% (0.3488 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.90% (0.3496 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3469 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.67% (0.3643 => 0.4068, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.51% (0.3650 => 0.4070, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.25% (0.3724 => 0.4143, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.30% (1.5932 => 1.7414, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5826 => 0.6338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.78% (0.5889 => 0.6406, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2875 => 0.3093, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 7.49% (0.2750 => 0.2956, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.45% (0.3195 => 0.3433, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.42% (0.3004 => 0.3227, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.42% (0.7171 => 0.7703, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.34% (0.2780 => 0.2984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (0.2725 => 0.2924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.30% (0.2823 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2792 => 0.2995, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2738 => 0.2937, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.25% (0.2813 => 0.3017, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.22% (0.2811 => 0.3014, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.17% (0.3096 => 0.3318, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.15% (0.2729 => 0.2924, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2803 => 0.3003, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.13% (1.6211 => 1.7367, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 7.09% (0.9909 => 1.0612, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3317 => 0.3549, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3060 => 0.3274, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.97% (2.0673 => 2.2113, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3348 => 0.3580, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3267 => 0.3490, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.80% (1.3152 => 1.4046, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.79% (0.4361 => 0.4657, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.79% (3.5627 => 3.8045, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3258 => 0.3478, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.73% (5.5417 => 5.9146, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.3362 => 0.3587, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.63% (0.3124 => 0.3331, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.61% (0.3282 => 0.3499, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (0.4994 => 0.5324, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.56% (0.5000 => 0.5328, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.3678 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.54% (2.7292 => 2.9077, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (0.3726 => 0.3967, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3477 => 0.3700, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 6.29% (23.5202 => 25.0004, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4146 => 0.4403, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.17% (1.0781 => 1.1446, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (0.3930 => 0.4171, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4251 => 0.4511, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (0.5026 => 0.5332, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.07% (0.3690 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.2866 => 0.3039, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.3981 => 0.4219, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.85% (4.2109 => 4.4574, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.3845 => 0.4070, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.2736 => 0.2896, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.74% (0.6634 => 0.7015, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (0.5900 => 0.6236, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 5.69% (0.2566 => 0.2712, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.61% (0.4029 => 0.4255, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.5012 => 0.5293, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.3903 => 0.4119, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.52% (0.6435 => 0.6790, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.52% (0.3336 => 0.3520, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.48% (0.4139 => 0.4366, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.46% (4.4195 => 4.6606, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.42% (0.2068 => 0.2180, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.40% (0.3890 => 0.4100, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.2737 => 0.2883, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.29% (1.8794 => 1.9788, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 5.24% (2.1013 => 2.2114, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.22% (4.6177 => 4.8586, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 5.19% (1.4269 => 1.5009, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 5.14% (0.9697 => 1.0195, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.3084 => 0.3241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (0.4658 => 0.4895, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.08% (0.5546 => 0.5828, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.96% (2.1653 => 2.2728, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.95% (0.2969 => 0.3116, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.86% (0.3271 => 0.3430, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.72% (1.9694 => 2.0623, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.70% (0.7875 => 0.8245, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.70% (1.9966 => 2.0904, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (0.4847 => 0.5049, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 4.12% (2.0346 => 2.1184, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.91% (0.7426 => 0.7716, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (0.2691 => 0.2796, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (0.5361 => 0.5562, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.55% (0.4253 => 0.4404, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.40% (0.5584 => 0.5774, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (11.6398 => 12.0207, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (4.6926 => 4.8396, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 3.06% (0.3498 => 0.3605, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.77% (0.3792 => 0.3897, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.93% (11.9555 => 12.1859, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6731, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1728, std.dev.: 0.0779) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6451, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2003, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5068, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.81% (3.1722 => 3.2295, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4530, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2888, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5865, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4737, std.dev.: 0.0516) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5461, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7944, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7995, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.68% (17.2379 => 16.7755, std.dev.: 0.0604) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5705, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 12:35:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 14:35:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927193548.6A6282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4317?compare_to=4314&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4317, Order: 164782, Start Time: 2012-09-27 18:24:46, End Time: 2012-09-27 19:37:22 To: 4314, Order: 164774, Start Time: 2012-09-27 15:14:48, End Time: 2012-09-27 16:25:36 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (78 on baseline) Performance Improvements: 3 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 892 (775 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5613 => 0.5747, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 12.67% (0.1413 => 0.1592, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.08% (1.8155 => 1.8715, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.63% (3.6191 => 3.6781, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.17% (5.8620 => 5.9308, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/ReedSolomon: 1.15% (8.7648 => 8.8652, std.dev.: 0.0335) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.98% (0.3242 => 0.3113, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.38% (0.7891 => 0.7703, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.30% (0.5815 => 0.5681, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.80% (1.0173 => 1.0092, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -0.29% (0.5910 => 0.5893, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 1.18% (0.1523 => 0.1541, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.68% (0.1325 => 0.1334, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (0.2965 => 0.2969, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.18% (0.2245 => 0.2241, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.30% (0.3027 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.67% (0.2136 => 0.2079, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: - (0.0280 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -19.32% (0.0088 => 0.0071, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: 2.25% (0.0089 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.86% (0.0070 => 0.0079, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.32% (0.0194 => 0.0141, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.00% (0.0391 => 0.0348, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.93% (0.0224 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0283 => 0.0286, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.27% (0.0326 => 0.0286, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: 26.95% (0.0141 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 11.03% (0.0136 => 0.0151, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -26.38% (0.0254 => 0.0187, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 24.00% (0.0100 => 0.0124, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.48% (0.1454 => 0.1447, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -4.75% (1.4869 => 1.4163, std.dev.: 0.0436) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1479 => 0.1481, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.37% (0.4093 => 0.4078, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1366 => 0.1368, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.28% (0.0546 => 0.0539, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.73% (0.0220 => 0.0192, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.96% (0.0571 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1275 => 1.1295, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.26% (0.0023 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.99% (0.0584 => 0.0619, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.70% (0.0198 => 0.0159, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.54% (0.7647 => 0.7688, std.dev.: 0.0191) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.25% (1.5966 => 1.6006, std.dev.: 0.0110) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.43% (4.1772 => 3.1148, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 9.51% (2.1763 => 2.3832, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.15% (0.1159 => 0.1265, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.56% (0.1414 => 0.1535, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 8.42% (0.5309 => 0.5756, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.25% (0.6410 => 0.6939, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (1.1653 => 1.2456, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.67% (0.3582 => 0.3821, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 6.57% (1.0046 => 1.0706, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: 6.50% (0.6173 => 0.6574, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 5.57% (0.6915 => 0.7300, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 5.39% (15.3105 => 16.1361, std.dev.: 0.1750) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (1.5150 => 1.5966, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.26% (0.3062 => 0.3223, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 5.21% (29.3170 => 30.8449, std.dev.: 0.2466) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.00% (0.3901 => 0.4096, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.86% (0.7639 => 0.8010, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (12.6413 => 13.2234, std.dev.: 0.1577) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4248 => 0.4440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.50% (0.6069 => 0.6342, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 4.43% (3.0225 => 3.1563, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (1.1672 => 1.2188, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.2797 => 0.2915, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.14% (0.2654 => 0.2764, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.09% (1.3268 => 1.3811, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (8.2186 => 8.5531, std.dev.: 0.0887) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.81% (0.2996 => 0.3110, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.72% (13.3238 => 13.8190, std.dev.: 0.1448) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.1827 => 1.2248, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0821 => 1.1205, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.3520 => 0.3644, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 3.31% (14.6079 => 15.0915, std.dev.: 0.1337) MultiSource/Applications/lua/lua: 3.29% (3.5980 => 3.7163, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.7226 => 0.7462, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.25% (6.2546 => 6.4579, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.21% (1.2021 => 1.2407, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 3.05% (14.7256 => 15.1742, std.dev.: 0.1488) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.3418 => 0.3521, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.84% (1.1440 => 1.1765, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8405 => 0.8639, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.74% (0.8569 => 0.8804, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (4.0318 => 4.1394, std.dev.: 0.0231) MultiSource/Applications/treecc/treecc: 2.27% (1.8798 => 1.9224, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.17% (0.5937 => 0.6066, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.2815 => 4.3727, std.dev.: 0.0273) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.4189 => 1.4487, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.97% (0.5636 => 0.5747, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.83% (4.2616 => 4.3397, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.57% (4.3380 => 4.4063, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (8.2559 => 8.3656, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 1.28% (3.8796 => 3.9293, std.dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.51% (0.0261 => 0.0385, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0289) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.80% (0.0766 => 0.0933, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.57% (1.7426 => 1.9965, std.dev.: 0.0629) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.20% (4.0101 => 4.5393, std.dev.: 0.0597) MultiSource/Benchmarks/Olden/mst/mst: 12.35% (0.1417 => 0.1592, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.31% (0.2857 => 0.3123, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 9.04% (7.0025 => 7.6357, std.dev.: 0.0372) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.94% (1.0063 => 1.0862, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.3301 => 0.3544, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.76% (40.4792 => 42.8088, std.dev.: 0.3960) SingleSource/Benchmarks/Misc/dt: 4.49% (0.9851 => 1.0293, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 4.16% (8.5113 => 8.8652, std.dev.: 0.0335) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 3.90% (15.2242 => 15.8177, std.dev.: 0.0713) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8866, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8103, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 2.70% (3.8907 => 3.9957, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.6127 => 4.7187, std.dev.: 0.0251) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6327, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2726 => 1.2934, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4455 => 2.4776, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.15% (0.3497 => 0.2058, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.32% (5.2665 => 4.0909, std.dev.: 0.1408) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.19% (1.1647 => 0.9645, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.70% (15.8312 => 13.1872, std.dev.: 0.1742) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0496) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.01% (0.0917 => 0.0816, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.80% (3.2007 => 2.9511, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3750, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3275, std.dev.: 0.0232) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.61% (2.0027 => 1.8703, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.29% (2.9728 => 2.7857, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: -6.12% (0.2664 => 0.2501, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3567, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -6.04% (7.6833 => 7.2192, std.dev.: 0.0344) MultiSource/Applications/SIBsim4/SIBsim4: -5.71% (3.4230 => 3.2277, std.dev.: 0.0307) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9388, std.dev.: 0.1095) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1862, std.dev.: 0.0314) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -4.15% (2.5166 => 2.4122, std.dev.: 0.0114) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2224, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.77% (1.2959 => 1.2471, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (9.2503 => 8.9295, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.14% (0.4140 => 0.4010, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.04% (3.9413 => 3.8213, std.dev.: 0.0301) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.89% (1.1683 => 1.1345, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.53% (1.0686 => 1.0416, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -2.28% (92.7467 => 90.6347, std.dev.: 0.7474) MultiSource/Applications/aha/aha: -1.98% (3.4286 => 3.3607, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.91% (3.7496 => 3.6781, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2433, std.dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std.dev.: 0.0833) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.35% (1.7361 => 1.7127, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: -1.27% (3.4876 => 3.4434, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5617 => 16.3560, std.dev.: 0.0353) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.12% (0.9980 => 1.0092, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -2.14% (0.6022 => 0.5893, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: -7.50% (0.1666 => 0.1541, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.16% (0.1554 => 0.1334, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.70% (0.3083 => 0.2969, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.39% (0.2394 => 0.2241, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.38% (0.3175 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -9.69% (0.2302 => 0.2079, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -37.64% (0.0449 => 0.0280, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -20.22% (0.0089 => 0.0071, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -67.08% (0.0240 => 0.0079, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -26.56% (0.0192 => 0.0141, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.77% (0.0390 => 0.0348, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.73% (0.0324 => 0.0286, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -20.11% (0.0189 => 0.0151, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -24.90% (0.0249 => 0.0187, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1429 => 0.1447, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.70% (1.5019 => 1.4163, std.dev.: 0.0436) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.33% (0.1501 => 0.1481, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.36% (0.4264 => 0.4078, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.79% (0.1344 => 0.1368, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.49% (0.0589 => 0.0539, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.24% (0.0232 => 0.0192, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1350 => 1.1295, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.83% (0.0637 => 0.0619, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.37% (0.0246 => 0.0159, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.95% (0.7541 => 0.7688, std.dev.: 0.0191) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.19% (1.5363 => 1.6006, std.dev.: 0.0110) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 13:29:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 15:29:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927202935.6388F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4318?compare_to=4315&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4318, Order: 164784, Start Time: 2012-09-27 19:11:08, End Time: 2012-09-27 20:31:07 To: 4315, Order: 164774, Start Time: 2012-09-27 15:28:28, End Time: 2012-09-27 16:48:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.82% (28.5872 => 29.6800, std.dev.: 0.0193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.59% (0.5787 => 0.5753, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 0.04% (16.0046 => 16.0105, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: -0.13% (14.9221 => 14.9032, std.dev.: 0.1136) MultiSource/Benchmarks/Bullet/bullet: 0.29% (83.4308 => 83.6738, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/gs/gs: 0.47% (4.3434 => 4.3637, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2335 => 1.2332, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.5153 => 7.5194, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.10% (3.7181 => 3.7142, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.11% (0.6476 => 0.6483, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (0.0685 => 0.0698, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.30% (63.2438 => 83.6738, std.dev.: 0.0255) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.97% (0.0720 => 10.3219, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.55% (10.3673 => 15.0899, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 30.46% (0.1622 => 0.2116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.41% (2.2022 => 2.5416, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.27% (7.0540 => 8.1313, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.71% (0.0834 => 0.0940, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2576, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.78% (1.7609 => 1.9683, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1584 => 0.1744, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.43% (0.1655 => 0.1811, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.29% (10.4361 => 11.4055, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1440 => 0.1567, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.22% (9.4845 => 10.2637, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3307 => 0.3575, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.3177 => 0.3428, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.83% (5.7591 => 6.2101, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.4879 => 0.5254, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.46% (0.3109 => 0.3341, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.44% (0.2700 => 0.2901, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.40% (0.7433 => 0.7983, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 7.38% (0.7115 => 0.7640, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.36% (0.6030 => 0.6474, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.4615 => 0.4954, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.34% (0.6675 => 0.7165, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.3423 => 0.3671, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 7.24% (3.3354 => 3.5770, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.18% (0.5860 => 0.6281, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.12% (8.1363 => 8.7159, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.09% (0.2271 => 0.2432, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2554 => 0.2735, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.08% (1.5415 => 1.6506, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 7.04% (0.7326 => 0.7842, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.00% (1.3050 => 1.3964, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.95% (0.1510 => 0.1615, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.89% (4.2646 => 4.5583, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.84% (0.8172 => 0.8731, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.84% (0.5105 => 0.5454, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3422 => 0.3655, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.74% (0.2107 => 0.2249, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.71% (4.9449 => 5.2769, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.61% (5.0018 => 5.3322, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5569 => 0.5936, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.8067 => 0.8587, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3121 => 0.3321, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.36% (1.1642 => 1.2382, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.34% (0.4636 => 0.4930, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.32% (0.7835 => 0.8330, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (7.9617 => 8.4595, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.25% (0.9765 => 1.0375, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.18% (0.5020 => 0.5330, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.16% (1.0722 => 1.1383, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 6.11% (0.3092 => 0.3281, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.10% (1.1861 => 1.2585, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4289 => 0.4550, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.3232 => 0.3427, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.02% (21.9371 => 23.2567, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 5.99% (0.3387 => 0.3590, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.97% (0.4103 => 0.4348, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.96% (3.8723 => 4.1029, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/strcat: 5.93% (0.2831 => 0.2999, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.93% (0.4064 => 0.4305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 5.89% (0.6456 => 0.6836, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.84% (0.3441 => 0.3642, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2891 => 0.3059, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.80% (0.2603 => 0.2754, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 5.79% (1.5603 => 1.6507, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.77% (0.3865 => 0.4088, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.75% (0.3180 => 0.3363, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 5.71% (0.2905 => 0.3071, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3650 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.62% (0.3826 => 0.4041, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.59% (0.4203 => 0.4438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.58% (0.4048 => 0.4274, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.54% (2.0273 => 2.1397, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 5.54% (0.4620 => 0.4876, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.47% (0.3052 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.3098 => 0.3267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.43% (0.2872 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.38% (0.3162 => 0.3332, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.36% (0.6450 => 0.6796, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.36% (2.0665 => 2.1772, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3603 => 0.3796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3684 => 0.3881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2871 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2802 => 0.2948, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.21% (2.2969 => 2.4165, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2877 => 0.3026, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3935 => 0.4138, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.13% (0.8921 => 0.9379, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.84% (1.5859 => 1.6627, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5981 => 0.6270, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (14.3668 => 15.0366, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.64% (2.2024 => 2.3047, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.4186 => 1.4832, std.dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.1840 => 1.2350, std.dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 3.81% (1.2842 => 1.3331, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.3131 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.27% (0.3427 => 0.3539, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.8101 => 0.8358, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.27% (17.1811 => 17.5717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.73% (3.8922 => 3.9596, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8966, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (3.1578 => 3.3861, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.62% (3.6395 => 3.7711, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3453, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2780, std.dev.: 0.0393) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2490, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.11% (5.3855 => 3.9256, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.69% (5.3526 => 3.9238, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1376, std.dev.: 0.0223) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.14% (2.9384 => 2.6110, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -8.58% (22.1758 => 20.2738, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2931, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7098, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5715, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.05% (1.6805 => 1.5956, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1649, std.dev.: 0.0201) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4988, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.15% (8.6802 => 8.4934, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: -2.06% (1.2373 => 1.2118, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0816, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0042, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -1.81% (12.4730 => 12.2478, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2269, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.02% (0.5229 => 0.5753, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 6.81% (14.9895 => 16.0105, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 5.28% (14.1553 => 14.9032, std.dev.: 0.1136) MultiSource/Benchmarks/MallocBench/gs/gs: 6.16% (4.1105 => 4.3637, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.62% (1.1048 => 1.2332, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.05% (7.1582 => 7.5194, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.26% (3.4629 => 3.7142, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.19% (0.6222 => 0.6483, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.01% (0.2116 => 0.0698, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 13:44:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 15:44:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120927204445.8D0D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4319?compare_to=4312&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4319, Order: 164784, Start Time: 2012-09-27 19:31:39, End Time: 2012-09-27 20:46:16 To: 4312, Order: 164771, Start Time: 2012-09-27 14:07:31, End Time: 2012-09-27 15:22:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (184 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (687 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.08% (55.2720 => 56.4225, std.dev.: 0.0984) SingleSource/Benchmarks/Misc/lowercase: 1.65% (7.9521 => 8.0837, std.dev.: 0.0205) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.58% (2.0176 => 2.4529, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.65% (0.0819 => 0.0939, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.54% (0.1413 => 0.1576, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.27% (0.1588 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1013 => 0.1126, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.00% (3.9660 => 4.4021, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 10.95% (0.5818 => 0.6455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.79% (0.4328 => 0.4795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.72% (0.5748 => 0.6364, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.2721 => 0.3009) MultiSource/Applications/hbd/hbd: 10.55% (1.3693 => 1.5138, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.7710 => 0.8512, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.32% (0.2596 => 0.2864, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.29% (1.2193 => 1.3448, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.22% (0.7038 => 0.7757, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.13% (0.3130 => 0.3447, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.08% (0.9199 => 1.0126, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.04% (0.6959 => 0.7658, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.02% (0.1327 => 0.1460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2782 => 0.3060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.95% (0.4062 => 0.4466, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.93% (0.5265 => 0.5788, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.80% (1.1364 => 1.2478, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.79% (13.8202 => 15.1726, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.3899 => 0.4279, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.65% (0.6283 => 0.6889, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.61% (1.4563 => 1.5962, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 9.60% (0.3293 => 0.3609, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.56% (0.3022 => 0.3311, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.45% (0.2655 => 0.2906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.44% (0.3580 => 0.3918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.41% (0.3485 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2765 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2607 => 0.2850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.31% (0.2761 => 0.3018, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.30% (0.3107 => 0.3396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.26% (0.3489 => 0.3812, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 9.22% (0.2690 => 0.2938, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.22% (1.9828 => 2.1656, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.19% (0.4016 => 0.4385, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.16% (0.4791 => 0.5230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.16% (0.2937 => 0.3206, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.16% (0.3756 => 0.4100, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.15% (0.3868 => 0.4222, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.14% (0.2966 => 0.3237, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.09% (1.0313 => 1.1250, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 9.08% (0.2995 => 0.3267, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 9.05% (0.3149 => 0.3434, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.00% (0.2988 => 0.3257) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.99% (0.1157 => 0.1261, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.98% (0.5577 => 0.6078, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938) SingleSource/Benchmarks/Shootout-C++/ary2: 8.90% (0.3192 => 0.3476, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.86% (0.4379 => 0.4767, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.75% (0.3246 => 0.3530, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.69% (0.3453 => 0.3753, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.59% (0.4390 => 0.4767, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 8.55% (0.3534 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 8.54% (0.8310 => 0.9020, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 8.52% (3.8646 => 4.1940, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 8.45% (1.1061 => 1.1996, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.42% (7.2180 => 7.8256, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.39% (3.6692 => 3.9771, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.32% (0.5637 => 0.6106, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.23% (0.6576 => 0.7117, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.14% (0.7506 => 0.8117, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2945 => 0.3183, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.06% (3.1889 => 3.4459, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 8.04% (0.3220 => 0.3479, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.04% (0.7460 => 0.8060, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 7.98% (16.6129 => 17.9389, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.83% (0.6744 => 0.7272, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.2925 => 0.3154, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 7.78% (1.0594 => 1.1418, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.77% (0.8818 => 0.9503, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1865 => 0.2009, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 7.70% (2.1791 => 2.3469, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.62% (0.8698 => 0.9361, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.54% (1.9270 => 2.0722, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 7.53% (14.8535 => 15.9727, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.48% (1.3245 => 1.4236, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.46% (0.3755 => 0.4035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 7.40% (1.2749 => 1.3692, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.38% (8.4961 => 9.1234, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.37% (0.4003 => 0.4298, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.22% (0.3601 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.21% (0.3646 => 0.3909, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.11% (4.4433 => 4.7590, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.10% (4.3801 => 4.6911, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.99% (0.6135 => 0.6564, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.95% (4.6629 => 4.9868, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.94% (1.1333 => 1.2120, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.86% (1.3813 => 1.4760, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (1.3819 => 1.4766, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 6.83% (0.3131 => 0.3345, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.80% (13.2842 => 14.1875, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 6.79% (0.2859 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.75% (0.3245 => 0.3464, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.68% (0.2140 => 0.2283, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 6.58% (6.5754 => 7.0083, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.49% (1.2292 => 1.3090, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 6.49% (14.5298 => 15.4722, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.18% (3.2742 => 3.4767, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.14% (0.9108 => 0.9667, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.93% (0.4805 => 0.5090, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.6250 => 0.6612, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.60% (4.9865 => 5.2656, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.2008 => 0.2120, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.39% (1.5188 => 1.6006, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.38% (6.2785 => 6.6164, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 5.24% (3.7467 => 3.9432, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.14% (2.1007 => 2.2087, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.39% (33.2944 => 34.7550, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.36% (0.3511 => 0.3664, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7729, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std.dev.: 0.0492) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4160, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7246, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1166, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5858, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5845, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2253, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9188, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6846, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.37% (22.5627 => 22.0269, std.dev.: 0.0208) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.34% (20.3410 => 18.2368, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3027, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.24% (2.6470 => 2.5083, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1569, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9448, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2470, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (0.6615 => 0.6504) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -1.62% (1.2308 => 1.2108, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1717, std.dev.: 0.0214) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2281, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: -1.11% (7.3305 => 7.2493, std.dev.: 0.0150) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 14:02:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 16:02:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927210226.AE5B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4320?compare_to=4317&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4320, Order: 164787, Start Time: 2012-09-27 19:53:36, End Time: 2012-09-27 21:04:01 To: 4317, Order: 164782, Start Time: 2012-09-27 18:24:46, End Time: 2012-09-27 19:37:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (78 on baseline) Performance Improvements: 2 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.02% (0.3113 => 0.3238, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.5681 => 0.5901, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.65% (0.2739 => 0.2839, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 15.37% (0.7624 => 0.8796, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.04% (1.3343 => 1.3748, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ffbench: 2.05% (1.3804 => 1.4087, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (4.3280 => 4.4085, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.81% (2.6829 => 2.7315, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.13% (1.1345 => 1.1473, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -15.71% (1.6917 => 1.4259, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.3504 => 4.3027, std.dev.: 0.0168) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.99% (1.0092 => 1.0192, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.5893 => 0.5909, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -0.39% (0.1541 => 0.1535, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1334 => 0.1334, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.28% (0.2969 => 0.2931, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.20% (0.2241 => 0.2214, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (0.3036 => 0.2997, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.78% (0.2079 => 0.2116, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -0.36% (0.0280 => 0.0279, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 23.94% (0.0071 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -6.59% (0.0091 => 0.0085, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.65% (0.0079 => 0.0054, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 36.17% (0.0141 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.29% (0.0348 => 0.0347, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.00% (0.0300 => 0.0249, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.55% (0.0286 => 0.0273, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.29% (0.0286 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0179 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -22.52% (0.0151 => 0.0117, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 34.76% (0.0187 => 0.0252, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 0.81% (0.0124 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.62% (0.1447 => 0.1456, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.17% (1.4163 => 1.5179, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.88% (0.1481 => 0.1494, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.13% (0.4078 => 0.4328, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.26% (0.1368 => 0.1440, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.73% (0.0539 => 0.0613, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.21% (0.0192 => 0.0202, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.30% (0.0645 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.27% (1.1295 => 1.1325, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.98% (0.0619 => 0.0582, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.95% (0.0159 => 0.0178, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.47% (0.7688 => 0.7652, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -2.96% (1.6006 => 1.5533, std.dev.: 0.0307) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.93% (0.0121 => 0.0063, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.55% (4.1772 => 3.0682, std.dev.: 0.0551) SingleSource/Benchmarks/Shootout-C++/except: 81666.67% (0.0006 => 0.4906, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.90% (2.1763 => 2.3699, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.77% (0.6410 => 0.6972, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 8.02% (0.5309 => 0.5735, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.76% (0.3582 => 0.3860, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.08% (0.6173 => 0.6610, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 6.99% (1.0046 => 1.0748, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 6.70% (1.1653 => 1.2434, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 5.56% (15.3105 => 16.1622, std.dev.: 0.1381) MultiSource/Applications/lambda-0_1_3/lambda: 5.44% (0.6915 => 0.7291, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.41% (0.2552 => 0.2690, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.3901 => 0.4099, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.02% (1.5150 => 1.5910, std.dev.: 0.0163) MultiSource/Benchmarks/Bullet/bullet: 4.89% (29.3170 => 30.7506, std.dev.: 0.0444) MultiSource/Applications/d/make_dparser: 4.74% (3.0225 => 3.1659, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.67% (12.6413 => 13.2319, std.dev.: 0.0902) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.58% (0.6069 => 0.6347, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.56% (0.7639 => 0.7987, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.19% (0.4248 => 0.4426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.18% (0.2797 => 0.2914, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.09% (0.2886 => 0.3004, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.1672 => 1.2133, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: 3.85% (13.3238 => 13.8366, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.83% (1.4113 => 1.4653, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 3.65% (14.6079 => 15.1410, std.dev.: 0.0175) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (8.2186 => 8.5171, std.dev.: 0.0149) MultiSource/Applications/hbd/hbd: 3.63% (1.3268 => 1.3749, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 3.52% (4.7455 => 4.9127, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.50% (1.1827 => 1.2241, std.dev.: 0.0124) MultiSource/Applications/siod/siod: 3.41% (2.0972 => 2.1687, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.40% (0.8569 => 0.8860, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 3.37% (1.1440 => 1.1825, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.36% (6.2546 => 6.4646, std.dev.: 0.0609) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.34% (3.0758 => 3.1785, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.31% (1.2021 => 1.2419, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0821 => 1.1177, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4880 => 0.5040, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.18% (1.4408 => 1.4866, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.0689 => 1.1004, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.4908 => 6.6791, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5740 => 0.5901, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8405 => 0.8634, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (4.0318 => 4.1415, std.dev.: 0.0369) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.7256 => 15.1249, std.dev.: 0.0629) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.65% (1.2742 => 1.3080, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 2.61% (3.5980 => 3.6919, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (2.0317 => 2.0837, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (4.2616 => 4.3666, std.dev.: 0.0203) MultiSource/Applications/treecc/treecc: 2.37% (1.8798 => 1.9244, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.97% (1.4189 => 1.4468, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2270, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5475, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 11.24% (0.1433 => 0.1594, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 10.90% (1.6261 => 1.8034, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.79% (0.2857 => 0.3108, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6169, std.dev.: 0.0350) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.21% (1.0063 => 1.0889, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.64% (4.2129 => 4.4085, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.21% (40.4792 => 42.1826, std.dev.: 0.2593) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5423, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 3.91% (15.2242 => 15.8188, std.dev.: 0.0319) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.51% (0.8498 => 0.8796, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.11% (14.4877 => 14.9382, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/ReedSolomon: 3.06% (8.5113 => 8.7715, std.dev.: 0.0502) SingleSource/Benchmarks/Shootout-C++/hash: 2.90% (0.6308 => 0.6491, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8097, std.dev.: 0.0081) MultiSource/Benchmarks/sim/sim: 2.52% (3.8907 => 3.9887, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.47% (2.6656 => 2.7315, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.38% (0.5876 => 0.6016, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 1.95% (3.5520 => 3.6212, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.94% (4.6127 => 4.7023, std.dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/dry: 1.93% (2.4013 => 2.4477, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.4184 => 1.4394, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.64% (0.3497 => 0.2041, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.53% (5.2665 => 4.0801, std.dev.: 0.3018) SingleSource/Benchmarks/Shootout-C++/ary3: -18.39% (1.7473 => 1.4259, std.dev.: 0.0269) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.36% (1.1647 => 0.9625, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.06% (15.8312 => 13.4469, std.dev.: 0.1151) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1579, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -12.23% (0.3746 => 0.3288, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: -10.59% (0.1114 => 0.0996, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9447, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3748, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3310, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8731, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -6.40% (7.6833 => 7.1912, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.4441 => 1.3564, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: -6.04% (3.4230 => 3.2164, std.dev.: 0.0225) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9276, std.dev.: 0.0748) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1882, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -4.00% (2.5166 => 2.4159, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: -3.95% (8.5323 => 8.1954, std.dev.: 0.1039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.79% (1.2722 => 1.2240, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/methcall: -3.49% (9.2503 => 8.9278, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8205, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2858, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.48% (45.4683 => 44.3409, std.dev.: 0.2209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.38% (3.7496 => 3.6602, std.dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: -2.25% (92.7467 => 90.6560, std.dev.: 0.1063) SingleSource/Benchmarks/Shootout-C++/hash2: -2.01% (3.4876 => 3.4174, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.01% (0.6119 => 0.5996, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.95% (1.4021 => 1.3748, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.93% (2.3569 => 2.3115, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/neural/neural: -1.91% (1.0926 => 1.0717, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3661, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.80% (1.1683 => 1.1473, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2265, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3062, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4629, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.35% (16.5617 => 16.3377, std.dev.: 0.0310) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.12% (0.9980 => 1.0192, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -1.88% (0.6022 => 0.5909, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -7.86% (0.1666 => 0.1535, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.16% (0.1554 => 0.1334, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.93% (0.3083 => 0.2931, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.52% (0.2394 => 0.2214, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (0.3175 => 0.2997, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.08% (0.2302 => 0.2116, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -37.86% (0.0449 => 0.0279, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -5.56% (0.0090 => 0.0085, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -77.50% (0.0240 => 0.0054, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.03% (0.0390 => 0.0347, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.28% (0.0301 => 0.0249, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.87% (0.0284 => 0.0273, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -38.10% (0.0189 => 0.0117, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.89% (0.1429 => 0.1456, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.07% (1.5019 => 1.5179, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.50% (0.4264 => 0.4328, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0232 => 0.0202, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.45% (0.0639 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1350 => 1.1325, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.63% (0.0637 => 0.0582, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (0.0246 => 0.0178, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 1.11% (1.5363 => 1.5533, std.dev.: 0.0307) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.00% (0.0070 => 0.0063, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 15:19:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 17:19:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120927221941.8BBCE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4321?compare_to=4318&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4321, Order: 164790, Start Time: 2012-09-27 21:00:18, End Time: 2012-09-27 22:20:08 To: 4318, Order: 164784, Start Time: 2012-09-27 19:11:08, End Time: 2012-09-27 20:31:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (706 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.63% (79.2448 => 80.5337, std.dev.: 0.4035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5753 => 0.5746, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -0.10% (16.0105 => 15.9944, std.dev.: 0.0239) MultiSource/Applications/kimwitu++/kc: 0.35% (14.9032 => 14.9559, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -0.52% (83.6738 => 83.2423, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: -0.29% (4.3637 => 4.3512, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2332 => 1.2325, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (7.5194 => 7.5393, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (3.7142 => 3.7203, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.17% (0.6483 => 0.6494, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.86% (0.0698 => 0.0685, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.62% (63.2438 => 83.2423, std.dev.: 0.0138) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14232.22% (0.0720 => 10.3192, std.dev.: 0.0096) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.50% (10.3673 => 14.9811, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 28.18% (0.1622 => 0.2079, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.82% (2.2022 => 2.5285, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.72% (7.0540 => 8.0927, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.71% (0.1566 => 0.1765, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.70% (1.1194 => 1.2616, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.01% (1.7609 => 1.9723, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.04% (0.1584 => 0.1743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.69% (0.3282 => 0.3600, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.84% (0.3473 => 0.3780, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.69% (0.3543 => 0.3851, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3543 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.62% (0.3561 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.53% (0.3694 => 0.4009, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 8.46% (0.1655 => 0.1795, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 8.43% (10.4361 => 11.3161, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 8.40% (0.1440 => 0.1561, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3828 => 0.4147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.30% (0.3927 => 0.4253, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.21% (0.6030 => 0.6525, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.19% (0.3307 => 0.3578, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.16% (0.7326 => 0.7924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.13% (0.3886 => 0.4202, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (9.4845 => 10.2542, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.4879 => 0.5261, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.6675 => 0.7186, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.59% (0.7115 => 0.7655, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.51% (0.7433 => 0.7991, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.37% (0.3109 => 0.3338, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.33% (0.2700 => 0.2898, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.09% (0.2271 => 0.2432, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4615 => 0.4941, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.04% (5.7591 => 6.1643, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.5105 => 0.5463, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 6.98% (0.3423 => 0.3662, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.96% (1.5415 => 1.6488, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.96% (1.3050 => 1.3958, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.89% (3.3354 => 3.5652, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.8172 => 0.8733, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (8.1363 => 8.6936, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.76% (4.2646 => 4.5531, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.73% (0.4636 => 0.4948, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.68% (0.4103 => 0.4377, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.59% (4.9449 => 5.2707, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 6.58% (0.2554 => 0.2722, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.55% (5.0018 => 5.3293, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5569 => 0.5930, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.37% (0.5020 => 0.5340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.36% (0.3865 => 0.4111, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.8067 => 0.8576, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 6.31% (0.7835 => 0.8329, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4289 => 0.4559, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.27% (0.2758 => 0.2931, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.26% (1.5603 => 1.6579, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.21% (0.6456 => 0.6857, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.4064 => 0.4316, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3650 => 0.3876, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.19% (0.4203 => 0.4463, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 6.18% (0.2831 => 0.3006, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (0.9765 => 1.0364, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 6.07% (1.0722 => 1.1373, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (2.0665 => 2.1914, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3603 => 0.3820, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.01% (1.1642 => 1.2342, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.93% (0.3387 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (1.1861 => 1.2564, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3283 => 0.3477, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.88% (0.3826 => 0.4051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3684 => 0.3900, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.84% (0.2603 => 0.2755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.83% (0.4048 => 0.4284, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.82% (0.3092 => 0.3272, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.81% (0.3441 => 0.3641, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4620 => 0.4888, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.78% (3.8723 => 4.0962, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (7.9617 => 8.4192, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.74% (0.2877 => 0.3042, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.69% (21.9371 => 23.1854, std.dev.: 0.0374) MultiSource/Benchmarks/McCat/09-vor/vor: 5.60% (0.3180 => 0.3358, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.59% (0.3935 => 0.4155, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 5.44% (2.0273 => 2.1376, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6450 => 0.6795, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8921 => 0.9382, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 5.07% (2.2969 => 2.4133, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.86% (1.5859 => 1.6630, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.82% (0.5981 => 0.6269, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.67% (2.2024 => 2.3053, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.4186 => 1.4831, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (14.3668 => 15.0195, std.dev.: 0.0220) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.1840 => 1.2341, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2842 => 1.3378, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.99% (0.3131 => 0.3256, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.81% (0.8101 => 0.8329, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.20% (17.1811 => 17.5587, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.85% (3.8922 => 3.9643, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (3.1578 => 3.3852, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7664, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3470, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.68% (9.1159 => 9.2687, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.52% (0.9540 => 0.9685, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7997, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.41% (5.2763 => 3.2499, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.99% (5.3855 => 3.9321, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.68% (5.3526 => 3.9246, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1363, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.34% (2.9384 => 2.6051, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -8.54% (22.1758 => 20.2830, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2961, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5054, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -3.02% (1.2373 => 1.1999, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5021, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0810, std.dev.: 0.0287) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9970, std.dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2534, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0191) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.89% (0.5229 => 0.5746, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.70% (14.9895 => 15.9944, std.dev.: 0.0239) MultiSource/Applications/kimwitu++/kc: 5.66% (14.1553 => 14.9559, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 5.86% (4.1105 => 4.3512, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.56% (1.1048 => 1.2325, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.32% (7.1582 => 7.5393, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.43% (3.4629 => 3.7203, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.37% (0.6222 => 0.6494, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 15:29:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 17:29:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927222937.E6B3C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4322?compare_to=4320&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4322, Order: 164791, Start Time: 2012-09-27 21:19:59, End Time: 2012-09-27 22:31:13 To: 4320, Order: 164787, Start Time: 2012-09-27 19:53:36, End Time: 2012-09-27 21:04:01 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (85 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.36% (6.6791 => 6.7697, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 1.21% (15.1249 => 15.3085, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 13.55% (3.0520 => 3.4656, std.dev.: 0.0541) SingleSource/Benchmarks/Shootout/ary3: 2.59% (1.9980 => 2.0497, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.58% (1.6803 => 1.7236, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (3.2164 => 3.2722, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.68% (1.8387 => 1.8696, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.40% (4.4992 => 4.5624, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/mandel-2: 1.05% (3.0682 => 3.1004, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -2.48% (2.4558 => 2.3949, std.dev.: 0.0065) MultiSource/Benchmarks/llubenchmark/llu: -1.22% (2.0220 => 1.9974, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.39% (1.0192 => 1.0152, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 0.81% (0.5909 => 0.5957, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: -1.11% (0.1535 => 0.1518, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.30% (0.1334 => 0.1330, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.55% (0.2931 => 0.2947, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (0.2214 => 0.2242, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.77% (0.2997 => 0.2974, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.57% (0.2116 => 0.2128, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -0.36% (0.0279 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 5.88% (0.0085 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 53.70% (0.0054 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.39% (0.0347 => 0.0390, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.24% (0.0249 => 0.0226, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.76% (0.0273 => 0.0286, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.11% (0.0180 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 65.81% (0.0117 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -33.33% (0.0252 => 0.0168, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: - (0.0125 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1456 => 0.1458, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -6.98% (1.5179 => 1.4119, std.dev.: 0.0536) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.74% (0.1494 => 0.1468, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.24% (0.4328 => 0.4101, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.38% (0.1440 => 0.1377, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.77% (0.0613 => 0.0547, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.46% (0.0202 => 0.0193, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.94% (0.0585 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1325 => 1.1287, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.11% (0.0582 => 0.0635, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.98% (0.0178 => 0.0146, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7652 => 0.7655, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.03% (1.5533 => 1.6004, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.98% (0.0063 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.78% (4.1772 => 3.1004, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0111) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.83% (0.0745 => 0.0930, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.33% (0.6410 => 0.7008, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.35% (0.1414 => 0.1532, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 8.30% (2.1763 => 2.3570, std.dev.: 0.0285) SingleSource/Benchmarks/Misc-C++/bigfib: 7.91% (0.5309 => 0.5729, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 7.17% (1.1653 => 1.2488, std.dev.: 0.0173) MultiSource/Applications/lemon/lemon: 7.16% (1.0046 => 1.0765, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: 6.61% (0.6173 => 0.6581, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.23% (0.2552 => 0.2711, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 6.20% (15.3105 => 16.2605, std.dev.: 0.1481) MultiSource/Applications/lambda-0_1_3/lambda: 5.90% (0.6915 => 0.7323, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.30% (1.5150 => 1.5953, std.dev.: 0.0174) MultiSource/Applications/d/make_dparser: 5.08% (3.0225 => 3.1761, std.dev.: 0.0166) MultiSource/Benchmarks/Bullet/bullet: 4.97% (29.3170 => 30.7738, std.dev.: 0.2019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (12.6413 => 13.2692, std.dev.: 0.1004) MultiSource/Applications/oggenc/oggenc: 4.95% (4.7455 => 4.9804, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.73% (0.7639 => 0.8000, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 4.36% (13.3238 => 13.9048, std.dev.: 0.0548) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (6.4908 => 6.7697, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.28% (0.6069 => 0.6329, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 4.25% (2.0972 => 2.1863, std.dev.: 0.0170) MultiSource/Applications/Burg/burg: 4.18% (1.1440 => 1.1918, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.15% (0.2797 => 0.2913, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.1672 => 1.2151, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3217 => 0.3346, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 3.96% (14.7256 => 15.3085, std.dev.: 0.0256) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (8.2186 => 8.5430, std.dev.: 0.0470) MultiSource/Applications/ClamAV/clamscan: 3.94% (14.6079 => 15.1841, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.72% (0.4248 => 0.4406, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.58% (1.0821 => 1.1208, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 3.51% (0.8405 => 0.8700, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.50% (1.1827 => 1.2241, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.39% (1.2021 => 1.2429, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 3.35% (3.5980 => 3.7185, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (6.2546 => 6.4604, std.dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.20% (3.0758 => 3.1741, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.0317 => 2.0948, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5636 => 0.5811, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 3.01% (1.8798 => 1.9363, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.01% (1.4408 => 1.4841, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.99% (0.8569 => 0.8825, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.92% (4.0318 => 4.1496, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.88% (0.7226 => 0.7434, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (0.4880 => 0.5017, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.74% (1.3268 => 1.3632, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5520 => 0.5651, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.2742 => 1.3028, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8796 => 3.9649, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7784 => 0.7955, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.4189 => 1.4495, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.99% (4.2616 => 4.3464, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.3380 => 4.4226, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.92% (0.5937 => 0.6051, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.61% (8.2559 => 8.3891, std.dev.: 0.0220) MultiSource/Applications/hexxagon/hexxagon: 1.32% (0.9425 => 0.9549, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.11% (0.0263 => 0.0379, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3396, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.67% (0.0766 => 0.0932, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 17.62% (1.7426 => 2.0497, std.dev.: 0.0147) SingleSource/Benchmarks/Stanford/Puzzle: 13.40% (0.1433 => 0.1625, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.35% (4.0101 => 4.5453, std.dev.: 0.0448) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.10% (0.2857 => 0.3117, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.97% (7.0025 => 7.6309, std.dev.: 0.0438) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.53% (1.0063 => 1.0921, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/heapsort: 7.76% (3.2159 => 3.4656, std.dev.: 0.0541) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.47% (4.2129 => 4.4014, std.dev.: 0.0543) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8245, std.dev.: 0.0589) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.14% (3.8907 => 4.0130, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/ReedSolomon: 3.06% (8.5113 => 8.7715, std.dev.: 0.0395) MultiSource/Applications/siod/siod: 2.98% (3.5520 => 3.6579, std.dev.: 0.0175) MultiSource/Applications/hexxagon/hexxagon: 2.89% (14.4877 => 14.9060, std.dev.: 0.0429) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.87% (2.6656 => 2.7420, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8094, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4013 => 2.4483, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/whetstone: 1.67% (2.3453 => 2.3845, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: 1.25% (1.4184 => 1.4361, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: 1.22% (4.6414 => 4.6980, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (2.4455 => 2.4739, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.29% (0.3497 => 0.2088, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.26% (5.2665 => 4.1993, std.dev.: 0.1145) SingleSource/Benchmarks/Shootout-C++/ary3: -19.85% (1.7473 => 1.4004, std.dev.: 0.0415) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.1647 => 0.9592, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.73% (15.8312 => 13.3406, std.dev.: 0.1408) SingleSource/Benchmarks/Shootout/sieve: -11.94% (8.1594 => 7.1849, std.dev.: 0.0246) MultiSource/Applications/sgefa/sgefa: -11.16% (0.3746 => 0.3328, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/moments: -10.32% (0.1114 => 0.0999, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9390, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3790, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.54% (2.0027 => 1.8718, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3507, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.42% (4.6355 => 4.3380, std.dev.: 0.0168) MultiSource/Applications/lambda-0_1_3/lambda: -6.28% (7.6833 => 7.2011, std.dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: -5.78% (0.2664 => 0.2510, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -5.42% (62.4126 => 59.0286, std.dev.: 0.1109) SingleSource/Benchmarks/Shootout/fib2: -5.13% (4.4195 => 4.1928, std.dev.: 0.0205) MultiSource/Applications/SIBsim4/SIBsim4: -4.41% (3.4230 => 3.2722, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -4.18% (2.5166 => 2.4113, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (9.2503 => 8.9015, std.dev.: 0.0530) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.40% (1.2722 => 1.2290, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8206, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -2.89% (0.4296 => 0.4172, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.75% (1.2959 => 1.2603, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2880, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.53% (3.7496 => 3.6547, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.39% (1.1683 => 1.1404, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.08% (2.4457 => 2.3949, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4172, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -2.00% (92.7467 => 90.8887, std.dev.: 0.4697) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3639, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2339, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3569 => 2.3199, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.23% (25.6658 => 25.3494, std.dev.: 0.0379) MultiSource/Benchmarks/llubenchmark/llu: -1.08% (2.0192 => 1.9974, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.72% (0.9980 => 1.0152, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -1.08% (0.6022 => 0.5957, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: -8.88% (0.1666 => 0.1518, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.41% (0.1554 => 0.1330, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.41% (0.3083 => 0.2947, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.35% (0.2394 => 0.2242, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.33% (0.3175 => 0.2974, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.56% (0.2302 => 0.2128, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -38.08% (0.0449 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.92% (0.0301 => 0.0226, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -32.53% (0.0249 => 0.0168, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.99% (1.5019 => 1.4119, std.dev.: 0.0536) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.20% (0.1501 => 0.1468, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.82% (0.4264 => 0.4101, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.46% (0.1344 => 0.1377, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.81% (0.0232 => 0.0193, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0639 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.31% (0.0637 => 0.0635, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.65% (0.0246 => 0.0146, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.17% (1.5363 => 1.6004, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.29% (0.0070 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 16:57:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 18:57:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120927235715.6D66D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4323?compare_to=4322&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4323, Order: 164805, Start Time: 2012-09-27 22:47:29, End Time: 2012-09-27 23:58:51 To: 4322, Order: 164791, Start Time: 2012-09-27 21:19:59, End Time: 2012-09-27 22:31:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (86 on baseline) Performance Improvements: 5 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 888 (763 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.47% (0.2225 => 0.2369, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.39% (0.2077 => 0.2189, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.65% (0.3149 => 0.3264, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.3570 => 2.3897, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sgefa/sgefa: 7.66% (0.3328 => 0.3583, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 4.39% (8.1459 => 8.5036, std.dev.: 0.1233) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.56% (1.3213 => 1.3683, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.05% (2.4340 => 2.4838, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -8.08% (3.6023 => 3.3112, std.dev.: 0.0647) MultiSource/Applications/lua/lua: -2.85% (29.7095 => 28.8627, std.dev.: 0.1605) SingleSource/Benchmarks/Misc/ReedSolomon: -2.83% (8.7715 => 8.5236, std.dev.: 0.0461) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.19% (27.4311 => 26.8301, std.dev.: 0.0170) MultiSource/Applications/spiff/spiff: -1.23% (2.8815 => 2.8461, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.39% (1.0152 => 1.0192, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -0.86% (0.5957 => 0.5906, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 0.66% (0.1518 => 0.1528, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.15% (0.1330 => 0.1332, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.19% (0.2947 => 0.2982, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (0.2242 => 0.2270, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (0.2974 => 0.3063, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.13% (0.2128 => 0.2152, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 2.88% (0.0278 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -8.89% (0.0090 => 0.0082, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0083 => 0.0083, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.00% (0.0192 => 0.0144, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.34% (0.0226 => 0.0281, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0286 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.81% (0.0178 => 0.0183, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -39.69% (0.0194 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 49.40% (0.0168 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -23.20% (0.0125 => 0.0096, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.62% (0.1458 => 0.1467, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 6.31% (1.4119 => 1.5010, std.dev.: 0.0160) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.68% (0.1468 => 0.1458, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.12% (0.4101 => 0.4188, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.98% (0.1377 => 0.1418, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.31% (0.0547 => 0.0587, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.62% (0.0193 => 0.0227, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.79% (0.0649 => 0.0579, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1287 => 1.1296, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.70% (0.0635 => 0.0548, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.45% (0.0146 => 0.0189, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7655 => 0.7648, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.28% (1.6004 => 1.5959, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 160.87% (0.0046 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.58% (4.1772 => 3.0670, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.45% (0.0745 => 0.0875, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.97% (0.1414 => 0.1555, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 9.81% (2.1763 => 2.3897, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.56% (0.6410 => 0.7023, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 9.08% (0.5309 => 0.5791, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 7.15% (1.0046 => 1.0764, std.dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: 6.91% (1.1653 => 1.2458, std.dev.: 0.0214) MultiSource/Applications/minisat/minisat: 6.72% (0.6173 => 0.6588, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 6.06% (0.6915 => 0.7334, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.2552 => 0.2699, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 5.58% (15.3105 => 16.1642, std.dev.: 0.2099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (1.5150 => 1.5958, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.05% (0.3901 => 0.4098, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.96% (1.1440 => 1.2007, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.88% (0.7639 => 0.8012, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.75% (0.2886 => 0.3023, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 4.73% (3.0225 => 3.1656, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.71% (0.6069 => 0.6355, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (12.6413 => 13.2274, std.dev.: 0.0982) MultiSource/Benchmarks/Bullet/bullet: 4.63% (29.3170 => 30.6742, std.dev.: 0.0381) MultiSource/Benchmarks/McCat/18-imp/imp: 4.54% (0.3217 => 0.3363, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.46% (13.3238 => 13.9182, std.dev.: 0.1127) MultiSource/Applications/oggenc/oggenc: 4.38% (4.7455 => 4.9534, std.dev.: 0.0769) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.14% (0.2654 => 0.2764, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.03% (1.1827 => 1.2304, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.98% (0.2662 => 0.2768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.95% (0.3062 => 0.3183, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.90% (1.1672 => 1.2127, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 3.77% (14.6079 => 15.1588, std.dev.: 0.0764) SingleSource/Benchmarks/Shootout-C++/lists1: 3.75% (0.2771 => 0.2875, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (8.2186 => 8.5188, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.59% (3.0758 => 3.1861, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (2.0317 => 2.1042, std.dev.: 0.0151) MultiSource/Applications/siod/siod: 3.50% (2.0972 => 2.1707, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.50% (0.2996 => 0.3101, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.2546 => 6.4735, std.dev.: 0.0446) MultiSource/Applications/JM/lencod/lencod: 3.43% (14.7256 => 15.2314, std.dev.: 0.1247) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.40% (0.5937 => 0.6139, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 3.26% (3.5980 => 3.7152, std.dev.: 0.0201) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0821 => 1.1173, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (6.4908 => 6.6981, std.dev.: 0.0797) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.17% (0.8569 => 0.8841, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.16% (0.4880 => 0.5034, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.15% (4.0318 => 4.1590, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (1.4408 => 1.4855, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.3520 => 0.3629, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8405 => 0.8660, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.03% (1.2021 => 1.2385, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (0.3847 => 0.3953, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.73% (1.0689 => 1.0981, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.68% (1.8798 => 1.9301, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.57% (1.4113 => 1.4475, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9029 => 0.9251, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (1.4189 => 1.4507, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.23% (4.2815 => 4.3771, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.01% (8.2559 => 8.4221, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.3380 => 4.4172, std.dev.: 0.0237) MultiSource/Applications/hexxagon/hexxagon: 1.77% (0.9425 => 0.9592, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (1.3935 => 1.4168, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.60% (4.2616 => 4.3298, std.dev.: 0.0252) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.35% (4.0101 => 4.5857, std.dev.: 0.0522) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 11.00% (1.6261 => 1.8050, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/lists: 9.22% (7.0025 => 7.6478, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.02% (1.0063 => 1.0971, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 4.34% (15.2242 => 15.8856, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/dt: 3.88% (0.9851 => 1.0233, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.31% (2.4042 => 2.4838, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8931, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8104, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 2.64% (3.8907 => 3.9935, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: 2.44% (0.5004 => 0.5126, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4013 => 2.4508, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/whetstone: 1.88% (2.3453 => 2.3895, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: 1.12% (1.4184 => 1.4343, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.09% (5.2665 => 4.1030, std.dev.: 0.1438) SingleSource/Benchmarks/Shootout-C++/ary3: -20.17% (1.7473 => 1.3949, std.dev.: 0.0791) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.1647 => 0.9604, std.dev.: 0.0319) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.95% (15.8312 => 13.4646, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/moments: -9.34% (0.1114 => 0.1010, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.08% (3.6023 => 3.3112, std.dev.: 0.0647) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.99% (3.2007 => 2.9449, std.dev.: 0.0499) MultiSource/Applications/lambda-0_1_3/lambda: -7.14% (7.6833 => 7.1349, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3745, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.70% (2.0027 => 1.8685, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3330, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -5.75% (1.4441 => 1.3611, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -5.67% (0.2664 => 0.2513, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -5.66% (3.4230 => 3.2292, std.dev.: 0.0428) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9469, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/fib2: -5.39% (4.4195 => 4.1812, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (9.2503 => 8.8405, std.dev.: 0.0586) MultiSource/Benchmarks/Olden/bh/bh: -3.88% (2.5166 => 2.4189, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.81% (1.2722 => 1.2237, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.63% (2.4457 => 2.3570, std.dev.: 0.0283) SingleSource/Benchmarks/McGill/misr: -3.28% (0.4296 => 0.4155, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8205, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6439, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: -2.65% (9.5474 => 9.2948, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: -2.58% (92.7467 => 90.3521, std.dev.: 0.5473) MultiSource/Applications/lua/lua: -2.24% (29.5232 => 28.8627, std.dev.: 0.1605) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.07% (1.1683 => 1.1441, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4196, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0008) MultiSource/Applications/aha/aha: -1.84% (3.4286 => 3.3656, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.69% (45.4683 => 44.7005, std.dev.: 0.2923) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2311, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -1.45% (2.4971 => 2.4609, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std.dev.: 0.0560) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (27.1724 => 26.8301, std.dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.12% (0.9980 => 1.0192, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.93% (0.6022 => 0.5906, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: -8.28% (0.1666 => 0.1528, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.29% (0.1554 => 0.1332, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.28% (0.3083 => 0.2982, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.18% (0.2394 => 0.2270, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (0.3175 => 0.3063, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.52% (0.2302 => 0.2152, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -36.30% (0.0449 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -8.89% (0.0090 => 0.0082, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.00% (0.0192 => 0.0144, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.64% (0.0301 => 0.0281, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -38.10% (0.0189 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -70.46% (0.0325 => 0.0096, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.66% (0.1429 => 0.1467, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -0.06% (1.5019 => 1.5010, std.dev.: 0.0160) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.86% (0.1501 => 0.1458, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.78% (0.4264 => 0.4188, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.51% (0.1344 => 0.1418, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.34% (0.0589 => 0.0587, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.16% (0.0232 => 0.0227, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.39% (0.0639 => 0.0579, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1350 => 1.1296, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.17% (0.0246 => 0.0189, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.88% (1.5363 => 1.5959, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 17:08:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 19:08:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928000843.46AEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4324?compare_to=4321&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4324, Order: 164803, Start Time: 2012-09-27 22:50:19, End Time: 2012-09-28 00:10:15 To: 4321, Order: 164790, Start Time: 2012-09-27 21:00:18, End Time: 2012-09-27 22:20:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (0.8733 => 0.8852, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.39% (14.9811 => 14.7726, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.13% (1.1999 => 1.0904, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.88% (80.5337 => 78.2107, std.dev.: 0.8999) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5746 => 0.5749, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 0.20% (15.9944 => 16.0257, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 0.26% (14.9559 => 14.9949, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 0.23% (83.2423 => 83.4309, std.dev.: 0.0470) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3512 => 4.3503, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.20% (1.2325 => 1.2350, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.5393 => 7.5438, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.7203 => 3.7222, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.6494 => 0.6503, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (0.0685 => 0.0692, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.92% (63.2438 => 83.4309, std.dev.: 0.0470) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14234.17% (0.0720 => 10.3206, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.49% (10.3673 => 14.7726, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 28.36% (0.1622 => 0.2082, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.74% (7.0540 => 8.1644, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.34% (2.2022 => 2.5400, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.11% (0.1432 => 0.1634, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.09% (0.1566 => 0.1771, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.00% (1.1194 => 1.2649, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.24% (1.7609 => 1.9765, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.99% (0.3282 => 0.3610, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 9.55% (0.3886 => 0.4257, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 9.31% (0.1440 => 0.1574, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 9.02% (10.4361 => 11.3779, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3307 => 0.3585, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1655 => 0.1793, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.32% (0.8172 => 0.8852, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.12% (0.3177 => 0.3435, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (9.4845 => 10.2543, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.92% (0.7433 => 0.8022, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.4879 => 0.5264, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2700 => 0.2906, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.59% (0.7115 => 0.7655, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.57% (0.1625 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.54% (0.6675 => 0.7178, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.41% (5.7591 => 6.1859, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 7.20% (0.3109 => 0.3333, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.19% (0.3423 => 0.3669, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.18% (0.2271 => 0.2434, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4615 => 0.4946, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.14% (1.5415 => 1.6515, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.06% (0.5860 => 0.6274, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.05% (1.3050 => 1.3970, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.04% (8.1363 => 8.7090, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 6.96% (3.3354 => 3.5674, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.95% (0.5105 => 0.5460, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (4.2646 => 4.5581, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.84% (0.8067 => 0.8619, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3422 => 0.3655, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.78% (5.0018 => 5.3410, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1510 => 0.1612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.73% (4.9449 => 5.2778, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.64% (0.5569 => 0.5939, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.60% (0.4103 => 0.4374, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 6.52% (0.7835 => 0.8346, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.37% (0.4064 => 0.4323, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.37% (0.2905 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.35% (0.5020 => 0.5339, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.34% (0.1940 => 0.2063, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.32% (1.1642 => 1.2378, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.3121 => 0.3318, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4289 => 0.4559, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.29% (0.3865 => 0.4108, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.6456 => 0.6861, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 6.24% (0.3092 => 0.3285, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4203 => 0.4465, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.21% (0.9765 => 1.0371, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3441 => 0.3653, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.15% (1.5603 => 1.6563, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3826 => 0.4059, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.09% (1.1861 => 1.2583, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4620 => 0.4901, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.06% (0.2871 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.02% (1.0722 => 1.1368, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3162 => 0.3352, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 6.00% (3.8723 => 4.1048, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/sieve: 6.00% (0.3603 => 0.3819, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (7.9617 => 8.4368, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2603 => 0.2758, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.92% (2.0665 => 2.1889, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/moments: 5.90% (0.4048 => 0.4287, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.3180 => 0.3366, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 5.85% (0.3387 => 0.3585, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3684 => 0.3898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2802 => 0.2964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.67% (21.9371 => 23.1812, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.64% (0.3935 => 0.4157, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 5.57% (2.0273 => 2.1403, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4299 => 0.4529, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6450 => 0.6795, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.29% (2.2969 => 2.4185, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 5.15% (0.8921 => 0.9380, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.98% (1.5859 => 1.6649, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5981 => 0.6270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.71% (14.3668 => 15.0438, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.68% (2.2024 => 2.3054, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.59% (1.4186 => 1.4837, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2842 => 1.3390, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.15% (1.1840 => 1.2331, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.15% (0.8101 => 0.8356, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.31% (17.1811 => 17.5779, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.94% (3.8922 => 3.9676, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4511, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3805, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7640, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7647, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2331, std.dev.: 0.0298) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2583, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.95% (5.3855 => 3.9339, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.59% (5.3526 => 3.9292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2047, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.87% (2.9384 => 2.6189, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -8.38% (22.1758 => 20.3170, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -11.87% (1.2373 => 1.0904, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2847, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.60% (1.8329 => 1.7119, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0150) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1637, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4992, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9848, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5074, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/salsa20: -1.74% (10.2830 => 10.1039, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: -1.74% (12.4730 => 12.2560, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2290, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.94% (0.5229 => 0.5749, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 6.91% (14.9895 => 16.0257, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 5.93% (14.1553 => 14.9949, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 5.83% (4.1105 => 4.3503, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.78% (1.1048 => 1.2350, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.39% (7.1582 => 7.5438, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.49% (3.4629 => 3.7222, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.52% (0.6222 => 0.6503, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.30% (0.2116 => 0.0692, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 17:16:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 19:16:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928001650.8BCC82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4325?compare_to=4319&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4325, Order: 164805, Start Time: 2012-09-27 23:03:39, End Time: 2012-09-28 00:18:23 To: 4319, Order: 164784, Start Time: 2012-09-27 19:31:39, End Time: 2012-09-27 20:46:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (182 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 968 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2108 => 1.0946, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.0538 => 27.7065, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.66% (2.0176 => 2.4547, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.02% (0.1410 => 0.1650, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.18% (0.4328 => 0.4812, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.17% (0.7061 => 0.7850, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.08% (0.1588 => 0.1764, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.07% (3.9660 => 4.4049, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.75% (0.2781 => 0.3080, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 10.63% (1.3693 => 1.5148, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.59% (0.2596 => 0.2871, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.55% (0.2721 => 0.3008, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.46% (0.7038 => 0.7774, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.37% (1.2193 => 1.3458, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 10.29% (0.4062 => 0.4480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.14% (0.7710 => 0.8492, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.14% (0.5265 => 0.5799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.04% (0.6959 => 0.7658, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.03% (0.3130 => 0.3444, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.99% (0.3485 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.97% (0.9199 => 1.0116, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3022 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.86% (1.1364 => 1.2485, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 9.85% (13.8202 => 15.1810, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.84% (0.4390 => 0.4822, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.83% (1.4563 => 1.5994, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.78% (0.2761 => 0.3031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.74% (0.2937 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.69% (1.9828 => 2.1749, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.68% (0.6283 => 0.6891, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 9.67% (0.2628 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.66% (0.3293 => 0.3611, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.2726 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.64% (0.3756 => 0.4118, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.58% (0.2966 => 0.3250, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.57% (0.3489 => 0.3823, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.54% (0.4016 => 0.4399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.53% (0.3580 => 0.3921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.44% (0.3868 => 0.4233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.24% (0.3149 => 0.3440, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.18% (1.0313 => 1.1260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.18% (0.3192 => 0.3485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.11% (0.5577 => 0.6085, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.4791 => 0.5226, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.06% (0.3453 => 0.3766, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.05% (0.2995 => 0.3266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.91% (0.3534 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.84% (0.3246 => 0.3533, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.82% (0.8310 => 0.9043, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.63% (0.4379 => 0.4757, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 8.50% (1.1061 => 1.2001, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.49% (7.2180 => 7.8306, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 8.43% (3.8646 => 4.1904, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.39% (3.6692 => 3.9769, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 8.35% (0.3220 => 0.3489, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 8.35% (0.2945 => 0.3191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.32% (0.5637 => 0.6106, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.19% (0.7506 => 0.8121, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.16% (0.7460 => 0.8069, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.16% (16.6129 => 17.9684, std.dev.: 0.0109) MultiSource/Applications/d/make_dparser: 8.11% (3.1889 => 3.4475, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.04% (0.6576 => 0.7105, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.96% (0.2023 => 0.2184, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 7.92% (0.6744 => 0.7278, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.90% (0.8698 => 0.9385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.86% (0.3755 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.83% (1.0594 => 1.1424, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 7.81% (2.1791 => 2.3492, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.80% (0.2243 => 0.2418, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.69% (1.9270 => 2.0752, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 7.67% (1.2749 => 1.3727, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.67% (0.1865 => 0.2008, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.63% (1.3245 => 1.4255, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.61% (14.8535 => 15.9832, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4113 => 0.4423, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3789 => 0.4074, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.51% (0.3914 => 0.4208, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.45% (0.3663 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.43% (0.8818 => 0.9473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.16% (4.4433 => 4.7614, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.15% (1.1333 => 1.2143, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 7.14% (8.4961 => 9.1030, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.13% (4.3801 => 4.6923, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.08% (13.2842 => 14.2242, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.07% (0.6135 => 0.6569, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.2140 => 0.2289, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.93% (0.3245 => 0.3470, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.87% (0.3131 => 0.3346, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.75% (1.2292 => 1.3122, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 6.74% (14.5298 => 15.5091, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.65% (1.3813 => 1.4732, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 6.65% (4.6629 => 4.9730, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.2859 => 0.3048, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.60% (1.3819 => 1.4731, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 6.56% (6.5754 => 7.0070, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.47% (3.2742 => 3.4861, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.25% (0.2321 => 0.2466, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.21% (0.3511 => 0.3729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.16% (0.6250 => 0.6635, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.03% (4.9865 => 5.2871, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.01% (0.4805 => 0.5094, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.91% (0.9108 => 0.9646, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.65% (1.5188 => 1.6046, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.2008 => 0.2120, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.37% (3.7467 => 3.9480, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.23% (2.1007 => 2.2106, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.99% (6.2785 => 6.5915, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 4.45% (33.2944 => 34.7749, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 3.51% (16.2614 => 16.8315, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2588, std.dev.: 0.0467) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7257, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.84% (10.7476 => 11.0526, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.08% (7.4271 => 7.5819, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0055) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5158, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5841, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5938, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2237, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.68% (0.4657 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (22.5627 => 22.0624, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2308 => 1.0946, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2782, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5091, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9448, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4792, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9313, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2386, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7065, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.40% (7.3305 => 7.2282, std.dev.: 0.0239) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1510, std.dev.: 0.0390) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2504, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8714, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4328, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 18:23:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 20:23:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928012313.561272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4326?compare_to=4323&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4326, Order: 164807, Start Time: 2012-09-28 00:14:41, End Time: 2012-09-28 01:24:49 To: 4323, Order: 164805, Start Time: 2012-09-27 22:47:29, End Time: 2012-09-27 23:58:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 2 (46 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 898 (758 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.52% (1.2667 => 1.2859, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.94% (22.3394 => 21.9071, std.dev.: 0.1358) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.60% (13.4646 => 13.2497, std.dev.: 0.0371) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.49% (1.0192 => 1.0142, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: -0.49% (0.5906 => 0.5877, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -3.53% (0.1528 => 0.1474, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.75% (0.1332 => 0.1322, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.64% (0.2982 => 0.2963, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.88% (0.2270 => 0.2182, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (0.3063 => 0.3014, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (0.2152 => 0.2122, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -5.59% (0.0286 => 0.0270, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -11.24% (0.0089 => 0.0079, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 10.98% (0.0082 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0083 => 0.0083, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 35.42% (0.0144 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0392 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.47% (0.0281 => 0.0302, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0286 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.87% (0.0326 => 0.0271, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -1.09% (0.0183 => 0.0181, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 65.81% (0.0117 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0251 => 0.0253, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: 30.21% (0.0096 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.91% (0.1467 => 0.1439, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 0.11% (1.5010 => 1.5027, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.75% (0.1458 => 0.1447, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.81% (0.4188 => 0.4112, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.90% (0.1418 => 0.1391, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.94% (0.0587 => 0.0558, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.88% (0.0227 => 0.0225, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.74% (0.0579 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1296 => 1.1246, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 118.18% (0.0011 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 180.00% (0.0005 => 0.0014, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.65% (0.0548 => 0.0568, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.82% (0.0189 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.7648 => 0.7657, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.17% (1.5959 => 1.5986, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -57.50% (0.0120 => 0.0051, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.57% (4.1772 => 3.0254, std.dev.: 0.0619) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0005) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.12% (0.0745 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (0.1414 => 0.1552, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.67% (0.6410 => 0.7030, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 8.62% (2.1763 => 2.3638, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 7.74% (0.6173 => 0.6651, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 7.44% (0.5309 => 0.5704, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 6.38% (1.0046 => 1.0687, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.04% (1.1653 => 1.2357, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.78% (0.3582 => 0.3789, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 5.68% (15.3105 => 16.1799, std.dev.: 0.0526) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (1.5150 => 1.6003, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 5.25% (0.6915 => 0.7278, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (12.6413 => 13.2689, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.3901 => 0.4089, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (1.1672 => 1.2186, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 4.24% (3.0225 => 3.1507, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.19% (0.4248 => 0.4426, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 4.17% (0.3217 => 0.3351, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 4.09% (29.3170 => 30.5163, std.dev.: 0.4122) MultiSource/Applications/Burg/burg: 4.05% (1.1440 => 1.1903, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.03% (0.7639 => 0.7947, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.02% (0.6069 => 0.6313, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.97% (0.2797 => 0.2908, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.81% (0.2654 => 0.2755, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.78% (4.7455 => 4.9251, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 3.77% (13.3238 => 13.8261, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 3.57% (2.0972 => 2.1720, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.1827 => 1.2239, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (6.2546 => 6.4658, std.dev.: 0.0284) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (8.2186 => 8.4935, std.dev.: 0.0554) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.0689 => 1.1035, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.23% (1.3268 => 1.3697, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.22% (1.2021 => 1.2408, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (2.0317 => 2.0966, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.11% (0.7226 => 0.7451, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.03% (0.8569 => 0.8829, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.01% (3.0758 => 3.1685, std.dev.: 0.0225) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0821 => 1.1139, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.94% (1.8798 => 1.9350, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 2.90% (14.6079 => 15.0322, std.dev.: 0.0617) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8405 => 0.8640, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.4908 => 6.6703, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (4.0318 => 4.1430, std.dev.: 0.0274) MultiSource/Applications/lua/lua: 2.76% (3.5980 => 3.6972, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.4408 => 1.4761, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.7256 => 15.0834, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.4113 => 1.4455, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.4189 => 1.4529, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.27% (0.5937 => 0.6072, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.13% (0.5636 => 0.5756, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5740 => 0.5860, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8796 => 3.9574, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (4.2815 => 4.3638, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.90% (4.3380 => 4.4203, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.90% (0.5963 => 0.6076, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.83% (4.2616 => 4.3396, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.2742 => 1.2946, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (8.2559 => 8.3654, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 45.25% (0.0263 => 0.0382, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/ary3: 14.98% (1.7426 => 2.0036, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.51% (4.0101 => 4.5518, std.dev.: 0.0221) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 8.58% (0.1433 => 0.1556, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 8.57% (7.0025 => 7.6026, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.43% (1.0063 => 1.0710, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.45% (40.4792 => 42.6871, std.dev.: 0.4651) SingleSource/Benchmarks/Misc/fp-convert: 4.41% (15.2242 => 15.8951, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.75% (3.4080 => 3.5358, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8934, std.dev.: 0.0321) MultiSource/Benchmarks/sim/sim: 2.79% (3.8907 => 3.9994, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8105, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/mason/mason: 2.44% (0.5004 => 0.5126, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.41% (0.6308 => 0.6460, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.28% (0.5876 => 0.6010, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 2.17% (3.5520 => 3.6292, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.07% (2.6656 => 2.7208, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: 1.90% (2.4013 => 2.4469, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.4184 => 1.4345, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.05% (1.2726 => 1.2859, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.37% (5.2665 => 4.0885, std.dev.: 0.0572) SingleSource/Benchmarks/Shootout-C++/ary3: -20.78% (1.7473 => 1.3842, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.41% (1.1647 => 0.9619, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.31% (15.8312 => 13.2497, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.42% (3.2007 => 2.9313, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -6.81% (7.6833 => 7.1597, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.6254 => 3.3784, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/fibo: -6.68% (4.6355 => 4.3259, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.26% (3.4230 => 3.2088, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/richards_benchmark: -6.00% (1.4441 => 1.3575, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0247) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9443, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1853, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.35% (0.3746 => 0.3583, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -4.32% (2.5166 => 2.4079, std.dev.: 0.0160) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.86% (1.2959 => 1.2459, std.dev.: 0.0194) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.76% (1.2722 => 1.2244, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: -3.43% (9.2503 => 8.9330, std.dev.: 0.0362) SingleSource/Benchmarks/McGill/misr: -3.07% (0.4296 => 0.4164, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.67% (61.1734 => 59.5412, std.dev.: 0.5086) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.65% (2.8964 => 2.8196, std.dev.: 0.0203) MultiSource/Applications/lua/lua: -2.59% (29.5232 => 28.7598, std.dev.: 0.0661) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.52% (3.7496 => 3.6551, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.46% (1.0686 => 1.0423, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.37% (3.9413 => 3.8478, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.09% (1.1683 => 1.1439, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: -2.08% (6.7458 => 6.6054, std.dev.: 0.0300) MultiSource/Benchmarks/PAQ8p/paq8p: -1.99% (92.7467 => 90.8998, std.dev.: 0.4312) MultiSource/Applications/aha/aha: -1.96% (3.4286 => 3.3613, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.93% (22.3381 => 21.9071, std.dev.: 0.1358) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3141, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4876 => 3.4244, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2363, std.dev.: 0.0330) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4617, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (16.5617 => 16.3297, std.dev.: 0.0581) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3084, std.dev.: 0.0176) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.30% (27.1724 => 26.8200, std.dev.: 0.0123) MultiSource/Benchmarks/llubenchmark/llu: -1.00% (2.0192 => 1.9990, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.62% (0.9980 => 1.0142, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: -2.41% (0.6022 => 0.5877, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -11.52% (0.1666 => 0.1474, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.93% (0.1554 => 0.1322, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.89% (0.3083 => 0.2963, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.86% (0.2394 => 0.2182, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.07% (0.3175 => 0.3014, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.82% (0.2302 => 0.2122, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -39.87% (0.0449 => 0.0270, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -11.24% (0.0089 => 0.0079, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.36% (0.0324 => 0.0271, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1429 => 0.1439, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 0.05% (1.5019 => 1.5027, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.60% (0.1501 => 0.1447, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.56% (0.4264 => 0.4112, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.50% (0.1344 => 0.1391, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.26% (0.0589 => 0.0558, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.02% (0.0232 => 0.0225, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.92% (1.1350 => 1.1246, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0006 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.67% (0.0024 => 0.0014, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.83% (0.0637 => 0.0568, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.06% (1.5363 => 1.5986, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.14% (0.0070 => 0.0051, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 18:39:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 20:39:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928013956.7512D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4327?compare_to=4316&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4327, Order: 164805, Start Time: 2012-09-27 22:57:31, End Time: 2012-09-28 01:41:31 To: 4316, Order: 164776, Start Time: 2012-09-27 16:27:12, End Time: 2012-09-27 19:11:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (131 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (762 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.92% (1.7414 => 1.7748, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.73% (125.0967 => 129.7680, std.dev.: 1.1088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.40% (1.5932 => 1.7748, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.46% (0.3488 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.45% (0.3446 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.43% (0.3442 => 0.3801, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3465 => 0.3821, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3496 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.17% (0.3460 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.15% (0.3469 => 0.3821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.02% (0.3643 => 0.4008, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.00% (0.3650 => 0.4015, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.83% (0.3724 => 0.4090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5826 => 0.6318, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5889 => 0.6375, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.02% (0.1421 => 0.1535, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2875 => 0.3083, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (1.6211 => 1.7375, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.3004 => 0.3217, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.09% (1.3152 => 1.4084, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2738 => 0.2930, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.99% (0.7171 => 0.7672, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.95% (3.5627 => 3.8104, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3195 => 0.3416, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.85% (0.2729 => 0.2916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.83% (0.4994 => 0.5335, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (0.4361 => 0.4658, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 6.80% (0.2823 => 0.3015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.80% (0.2750 => 0.2937, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.78% (5.5417 => 5.9172, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 6.75% (0.2813 => 0.3003, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.74% (0.9909 => 1.0577, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3096 => 0.3304, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2803 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.70% (0.2792 => 0.2979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.67% (2.0673 => 2.2051, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.2911 => 0.3103, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.2780 => 0.2963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.58% (0.2811 => 0.2996, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.54% (0.5000 => 0.5327, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 6.53% (1.0781 => 1.1485, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.45% (0.1968 => 0.2095, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.44% (0.4146 => 0.4413, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3267 => 0.3477, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.41% (0.3060 => 0.3256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.38% (0.3258 => 0.3466, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.36% (0.2014 => 0.2142, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3124 => 0.3322, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.2866 => 0.3047, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.31% (0.3726 => 0.3961, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.29% (0.3625 => 0.3853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.28% (0.3678 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3362 => 0.3573, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3317 => 0.3524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.21% (0.3348 => 0.3556, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 6.10% (0.3477 => 0.3689, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.09% (0.3282 => 0.3482, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.3930 => 0.4169, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.01% (0.3845 => 0.4076, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 6.00% (23.5202 => 24.9325, std.dev.: 0.0155) MultiSource/Applications/hbd/hbd: 5.99% (0.9697 => 1.0278, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.96% (0.3690 => 0.3910, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 5.92% (0.2566 => 0.2718, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (0.4251 => 0.4502, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.88% (2.7292 => 2.8896, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 5.88% (4.2109 => 4.4583, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.86% (0.5900 => 0.6246, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.2736 => 0.2895, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.3981 => 0.4207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (0.5026 => 0.5310, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (4.4195 => 4.6682, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.58% (0.4139 => 0.4370, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.58% (0.3890 => 0.4107, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.54% (1.8794 => 1.9835, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 5.52% (0.6634 => 0.7000, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 5.49% (2.1013 => 2.2166, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.45% (0.6435 => 0.6786, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.44% (0.4029 => 0.4248, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 5.43% (0.5012 => 0.5284, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.42% (0.2068 => 0.2180, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 5.40% (0.3336 => 0.3516, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.35% (0.3084 => 0.3249, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.35% (1.4269 => 1.5032, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 5.29% (4.6177 => 4.8619, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.28% (0.4658 => 0.4904, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.2737 => 0.2881, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.25% (0.3903 => 0.4108, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (2.1653 => 2.2787, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.3271 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.14% (0.2103 => 0.2211, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (0.2691 => 0.2829, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.94% (0.5546 => 0.5820, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 4.70% (2.0346 => 2.1303, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 4.67% (0.7875 => 0.8243, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.53% (1.9694 => 2.0587, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 4.42% (0.4847 => 0.5061, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.2969 => 0.3099, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.32% (1.9966 => 2.0828, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.29% (0.5361 => 0.5591, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.3498 => 0.3648) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.21% (0.4253 => 0.4432, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.05% (0.7426 => 0.7727, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.80% (0.5584 => 0.5796, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.50% (11.6398 => 12.0476, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.36% (4.6926 => 4.8502, std.dev.: 0.0144) MultiSource/Applications/kimwitu++/kc: 2.05% (11.9555 => 12.2008, std.dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6645, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.76% (15.4430 => 16.1774, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-2: 4.42% (1.8057 => 1.8855, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6302, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2021, std.dev.: 0.0549) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5079, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2263, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4494, std.dev.: 0.0212) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5863, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5446, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7992, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7990, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7478, std.dev.: 0.0390) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0446, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 18:57:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 20:57:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928015725.2E2382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4328?compare_to=4324&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4328, Order: 164807, Start Time: 2012-09-28 00:39:14, End Time: 2012-09-28 01:59:00 To: 4324, Order: 164803, Start Time: 2012-09-27 22:50:19, End Time: 2012-09-28 00:10:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (149 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (14.7726 => 15.0927, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.64% (55.0696 => 56.5257, std.dev.: 0.1526) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.17% (78.2107 => 79.9066, std.dev.: 0.5419) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.31% (0.5749 => 0.5767, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 0.24% (16.0257 => 16.0637, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 0.07% (14.9949 => 15.0048, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: -0.46% (83.4309 => 83.0508, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/gs/gs: 0.39% (4.3503 => 4.3673, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2350 => 1.2359, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.5438 => 7.5558, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.28% (3.7222 => 3.7328, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.31% (0.6503 => 0.6523, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.36% (0.0692 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.32% (63.2438 => 83.0508, std.dev.: 0.0180) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14231.39% (0.0720 => 10.3186, std.dev.: 0.0112) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.58% (10.3673 => 15.0927, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/richards_benchmark: 28.85% (0.1622 => 0.2090, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.50% (7.0540 => 8.1474, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.29% (2.2022 => 2.5389, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 13.97% (0.1432 => 0.1632, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.63% (1.1194 => 1.2608, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.16% (1.7609 => 1.9750, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.48% (0.1584 => 0.1750, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.81% (0.3282 => 0.3604, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1440 => 0.1567, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.72% (10.4361 => 11.3461, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.47% (0.3307 => 0.3587, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.45% (9.4845 => 10.2863, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.31% (0.3177 => 0.3441, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.22% (0.7433 => 0.8044, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.15% (0.2700 => 0.2920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553) SingleSource/UnitTests/ObjC++/property-reference-object: 7.94% (0.6030 => 0.6509, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.79% (0.6675 => 0.7195, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.77% (0.8172 => 0.8807, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1625 => 0.1750, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.69% (0.7115 => 0.7662, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.61% (0.4615 => 0.4966, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.50% (5.7591 => 6.1912, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 7.49% (0.3109 => 0.3342, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.44% (0.2271 => 0.2440, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.42% (0.3423 => 0.3677, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.41% (3.3354 => 3.5824, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.37% (0.5105 => 0.5481, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2554 => 0.2742, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.35% (8.1363 => 8.7345, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (4.2646 => 4.5771, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.25% (1.3050 => 1.3996, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 7.25% (0.3422 => 0.3670, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.22% (1.5415 => 1.6528, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.17% (0.5860 => 0.6280, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1510 => 0.1618, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.02% (0.5569 => 0.5960, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.99% (0.4636 => 0.4960, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.95% (5.0018 => 5.3493, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.4103 => 0.4387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.92% (0.8067 => 0.8625, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: 6.88% (0.7835 => 0.8374, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.4064 => 0.4343, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.83% (0.2107 => 0.2251, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.80% (4.9449 => 5.2814, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 6.80% (1.5603 => 1.6664, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.77% (0.3826 => 0.4085, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.74% (0.4289 => 0.4578, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.69% (0.6456 => 0.6888, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.61% (0.5020 => 0.5352, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.60% (0.2758 => 0.2940, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 6.60% (0.3092 => 0.3296, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.60% (0.3865 => 0.4120, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.59% (0.4203 => 0.4480, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.50% (0.3121 => 0.3324, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1940 => 0.2066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.46% (1.1861 => 1.2627, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3603 => 0.3834, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 6.41% (1.1642 => 1.2388, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 6.41% (0.3387 => 0.3604, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.38% (0.9765 => 1.0388, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (2.0665 => 2.1982, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.35% (1.0722 => 1.1403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.32% (0.4620 => 0.4912, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.31% (7.9617 => 8.4638, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2802 => 0.2978, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3232 => 0.3435, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 6.23% (3.8723 => 4.1134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.19% (0.3684 => 0.3912, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2603 => 0.2764, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3441 => 0.3651, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 6.00% (21.9371 => 23.2540, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4299 => 0.4553, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3379 => 0.3577, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.85% (2.0273 => 2.1459, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6450 => 0.6814, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.60% (2.2969 => 2.4256, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 5.38% (0.8921 => 0.9401, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.08% (1.5859 => 1.6665, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.07% (14.3668 => 15.0948, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.03% (0.5981 => 0.6282, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.86% (2.2024 => 2.3095, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.82% (1.4186 => 1.4870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.3131 => 0.3274, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.2842 => 1.3424, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.45% (1.1840 => 1.2367, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.38% (0.8101 => 0.8375, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.44% (17.1811 => 17.6004, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.17% (3.8922 => 3.9768, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.61% (3.6395 => 3.7709, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3512, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2340, std.dev.: 0.0278) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5747, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.08% (5.2763 => 3.2670, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.96% (5.3855 => 3.9333, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.57% (5.3526 => 3.9302, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1611, std.dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.89% (2.9384 => 2.6185, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -8.32% (22.1758 => 20.3308, std.dev.: 0.0181) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -12.01% (1.2373 => 1.0887, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -10.23% (1.5373 => 1.3800, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2894, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7102, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.04% (1.6805 => 1.5958, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5057, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5102, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0048, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -1.84% (2.5528 => 2.5059, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0984, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2533, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6839, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2353, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.29% (0.5229 => 0.5767, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 7.17% (14.9895 => 16.0637, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 6.00% (14.1553 => 15.0048, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 6.25% (4.1105 => 4.3673, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.87% (1.1048 => 1.2359, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.55% (7.1582 => 7.5558, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.79% (3.4629 => 3.7328, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.84% (0.6222 => 0.6523, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 19:00:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 21:00:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928020018.3FD752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4329?compare_to=4325&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4329, Order: 164807, Start Time: 2012-09-28 00:47:18, End Time: 2012-09-28 02:01:52 To: 4325, Order: 164805, Start Time: 2012-09-27 23:03:39, End Time: 2012-09-28 00:18:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (694 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.83% (54.9702 => 56.5280, std.dev.: 0.1601) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.39% (2.0176 => 2.4491, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.16% (0.1410 => 0.1652, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.26% (0.7061 => 0.7856, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.84% (0.4328 => 0.4797, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.75% (3.9660 => 4.3923, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.71% (0.1588 => 0.1758, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.56% (1.3693 => 1.5139, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 10.50% (0.2781 => 0.3073, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.2721 => 0.3001, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (0.7710 => 0.8497, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.08% (1.2193 => 1.3422, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.05% (0.7038 => 0.7745, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 10.00% (0.4062 => 0.4468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2782 => 0.3059, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.85% (0.3899 => 0.4283, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.82% (0.5265 => 0.5782, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.79% (0.9199 => 1.0100, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.78% (0.3130 => 0.3436, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.70% (0.3485 => 0.3823, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.68% (1.1364 => 1.2464, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.66% (0.3022 => 0.3314, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.66% (0.6959 => 0.7631, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2761 => 0.3027, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.62% (1.4563 => 1.5964, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 9.57% (0.2760 => 0.3024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.46% (0.4016 => 0.4396, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.45% (13.8202 => 15.1259, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.2966 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.40% (1.9828 => 2.1691, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.37% (0.3489 => 0.3816, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.36% (0.6283 => 0.6871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.35% (0.3293 => 0.3601, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.32% (0.2726 => 0.2980, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.27% (0.3756 => 0.4104, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 9.23% (0.2937 => 0.3208, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.22% (0.3580 => 0.3910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.21% (0.3107 => 0.3393, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 9.00% (0.3868 => 0.4216, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3149 => 0.3432, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.95% (1.0313 => 1.1236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.92% (0.3453 => 0.3761, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.86% (0.2945 => 0.3206, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.85% (0.4791 => 0.5215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.83% (0.3192 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.79% (0.4390 => 0.4776, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.75% (0.5577 => 0.6065, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.75% (0.3246 => 0.3530, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.66% (0.3534 => 0.3840, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.61% (0.2995 => 0.3253, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.38% (0.4379 => 0.4746, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.36% (3.6692 => 3.9761, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 8.26% (0.8310 => 0.8996, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.20% (7.2180 => 7.8098, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 8.09% (3.8646 => 4.1773, std.dev.: 0.0127) MultiSource/Applications/Burg/burg: 8.06% (1.1061 => 1.1952, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.2914 => 0.3147, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 7.98% (0.7506 => 0.8105, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.97% (0.5637 => 0.6086, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.96% (16.6129 => 17.9358, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.92% (0.7460 => 0.8051, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3220 => 0.3475, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.89% (0.6744 => 0.7276, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.88% (0.6576 => 0.7094, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 7.78% (3.1889 => 3.4370, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.61% (1.0594 => 1.1400, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.56% (0.8698 => 0.9356, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.51% (0.2023 => 0.2175, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.51% (2.1791 => 2.3427, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.46% (0.3755 => 0.4035, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.44% (1.2749 => 1.3697, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 7.39% (1.9270 => 2.0695, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.34% (1.3245 => 1.4217, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 7.31% (14.8535 => 15.9390, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.27% (0.8818 => 0.9459, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.12% (0.6135 => 0.6572, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.05% (0.4113 => 0.4403, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.93% (8.4961 => 9.0852, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.2140 => 0.2288, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.87% (4.3801 => 4.6811, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.86% (13.2842 => 14.1954, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.86% (4.4433 => 4.7480, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (1.1333 => 1.2108, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 6.82% (0.3578 => 0.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.78% (0.3245 => 0.3465, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.77% (0.3131 => 0.3343, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.72% (0.3914 => 0.4177, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.71% (14.5298 => 15.5047, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/for-in: 6.70% (0.3789 => 0.4043, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.65% (1.3813 => 1.4731, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 6.65% (0.4003 => 0.4269, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3646 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.63% (0.2504 => 0.2670, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.62% (4.6629 => 4.9718, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (1.3819 => 1.4733, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.52% (1.2292 => 1.3094, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.2859 => 0.3044, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.45% (0.3940 => 0.4194, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.41% (0.3511 => 0.3736, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.33% (6.5754 => 6.9914, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.24% (3.2742 => 3.4785, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6250 => 0.6629, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.71% (4.9865 => 5.2714, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.70% (0.4805 => 0.5079, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.68% (0.2008 => 0.2122, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.67% (0.9108 => 0.9624, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.39% (1.5188 => 1.6007, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.11% (3.7467 => 3.9380, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.91% (2.1007 => 2.2038, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (6.2785 => 6.5711, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 4.30% (33.2944 => 34.7249, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 3.33% (16.2614 => 16.8031, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2512, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4117, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.3458 => 0.3627) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.09% (10.7476 => 11.0796, std.dev.: 0.0471) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5895, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.25% (5.5130 => 5.5820, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5975, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9234, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2254, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.36% (0.4657 => 0.3895, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.43% (22.5627 => 22.0146, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.75% (1.2308 => 1.0862, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2902, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.94% (1.3780 => 1.2962, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5111, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9444, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.51% (4.5947 => 4.4793, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7059, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2461, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3305 => 7.2275, std.dev.: 0.0120) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1540, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4359, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 21:00:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 23:00:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928040040.A004D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4330?compare_to=4326&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4330, Order: 164811, Start Time: 2012-09-28 02:51:41, End Time: 2012-09-28 04:02:15 To: 4326, Order: 164807, Start Time: 2012-09-28 00:14:41, End Time: 2012-09-28 01:24:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 0 (44 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 898 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.21% (3.0254 => 3.1224, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: 2.02% (2.3685 => 2.4164, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 1.24% (16.3297 => 16.5330, std.dev.: 0.0159) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.86% (1.0142 => 1.0055, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.5877 => 0.5874, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 3.32% (0.1474 => 0.1523, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.53% (0.1322 => 0.1329, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.87% (0.2963 => 0.2878, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.83% (0.2182 => 0.2222, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.56% (0.3014 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.16% (0.2122 => 0.2055, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -27.41% (0.0270 => 0.0196, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -27.85% (0.0079 => 0.0057, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: -1.10% (0.0091 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.41% (0.0083 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.44% (0.0195 => 0.0161, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.38% (0.0390 => 0.0369, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.56% (0.0302 => 0.0252, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -22.73% (0.0286 => 0.0221, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.49% (0.0271 => 0.0294, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -1.10% (0.0181 => 0.0179) SingleSource/UnitTests/Vector/Altivec/test1: -32.99% (0.0194 => 0.0130, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.19% (0.0253 => 0.0250, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 0.80% (0.0125 => 0.0126, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1439 => 0.1440, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.14% (1.5027 => 1.5198, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.17% (0.1447 => 0.1464, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.19% (0.4112 => 0.4022, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.24% (0.1391 => 0.1436, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.15% (0.0558 => 0.0546, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.22% (0.0225 => 0.0239, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.10% (0.0647 => 0.0614, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1246 => 1.1278, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0024 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -64.29% (0.0014 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.58% (0.0568 => 0.0577, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.00% (0.0200 => 0.0228, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7657 => 0.7658, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.19% (1.5986 => 1.5955, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.57% (0.0051 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.25% (4.1772 => 3.1224, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/except: 82366.67% (0.0006 => 0.4948, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.12% (0.1414 => 0.1543, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.11% (0.6410 => 0.6994, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 8.93% (2.1763 => 2.3707, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.63% (0.1159 => 0.1259, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.34% (0.5309 => 0.5752, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.44% (0.6173 => 0.6632, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.09% (0.3582 => 0.3836, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 6.52% (1.1653 => 1.2413, std.dev.: 0.0178) MultiSource/Applications/lemon/lemon: 6.41% (1.0046 => 1.0690, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 5.78% (15.3105 => 16.1953, std.dev.: 0.0654) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.54% (1.5150 => 1.5990, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.53% (0.4248 => 0.4483, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.21% (0.6915 => 0.7275, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 5.07% (0.2877 => 0.3023, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.98% (0.6069 => 0.6371, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: 4.59% (3.0225 => 3.1613, std.dev.: 0.0317) MultiSource/Benchmarks/Bullet/bullet: 4.51% (29.3170 => 30.6394, std.dev.: 0.0467) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.41% (0.7639 => 0.7976, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.34% (1.2021 => 1.2543, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (12.6413 => 13.1787, std.dev.: 0.1674) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.00% (1.1827 => 1.2300, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.83% (13.3238 => 13.8340, std.dev.: 0.1732) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.83% (0.2797 => 0.2904, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.82% (0.5740 => 0.5959, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.73% (1.8798 => 1.9500, std.dev.: 0.0182) MultiSource/Benchmarks/nbench/nbench: 3.65% (1.0821 => 1.1216, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.46% (0.7722 => 0.7989, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3217 => 0.3328, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.43% (1.4408 => 1.4902, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.39% (0.3008 => 0.3110, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3062 => 0.3165, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.35% (6.2546 => 6.4639, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.28% (0.5937 => 0.6132, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (6.4908 => 6.7022, std.dev.: 0.0816) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.6079 => 15.0757, std.dev.: 0.0880) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (2.0317 => 2.0966, std.dev.: 0.0164) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (8.2186 => 8.4742, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5636 => 0.5805, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.93% (1.3268 => 1.3657, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.92% (0.8569 => 0.8819, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (4.0318 => 4.1484, std.dev.: 0.0299) MultiSource/Applications/JM/lencod/lencod: 2.89% (14.7256 => 15.1506, std.dev.: 0.1397) MultiSource/Applications/lua/lua: 2.87% (3.5980 => 3.7013, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.87% (0.4880 => 0.5020, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.82% (0.7226 => 0.7430, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (0.3847 => 0.3953, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (1.0689 => 1.0983, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (3.8796 => 3.9846, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.41% (1.2742 => 1.3049, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.38% (4.2616 => 4.3632, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.34% (4.3380 => 4.4394, std.dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.5963 => 0.6072, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.52% (8.2559 => 8.3818, std.dev.: 0.0165) MultiSource/Applications/hexxagon/hexxagon: 1.19% (0.9425 => 0.9537, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 48.28% (0.0261 => 0.0387, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.63% (0.0766 => 0.0924, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0015, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5527, std.dev.: 0.1025) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6084, std.dev.: 0.0236) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8511, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/dt: 4.03% (0.9851 => 1.0248, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.99% (0.8498 => 0.8837, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5380, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 3.03% (2.3453 => 2.4164, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 2.78% (3.8907 => 3.9990, std.dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8898, std.dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8098, std.dev.: 0.0263) MultiSource/Benchmarks/FreeBench/mason/mason: 2.44% (0.5004 => 0.5126, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 2.27% (2.4013 => 2.4558, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.18% (2.6656 => 2.7236, std.dev.: 0.0197) MultiSource/Applications/siod/siod: 2.11% (3.5520 => 3.6271, std.dev.: 0.0280) MultiSource/Benchmarks/Olden/power/power: 1.28% (1.4184 => 1.4366, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.58% (5.2665 => 4.1302, std.dev.: 0.2763) SingleSource/Benchmarks/Shootout-C++/ary3: -20.75% (1.7473 => 1.3848, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.36% (1.1647 => 0.9625, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.77% (15.8312 => 13.1760, std.dev.: 0.1687) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.23% (0.0917 => 0.0814, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.76% (1.4034 => 1.2804, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/distray/distray: -8.56% (0.2664 => 0.2436, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.36% (3.2007 => 2.9332, std.dev.: 0.0611) MultiSource/Applications/lambda-0_1_3/lambda: -7.18% (7.6833 => 7.1317, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3759, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -6.67% (4.6355 => 4.3265, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.4441 => 1.3557, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (62.4126 => 58.9096, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -5.54% (3.4230 => 3.2335, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1861, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: -4.51% (0.3746 => 0.3577, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.49% (0.4564 => 0.4359, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -4.46% (2.5166 => 2.4044, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.39% (1.2959 => 1.2390, std.dev.: 0.0214) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.02% (1.2722 => 1.2210, std.dev.: 0.0162) SingleSource/Benchmarks/McGill/misr: -3.84% (0.4296 => 0.4131, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (9.2503 => 8.9585, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.08% (3.9413 => 3.8199, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.04% (3.7496 => 3.6355, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.87% (22.3381 => 21.6959, std.dev.: 0.2376) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.68% (0.4140 => 0.4029, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -2.63% (29.5232 => 28.7455, std.dev.: 0.1152) MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (92.7467 => 90.5494, std.dev.: 0.4428) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.17% (1.1683 => 1.1430, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.03% (1.7361 => 1.7008, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4198, std.dev.: 0.0261) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3133, std.dev.: 0.0084) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3696, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2298, std.dev.: 0.0259) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4616, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3066, std.dev.: 0.0534) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8099, std.dev.: 0.0757) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.75% (0.9980 => 1.0055, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -2.46% (0.6022 => 0.5874, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -8.58% (0.1666 => 0.1523, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.48% (0.1554 => 0.1329, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (0.3083 => 0.2878, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.18% (0.2394 => 0.2222, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (0.3175 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -10.73% (0.2302 => 0.2055, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -56.35% (0.0449 => 0.0196, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -35.96% (0.0089 => 0.0057, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -66.25% (0.0240 => 0.0081, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.15% (0.0192 => 0.0161, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.38% (0.0390 => 0.0369, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.28% (0.0301 => 0.0252, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -22.18% (0.0284 => 0.0221, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.26% (0.0324 => 0.0294, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179) SingleSource/UnitTests/Vector/Altivec/test1: -31.22% (0.0189 => 0.0130, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -61.23% (0.0325 => 0.0126, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1429 => 0.1440, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.19% (1.5019 => 1.5198, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.47% (0.1501 => 0.1464, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.68% (0.4264 => 0.4022, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1344 => 0.1436, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.30% (0.0589 => 0.0546, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.02% (0.0232 => 0.0239, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.91% (0.0639 => 0.0614, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1350 => 1.1278, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.42% (0.0637 => 0.0577, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.32% (0.0246 => 0.0228, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.85% (1.5363 => 1.5955, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.43% (0.0070 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 21:17:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 23:17:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928041721.81FBE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4331?compare_to=4329&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4331, Order: 164811, Start Time: 2012-09-28 03:04:18, End Time: 2012-09-28 04:18:55 To: 4329, Order: 164807, Start Time: 2012-09-28 00:47:18, End Time: 2012-09-28 02:01:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (691 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.04% (1.0862 => 1.0975, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.85% (2.0176 => 2.4584, std.dev.: 0.0140) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.55% (0.1013 => 0.1130, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4328 => 0.4821, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.38% (0.5748 => 0.6402, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.15% (0.7061 => 0.7848, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.13% (3.9660 => 4.4075, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.08% (0.1588 => 0.1764, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.01% (1.3693 => 1.5201, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.80% (0.7038 => 0.7798, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.67% (0.2596 => 0.2873, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.2721 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.55% (0.1327 => 0.1467, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.44% (0.3899 => 0.4306, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 10.44% (0.4062 => 0.4486, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.27% (0.6959 => 0.7674, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.22% (0.9199 => 1.0139, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.22% (0.5265 => 0.5803, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.18% (1.2193 => 1.3434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.13% (0.2765 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.08% (0.7710 => 0.8487, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.06% (0.3130 => 0.3445, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.01% (1.9828 => 2.1813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.00% (1.1364 => 1.2500, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 9.94% (0.2937 => 0.3229, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.89% (0.3580 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3489 => 0.3834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.85% (13.8202 => 15.1814, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.4563 => 1.5997, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.80% (0.3756 => 0.4124, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.6283 => 0.6896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.66% (0.4016 => 0.4404, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.59% (0.3107 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.54% (0.2988 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.50% (0.1589 => 0.1740, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 9.49% (0.3868 => 0.4235, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.34% (1.0313 => 1.1276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.33% (0.3453 => 0.3775, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.25% (0.3534 => 0.3861, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.20% (0.4379 => 0.4782, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.11% (0.4390 => 0.4790, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.5577 => 0.6084, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.4791 => 0.5226, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.85% (0.2995 => 0.3260, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.67% (1.1061 => 1.2020, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 8.66% (0.3220 => 0.3499, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.60% (3.6692 => 3.9847, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 8.52% (3.8646 => 4.1940, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.52% (7.2180 => 7.8327, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.52% (0.6576 => 0.7136, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 8.48% (0.8310 => 0.9015, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.40% (16.6129 => 18.0087, std.dev.: 0.0295) MultiSource/Benchmarks/McCat/09-vor/vor: 8.38% (0.2925 => 0.3170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.28% (0.3755 => 0.4066, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.27% (0.7506 => 0.8127, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 8.21% (3.1889 => 3.4506, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 8.20% (0.6744 => 0.7297, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.18% (0.5637 => 0.6098, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.15% (0.7460 => 0.8068, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 8.10% (2.1791 => 2.3557, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.09% (0.8698 => 0.9402, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.07% (0.2243 => 0.2424, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 7.94% (1.0594 => 1.1435, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.93% (1.9270 => 2.0799, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.64% (1.3245 => 1.4257, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3578 => 0.3851, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.61% (14.8535 => 15.9833, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.58% (0.1569 => 0.1688, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 7.55% (1.2749 => 1.3712, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.30% (0.1657 => 0.1778, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.27% (0.3646 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.25% (8.4961 => 9.1119, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.22% (0.4113 => 0.4410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.18% (0.3245 => 0.3478, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.16% (0.8818 => 0.9449, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 7.15% (0.3131 => 0.3355, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.14% (0.6135 => 0.6573, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.13% (0.3940 => 0.4221, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.12% (4.4433 => 4.7597, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (1.1333 => 1.2138, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.08% (4.3801 => 4.6902, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2504 => 0.2680, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3153, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.98% (0.3511 => 0.3756, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (13.2842 => 14.2103, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.97% (1.3819 => 1.4782, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.2140 => 0.2289, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 6.96% (0.2859 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.89% (1.3813 => 1.4765, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.88% (14.5298 => 15.5296, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 6.79% (6.5754 => 7.0216, std.dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 6.72% (4.6629 => 4.9764, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.55% (0.2321 => 0.2473, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.39% (3.2742 => 3.4835, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6250 => 0.6644, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.18% (4.9865 => 5.2948, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.08% (0.4805 => 0.5097, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.89% (1.5188 => 1.6083, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (0.9108 => 0.9638, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 5.49% (3.7467 => 3.9525, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.46% (2.1007 => 2.2154, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.2008 => 0.2112, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (6.2785 => 6.5937, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 4.72% (33.2944 => 34.8673, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 3.61% (16.2614 => 16.8480, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std.dev.: 0.0453) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7234, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0702, std.dev.: 0.0586) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 1.99% (7.4271 => 7.5747, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5840, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5915, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.06% (22.5627 => 22.0983, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2960, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.75% (1.3780 => 1.2987, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1570, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723) MultiSource/Applications/spiff/spiff: -2.73% (3.0263 => 2.9436, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9313, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2354, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7056, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8576, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2299, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2512, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1950, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5636, std.dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 21:22:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 23:22:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928042230.CF8E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4332?compare_to=4328&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4332, Order: 164811, Start Time: 2012-09-28 03:04:18, End Time: 2012-09-28 04:24:05 To: 4328, Order: 164807, Start Time: 2012-09-28 00:39:14, End Time: 2012-09-28 01:59:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (149 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (703 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.11% (2.1982 => 2.1737, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (0.5767 => 0.5771, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.13% (16.0637 => 16.0852, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: -0.51% (15.0048 => 14.9282, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 0.24% (83.0508 => 83.2490, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.3673 => 4.3612, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.24% (1.2359 => 1.2389, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.51% (7.5558 => 7.5171, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.68% (3.7328 => 3.7076, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.77% (0.6523 => 0.6473, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (0.0648 => 0.0670, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.63% (63.2438 => 83.2490, std.dev.: 0.0183) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14236.39% (0.0720 => 10.3222, std.dev.: 0.0126) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.99% (10.3673 => 15.1355, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 29.04% (0.1622 => 0.2093) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.38% (7.0540 => 8.2094, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.62% (2.2022 => 2.5462, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.23% (1.1194 => 1.2675, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.64% (1.7609 => 1.9835, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.54% (0.1584 => 0.1751, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.39% (0.3282 => 0.3623, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.78% (0.3927 => 0.4311, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 8.91% (10.4361 => 11.3661, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.73% (0.4879 => 0.5305, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 8.68% (0.1440 => 0.1565) MultiSource/Benchmarks/mafft/pairlocalalign: 8.66% (9.4845 => 10.3058, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.37% (0.3177 => 0.3443, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.03% (5.7591 => 6.2217, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3307 => 0.3568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.70% (0.6675 => 0.7189, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3109 => 0.3348, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2700 => 0.2906, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.63% (0.7433 => 0.8000, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 7.59% (0.5925 => 0.6375, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.46% (0.7115 => 0.7646, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (0.4615 => 0.4958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.41% (0.6030 => 0.6477, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27% (0.5860 => 0.6286, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.26% (4.2646 => 4.5740, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.23% (0.5105 => 0.5474, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.22% (0.2271 => 0.2435, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.22% (0.3423 => 0.3670, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.21% (8.1363 => 8.7229, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 7.21% (3.3354 => 3.5758, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.18% (1.3050 => 1.3987, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.8172 => 0.8757, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.11% (1.5415 => 1.6511, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.02% (0.1510 => 0.1616, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.95% (4.9449 => 5.2885, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.92% (5.0018 => 5.3481, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.76% (0.7326 => 0.7821, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.8067 => 0.8607, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.64% (0.5569 => 0.5939, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 6.56% (0.7835 => 0.8349, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.50% (0.2107 => 0.2244, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3121 => 0.3323, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.44% (0.3387 => 0.3605, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.41% (7.9617 => 8.4723, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 6.40% (1.5603 => 1.6602, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.3092 => 0.3289, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.36% (1.1861 => 1.2615, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.31% (0.5020 => 0.5337, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.28% (0.3422 => 0.3637, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.26% (0.2603 => 0.2766, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.26% (1.0722 => 1.1393, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.20% (0.9765 => 1.0370, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.17% (0.4636 => 0.4922, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.14% (1.1642 => 1.2357, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 6.01% (3.8723 => 4.1052, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.6456 => 0.6843, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.96% (21.9371 => 23.2440, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.4064 => 0.4304, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.89% (0.4299 => 0.4552, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.4103 => 0.4343, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.82% (0.3180 => 0.3365, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4289 => 0.4538, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 5.69% (2.0273 => 2.1427, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2905 => 0.3070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2891 => 0.3055, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3650 => 0.3855, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.58% (0.6450 => 0.6810, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.56% (0.3865 => 0.4080, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.4048 => 0.4270, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4620 => 0.4873, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.46% (0.3826 => 0.4035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.44% (0.2831 => 0.2985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.42% (0.4203 => 0.4431, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 5.40% (2.2969 => 2.4209, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/fibo: 5.39% (0.2725 => 0.2872, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 5.38% (0.8921 => 0.9401, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.37% (0.2793 => 0.2943, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.34% (0.3162 => 0.3331, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.33% (0.3098 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2871 => 0.3023, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.3052 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2872 => 0.3023, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3283 => 0.3455, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2756 => 0.2900, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.22% (1.5859 => 1.6687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.22% (0.3603 => 0.3791, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (2.0665 => 2.1737, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 5.16% (0.2714 => 0.2854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.3232 => 0.3398, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3935 => 0.4136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2802 => 0.2944, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.05% (0.3684 => 0.3870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.04% (0.2877 => 0.3022, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (14.3668 => 15.0820, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.87% (0.5981 => 0.6272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3379 => 0.3542, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (1.4186 => 1.4869, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.78% (2.2024 => 2.3076, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.59% (1.1840 => 1.2383, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.71% (1.2842 => 1.3318, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.41% (0.3427 => 0.3544, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.38% (0.8101 => 0.8375, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.32% (0.3131 => 0.3235, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.48% (17.1811 => 17.6075, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.14% (3.8922 => 3.9756, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.77% (0.4162 => 0.4319, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7665, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3522, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (0.9540 => 0.9683, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2429, std.dev.: 0.0258) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7993, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5809, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6817, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.97% (5.2763 => 3.2730, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.87% (5.3855 => 3.9383, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.55% (5.3526 => 3.9313, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3216, std.dev.: 0.0261) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.78% (2.9384 => 2.6217, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -8.30% (22.1758 => 20.3352, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0957, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.60% (1.5373 => 1.3744, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2856, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0148) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1637, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5045, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9933, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5076, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0813, std.dev.: 0.0210) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2539, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.37% (0.5229 => 0.5771, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 7.31% (14.9895 => 16.0852, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 5.46% (14.1553 => 14.9282, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 6.10% (4.1105 => 4.3612, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.14% (1.1048 => 1.2389, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.01% (7.1582 => 7.5171, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.07% (3.4629 => 3.7076, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.03% (0.6222 => 0.6473, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Sep 27 21:52:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Sep 2012 23:52:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928045242.DF58B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4333?compare_to=4327&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4333, Order: 164807, Start Time: 2012-09-28 02:10:21, End Time: 2012-09-28 04:54:17 To: 4327, Order: 164805, Start Time: 2012-09-27 22:57:31, End Time: 2012-09-28 01:41:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (763 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.40% (1.5932 => 1.7749, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.19% (0.1063 => 0.1182, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3465 => 0.3819, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3446 => 0.3798, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3496 => 0.3852, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.09% (0.3469 => 0.3819, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.06% (0.3488 => 0.3839, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3442 => 0.3788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3460 => 0.3804, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.73% (0.3650 => 0.4005, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3643 => 0.3996, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.56% (0.3724 => 0.4080, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5826 => 0.6300, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.12% (0.5889 => 0.6367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.52% (0.2738 => 0.2944, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.42% (0.3004 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.41% (0.1619 => 0.1739, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.22% (1.3152 => 1.4101, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.20% (0.2875 => 0.3082, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3195 => 0.3424, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (1.6211 => 1.7363, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.94% (0.9909 => 1.0597, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (0.4361 => 0.4661, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 6.87% (0.2823 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.87% (3.5627 => 3.8075, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.84% (0.1549 => 0.1655, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.84% (0.2750 => 0.2938, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (2.0673 => 2.2086, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.83% (0.7171 => 0.7661, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 6.83% (0.2813 => 0.3005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.81% (0.2803 => 0.2994, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.80% (0.5000 => 0.5340, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.75% (5.5417 => 5.9157, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 6.74% (0.2566 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2792 => 0.2980) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.73% (0.4994 => 0.5330, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2811 => 0.3000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2729 => 0.2912, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2780 => 0.2966, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 6.69% (1.0781 => 1.1502, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3096 => 0.3302, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.2911 => 0.3103, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3267 => 0.3481, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.54% (0.3258 => 0.3471, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3124 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3317 => 0.3532, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.47% (0.3060 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.45% (0.3362 => 0.3579, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.40% (0.3625 => 0.3857, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.25% (0.3678 => 0.3908, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.2866 => 0.3045, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.24% (0.3348 => 0.3557, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.15% (0.3282 => 0.3484, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.2014 => 0.2137, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.10% (0.3477 => 0.3689, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.09% (0.3726 => 0.3953, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.3930 => 0.4169, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 6.03% (23.5202 => 24.9377, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 6.00% (0.4251 => 0.4506, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4146 => 0.4393, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 5.95% (0.6634 => 0.7029, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 5.93% (4.2109 => 4.4607, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.3690 => 0.3907, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 5.88% (0.9697 => 1.0267, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.3845 => 0.4071, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.2736 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (0.5026 => 0.5319, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 5.78% (0.4029 => 0.4262, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (2.7292 => 2.8847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.3981 => 0.4207, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.66% (0.5900 => 0.6234, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.63% (0.4139 => 0.4372, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (4.4195 => 4.6681, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.3084 => 0.3256, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (0.3890 => 0.4105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.47% (0.5012 => 0.5286, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.45% (0.6435 => 0.6786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.43% (0.3903 => 0.4115, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.37% (1.8794 => 1.9804, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.37% (0.4658 => 0.4908, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.32% (2.1013 => 2.2130, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.27% (2.1653 => 2.2795, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.22% (0.2068 => 0.2176, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.21% (4.6177 => 4.8582, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.19% (0.2737 => 0.2879, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.17% (1.4269 => 1.5006, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 5.10% (0.3336 => 0.3506, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.96% (0.5546 => 0.5821, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.95% (0.2040 => 0.2141, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.95% (0.2103 => 0.2207, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.3271 => 0.3429, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.2969 => 0.3108, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.56% (2.0346 => 2.1274, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.51% (1.9694 => 2.0583, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.51% (1.9966 => 2.0867, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.46% (0.5361 => 0.5600, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.37% (0.7875 => 0.8219, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.30% (0.7426 => 0.7745, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.04% (0.4253 => 0.4425, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 3.98% (0.2691 => 0.2798, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (0.5584 => 0.5803, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.47% (11.6398 => 12.0438, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.6926 => 4.8468, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 1.98% (11.9555 => 12.1917, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6667, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1670, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.08% (14.0481 => 14.6212, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1970, std.dev.: 0.0485) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5060, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4468, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5911, std.dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5561, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary2: -9.91% (0.2402 => 0.2164, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7955, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7875, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7742, std.dev.: 0.0775) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5726, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 01:08:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 03:08:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928080816.745102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4334?compare_to=4333&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4334, Order: 164811, Start Time: 2012-09-28 05:23:10, End Time: 2012-09-28 08:09:51 To: 4333, Order: 164807, Start Time: 2012-09-28 02:10:21, End Time: 2012-09-28 04:54:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 970 (786 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 10.19% (1.5932 => 1.7556, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/exceptions-2: 9.81% (0.3446 => 0.3784, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.70% (0.3465 => 0.3801, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3496 => 0.3833, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3469 => 0.3803, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3442 => 0.3773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.55% (0.3488 => 0.3821, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3460 => 0.3785, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.26% (0.3650 => 0.3988, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3643 => 0.3977, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.05% (0.3724 => 0.4061, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5826 => 0.6303, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.5889 => 0.6365, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.3004 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.10% (0.3195 => 0.3422, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.06% (0.2875 => 0.3078, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (1.6211 => 1.7354, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.02% (0.4361 => 0.4667, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2738 => 0.2930, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.92% (0.5000 => 0.5346, std.dev.: 0.0101) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7171 => 0.7664, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 6.84% (0.2750 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.80% (0.2823 => 0.3015, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.75% (0.2813 => 0.3003, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.74% (3.5627 => 3.8028, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.2780 => 0.2965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2803 => 0.2988, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.57% (0.9909 => 1.0560, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2792 => 0.2975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3096 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2729 => 0.2907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2811 => 0.2994, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 6.48% (1.0781 => 1.1480, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3267 => 0.3476, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.32% (0.3258 => 0.3464, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.27% (5.5417 => 5.8894, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 6.14% (0.3678 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (0.3930 => 0.4170, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.03% (0.3317 => 0.3517, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.01% (0.3625 => 0.3843, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.97% (0.3348 => 0.3548, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 5.96% (23.5202 => 24.9220, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4146 => 0.4393, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.2736 => 0.2898, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.90% (0.3477 => 0.3682, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.89% (4.2109 => 4.4591, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3726 => 0.3945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.77% (0.3690 => 0.3903, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4251 => 0.4493, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.64% (0.3845 => 0.4062, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.2866 => 0.3026, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.51% (0.4029 => 0.4251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.3981 => 0.4200, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.40% (1.8794 => 1.9808, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.36% (0.4139 => 0.4361, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.33% (0.5012 => 0.5279, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.32% (0.6634 => 0.6987, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 5.28% (1.4269 => 1.5022, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.3903 => 0.4107, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.17% (2.1013 => 2.2100, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 5.15% (4.6177 => 4.8556, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.14% (0.6435 => 0.6766, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2737 => 0.2876, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.3084 => 0.3240, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (0.2040 => 0.2143, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.02% (0.9697 => 1.0184, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 4.99% (2.1653 => 2.2734, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.93% (0.2068 => 0.2170, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.86% (0.3336 => 0.3498, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.81% (0.5546 => 0.5813, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (0.4658 => 0.4880, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.2103 => 0.2203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.2969 => 0.3105, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.34% (0.7875 => 0.8217, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.28% (2.0346 => 2.1216, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.81% (0.7426 => 0.7709, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (0.5361 => 0.5563, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (0.5584 => 0.5776, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (11.6398 => 12.0079, std.dev.: 0.0364) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.08% (4.6926 => 4.8369, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 1.76% (11.9555 => 12.1658, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.34% (0.2162 => 0.3553, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.40% (0.5917 => 0.6710, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std.dev.: 0.0876) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8894, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6327, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2067, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5056, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4539, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2206, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5795, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5706, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7974, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: -3.12% (17.2379 => 16.7000, std.dev.: 0.0615) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5805, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 01:50:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 03:50:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928085005.28D9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4335?compare_to=4330&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4335, Order: 164813, Start Time: 2012-09-28 07:41:21, End Time: 2012-09-28 08:51:41 To: 4330, Order: 164811, Start Time: 2012-09-28 02:51:41, End Time: 2012-09-28 04:02:15 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (86 on baseline) Performance Improvements: 2 (41 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (764 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 7.46% (8.3863 => 9.0120, std.dev.: 0.1999) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.11% (1.4318 => 1.4620, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.33% (1.0690 => 1.0832, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 18.96% (1.5672 => 1.8644, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/distray/distray: 5.83% (0.2436 => 0.2578, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.81% (2.3176 => 2.4059, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.25% (0.7544 => 0.7789, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.09% (1.0518 => 1.0843, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/ffbench: 1.74% (1.3877 => 1.4119, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.31% (3.1224 => 3.0814, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.5330 => 16.3398, std.dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.74% (1.0055 => 1.0230, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -0.29% (0.5874 => 0.5857, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -3.55% (0.1523 => 0.1469, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.28% (0.1329 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.63% (0.2878 => 0.2925, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.78% (0.2222 => 0.2138, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.57% (0.2997 => 0.2980, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (0.2055 => 0.2111, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 42.35% (0.0196 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 54.39% (0.0057 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.41% (0.0081 => 0.0075, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.63% (0.0161 => 0.0191, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0369 => 0.0388, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.05% (0.0252 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.70% (0.0221 => 0.0280, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.63% (0.0294 => 0.0251, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -1.12% (0.0179 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 46.92% (0.0130 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0250 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.59% (0.0126 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1440 => 0.1448, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -0.76% (1.5198 => 1.5082, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.30% (0.1464 => 0.1483, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.37% (0.4022 => 0.4077, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.34% (0.1436 => 0.1388, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 66.67% (0.0003 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.09% (0.0546 => 0.0612, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.37% (0.0239 => 0.0219, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.79% (0.0614 => 0.0560, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1278 => 1.1263, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -58.33% (0.0012 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 360.00% (0.0005 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.03% (0.0577 => 0.0548, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.21% (0.0228 => 0.0207, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7658 => 0.7650, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.34% (1.5955 => 1.6010, std.dev.: 0.0048) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 95.16% (0.0062 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.23% (4.1772 => 3.0814, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/except: 83700.00% (0.0006 => 0.5028, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.43% (0.0745 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.89% (0.1414 => 0.1568, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 8.87% (0.5309 => 0.5780, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.80% (0.6410 => 0.6974, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 8.07% (2.1763 => 2.3519, std.dev.: 0.0397) MultiSource/Applications/lemon/lemon: 7.82% (1.0046 => 1.0832, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.06% (0.3582 => 0.3835, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 6.77% (0.6173 => 0.6591, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 6.55% (1.1653 => 1.2416, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 5.94% (0.3217 => 0.3408, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.84% (0.6915 => 0.7319, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.5150 => 1.6035, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 5.49% (15.3105 => 16.1515, std.dev.: 0.0459) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.41% (0.2552 => 0.2690, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.90% (0.3901 => 0.4092, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.70% (29.3170 => 30.6945, std.dev.: 0.1898) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.7722 => 0.8072, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.37% (0.7639 => 0.7973, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.33% (0.2654 => 0.2769, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.29% (3.0225 => 3.1522, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (12.6413 => 13.1754, std.dev.: 0.1923) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.05% (1.1827 => 1.2306, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.00% (0.2797 => 0.2909, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.00% (0.6069 => 0.6312, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.93% (1.2021 => 1.2494, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.79% (0.4248 => 0.4409, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (3.0758 => 3.1907, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.71% (6.2546 => 6.4869, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.71% (1.1672 => 1.2105, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 3.65% (13.3238 => 13.8101, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.59% (1.4113 => 1.4620, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.51% (4.7455 => 4.9123, std.dev.: 0.0202) MultiSource/Applications/lua/lua: 3.51% (3.5980 => 3.7244, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 3.33% (2.0972 => 2.1671, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.18% (1.1440 => 1.1804, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.17% (0.5937 => 0.6125, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0821 => 1.1163, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.14% (8.2186 => 8.4768, std.dev.: 0.0565) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.6079 => 15.0664, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.12% (0.5636 => 0.5812, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.0318 => 4.1567, std.dev.: 0.0258) MultiSource/Applications/hbd/hbd: 3.09% (1.3268 => 1.3678, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.0689 => 1.1019, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.05% (0.4562 => 0.4701, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (6.4908 => 6.6883, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (0.4880 => 0.5027, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.4408 => 1.4838, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.88% (0.8569 => 0.8816, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.74% (2.0317 => 2.0874, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.7256 => 15.1198, std.dev.: 0.0581) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8405 => 0.8629, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.2742 => 1.3050, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.18% (1.4189 => 1.4499, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.5963 => 0.6093, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.17% (4.3380 => 4.4322, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: 2.16% (1.8798 => 1.9204, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.94% (8.2559 => 8.4164, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (3.8796 => 3.9510, std.dev.: 0.0235) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (4.2616 => 4.3379, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (4.2815 => 4.3488, std.dev.: 0.0213) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std.dev.: 0.0574) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.97% (0.0766 => 0.0873, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5463, std.dev.: 0.0727) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.45% (7.0025 => 7.5940, std.dev.: 0.0268) SingleSource/Benchmarks/Stanford/Puzzle: 7.89% (0.1433 => 0.1546, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.75% (1.0063 => 1.0843, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.3301 => 0.3490, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.79% (15.2242 => 15.9536, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.15% (40.4792 => 42.1571, std.dev.: 0.5226) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.66% (0.8498 => 0.8809, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8974, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.6308 => 0.6471, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6328, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.13% (2.4042 => 2.4554, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: 2.12% (2.4013 => 2.4523, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.03% (2.3580 => 2.4059, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.99% (0.5876 => 0.5993, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.41% (0.3497 => 0.2049, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.39% (5.2665 => 4.0875, std.dev.: 0.1448) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9600, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.74% (15.8312 => 13.1809, std.dev.: 0.2654) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1572, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.25% (3.2007 => 2.9365, std.dev.: 0.0236) MultiSource/Applications/lambda-0_1_3/lambda: -7.09% (7.6833 => 7.1387, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3740, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/fibo: -6.65% (4.6355 => 4.3272, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.60% (2.0027 => 1.8705, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.4441 => 1.3557, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7949, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.97% (3.4230 => 3.2186, std.dev.: 0.0544) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9344, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1874, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.73% (0.4140 => 0.3944, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.38% (0.4564 => 0.4364, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -4.19% (2.5166 => 2.4112, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (9.2503 => 8.9042, std.dev.: 0.0500) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.73% (1.2959 => 1.2476, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.44% (1.2722 => 1.2284, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.04% (3.9413 => 3.8215, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2849, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.71% (61.1734 => 59.5178, std.dev.: 0.4588) MultiSource/Applications/lua/lua: -2.58% (29.5232 => 28.7607, std.dev.: 0.0269) MultiSource/Benchmarks/PAQ8p/paq8p: -2.39% (92.7467 => 90.5341, std.dev.: 0.7578) MultiSource/Applications/JM/lencod/lencod: -2.36% (6.7458 => 6.5864, std.dev.: 0.0564) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.12% (1.1683 => 1.1435, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.09% (3.7496 => 3.6713, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/hash2: -2.07% (3.4876 => 3.4155, std.dev.: 0.0235) MultiSource/Applications/SPASS/SPASS: -1.92% (8.5323 => 8.3688, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0079) MultiSource/Applications/aha/aha: -1.71% (3.4286 => 3.3701, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2340, std.dev.: 0.0147) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.45% (27.1724 => 26.7777, std.dev.: 0.0250) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3083, std.dev.: 0.0437) SingleSource/Benchmarks/Shootout-C++/lists: -1.34% (16.5617 => 16.3398, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.12% (1.7361 => 1.7167, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.51% (0.9980 => 1.0230, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -2.74% (0.6022 => 0.5857, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -11.82% (0.1666 => 0.1469, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.38% (0.1554 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.12% (0.3083 => 0.2925, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.69% (0.2394 => 0.2138, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.14% (0.3175 => 0.2980, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.30% (0.2302 => 0.2111, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -37.86% (0.0449 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -3.33% (0.0090 => 0.0087, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.53% (0.0324 => 0.0251, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -61.85% (0.0325 => 0.0124, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.33% (0.1429 => 0.1448, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 0.42% (1.5019 => 1.5082, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.20% (0.1501 => 0.1483, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.39% (0.4264 => 0.4077, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.27% (0.1344 => 0.1388, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.60% (0.0232 => 0.0219, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.36% (0.0639 => 0.0560, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.77% (1.1350 => 1.1263, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.85% (0.0246 => 0.0207, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.21% (1.5363 => 1.6010, std.dev.: 0.0048) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 02:07:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 04:07:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928090739.8872B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4336?compare_to=4331&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4336, Order: 164813, Start Time: 2012-09-28 07:54:22, End Time: 2012-09-28 09:09:14 To: 4331, Order: 164811, Start Time: 2012-09-28 03:04:18, End Time: 2012-09-28 04:18:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.84% (2.0176 => 2.4583, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.45% (0.1013 => 0.1129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.41% (0.4328 => 0.4822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.08% (0.1588 => 0.1764, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.07% (1.3693 => 1.5209, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.03% (3.9660 => 4.4033, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 10.82% (0.7061 => 0.7825, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.64% (0.7710 => 0.8530, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 10.60% (0.7038 => 0.7784, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.52% (0.6959 => 0.7691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.47% (0.1327 => 0.1466, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.40% (0.2721 => 0.3004, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.36% (0.2596 => 0.2865, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.36% (0.3899 => 0.4303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.24% (1.4563 => 1.6054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.22% (0.9199 => 1.0139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.13% (1.2193 => 1.3428, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.10% (0.5265 => 0.5797, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.10% (0.3130 => 0.3446, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.03% (0.3489 => 0.3839, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.00% (1.9828 => 2.1811, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.94% (0.2937 => 0.3229, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.90% (1.1364 => 1.2489, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.86% (13.8202 => 15.1826, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/lists: 9.84% (0.3293 => 0.3617, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.74% (0.3756 => 0.4122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.64% (0.4016 => 0.4403, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.61% (0.6283 => 0.6887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.49% (0.3868 => 0.4235, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.30% (0.3453 => 0.3774, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.22% (1.0313 => 1.1264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3534 => 0.3858, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.4791 => 0.5226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.06% (0.5577 => 0.6082, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.04% (0.4390 => 0.4787, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.84% (0.3246 => 0.3533, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.79% (0.2127 => 0.2314, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 8.78% (0.2995 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.68% (1.1061 => 1.2021, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.63% (0.4379 => 0.4757, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.59% (0.6576 => 0.7141, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.56% (3.6692 => 3.9832, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 8.56% (0.8310 => 0.9021, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.48% (7.2180 => 7.8303, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 8.47% (0.7506 => 0.8142, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.41% (0.5637 => 0.6111, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 8.40% (16.6129 => 18.0088, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 8.36% (3.8646 => 4.1878, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.23% (0.7460 => 0.8074, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.23% (0.3220 => 0.3485, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.12% (3.1889 => 3.4478, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.10% (0.3755 => 0.4059, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 8.07% (0.6744 => 0.7288, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 8.05% (2.1791 => 2.3546, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.01% (0.8698 => 0.9395, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 7.89% (1.0594 => 1.1430, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 7.78% (1.9270 => 2.0769, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.76% (1.3245 => 1.4273, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1865 => 0.2009, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.63% (14.8535 => 15.9864, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: 7.60% (0.3578 => 0.3850, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (0.8818 => 0.9487, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 7.42% (1.2749 => 1.3695, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 7.39% (0.4003 => 0.4299, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.39% (0.3789 => 0.4069, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 7.34% (0.3663 => 0.3932, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (8.4961 => 9.1109, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.21% (4.3801 => 4.6959, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 7.13% (0.3940 => 0.4221, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.13% (1.3813 => 1.4798, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 7.12% (0.3131 => 0.3354, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (1.1333 => 1.2138, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.10% (4.4433 => 4.7587, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.08% (0.4113 => 0.4404, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.07% (0.6135 => 0.6569, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.04% (1.3819 => 1.4792, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.04% (13.2842 => 14.2188, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 7.03% (0.2859 => 0.3060, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3153, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.95% (0.3511 => 0.3755, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.87% (0.2140 => 0.2287, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.84% (14.5298 => 15.5230, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 6.78% (4.6629 => 4.9792, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 6.68% (6.5754 => 7.0144, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2504 => 0.2671, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.41% (3.2742 => 3.4842, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6250 => 0.6644, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.10% (0.4805 => 0.5098, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.99% (4.9865 => 5.2850, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.77% (1.5188 => 1.6064, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.73% (0.9108 => 0.9630, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.48% (3.7467 => 3.9520, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.25% (2.1007 => 2.2109, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 5.23% (0.2008 => 0.2113, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (6.2785 => 6.5964, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 4.71% (33.2944 => 34.8640, std.dev.: 0.0316) MultiSource/Applications/sqlite3/sqlite3: 3.67% (16.2614 => 16.8583, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.45% (5.7573 => 7.5104, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std.dev.: 0.0517) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.16% (0.2093 => 0.2222, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7248, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.96% (10.7476 => 11.0660, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5967, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2255, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5932, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.03% (13.3668 => 13.5044, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.97% (22.5627 => 22.1183, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2308 => 1.0900, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3024, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9658, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0173) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9446, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7057, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2516, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2299, std.dev.: 0.0237) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1728, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2522, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: -1.11% (4.4810 => 4.4313, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2338, std.dev.: 0.0137) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 02:12:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 04:12:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928091248.DF24A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4337?compare_to=4332&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4337, Order: 164813, Start Time: 2012-09-28 07:54:17, End Time: 2012-09-28 09:14:23 To: 4332, Order: 164811, Start Time: 2012-09-28 03:04:18, End Time: 2012-09-28 04:24:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 950 (704 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.10% (0.5771 => 0.5765, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: -0.09% (16.0852 => 16.0701, std.dev.: 0.0337) MultiSource/Applications/kimwitu++/kc: 0.08% (14.9282 => 14.9403, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: -0.01% (83.2490 => 83.2380, std.dev.: 0.0947) MultiSource/Benchmarks/MallocBench/gs/gs: -0.20% (4.3612 => 4.3523, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.24% (1.2389 => 1.2359, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (7.5171 => 7.5171, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.05% (3.7076 => 3.7093, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.6473 => 0.6475, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0670 => 0.0648, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.61% (63.2438 => 83.2380, std.dev.: 0.0947) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.28% (0.0720 => 10.3214, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.00% (10.3673 => 15.1359, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/richards_benchmark: 28.91% (0.1622 => 0.2091, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.46% (7.0540 => 8.2150, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.67% (2.2022 => 2.5473, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.54% (0.1566 => 0.1778, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.13% (1.1194 => 1.2664, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.62% (1.7609 => 1.9832, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.39% (0.3282 => 0.3623, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.13% (0.3516 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.95% (10.4361 => 11.3702, std.dev.: 0.0227) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.59% (9.4845 => 10.2991, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 8.05% (5.7591 => 6.2225, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.81% (0.2700 => 0.2911, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 7.79% (0.7433 => 0.8012, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3109 => 0.3348, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.60% (0.6675 => 0.7182, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 7.56% (0.7115 => 0.7653, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5925 => 0.6372, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.41% (0.6030 => 0.6477, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.40% (0.2271 => 0.2439, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.39% (0.4615 => 0.4956, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (8.1363 => 8.7299, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/08-main/main: 7.28% (0.2554 => 0.2740, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.3423 => 0.3672, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 7.25% (3.3354 => 3.5772, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (1.3050 => 1.3990, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (4.2646 => 4.5714, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.17% (1.5415 => 1.6520, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.15% (0.5105 => 0.5470, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.96% (0.5860 => 0.6268, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.87% (0.8067 => 0.8621, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.86% (5.0018 => 5.3449, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.80% (4.9449 => 5.2810, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.79% (0.5569 => 0.5947, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 6.67% (0.7326 => 0.7815, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.64% (0.2107 => 0.2247, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.60% (0.3121 => 0.3327, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.8172 => 0.8707, std.dev.: 0.0100) MultiSource/Applications/spiff/spiff: 6.50% (0.7835 => 0.8344, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.45% (0.5020 => 0.5344, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.38% (7.9617 => 8.4697, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 6.38% (3.8723 => 4.1193, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.37% (1.1861 => 1.2616, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 6.36% (1.5603 => 1.6596, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.36% (0.9765 => 1.0386, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 6.30% (1.1642 => 1.2376, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.30% (0.2603 => 0.2767, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 6.29% (1.0722 => 1.1396, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.24% (0.2758 => 0.2930, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 6.23% (0.3387 => 0.3598, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 6.18% (0.3092 => 0.3283, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 6.17% (0.3422 => 0.3633, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3441 => 0.3652, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4299 => 0.4556, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.4103 => 0.4347, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.93% (21.9371 => 23.2387, std.dev.: 0.0416) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.6456 => 0.6839, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.3180 => 0.3367, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.78% (0.4289 => 0.4537, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3865 => 0.4086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.71% (0.2891 => 0.3056, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.6450 => 0.6814, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3650 => 0.3855, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.61% (2.0273 => 2.1410, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 5.58% (0.2905 => 0.3067, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.54% (0.4636 => 0.4893, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 5.51% (0.2831 => 0.2987, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.46% (0.3826 => 0.4035, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4203 => 0.4432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.42% (2.2969 => 2.4213, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 5.39% (0.8921 => 0.9402, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 5.36% (0.3098 => 0.3264, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.34% (0.3162 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2756 => 0.2903, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.3136 => 0.3303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.32% (0.3232 => 0.3404, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.26% (0.4048 => 0.4261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.25% (0.3603 => 0.3792, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (2.0665 => 2.1747, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2871 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3283 => 0.3454, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.20% (0.2714 => 0.2855, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.18% (0.3935 => 0.4139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.3052 => 0.3210, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (1.5859 => 1.6676, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2793 => 0.2936, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2877 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.10% (0.3684 => 0.3872, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2802 => 0.2944, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.5981 => 0.6279, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (14.3668 => 15.0694, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 4.85% (0.3379 => 0.3543, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.4186 => 1.4872, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.79% (2.2024 => 2.3078, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.1840 => 1.2381, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2842 => 1.3321, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.41% (0.3427 => 0.3544, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.25% (0.8101 => 0.8364, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (3.8922 => 3.9769, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.26% (3.1578 => 3.3872, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.1396 => 1.2156, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.79% (3.6395 => 3.7773, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3524, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2392, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5790, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.93% (5.2763 => 3.2749, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.88% (5.3855 => 3.9378, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.52% (5.3526 => 3.9329, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.39% (54.1659 => 46.3697, std.dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.73% (2.9384 => 2.6230, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.30% (22.1758 => 20.3358, std.dev.: 0.0625) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.94% (1.2373 => 1.0896, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2946, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.56% (1.8329 => 1.7126, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5079, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (8.1563 => 7.9728, std.dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5015, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0953, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2515, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6836, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8562, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.25% (0.5229 => 0.5765, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 7.21% (14.9895 => 16.0701, std.dev.: 0.0337) MultiSource/Applications/kimwitu++/kc: 5.55% (14.1553 => 14.9403, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 5.88% (4.1105 => 4.3523, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.87% (1.1048 => 1.2359, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.01% (7.1582 => 7.5171, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.12% (3.4629 => 3.7093, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.6222 => 0.6475, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 04:17:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 06:17:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928111731.164E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4338?compare_to=4335&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4338, Order: 164814, Start Time: 2012-09-28 10:07:21, End Time: 2012-09-28 11:19:07 To: 4335, Order: 164813, Start Time: 2012-09-28 07:41:21, End Time: 2012-09-28 08:51:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (57 on baseline) Performance Improvements: 3 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (792 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.71% (2.3519 => 2.3922, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 9.64% (3.0574 => 3.3522, std.dev.: 0.1126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.25% (20.9708 => 22.7004, std.dev.: 0.1747) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.49% (4.0875 => 4.2300, std.dev.: 0.0507) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.64% (13.1809 => 13.5293, std.dev.: 0.0386) MultiSource/Benchmarks/FreeBench/mason/mason: 2.02% (0.5042 => 0.5144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 1.69% (3.0814 => 3.1336, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.07% (1.7167 => 1.7351, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -8.23% (0.1568 => 0.1439, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -7.29% (9.0120 => 8.3552, std.dev.: 0.1993) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.50% (1.4620 => 1.4401, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.45% (1.0230 => 1.0082, std.dev.: 0.0220) MultiSource/Applications/sqlite3/sqlite3: -0.12% (0.5857 => 0.5850, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/08-main/main: 3.06% (0.1469 => 0.1514, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.12% (0.1346 => 0.1304, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.41% (0.2925 => 0.2937, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.79% (0.2138 => 0.2219, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.91% (0.2980 => 0.3007, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.24% (0.2111 => 0.2106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -6.09% (0.0279 => 0.0262, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -21.59% (0.0088 => 0.0069, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: 2.30% (0.0087 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.67% (0.0075 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0388 => 0.0387, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0300 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -17.50% (0.0280 => 0.0231, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 27.89% (0.0251 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0191 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0251 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.81% (0.0124 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1448 => 0.1444, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.19% (1.5082 => 1.5262, std.dev.: 0.0428) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.81% (0.1483 => 0.1471, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.10% (0.4077 => 0.4032, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1388 => 0.1365, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.31% (0.0612 => 0.0555, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.42% (0.0219 => 0.0194, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.21% (0.0560 => 0.0578, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.1263 => 1.1273, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0005 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.26% (0.0023 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.79% (0.0548 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.21% (0.0207 => 0.0190, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.95% (0.7650 => 0.7577, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.16% (1.6010 => 1.5984, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.98% (4.1772 => 3.1336, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/except: 82516.67% (0.0006 => 0.4957, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 25.37% (0.0745 => 0.0934, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.92% (2.1763 => 2.3922, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.75% (0.1159 => 0.1272, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6410 => 0.6954, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 8.01% (0.5309 => 0.5734, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 7.78% (0.6173 => 0.6653, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 7.00% (1.0046 => 1.0749, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.59% (0.3582 => 0.3818, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.44% (1.1653 => 1.2403, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.35% (0.2552 => 0.2714, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.88% (15.3105 => 16.2109, std.dev.: 0.2017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.12% (1.5150 => 1.5925, std.dev.: 0.0203) MultiSource/Applications/d/make_dparser: 4.61% (3.0225 => 3.1618, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (12.6413 => 13.1951, std.dev.: 0.1236) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.37% (0.6069 => 0.6334, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 4.04% (13.3238 => 13.8626, std.dev.: 0.1551) MultiSource/Applications/oggenc/oggenc: 4.00% (4.7455 => 4.9354, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.81% (1.2021 => 1.2479, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.61% (0.2797 => 0.2898, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.59% (0.8569 => 0.8877, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.0689 => 1.1071, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.51% (1.1440 => 1.1841, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (1.1827 => 1.2231, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.2952 => 0.3052, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.0318 => 4.1601, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/hash2: 3.04% (0.3847 => 0.3964, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1672 => 1.2009, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.77% (0.4880 => 0.5015, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.4908 => 6.6646, std.dev.: 0.0414) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.7256 => 15.1193, std.dev.: 0.1344) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8405 => 0.8613, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4562 => 0.4667, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (1.4113 => 1.4401, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.98% (4.2616 => 4.3459, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 56.70% (0.0261 => 0.0409, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Bubblesort: 46.77% (0.0263 => 0.0386, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.48% (1.6538 => 2.3398, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.88% (4.0101 => 4.5667, std.dev.: 0.0115) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 11.16% (1.6261 => 1.8075, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6124, std.dev.: 0.0598) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.01% (1.0063 => 1.0869, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.32% (15.2242 => 15.8818, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.06% (3.8907 => 4.0096, std.dev.: 0.0255) MultiSource/Applications/hexxagon/hexxagon: 2.91% (14.4877 => 14.9095, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/mason/mason: 2.80% (0.5004 => 0.5144, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (6.6312 => 6.8106, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.62% (2.6656 => 2.7355, std.dev.: 0.0199) MultiSource/Applications/siod/siod: 2.55% (3.5520 => 3.6427, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.42% (0.5876 => 0.6018, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 2.30% (0.6308 => 0.6453, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 1.13% (1.4184 => 1.4344, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -7.14% (8.9977 => 8.3552, std.dev.: 0.1993) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -20.75% (1.7473 => 1.3847, std.dev.: 0.0437) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.68% (5.2665 => 4.2300, std.dev.: 0.0507) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.96% (1.1647 => 0.9555, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.54% (15.8312 => 13.5293, std.dev.: 0.0386) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/moments: -9.52% (0.1114 => 0.1008, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.83% (3.2007 => 2.9500, std.dev.: 0.0707) MultiSource/Applications/lambda-0_1_3/lambda: -7.15% (7.6833 => 7.1337, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3775, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3280, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8723, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.93% (2.9728 => 2.7964, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9469, std.dev.: 0.0978) SingleSource/Benchmarks/Misc/richards_benchmark: -5.28% (1.4441 => 1.3679, std.dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (3.4230 => 3.2446, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/fib2: -5.18% (4.4195 => 4.1906, std.dev.: 0.0144) MultiSource/Applications/sgefa/sgefa: -4.56% (0.3746 => 0.3575, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.23% (0.4564 => 0.4371, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.15% (0.4140 => 0.3968, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -4.08% (2.5166 => 2.4139, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: -3.92% (9.2503 => 8.8881, std.dev.: 0.0398) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.70% (1.2722 => 1.2251, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8210, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.00% (1.8739 => 1.8176, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2888, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.70% (3.7496 => 3.6485, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.51% (1.1683 => 1.1390, std.dev.: 0.0068) MultiSource/Applications/lua/lua: -2.39% (29.5232 => 28.8190, std.dev.: 0.2558) MultiSource/Applications/JM/lencod/lencod: -2.27% (6.7458 => 6.5929, std.dev.: 0.0088) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3652, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4876 => 3.4245, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.77% (2.3569 => 2.3151, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -1.75% (92.7467 => 91.1222, std.dev.: 0.5582) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2220, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.67% (0.6119 => 0.6017, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3229, std.dev.: 0.0895) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8177, std.dev.: 0.1125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.02% (0.9980 => 1.0082, std.dev.: 0.0220) MultiSource/Applications/sqlite3/sqlite3: -2.86% (0.6022 => 0.5850, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/08-main/main: -9.12% (0.1666 => 0.1514, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.09% (0.1554 => 0.1304, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.74% (0.3083 => 0.2937, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.31% (0.2394 => 0.2219, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.29% (0.3175 => 0.3007, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.51% (0.2302 => 0.2106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -41.65% (0.0449 => 0.0262, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -22.47% (0.0089 => 0.0069, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -65.42% (0.0240 => 0.0083, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.66% (0.0284 => 0.0231, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -61.54% (0.0325 => 0.0125, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1429 => 0.1444, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.62% (1.5019 => 1.5262, std.dev.: 0.0428) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.00% (0.1501 => 0.1471, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.44% (0.4264 => 0.4032, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.56% (0.1344 => 0.1365, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.0589 => 0.0555, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.38% (0.0232 => 0.0194, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1350 => 1.1273, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.47% (0.0637 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.76% (0.0246 => 0.0190, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.48% (0.7541 => 0.7577, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.04% (1.5363 => 1.5984, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 04:21:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 06:21:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928112105.077492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4339?compare_to=4334&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4339, Order: 164813, Start Time: 2012-09-28 08:38:59, End Time: 2012-09-28 11:22:39 To: 4334, Order: 164811, Start Time: 2012-09-28 05:23:10, End Time: 2012-09-28 08:09:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (765 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.39% (54.1081 => 54.8594, std.dev.: 0.0509) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.63% (0.1063 => 0.1176, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.19% (1.5932 => 1.7555, std.dev.: 0.0173) SingleSource/UnitTests/ObjC/exceptions-3: 9.57% (0.3460 => 0.3791, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3446 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3442 => 0.3769, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3496 => 0.3828, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3465 => 0.3794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.49% (0.3488 => 0.3819, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.37% (0.3469 => 0.3794, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.32% (0.3650 => 0.3990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3643 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.08% (0.3724 => 0.4062, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5826 => 0.6304, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.5889 => 0.6361, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.60% (0.1619 => 0.1742, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (1.6211 => 1.7363, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.01% (1.3152 => 1.4074, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.89% (0.2875 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.89% (0.3195 => 0.3415, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (0.4361 => 0.4661, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.87% (3.5627 => 3.8076, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 6.86% (0.7171 => 0.7663, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.3004 => 0.3207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 6.62% (0.2823 => 0.3010, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.58% (0.2750 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.54% (0.2813 => 0.2997, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.54% (0.2738 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.51% (0.2780 => 0.2961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2811 => 0.2994, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.48% (0.5000 => 0.5324, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.45% (0.9909 => 1.0548, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2792 => 0.2972, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.42% (0.2803 => 0.2983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2729 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (2.0673 => 2.1995, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.39% (0.2911 => 0.3097, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.31% (0.3060 => 0.3253, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3124 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3267 => 0.3471, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.24% (5.5417 => 5.8873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.20% (0.3258 => 0.3460, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.19% (0.3362 => 0.3570, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.18% (1.0781 => 1.1447, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wc: 6.17% (0.3096 => 0.3287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.06% (0.3317 => 0.3518, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (2.7292 => 2.8943, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/moments: 5.98% (0.3678 => 0.3898, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3625 => 0.3841, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (0.3930 => 0.4164, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.91% (0.3282 => 0.3476, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.90% (0.3726 => 0.3946, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.88% (0.2736 => 0.2897, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.88% (0.3348 => 0.3545, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.87% (0.3477 => 0.3681, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 5.83% (23.5202 => 24.8917, std.dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 5.77% (4.2109 => 4.4538, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (0.4251 => 0.4491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4146 => 0.4380, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.62% (4.4195 => 4.6677, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 5.61% (0.2566 => 0.2710, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.53% (0.3690 => 0.3894, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (0.5026 => 0.5301, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.3845 => 0.4051, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.35% (0.3981 => 0.4194, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.3903 => 0.4111, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.32% (0.3890 => 0.4097, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (0.4139 => 0.4359, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.22% (2.1013 => 2.2110, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (1.8794 => 1.9775, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.21% (0.6435 => 0.6770, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.19% (0.4029 => 0.4238, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 5.19% (0.6634 => 0.6978, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 5.16% (0.3336 => 0.3508, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.15% (4.6177 => 4.8557, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 5.09% (1.4269 => 1.4995, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 5.07% (2.1653 => 2.2750, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.99% (0.3084 => 0.3238, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.98% (0.2068 => 0.2171, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.96% (0.5546 => 0.5821, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.2737 => 0.2872, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.2040 => 0.2140, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.88% (0.9697 => 1.0170, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.83% (0.4658 => 0.4883, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.65% (0.3271 => 0.3423, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.2969 => 0.3103, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (1.9694 => 2.0572, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.37% (1.9966 => 2.0838, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 4.36% (2.0346 => 2.1234, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.32% (0.7875 => 0.8215, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 4.19% (0.4847 => 0.5050, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (0.7426 => 0.7714, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.84% (0.5361 => 0.5567, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (0.5584 => 0.5783, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.32% (0.4253 => 0.4394, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.13% (11.6398 => 12.0046, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 3.06% (0.3498 => 0.3605, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.98% (4.6926 => 4.8326, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 1.75% (11.9555 => 12.1650, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6760, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.77% (15.4430 => 16.1791, std.dev.: 0.1318) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6471, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2089, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5022, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4387, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.51% (7.1849 => 7.2931, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5341, std.dev.: 0.0298) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7878, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -4.87% (0.2402 => 0.2285, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7997, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -2.71% (17.2379 => 16.7711, std.dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5781, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 04:27:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 06:27:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928112724.7C8222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4340?compare_to=4336&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4340, Order: 164814, Start Time: 2012-09-28 10:14:28, End Time: 2012-09-28 11:28:59 To: 4336, Order: 164813, Start Time: 2012-09-28 07:54:22, End Time: 2012-09-28 09:09:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (689 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.29% (3.7818 => 3.8307, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.85% (2.0176 => 2.4584, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.95% (0.1410 => 0.1649, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.41% (0.1072 => 0.1205, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.68% (0.1413 => 0.1578, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.36% (0.5748 => 0.6401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.25% (0.4328 => 0.4815, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.07% (3.9660 => 4.4052, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: 11.02% (1.3693 => 1.5202, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.90% (0.7038 => 0.7805, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 10.86% (0.2781 => 0.3083, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.82% (0.7061 => 0.7825, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.79% (0.0964 => 0.1068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.71% (0.4062 => 0.4497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.71% (0.2596 => 0.2874, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.70% (0.1327 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.62% (0.3899 => 0.4313, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.55% (0.2721 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.39% (0.7710 => 0.8511, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.33% (0.6959 => 0.7678, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.18% (1.2193 => 1.3434, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.16% (0.5265 => 0.5800, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.16% (0.3130 => 0.3448, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.15% (1.9828 => 2.1840, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.02% (0.9199 => 1.0121, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3489 => 0.3836, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 9.92% (0.2761 => 0.3035, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.88% (1.1364 => 1.2487, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.85% (0.3756 => 0.4126, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.84% (13.8202 => 15.1796, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.83% (1.4563 => 1.5994, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.69% (0.4016 => 0.4405, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.64% (0.3868 => 0.4241, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.6283 => 0.6888, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.35% (0.3453 => 0.3776, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4390 => 0.4800, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 9.24% (1.0313 => 1.1266, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.23% (0.5577 => 0.6092, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.08% (0.1157 => 0.1262, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.06% (0.4791 => 0.5225, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.06% (0.3246 => 0.3540, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 8.78% (0.2995 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.73% (1.1061 => 1.2027, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.72% (0.4379 => 0.4761, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1276 => 0.1387) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.63% (0.7460 => 0.8104, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 8.60% (3.8646 => 4.1971, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (7.2180 => 7.8361, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6576 => 0.7139, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.54% (3.6692 => 3.9825, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 8.48% (16.6129 => 18.0211, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/football/football: 8.41% (0.8310 => 0.9009, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 8.39% (0.3220 => 0.3490, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.30% (0.5637 => 0.6105, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 8.25% (0.7506 => 0.8125, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 8.22% (3.1889 => 3.4510, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.2925 => 0.3165, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 8.19% (2.1791 => 2.3575, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 8.19% (0.6744 => 0.7296, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.12% (0.3755 => 0.4060, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.02% (0.2243 => 0.2423, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.01% (0.2023 => 0.2185, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.98% (0.8698 => 0.9392, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 7.94% (1.9270 => 2.0800, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.91% (1.0594 => 1.1432, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.88% (0.1865 => 0.2012, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.67% (14.8535 => 15.9934, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3578 => 0.3851, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.60% (1.3245 => 1.4252, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (0.1657 => 0.1780, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 7.42% (1.2749 => 1.3695, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.37% (0.4003 => 0.4298, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.26% (4.3801 => 4.6982, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 7.25% (0.3131 => 0.3358, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.24% (8.4961 => 9.1113, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 7.18% (0.3623 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.16% (1.1333 => 1.2144, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.15% (0.3663 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.15% (4.4433 => 4.7610, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 7.14% (0.2859 => 0.3063, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.12% (0.8818 => 0.9446, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.11% (0.6135 => 0.6571, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.08% (0.4113 => 0.4404, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.01% (0.3511 => 0.3757, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.2140 => 0.2289, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.95% (13.2842 => 14.2078, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.86% (1.3813 => 1.4761, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.86% (1.3819 => 1.4767, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 6.84% (14.5298 => 15.5235, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 6.78% (4.6629 => 4.9789, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (6.5754 => 7.0154, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.55% (0.2321 => 0.2473, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.41% (3.2742 => 3.4842, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 6.21% (0.6250 => 0.6638, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.08% (4.9865 => 5.2896, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.06% (0.4805 => 0.5096, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.74% (1.5188 => 1.6060, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.65% (0.9108 => 0.9623, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.57% (3.7467 => 3.9554, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.36% (2.1007 => 2.2132, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.2008 => 0.2115, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (6.2785 => 6.5960, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 4.75% (33.2944 => 34.8748, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 3.63% (16.2614 => 16.8512, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2572) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4171, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.10% (1.2998 => 1.3791, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7248, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0753, std.dev.: 0.0535) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5889, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420) MultiSource/Benchmarks/llubenchmark/llu: 1.53% (3.7731 => 3.8307, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5848, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3232, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.06% (12.0921 => 12.2207, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5877, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9171, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.85% (0.4657 => 0.3919, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.08% (22.5627 => 22.0926, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.69% (1.2308 => 1.0869, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2859, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.62% (1.3780 => 1.3005, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.27% (0.4867 => 0.4708, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.78% (3.0263 => 2.9423, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7054, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.66% (0.6615 => 0.6505, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1230, std.dev.: 0.0547) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2301, std.dev.: 0.0316) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0169) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 04:32:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 06:32:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928113233.ACFAE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4341?compare_to=4337&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4341, Order: 164814, Start Time: 2012-09-28 10:14:16, End Time: 2012-09-28 11:34:09 To: 4337, Order: 164813, Start Time: 2012-09-28 07:54:17, End Time: 2012-09-28 09:14:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (702 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.49% (78.4906 => 80.4476, std.dev.: 0.3638) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.09% (0.5765 => 0.5770, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.05% (16.0701 => 16.0786, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -0.07% (14.9403 => 14.9297, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: -0.02% (83.2380 => 83.2251, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3523 => 4.3513, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2359 => 1.2364, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.5171 => 7.5146, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.7093 => 3.7095, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.6475 => 0.6468, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1433 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.59% (63.2438 => 83.2251, std.dev.: 0.0212) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14228.75% (0.0720 => 10.3167, std.dev.: 0.0082) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.98% (10.3673 => 15.1343, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: 28.91% (0.1622 => 0.2091, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.36% (7.0540 => 8.2080, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.64% (2.2022 => 2.5467, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.18% (1.1194 => 1.2669, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.64% (1.7609 => 1.9834, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.48% (0.1584 => 0.1750, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3543 => 0.3912, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.78% (0.3927 => 0.4311, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 9.00% (10.4361 => 11.3750, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.62% (9.4845 => 10.3021, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.40% (0.3177 => 0.3444, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 8.05% (5.7591 => 6.2225, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.81% (0.2700 => 0.2911, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.72% (0.7433 => 0.8007, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6675 => 0.7187, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.62% (0.3109 => 0.3346, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.58% (0.4615 => 0.4965, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.58% (0.5925 => 0.6374, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.56% (0.7115 => 0.7653, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.42% (0.5860 => 0.6295, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.35% (0.6030 => 0.6473, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.27% (0.2271 => 0.2436, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.3423 => 0.3671, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 7.22% (3.3354 => 3.5762, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.21% (8.1363 => 8.7230, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (1.3050 => 1.3989, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.18% (0.3121 => 0.3345, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (1.5415 => 1.6518, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (4.2646 => 4.5690, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.05% (0.5105 => 0.5465, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.86% (5.0018 => 5.3447, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.75% (4.9449 => 5.2789, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 6.72% (0.7326 => 0.7818, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.8067 => 0.8606, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.8172 => 0.8718, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.61% (0.5569 => 0.5937, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.60% (0.2107 => 0.2246, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 6.47% (0.7835 => 0.8342, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.38% (7.9617 => 8.4697, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.35% (0.5020 => 0.5339, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.35% (1.5603 => 1.6594, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.29% (0.9765 => 1.0379, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 6.28% (1.1642 => 1.2373, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 6.26% (0.3387 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (1.1861 => 1.2603, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 6.23% (1.0722 => 1.1390, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.22% (0.2603 => 0.2765, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.14% (0.3092 => 0.3282, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 6.05% (3.8723 => 4.1066, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 6.05% (0.3422 => 0.3629, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.04% (0.4103 => 0.4351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.96% (0.3441 => 0.3646, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.94% (21.9371 => 23.2399, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 5.89% (0.6456 => 0.6836, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.3180 => 0.3366, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4299 => 0.4550, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4289 => 0.4538, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (0.4064 => 0.4297, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2891 => 0.3055, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.65% (2.0273 => 2.1418, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.64% (0.4203 => 0.4440, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 5.61% (0.2905 => 0.3068, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3650 => 0.3853, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3162 => 0.3337, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.52% (0.6450 => 0.6806, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3865 => 0.4077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.3098 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.41% (0.4636 => 0.4887, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.41% (0.3826 => 0.4033, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.8921 => 0.9403, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 5.37% (0.2831 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (0.4620 => 0.4868, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3603 => 0.3795, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.32% (0.2725 => 0.2870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.31% (0.4048 => 0.4263, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.29% (2.2969 => 2.4185, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302) SingleSource/Benchmarks/Shootout-C++/except: 5.26% (0.2871 => 0.3022, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3283 => 0.3454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.19% (0.2756 => 0.2899, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2872 => 0.3021, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.17% (0.3232 => 0.3399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3052 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (2.0665 => 2.1723, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.09% (1.5859 => 1.6666, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3935 => 0.4135, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.05% (0.3684 => 0.3870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.05% (0.2793 => 0.2934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.04% (0.2877 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.97% (0.5981 => 0.6278, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 4.93% (0.2802 => 0.2940, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (14.3668 => 15.0664, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3379 => 0.3542, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.4186 => 1.4866, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.76% (2.2024 => 2.3072, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.1840 => 1.2380, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2842 => 1.3309, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.3427 => 0.3545, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.23% (0.8101 => 0.8363, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.50% (17.1811 => 17.6102, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.15% (3.8922 => 3.9760, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (3.1578 => 3.3804, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.43% (3.6395 => 3.7643, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.04% (4.2280 => 4.3564, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2268, std.dev.: 0.0189) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.94% (5.2763 => 3.2745, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.88% (5.3855 => 3.9381, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.53% (5.3526 => 3.9325, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.46% (54.1659 => 46.3341, std.dev.: 0.0370) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.75% (2.9384 => 2.6226, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -8.30% (22.1758 => 20.3361, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -12.16% (1.2373 => 1.0869, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2928, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.57% (1.9577 => 1.8487, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1655, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5002, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5051, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9955, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0938, std.dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2539, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.35% (0.5229 => 0.5770, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.27% (14.9895 => 16.0786, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 5.47% (14.1553 => 14.9297, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 5.86% (4.1105 => 4.3513, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.91% (1.1048 => 1.2364, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.98% (7.1582 => 7.5146, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.12% (3.4629 => 3.7095, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.95% (0.6222 => 0.6468, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 05:44:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 07:44:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928124400.650CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4342?compare_to=4338&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4342, Order: 164818, Start Time: 2012-09-28 11:35:18, End Time: 2012-09-28 12:45:37 To: 4338, Order: 164814, Start Time: 2012-09-28 10:07:21, End Time: 2012-09-28 11:19:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (96 on baseline) Performance Improvements: 10 (45 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 881 (750 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.13% (0.1439 => 0.1556, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5555 => 0.5779, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: 3.65% (8.3552 => 8.6602, std.dev.: 0.0801) MultiSource/Applications/hbd/hbd: 3.12% (1.3326 => 1.3742, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.36% (0.5981 => 0.6122, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.24% (0.7585 => 0.7755, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7152 => 0.7309, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5807 => 0.5907, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 14.81% (20.0282 => 22.9949, std.dev.: 0.6420) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.34% (1.8176 => 1.8601, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (2.3922 => 2.3675, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -4.14% (0.6710 => 0.6432, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.18% (13.5293 => 13.0988, std.dev.: 0.1624) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.04% (45.2201 => 43.8472, std.dev.: 0.3075) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.78% (4.2300 => 4.1124, std.dev.: 0.0349) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.07% (0.8982 => 0.8796, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (39.7639 => 39.0415, std.dev.: 0.2433) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.47% (1.2986 => 1.2795, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.45% (43.3218 => 42.6933, std.dev.: 0.0855) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.09% (1.3712 => 1.3562, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.05% (1.0082 => 1.0087, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 5.26% (0.5850 => 0.6158, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 11.82% (0.1514 => 0.1693, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.70% (0.1304 => 0.1587, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.41% (0.2937 => 0.3096, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.43% (0.2219 => 0.2406, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.19% (0.3007 => 0.3193, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.92% (0.2106 => 0.2315, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 73.28% (0.0262 => 0.0454, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 23.19% (0.0069 => 0.0085, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -66.29% (0.0089 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 103.61% (0.0083 => 0.0169, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.58% (0.0190 => 0.0193, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.07% (0.0387 => 0.0379, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.00% (0.0300 => 0.0294, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 22.08% (0.0231 => 0.0282, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0321 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -14.66% (0.0191 => 0.0163, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 121.60% (0.0125 => 0.0277, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.62% (0.1444 => 0.1453, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: -0.55% (1.5262 => 1.5178, std.dev.: 0.0245) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1471 => 0.1475, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.84% (0.4032 => 0.4227, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.39% (0.1365 => 0.1346, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.45% (0.0555 => 0.0613, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.86% (0.0194 => 0.0217, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.86% (0.0578 => 0.0635, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1273 => 1.1305, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 60.00% (0.0010 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 240.00% (0.0005 => 0.0017, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.37% (0.0640 => 0.0548, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.0190 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.90% (0.7577 => 0.7645, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -4.61% (1.5984 => 1.5247, std.dev.: 0.0362) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.06% (4.1772 => 3.0885, std.dev.: 0.0485) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.97% (0.0745 => 0.0931, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.04% (0.1414 => 0.1556, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.49% (0.1159 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.95% (0.6410 => 0.6984, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 8.79% (2.1763 => 2.3675, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.5309 => 0.5721, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 7.25% (1.0046 => 1.0774, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 6.97% (0.6173 => 0.6603, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.48% (0.3582 => 0.3814, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (1.1653 => 1.2390, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.16% (1.5150 => 1.6083, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 5.84% (15.3105 => 16.2048, std.dev.: 0.2491) MultiSource/Applications/lambda-0_1_3/lambda: 5.70% (0.6915 => 0.7309, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.60% (0.2552 => 0.2695, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.16% (0.3217 => 0.3383, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.3901 => 0.4099, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.57% (3.0225 => 3.1606, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.56% (0.2654 => 0.2775, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.56% (29.3170 => 30.6534, std.dev.: 0.1735) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.7639 => 0.7986, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.50% (0.2797 => 0.2923, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.40% (0.4248 => 0.4435, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (12.6413 => 13.1801, std.dev.: 0.1099) MultiSource/Applications/SPASS/SPASS: 4.08% (13.3238 => 13.8672, std.dev.: 0.1090) MultiSource/Applications/Burg/burg: 4.06% (1.1440 => 1.1904, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.97% (0.6069 => 0.6310, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.84% (1.1827 => 1.2281, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 3.64% (2.0972 => 2.1735, std.dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (8.2186 => 8.5148, std.dev.: 0.0560) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (1.4408 => 1.4924, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 3.57% (1.3268 => 1.3742, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.2546 => 6.4749, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.0689 => 1.1062, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.48% (0.4880 => 0.5050, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 3.47% (14.6079 => 15.1151, std.dev.: 0.0844) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.43% (0.3062 => 0.3167, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3026 => 0.3129, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.36% (1.2021 => 1.2425, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: 3.36% (0.8405 => 0.8687, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.3418 => 0.3531, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.27% (1.1672 => 1.2054, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.7226 => 0.7461, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.23% (1.8798 => 1.9406, std.dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (6.4908 => 6.6976, std.dev.: 0.0492) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.17% (0.8569 => 0.8841, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.12% (0.5937 => 0.6122, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 3.09% (14.7256 => 15.1809, std.dev.: 0.1094) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0821 => 1.1153, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5740 => 0.5907, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.0758 => 3.1618, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (4.0318 => 4.1427, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.59% (1.4113 => 1.4478, std.dev.: 0.0126) MultiSource/Applications/lua/lua: 2.54% (3.5980 => 3.6893, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.54% (0.5636 => 0.5779, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.0317 => 2.0804, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5520 => 0.5647, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.29% (1.2742 => 1.3034, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (4.2815 => 4.3713, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: 2.05% (3.8796 => 3.9590, std.dev.: 0.0265) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.03% (0.5963 => 0.6084, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.4189 => 1.4438, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.66% (4.2616 => 4.3323, std.dev.: 0.0196) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.50% (4.3380 => 4.4030, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.49% (8.2559 => 8.3789, std.dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: 1.43% (0.9425 => 0.9560, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (1.3935 => 1.4077, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 42.15% (0.0261 => 0.0371, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.58% (0.0917 => 0.1069, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.54% (0.0766 => 0.0885, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9962, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5504, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/Puzzle: 12.98% (0.1433 => 0.1619, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6123, std.dev.: 0.1107) MultiSource/Benchmarks/nbench/nbench: 8.61% (21.1721 => 22.9949, std.dev.: 0.6420) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.51% (0.2857 => 0.3100, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.09% (1.0063 => 1.0776, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3301 => 0.3503, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.47% (40.4792 => 42.6933, std.dev.: 0.0855) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8468, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: 3.86% (0.9851 => 1.0231, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.51% (0.8498 => 0.8796, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.76% (14.4877 => 14.8879, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (6.6312 => 6.8102, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 2.63% (3.8907 => 3.9931, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: 2.48% (0.5004 => 0.5128, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.01% (3.5520 => 3.6235, std.dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/dry: 1.91% (2.4013 => 2.4472, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.34% (4.6127 => 4.6746, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (2.4042 => 2.4331, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: 1.04% (1.4184 => 1.4331, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.75% (8.9977 => 8.6602, std.dev.: 0.0801) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.12% (0.3497 => 0.2094, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.91% (5.2665 => 4.1124, std.dev.: 0.0349) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.36% (1.1647 => 0.9625, std.dev.: 0.0315) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.26% (15.8312 => 13.0988, std.dev.: 0.1624) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1566, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9372, std.dev.: 0.0239) MultiSource/Applications/lambda-0_1_3/lambda: -7.19% (7.6833 => 7.1307, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3776, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -6.74% (4.6355 => 4.3231, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -6.49% (0.2664 => 0.2491, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.43% (2.0027 => 1.8739, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: -6.22% (3.4230 => 3.2102, std.dev.: 0.0374) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7927, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -5.84% (1.4441 => 1.3598, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9328, std.dev.: 0.0841) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1893, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -4.47% (2.5166 => 2.4041, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: -4.35% (0.3746 => 0.3583, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.92% (1.2722 => 1.2223, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.57% (45.4683 => 43.8472, std.dev.: 0.3075) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.2959 => 1.2519, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (9.2503 => 8.9416, std.dev.: 0.0375) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.27% (1.4021 => 1.3562, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.08% (3.9413 => 3.8199, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0171) MultiSource/Applications/lua/lua: -2.56% (29.5232 => 28.7672, std.dev.: 0.2285) MultiSource/Benchmarks/PAQ8p/paq8p: -2.46% (92.7467 => 90.4683, std.dev.: 0.1447) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.46% (1.1683 => 1.1396, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/misr: -2.40% (0.4296 => 0.4193, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.10% (2.4457 => 2.3943, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.01% (3.7496 => 3.6744, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4181, std.dev.: 0.0250) MultiSource/Applications/aha/aha: -1.78% (3.4286 => 3.3674, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.73% (2.3569 => 2.3161, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2339, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3069, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: -1.37% (1.0194 => 1.0054, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4640, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8164, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: -1.10% (16.5617 => 16.3803, std.dev.: 0.0227) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.07% (0.9980 => 1.0087, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.26% (0.6022 => 0.6158, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 1.62% (0.1666 => 0.1693, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.12% (0.1554 => 0.1587, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (0.3083 => 0.3096, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.50% (0.2394 => 0.2406, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3175 => 0.3193, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.56% (0.2302 => 0.2315, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -4.49% (0.0089 => 0.0085, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -29.58% (0.0240 => 0.0169, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.82% (0.0390 => 0.0379, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.33% (0.0301 => 0.0294, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.76% (0.0189 => 0.0163, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -14.77% (0.0325 => 0.0277, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 1.06% (1.5019 => 1.5178, std.dev.: 0.0245) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.73% (0.1501 => 0.1475, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.87% (0.4264 => 0.4227, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1344 => 0.1346, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.47% (0.0232 => 0.0217, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.63% (0.0639 => 0.0635, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1350 => 1.1305, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -29.17% (0.0024 => 0.0017, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.38% (0.7541 => 0.7645, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.76% (1.5363 => 1.5247, std.dev.: 0.0362) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 06:10:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 08:10:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928131046.852912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4343?compare_to=4340&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4343, Order: 164818, Start Time: 2012-09-28 11:57:41, End Time: 2012-09-28 13:12:21 To: 4340, Order: 164814, Start Time: 2012-09-28 10:14:28, End Time: 2012-09-28 11:28:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (690 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.05% (54.6868 => 56.3568, std.dev.: 0.0865) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.42% (2.0176 => 2.4497, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647) SingleSource/Benchmarks/Misc/flops: 16.22% (0.0826 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 11.45% (0.1013 => 0.1129) SingleSource/Benchmarks/Shootout-C++/hash2: 11.37% (0.4328 => 0.4820, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 11.22% (0.5818 => 0.6471, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.95% (1.3693 => 1.5192, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.84% (3.9660 => 4.3961, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.81% (0.7061 => 0.7824, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 10.59% (0.4062 => 0.4492, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.40% (0.7038 => 0.7770, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.40% (0.2721 => 0.3004, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.38% (0.7710 => 0.8510, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.18% (1.2193 => 1.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.10% (0.3130 => 0.3446, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.08% (0.3899 => 0.4292, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.06% (1.9828 => 2.1822, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.01% (0.3485 => 0.3834, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2760 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.95% (0.4390 => 0.4827, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.94% (1.4563 => 1.6010, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.91% (0.3107 => 0.3415, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.90% (0.5265 => 0.5786, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.88% (0.9199 => 1.0108, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.86% (0.6959 => 0.7645, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 9.84% (0.3293 => 0.3617, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.72% (0.3756 => 0.4121, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.66% (1.1364 => 1.2462, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 9.64% (13.8202 => 15.1518, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.61% (0.4016 => 0.4402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.57% (0.3868 => 0.4238, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.52% (0.3192 => 0.3496, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.50% (0.6283 => 0.6880, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.41% (0.3453 => 0.3778, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.08% (1.0313 => 1.1249, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.02% (0.4791 => 0.5223, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.79% (0.5577 => 0.6067, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.72% (0.4379 => 0.4761, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.66% (1.1061 => 1.2019, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.65% (0.2127 => 0.2311, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.42% (7.2180 => 7.8259, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.40% (3.6692 => 3.9774, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.34% (0.2914 => 0.3157, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.33% (0.6576 => 0.7124, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.33% (0.8310 => 0.9002, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 8.25% (3.8646 => 4.1836, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 8.21% (0.7506 => 0.8122, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 8.09% (16.6129 => 17.9570, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3755 => 0.4058, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.06% (0.7460 => 0.8061, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 8.04% (0.3220 => 0.3479, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.04% (0.5637 => 0.6090, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.98% (0.8698 => 0.9392, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 7.98% (3.1889 => 3.4433, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 7.87% (0.6744 => 0.7275, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.2925 => 0.3154, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.71% (0.2023 => 0.2179, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.65% (2.1791 => 2.3457, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 7.61% (1.0594 => 1.1400, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.59% (1.9270 => 2.0733, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 7.58% (0.1478 => 0.1590, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.52% (1.3245 => 1.4241, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 7.46% (14.8535 => 15.9615, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 7.44% (1.2749 => 1.3697, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3578 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.19% (8.4961 => 9.1068, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.13% (0.8818 => 0.9447, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.10% (0.3789 => 0.4058, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.4113 => 0.4405, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.08% (0.3601 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.07% (0.6135 => 0.6569, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.06% (0.2140 => 0.2291, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.00% (4.4433 => 4.7544, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (1.1333 => 1.2126, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.00% (0.3245 => 0.3472, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.99% (1.3813 => 1.4779, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.98% (1.2292 => 1.3150, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.94% (4.3801 => 4.6842, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 6.93% (0.3131 => 0.3348, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.89% (1.3819 => 1.4771, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 6.82% (0.2859 => 0.3054, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.75% (0.3511 => 0.3748, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (13.2842 => 14.1782, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 6.72% (4.6629 => 4.9763, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 6.57% (14.5298 => 15.4837, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 6.50% (6.5754 => 7.0031, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.6250 => 0.6636, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.17% (3.2742 => 3.4762, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.12% (0.2321 => 0.2463, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.4805 => 0.5095, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.75% (4.9865 => 5.2734, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.72% (0.9108 => 0.9629, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.53% (1.5188 => 1.6028, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.33% (2.1007 => 2.2127, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 5.28% (3.7467 => 3.9445, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.2008 => 0.2112, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (6.2785 => 6.5938, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 4.54% (33.2944 => 34.8044, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 3.34% (16.2614 => 16.8040, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2530, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (3.1736 => 3.4178, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7252, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.94% (10.7476 => 11.0633, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5878, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5942, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2244, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (22.5627 => 22.0619, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.63% (1.2308 => 1.0876, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2658, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3056, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.34% (1.7688 => 1.7097, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -2.73% (3.0263 => 2.9436, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4791, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9306, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7046, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2423, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2242, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1444, std.dev.: 0.0335) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2500, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8695, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: -1.15% (4.4810 => 4.4294, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 06:21:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 08:21:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928132105.AA9502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4344?compare_to=4341&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4344, Order: 164818, Start Time: 2012-09-28 12:03:00, End Time: 2012-09-28 13:22:40 To: 4341, Order: 164814, Start Time: 2012-09-28 10:14:16, End Time: 2012-09-28 11:34:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (150 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (701 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.08% (8.2080 => 8.1193, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5770 => 0.5772, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -0.07% (16.0786 => 16.0672, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 0.24% (14.9297 => 14.9659, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 0.52% (83.2251 => 83.6585, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.3513 => 4.3562, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2364 => 1.2374, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.34% (7.5146 => 7.5398, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.30% (3.7095 => 3.7208, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.63% (0.6468 => 0.6509, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1431 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0647 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.28% (63.2438 => 83.6585, std.dev.: 0.0047) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14240.97% (0.0720 => 10.3255, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.34% (10.3673 => 15.0675, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 29.04% (0.1622 => 0.2093, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.32% (2.2022 => 2.5395, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.10% (7.0540 => 8.1193, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.08% (1.1194 => 1.2658, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.89% (1.7609 => 1.9878, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.16% (10.4361 => 11.3916, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/power/power: 8.68% (0.1440 => 0.1565, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.47% (0.3177 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.46% (0.1655 => 0.1795, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.34% (9.4845 => 10.2756, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.30% (0.4879 => 0.5284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3307 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.81% (0.2700 => 0.2911, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.76% (0.7433 => 0.8010, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.72% (5.7591 => 6.2038, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.65% (0.7115 => 0.7659, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6675 => 0.7185, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.51% (0.3423 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.4615 => 0.4961, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.46% (0.3109 => 0.3341, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2554 => 0.2743, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.40% (0.2271 => 0.2439, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.37% (0.1695 => 0.1820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (8.1363 => 8.7327, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.28% (0.1510 => 0.1620, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.26% (4.2646 => 4.5741, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 7.22% (3.3354 => 3.5762, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.13% (1.5415 => 1.6514, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.10% (1.3050 => 1.3976, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.03% (0.5860 => 0.6272, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.8172 => 0.8735, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.86% (4.9449 => 5.2841, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.85% (5.0018 => 5.3445, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3422 => 0.3655, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.75% (0.5569 => 0.5945, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.70% (0.1940 => 0.2070, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.69% (0.2107 => 0.2248, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.67% (0.8067 => 0.8605, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.60% (0.3121 => 0.3327, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.59% (0.7835 => 0.8351, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.56% (0.2758 => 0.2939, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.41% (0.5020 => 0.5342, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.41% (0.3650 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1861 => 1.2621, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.39% (1.1642 => 1.2386, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 6.38% (1.5603 => 1.6599, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.6456 => 0.6866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.34% (0.4103 => 0.4363, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.27% (0.4064 => 0.4319, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.27% (0.3092 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.26% (0.3865 => 0.4107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.26% (0.4203 => 0.4466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4289 => 0.4557, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.25% (0.3826 => 0.4065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.24% (0.9765 => 1.0374, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.3180 => 0.3377, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3441 => 0.3654, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 6.17% (1.0722 => 1.1384, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.13% (3.8723 => 4.1096, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.11% (7.9617 => 8.4483, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2603 => 0.2762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4636 => 0.4918, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 6.08% (0.2831 => 0.3003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.07% (0.3098 => 0.3286, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3603 => 0.3821, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3162 => 0.3352, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.01% (2.0665 => 2.1906, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 6.00% (0.4299 => 0.4557, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 5.99% (0.3387 => 0.3590, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (0.4620 => 0.4895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.93% (0.4048 => 0.4288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3283 => 0.3477, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.88% (21.9371 => 23.2264, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.73% (0.3684 => 0.3895, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.67% (2.0273 => 2.1423, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.67% (0.3935 => 0.4158, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6450 => 0.6801, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.39% (0.8921 => 0.9402, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.33% (2.2969 => 2.4194, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.03% (1.5859 => 1.6657, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.5981 => 0.6279, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (14.3668 => 15.0707, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.80% (2.2024 => 2.3082, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.4186 => 1.4865, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.1840 => 1.2356, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2842 => 1.3393, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.12% (0.3131 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.3427 => 0.3549, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.48% (0.8101 => 0.8383, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6036, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.12% (3.8922 => 3.9748, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7666, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3482, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.52% (0.9540 => 0.9685, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2424, std.dev.: 0.0314) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7990, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5837, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2704, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.97% (5.3855 => 3.9330, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.56% (5.3526 => 3.9307, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2063, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.98% (2.9384 => 2.6159, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -8.35% (22.1758 => 20.3231, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.66% (1.2373 => 1.0930, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2874, std.dev.: 0.1283) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4999, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0880, std.dev.: 0.0305) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0060, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2515, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.76% (8.6802 => 8.5273, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2361, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.38% (0.5229 => 0.5772, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.19% (14.9895 => 16.0672, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 5.73% (14.1553 => 14.9659, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 5.98% (4.1105 => 4.3562, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.00% (1.1048 => 1.2374, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.33% (7.1582 => 7.5398, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.45% (3.4629 => 3.7208, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.61% (0.6222 => 0.6509, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 07:33:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 09:33:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928143329.E63222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4345?compare_to=4339&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4345, Order: 164818, Start Time: 2012-09-28 11:51:23, End Time: 2012-09-28 14:35:05 To: 4339, Order: 164813, Start Time: 2012-09-28 08:38:59, End Time: 2012-09-28 11:22:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (763 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.31% (2.0677 => 2.1155, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.2285 => 0.2182, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 10.16% (1.5932 => 1.7551, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3446 => 0.3785, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.70% (0.3465 => 0.3801, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.69% (0.3488 => 0.3826, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3442 => 0.3775, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3496 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.57% (0.3469 => 0.3801, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.54% (0.3460 => 0.3790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.45% (0.3650 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.36% (0.3643 => 0.3984, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.18% (0.3724 => 0.4066, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5826 => 0.6308, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.5889 => 0.6374, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.41% (0.1619 => 0.1739, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (1.6211 => 1.7351, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2875 => 0.3076, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (1.3152 => 1.4067, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.89% (0.7171 => 0.7665, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (0.4361 => 0.4661, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.73% (0.3195 => 0.3410, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.70% (3.5627 => 3.8013, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.59% (0.3004 => 0.3202, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.58% (0.2813 => 0.2998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2738 => 0.2918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.56% (0.2729 => 0.2908, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 6.51% (0.2750 => 0.2929, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.49% (0.2803 => 0.2985, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.49% (0.9909 => 1.0552, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.48% (0.2823 => 0.3006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2792 => 0.2972) SingleSource/Benchmarks/Shootout-C++/matrix: 6.40% (0.2780 => 0.2958, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (2.0673 => 2.1992, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.37% (0.4994 => 0.5312, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.37% (0.3267 => 0.3475, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.35% (0.3258 => 0.3465, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.33% (0.2811 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.3096 => 0.3292, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (0.5000 => 0.5314, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.27% (0.3060 => 0.3252, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.20% (5.5417 => 5.8853, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 6.18% (1.0781 => 1.1447, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.2911 => 0.3090, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.12% (0.3678 => 0.3903, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.11% (0.3124 => 0.3315, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (0.3930 => 0.4170, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3362 => 0.3567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.09% (0.3317 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.06% (0.3282 => 0.3481, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 6.06% (23.5202 => 24.9446, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (0.3625 => 0.3842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.97% (0.3348 => 0.3548, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (4.4195 => 4.6803, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (2.7292 => 2.8889, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 5.85% (0.3726 => 0.3944, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.85% (0.2566 => 0.2716, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.84% (0.3477 => 0.3680, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.81% (0.4251 => 0.4498, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.77% (0.2736 => 0.2894, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.73% (4.2109 => 4.4522, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4146 => 0.4382, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.58% (0.3690 => 0.3896, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.57% (0.5026 => 0.5306, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.51% (0.3845 => 0.4057, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (0.3890 => 0.4104, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.2866 => 0.3022, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.42% (2.1013 => 2.2152, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.3981 => 0.4195, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.33% (0.5012 => 0.5279, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 5.26% (1.8794 => 1.9782, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.4139 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.22% (0.2068 => 0.2176, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.21% (4.6177 => 4.8582, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.20% (0.2040 => 0.2146, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.3084 => 0.3244, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.16% (0.6435 => 0.6767, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2737 => 0.2878, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.14% (1.4269 => 1.5003, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.05% (2.1653 => 2.2747, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.3903 => 0.4097, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 4.89% (0.3336 => 0.3499, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.5900 => 0.6188, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.80% (0.5546 => 0.5812, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.78% (0.9697 => 1.0161, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (0.4658 => 0.4878, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.71% (2.0346 => 2.1304) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.3271 => 0.3425, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (1.9966 => 2.0883, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.48% (0.7875 => 0.8228, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.2969 => 0.3102, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.47% (1.9694 => 2.0574, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 4.39% (0.4847 => 0.5060, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.22% (0.2391 => 0.2492, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.16% (0.7426 => 0.7735, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (0.5361 => 0.5565, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.55% (0.5584 => 0.5782, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.20% (0.4253 => 0.4389, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.10% (11.6398 => 12.0004, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.6926 => 4.8358, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.3498 => 0.3603, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.81% (11.9555 => 12.1720, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6621, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 4.76% (15.4430 => 16.1784, std.dev.: 0.1271) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8906, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6343, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2026, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5024, std.dev.: 0.0136) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (2.0820 => 2.1155, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4545, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2809, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5960, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5795, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.15% (17.2379 => 16.6954, std.dev.: 0.0495) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 08:51:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 10:51:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928155114.53DAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4346?compare_to=4342&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4346, Order: 164822, Start Time: 2012-09-28 14:41:42, End Time: 2012-09-28 15:52:50 To: 4342, Order: 164818, Start Time: 2012-09-28 11:35:18, End Time: 2012-09-28 12:45:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (63 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 895 (790 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.72% (8.6602 => 9.2424, std.dev.: 0.1207) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (13.0988 => 13.4464, std.dev.: 0.1241) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.58% (2.6635 => 2.7322, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 1.54% (6.9063 => 7.0128, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.31% (4.6746 => 4.7359, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.07% (22.9949 => 21.5994, std.dev.: 0.4436) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.24% (1.0087 => 1.0111, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -0.71% (0.6158 => 0.6114, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -3.13% (0.1693 => 0.1640, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.88% (0.1587 => 0.1573, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.74% (0.3096 => 0.3119, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.62% (0.2406 => 0.2391, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (0.3193 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.35% (0.2315 => 0.2323, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 0.66% (0.0454 => 0.0457, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 4.71% (0.0085 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 203.33% (0.0030 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 23.67% (0.0169 => 0.0209, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -31.61% (0.0193 => 0.0132, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.17% (0.0379 => 0.0391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.38% (0.0294 => 0.0301, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.77% (0.0282 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 2.79% (0.0179 => 0.0184, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 19.02% (0.0163 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -0.39% (0.0254 => 0.0253, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 18.77% (0.0277 => 0.0329, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1453 => 0.1449, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 0.67% (1.5178 => 1.5280, std.dev.: 0.0190) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.32% (0.1475 => 0.1426, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.25% (0.4227 => 0.4132, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.58% (0.1346 => 0.1448, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0613 => 0.0612, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.76% (0.0217 => 0.0223, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.05% (0.0635 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1305 => 1.1279, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 43.75% (0.0016 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.59% (0.0017 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.78% (0.0548 => 0.0629, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0200 => 0.0200, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7645 => 0.7661, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.98% (1.5247 => 1.6007, std.dev.: 0.0066) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.87% (4.1772 => 3.0964, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.11% (0.6410 => 0.6994, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 8.77% (2.1763 => 2.3671, std.dev.: 0.0320) SingleSource/Benchmarks/Misc-C++/bigfib: 7.57% (0.5309 => 0.5711, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.01% (0.3582 => 0.3833, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 6.84% (0.6173 => 0.6595, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 6.83% (1.0046 => 1.0732, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 6.12% (0.3217 => 0.3414, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.99% (1.1653 => 1.2351, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.72% (0.2552 => 0.2698, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 5.62% (15.3105 => 16.1711, std.dev.: 0.0624) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.6915 => 0.7277, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.91% (0.7639 => 0.8014, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (12.6413 => 13.2342, std.dev.: 0.0891) MultiSource/Applications/d/make_dparser: 4.67% (3.0225 => 3.1636, std.dev.: 0.0249) MultiSource/Applications/Burg/burg: 4.64% (1.1440 => 1.1971, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: 4.54% (29.3170 => 30.6484, std.dev.: 0.1311) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.33% (0.2654 => 0.2769, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.01% (1.5150 => 1.5758, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.00% (0.4248 => 0.4418, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.3062 => 0.3182, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.89% (4.7455 => 4.9299, std.dev.: 0.0372) MultiSource/Applications/siod/siod: 3.71% (2.0972 => 2.1750, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.61% (0.2797 => 0.2898, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.54% (13.3238 => 13.7959, std.dev.: 0.1017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4562 => 0.4705, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.0689 => 1.1021, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.6079 => 15.0247, std.dev.: 0.0219) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (8.2186 => 8.4481, std.dev.: 0.0695) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.77% (0.8569 => 0.8806, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 2.75% (3.5980 => 3.6971, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.4908 => 6.6659, std.dev.: 0.0495) MultiSource/Applications/JM/lencod/lencod: 2.59% (14.7256 => 15.1075, std.dev.: 0.0891) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (4.0318 => 4.1354, std.dev.: 0.0281) MultiSource/Applications/hbd/hbd: 2.56% (1.3268 => 1.3608, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.4880 => 0.5001, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.5963 => 0.6108, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 14.83% (1.7426 => 2.0010, std.dev.: 0.0348) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.52% (0.0917 => 0.1041, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5516, std.dev.: 0.0497) SingleSource/Benchmarks/McGill/queens: 10.91% (1.6261 => 1.8035, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Puzzle: 10.61% (0.1433 => 0.1585, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.10% (0.2857 => 0.3117, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 8.82% (7.0025 => 7.6198, std.dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.29% (1.0063 => 1.0897, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (0.3301 => 0.3516, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.76% (40.4792 => 42.8096, std.dev.: 0.4302) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 4.18% (15.2242 => 15.8612, std.dev.: 0.0386) SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.6308 => 0.6549, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 3.24% (3.8907 => 4.0169, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8995, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8095, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.67% (4.6127 => 4.7359, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.50% (2.6656 => 2.7322, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6325, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.18% (0.5876 => 0.6004, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4013 => 2.4508, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.4184 => 1.4337, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.64% (0.3497 => 0.2041, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.86% (5.2665 => 4.1155, std.dev.: 0.0675) SingleSource/Benchmarks/Shootout-C++/ary3: -20.08% (1.7473 => 1.3964, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.46% (1.1647 => 0.9614, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.06% (15.8312 => 13.4464, std.dev.: 0.1241) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0635) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.99% (1.4034 => 1.2773, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.45% (3.2007 => 2.9622, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -7.15% (7.6833 => 7.1342, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3761, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3339, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8734, std.dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.34% (1.4021 => 1.3132, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/richards_benchmark: -6.20% (1.4441 => 1.3546, std.dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: -6.09% (3.4230 => 3.2145, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7926, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9222, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout/fib2: -5.19% (4.4195 => 4.1903, std.dev.: 0.0343) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.08% (1.2722 => 1.2203, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: -4.07% (2.5166 => 2.4141, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/methcall: -3.82% (9.2503 => 8.8974, std.dev.: 0.0628) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.13% (1.2959 => 1.2553, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.08% (3.9413 => 3.8201, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -2.27% (29.5232 => 28.8539, std.dev.: 0.0237) MultiSource/Applications/JM/lencod/lencod: -2.22% (6.7458 => 6.5958, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.08% (3.7496 => 3.6715, std.dev.: 0.0259) MultiSource/Applications/aha/aha: -2.02% (3.4286 => 3.3592, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4178, std.dev.: 0.0261) MultiSource/Benchmarks/PAQ8p/paq8p: -1.74% (92.7467 => 91.1286, std.dev.: 0.1597) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.71% (2.3569 => 2.3165, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2334, std.dev.: 0.0298) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7924, std.dev.: 0.1353) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.35% (1.8739 => 1.8486, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.33% (2.8964 => 2.8580, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.31% (0.9980 => 1.0111, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.53% (0.6022 => 0.6114, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -1.56% (0.1666 => 0.1640, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.22% (0.1554 => 0.1573, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (0.3083 => 0.3119, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2394 => 0.2391, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.57% (0.3175 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.91% (0.2302 => 0.2323, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 1.78% (0.0449 => 0.0457, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.92% (0.0240 => 0.0209, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -31.25% (0.0192 => 0.0132, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 3.95% (0.0177 => 0.0184, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.40% (0.1429 => 0.1449, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.74% (1.5019 => 1.5280, std.dev.: 0.0190) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.00% (0.1501 => 0.1426, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.10% (0.4264 => 0.4132, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.74% (0.1344 => 0.1448, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.88% (0.0232 => 0.0223, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0639 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1350 => 1.1279, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 283.33% (0.0006 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.26% (0.0637 => 0.0629, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.59% (0.7541 => 0.7661, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.19% (1.5363 => 1.6007, std.dev.: 0.0066) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 09:07:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 11:07:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928160711.A3D3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4347?compare_to=4343&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4347, Order: 164822, Start Time: 2012-09-28 14:54:10, End Time: 2012-09-28 16:08:46 To: 4343, Order: 164818, Start Time: 2012-09-28 11:57:41, End Time: 2012-09-28 13:12:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (695 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.28% (2.0176 => 2.4470, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.50% (0.5818 => 0.6487, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.28% (0.4328 => 0.4816, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.91% (1.3693 => 1.5187, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.60% (3.9660 => 4.3863, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.46% (0.4062 => 0.4487, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.2721 => 0.3001, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.28% (0.3899 => 0.4300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.21% (0.2596 => 0.2861, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 10.20% (0.7038 => 0.7756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.10% (0.3485 => 0.3837, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.06% (0.3022 => 0.3326, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.01% (0.2726 => 0.2999, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.99% (1.2193 => 1.3411, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.95% (1.9828 => 2.1801, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 9.94% (0.2937 => 0.3229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.90% (0.3130 => 0.3440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.87% (0.7710 => 0.8471, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 9.85% (0.2761 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.83% (0.3489 => 0.3832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.78% (0.3293 => 0.3615, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.77% (0.9199 => 1.0098, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.75% (0.3149 => 0.3456, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3580 => 0.3929, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.72% (0.5265 => 0.5777, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.64% (0.3756 => 0.4118, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.61% (0.6959 => 0.7628, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.57% (1.1364 => 1.2451, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.46% (0.4016 => 0.4396, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.42% (0.6283 => 0.6875, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.42% (1.4563 => 1.5935, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.3868 => 0.4232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.38% (13.8202 => 15.1165, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 9.35% (0.3453 => 0.3776, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.13% (0.4390 => 0.4791, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 9.08% (0.3534 => 0.3855, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.91% (1.0313 => 1.1232, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.85% (0.4791 => 0.5215, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.75% (0.3246 => 0.3530, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.64% (0.5577 => 0.6059, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4379 => 0.4745, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.27% (1.1061 => 1.1976, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 8.27% (0.8310 => 0.8997) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.22% (7.2180 => 7.8115, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 8.22% (0.7506 => 0.8123, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.15% (3.6692 => 3.9683, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.11% (0.6576 => 0.7109, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.06% (0.2914 => 0.3149, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.04% (0.5637 => 0.6090, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 7.99% (3.8646 => 4.1735, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 7.99% (16.6129 => 17.9405, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3755 => 0.4055, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.90% (3.1889 => 3.4409, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.89% (0.8698 => 0.9384, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.86% (0.2023 => 0.2182, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.82% (0.7460 => 0.8043, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 7.81% (0.6744 => 0.7271, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3220 => 0.3471, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.66% (0.2925 => 0.3149, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 7.65% (2.1791 => 2.3458, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 7.61% (1.0594 => 1.1400, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.38% (0.8818 => 0.9469, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.38% (1.9270 => 2.0692, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.34% (1.3245 => 1.4217, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.25% (14.8535 => 15.9300, std.dev.: 0.0151) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 7.13% (1.2749 => 1.3658, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.10% (0.3578 => 0.3832, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.98% (8.4961 => 9.0891, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.96% (0.3245 => 0.3471, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.95% (0.3914 => 0.4186, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/parameter-passing: 6.94% (0.4003 => 0.4281, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.93% (0.6135 => 0.6560, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.91% (1.3819 => 1.4774, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.90% (0.3131 => 0.3347, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.89% (4.3801 => 4.6818, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4764, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 6.88% (0.4113 => 0.4396, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 6.87% (1.2292 => 1.3137, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3601 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.83% (4.4433 => 4.7468, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3789 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.77% (0.3650 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.76% (1.1333 => 1.2099, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.74% (4.6629 => 4.9773, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.69% (0.3511 => 0.3746, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3663 => 0.3908, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (13.2842 => 14.1690, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.2140 => 0.2282, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.2859 => 0.3048, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3623 => 0.3862, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.48% (14.5298 => 15.4709, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.43% (0.2504 => 0.2665, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.36% (6.5754 => 6.9937, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.6250 => 0.6636, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.15% (3.2742 => 3.4756, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.4805 => 0.5086, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.68% (4.9865 => 5.2696, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (0.9108 => 0.9616, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.43% (1.5188 => 1.6013, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.19% (3.7467 => 3.9413, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.06% (2.1007 => 2.2070, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.2008 => 0.2109, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (6.2785 => 6.5719, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 4.54% (33.2944 => 34.8055, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 3.28% (16.2614 => 16.7949, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.12% (1.0895 => 1.3632, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4168, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.01% (1.2998 => 1.3779, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7238, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.94% (10.7476 => 11.0639, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5890, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5830, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2239, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5858, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.17% (0.4657 => 0.3904, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.33% (22.5627 => 22.0381, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2308 => 1.0938, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2685, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.92% (1.3780 => 1.2964, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.82% (3.0263 => 2.9410, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.25% (1.9762 => 1.9317, std.dev.: 0.0096) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7098, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2451, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2265, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1444, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 09:12:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 11:12:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928161213.437AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4348?compare_to=4344&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4348, Order: 164822, Start Time: 2012-09-28 14:53:59, End Time: 2012-09-28 16:13:49 To: 4344, Order: 164818, Start Time: 2012-09-28 12:03:00, End Time: 2012-09-28 13:22:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (54.8243 => 56.4230, std.dev.: 0.0598) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5772 => 0.5767, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -0.26% (16.0672 => 16.0248, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: -0.24% (14.9659 => 14.9293, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -0.14% (83.6585 => 83.5451, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: -0.23% (4.3562 => 4.3461, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.2374 => 1.2348, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.11% (7.5398 => 7.5313, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.25% (3.7208 => 3.7114, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.14% (0.6509 => 0.6500, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 32.10% (63.2438 => 83.5451, std.dev.: 0.0050) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.75% (0.0720 => 10.3203, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.49% (10.3673 => 14.9794, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: 28.85% (0.1622 => 0.2090, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.08% (2.2022 => 2.5342, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.88% (7.0540 => 8.1033, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 13.97% (0.1432 => 0.1632, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.18% (1.1194 => 1.2669, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.67% (1.7609 => 1.9840, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.48% (0.1584 => 0.1750, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.93% (0.3282 => 0.3608, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.85% (0.3543 => 0.3892, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.60% (0.1625 => 0.1781, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3694 => 0.4044, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.24% (0.3927 => 0.4290, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.11% (0.3886 => 0.4240, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.81% (0.3177 => 0.3457, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.65% (10.4361 => 11.3392, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.40% (0.1655 => 0.1794, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.26% (9.4845 => 10.2676, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.99% (0.6030 => 0.6512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.67% (0.7433 => 0.8003, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6675 => 0.7185, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.62% (0.7115 => 0.7657, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.56% (0.2700 => 0.2904, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 7.45% (5.7591 => 6.1882, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 7.43% (0.3109 => 0.3340, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.16% (0.3423 => 0.3668, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.13% (0.2271 => 0.2433, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (0.4615 => 0.4942, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 7.07% (0.7326 => 0.7844, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.04% (8.1363 => 8.7091, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.02% (0.1510 => 0.1616, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.01% (1.5415 => 1.6496, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.99% (0.5105 => 0.5462, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.99% (3.3354 => 3.5686, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3960, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (4.2646 => 4.5616, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.89% (0.5860 => 0.6264, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.88% (0.2107 => 0.2252, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.4103 => 0.4385, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.8172 => 0.8722, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.66% (0.8067 => 0.8604, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.63% (4.9449 => 5.2728, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.63% (5.0018 => 5.3334, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.54% (0.5569 => 0.5933, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3121 => 0.3323, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.41% (0.5020 => 0.5342, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.30% (0.2905 => 0.3088) MultiSource/Applications/spiff/spiff: 6.29% (0.7835 => 0.8328, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.25% (0.3826 => 0.4065, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.24% (0.2758 => 0.2930, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.22% (1.5603 => 1.6574, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (1.1861 => 1.2598, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 6.21% (0.3092 => 0.3284, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.21% (0.9765 => 1.0371, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.4064 => 0.4316, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.6456 => 0.6855, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.13% (1.0722 => 1.1379, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.11% (1.1642 => 1.2353, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.07% (0.3162 => 0.3354, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 6.04% (3.8723 => 4.1060, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2603 => 0.2760, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 6.02% (0.3387 => 0.3591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.02% (0.4289 => 0.4547, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.99% (0.3441 => 0.3647, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4203 => 0.4453, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.95% (0.3650 => 0.3867, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.87% (0.3098 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.87% (0.2725 => 0.2885, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3865 => 0.4091, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.80% (0.3052 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.79% (0.2831 => 0.2995, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/09-vor/vor: 5.79% (0.3180 => 0.3364, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4620 => 0.4885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2872 => 0.3036, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (7.9617 => 8.4156, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/except: 5.68% (0.2871 => 0.3034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.67% (0.2714 => 0.2868, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4636 => 0.4899, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.64% (21.9371 => 23.1753, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3232 => 0.3414, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.61% (2.0273 => 2.1410, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 5.61% (0.3603 => 0.3805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (2.0665 => 2.1822, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: 5.58% (0.4048 => 0.4274, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3935 => 0.4154, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.51% (0.2793 => 0.2947, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.51% (0.3684 => 0.3887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2802 => 0.2952, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.26% (2.2969 => 2.4178, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6450 => 0.6789, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8921 => 0.9384, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.11% (1.5859 => 1.6669, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (14.3668 => 15.0503, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (2.2024 => 2.3056, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5981 => 0.6261, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.4186 => 1.4840, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.39% (1.1840 => 1.2360, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2842 => 1.3351, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.3131 => 0.3250, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.8101 => 0.8351, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.41% (17.1811 => 17.5948, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.19% (3.8922 => 3.9775, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4512, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.74% (1.1396 => 1.2164, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (3.6395 => 3.7727, std.dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (4.2280 => 4.3493, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2295, std.dev.: 0.0244) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5797, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2644, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.19% (5.3855 => 3.9214, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.79% (5.3526 => 3.9186, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1692, std.dev.: 0.0257) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.95% (2.9384 => 2.6166, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -8.39% (22.1758 => 20.3151, std.dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.98% (1.2373 => 1.0891, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2503, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7115, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1614, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4962, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3296, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9906, std.dev.: 0.0232) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.95% (8.6802 => 8.5109, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: -1.73% (12.4730 => 12.2566, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.71% (10.2830 => 10.1076, std.dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.29% (0.5229 => 0.5767, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 6.91% (14.9895 => 16.0248, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 5.47% (14.1553 => 14.9293, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 5.73% (4.1105 => 4.3461, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.77% (1.1048 => 1.2348, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (7.1582 => 7.5313, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.18% (3.4629 => 3.7114, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.47% (0.6222 => 0.6500, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 10:18:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 12:18:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928171806.745E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4349?compare_to=4346&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4349, Order: 164824, Start Time: 2012-09-28 16:09:07, End Time: 2012-09-28 17:19:43 To: 4346, Order: 164822, Start Time: 2012-09-28 14:41:42, End Time: 2012-09-28 15:52:50 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (78 on baseline) Performance Improvements: 2 (42 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 890 (771 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.02% (0.4406 => 0.4627, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 1.98% (1.9026 => 1.9403, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.3078 => 4.3779, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (3.1531 => 3.2004, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (1.4052 => 1.4238, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.11% (1.5758 => 1.5933, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.70% (21.5994 => 24.3425, std.dev.: 1.0504) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.80% (0.7568 => 0.8158, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ffbench: 3.00% (1.3747 => 1.4159, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.61% (44.4283 => 43.2697, std.dev.: 0.3514) SingleSource/Benchmarks/McGill/chomp: -1.63% (1.0233 => 1.0066, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.22% (1.0111 => 1.0133, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 0.51% (0.6114 => 0.6145, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 2.87% (0.1640 => 0.1687, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.10% (0.1573 => 0.1540, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.87% (0.3119 => 0.3092, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.54% (0.2391 => 0.2404, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.59% (0.3225 => 0.3206, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.29% (0.2323 => 0.2293, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -2.19% (0.0457 => 0.0447, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -24.72% (0.0089 => 0.0067, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.35% (0.0209 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 43.18% (0.0132 => 0.0189, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.53% (0.0391 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -11.15% (0.0287 => 0.0255, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0325 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -4.35% (0.0184 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -5.67% (0.0194 => 0.0183, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.98% (0.0253 => 0.0248, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.82% (0.0329 => 0.0323, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1449 => 0.1441, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -0.90% (1.5280 => 1.5142, std.dev.: 0.0151) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.24% (0.1426 => 0.1458, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.38% (0.4132 => 0.4075, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.52% (0.1448 => 0.1397, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.27% (0.0612 => 0.0592, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.18% (0.0223 => 0.0178, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.08% (0.0648 => 0.0641, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1279 => 1.1305, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -47.83% (0.0023 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.81% (0.0629 => 0.0561, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.50% (0.0200 => 0.0163, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.7661 => 0.7649, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.02% (1.6007 => 1.6011, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.24% (0.0121 => 0.0059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.20% (4.1772 => 3.0829, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/except: 82833.33% (0.0006 => 0.4976, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.67% (0.0745 => 0.0899, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.61% (0.1414 => 0.1564, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.63% (0.1159 => 0.1259, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 8.43% (2.1763 => 2.3597, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.03% (0.6410 => 0.6925, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 7.72% (0.5309 => 0.5719, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.2552 => 0.2722, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.53% (0.6173 => 0.6576, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 6.15% (1.1653 => 1.2370, std.dev.: 0.0127) MultiSource/Applications/lemon/lemon: 5.83% (1.0046 => 1.0632, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.58% (0.3582 => 0.3782, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.43% (15.3105 => 16.1416, std.dev.: 0.0456) MultiSource/Applications/lambda-0_1_3/lambda: 5.42% (0.6915 => 0.7290, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (1.5150 => 1.5933, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 4.79% (0.3217 => 0.3371, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 4.75% (1.3268 => 1.3898, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.73% (0.4248 => 0.4449, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.52% (0.7639 => 0.7984, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (12.6413 => 13.1592, std.dev.: 0.0878) MultiSource/Benchmarks/Bullet/bullet: 4.09% (29.3170 => 30.5165, std.dev.: 0.1996) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (3.0758 => 3.2004, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.2797 => 0.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.77% (0.6069 => 0.6298, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.59% (0.3062 => 0.3172, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (1.1827 => 1.2243, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.40% (0.5937 => 0.6139, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.34% (1.1440 => 1.1822, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 3.22% (1.8798 => 1.9403, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.2186 => 8.4747, std.dev.: 0.0156) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.11% (6.2546 => 6.4493, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.99% (1.4408 => 1.4839, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0821 => 1.1115, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5636 => 0.5788, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (4.0318 => 4.1400, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.4880 => 0.5006, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8405 => 0.8619, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.4113 => 1.4462, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.44% (0.8569 => 0.8778, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.7226 => 0.7402, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.34% (1.0689 => 1.0939, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.5963 => 0.6098, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.25% (4.2815 => 4.3779, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (1.3935 => 1.4238, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.0317 => 2.0740, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (4.2616 => 4.3327, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.3380 => 4.4100, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (8.2559 => 8.3622, std.dev.: 0.0281) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.89% (0.0261 => 0.0386, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 40.95% (1.6538 => 2.3311, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0154) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.12% (0.0917 => 0.1074, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.32% (0.0766 => 0.0891, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 14.97% (21.1721 => 24.3425, std.dev.: 1.0504) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.28% (4.0101 => 4.5425, std.dev.: 0.0620) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 9.21% (0.1433 => 0.1565, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 9.13% (7.0025 => 7.6421, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.83% (1.0063 => 1.0851, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.22% (0.7609 => 0.8158, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.73% (40.4792 => 42.7972, std.dev.: 0.1811) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8472, std.dev.: 0.0606) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.05% (4.2129 => 4.3834, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/dt: 3.92% (0.9851 => 1.0237, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.75% (0.8498 => 0.8817, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8897, std.dev.: 0.0348) MultiSource/Benchmarks/sim/sim: 2.71% (3.8907 => 3.9963, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (6.6312 => 6.8090, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.64% (0.5876 => 0.6031, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.59% (2.6656 => 2.7347, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 2.11% (3.5520 => 3.6271, std.dev.: 0.0204) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4501, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.01% (0.3497 => 0.2063, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.27% (5.2665 => 4.0934, std.dev.: 0.1293) SingleSource/Benchmarks/Shootout-C++/ary3: -20.63% (1.7473 => 1.3869, std.dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.47% (1.1647 => 0.9612, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.48% (15.8312 => 13.3807, std.dev.: 0.0882) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: -8.45% (0.2664 => 0.2439, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2007 => 2.9417, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -7.21% (7.6833 => 7.1293, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3733, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.63% (2.0027 => 1.8700, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3309, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: -6.40% (1.4441 => 1.3517, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: -6.37% (3.4230 => 3.2049, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.65% (62.4126 => 58.8883, std.dev.: 0.0610) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1864, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.84% (45.4683 => 43.2697, std.dev.: 0.3514) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.45% (2.5166 => 2.4045, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/methcall: -4.45% (9.2503 => 8.8386, std.dev.: 0.0778) MultiSource/Applications/sgefa/sgefa: -4.27% (0.3746 => 0.3586, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2224, std.dev.: 0.0165) SingleSource/Benchmarks/McGill/misr: -3.28% (0.4296 => 0.4155, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.05% (3.9413 => 3.8210, std.dev.: 0.0284) MultiSource/Applications/lua/lua: -2.85% (29.5232 => 28.6823, std.dev.: 0.2558) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.73% (1.8739 => 1.8227, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.71% (3.7496 => 3.6478, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.26% (1.1683 => 1.1419, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.19% (1.0686 => 1.0452, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -1.93% (3.4286 => 3.3624, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0248) MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (92.7467 => 91.0056, std.dev.: 0.2751) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.43% (9.3855 => 9.2514, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4617, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.39% (61.1734 => 60.3232, std.dev.: 0.0850) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3129, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8097, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/chomp: -1.26% (1.0194 => 1.0066, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.53% (0.9980 => 1.0133, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.04% (0.6022 => 0.6145, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 1.26% (0.1666 => 0.1687, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.90% (0.1554 => 0.1540, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3083 => 0.3092, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.42% (0.2394 => 0.2404, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.98% (0.3175 => 0.3206, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -0.45% (0.0449 => 0.0447, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -24.72% (0.0089 => 0.0067, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.21% (0.0284 => 0.0255, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -3.17% (0.0189 => 0.0183, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1429 => 0.1441, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 0.82% (1.5019 => 1.5142, std.dev.: 0.0151) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.86% (0.1501 => 0.1458, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.43% (0.4264 => 0.4075, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1344 => 0.1397, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0589 => 0.0592, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.31% (0.0639 => 0.0641, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1350 => 1.1305, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.93% (0.0637 => 0.0561, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.74% (0.0246 => 0.0163, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.22% (1.5363 => 1.6011, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.71% (0.0070 => 0.0059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 10:45:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 12:45:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928174536.4FACA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4350?compare_to=4345&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4350, Order: 164822, Start Time: 2012-09-28 15:03:46, End Time: 2012-09-28 17:47:12 To: 4345, Order: 164818, Start Time: 2012-09-28 11:51:23, End Time: 2012-09-28 14:35:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (763 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.99% (124.7405 => 128.4745, std.dev.: 1.4071) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.24% (0.3488 => 0.3845, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.23% (0.3442 => 0.3794, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.19% (0.3446 => 0.3797, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 10.12% (1.5932 => 1.7545, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.07% (0.3465 => 0.3814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3496 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.00% (0.3460 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.95% (0.3469 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3643 => 0.4002, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 9.73% (0.3650 => 0.4005, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.72% (0.3724 => 0.4086, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5826 => 0.6328, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.5889 => 0.6391, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.41% (0.1619 => 0.1739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2875 => 0.3083, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.20% (0.7171 => 0.7687, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (1.6211 => 1.7359, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.3195 => 0.3420, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.95% (0.4361 => 0.4664, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (3.5627 => 3.8084, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.83% (0.2738 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.80% (0.2823 => 0.3015, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.79% (0.3004 => 0.3208, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.79% (1.3152 => 1.4045, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 6.76% (0.2750 => 0.2936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.74% (0.2803 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.74% (0.2729 => 0.2913, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2780 => 0.2967) SingleSource/Benchmarks/Shootout-C++/methcall: 6.72% (0.2813 => 0.3002, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.64% (0.9909 => 1.0567, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.2911 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.63% (0.2792 => 0.2977, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (2.0673 => 2.2037, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2811 => 0.2995, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.51% (0.3258 => 0.3470, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.46% (0.3267 => 0.3478, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.44% (0.3060 => 0.3257, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.3096 => 0.3294, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.35% (5.5417 => 5.8935, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 6.30% (1.0781 => 1.1460, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.28% (0.3678 => 0.3909, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (0.5000 => 0.5314, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3282 => 0.3487, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (0.3930 => 0.4175, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.22% (0.3362 => 0.3571, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (0.5026 => 0.5338, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (0.2014 => 0.2139, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.18% (0.3124 => 0.3317, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.12% (0.3348 => 0.3553, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.12% (0.3317 => 0.3520, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.07% (0.3625 => 0.3845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.04% (0.3726 => 0.3951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.01% (0.3477 => 0.3686, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.92% (4.2109 => 4.4602, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.89% (2.7292 => 2.8900, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.2736 => 0.2896, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 5.84% (23.5202 => 24.8936, std.dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 5.81% (0.2566 => 0.2715, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.77% (0.3690 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4146 => 0.4385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.76% (0.4251 => 0.4496, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.3845 => 0.4065, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (4.4195 => 4.6720, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.65% (0.3981 => 0.4206, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.45% (0.3890 => 0.4102, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.42% (0.2068 => 0.2180, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.40% (2.1013 => 2.2148, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.2866 => 0.3020, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.35% (0.6435 => 0.6779, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (1.8794 => 1.9798, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 5.33% (0.5012 => 0.5279, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.4139 => 0.4358, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.29% (0.6634 => 0.6985, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.29% (4.6177 => 4.8618, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.2737 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.25% (0.3084 => 0.3246, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.1968 => 0.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.3903 => 0.4107, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.5900 => 0.6206, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.15% (0.2040 => 0.2145, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.13% (1.4269 => 1.5001, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.08% (2.1653 => 2.2753, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: 4.95% (0.3336 => 0.3501, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.90% (0.2103 => 0.2206, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (0.4658 => 0.4886, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.81% (0.5546 => 0.5813, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 4.76% (0.9697 => 1.0159, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 4.76% (2.0346 => 2.1314, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.65% (0.3271 => 0.3423, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.65% (1.9694 => 2.0609, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.54% (1.9966 => 2.0872, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.2969 => 0.3101, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.44% (0.7875 => 0.8225, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 4.35% (0.2391 => 0.2495, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (0.4847 => 0.5054, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.24% (0.7426 => 0.7741, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (0.5361 => 0.5588, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (0.2691 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.71% (0.5584 => 0.5791, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.19% (11.6398 => 12.0112, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.6926 => 4.8366, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.56% (0.4253 => 0.4362, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.94% (11.9555 => 12.1880, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 6.36% (0.2122 => 0.2257, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.64% (15.4430 => 16.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6462, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2080, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5032, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4384, std.dev.: 0.0242) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2207, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5998, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5633, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: -10.57% (0.2402 => 0.2148, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7963, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0048) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7924, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.55% (17.2379 => 16.7980, std.dev.: 0.0348) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 10:50:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 12:50:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928175038.0CEDB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4351?compare_to=4347&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4351, Order: 164824, Start Time: 2012-09-28 16:37:31, End Time: 2012-09-28 17:52:13 To: 4347, Order: 164822, Start Time: 2012-09-28 14:54:10, End Time: 2012-09-28 16:08:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 970 (698 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.43% (2.0176 => 2.4297, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1410 => 0.1636, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.26% (0.5818 => 0.6473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.70% (0.4328 => 0.4791, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.43% (0.2781 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.06% (3.9660 => 4.3650, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 10.01% (1.3693 => 1.5063, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.98% (0.1072 => 0.1179, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2782 => 0.3059, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.87% (0.7038 => 0.7733, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.85% (0.2721 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.80% (0.4062 => 0.4460, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.60% (0.7710 => 0.8450, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.60% (0.3022 => 0.3312, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.52% (0.3899 => 0.4270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.49% (0.2760 => 0.3022, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.47% (0.3485 => 0.3815, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.44% (0.2596 => 0.2841, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.42% (1.2193 => 1.3341, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 9.41% (0.2690 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (1.9828 => 2.1686, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.34% (0.3489 => 0.3815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.30% (0.2937 => 0.3210, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.29% (0.5265 => 0.5754, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 9.24% (0.2761 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.24% (1.4563 => 1.5908, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.23% (0.3130 => 0.3419, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3293 => 0.3597, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.20% (0.2966 => 0.3239, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.19% (0.3580 => 0.3909, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.18% (0.6959 => 0.7598, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.17% (0.9199 => 1.0043, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.09% (1.1364 => 1.2397, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.09% (0.4016 => 0.4381, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.3756 => 0.4097, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 9.07% (13.8202 => 15.0731, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 9.01% (0.3107 => 0.3387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.96% (0.3149 => 0.3431, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.93% (0.6283 => 0.6844, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.84% (0.4390 => 0.4778, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.82% (0.3868 => 0.4209, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 8.66% (0.3453 => 0.3752, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.66% (0.3534 => 0.3840, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.65% (0.3192 => 0.3468, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 8.46% (1.0313 => 1.1185, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.4791 => 0.5192, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.5577 => 0.6034, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 8.15% (0.2995 => 0.3239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.12% (0.2945 => 0.3184, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (0.4379 => 0.4721, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.77% (0.8310 => 0.8956, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (3.6692 => 3.9539, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.65% (0.2914 => 0.3137, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.60% (1.1061 => 1.1902, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.59% (0.3755 => 0.4040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.57% (7.2180 => 7.7642, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 7.52% (16.6129 => 17.8618, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/gs/gs: 7.52% (3.8646 => 4.1551, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.50% (0.6576 => 0.7069, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.49% (0.5637 => 0.6059, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 7.43% (0.6744 => 0.7245, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 7.39% (0.3220 => 0.3458, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 7.37% (0.7506 => 0.8059, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.35% (0.7460 => 0.8008, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.31% (0.8698 => 0.9334, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.26% (3.1889 => 3.4205, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 7.15% (1.0594 => 1.1351, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2243 => 0.2402, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.08% (0.2925 => 0.3132, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.97% (0.2023 => 0.2164, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 6.87% (1.9270 => 2.0593, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.85% (2.1791 => 2.3283, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.76% (0.1865 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.73% (1.3245 => 1.4137, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 6.70% (1.2749 => 1.3603, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.69% (0.1569 => 0.1674, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.66% (14.8535 => 15.8428, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.60% (0.8818 => 0.9400, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.59% (0.4113 => 0.4384, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3578 => 0.3811, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.49% (1.3819 => 1.4716, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.44% (0.6135 => 0.6530, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3245 => 0.3452, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.38% (4.3801 => 4.6594, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 6.37% (8.4961 => 9.0373, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 6.36% (1.2292 => 1.3074, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.36% (4.4433 => 4.7257, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 6.31% (0.3914 => 0.4161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.28% (0.3663 => 0.3893, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 6.25% (0.4003 => 0.4253, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.23% (0.3646 => 0.3873, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (1.3813 => 1.4670, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.14% (1.1333 => 1.2029, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.11% (0.3650 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (13.2842 => 14.0935, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 6.09% (0.2859 => 0.3033, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.04% (0.3623 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.04% (0.3940 => 0.4178, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.97% (4.6629 => 4.9414, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 5.97% (0.3131 => 0.3318, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.91% (14.5298 => 15.3888, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.2140 => 0.2266, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.87% (0.3511 => 0.3717, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.81% (6.5754 => 6.9576, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 5.76% (0.6250 => 0.6610, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.71% (0.2504 => 0.2647, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.68% (3.2742 => 3.4603, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.41% (0.4805 => 0.5065, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.32% (4.9865 => 5.2517, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.30% (0.2321 => 0.2444, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (0.9108 => 0.9568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.61% (1.5188 => 1.5888, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.55% (3.7467 => 3.9170, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.18% (2.1007 => 2.1885, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (6.2785 => 6.5370, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 4.00% (33.2944 => 34.6249, std.dev.: 0.0413) MultiSource/Applications/sqlite3/sqlite3: 2.73% (16.2614 => 16.7048, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5150, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2558, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4166, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7255, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.91% (10.7476 => 11.0601, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5903, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5842, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2244, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5886, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9186, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6850, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.71% (0.4657 => 0.3879, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.60% (22.5627 => 21.9761, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.63% (1.2308 => 1.0877, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2762, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.84% (1.3780 => 1.2975, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5117, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1584, std.dev.: 0.0178) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9309, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7061, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2315, std.dev.: 0.0207) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1746, std.dev.: 0.0275) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2497, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 11:00:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 13:00:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928180038.336612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4352?compare_to=4348&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4352, Order: 164824, Start Time: 2012-09-28 16:42:35, End Time: 2012-09-28 18:02:11 To: 4348, Order: 164822, Start Time: 2012-09-28 14:53:59, End Time: 2012-09-28 16:13:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (143 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (708 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.17% (78.8083 => 81.3046, std.dev.: 0.2166) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.11% (14.9794 => 14.6635, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.50% (0.5767 => 0.5738, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.56% (16.0248 => 15.9343, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: -0.14% (14.9293 => 14.9079, std.dev.: 0.0149) MultiSource/Benchmarks/Bullet/bullet: -0.52% (83.5451 => 83.1076, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: -0.40% (4.3461 => 4.3286, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.61% (1.2348 => 1.2273, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (7.5313 => 7.5073, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.21% (3.7114 => 3.7035, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.22% (0.6500 => 0.6486, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.41% (63.2438 => 83.1076, std.dev.: 0.0143) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14229.86% (0.0720 => 10.3175, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.44% (10.3673 => 14.6635, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 28.67% (0.1622 => 0.2087, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.59% (2.2022 => 2.5234, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.01% (7.0540 => 8.0424, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 13.06% (0.1432 => 0.1619, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.65% (1.1194 => 1.2610, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.39% (0.1566 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.81% (1.7609 => 1.9689, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3543 => 0.3907, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 9.88% (0.3473 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3543 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.60% (0.3282 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.37% (0.3694 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.30% (0.3828 => 0.4184, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.3927 => 0.4288, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.06% (0.3886 => 0.4238, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.82% (10.4361 => 11.3569, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.14% (0.6030 => 0.6521, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3307 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.50% (9.4845 => 10.1954, std.dev.: 0.0142) SingleSource/UnitTests/ObjC++/property-reference: 7.40% (0.7326 => 0.7868, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.24% (0.7433 => 0.7971, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.99% (0.7115 => 0.7612, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.95% (0.3109 => 0.3325, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.94% (0.6675 => 0.7138, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 6.69% (0.3423 => 0.3652, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.63% (5.7591 => 6.1411, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 6.62% (0.2554 => 0.2723, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2271 => 0.2421, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (8.1363 => 8.6681, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.50% (4.2646 => 4.5417, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.48% (3.3354 => 3.5514, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 6.46% (0.3422 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.43% (1.5415 => 1.6406, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.42% (1.3050 => 1.3888, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.40% (0.8067 => 0.8583, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.8172 => 0.8688, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5860 => 0.6230, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.5105 => 0.5426, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5569 => 0.5918, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.20% (5.0018 => 5.3118, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.13% (4.9449 => 5.2479, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.09% (0.2905 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4289 => 0.4549, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.95% (0.4064 => 0.4306, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.93% (0.2831 => 0.2999, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.89% (0.3650 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2756 => 0.2918, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.87% (0.2758 => 0.2920, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.83% (0.4203 => 0.4448, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.82% (0.3092 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.82% (0.3865 => 0.4090, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.82% (0.7835 => 0.8291, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 5.81% (0.3098 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.80% (0.5020 => 0.5311, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.6456 => 0.6830, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3826 => 0.4044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.70% (0.3283 => 0.3470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.69% (0.3603 => 0.3808, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.68% (1.1642 => 1.2303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2802 => 0.2961, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.67% (2.0665 => 2.1836, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (0.4620 => 0.4881, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.63% (1.1861 => 1.2529, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3232 => 0.3414, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3162 => 0.3340, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.60% (1.5603 => 1.6476, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.9765 => 1.0308, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.56% (3.8723 => 4.0875, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.54% (0.4636 => 0.4893, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.4048 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.49% (0.2877 => 0.3035, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.44% (1.0722 => 1.1305, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.38% (0.3441 => 0.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3935 => 0.4145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3684 => 0.3879, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.26% (0.4299 => 0.4525, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (7.9617 => 8.3787, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 5.18% (2.0273 => 2.1323, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 5.12% (21.9371 => 23.0598, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2603 => 0.2736, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.02% (0.3387 => 0.3557, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.85% (0.6450 => 0.6763, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 4.70% (2.2969 => 2.4048, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8921 => 0.9328, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.34% (1.5859 => 1.6547, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.26% (0.5981 => 0.6236, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (14.3668 => 14.9540, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.4186 => 1.4756, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.3131 => 0.3251, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2842 => 1.3334, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.68% (1.1840 => 1.2276, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.66% (2.2024 => 2.2829, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.93% (0.8101 => 0.8338, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.72% (17.1811 => 17.4772, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.8922 => 3.9467, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.1396 => 1.2156, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (3.6395 => 3.7657, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3489, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2327, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6817, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.48% (5.2763 => 3.2458, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (5.3855 => 3.8969, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.24% (5.3526 => 3.8943, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1423, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.99% (2.9384 => 2.6154, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: -8.86% (22.1758 => 20.2114, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -12.11% (1.2373 => 1.0875, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2609, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (2.7294 => 2.5712, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1639, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5040, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5166, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0927, std.dev.: 0.0300) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0081, std.dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2505, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.73% (0.5229 => 0.5738, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.30% (14.9895 => 15.9343, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 5.32% (14.1553 => 14.9079, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: 5.31% (4.1105 => 4.3286, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.09% (1.1048 => 1.2273, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.88% (7.1582 => 7.5073, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.95% (3.4629 => 3.7035, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.24% (0.6222 => 0.6486, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 11:44:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 13:44:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928184452.87F242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4353?compare_to=4349&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4353, Order: 164827, Start Time: 2012-09-28 17:35:39, End Time: 2012-09-28 18:46:29 To: 4349, Order: 164824, Start Time: 2012-09-28 16:09:07, End Time: 2012-09-28 17:19:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (71 on baseline) Performance Improvements: 2 (46 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 891 (774 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.23% (0.1909 => 0.2028, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.98% (0.7469 => 0.7916, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.7593 => 0.7934, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.41% (1.1975 => 1.2144, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3166 => 0.3508, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.56% (2.3781 => 2.4152, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.33% (13.3807 => 13.5580, std.dev.: 0.0484) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.06% (4.6844 => 4.7340, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/viterbi/viterbi: -7.56% (0.1535 => 0.1419, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -11.59% (24.3425 => 21.5221, std.dev.: 0.6193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.11% (1.0133 => 1.0144, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.6145 => 0.6148, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: -0.41% (0.1687 => 0.1680, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.69% (0.1540 => 0.1566, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.16% (0.3092 => 0.3128, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2404 => 0.2404, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.22% (0.3206 => 0.3213, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.44% (0.2293 => 0.2326, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 1.12% (0.0447 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 29.85% (0.0067 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.41% (0.0239 => 0.0195, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0189 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0385 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0297 => 0.0290, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.80% (0.0255 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0320 => 0.0319, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0176 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 5.46% (0.0183 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0248 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.62% (0.0323 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.89% (0.1441 => 0.1385, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -3.65% (1.5142 => 1.4589, std.dev.: 0.0366) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.77% (0.1458 => 0.1513, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.12% (0.4075 => 0.4080, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.22% (0.1397 => 0.1442, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.43% (0.0592 => 0.0548, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.66% (0.0178 => 0.0213, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.01% (0.0641 => 0.0564, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1305 => 1.1261, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 120.00% (0.0005 => 0.0011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.50% (0.0561 => 0.0547, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.38% (0.0163 => 0.0206, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7649 => 0.7663, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.11% (1.6011 => 1.5994, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.71% (0.0059 => 0.0096, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.06% (4.1772 => 3.1306, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/except: 82850.00% (0.0006 => 0.4977, std.dev.: 0.0056) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 9.04% (0.5309 => 0.5789, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 8.81% (2.1763 => 2.3681, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6410 => 0.6949, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.27% (0.1414 => 0.1531, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 6.91% (1.0046 => 1.0740, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 6.61% (0.6173 => 0.6581, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 6.61% (1.1653 => 1.2423, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.15% (0.2552 => 0.2709, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 5.48% (0.6915 => 0.7294, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 5.44% (15.3105 => 16.1431, std.dev.: 0.2004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.14% (0.3582 => 0.3766, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.74% (0.7639 => 0.8001, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.63% (1.5150 => 1.5851, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (12.6413 => 13.2219, std.dev.: 0.1199) MultiSource/Applications/d/make_dparser: 4.55% (3.0225 => 3.1599, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.43% (0.2797 => 0.2921, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.38% (0.3901 => 0.4072, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.31% (29.3170 => 30.5805, std.dev.: 0.2637) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.26% (0.2654 => 0.2767, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (1.1672 => 1.2144, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 4.03% (1.3268 => 1.3803, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.4248 => 0.4414, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.86% (0.6069 => 0.6303, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 3.68% (4.7455 => 4.9201, std.dev.: 0.0549) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.56% (0.3062 => 0.3171, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.54% (13.3238 => 13.7954, std.dev.: 0.1045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.50% (4.0318 => 4.1729, std.dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.6079 => 15.1057, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.38% (3.0758 => 3.1799, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.12% (6.2546 => 6.4498, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.1827 => 1.2165, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 2.72% (3.5980 => 3.6958, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8405 => 0.8633, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.4408 => 1.4786, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.0317 => 2.0846, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.0689 => 1.0966, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.4880 => 0.5006, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.24% (14.7256 => 15.0553, std.dev.: 0.1031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8796 => 3.9588, std.dev.: 0.0225) MultiSource/Applications/treecc/treecc: 1.94% (1.8798 => 1.9163, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.2815 => 4.3616, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.84% (1.4189 => 1.4450, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/ary3: 15.10% (1.7426 => 2.0057, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.13% (4.0101 => 4.5769, std.dev.: 0.1145) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.93% (0.2857 => 0.3112, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 8.85% (7.0025 => 7.6221, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.21% (1.0063 => 1.0889, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.27% (0.3301 => 0.3508, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.33% (40.4792 => 42.2303, std.dev.: 0.5180) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8498, std.dev.: 0.0606) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.11% (2.6656 => 2.7485, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.6308 => 0.6489, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.85% (14.4877 => 14.9013, std.dev.: 0.0589) MultiSource/Benchmarks/sim/sim: 2.77% (3.8907 => 3.9984, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8098, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.63% (4.6127 => 4.7340, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/mason/mason: 2.52% (0.5004 => 0.5130, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 2.41% (3.5520 => 3.6376, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: 1.91% (2.4013 => 2.4471, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.32% (4.0659 => 4.1194, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/em3d/em3d: 1.22% (4.6414 => 4.6978, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.76% (5.2665 => 4.1203, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/ary3: -20.39% (1.7473 => 1.3910, std.dev.: 0.0273) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.56% (1.1647 => 0.9602, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.36% (15.8312 => 13.5580, std.dev.: 0.0484) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.74% (0.0917 => 0.0791, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9407, std.dev.: 0.0950) MultiSource/Applications/lambda-0_1_3/lambda: -7.13% (7.6833 => 7.1355, std.dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3759, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3334, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -6.40% (1.4441 => 1.3517, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: -6.24% (3.4230 => 3.2093, std.dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (62.4126 => 58.9195, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout/fib2: -5.19% (4.4195 => 4.1903, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/methcall: -4.92% (9.2503 => 8.7951, std.dev.: 0.0853) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -4.18% (2.5166 => 2.4115, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: -4.14% (0.3746 => 0.3591, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.86% (45.4683 => 43.7121, std.dev.: 0.5698) SingleSource/Benchmarks/McGill/misr: -3.47% (0.4296 => 0.4147, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.19% (0.4140 => 0.4008, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.07% (3.7496 => 3.6343, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8205, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.04% (1.2722 => 1.2335, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2899, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -2.53% (29.5232 => 28.7767, std.dev.: 0.1682) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.50% (0.6119 => 0.5966, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.30% (1.1683 => 1.1414, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: -2.29% (6.7458 => 6.5915, std.dev.: 0.0456) MultiSource/Benchmarks/PAQ8p/paq8p: -2.12% (92.7467 => 90.7829, std.dev.: 0.1932) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4172, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2285, std.dev.: 0.0223) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3718, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: -1.61% (1.0926 => 1.0750, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.60% (1.8739 => 1.8439, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -1.38% (3.4659 => 3.4179, std.dev.: 0.0159) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3148, std.dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4638, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.25% (2.4457 => 2.4152, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.64% (0.9980 => 1.0144, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.09% (0.6022 => 0.6148, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 0.84% (0.1666 => 0.1680, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.77% (0.1554 => 0.1566, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.46% (0.3083 => 0.3128, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.42% (0.2394 => 0.2404, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (0.3175 => 0.3213, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.04% (0.2302 => 0.2326, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0449 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.75% (0.0240 => 0.0195, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.65% (0.0301 => 0.0290, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.08% (0.1429 => 0.1385, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -2.86% (1.5019 => 1.4589, std.dev.: 0.0366) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.80% (0.1501 => 0.1513, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.32% (0.4264 => 0.4080, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.29% (0.1344 => 0.1442, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.96% (0.0589 => 0.0548, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.19% (0.0232 => 0.0213, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.74% (0.0639 => 0.0564, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.78% (1.1350 => 1.1261, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.17% (0.0024 => 0.0011, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.13% (0.0637 => 0.0547, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.26% (0.0246 => 0.0206, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.62% (0.7541 => 0.7663, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.11% (1.5363 => 1.5994, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.14% (0.0070 => 0.0096, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 12:49:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 14:49:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928194908.736AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4354?compare_to=4352&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4354, Order: 164831, Start Time: 2012-09-28 18:31:08, End Time: 2012-09-28 19:50:44 To: 4352, Order: 164824, Start Time: 2012-09-28 16:42:35, End Time: 2012-09-28 18:02:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (705 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (14.6635 => 14.9298, std.dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.24% (0.5738 => 0.5752, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.29% (15.9343 => 15.9801, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: -0.19% (14.9079 => 14.8794, std.dev.: 0.0177) MultiSource/Benchmarks/Bullet/bullet: -0.31% (83.1076 => 82.8535, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 0.18% (4.3286 => 4.3364, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.23% (1.2273 => 1.2301, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.28% (7.5073 => 7.5281, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.27% (3.7035 => 3.7135, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.02% (0.6486 => 0.6487, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 31.01% (63.2438 => 82.8535, std.dev.: 0.0105) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14238.47% (0.0720 => 10.3237, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.01% (10.3673 => 14.9298, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 28.73% (0.1622 => 0.2088, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.29% (2.2022 => 2.5168, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (7.0540 => 8.0588, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 13.62% (0.1432 => 0.1627, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.71% (0.1566 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.49% (1.1194 => 1.2592, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.97% (1.7609 => 1.9717, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.44% (0.3473 => 0.3801, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.27% (0.3561 => 0.3891, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.23% (0.3543 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3543 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.18% (0.3497 => 0.3818, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3694 => 0.4033, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.10% (0.3516 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.83% (0.3828 => 0.4166, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.73% (0.3927 => 0.4270, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.62% (0.3886 => 0.4221, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.36% (10.4361 => 11.3081, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.87% (9.4845 => 10.2309, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.83% (0.3307 => 0.3566, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.77% (0.4879 => 0.5258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5925 => 0.6385, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.61% (0.6030 => 0.6489, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.37% (0.3109 => 0.3338, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.27% (0.6675 => 0.7160, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7433 => 0.7962, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.10% (0.7115 => 0.7620, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.03% (5.7591 => 6.1637, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.96% (0.2700 => 0.2888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7326 => 0.7832, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.88% (3.3354 => 3.5649, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.88% (0.5105 => 0.5456) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3423 => 0.3656, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4615 => 0.4927, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/em3d/em3d: 6.67% (0.1695 => 0.1808, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.62% (1.5415 => 1.6435, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.57% (1.3050 => 1.3907, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.53% (4.2646 => 4.5432, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.48% (0.5860 => 0.6240, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (8.1363 => 8.6639, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.37% (0.8067 => 0.8581, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.37% (0.3422 => 0.3640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (5.0018 => 5.3178, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.30% (0.2891 => 0.3073, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.21% (4.9449 => 5.2520, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.8172 => 0.8678, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4289 => 0.4550, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6456 => 0.6847, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.02% (0.4103 => 0.4350, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.2905 => 0.3079, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.98% (0.3865 => 0.4096, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.98% (0.5020 => 0.5320, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.93% (0.7835 => 0.8300, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.4064 => 0.4303, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.88% (1.5603 => 1.6520, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.78% (0.4203 => 0.4446, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.78% (0.4636 => 0.4904, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.77% (1.1642 => 1.2314, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.76% (1.1861 => 1.2544, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.76% (0.9765 => 1.0327, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.75% (0.3650 => 0.3860, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.75% (0.3098 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2872 => 0.3035, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 5.66% (1.0722 => 1.1329, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 5.64% (0.2871 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.62% (0.2756 => 0.2911, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.61% (0.3136 => 0.3312, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4620 => 0.4879, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.60% (0.3052 => 0.3223, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3826 => 0.4040, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 5.59% (3.8723 => 4.0886, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.57% (0.3162 => 0.3338, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.56% (2.0665 => 2.1815, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.4048 => 0.4272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.52% (0.3603 => 0.3802, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3935 => 0.4152, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.49% (0.3441 => 0.3630, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.3283 => 0.3463, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.46% (7.9617 => 8.3967, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: 5.46% (0.3387 => 0.3572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2802 => 0.2955, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3684 => 0.3885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.44% (0.2793 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.42% (0.2877 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.41% (21.9371 => 23.1236, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.23% (0.4299 => 0.4524, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.21% (2.0273 => 2.1329, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 5.18% (0.3379 => 0.3554, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.95% (0.6450 => 0.6769, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.8921 => 0.9351, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.81% (2.2969 => 2.4073, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.66% (1.5859 => 1.6598, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.43% (0.5981 => 0.6246, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.36% (1.4186 => 1.4805, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (14.3668 => 14.9800, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.23% (2.2024 => 2.2955, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 3.89% (1.1840 => 1.2300, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2842 => 1.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.8101 => 0.8328, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.90% (17.1811 => 17.5080, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (3.8922 => 3.9631, std.dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.50% (3.6395 => 3.7669, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (4.2280 => 4.3559, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2437, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2557, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.67% (5.3855 => 3.8956, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.29% (5.3526 => 3.8920, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1814, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.13% (2.9384 => 2.6115, std.dev.: 0.0197) MultiSource/Applications/ClamAV/clamscan: -8.87% (22.1758 => 20.2081, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -11.86% (1.2373 => 1.0905, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2806, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7110, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1617, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.17% (10.2830 => 10.0603, std.dev.: 0.0210) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9863, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5076, std.dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2535, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2280, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.00% (0.5229 => 0.5752, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.61% (14.9895 => 15.9801, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 5.12% (14.1553 => 14.8794, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 5.50% (4.1105 => 4.3364, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.34% (1.1048 => 1.2301, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.17% (7.1582 => 7.5281, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.24% (3.4629 => 3.7135, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.26% (0.6222 => 0.6487, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 13:57:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 15:57:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120928205750.DEAD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4355?compare_to=4350&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4355, Order: 164831, Start Time: 2012-09-28 18:15:53, End Time: 2012-09-28 20:59:27 To: 4350, Order: 164822, Start Time: 2012-09-28 15:03:46, End Time: 2012-09-28 17:47:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 968 (766 on baseline) Total Tests: 970 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 29.23% (57.9567 => 74.8982, std.dev.: 0.0379) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.02% (1.7545 => 1.7366, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 10.81% (0.3442 => 0.3814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.75% (0.3488 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.71% (0.3446 => 0.3815, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.59% (0.3465 => 0.3832, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3496 => 0.3866, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.49% (0.3469 => 0.3833, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3460 => 0.3823, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 10.33% (0.3650 => 0.4027, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3643 => 0.4015, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.20% (0.3724 => 0.4104, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.00% (1.5932 => 1.7366, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.63% (0.5889 => 0.6397, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.55% (0.5826 => 0.6324, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2875 => 0.3094, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.3004 => 0.3222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2738 => 0.2936, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3195 => 0.3426, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.15% (0.7171 => 0.7684, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.15% (0.2729 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.13% (0.2750 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.11% (0.2813 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.2014 => 0.2157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2803 => 0.3002, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (1.6211 => 1.7361, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 7.08% (0.2823 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2792 => 0.2987, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.2780 => 0.2973, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.88% (2.0673 => 2.2096, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3096 => 0.3309, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.87% (0.2811 => 0.3004, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.84% (0.2911 => 0.3110, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.83% (0.9909 => 1.0586, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3267 => 0.3487, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.73% (0.3060 => 0.3266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3258 => 0.3475, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.62% (1.3152 => 1.4023, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.60% (0.4361 => 0.4649, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3124 => 0.3328, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3362 => 0.3581, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.50% (3.5627 => 3.7943, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3317 => 0.3531, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.44% (0.3930 => 0.4183, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.34% (0.3625 => 0.3855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.33% (0.3477 => 0.3697, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.3282 => 0.3489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.30% (0.3348 => 0.3559, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3726 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.23% (0.4994 => 0.5305, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.16% (5.5417 => 5.8832, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4251 => 0.4511, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.02% (1.0781 => 1.1430, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.02% (0.3690 => 0.3912, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.98% (0.5000 => 0.5299, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.98% (2.7292 => 2.8924, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4146 => 0.4392, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.93% (0.3845 => 0.4073, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (0.5026 => 0.5321, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.3981 => 0.4212, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 5.68% (23.5202 => 24.8565, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 5.64% (2.1013 => 2.2199, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.60% (4.2109 => 4.4465, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.2736 => 0.2889, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.57% (0.2566 => 0.2709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 5.45% (0.5012 => 0.5285, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (4.4195 => 4.6594, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.31% (0.6634 => 0.6986, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.30% (0.6435 => 0.6776, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.2068 => 0.2177, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (0.3890 => 0.4095, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.22% (0.2737 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.22% (0.3084 => 0.3245, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.22% (0.4139 => 0.4355, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 5.18% (1.8794 => 1.9768, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 5.16% (0.9697 => 1.0197, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 5.10% (4.6177 => 4.8532, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.3903 => 0.4099, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 4.98% (1.4269 => 1.4979, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.96% (2.1653 => 2.2728, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.2103 => 0.2205, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (0.4658 => 0.4880, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.71% (0.5546 => 0.5807, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.52% (0.3271 => 0.3419, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 4.46% (2.0346 => 2.1254, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.41% (0.2969 => 0.3100, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.40% (1.9694 => 2.0560, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (1.9966 => 2.0834, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 4.32% (0.7875 => 0.8215, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.04% (0.7426 => 0.7726, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.84% (0.4847 => 0.5033, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (0.2691 => 0.2794, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.79% (0.5361 => 0.5564, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (0.5584 => 0.5778, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.24% (11.6398 => 12.0169, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 2.97% (0.3498 => 0.3602, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (4.6926 => 4.8296, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.35% (0.4253 => 0.4353, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 1.71% (11.9555 => 12.1598, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6698, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std.dev.: 0.1409) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6475, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std.dev.: 0.0098) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5082, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4488, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5877, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5571, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: -9.95% (0.2402 => 0.2163, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8068, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std.dev.: 0.0110) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7847, std.dev.: 0.1045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 14:22:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 16:22:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928212251.F02032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4356?compare_to=4351&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4356, Order: 164836, Start Time: 2012-09-28 20:09:32, End Time: 2012-09-28 21:24:24 To: 4351, Order: 164824, Start Time: 2012-09-28 16:37:31, End Time: 2012-09-28 17:52:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 72 (72 on baseline) Performance Regressions: 0 (174 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 969 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -10.25% (0.4330 => 0.3886, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.08% (2.0176 => 2.4429, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.89% (0.7061 => 0.7830, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 10.83% (0.5818 => 0.6448, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.70% (0.4328 => 0.4791, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.63% (0.5748 => 0.6359, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.29% (1.3693 => 1.5102, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.24% (3.9660 => 4.3723, std.dev.: 0.0081) SingleSource/Regression/C++/ofstream_ctor: 10.21% (0.2781 => 0.3065, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.06% (0.7038 => 0.7746, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 10.02% (0.4062 => 0.4469, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.90% (0.3899 => 0.4285, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.81% (0.2721 => 0.2988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.78% (1.2193 => 1.3386, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.78% (0.2782 => 0.3054, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.75% (0.2596 => 0.2849, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.71% (0.6959 => 0.7635, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.58% (0.3130 => 0.3430, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.53% (0.3022 => 0.3310, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.50% (0.5265 => 0.5765, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.45% (0.4390 => 0.4805, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.40% (0.7710 => 0.8435, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 9.40% (0.2607 => 0.2852, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.38% (0.9199 => 1.0062, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.37% (0.3489 => 0.3816, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.35% (0.3485 => 0.3811, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.35% (1.4563 => 1.5925, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.34% (0.2655 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.32% (0.3293 => 0.3600, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.31% (1.9828 => 2.1673, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.30% (13.8202 => 15.1051, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.26% (0.6283 => 0.6865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.26% (0.2937 => 0.3209, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.24% (1.1364 => 1.2414, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.22% (0.2765 => 0.3020, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.22% (0.3580 => 0.3910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.17% (0.2726 => 0.2976, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.14% (0.2966 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.11% (0.4016 => 0.4382, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 9.09% (0.2761 => 0.3012, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.05% (0.3756 => 0.4096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.01% (0.2696 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.01% (0.3107 => 0.3387, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.87% (0.3868 => 0.4211, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.86% (0.3149 => 0.3428, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 8.85% (1.0313 => 1.1226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.77% (0.3192 => 0.3472, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.66% (0.4791 => 0.5206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.63% (0.3453 => 0.3751, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.48% (0.2995 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.43% (0.3534 => 0.3832, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.43% (0.5577 => 0.6047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.35% (0.3246 => 0.3517, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.22% (0.2945 => 0.3187, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.11% (0.4379 => 0.4734, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.99% (0.2127 => 0.2297, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.94% (0.8310 => 0.8970, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: 7.92% (1.1061 => 1.1937, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.91% (3.6692 => 3.9594, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 7.90% (3.8646 => 4.1700, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 7.76% (16.6129 => 17.9018, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 7.70% (0.3220 => 0.3468, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (7.2180 => 7.7731, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.58% (0.6744 => 0.7255, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.54% (0.5637 => 0.6062, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.52% (0.7460 => 0.8021, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.50% (0.8698 => 0.9350, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.49% (0.7506 => 0.8068, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 7.47% (3.1889 => 3.4272, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.46% (0.3755 => 0.4035, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.35% (1.0594 => 1.1373, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.33% (2.1791 => 2.3388, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.31% (0.6576 => 0.7057, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.22% (0.2243 => 0.2405, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.12% (1.9270 => 2.0642, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.99% (1.3245 => 1.4171, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.94% (14.8535 => 15.8841, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.85% (0.8818 => 0.9422, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (1.2749 => 1.3618, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.4113 => 0.4390, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.68% (8.4961 => 9.0633, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.63% (0.2504 => 0.2670, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 6.61% (0.3131 => 0.3338, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.60% (0.6135 => 0.6540, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.60% (4.3801 => 4.6690, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.51% (4.4433 => 4.7324, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 6.51% (0.2859 => 0.3045, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3245 => 0.3455, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.44% (1.3819 => 1.4709, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2060, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.41% (0.3511 => 0.3736, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.37% (1.3813 => 1.4693, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 6.34% (0.3578 => 0.3805, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 6.31% (1.2292 => 1.3068, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3914 => 0.4158, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.4003 => 0.4251, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.18% (4.6629 => 4.9512, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.10% (14.5298 => 15.4159, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-2: 6.08% (0.3601 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (13.2842 => 14.0906, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (3.2742 => 3.4729, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 6.06% (0.3646 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.05% (0.3650 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.02% (0.3789 => 0.4017, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.97% (6.5754 => 6.9682, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3663 => 0.3881, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.6250 => 0.6621, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.89% (0.3940 => 0.4172, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2321 => 0.2451, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.60% (0.4805 => 0.5074, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.56% (4.9865 => 5.2637, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.42% (0.9108 => 0.9602, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.33% (1.5188 => 1.5998, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.91% (3.7467 => 3.9308, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.87% (2.1007 => 2.2031, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (6.2785 => 6.5633, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 4.40% (33.2944 => 34.7581, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.99% (16.2614 => 16.7470, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 25.00% (1.8175 => 2.2718, std.dev.: 0.0332) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (3.1736 => 3.4169, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7251, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.11% (10.7476 => 11.0815, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5912, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5845, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2253, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (8.8259 => 8.9146, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.42% (22.5627 => 22.0163, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.64% (1.2308 => 1.0875, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2760, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.24% (1.3780 => 1.2920, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9661, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1576, std.dev.: 0.0256) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4790, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.23% (1.9762 => 1.9322, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7054, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.77% (0.6615 => 0.6498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2286, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1794, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4348, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 14:38:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 16:38:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928213817.6044A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4357?compare_to=4354&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4357, Order: 164836, Start Time: 2012-09-28 20:19:36, End Time: 2012-09-28 21:39:53 To: 4354, Order: 164831, Start Time: 2012-09-28 18:31:08, End Time: 2012-09-28 19:50:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 72 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (143 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 949 (707 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.40% (7.9499 => 8.0610, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5752 => 0.5755, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.03% (15.9801 => 15.9842, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: -0.07% (14.8794 => 14.8685, std.dev.: 0.2107) MultiSource/Benchmarks/Bullet/bullet: 0.10% (82.8535 => 82.9354, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: -0.15% (4.3364 => 4.3298, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2301 => 1.2301, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.5281 => 7.5290, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (3.7135 => 3.7146, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.14% (0.6487 => 0.6478, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.14% (63.2438 => 82.9354, std.dev.: 0.0090) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14237.64% (0.0720 => 10.3231, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.15% (10.3673 => 14.9447, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: 28.85% (0.1622 => 0.2090, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.57% (7.0540 => 8.0821, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.43% (2.2022 => 2.5199, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.06% (1.1194 => 1.2656, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.56% (1.7609 => 1.9821, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.85% (0.1584 => 0.1740, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.49% (0.3497 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.48% (0.3543 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.41% (0.3282 => 0.3591, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.35% (0.3561 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3828 => 0.4175, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.96% (0.3927 => 0.4279, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.88% (0.3886 => 0.4231, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.43% (10.4361 => 11.3154, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.99% (9.4845 => 10.2422, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.97% (0.4879 => 0.5268, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 7.92% (0.1440 => 0.1554, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.71% (0.3307 => 0.3562, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5925 => 0.6360, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.22% (0.6675 => 0.7157, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7433 => 0.7965, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.6030 => 0.6458, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2700 => 0.2891, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.06% (0.7115 => 0.7617, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.01% (0.3109 => 0.3327, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.95% (5.7591 => 6.1594, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.93% (0.4615 => 0.4935, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.88% (0.5105 => 0.5456, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.87% (0.3423 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.73% (3.3354 => 3.5598, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.69% (1.5415 => 1.6447, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.67% (1.3050 => 1.3921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.65% (0.1625 => 0.1733, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (8.1363 => 8.6746, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (4.2646 => 4.5436, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7326 => 0.7797, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5860 => 0.6235, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.37% (5.0018 => 5.3202, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.31% (1.5603 => 1.6588, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.31% (0.3422 => 0.3638, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.8172 => 0.8687, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (4.9449 => 5.2556, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.5569 => 0.5917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.8067 => 0.8564, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.6456 => 0.6851, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3121 => 0.3310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2891 => 0.3063, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.92% (0.7835 => 0.8299, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.4064 => 0.4304, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.4103 => 0.4344, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.85% (0.4289 => 0.4540, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.82% (1.1642 => 1.2320, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.82% (0.2905 => 0.3074, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.80% (0.5020 => 0.5311, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.79% (1.1861 => 1.2548, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.78% (0.9765 => 1.0329, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 5.75% (0.3603 => 0.3810, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3650 => 0.3859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.72% (0.2725 => 0.2881, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3865 => 0.4086, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (7.9617 => 8.4147, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.69% (0.4203 => 0.4442, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.68% (3.8723 => 4.0922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3098 => 0.3273, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.64% (0.3136 => 0.3313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2872 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4636 => 0.4897, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.62% (0.3826 => 0.4041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.60% (0.3162 => 0.3339, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 5.60% (1.0722 => 1.1322, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 5.58% (0.4620 => 0.4878, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.54% (0.3283 => 0.3465, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.52% (0.2756 => 0.2908, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.49% (0.3441 => 0.3630, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.48% (21.9371 => 23.1401, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary: 5.48% (0.3232 => 0.3409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.47% (0.3052 => 0.3219, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (2.0665 => 2.1790, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.4048 => 0.4268, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 5.37% (0.3387 => 0.3569, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2802 => 0.2951, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4299 => 0.4526, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2877 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.24% (0.3935 => 0.4141, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2793 => 0.2939, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3684 => 0.3876, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.14% (2.0273 => 2.1316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.09% (0.3379 => 0.3551, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6450 => 0.6778, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 4.83% (0.8921 => 0.9352, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.76% (2.2969 => 2.4062, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.59% (1.5859 => 1.6587, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.41% (0.5981 => 0.6245, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (14.3668 => 14.9805, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.4186 => 1.4781, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.14% (2.2024 => 2.2935, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (1.1840 => 1.2307, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.67% (1.2842 => 1.3313, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.70% (0.8101 => 0.8320, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5018, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (3.8922 => 3.9639, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.04% (3.1578 => 3.3801, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.93% (3.6395 => 3.7825, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3480, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2631, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7991, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2608, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (5.3855 => 3.8969, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.24% (5.3526 => 3.8946, std.dev.: 0.0077) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1377, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.08% (2.9384 => 2.6127, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.74% (22.1758 => 20.2373, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4277, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.22% (1.2373 => 1.0985, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2586, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5713, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5013, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.17% (8.6802 => 8.4916, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.1001, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2540, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0159, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4245, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2217, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.06% (0.5229 => 0.5755, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.64% (14.9895 => 15.9842, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 5.04% (14.1553 => 14.8685, std.dev.: 0.2107) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (4.1105 => 4.3298, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.34% (1.1048 => 1.2301, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.18% (7.1582 => 7.5290, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.27% (3.4629 => 3.7146, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.11% (0.6222 => 0.6478, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 14:59:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 16:59:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120928215957.E67E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4358?compare_to=4353&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4358, Order: 164839, Start Time: 2012-09-28 20:37:33, End Time: 2012-09-28 22:01:29 To: 4353, Order: 164827, Start Time: 2012-09-28 17:35:39, End Time: 2012-09-28 18:46:29 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (68 on baseline) Performance Improvements: 6 (40 on baseline) Added Tests: 72 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 884 (783 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/lists: 18.50% (0.0546 => 0.0647, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.82% (0.1419 => 0.1530, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.95% (0.8740 => 0.9085, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: 2.02% (8.9105 => 9.0904, std.dev.: 0.0533) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.5957 => 0.6066, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 24.81% (0.1415 => 0.1766, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/heapsort: 24.12% (3.0546 => 3.7915, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.13% (3.0668 => 3.7455, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (1.3910 => 1.4523, std.dev.: 0.0190) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.14% (4.1203 => 4.2909, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.46% (4.4843 => 4.5498, std.dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.41% (4.1729 => 4.0725, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.63% (1.4496 => 1.4259, std.dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: -1.45% (1.1220 => 1.1057, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -1.44% (3.9588 => 3.9019, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.17% (13.2219 => 13.0678, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.27% (2.6050 => 2.5718, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.49% (1.0144 => 1.0094, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -0.94% (0.6148 => 0.6090, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: -3.15% (0.1680 => 0.1627, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.17% (0.1566 => 0.1532, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.35% (0.3128 => 0.3139, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.2404 => 0.2401, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.12% (0.3213 => 0.3217, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.03% (0.2326 => 0.2350, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -14.60% (0.0452 => 0.0386, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: 2.30% (0.0087 => 0.0089, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: -45.45% (0.0088 => 0.0048, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.23% (0.0195 => 0.0177, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.05% (0.0190 => 0.0112, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.34% (0.0385 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.38% (0.0290 => 0.0228, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.50% (0.0280 => 0.0287, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.82% (0.0319 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.98% (0.0176 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -7.25% (0.0193 => 0.0179, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -8.03% (0.0249 => 0.0229, std.dev.: 0.0043) SingleSource/UnitTests/byval-alignment: -10.28% (0.0321 => 0.0288, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.72% (0.1385 => 0.1375, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -0.45% (1.4589 => 1.4523, std.dev.: 0.0327) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.63% (0.1513 => 0.1443, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.42% (0.4080 => 0.4097, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.53% (0.1442 => 0.1420, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 66.67% (0.0003 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.86% (0.0548 => 0.0613, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.57% (0.0213 => 0.0199, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.06% (0.0564 => 0.0558, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.33% (1.1261 => 1.1411, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -54.55% (0.0011 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.93% (0.0547 => 0.0563, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.36% (0.0206 => 0.0162, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.25% (0.7663 => 0.7644, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.23% (1.5994 => 1.6030, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.08% (0.0096 => 0.0098, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.14% (4.1772 => 3.1269, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/except: 83400.00% (0.0006 => 0.5010, std.dev.: 0.0121) SingleSource/Regression/C++/EH/ctor_dtor_count: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.28% (0.0745 => 0.0911, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 8.34% (2.1763 => 2.3578, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.94% (0.6410 => 0.6919, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 7.48% (0.5309 => 0.5706, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 6.03% (15.3105 => 16.2342, std.dev.: 0.2444) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.96% (0.7639 => 0.8094, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 5.90% (1.0046 => 1.0639, std.dev.: 0.0138) MultiSource/Applications/SIBsim4/SIBsim4: 5.75% (1.1653 => 1.2323, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.39% (0.3582 => 0.3775, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.21% (0.2552 => 0.2685, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.96% (0.3062 => 0.3214, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.6915 => 0.7249, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 4.76% (4.7455 => 4.9713, std.dev.: 0.0296) MultiSource/Benchmarks/McCat/18-imp/imp: 4.72% (0.3217 => 0.3369, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.2797 => 0.2927, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.63% (1.5150 => 1.5852, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4248 => 0.4437, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 4.32% (29.3170 => 30.5828, std.dev.: 0.1521) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.97% (0.6069 => 0.6310, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.3901 => 0.4053, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (1.1672 => 1.2081, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 3.43% (0.3847 => 0.3979, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (12.6413 => 13.0678, std.dev.: 0.0217) MultiSource/Applications/SPASS/SPASS: 3.31% (13.3238 => 13.7643, std.dev.: 0.1421) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.29% (0.7226 => 0.7464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.13% (0.3418 => 0.3525, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.2186 => 8.4698, std.dev.: 0.0334) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.83% (1.0689 => 1.0992, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 2.75% (3.5980 => 3.6968, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (0.4880 => 0.5012, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.6079 => 14.9919, std.dev.: 0.0894) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.49% (1.2021 => 1.2320, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.43% (6.4908 => 6.6488, std.dev.: 0.0551) MultiSource/Benchmarks/nbench/nbench: 2.18% (1.0821 => 1.1057, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.16% (0.8569 => 0.8754, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.08% (6.2546 => 6.3844, std.dev.: 0.0320) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.5963 => 0.6066, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (8.2559 => 8.3428, std.dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 40.61% (0.0261 => 0.0367, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 24.63% (0.1417 => 0.1766, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.79% (3.0256 => 3.7455, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/matrix: 22.22% (3.4629 => 4.2322, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/heapsort: 17.90% (3.2159 => 3.7915, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout/ary3: 14.93% (1.7426 => 2.0028, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.97% (4.0101 => 4.5705, std.dev.: 0.1087) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 11.19% (1.6261 => 1.8080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 9.34% (7.0025 => 7.6568, std.dev.: 0.0246) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.16% (0.2857 => 0.3090, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.98% (1.0063 => 1.0866, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.27% (0.3301 => 0.3541, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.83% (40.4792 => 42.8374, std.dev.: 0.2774) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.15% (4.2129 => 4.4299, std.dev.: 0.0418) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.84% (0.7609 => 0.7977, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/dt: 3.93% (0.9851 => 1.0238, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.64% (3.4080 => 3.5322, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 3.51% (15.2242 => 15.7580, std.dev.: 0.0534) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8960, std.dev.: 0.0330) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8096, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: 2.68% (3.8907 => 3.9950, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.6308 => 0.6464, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/mason/mason: 2.40% (0.5004 => 0.5124, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 1.93% (2.4013 => 2.4477, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.61% (1.6110 => 1.6369, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.28% (4.0659 => 4.1178, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.24% (0.3497 => 0.2055, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.48% (0.0311 => 0.0210, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.52% (5.2665 => 4.2909, std.dev.: 0.0409) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.18% (1.1647 => 0.9530, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.90% (15.8312 => 13.1553, std.dev.: 0.1659) SingleSource/Benchmarks/Shootout-C++/ary3: -16.88% (1.7473 => 1.4523, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1610, std.dev.: 0.0658) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.96% (1.4034 => 1.2776, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -7.10% (7.6833 => 7.1377, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3751, std.dev.: 0.0264) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.54% (2.0027 => 1.8717, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -6.39% (4.6355 => 4.3395, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: -6.29% (3.4230 => 3.2077, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/richards_benchmark: -6.25% (1.4441 => 1.3538, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: -6.08% (0.2664 => 0.2502, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: -5.48% (62.4126 => 58.9942, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout/fib2: -5.03% (4.4195 => 4.1971, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -4.09% (9.2503 => 8.8721, std.dev.: 0.0606) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.03% (0.4140 => 0.3973, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -4.03% (0.3746 => 0.3595, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -3.81% (2.5166 => 2.4207, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/misr: -3.77% (0.4296 => 0.4134, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.50% (1.1683 => 1.1274, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: -3.10% (92.7467 => 89.8740, std.dev.: 0.5284) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8208, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2878, std.dev.: 0.0341) MultiSource/Applications/lua/lua: -2.24% (29.5232 => 28.8609, std.dev.: 0.2521) MultiSource/Applications/JM/lencod/lencod: -2.20% (6.7458 => 6.5977, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/neural/neural: -1.99% (1.0926 => 1.0709, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4229, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.80% (3.4286 => 3.3669, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2206, std.dev.: 0.0240) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.75% (0.6119 => 0.6012, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.38% (27.1724 => 26.7972, std.dev.: 0.0361) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.27% (25.6658 => 25.3387, std.dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/fldry: -1.22% (2.4971 => 2.4667, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.02% (2.5984 => 2.5718, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.14% (0.9980 => 1.0094, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.13% (0.6022 => 0.6090, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: -2.34% (0.1666 => 0.1627, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.42% (0.1554 => 0.1532, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.82% (0.3083 => 0.3139, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.29% (0.2394 => 0.2401, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.32% (0.3175 => 0.3217, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.09% (0.2302 => 0.2350, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -14.03% (0.0449 => 0.0386, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: -46.67% (0.0090 => 0.0048, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.25% (0.0240 => 0.0177, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.67% (0.0192 => 0.0112, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0390 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.25% (0.0301 => 0.0228, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -5.29% (0.0189 => 0.0179, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -8.03% (0.0249 => 0.0229, std.dev.: 0.0043) SingleSource/UnitTests/byval-alignment: -11.38% (0.0325 => 0.0288, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.78% (0.1429 => 0.1375, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -3.30% (1.5019 => 1.4523, std.dev.: 0.0327) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.86% (0.1501 => 0.1443, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.92% (0.4264 => 0.4097, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.65% (0.1344 => 0.1420, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0232 => 0.0199, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.68% (0.0639 => 0.0558, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1350 => 1.1411, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.62% (0.0637 => 0.0563, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.15% (0.0246 => 0.0162, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.37% (0.7541 => 0.7644, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.34% (1.5363 => 1.6030, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.00% (0.0070 => 0.0098, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 4.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 16:06:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 18:06:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120928230656.89BE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4359?compare_to=4356&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4359, Order: 164845, Start Time: 2012-09-28 21:53:29, End Time: 2012-09-28 23:08:29 To: 4356, Order: 164836, Start Time: 2012-09-28 20:09:32, End Time: 2012-09-28 21:24:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 969 (689 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 6.45% (3.7759 => 4.0195, std.dev.: 0.0376) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0478 => 0.0477, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.42% (0.0479 => 0.0477, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0447 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.45% (0.0449 => 0.0447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0448 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0452 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.00% (0.0466 => 0.0452, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0428 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0459 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0460 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.24% (0.0421 => 0.0420) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.47% (0.0423 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.42% (2.0176 => 2.4498, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 11.77% (0.5818 => 0.6503, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.62% (0.5748 => 0.6416, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.46% (0.7061 => 0.7870, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.67% (0.4328 => 0.4790, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.48% (3.9660 => 4.3816, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.36% (0.7038 => 0.7767, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.30% (1.3693 => 1.5104, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.95% (0.3899 => 0.4287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.95% (0.4062 => 0.4466, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.89% (0.3022 => 0.3321, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.88% (0.2782 => 0.3057, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.81% (0.3130 => 0.3437, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.70% (0.4390 => 0.4816, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.62% (0.7710 => 0.8452, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.62% (1.2193 => 1.3366, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.55% (0.2690 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.54% (1.9828 => 2.1719, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.50% (0.6959 => 0.7620, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.50% (0.5265 => 0.5765, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.48% (0.9199 => 1.0071, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 9.47% (13.8202 => 15.1291, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.41% (0.3485 => 0.3813, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.41% (1.1364 => 1.2433, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.34% (0.3489 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.33% (1.4563 => 1.5921, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.30% (0.3580 => 0.3913, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3293 => 0.3599, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.28% (0.6283 => 0.6866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.27% (0.2966 => 0.3241, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.24% (0.2760 => 0.3015, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.24% (0.3756 => 0.4103, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.22% (0.2765 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.19% (0.2937 => 0.3207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.16% (0.4016 => 0.4384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.08% (0.3107 => 0.3389, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.89% (0.3149 => 0.3429, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.84% (0.3868 => 0.4210, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 8.83% (0.3453 => 0.3758, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.75% (1.0313 => 1.1215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.71% (0.3192 => 0.3470, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.60% (0.4791 => 0.5203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.43% (0.3534 => 0.3832, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.41% (0.3246 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.41% (0.5577 => 0.6046, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.20% (0.6576 => 0.7115, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2945 => 0.3186, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.18% (0.2995 => 0.3240, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.15% (0.4379 => 0.4736, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.06% (1.1061 => 1.1953, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.01% (16.6129 => 17.9435, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (3.6692 => 3.9612, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (7.2180 => 7.7826, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 7.80% (3.1889 => 3.4377, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 7.75% (0.7506 => 0.8088, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 7.73% (3.8646 => 4.1635, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.69% (0.2914 => 0.3138, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.68% (0.5637 => 0.6070, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.59% (0.7460 => 0.8026, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.54% (0.8698 => 0.9354, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.3220 => 0.3462, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.51% (0.3755 => 0.4037) MultiSource/Applications/minisat/minisat: 7.49% (0.6744 => 0.7249, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 7.43% (2.1791 => 2.3411, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 7.43% (1.0594 => 1.1381, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.37% (1.9270 => 2.0691, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.18% (4.6629 => 4.9978, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.10% (0.3914 => 0.4192, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.3245 => 1.4185, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 7.09% (0.4003 => 0.4287, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 6.97% (14.8535 => 15.8894, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.97% (0.1865 => 0.1995, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (1.2749 => 1.3628, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3623 => 0.3871, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 6.78% (0.3940 => 0.4207, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.74% (1.3813 => 1.4744, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.72% (0.3245 => 0.3463, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.70% (1.3819 => 1.4745, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.69% (4.3801 => 4.6733, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.69% (0.8818 => 0.9408, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.62% (8.4961 => 9.0582, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.59% (4.4433 => 4.7359, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.1333 => 1.2077, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.4113 => 0.4379, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 6.37% (1.2292 => 1.3075, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.35% (13.2842 => 14.1272, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 6.18% (14.5298 => 15.4273, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 6.16% (0.2859 => 0.3035, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 6.13% (6.5754 => 6.9783, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.01% (0.3511 => 0.3722, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.94% (3.2742 => 3.4687, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.91% (0.2504 => 0.2652, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.81% (0.4805 => 0.5084, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.74% (0.6250 => 0.6609, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.62% (4.9865 => 5.2669, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2321 => 0.2451, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.23% (0.9108 => 0.9584, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.10% (1.5188 => 1.5963, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.94% (3.7467 => 3.9316, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (6.2785 => 6.5833, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (2.1007 => 2.1993, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.54% (33.2944 => 34.8061, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 3.03% (16.2614 => 16.7541, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (3.1736 => 3.4120, std.dev.: 0.0057) MultiSource/Benchmarks/llubenchmark/llu: 6.53% (3.7731 => 4.0195, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7248, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9841, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.08% (10.7476 => 11.0789, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5872, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5845, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2234, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.06% (8.8259 => 8.9196, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6845, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.49% (22.5627 => 22.0006, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2308 => 1.0965, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2920, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.41% (1.3780 => 1.2897, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9661, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7939, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.47% (3.2729 => 3.1592, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9308, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2395, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7062, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1251, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3305 => 7.2271, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0310 => 1.0203, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4345, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5641, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 16:27:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 18:27:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120928232737.0C4472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4360?compare_to=4357&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4360, Order: 164851, Start Time: 2012-09-28 22:08:57, End Time: 2012-09-28 23:29:11 To: 4357, Order: 164836, Start Time: 2012-09-28 20:19:36, End Time: 2012-09-28 21:39:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (146 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (705 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.5999 => 56.4514, std.dev.: 0.0797) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (79.8846 => 81.6126, std.dev.: 0.2608) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (14.9447 => 14.7740, std.dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5755 => 0.5763, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.04% (15.9842 => 15.9774, std.dev.: 0.0087) MultiSource/Applications/kimwitu++/kc: 0.49% (14.8685 => 14.9409, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: 0.29% (82.9354 => 83.1783, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.3298 => 4.3426, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0483 => 0.0481, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0485 => 0.0483, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0453 => 0.0452) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0454 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0443 => 0.0441) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.66% (0.0455 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.44% (0.0456 => 0.0454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.45% (0.0449 => 0.0447) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0449 => 0.0449, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.68% (0.0439 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.45% (0.0440 => 0.0438) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0446 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.67% (0.0448 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.66% (0.0458 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.44% (0.0459 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.46% (0.0438 => 0.0436) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.46% (0.0431 => 0.0429) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.47% (0.0430 => 0.0428) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0465 => 0.0464) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.43% (0.0466 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0437 => 0.0437, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.27% (1.2301 => 1.2334, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (7.5290 => 7.5189, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (3.7146 => 3.7114, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6478 => 0.6473, std.dev.: 0.0155) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0647 => 0.0647, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.52% (63.2438 => 83.1783, std.dev.: 0.0077) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.69% (0.0720 => 10.3217, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.51% (10.3673 => 14.7740, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: 27.93% (0.1622 => 0.2075, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.78% (2.2022 => 2.5276, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.48% (7.0540 => 8.0753, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops: 13.13% (0.1432 => 0.1620, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.84% (0.1566 => 0.1767, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.65% (1.1194 => 1.2610, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (1.7609 => 1.9785, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.96% (0.3282 => 0.3609, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.91% (0.3543 => 0.3894, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3694 => 0.4044, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.37% (0.3927 => 0.4295, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.19% (0.3886 => 0.4243, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.63% (10.4361 => 11.3363, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.96% (9.4845 => 10.2399, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.96% (0.3177 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.86% (0.3307 => 0.3567, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.69% (5.7591 => 6.2021, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 7.66% (0.5925 => 0.6379, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 7.56% (0.7115 => 0.7653, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.56% (0.7433 => 0.7995, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.39% (3.3354 => 3.5820, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.34% (0.6675 => 0.7165, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.27% (0.3109 => 0.3335, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (0.4615 => 0.4942, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.3423 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3960, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.90% (0.5105 => 0.5457, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.89% (0.1625 => 0.1737, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.84% (4.2646 => 4.5565, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (8.1363 => 8.6921, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 6.83% (0.7326 => 0.7826, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.78% (1.5415 => 1.6460, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1510 => 0.1612, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.72% (0.5860 => 0.6254, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.57% (5.0018 => 5.3303, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.51% (4.9449 => 5.2670, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5569 => 0.5929, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.42% (0.2758 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.8172 => 0.8693, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 6.37% (0.3422 => 0.3640, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.33% (0.8067 => 0.8578, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.31% (0.2107 => 0.2240, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.25% (0.7835 => 0.8325, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.18% (0.5020 => 0.5330, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.17% (21.9371 => 23.2905, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.12% (0.9765 => 1.0363, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.01% (1.1642 => 1.2342, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.00% (1.1861 => 1.2573, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.00% (3.8723 => 4.1045, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.97% (0.4103 => 0.4348, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2891 => 0.3063, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.92% (0.2905 => 0.3077, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.92% (7.9617 => 8.4327, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 5.91% (1.0722 => 1.1356, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (0.4064 => 0.4300, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.81% (1.5603 => 1.6509, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.6456 => 0.6830, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 5.75% (0.3180 => 0.3363, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.75% (0.3441 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.75% (0.3650 => 0.3860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.71% (0.4048 => 0.4279, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4636 => 0.4899, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 5.67% (0.4289 => 0.4532, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.64% (0.3865 => 0.4083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.62% (0.2831 => 0.2990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.62% (0.4203 => 0.4439, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.58% (0.3387 => 0.3576, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.52% (0.3098 => 0.3269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.51% (0.3283 => 0.3464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.3232 => 0.3410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.50% (0.2871 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.49% (0.3826 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4620 => 0.4873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3603 => 0.3800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2756 => 0.2906, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.44% (0.3162 => 0.3334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.43% (0.2872 => 0.3028, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.3052 => 0.3217, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.30% (2.0273 => 2.1348, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6450 => 0.6792, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.29% (2.0665 => 2.1759, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/random: 5.25% (0.2802 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2793 => 0.2939, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3935 => 0.4138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.16% (0.3684 => 0.3874, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.15% (0.3379 => 0.3553, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.04% (0.8921 => 0.9371, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.96% (2.2969 => 2.4109, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.74% (1.5859 => 1.6610, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.73% (0.5981 => 0.6264, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (14.3668 => 15.0189, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.4186 => 1.4807, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.25% (2.2024 => 2.2961, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.1840 => 1.2332, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2842 => 1.3321, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.18% (0.8101 => 0.8359, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.27% (17.1811 => 17.5705, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (3.8922 => 3.9735, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7677, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3444, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2396, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.50% (5.2763 => 3.2450, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.35% (5.3855 => 3.9126, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.98% (5.3526 => 3.9084, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1361, std.dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.00% (2.9384 => 2.6153, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: -8.57% (22.1758 => 20.2754, std.dev.: 0.0345) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2373 => 1.0970, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2748, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.79% (2.7294 => 2.5714, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.60% (3.2827 => 3.1645, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5070, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.15% (8.6802 => 8.4937, std.dev.: 0.0177) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0045, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0959, std.dev.: 0.0210) MultiSource/Applications/hexxagon/hexxagon: -1.74% (12.4730 => 12.2555, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5089, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2369, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.21% (0.5229 => 0.5763, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.59% (14.9895 => 15.9774, std.dev.: 0.0087) MultiSource/Applications/kimwitu++/kc: 5.55% (14.1553 => 14.9409, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 5.65% (4.1105 => 4.3426, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.64% (1.1048 => 1.2334, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.04% (7.1582 => 7.5189, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.18% (3.4629 => 3.7114, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.03% (0.6222 => 0.6473, std.dev.: 0.0155) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 17:13:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 19:13:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929001308.477342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4361?compare_to=4355&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4361, Order: 164845, Start Time: 2012-09-28 21:30:30, End Time: 2012-09-29 00:14:42 To: 4355, Order: 164831, Start Time: 2012-09-28 18:15:53, End Time: 2012-09-28 20:59:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 72 (72 on baseline) Performance Regressions: 3 (131 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 967 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.18% (2.0306 => 2.0952, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.18% (125.0240 => 128.9949, std.dev.: 0.3120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.1654 => 54.8796, std.dev.: 0.0135) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.50% (0.3442 => 0.3838, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3465 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.38% (0.3496 => 0.3894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.33% (0.3460 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 11.12% (0.3650 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.03% (0.3643 => 0.4045, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 9.86% (1.5932 => 1.7503, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5826 => 0.6341, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5889 => 0.6407, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.66% (1.3152 => 1.4160, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.3004 => 0.3230, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.2823 => 0.3035, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7171 => 0.7708, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.48% (1.6211 => 1.7424, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2813 => 0.3023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.41% (0.2875 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.39% (0.3195 => 0.3431, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.31% (0.4361 => 0.4680, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (3.5627 => 3.8184, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.15% (2.0673 => 2.2151, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2738 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.11% (0.2714 => 0.2907, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.11% (0.3362 => 0.3601, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2792 => 0.2990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.09% (0.2780 => 0.2977, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2803 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.01% (0.2811 => 0.3008, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2911 => 0.3115, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.00% (0.2729 => 0.2920, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.95% (2.7292 => 2.9190, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 6.94% (0.9909 => 1.0597, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3267 => 0.3493, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.90% (0.3060 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.89% (0.4994 => 0.5338, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.2014 => 0.2152, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.85% (0.3096 => 0.3308, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3258 => 0.3476, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 6.66% (0.3317 => 0.3538, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.65% (5.5417 => 5.9103, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.60% (0.5000 => 0.5330, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3726 => 0.3971, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.54% (0.3348 => 0.3567, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.51% (0.3625 => 0.3861, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.47% (0.3678 => 0.3916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.47% (0.3124 => 0.3326, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3477 => 0.3700, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.40% (0.3282 => 0.3492, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.34% (0.3930 => 0.4179, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.31% (1.0781 => 1.1461, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3690 => 0.3915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.09% (0.4251 => 0.4510, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.09% (23.5202 => 24.9532, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4146 => 0.4398, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.99% (4.2109 => 4.4631, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (2.1013 => 2.2262, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.2736 => 0.2898, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (0.5026 => 0.5322, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.3981 => 0.4215, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.3084 => 0.3263, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.78% (0.3890 => 0.4115, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 5.73% (1.8794 => 1.9870, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.3845 => 0.4065, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 5.72% (4.6177 => 4.8819, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.69% (0.2866 => 0.3029, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.65% (4.4195 => 4.6694, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.65% (0.4139 => 0.4373, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.5012 => 0.5293, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.59% (0.6435 => 0.6795, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.5900 => 0.6230, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 5.58% (0.4029 => 0.4254, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 5.58% (0.6634 => 0.7004, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 5.55% (1.4269 => 1.5061, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.2068 => 0.2182, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.2737 => 0.2885, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (0.3903 => 0.4114, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (2.1653 => 2.2810, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 5.29% (0.9697 => 1.0210, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 5.19% (0.3336 => 0.3509, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.17% (0.5546 => 0.5833, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (0.2040 => 0.2144, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.2103 => 0.2210, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.07% (1.9694 => 2.0692, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (0.4658 => 0.4893, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.3271 => 0.3435, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.80% (1.9966 => 2.0924, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 4.75% (0.7875 => 0.8249, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.62% (2.0346 => 2.1286, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.2969 => 0.3105, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.35% (0.2391 => 0.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (0.5361 => 0.5593, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.30% (0.7426 => 0.7745, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (0.2691 => 0.2806, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 4.13% (0.4847 => 0.5047, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (0.5584 => 0.5805, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.59% (11.6398 => 12.0577, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.41% (0.4253 => 0.4398, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.3498 => 0.3617, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.6926 => 4.8486, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 2.13% (11.9555 => 12.2102, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6603, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1730, std.dev.: 0.1477) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6319, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std.dev.: 0.0102) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5048, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.88% (3.1722 => 3.2318, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4545, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.28% (1.0927 => 1.1067, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6008, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.10% (2.4764 => 2.4491, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5622, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -10.32% (0.2402 => 0.2154, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9735, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8038, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std.dev.: 0.0101) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -2.87% (17.2379 => 16.7428, std.dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0439, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 17:50:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 19:50:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929005050.86DB62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4362?compare_to=4359&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4362, Order: 164864, Start Time: 2012-09-28 23:37:24, End Time: 2012-09-29 00:52:25 To: 4359, Order: 164845, Start Time: 2012-09-28 21:53:29, End Time: 2012-09-28 23:08:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 4 (177 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 966 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.89% (0.5334 => 0.5435, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.71% (55.6612 => 56.6103, std.dev.: 0.0717) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.45% (79.2685 => 80.4189, std.dev.: 0.2025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.15% (5.4228 => 5.4853, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0477 => 0.0476) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0477 => 0.0478, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.46% (0.0431 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0447 => 0.0446) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.68% (0.0443 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0432 => 0.0431) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0452 => 0.0452, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0427 => 0.0426) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0458 => 0.0457) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.44% (0.0459 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.94% (2.0176 => 2.4401, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0819 => 0.0929, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.71% (0.5818 => 0.6499, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.66% (0.1072 => 0.1197, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.53% (0.5748 => 0.6411, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.99% (0.7061 => 0.7837, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 10.81% (0.4328 => 0.4796, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.47% (3.9660 => 4.3811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.29% (0.4062 => 0.4480, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.08% (0.3899 => 0.4292, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.06% (1.3693 => 1.5071, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.95% (0.1327 => 0.1459, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.93% (0.7038 => 0.7737, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.84% (0.3485 => 0.3828, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.82% (1.9828 => 2.1776, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.79% (0.2726 => 0.2993, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.78% (0.2721 => 0.2987, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.74% (0.3489 => 0.3829, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.69% (1.2193 => 1.3375, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.69% (0.3756 => 0.4120, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.69% (0.5265 => 0.5775, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.6283 => 0.6890, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.64% (0.2966 => 0.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.63% (0.3293 => 0.3610, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.57% (0.2760 => 0.3024, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.53% (0.7710 => 0.8445, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.53% (0.3580 => 0.3921, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.52% (0.4390 => 0.4808, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.46% (0.4016 => 0.4396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.43% (0.3149 => 0.3446, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.43% (0.6959 => 0.7615, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 9.38% (0.3868 => 0.4231, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.36% (13.8202 => 15.1138, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.35% (0.2696 => 0.2948, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.29% (0.9199 => 1.0054, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.26% (1.4563 => 1.5912, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 9.14% (0.2988 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.10% (0.4791 => 0.5227, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.05% (1.1364 => 1.2393, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 9.02% (0.3192 => 0.3480, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.98% (0.3453 => 0.3763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.58% (0.2914 => 0.3164, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.55% (1.0313 => 1.1195, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.48% (0.5577 => 0.6050, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.44% (0.3246 => 0.3520, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.25% (0.2995 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1276 => 0.1381, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.19% (16.6129 => 17.9731, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.07% (0.6576 => 0.7107, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 7.98% (1.1061 => 1.1944, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.4379 => 0.4728, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 7.95% (3.8646 => 4.1717, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.95% (0.2127 => 0.2296, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.83% (0.8310 => 0.8961, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.71% (0.8698 => 0.9369, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (7.2180 => 7.7710, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.66% (3.6692 => 3.9501, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 7.65% (0.6744 => 0.7260, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.64% (0.3755 => 0.4042, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.62% (0.7506 => 0.8078, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.61% (0.5637 => 0.6066, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 7.58% (0.2243 => 0.2413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.56% (0.7460 => 0.8024, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.3220 => 0.3462, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.37% (1.0594 => 1.1375, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.31% (2.1791 => 2.3385, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 7.31% (3.1889 => 3.4221, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2023 => 0.2168, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.11% (1.9270 => 2.0640, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.06% (0.3245 => 0.3474, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.94% (0.4003 => 0.4281, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.3245 => 1.4150, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.74% (0.3650 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.73% (0.3789 => 0.4044, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.72% (0.3663 => 0.3909, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.65% (1.2292 => 1.3110, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.64% (1.2749 => 1.3595, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.61% (14.8535 => 15.8357, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 6.59% (0.4113 => 0.4384, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.58% (0.1657 => 0.1766, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.46% (0.8818 => 0.9388, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 6.40% (0.2859 => 0.3042, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.39% (4.3801 => 4.6601, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.38% (4.4433 => 4.7267, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.36% (8.4961 => 9.0363, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.33% (1.3813 => 1.4687, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.30% (1.1333 => 1.2047, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.29% (0.6135 => 0.6521, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (1.3819 => 1.4683, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.14% (4.6629 => 4.9492, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (13.2842 => 14.0828, std.dev.: 0.0081) MultiSource/Benchmarks/sim/sim: 5.97% (0.3131 => 0.3318, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.96% (14.5298 => 15.3963, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 5.92% (0.6250 => 0.6620, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.88% (3.2742 => 3.4667, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.86% (0.2321 => 0.2457, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.82% (6.5754 => 6.9583, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.75% (0.2504 => 0.2648, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.68% (0.4805 => 0.5078, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3511 => 0.3708, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.51% (4.9865 => 5.2612, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.21% (1.5188 => 1.5979, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.98% (0.9108 => 0.9562, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.93% (3.7467 => 3.9314, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.72% (2.1007 => 2.1999, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.68% (6.2785 => 6.5725, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 4.05% (33.2944 => 34.6434, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6905, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 25.63% (1.8175 => 2.2834, std.dev.: 0.0341) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2564, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.40% (0.1322 => 0.1433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7248, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.11% (10.7476 => 11.0823, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5867, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5833, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1864, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5963, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2226, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.78% (0.2670 => 0.2569, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.45% (22.5627 => 22.0096, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2820, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std.dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.37% (1.7688 => 1.7092, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7057, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2458, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2315, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2224, std.dev.: 0.0261) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 18:16:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 20:16:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929011647.C8F1A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4363?compare_to=4360&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4363, Order: 164864, Start Time: 2012-09-28 23:58:14, End Time: 2012-09-29 01:18:23 To: 4360, Order: 164851, Start Time: 2012-09-28 22:08:57, End Time: 2012-09-28 23:29:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (149 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (701 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.44% (20.2754 => 20.7695, std.dev.: 0.0204) MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (14.7740 => 14.9267, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.00% (1.0970 => 1.0860, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5763 => 0.5765, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.53% (15.9774 => 16.0622, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 0.29% (14.9409 => 14.9844, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 0.70% (83.1783 => 83.7616, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 0.23% (4.3426 => 4.3527, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.83% (0.0481 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.83% (0.0483 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.66% (0.0452 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.66% (0.0453 => 0.0456) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.68% (0.0441 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.68% (0.0443 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.66% (0.0452 => 0.0455, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0454 => 0.0456, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.67% (0.0447 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.45% (0.0449 => 0.0451) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.92% (0.0436 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.67% (0.0445 => 0.0448) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.66% (0.0455 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0457 => 0.0459, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.69% (0.0433 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.67% (0.0445 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.46% (0.0437 => 0.0439) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.70% (0.0426 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0464 => 0.0466) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.65% (0.0464 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.94% (0.0426 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.94% (0.0427 => 0.0431) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2334 => 1.2342, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.44% (7.5189 => 7.5519, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.53% (3.7114 => 3.7310, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.46% (0.6473 => 0.6503, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.28% (0.1432 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0647 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.44% (63.2438 => 83.7616, std.dev.: 0.0013) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.89% (0.0720 => 10.3204, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.98% (10.3673 => 14.9267, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 29.84% (0.1622 => 0.2106, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.40% (2.2022 => 2.5413, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.14% (7.0540 => 8.1217, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 14.46% (0.1432 => 0.1639, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.54% (0.1566 => 0.1778, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.51% (1.1194 => 1.2706, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.25% (1.7609 => 1.9766, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.27% (0.3282 => 0.3619, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.59% (0.3307 => 0.3591, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.22% (0.4879 => 0.5280, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 8.22% (0.1655 => 0.1791, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.18% (9.4845 => 10.2606, std.dev.: 0.0138) SingleSource/UnitTests/ObjC++/Hello: 8.17% (0.5925 => 0.6409, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.09% (0.6675 => 0.7215, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.05% (10.4361 => 11.2760, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.96% (0.3177 => 0.3430, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.90% (0.7433 => 0.8020, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.89% (0.2700 => 0.2913, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.80% (0.7115 => 0.7670, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.5105 => 0.5495, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 7.50% (5.7591 => 6.1909, std.dev.: 0.0145) MultiSource/Applications/sgefa/sgefa: 7.40% (0.3109 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.32% (0.4615 => 0.4953, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.28% (4.2646 => 4.5750, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: 7.21% (3.3354 => 3.5760, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 7.19% (0.3423 => 0.3669, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.14% (1.3050 => 1.3982, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.09% (0.2271 => 0.2432, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.08% (0.1625 => 0.1740, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.07% (1.5415 => 1.6505, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.00% (0.5860 => 0.6270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.97% (8.1363 => 8.7031, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.89% (0.1510 => 0.1614, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.80% (4.9449 => 5.2813, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.79% (0.8067 => 0.8615, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.77% (5.0018 => 5.3402, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.8172 => 0.8722, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4636 => 0.4945, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.66% (0.5569 => 0.5940, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.63% (0.3092 => 0.3297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.45% (0.2107 => 0.2243, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.42% (0.4064 => 0.4325, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.42% (0.7835 => 0.8338, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 6.42% (1.1642 => 1.2389, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4289 => 0.4564, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.39% (0.5020 => 0.5341, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.39% (0.3865 => 0.4112, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (1.1861 => 1.2610, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.30% (0.3650 => 0.3880, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.29% (0.4103 => 0.4361, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.26% (0.4203 => 0.4466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.22% (0.9765 => 1.0372, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (7.9617 => 8.4535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3283 => 0.3483, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3826 => 0.4059, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.07% (0.3162 => 0.3354, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.06% (0.2871 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3441 => 0.3649, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.03% (2.0665 => 2.1912, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 6.03% (3.8723 => 4.1058, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.03% (0.4048 => 0.4292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.02% (0.4620 => 0.4898, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.02% (1.0722 => 1.1367, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.00% (0.3603 => 0.3819, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.98% (21.9371 => 23.2488, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.97% (0.3180 => 0.3370, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.95% (0.2872 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3935 => 0.4164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.81% (1.5603 => 1.6509, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 5.79% (0.3387 => 0.3583, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3684 => 0.3897, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.77% (0.3379 => 0.3574, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.61% (0.2603 => 0.2749, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.55% (2.0273 => 2.1398, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6450 => 0.6792, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.22% (2.2969 => 2.4167, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.15% (0.8921 => 0.9380, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.13% (1.5859 => 1.6673, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5981 => 0.6270, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (14.3668 => 15.0476, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.73% (1.4186 => 1.4857, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.60% (2.2024 => 2.3037, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.1840 => 1.2351, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.2842 => 1.3379, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.06% (0.3131 => 0.3258, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.3427 => 0.3545, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.25% (0.8101 => 0.8364, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.28% (17.1811 => 17.5727, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.8922 => 3.9808, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.70% (3.6395 => 3.7742, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (4.2280 => 4.3586, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.27% (6.5088 => 6.5917, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2155, std.dev.: 0.0258) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.46% (5.2763 => 3.2471, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.16% (5.3855 => 3.9227, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.76% (5.3526 => 3.9201, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0730, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.11% (2.9384 => 2.6120, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -6.34% (22.1758 => 20.7695, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -12.23% (1.2373 => 1.0860, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2881, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1610, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4983, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (8.1563 => 7.9797, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.95% (8.6802 => 8.5110, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2526, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5089, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.70% (10.2830 => 10.1084, std.dev.: 0.0085) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.25% (0.5229 => 0.5765, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 7.16% (14.9895 => 16.0622, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 5.86% (14.1553 => 14.9844, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 5.89% (4.1105 => 4.3527, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.71% (1.1048 => 1.2342, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.50% (7.1582 => 7.5519, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.74% (3.4629 => 3.7310, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.52% (0.6222 => 0.6503, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 18:34:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 20:34:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929013424.33E642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4364?compare_to=4358&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4364, Order: 164864, Start Time: 2012-09-29 00:12:40, End Time: 2012-09-29 01:36:01 To: 4358, Order: 164839, Start Time: 2012-09-28 20:37:33, End Time: 2012-09-28 22:01:29 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (70 on baseline) Performance Improvements: 6 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 962 (779 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.21% (0.1425 => 0.1542, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.7587 => 0.7884, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.09% (0.6310 => 0.6442, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.75% (1.1687 => 1.1892, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.29% (1.2662 => 1.2825, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.87% (0.8376 => 0.8219, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -4.60% (4.2909 => 4.0937, std.dev.: 0.0736) MultiSource/Applications/SPASS/SPASS: -2.87% (8.5101 => 8.2655, std.dev.: 0.0793) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.49% (3.8208 => 3.7257, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.63% (3.6903 => 3.6303, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.27% (1.4446 => 1.4262, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.43% (1.0094 => 1.0051, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.6090 => 0.6092, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 1.23% (0.1627 => 0.1647, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.89% (0.1532 => 0.1561, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (0.3139 => 0.3071, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2401 => 0.2403, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.71% (0.3217 => 0.3240, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (0.2350 => 0.2313, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel: 17.62% (0.0386 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 87.50% (0.0048 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 36.72% (0.0177 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.21% (0.0112 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.27% (0.0394 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.02% (0.0228 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.39% (0.0287 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.22% (0.0328 => 0.0324, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -1.64% (0.0183 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 7.82% (0.0179 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 10.04% (0.0229 => 0.0252, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 3.13% (0.0288 => 0.0297, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.60% (0.1375 => 0.1452, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -3.37% (1.4523 => 1.4033, std.dev.: 0.0677) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.46% (0.1443 => 0.1464, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.37% (0.4097 => 0.4276, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.61% (0.1420 => 0.1383, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.49% (0.0613 => 0.0616, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.55% (0.0199 => 0.0178, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.89% (0.0558 => 0.0602, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.24% (1.1411 => 1.1270, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.24% (0.0563 => 0.0570, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.80% (0.0162 => 0.0220, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.7644 => 0.7654, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.11% (1.6030 => 1.6012, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.47% (0.0098 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.68% (4.1772 => 3.1046, std.dev.: 0.0425) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 9.14% (0.5309 => 0.5794, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 7.90% (2.1763 => 2.3482, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.61% (0.6410 => 0.6898, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 6.64% (0.6173 => 0.6583, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.15% (0.6069 => 0.6442, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.94% (1.0046 => 1.0643, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.1653 => 1.2328, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.58% (0.3582 => 0.3782, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.6915 => 0.7277, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.5150 => 1.5942, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 5.20% (15.3105 => 16.1067, std.dev.: 0.2512) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.02% (0.4880 => 0.5125, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3217 => 0.3378, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 4.53% (3.0225 => 3.1595, std.dev.: 0.0338) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.7639 => 0.7962, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.15% (0.2797 => 0.2913, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.10% (0.4248 => 0.4422, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.00% (0.3901 => 0.4057, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 3.95% (1.1440 => 1.1892, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 3.81% (29.3170 => 30.4330, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.72% (3.0758 => 3.1901, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.41% (1.1827 => 1.2230, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (12.6413 => 13.0719, std.dev.: 0.1488) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3062 => 0.3163, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.18% (13.3238 => 13.7470, std.dev.: 0.0724) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.15% (0.8569 => 0.8839, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 3.06% (14.6079 => 15.0553, std.dev.: 0.0087) MultiSource/Applications/hbd/hbd: 3.04% (1.3268 => 1.3671, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.97% (1.4408 => 1.4836, std.dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: 2.89% (4.7455 => 4.8826, std.dev.: 0.0493) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.0317 => 2.0875, std.dev.: 0.0157) MultiSource/Applications/siod/siod: 2.73% (2.0972 => 2.1545, std.dev.: 0.0205) MultiSource/Applications/treecc/treecc: 2.60% (1.8798 => 1.9287, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8405 => 0.8619, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (8.2186 => 8.4276, std.dev.: 0.0233) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.4908 => 6.6526, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.43% (1.2021 => 1.2313, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 2.27% (3.5980 => 3.6795, std.dev.: 0.0167) MultiSource/Applications/JM/lencod/lencod: 2.23% (14.7256 => 15.0538, std.dev.: 0.1219) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.12% (4.2616 => 4.3521, std.dev.: 0.0306) MultiSource/Benchmarks/nbench/nbench: 2.09% (1.0821 => 1.1047, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (6.2546 => 6.3794, std.dev.: 0.0454) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.60% (1.6538 => 2.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.71% (0.0766 => 0.0894, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.80% (1.7426 => 2.0005, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5496, std.dev.: 0.0195) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.98% (0.1433 => 0.1576, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.80% (7.0025 => 7.6189, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.79% (0.2857 => 0.3108, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 7.99% (21.1721 => 22.8640, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.27% (40.4792 => 43.0184, std.dev.: 0.2402) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3301 => 0.3505, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.93% (1.0063 => 1.0660, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/dt: 4.48% (0.9851 => 1.0292, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.04% (15.2242 => 15.8392, std.dev.: 0.0335) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.76% (3.4080 => 3.5361, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 3.11% (0.6308 => 0.6504, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 2.93% (3.8907 => 4.0047, std.dev.: 0.0312) MultiSource/Applications/siod/siod: 2.92% (3.5520 => 3.6557, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 2.86% (14.4877 => 14.9014, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.14% (6.6312 => 6.7729, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4013 => 2.4507, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.75% (1.6110 => 1.6392, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.4184 => 1.4388, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.09% (0.3497 => 0.2130, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.27% (5.2665 => 4.0937, std.dev.: 0.0736) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.45% (1.1647 => 0.9615, std.dev.: 0.0281) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.52% (15.8312 => 13.2163, std.dev.: 0.1223) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.43% (0.0917 => 0.0803, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.73% (3.2007 => 2.9532, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -7.24% (7.6833 => 7.1273, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/fibo: -6.67% (4.6355 => 4.3265, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.51% (2.0027 => 1.8724, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -6.17% (1.4441 => 1.3550, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -5.86% (3.4230 => 3.2224, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9328, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1886, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: -4.47% (0.4296 => 0.4104, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -4.21% (2.5166 => 2.4107, std.dev.: 0.0214) MultiSource/Applications/sgefa/sgefa: -4.08% (0.3746 => 0.3593, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (9.2503 => 8.9176, std.dev.: 0.0458) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.31% (1.2722 => 1.2301, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.18% (3.7496 => 3.6303, std.dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: -3.13% (8.5323 => 8.2655, std.dev.: 0.0793) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std.dev.: 0.0200) MultiSource/Benchmarks/PAQ8p/paq8p: -2.68% (92.7467 => 90.2615, std.dev.: 0.1480) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4140 => 0.4030, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.42% (1.1683 => 1.1400, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: -2.07% (6.7458 => 6.6064, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4171, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3646, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.85% (1.8739 => 1.8393, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2425, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/fldry: -1.46% (2.4971 => 2.4606, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3078, std.dev.: 0.0221) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.27% (27.1724 => 26.8279, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/lists: -1.15% (16.5617 => 16.3710, std.dev.: 0.0735) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.71% (0.9980 => 1.0051, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.16% (0.6022 => 0.6092, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1666 => 0.1647, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.45% (0.1554 => 0.1561, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (0.3083 => 0.3071, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.38% (0.2394 => 0.2403, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.05% (0.3175 => 0.3240, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.48% (0.2302 => 0.2313, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -8.62% (0.0325 => 0.0297, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -6.57% (1.5019 => 1.4033, std.dev.: 0.0677) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.47% (0.1501 => 0.1464, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.28% (0.4264 => 0.4276, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.90% (0.1344 => 0.1383, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.58% (0.0589 => 0.0616, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.79% (0.0639 => 0.0602, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.52% (0.0637 => 0.0570, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.57% (0.0246 => 0.0220, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.22% (1.5363 => 1.6012, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 19:57:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 21:57:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929025757.7C90E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4365?compare_to=4362&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4365, Order: 164869, Start Time: 2012-09-29 01:21:10, End Time: 2012-09-29 02:36:10 To: 4362, Order: 164864, Start Time: 2012-09-28 23:37:24, End Time: 2012-09-29 00:52:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 1 (177 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 967 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.29% (7.9434 => 8.0458, std.dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -1.88% (0.5435 => 0.5333, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.32% (5.4853 => 5.4129, std.dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0476 => 0.0477, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0478 => 0.0478) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0446 => 0.0447) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0447 => 0.0447, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0435 => 0.0435, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.45% (0.0446 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0447 => 0.0448) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0452 => 0.0452, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0427 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.44% (0.0457 => 0.0459, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0419 => 0.0420, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0421 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0429 => 0.0429) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.87% (2.0176 => 2.4386, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.03% (0.5818 => 0.6460, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.89% (0.5748 => 0.6374, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.81% (3.9660 => 4.3946, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 10.77% (0.4328 => 0.4794, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.56% (0.1013 => 0.1120, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.42% (0.7061 => 0.7797, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 10.28% (0.2781 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2782 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.07% (0.4062 => 0.4471, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 10.02% (1.3693 => 1.5065, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.95% (0.7710 => 0.8477, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.87% (0.7038 => 0.7733, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.82% (0.3899 => 0.4282, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.78% (0.2721 => 0.2987, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1327 => 0.1456, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.70% (0.3022 => 0.3315, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.68% (0.6283 => 0.6891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.58% (0.3485 => 0.3819, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.57% (1.2193 => 1.3360, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.52% (0.4390 => 0.4808, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.51% (0.6959 => 0.7621, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.48% (1.9828 => 2.1708, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 9.47% (0.2937 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.46% (0.9199 => 1.0069, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.42% (0.3756 => 0.4110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.41% (0.4016 => 0.4394, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.39% (0.2726 => 0.2982, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.36% (13.8202 => 15.1140, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3580 => 0.3915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3293 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.29% (0.3489 => 0.3813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.24% (0.2966 => 0.3240, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.24% (0.2761 => 0.3016, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.22% (1.4563 => 1.5906, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.4791 => 0.5231, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.13% (0.3868 => 0.4221, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.12% (1.1364 => 1.2400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.08% (0.3107 => 0.3389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3149 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.98% (0.3453 => 0.3763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.71% (0.3192 => 0.3470, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.63% (0.3534 => 0.3839, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 8.62% (1.0313 => 1.1202, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.54% (0.5577 => 0.6053, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.28% (0.2995 => 0.3243, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.22% (0.2945 => 0.3187, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 8.17% (16.6129 => 17.9694, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.15% (0.4379 => 0.4736, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.12% (1.1061 => 1.1959, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.09% (0.6576 => 0.7108, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.92% (3.8646 => 4.1708, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (3.6692 => 3.9540, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.76% (0.7460 => 0.8039, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.73% (7.2180 => 7.7756, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.65% (0.5637 => 0.6068, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.63% (0.8698 => 0.9362, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.56% (0.3755 => 0.4039, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.55% (0.6744 => 0.7253, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.55% (0.3220 => 0.3463, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.51% (3.1889 => 3.4284, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 7.47% (2.1791 => 2.3419, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1865 => 0.2002, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 7.32% (1.0594 => 1.1369, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 7.31% (0.2243 => 0.2407, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 7.29% (0.3623 => 0.3887, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.29% (1.9270 => 2.0674, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.1569 => 0.1683, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2023 => 0.2168, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.16% (0.3940 => 0.4222, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.00% (0.3245 => 0.3472, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.98% (1.3245 => 1.4170, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 6.96% (4.6629 => 4.9873, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.91% (4.3801 => 4.6828, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (1.3819 => 1.4755, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.75% (1.3813 => 1.4746, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 6.74% (8.4961 => 9.0686, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 6.69% (14.8535 => 15.8476, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.2859 => 0.3048, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.52% (1.2749 => 1.3580, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.44% (4.4433 => 4.7296, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.42% (1.1333 => 1.2061, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.41% (0.8818 => 0.9383, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.39% (0.4113 => 0.4376, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 6.35% (1.2292 => 1.3073, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.2140 => 0.2274, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.25% (14.5298 => 15.4378, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (13.2842 => 14.1057, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.10% (0.3131 => 0.3322, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.01% (3.2742 => 3.4711, std.dev.: 0.0138) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (6.5754 => 6.9658, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 5.76% (0.6250 => 0.6610, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.75% (0.3511 => 0.3713, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.75% (0.2504 => 0.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.72% (0.4805 => 0.5080, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.66% (4.9865 => 5.2689, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (1.5188 => 1.5970, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.12% (0.9108 => 0.9574, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.86% (3.7467 => 3.9289, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.67% (2.1007 => 2.1989, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.48% (6.2785 => 6.5600, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 4.26% (33.2944 => 34.7132, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.72% (16.2614 => 16.7039, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5200, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2567, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.64% (1.1560 => 1.2559, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.94% (10.7476 => 11.1715, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5896, std.dev.: 0.0043) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7731 => 3.8492, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5845, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2261, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.2986 => 2.3236, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5873, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.83% (0.4657 => 0.3920, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (22.5627 => 22.0055, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2308 => 1.0942, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2963, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5090, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9443, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9312, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2338, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7049, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1304, std.dev.: 0.0342) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2320, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2264, std.dev.: 0.0187) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 20:05:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 22:05:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929030554.D93B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4366?compare_to=4363&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4366, Order: 164874, Start Time: 2012-09-29 01:47:28, End Time: 2012-09-29 03:07:30 To: 4363, Order: 164864, Start Time: 2012-09-28 23:58:14, End Time: 2012-09-29 01:18:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (146 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.98% (0.3930 => 0.4047, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.54% (55.0685 => 56.4679, std.dev.: 0.0391) SingleSource/Benchmarks/Shootout/ary3: 1.16% (3.6942 => 3.7370, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5765 => 0.5760, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -0.54% (16.0622 => 15.9757, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: -0.54% (14.9844 => 14.9041, std.dev.: 0.0260) MultiSource/Benchmarks/Bullet/bullet: -0.57% (83.7616 => 83.2858, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: -0.21% (4.3527 => 4.3434, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0485 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0487 => 0.0486, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0455 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0456 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.67% (0.0446 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0455 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0456 => 0.0456, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0451 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0440 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.45% (0.0448 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0458 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0459 => 0.0459, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0448 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0466 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0467 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.33% (1.2342 => 1.2301, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.26% (7.5519 => 7.5320, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.17% (3.7310 => 3.7247, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.12% (0.6503 => 0.6495, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0649 => 0.0647, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.69% (63.2438 => 83.2858, std.dev.: 0.0055) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14249.86% (0.0720 => 10.3319, std.dev.: 0.0077) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.55% (10.3673 => 14.8824, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: 30.39% (0.1622 => 0.2115, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.06% (7.0540 => 8.1166, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.80% (2.2022 => 2.5281, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.91% (1.1194 => 1.2639, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.68% (1.7609 => 1.9666, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.95% (0.3543 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.09% (0.3282 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 8.40% (0.1440 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.22% (0.3307 => 0.3579, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 7.89% (9.4845 => 10.2333, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 7.87% (10.4361 => 11.2577, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.4879 => 0.5254, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6675 => 0.7185, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.4615 => 0.4961, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.48% (0.7115 => 0.7647, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2700 => 0.2897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.14% (0.7433 => 0.7964, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.13% (0.5105 => 0.5469, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.00% (0.2271 => 0.2430, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.98% (0.3109 => 0.3326, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.97% (0.2554 => 0.2732, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 6.90% (3.3354 => 3.5654, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 6.87% (0.3423 => 0.3658, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (4.2646 => 4.5516, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 6.71% (5.7591 => 6.1453, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (8.1363 => 8.6808, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.66% (1.5415 => 1.6441, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.66% (0.5860 => 0.6250, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.8172 => 0.8715, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.59% (1.3050 => 1.3910, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.58% (0.3422 => 0.3647, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.51% (4.9449 => 5.2667, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.47% (5.0018 => 5.3256, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.43% (0.4636 => 0.4934, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.8067 => 0.8576, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.30% (0.5569 => 0.5920, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.27% (0.2905 => 0.3087, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.23% (0.4289 => 0.4556, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.4103 => 0.4358, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.4064 => 0.4314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.13% (0.7835 => 0.8315, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.3650 => 0.3873, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.07% (0.4203 => 0.4458, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.06% (0.5020 => 0.5324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.05% (0.3865 => 0.4099, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.99% (0.3136 => 0.3324, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.6456 => 0.6843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (0.4620 => 0.4895, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.94% (2.0665 => 2.1892, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2756 => 0.2918, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.87% (21.9371 => 23.2245, std.dev.: 0.0162) MultiSource/Applications/Burg/burg: 5.87% (1.1642 => 1.2325, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 5.86% (0.3603 => 0.3814, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (7.9617 => 8.4271, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3098 => 0.3279, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.83% (0.3052 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3162 => 0.3344, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.76% (0.9765 => 1.0327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.3232 => 0.3418, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.73% (0.4048 => 0.4280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.72% (1.1861 => 1.2539, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.70% (3.8723 => 4.0932, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3826 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.4299 => 0.4542, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.65% (1.5603 => 1.6484, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.60% (0.3180 => 0.3358, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.60% (0.2877 => 0.3038, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.55% (0.3387 => 0.3575, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3935 => 0.4153, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3441 => 0.3631, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.48% (0.3684 => 0.3886, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.46% (1.0722 => 1.1307, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.30% (0.2603 => 0.2741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.16% (0.6450 => 0.6783, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 5.10% (2.0273 => 2.1307, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.78% (0.5981 => 0.6267, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.76% (0.8921 => 0.9346, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 4.56% (2.2969 => 2.4017, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.53% (1.5859 => 1.6578, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (14.3668 => 14.9992, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.26% (1.4186 => 1.4791, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.05% (1.1840 => 1.2320, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.99% (2.2024 => 2.2903, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.98% (1.2842 => 1.3353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.81% (0.8101 => 0.8329, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.79% (17.1811 => 17.4881, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.63% (3.8922 => 3.9557, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.34% (2.8904 => 3.2181, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (3.1578 => 3.3832, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.1396 => 1.2157, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7630, std.dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (4.2280 => 4.3631, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2456, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7997, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 1.02% (3.6994 => 3.7370, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.65% (5.2763 => 3.2371, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.49% (5.3855 => 3.9048, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.11% (5.3526 => 3.9015, std.dev.: 0.0104) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1037, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.23% (2.9384 => 2.6085, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -6.64% (22.1758 => 20.7039, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -11.80% (1.2373 => 1.0913, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.48% (1.5373 => 1.3762, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.19% (19.9488 => 18.3147, std.dev.: 0.1095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.50% (3.2827 => 3.1677, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4956, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.12% (8.6802 => 8.4965, std.dev.: 0.0119) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0979, std.dev.: 0.0190) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2531, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0164, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4247, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.25% (6.2999 => 6.2211, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.15% (0.5229 => 0.5760, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.58% (14.9895 => 15.9757, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 5.29% (14.1553 => 14.9041, std.dev.: 0.0260) MultiSource/Benchmarks/MallocBench/gs/gs: 5.67% (4.1105 => 4.3434, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.34% (1.1048 => 1.2301, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.22% (7.1582 => 7.5320, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.56% (3.4629 => 3.7247, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.39% (0.6222 => 0.6495, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 20:13:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 22:13:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929031323.330682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4367?compare_to=4364&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4367, Order: 164874, Start Time: 2012-09-29 01:51:55, End Time: 2012-09-29 03:15:00 To: 4364, Order: 164864, Start Time: 2012-09-29 00:12:40, End Time: 2012-09-29 01:36:01 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 15 (84 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 956 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5471 => 0.5629, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.74% (0.7891 => 0.8107, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.45% (0.8074 => 0.8272, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 1.17% (2.1545 => 2.1796, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 5.78% (3.1731 => 3.3566, std.dev.: 0.0575) MultiSource/Benchmarks/Olden/tsp/tsp: 3.52% (1.7449 => 1.8064, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (13.2163 => 13.6774, std.dev.: 0.0587) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.12% (4.0937 => 4.2215, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.81% (5.2505 => 5.3982, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.52% (2.6827 => 2.7504, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.76% (4.8435 => 4.9288, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.61% (1.2421 => 1.2621, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.53% (5.3455 => 5.4271, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.41% (39.1885 => 39.7403, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.13% (1.4262 => 1.4423, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.00% (43.0184 => 42.1559, std.dev.: 0.2922) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6392 => 1.6167, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.31% (1.0051 => 1.0082, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -0.02% (0.6092 => 0.6091, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 2.06% (0.1647 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.02% (0.1561 => 0.1577, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.64% (0.3071 => 0.3152, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.12% (0.2403 => 0.2328, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (0.3240 => 0.3198, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2313 => 0.2317, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel: -1.54% (0.0454 => 0.0447, std.dev.: 0.0047) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0242 => 0.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.34% (0.0194 => 0.0172, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0389 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -17.31% (0.0283 => 0.0234, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.10% (0.0324 => 0.0301, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0180 => 0.0181, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0193 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.79% (0.0252 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 5.72% (0.0297 => 0.0314, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 20.00% (0.0005 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1452 => 0.1453, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.25% (1.4033 => 1.5051, std.dev.: 0.0296) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1464 => 0.1486, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.94% (0.4276 => 0.4022, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1383 => 0.1383, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.46% (0.0616 => 0.0625, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.18% (0.0178 => 0.0189, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.49% (0.0602 => 0.0587, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1270 => 1.1293, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 108.33% (0.0012 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.81% (0.0570 => 0.0586, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.45% (0.0220 => 0.0186, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7654 => 0.7662, std.dev.: 0.0174) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.26% (1.6012 => 1.5970, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.48% (4.1772 => 3.0710, std.dev.: 0.0499) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 8.60% (2.1763 => 2.3634, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.38% (0.6410 => 0.6947, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 7.72% (0.5309 => 0.5719, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.67% (0.6173 => 0.6585, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.40% (1.0046 => 1.0689, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.06% (0.3582 => 0.3799, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 5.92% (1.1653 => 1.2343, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 5.82% (15.3105 => 16.2014, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 5.39% (1.1440 => 1.2057, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.09% (0.2552 => 0.2682, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.7722 => 0.8107, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.74% (0.3901 => 0.4086, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.73% (0.6069 => 0.6356, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 4.73% (0.6915 => 0.7242, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (1.5150 => 1.5862, std.dev.: 0.0104) MultiSource/Applications/d/make_dparser: 4.47% (3.0225 => 3.1577, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (0.7639 => 0.7967, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 4.15% (29.3170 => 30.5326, std.dev.: 0.3723) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (12.6413 => 13.1615, std.dev.: 0.1160) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3062 => 0.3187, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.08% (13.3238 => 13.8670, std.dev.: 0.0266) MultiSource/Applications/siod/siod: 3.93% (2.0972 => 2.1796, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 3.93% (0.2877 => 0.2990, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.81% (0.4248 => 0.4410, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.79% (0.8569 => 0.8894, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.72% (0.2797 => 0.2901, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3217 => 0.3336, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.25% (0.3418 => 0.3529, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.23% (3.0758 => 3.1751, std.dev.: 0.0339) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1672 => 1.2027, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 2.88% (3.5980 => 3.7017, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.87% (1.2021 => 1.2366, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.4908 => 6.6770, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (2.0317 => 2.0879, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.7256 => 15.1081, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (4.0318 => 4.1361, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (6.2546 => 6.4151, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.4408 => 1.4764, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.0821 => 1.1086, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.1827 => 1.2113, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 2.40% (14.6079 => 14.9592, std.dev.: 0.0652) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.32% (4.2616 => 4.3606, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 2.26% (1.8798 => 1.9222, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8796 => 3.9660, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.16% (0.5937 => 0.6065, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.4113 => 1.4412, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5520 => 0.5629, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.0689 => 1.0891, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.54% (4.2815 => 4.3473, std.dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.05% (3.4629 => 4.2263, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.54% (0.0766 => 0.0931, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 15.84% (1.7426 => 2.0187, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.50% (0.0917 => 0.1050, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 13.96% (0.1433 => 0.1633, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5475, std.dev.: 0.0367) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.2857 => 0.3120, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6056, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.13% (1.0063 => 1.0881, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.40% (4.2129 => 4.3981, std.dev.: 0.0222) MultiSource/Benchmarks/Olden/tsp/tsp: 4.24% (1.7330 => 1.8064, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.14% (40.4792 => 42.1559, std.dev.: 0.2922) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5424, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 3.69% (15.2242 => 15.7865, std.dev.: 0.0507) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.51% (0.5587 => 0.5783, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.20% (0.8498 => 0.8770, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.18% (2.6656 => 2.7504, std.dev.: 0.0124) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8987, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/mason/mason: 2.58% (0.5004 => 0.5133, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 2.40% (3.5520 => 3.6374, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.22% (6.6312 => 6.7782, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 2.16% (2.4013 => 2.4532, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.09% (38.9255 => 39.7403, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.08% (4.6127 => 4.7087, std.dev.: 0.0283) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.45% (4.6414 => 4.7086, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.42% (4.0659 => 4.1235, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 1.12% (5.1938 => 5.2520, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.04% (5.8830 => 5.9439, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.38% (0.3497 => 0.2120, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.84% (5.2665 => 4.2215, std.dev.: 0.0417) SingleSource/Benchmarks/Shootout-C++/ary3: -19.80% (1.7473 => 1.4013, std.dev.: 0.0455) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.1647 => 0.9607, std.dev.: 0.0322) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.60% (15.8312 => 13.6774, std.dev.: 0.0587) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0283) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.75% (3.2007 => 2.9527, std.dev.: 0.0142) MultiSource/Applications/lambda-0_1_3/lambda: -7.13% (7.6833 => 7.1355, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3727, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8726, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (4.6355 => 4.3351, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/richards_benchmark: -6.32% (1.4441 => 1.3528, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: -5.91% (3.4230 => 3.2208, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/distray/distray: -5.63% (0.2664 => 0.2514, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9226, std.dev.: 0.1610) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7254, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1888, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.16% (0.3746 => 0.3590, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.11% (2.5166 => 2.4132, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.76% (1.2722 => 1.2244, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/methcall: -3.46% (9.2503 => 8.9299, std.dev.: 0.0583) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.88% (1.4021 => 1.3617, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/misr: -2.75% (0.4296 => 0.4178, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.74% (3.7496 => 3.6469, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2877, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.61% (1.2959 => 1.2621, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -2.41% (29.5232 => 28.8119, std.dev.: 0.0316) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (92.7467 => 90.6264, std.dev.: 0.6224) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.23% (1.1683 => 1.1423, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: -2.18% (6.7458 => 6.5986, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4197, std.dev.: 0.0078) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3632, std.dev.: 0.0233) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (9.3855 => 9.2377, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.46% (1.8739 => 1.8465, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3186, std.dev.: 0.1128) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.29% (27.1724 => 26.8210, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/lists: -1.14% (16.5617 => 16.3732, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.03% (1.7361 => 1.7183, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.02% (0.9980 => 1.0082, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.15% (0.6022 => 0.6091, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 0.90% (0.1666 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.48% (0.1554 => 0.1577, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.3083 => 0.3152, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.76% (0.2394 => 0.2328, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.72% (0.3175 => 0.3198, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2302 => 0.2317, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel: -0.45% (0.0449 => 0.0447, std.dev.: 0.0047) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.42% (0.0192 => 0.0172, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -17.61% (0.0284 => 0.0234, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.10% (0.0324 => 0.0301, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -3.38% (0.0325 => 0.0314, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 0.21% (1.5019 => 1.5051, std.dev.: 0.0296) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.00% (0.1501 => 0.1486, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.68% (0.4264 => 0.4022, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.90% (0.1344 => 0.1383, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.0589 => 0.0625, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.53% (0.0232 => 0.0189, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1350 => 1.1293, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 316.67% (0.0006 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.01% (0.0637 => 0.0586, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.39% (0.0246 => 0.0186, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0174) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.95% (1.5363 => 1.5970, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 20:26:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 22:26:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929032626.D88B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4368?compare_to=4361&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4368, Order: 164866, Start Time: 2012-09-29 00:43:41, End Time: 2012-09-29 03:28:01 To: 4361, Order: 164845, Start Time: 2012-09-28 21:30:30, End Time: 2012-09-29 00:14:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 968 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.24% (1.7503 => 1.7720, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.2090 => 0.2233, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.64% (0.0468 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.64% (0.0469 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.68% (0.0439 => 0.0442, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0429 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.71% (0.0422 => 0.0425) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.45% (0.0441 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.47% (0.0424 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.71% (0.0425 => 0.0428, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.46% (0.0432 => 0.0434) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.68% (0.0442 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.48% (0.0418 => 0.0420) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.47% (0.0422 => 0.0424) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0451 => 0.0451, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.73% (0.0413 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0421 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3496 => 0.3915, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.98% (0.3488 => 0.3906, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.93% (0.3446 => 0.3857, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.89% (0.3465 => 0.3877, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.88% (0.3460 => 0.3871, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 11.73% (0.3469 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.73% (0.3650 => 0.4078, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.57% (0.1063 => 0.1186, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.3724 => 0.4148, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 11.22% (1.5932 => 1.7720, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 9.42% (0.5826 => 0.6375, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 9.41% (0.5889 => 0.6443, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.11% (1.6211 => 1.7526, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.96% (0.3004 => 0.3243, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.93% (0.2875 => 0.3103, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7171 => 0.7734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.2780 => 0.2998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2813 => 0.3033, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 7.79% (0.2823 => 0.3043, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.73% (0.3195 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.64% (0.4361 => 0.4694, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.60% (1.3152 => 1.4152, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.53% (0.2750 => 0.2957, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2792 => 0.3002, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.51% (0.9909 => 1.0653, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 7.49% (5.5417 => 5.9570, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2729 => 0.2933, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.47% (0.2811 => 0.3021, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.47% (3.5627 => 3.8287, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.40% (2.0673 => 2.2202, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 7.35% (1.0781 => 1.1573, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.32% (0.3060 => 0.3284, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2911 => 0.3123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3258 => 0.3494, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.19% (0.3267 => 0.3502, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.19% (0.4994 => 0.5353, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.12% (2.7292 => 2.9236, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3625 => 0.3881, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.96% (0.3317 => 0.3548, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.96% (0.3362 => 0.3596, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.96% (0.3348 => 0.3581, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.95% (0.3930 => 0.4203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.95% (0.3124 => 0.3341, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.87% (0.3726 => 0.3982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3678 => 0.3930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.83% (0.4146 => 0.4429, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3477 => 0.3712, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.74% (4.2109 => 4.4948, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.73% (0.3282 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.70% (0.2566 => 0.2738, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.68% (0.5000 => 0.5334, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.67% (0.3690 => 0.3936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (0.4251 => 0.4534, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.54% (4.4195 => 4.7087, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.2736 => 0.2915, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.43% (0.3981 => 0.4237, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.42% (0.6634 => 0.7060, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 6.38% (0.4029 => 0.4286, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (0.5026 => 0.5346, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.35% (0.2866 => 0.3048, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.33% (0.2068 => 0.2199, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.31% (1.8794 => 1.9980, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.29% (0.3845 => 0.4087, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.29% (2.1013 => 2.2335, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 6.29% (4.6177 => 4.9082, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.26% (0.6435 => 0.6838, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 6.23% (23.5202 => 24.9854, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (0.2040 => 0.2167, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.21% (2.1653 => 2.2998, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (0.3890 => 0.4128, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.11% (0.4139 => 0.4392, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.5900 => 0.6258, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.3271 => 0.3469, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 6.03% (1.4269 => 1.5130, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.5012 => 0.5312, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (0.2691 => 0.2850, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.77% (0.2737 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.76% (0.3903 => 0.4128, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.71% (0.3084 => 0.3260, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.68% (0.5546 => 0.5861, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.52% (2.0346 => 2.1469, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.50% (0.4658 => 0.4914, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.42% (1.9966 => 2.1049, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (1.9694 => 2.0757, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 5.40% (0.3336 => 0.3516, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.37% (0.2103 => 0.2216, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 5.32% (0.7875 => 0.8294, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.19% (0.2969 => 0.3123, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 5.10% (0.2391 => 0.2513, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.96% (0.9697 => 1.0178, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.75% (0.7426 => 0.7779, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 4.75% (0.4847 => 0.5077, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.74% (0.5361 => 0.5615, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.53% (0.5584 => 0.5837, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.90% (11.6398 => 12.0940, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.6926 => 4.8604, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.3498 => 0.3622, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.32% (0.4253 => 0.4394, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.77% (0.3792 => 0.3897, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.58% (11.9555 => 12.2634, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6431, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5039, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4381, std.dev.: 0.0267) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2819, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5150, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5769, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5395, std.dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8032, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7952, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.27% (17.2379 => 16.8458, std.dev.: 0.0242) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5725, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0438, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 21:38:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 23:38:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929043830.A61882A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/4369?compare_to=4365&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4369, Order: 164880, Start Time: 2012-09-29 03:25:05, End Time: 2012-09-29 04:40:04 To: 4365, Order: 164869, Start Time: 2012-09-29 01:21:10, End Time: 2012-09-29 02:36:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 1 (175 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 969 (698 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.09% (1.1959 => 1.2089, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.42% (0.0477 => 0.0479, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.42% (0.0478 => 0.0480, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.89% (0.0447 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.47% (0.0430 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0448 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.45% (0.0448 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.70% (0.0431 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.69% (0.0432 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.67% (0.0449 => 0.0452) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0452 => 0.0454, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.70% (0.0430 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.71% (0.0421 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.71% (0.0420 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.47% (0.0422 => 0.0424) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.70% (0.0428 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.47% (0.0429 => 0.0431, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.51% (2.0176 => 2.4515, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.18% (0.4328 => 0.4812, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 11.17% (0.7061 => 0.7850, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.70% (3.9660 => 4.3903, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.41% (0.4062 => 0.4485, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.7038 => 0.7762, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.21% (0.3899 => 0.4297, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1842, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.11% (1.3693 => 1.5078, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.10% (0.3485 => 0.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.06% (0.3022 => 0.3326, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.03% (0.2721 => 0.2994, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.91% (0.4390 => 0.4825, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.82% (1.2193 => 1.3390, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.74% (0.4016 => 0.4407, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.72% (0.3293 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.71% (0.7710 => 0.8459, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.69% (0.6283 => 0.6892, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.68% (0.2696 => 0.2957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.61% (0.6959 => 0.7628, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.59% (0.9199 => 1.0081, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.58% (0.3756 => 0.4116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.56% (0.3107 => 0.3404, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.56% (1.4563 => 1.5955, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.38% (13.8202 => 15.1170, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.36% (0.3868 => 0.4230, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.35% (1.1364 => 1.2427, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.35% (0.4791 => 0.5239, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.33% (0.3453 => 0.3775, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 9.29% (1.1061 => 1.2089, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.82% (1.0313 => 1.1223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.68% (0.2914 => 0.3167, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.66% (0.1478 => 0.1606, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.59% (0.5577 => 0.6056, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 8.58% (0.2995 => 0.3252, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.46% (3.8646 => 4.1917, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.38% (0.3246 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.32% (3.6692 => 3.9743, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.20% (0.4379 => 0.4738, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 8.13% (16.6129 => 17.9630, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 8.03% (0.8310 => 0.8977, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (7.2180 => 7.7934, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.91% (0.3755 => 0.4052, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.86% (0.6744 => 0.7274, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.82% (0.5637 => 0.6078, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3220 => 0.3471, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.79% (0.8698 => 0.9376, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.77% (0.6576 => 0.7087, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.73% (0.2925 => 0.3151, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.61% (0.7460 => 0.8028, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 7.58% (0.2243 => 0.2413, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.53% (3.1889 => 3.4290, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 7.45% (1.0594 => 1.1383, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 7.44% (2.1791 => 2.3412, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3578 => 0.3842, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.30% (1.9270 => 2.0676, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.19% (0.3601 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.15% (0.3245 => 0.3477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.11% (1.3245 => 1.4187, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.91% (14.8535 => 15.8800, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 6.87% (1.2749 => 1.3625, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.4113 => 0.4390, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.72% (1.2292 => 1.3118, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.71% (8.4961 => 9.0661, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.66% (1.3813 => 1.4733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.65% (1.3819 => 1.4738, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.63% (1.1333 => 1.2084, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.2859 => 0.3048, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.53% (0.8818 => 0.9394, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.52% (4.3801 => 4.6655, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 6.51% (6.5754 => 7.0037, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.46% (4.4433 => 4.7302, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.41% (13.2842 => 14.1361, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.37% (0.6135 => 0.6526, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.31% (4.6629 => 4.9571, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.25% (14.5298 => 15.4372, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.12% (3.2742 => 3.4747, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6250 => 0.6629, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.90% (0.3511 => 0.3718, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.79% (0.2504 => 0.2649, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.74% (4.9865 => 5.2727, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.70% (0.4805 => 0.5079, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.38% (0.9108 => 0.9598, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.21% (1.5188 => 1.5979, std.dev.: 0.0173) MultiSource/Applications/lua/lua: 4.98% (3.7467 => 3.9334, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.80% (2.1007 => 2.2015, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5675, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 4.22% (33.2944 => 34.7005, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7220, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.73% (5.7573 => 7.5264, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 25.75% (1.8175 => 2.2855, std.dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4127, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.05% (10.7476 => 11.0758, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5946, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5161, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5840, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.16% (1.5824 => 1.6008, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5988, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2246, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.49% (22.5627 => 22.0014, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2865, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1576, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7097, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2314, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1616, std.dev.: 0.0296) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 21:53:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 23:53:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929045331.873B92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4370?compare_to=4367&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4370, Order: 164880, Start Time: 2012-09-29 03:30:53, End Time: 2012-09-29 04:53:33 To: 4367, Order: 164874, Start Time: 2012-09-29 01:51:55, End Time: 2012-09-29 03:15:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 10 (77 on baseline) Performance Improvements: 5 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 958 (768 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 9.10% (0.1495 => 0.1631, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.66% (0.1408 => 0.1530, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.77% (0.9413 => 0.9580, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.14% (1.2027 => 1.2164, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.62% (21.6016 => 24.1109, std.dev.: 0.1466) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.21% (2.2814 => 2.3774, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.00% (2.3648 => 2.4122, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/richards_benchmark: 1.65% (1.3528 => 1.3751, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.39% (22.0476 => 22.3549, std.dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (8.9299 => 9.0223, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -2.37% (1.2057 => 1.1771, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.8894 => 0.8756, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (13.6774 => 12.9702, std.dev.: 0.2215) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.51% (39.7403 => 39.1412, std.dev.: 0.2019) MultiSource/Applications/minisat/minisat: -1.02% (6.2156 => 6.1524, std.dev.: 0.0219) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.11% (1.0082 => 1.0093, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 0.69% (0.6091 => 0.6133, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -3.99% (0.1681 => 0.1614, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1577 => 0.1580, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.82% (0.3152 => 0.3126, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.01% (0.2328 => 0.2398, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.31% (0.3198 => 0.3208, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.56% (0.2317 => 0.2304, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.57% (0.0447 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -55.56% (0.0090 => 0.0040, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.24% (0.0241 => 0.0244, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.05% (0.0172 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.59% (0.0390 => 0.0376, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.30% (0.0304 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 20.51% (0.0234 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.65% (0.0301 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -2.21% (0.0181 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.07% (0.0193 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0250 => 0.0249, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 3.82% (0.0314 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -16.67% (0.0006 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.69% (0.1453 => 0.1443, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -0.41% (1.5051 => 1.4990, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.62% (0.1486 => 0.1510, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.69% (0.4022 => 0.4251, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.18% (0.1383 => 0.1427, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.0625 => 0.0613, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.58% (0.0189 => 0.0226, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.70% (0.0587 => 0.0577, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1293 => 1.1291, std.dev.: 0.0536) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -48.00% (0.0025 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.19% (0.0586 => 0.0579, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.29% (0.0186 => 0.0165, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.46% (0.7662 => 0.7697, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.22% (1.5970 => 1.6005, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.94% (4.1772 => 3.0519, std.dev.: 0.1202) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0107) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.03% (0.0745 => 0.0924, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 8.78% (2.1763 => 2.3674, std.dev.: 0.0315) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.20% (0.1414 => 0.1530, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 7.82% (0.5309 => 0.5724, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.49% (0.6410 => 0.6890, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 6.56% (0.6173 => 0.6578, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.50% (0.2552 => 0.2718, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.99% (1.0046 => 1.0648, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.95% (0.3582 => 0.3795, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.80% (0.6915 => 0.7316, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 5.65% (1.1653 => 1.2311, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 5.64% (15.3105 => 16.1737, std.dev.: 0.2252) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.6069 => 0.6384, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (1.5150 => 1.5927, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.86% (0.4880 => 0.5117, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.71% (29.3170 => 30.6971, std.dev.: 0.1525) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.54% (0.2797 => 0.2924, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1672 => 1.2164, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.07% (0.4248 => 0.4421, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (12.6413 => 13.1548, std.dev.: 0.0488) MultiSource/Applications/d/make_dparser: 4.02% (3.0225 => 3.1440, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.97% (0.3901 => 0.4056, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 3.85% (13.3238 => 13.8371, std.dev.: 0.0593) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3062 => 0.3179, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.66% (0.7722 => 0.8005, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.2186 => 8.4873, std.dev.: 0.0738) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.12% (6.2546 => 6.4499, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.05% (1.2021 => 1.2388, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.03% (1.4408 => 1.4844, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 2.91% (2.0972 => 2.1582, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 2.89% (1.1440 => 1.1771, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (4.0318 => 4.1477, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 2.80% (1.3268 => 1.3640, std.dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0821 => 1.1123, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.3847 => 0.3950, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.67% (3.0758 => 3.1579, std.dev.: 0.0280) MultiSource/Applications/oggenc/oggenc: 2.58% (4.7455 => 4.8681, std.dev.: 0.0292) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.4908 => 6.6572, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.4113 => 1.4459, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.0317 => 2.0799, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.33% (14.6079 => 14.9476, std.dev.: 0.0758) MultiSource/Applications/treecc/treecc: 2.28% (1.8798 => 1.9227, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.18% (0.8569 => 0.8756, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (1.3935 => 1.4237, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8405 => 0.8582, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 2.09% (3.5980 => 3.6731, std.dev.: 0.0267) MultiSource/Applications/JM/lencod/lencod: 2.00% (14.7256 => 15.0205, std.dev.: 0.0831) MultiSource/Applications/hexxagon/hexxagon: 1.64% (0.9425 => 0.9580, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.23% (0.0766 => 0.0898, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0034, std.dev.: 0.0208) MultiSource/Benchmarks/nbench/nbench: 13.88% (21.1721 => 24.1109, std.dev.: 0.1466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.44% (4.0101 => 4.5490, std.dev.: 0.0780) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6099, std.dev.: 0.0339) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.19% (0.2857 => 0.3091, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.20% (1.0063 => 1.0788, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.95% (4.2129 => 4.4635, std.dev.: 0.0670) MultiSource/Benchmarks/Olden/tsp/tsp: 4.93% (1.7330 => 1.8185, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: 4.41% (15.2242 => 15.8954, std.dev.: 0.0359) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.11% (40.4792 => 42.1449, std.dev.: 0.1825) SingleSource/Benchmarks/Misc/dt: 4.02% (0.9851 => 1.0247, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8887, std.dev.: 0.0158) MultiSource/Benchmarks/sim/sim: 2.72% (3.8907 => 3.9964, std.dev.: 0.0396) MultiSource/Benchmarks/FreeBench/mason/mason: 2.48% (0.5004 => 0.5128, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 2.39% (3.5520 => 3.6368, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash: 2.31% (0.6308 => 0.6454, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.20% (2.6656 => 2.7242, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.14% (0.5876 => 0.6002, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (6.6312 => 6.7722, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.89% (4.6127 => 4.6999, std.dev.: 0.0217) SingleSource/Benchmarks/Dhrystone/dry: 1.86% (2.4013 => 2.4459, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 1.38% (1.4184 => 1.4380, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.46% (5.2665 => 4.1361, std.dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/ary3: -20.57% (1.7473 => 1.3878, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.07% (15.8312 => 12.9702, std.dev.: 0.2215) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.1647 => 0.9605, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.30% (0.0917 => 0.0795, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.94% (3.2007 => 2.9466, std.dev.: 0.0291) MultiSource/Applications/lambda-0_1_3/lambda: -7.20% (7.6833 => 7.1303, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3752, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: -6.61% (4.6355 => 4.3290, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -6.23% (3.4230 => 3.2098, std.dev.: 0.0672) MultiSource/Applications/sgefa/sgefa: -6.14% (0.3746 => 0.3516, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.10% (2.9728 => 2.7916, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.45% (62.4126 => 59.0116, std.dev.: 0.0619) MultiSource/Benchmarks/FreeBench/distray/distray: -5.33% (0.2664 => 0.2522, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1892, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -4.78% (1.4441 => 1.3751, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -4.31% (2.5166 => 2.4081, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.03% (45.4683 => 43.6362, std.dev.: 0.5629) SingleSource/Benchmarks/Misc/flops: -2.63% (9.5474 => 9.2965, std.dev.: 0.0462) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1381, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -2.58% (29.5232 => 28.7614, std.dev.: 0.1167) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.54% (0.4140 => 0.4035, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -2.46% (9.2503 => 9.0223, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -2.44% (6.7458 => 6.5810, std.dev.: 0.0424) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.38% (3.7496 => 3.6604, std.dev.: 0.0191) MultiSource/Benchmarks/PAQ8p/paq8p: -2.32% (92.7467 => 90.5924, std.dev.: 0.7341) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.92% (2.3569 => 2.3116, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4236, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.76% (1.7361 => 1.7055, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2234, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.63% (1.8739 => 1.8434, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.39% (27.1724 => 26.7944, std.dev.: 0.0296) SingleSource/Benchmarks/Dhrystone/fldry: -1.38% (2.4971 => 2.4626, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.16% (6.2244 => 6.1524, std.dev.: 0.0219) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.04% (2.8964 => 2.8663, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.13% (0.9980 => 1.0093, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 1.84% (0.6022 => 0.6133, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -3.12% (0.1666 => 0.1614, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.67% (0.1554 => 0.1580, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (0.3083 => 0.3126, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2394 => 0.2398, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (0.3175 => 0.3208, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.09% (0.2302 => 0.2304, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -55.56% (0.0090 => 0.0040, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.59% (0.0390 => 0.0376, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.78% (0.0324 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1429 => 0.1443, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -0.19% (1.5019 => 1.4990, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.60% (0.1501 => 0.1510, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.30% (0.4264 => 0.4251, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.18% (0.1344 => 0.1427, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 100.00% (0.0001 => 0.0002, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.59% (0.0232 => 0.0226, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.70% (0.0639 => 0.0577, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1350 => 1.1291, std.dev.: 0.0536) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.11% (0.0637 => 0.0579, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (0.0246 => 0.0165, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.07% (0.7541 => 0.7697, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.18% (1.5363 => 1.6005, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 21:56:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 28 Sep 2012 23:56:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929045608.88BC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4371?compare_to=4366&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4371, Order: 164880, Start Time: 2012-09-29 03:36:33, End Time: 2012-09-29 04:56:39 To: 4366, Order: 164874, Start Time: 2012-09-29 01:47:28, End Time: 2012-09-29 03:07:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 949 (706 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.26% (77.5305 => 80.8338, std.dev.: 0.1207) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5760 => 0.5752, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: -0.03% (15.9757 => 15.9717, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 0.32% (14.9041 => 14.9515, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 0.15% (83.2858 => 83.4067, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.3434 => 4.3415, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0485 => 0.0483, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0486 => 0.0485, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0454 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0455 => 0.0454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0443 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.44% (0.0455 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.44% (0.0456 => 0.0454, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0449 => 0.0448, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.45% (0.0441 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0446 => 0.0446, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.44% (0.0458 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0459 => 0.0458, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0447 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0465 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0466 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0429 => 0.0428) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2301 => 1.2314, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.46% (7.5320 => 7.5663, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.28% (3.7247 => 3.7350, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.46% (0.6495 => 0.6525, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.88% (63.2438 => 83.4067, std.dev.: 0.0120) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.42% (0.0720 => 10.3215, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.44% (10.3673 => 14.9741, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/richards_benchmark: 29.65% (0.1622 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.03% (2.2022 => 2.5332, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.83% (7.0540 => 8.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.27% (1.1194 => 1.2679, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.66% (1.7609 => 1.9663, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.09% (0.3282 => 0.3613, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.92% (0.3307 => 0.3602, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 8.01% (10.4361 => 11.2720, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.99% (0.4879 => 0.5269, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.84% (9.4845 => 10.2279, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.6675 => 0.7196, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.72% (0.7115 => 0.7664, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.31% (0.5105 => 0.5478, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.24% (0.7433 => 0.7971, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.22% (0.2700 => 0.2895, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 7.17% (0.3109 => 0.3332, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.16% (0.3422 => 0.3667, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.12% (0.4636 => 0.4966, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.04% (0.4615 => 0.4940, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.00% (0.2271 => 0.2430, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4289 => 0.4589, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.98% (3.3354 => 3.5681, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.97% (5.7591 => 6.1606, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2756 => 0.2948, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207) MultiSource/Benchmarks/McCat/18-imp/imp: 6.87% (0.3423 => 0.3658, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.81% (0.2554 => 0.2728, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (4.2646 => 4.5545, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.77% (1.5415 => 1.6459, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.77% (0.3650 => 0.3897, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.72% (2.0665 => 2.2054, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.72% (0.4064 => 0.4337, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.68% (0.3865 => 0.4123, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (8.1363 => 8.6783, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.64% (0.5860 => 0.6249, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.63% (0.4103 => 0.4375, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.63% (1.3050 => 1.3915, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.8172 => 0.8707, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3232 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4203 => 0.4477, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.51% (5.0018 => 5.3276, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.50% (0.2802 => 0.2984, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.43% (0.5569 => 0.5927, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.42% (4.9449 => 5.2625, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: 6.41% (0.6456 => 0.6870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.37% (0.3283 => 0.3492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.36% (0.4620 => 0.4914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.35% (0.4048 => 0.4305, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 6.33% (0.3603 => 0.3831, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.33% (0.3826 => 0.4068, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.32% (0.3684 => 0.3917, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.3121 => 0.3318, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.20% (0.7835 => 0.8321, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.20% (0.5020 => 0.5331, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.18% (0.3935 => 0.4178, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.8067 => 0.8558, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.96% (1.1642 => 1.2336, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.89% (21.9371 => 23.2282, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.87% (0.9765 => 1.0338, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (7.9617 => 8.4262, std.dev.: 0.0103) MultiSource/Applications/hbd/hbd: 5.83% (1.5603 => 1.6513, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.81% (1.1861 => 1.2550, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.69% (3.8723 => 4.0928, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 5.61% (1.0722 => 1.1324, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3441 => 0.3634, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 5.52% (0.3387 => 0.3574, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4299 => 0.4531, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.31% (2.0273 => 2.1349, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.6450 => 0.6781, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 4.77% (2.2969 => 2.4065, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.76% (0.8921 => 0.9346, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.72% (1.5859 => 1.6608, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5981 => 0.6254, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2842 => 1.3414, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (14.3668 => 15.0019, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.4186 => 1.4802, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.16% (2.2024 => 2.2940, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.1840 => 1.2314, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.8101 => 0.8342, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.95% (17.1811 => 17.5153, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.8922 => 3.9583, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (3.1578 => 3.3848, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.65% (1.1396 => 1.2154, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7607, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3464, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2240, std.dev.: 0.0269) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.58% (5.2763 => 3.2409, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.34% (5.3855 => 3.9132, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.98% (5.3526 => 3.9084, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1059, std.dev.: 0.0289) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.17% (2.9384 => 2.6103, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -6.62% (22.1758 => 20.7086, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -11.88% (1.2373 => 1.0903, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2857, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1612, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4992, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9883, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5046, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2524, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1021, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.00% (0.5229 => 0.5752, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 6.55% (14.9895 => 15.9717, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 5.62% (14.1553 => 14.9515, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 5.62% (4.1105 => 4.3415, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.46% (1.1048 => 1.2314, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.70% (7.1582 => 7.5663, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.86% (3.4629 => 3.7350, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.87% (0.6222 => 0.6525, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Sep 28 23:39:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 01:39:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929063924.434442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4372?compare_to=4368&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4372, Order: 164880, Start Time: 2012-09-29 03:56:57, End Time: 2012-09-29 06:41:00 To: 4368, Order: 164866, Start Time: 2012-09-29 00:43:41, End Time: 2012-09-29 03:28:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 967 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.21% (2.0718 => 2.1175, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.41% (2.4809 => 2.4212, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: -1.04% (1.7720 => 1.7536, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0471 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0472 => 0.0473) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.68% (0.0440 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0446 => 0.0446, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0453 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0416 => 0.0416, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0423 => 0.0423, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3446 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3496 => 0.3919, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.09% (0.3465 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3442 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.05% (0.3460 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3469 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.69% (0.3643 => 0.4069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.44% (0.3724 => 0.4150, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.35% (0.1063 => 0.1173, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.07% (1.5932 => 1.7536, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5826 => 0.6407, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.5889 => 0.6470, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.3004 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.66% (0.2875 => 0.3124, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.42% (0.7171 => 0.7775, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.42% (0.3195 => 0.3464, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2725 => 0.2950, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.22% (0.2714 => 0.2937, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2750 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2729 => 0.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.11% (0.2738 => 0.2960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2813 => 0.3041, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 8.06% (0.2803 => 0.3029, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.02% (0.2792 => 0.3016, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.96% (2.0673 => 2.2318, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 7.95% (0.2780 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.91% (0.3096 => 0.3341, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2811 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 7.83% (0.9909 => 1.0685, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.76% (0.2911 => 0.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.74% (0.3267 => 0.3520, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3060 => 0.3296, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 7.67% (0.3258 => 0.3508, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.64% (0.3362 => 0.3619, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 7.53% (0.3678 => 0.3955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.51% (0.1505 => 0.1618, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.39% (0.3317 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.37% (1.6211 => 1.7405, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3348 => 0.3593, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.3625 => 0.3890, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.26% (1.3152 => 1.4107, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3282 => 0.3519, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.18% (0.4361 => 0.4674, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.17% (0.4994 => 0.5352, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 7.16% (0.3477 => 0.3726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.15% (0.3690 => 0.3954, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.15% (0.3845 => 0.4120, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.14% (0.3726 => 0.3992, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.10% (3.5627 => 3.8155, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash: 7.04% (0.4146 => 0.4438, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.97% (1.0781 => 1.1532, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 6.93% (5.5417 => 5.9259, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.92% (0.5000 => 0.5346, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (0.4251 => 0.4542, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.81% (0.3981 => 0.4252, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.50% (2.7292 => 2.9065, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (0.3930 => 0.4176, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.16% (0.4029 => 0.4277, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 6.12% (4.2109 => 4.4684, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.03% (0.6435 => 0.6823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.03% (0.2737 => 0.2902, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (4.4195 => 4.6854, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.00% (0.6634 => 0.7032, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5012 => 0.5311, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.92% (0.2566 => 0.2718, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.2736 => 0.2898, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 5.88% (23.5202 => 24.9021, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.86% (0.2866 => 0.3034, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (0.5026 => 0.5319, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.73% (0.4139 => 0.4376, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.5900 => 0.6237, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.64% (0.2040 => 0.2155, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.62% (4.6177 => 4.8771, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 5.60% (2.1013 => 2.2189, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 5.56% (1.8794 => 1.9839, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (0.3890 => 0.4105, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.3903 => 0.4117, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.48% (0.3084 => 0.3253, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (2.1653 => 2.2834, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 5.44% (0.9697 => 1.0225, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.43% (1.4269 => 1.5044, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 5.10% (0.3336 => 0.3506, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (0.4658 => 0.4895, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.3271 => 0.3435, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.90% (0.5546 => 0.5818, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.90% (0.2103 => 0.2206, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.86% (0.7875 => 0.8258, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.70% (1.9694 => 2.0620, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 4.62% (2.0346 => 2.1287, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.2969 => 0.3106, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (1.9966 => 2.0883, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (0.2691 => 0.2811, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 4.39% (0.4847 => 0.5060, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 4.27% (0.2391 => 0.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (0.7426 => 0.7736, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.09% (0.5361 => 0.5580, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.74% (0.4253 => 0.4412, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.62% (0.5584 => 0.5786, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.49% (11.6398 => 12.0459, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.25% (4.6926 => 4.8452, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.06% (0.3498 => 0.3605, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.90% (0.3792 => 0.3902, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.45% (11.9555 => 12.2488, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.76% (15.4430 => 16.1788, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8883, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6321, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2120, std.dev.: 0.0406) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5035, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.71% (2.0820 => 2.1175, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4414, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6056, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.23% (2.4764 => 2.4212, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5700, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: -9.91% (0.2402 => 0.2164, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7894, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7966, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7530, std.dev.: 0.0504) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.54% (0.6293 => 0.6133, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 01:30:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 03:30:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929083032.CC8AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4373?compare_to=4369&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4373, Order: 164885, Start Time: 2012-09-29 07:18:23, End Time: 2012-09-29 08:32:07 To: 4369, Order: 164880, Start Time: 2012-09-29 03:25:05, End Time: 2012-09-29 04:40:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 13 (85 on baseline) Performance Regressions: 5 (176 on baseline) Performance Improvements: 6 (30 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 946 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -99.81% (0.1563 => 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -11.71% (0.1187 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -99.98% (7.5702 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 0.84% (1.4517 => 1.4639, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -81.52% (4.5699 => 0.8444, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.38% (4.3969 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -97.65% (7.2314 => 0.1700, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -99.10% (1.9304 => 0.0174) MultiSource/Benchmarks/Olden/power/power: -99.92% (1.4833 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -93.94% (0.0033 => 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.78% (0.0144 => 0.0140) MultiSource/Benchmarks/nbench/nbench: -29.45% (11.7244 => 8.2718, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -99.90% (0.8414 => 0.0008, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 2.03% (12.2246 => 12.4732, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.85% (79.4540 => 80.9239, std.dev.: 0.5059) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.3742 => 2.4077, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.06% (26.1616 => 26.4397, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.05% (42.0218 => 42.4642, std.dev.: 0.1190) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -1.09% (1.2089 => 1.1957, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.92% (3.1919 => 3.0347, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -1.97% (1.2560 => 1.2312, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.69% (1.6008 => 1.5737, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -1.17% (2.2855 => 2.2587, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.07% (9.3049 => 9.2051, std.dev.: 0.0162) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0479 => 0.0478, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0480 => 0.0479, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0448 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0451 => 0.0449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0438 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0449 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0450 => 0.0449, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0452 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0454 => 0.0456, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0460 => 0.0459) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0431 => 0.0431, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -99.80% (0.1519 => 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -12.23% (0.1194 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -99.98% (7.6086 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.38% (1.4298 => 1.4639, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -81.61% (4.5928 => 0.8444, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.38% (4.4062 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -97.68% (7.3305 => 0.1700, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -99.12% (1.9762 => 0.0174) MultiSource/Benchmarks/Olden/power/power: -99.92% (1.4728 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -94.29% (0.0035 => 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.45% (0.0145 => 0.0140) MultiSource/Benchmarks/nbench/nbench: -26.55% (11.2619 => 8.2718, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -99.90% (0.8273 => 0.0008, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.34% (2.0176 => 2.4482, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.72% (0.5818 => 0.6500, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.46% (0.5748 => 0.6407, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4328 => 0.4821, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.22% (0.2781 => 0.3093, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.03% (0.4062 => 0.4510, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.91% (0.1072 => 0.1189, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.88% (0.7061 => 0.7829, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.81% (0.2655 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.1588 => 0.1757, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.54% (1.3693 => 1.5136, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.54% (3.9660 => 4.3839, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.29% (0.2760 => 0.3044) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2761 => 0.3044, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.22% (0.3485 => 0.3841, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.21% (0.2596 => 0.2861, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 10.18% (0.2937 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.17% (0.1327 => 0.1462, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.15% (1.9828 => 2.1840, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.14% (0.6283 => 0.6920, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.13% (0.2765 => 0.3045, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 9.99% (0.7038 => 0.7741, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.99% (0.4016 => 0.4417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 9.93% (0.3868 => 0.4252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.84% (1.2193 => 1.3393, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.81% (0.6959 => 0.7642, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.78% (0.7710 => 0.8464, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.4791 => 0.5258, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.72% (0.5265 => 0.5777, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.54% (0.4390 => 0.4809, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.50% (0.9199 => 1.0073, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.33% (0.3130 => 0.3422, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.32% (1.1364 => 1.2423, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.29% (1.4563 => 1.5916, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 9.27% (13.8202 => 15.1015, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/lists1: 9.22% (0.3534 => 0.3860, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1589 => 0.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.93% (0.2945 => 0.3208, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.81% (0.2995 => 0.3259, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 8.76% (1.0313 => 1.1216, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.61% (0.5577 => 0.6057, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2127 => 0.2310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.34% (0.4379 => 0.4744, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.20% (0.3755 => 0.4063, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.10% (1.1061 => 1.1957, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 8.08% (16.6129 => 17.9557, std.dev.: 0.0270) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.94% (3.8646 => 4.1715, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.94% (3.6692 => 3.9605, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.91% (0.5637 => 0.6083, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (7.2180 => 7.7884, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.90% (0.8698 => 0.9385, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.88% (0.8310 => 0.8965, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.83% (0.6744 => 0.7272, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.74% (0.7506 => 0.8087, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.3220 => 0.3467, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.60% (0.6576 => 0.7076, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.59% (0.7460 => 0.8026, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.52% (0.1569 => 0.1687, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.45% (1.3819 => 1.4849, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.42% (1.3813 => 1.4838, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 7.41% (1.0594 => 1.1379, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 7.33% (3.1889 => 3.4225, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 7.28% (2.1791 => 2.3377, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.24% (0.3245 => 0.3480, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.22% (1.9270 => 2.0661, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.3245 => 1.4185, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.04% (1.2292 => 1.3157, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 7.03% (14.8535 => 15.8976, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 7.00% (0.4113 => 0.4401, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.95% (0.3914 => 0.4186, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.91% (0.3646 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.89% (0.4003 => 0.4279, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.89% (0.2859 => 0.3056, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3789 => 0.4050, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (8.4961 => 9.0768, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.83% (0.8818 => 0.9420, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.82% (0.3650 => 0.3899, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.81% (4.3801 => 4.6786, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.81% (4.4433 => 4.7460, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 6.74% (1.2749 => 1.3608, std.dev.: 0.0193) SingleSource/UnitTests/ObjC/exceptions-3: 6.73% (0.3623 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.68% (0.3940 => 0.4203, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (1.1333 => 1.2071, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.49% (0.6135 => 0.6533, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.32% (0.3131 => 0.3329, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.22% (13.2842 => 14.1109, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 6.19% (0.6250 => 0.6637, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 6.18% (14.5298 => 15.4272, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 6.15% (6.5754 => 6.9800, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2140 => 0.2271, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.04% (3.2742 => 3.4719, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.4805 => 0.5095, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.01% (4.6629 => 4.9430, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.76% (4.9865 => 5.2736, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.75% (0.2504 => 0.2648, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.61% (0.1819 => 0.1921, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.60% (0.9108 => 0.9618, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.3511 => 0.3701, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.31% (1.5188 => 1.5995, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.05% (3.7467 => 3.9358, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (6.2785 => 6.5844, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.76% (2.1007 => 2.2006, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.26% (33.2944 => 34.7125, std.dev.: 0.0230) MultiSource/Applications/sqlite3/sqlite3: 2.72% (16.2614 => 16.7039, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5101, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (3.1736 => 3.4167, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/richards_benchmark: 6.51% (1.1560 => 1.2312, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.39% (1.2998 => 1.3828, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.32% (2.8813 => 3.0347, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.72% (2.8606 => 2.9955, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.60% (10.7476 => 11.1344, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.15% (12.0921 => 12.4732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5805, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5854, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9268, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5948, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (9.9194 => 10.0285, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.15% (0.4657 => 0.3905, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.29% (22.5627 => 22.0465, std.dev.: 0.0257) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.2308 => 1.0949, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2610, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.83% (1.3780 => 1.2976, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -5.26% (2.6470 => 2.5078, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.43% (3.2729 => 3.1608, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.36% (1.7688 => 1.7094, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9413, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4789, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.98% (0.6615 => 0.6484, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (5.3167 => 5.2265, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.40% (9.3358 => 9.2051, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8990, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 01:36:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 03:36:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929083645.06E6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4374?compare_to=4371&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4374, Order: 164885, Start Time: 2012-09-29 07:18:10, End Time: 2012-09-29 08:38:21 To: 4371, Order: 164880, Start Time: 2012-09-29 03:36:33, End Time: 2012-09-29 04:56:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 11 (84 on baseline) Performance Regressions: 2 (147 on baseline) Performance Improvements: 4 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (19 on baseline) Unchanged Tests: 933 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -97.25% (0.1706 => 0.0047, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -16.28% (0.1253 => 0.1049, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -99.99% (10.3215 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 0.49% (1.4500 => 1.4571, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -81.51% (4.6150 => 0.8534, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.37% (4.4148 => 0.0276, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -99.10% (1.9320 => 0.0174) MultiSource/Benchmarks/Olden/power/power: -99.89% (1.1166 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -94.59% (0.0037 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -29.10% (11.7985 => 8.3648, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: -99.92% (0.9507 => 0.0008, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.87% (12.2524 => 12.4811, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.18% (54.9076 => 55.5532, std.dev.: 0.0804) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.69% (3.2177 => 3.0668, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.2154 => 1.1896, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.17% (27.9922 => 27.6633, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.11% (1.5962 => 1.5785, std.dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5752 => 0.5765, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 0.48% (15.9717 => 16.0485, std.dev.: 0.0358) MultiSource/Applications/kimwitu++/kc: 0.94% (14.9515 => 15.0926, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -0.54% (83.4067 => 82.9537, std.dev.: 0.1883) MultiSource/Benchmarks/MallocBench/gs/gs: 0.60% (4.3415 => 4.3676, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.04% (0.0483 => 0.0488, std.dev.: 0.3434) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.44% (0.0485 => 0.0492, std.dev.: 0.3317) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.88% (0.0453 => 0.0457, std.dev.: 0.2901) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.10% (0.0454 => 0.0459, std.dev.: 0.2907) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.13% (0.0442 => 0.0447, std.dev.: 0.2701) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.35% (0.0443 => 0.0449, std.dev.: 0.2700) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.69% (0.0435 => 0.0438, std.dev.: 0.2574) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.38% (0.0436 => 0.0442, std.dev.: 0.2574) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.10% (0.0453 => 0.0458, std.dev.: 0.2957) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.54% (0.0454 => 0.0461, std.dev.: 0.2901) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.89% (0.0448 => 0.0452, std.dev.: 0.2798) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.34% (0.0449 => 0.0455, std.dev.: 0.2853) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.46% (0.0439 => 0.0441, std.dev.: 0.2656) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.59% (0.0439 => 0.0446, std.dev.: 0.2636) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.35% (0.0445 => 0.0451, std.dev.: 0.2769) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.57% (0.0446 => 0.0453, std.dev.: 0.2783) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.10% (0.0456 => 0.0461, std.dev.: 0.3053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.62% (0.0458 => 0.0470, std.dev.: 0.3039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.92% (0.0433 => 0.0437, std.dev.: 0.2586) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.92% (0.0434 => 0.0438, std.dev.: 0.2595) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.90% (0.0445 => 0.0449, std.dev.: 0.2822) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.35% (0.0446 => 0.0452, std.dev.: 0.2821) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.38% (0.0436 => 0.0442, std.dev.: 0.2613) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.60% (0.0437 => 0.0444, std.dev.: 0.2617) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.70% (0.0428 => 0.0431, std.dev.: 0.2470) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.10% (0.0429 => 0.0438, std.dev.: 0.2477) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.17% (0.0427 => 0.0432, std.dev.: 0.2474) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.17% (0.0428 => 0.0433, std.dev.: 0.2478) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.08% (0.0464 => 0.0469, std.dev.: 0.3010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.08% (0.0465 => 0.0470, std.dev.: 0.3022) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.70% (0.0426 => 0.0429, std.dev.: 0.2414) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.94% (0.0427 => 0.0431, std.dev.: 0.2425) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.93% (0.0428 => 0.0432, std.dev.: 0.2476) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.63% (0.0429 => 0.0436, std.dev.: 0.2477) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.84% (0.0434 => 0.0442, std.dev.: 0.2599) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.06% (0.0436 => 0.0445, std.dev.: 0.2603) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.34% (1.2314 => 1.2356, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.17% (7.5663 => 7.5789, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.01% (3.7350 => 3.7354, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.44% (0.6525 => 0.6554, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1428 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.86% (0.0648 => 0.0686, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.16% (63.2438 => 82.9537, std.dev.: 0.1883) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -97.11% (0.1629 => 0.0047, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -19.18% (0.1298 => 0.1049, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 0.77% (1.4460 => 1.4571, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -81.62% (4.6441 => 0.8534, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.37% (4.3882 => 0.0276, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -99.10% (1.9405 => 0.0174) MultiSource/Benchmarks/Olden/power/power: -99.89% (1.1277 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -94.59% (0.0037 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -28.16% (11.6436 => 8.3648, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: -99.92% (0.9505 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.21% (10.3673 => 15.0547, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: 29.10% (0.1622 => 0.2094, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.74% (2.2022 => 2.5268, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.56% (7.0540 => 8.0812, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: 13.62% (0.1432 => 0.1627, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.94% (1.1194 => 1.2643, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.78% (1.7609 => 1.9683, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.68% (0.1584 => 0.1769, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.60% (0.3282 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5925 => 0.6491, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.6030 => 0.6601, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.34% (0.3307 => 0.3616, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7326 => 0.7965, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.16% (9.4845 => 10.2582, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.01% (0.6675 => 0.7210, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.98% (0.7433 => 0.8026, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 7.98% (0.3422 => 0.3695, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.97% (0.7115 => 0.7682, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.93% (0.4615 => 0.4981, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.93% (0.2700 => 0.2914, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.4879 => 0.5261, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.71% (0.2905 => 0.3129, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.68% (0.5105 => 0.5497, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.55% (0.4289 => 0.4613, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2831 => 0.3044, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.50% (10.4361 => 11.2193, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.46% (0.3109 => 0.3341, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.4064 => 0.4366, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2872 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.35% (2.0665 => 2.2183, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.8172 => 0.8772, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (4.2646 => 4.5771, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3865 => 0.4148, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.32% (0.2554 => 0.2741, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3603 => 0.3866, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.27% (0.3052 => 0.3274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3232 => 0.3467, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.23% (0.3650 => 0.3914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.3098 => 0.3322, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.22% (0.3283 => 0.3520, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.22% (0.3423 => 0.3670, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3826 => 0.4102, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.20% (0.5860 => 0.6282, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.18% (0.2271 => 0.2434, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.16% (0.4636 => 0.4968, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.09% (3.3354 => 3.5720, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.09% (1.3050 => 1.3975, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.08% (1.5415 => 1.6507, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.02% (0.5569 => 0.5960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 7.02% (0.6456 => 0.6909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.01% (0.3379 => 0.3616, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.99% (5.7591 => 6.1615, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.97% (0.8067 => 0.8629, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4620 => 0.4940, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.89% (0.4048 => 0.4327, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (8.1363 => 8.6922, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.77% (4.9449 => 5.2797, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.77% (5.0018 => 5.3403, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3684 => 0.3932, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.68% (0.3935 => 0.4198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.67% (0.2758 => 0.2942, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.64% (0.2107 => 0.2247, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.63% (0.5020 => 0.5353, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 6.62% (0.7835 => 0.8354, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3121 => 0.3323, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.3092 => 0.3289, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.35% (0.9765 => 1.0385, std.dev.: 0.0141) MultiSource/Applications/Burg/burg: 6.28% (1.1642 => 1.2373, std.dev.: 0.0122) MultiSource/Applications/hbd/hbd: 6.27% (1.5603 => 1.6582, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.27% (1.1861 => 1.2605, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.23% (7.9617 => 8.4575, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3441 => 0.3653, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 6.10% (3.8723 => 4.1086, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.99% (1.0722 => 1.1364, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.85% (0.3387 => 0.3585, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.84% (0.2603 => 0.2755, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.79% (2.0273 => 2.1446, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 5.77% (0.4299 => 0.4547, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 5.58% (21.9371 => 23.1610, std.dev.: 0.0272) MultiSource/Applications/siod/siod: 5.56% (2.2969 => 2.4245, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.46% (0.3131 => 0.3302, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.40% (0.6450 => 0.6798, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.2842 => 1.3515, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 5.23% (0.8921 => 0.9388, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5859 => 1.6662, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.97% (0.5981 => 0.6278, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.4186 => 1.4873, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.62% (2.2024 => 2.3041, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.52% (14.3668 => 15.0155, std.dev.: 0.0175) MultiSource/Benchmarks/nbench/nbench: 4.34% (1.1840 => 1.2354, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.3427 => 0.3540, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.8101 => 0.8366, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.10% (17.1811 => 17.5426, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.96% (3.8922 => 3.9684, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (3.1578 => 3.3807, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.10% (2.8904 => 3.0668, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 4.39% (1.1396 => 1.1896, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7607, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3490, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2348, std.dev.: 0.0170) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5834, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.39% (5.2763 => 3.2508, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.70% (5.3855 => 3.8936, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.33% (5.3526 => 3.8895, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0970, std.dev.: 0.0433) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.17% (2.9384 => 2.6101, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -6.45% (22.1758 => 20.7457, std.dev.: 0.0525) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -12.22% (1.2373 => 1.0861, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3161, std.dev.: 0.0784) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.56% (1.8329 => 1.7127, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.82% (1.5660 => 1.4905, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.26% (3.2827 => 3.1756, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4999, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9944, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.93% (8.6802 => 8.5127, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0945, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2302, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.25% (0.5229 => 0.5765, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 7.06% (14.9895 => 16.0485, std.dev.: 0.0358) MultiSource/Applications/kimwitu++/kc: 6.62% (14.1553 => 15.0926, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 6.25% (4.1105 => 4.3676, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.84% (1.1048 => 1.2356, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.88% (7.1582 => 7.5789, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.87% (3.4629 => 3.7354, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.34% (0.6222 => 0.6554, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: -98.06% (0.0720 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 01:46:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 03:46:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929084634.089FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4375?compare_to=4370&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4375, Order: 164885, Start Time: 2012-09-29 07:02:02, End Time: 2012-09-29 08:48:10 To: 4370, Order: 164880, Start Time: 2012-09-29 03:30:53, End Time: 2012-09-29 04:53:33 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 29 (29 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 8 (63 on baseline) Performance Improvements: 7 (38 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 929 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: -1.96% (14.9476 => 14.6542, std.dev.: 0.0360) MultiSource/Applications/kimwitu++/kc: -0.07% (16.1737 => 16.1621, std.dev.: 0.0289) MultiSource/Applications/lua/lua: -0.05% (3.6731 => 3.6714, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 0.17% (2.1582 => 2.1618, std.dev.: 0.0251) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.11% (0.0778 => 0.0676, std.dev.: 0.0030) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: 2577.66% (0.0658 => 1.7619, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: -99.99% (6.5810 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -99.81% (0.0526 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (28.7614 => 0.0001) MultiSource/Applications/minisat/minisat: 111.82% (6.1524 => 13.0323, std.dev.: 0.0766) MultiSource/Applications/siod/siod: -100.00% (3.6368 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.43% (2.4526 => 0.0140) MultiSource/Benchmarks/Bullet/bullet: -92.01% (6.9187 => 0.5525, std.dev.: 0.0567) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.61% (0.1765 => 0.1719, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -98.00% (0.3403 => 0.0068, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -90.53% (0.0412 => 0.0039, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -98.92% (2.4081 => 0.0259, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -99.87% (1.4380 => 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -26.57% (0.0941 => 0.0691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 62425450.00% (0.0008 => 499.4044, std.dev.: 0.2170) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -24.91% (0.0277 => 0.0208, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: -23.04% (24.1109 => 18.5555, std.dev.: 1.9541) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.52% (2.7916 => 2.7492, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -78.20% (1.3751 => 0.2998, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -0.40% (2.3616 => 2.3521, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/methcall: 5.46% (9.0223 => 9.5152, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/objinst: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 3.23% (0.0031 => 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.1999 => 1.2172, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 8.30% (3.2098 => 3.4761, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.75% (3.0432 => 3.2789, std.dev.: 0.0768) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 5.14% (1.8722 => 1.9684, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 2.93% (3.0519 => 3.1413, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.50% (1.6098 => 1.6339, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 1.46% (2.8357 => 2.8772, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.16% (1.7055 => 1.7252, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -2.72% (0.9580 => 0.9319, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.91% (1.2164 => 1.1932, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.56% (1.4459 => 1.4234, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -99.81% (1.4009 => 0.0027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -9.40% (8.5247 => 7.7231, std.dev.: 0.0494) MultiSource/Benchmarks/Olden/tsp/tsp: -3.93% (1.8185 => 1.7471, std.dev.: 0.0210) MultiSource/Applications/hexxagon/hexxagon: -2.67% (14.8887 => 14.4914, std.dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.46% (1.0093 => 0.9946, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -1.16% (0.6133 => 0.6062, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 3.10% (0.1614 => 0.1664, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.68% (0.1580 => 0.1506, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.06% (0.3126 => 0.3093, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.96% (0.2398 => 0.2351, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.87% (0.3208 => 0.3180, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2304 => 0.2297, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -4.85% (0.0454 => 0.0432, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: 200.00% (0.0030 => 0.0090, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -15.00% (0.0040 => 0.0034, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.46% (0.0244 => 0.0238, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.60% (0.0191 => 0.0123, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.66% (0.0376 => 0.0386, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.89% (0.0297 => 0.0232, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0282 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.92% (0.0315 => 0.0268, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -24.29% (0.0177 => 0.0134, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: -24.85% (0.0326 => 0.0245, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1443 => 0.0001) MultiSource/Applications/lemon/lemon: -99.58% (1.4990 => 0.0063, std.dev.: 0.0011) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 14.50% (0.1510 => 0.1729, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -99.98% (0.4251 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.50% (0.1427 => 0.1377, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0613 => 0.0612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.12% (0.0226 => 0.0176, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0577 => 0.0578, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1291 => 1.1269, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0013 => 0.0016, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.80% (0.0579 => 0.0601, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.73% (0.0165 => 0.0144, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.7697 => 0.7671, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.05% (1.6005 => 1.5997, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: 0.32% (14.6079 => 14.6542, std.dev.: 0.0360) MultiSource/Applications/kimwitu++/kc: 5.56% (15.3105 => 16.1621, std.dev.: 0.0289) MultiSource/Applications/lua/lua: 2.04% (3.5980 => 3.6714, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 3.08% (2.0972 => 2.1618, std.dev.: 0.0251) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.43% (0.0790 => 0.0676, std.dev.: 0.0030) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: 2557.47% (0.0663 => 1.7619, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: -99.99% (6.7458 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -99.80% (0.0500 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (29.5232 => 0.0001) MultiSource/Applications/minisat/minisat: 109.37% (6.2244 => 13.0323, std.dev.: 0.0766) MultiSource/Applications/siod/siod: -100.00% (3.5520 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.42% (2.4042 => 0.0140) MultiSource/Benchmarks/Bullet/bullet: -92.08% (6.9722 => 0.5525, std.dev.: 0.0567) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.1743 => 0.1719, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -97.94% (0.3301 => 0.0068, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -90.99% (0.0433 => 0.0039, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -98.97% (2.5166 => 0.0259, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -99.87% (1.4184 => 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -27.03% (0.0947 => 0.0691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 62425450.00% (0.0008 => 499.4044, std.dev.: 0.2170) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -87.50% (0.0040 => 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.12% (0.0311 => 0.0208, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: -12.36% (21.1721 => 18.5555, std.dev.: 1.9541) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -7.52% (2.9728 => 2.7492, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -79.24% (1.4441 => 0.2998, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 0.29% (2.3453 => 2.3521, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/methcall: 2.86% (9.2503 => 9.5152, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 3.23% (0.0031 => 0.0032) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.80% (4.1772 => 3.1413, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0139) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.64% (0.0745 => 0.0869, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.40% (0.1159 => 0.1268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.25% (0.5309 => 0.5747, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 8.24% (2.1763 => 2.3557, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.88% (0.6410 => 0.6851, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 6.56% (0.6173 => 0.6578, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.17% (1.0046 => 1.0666, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (1.1653 => 1.2338, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.78% (0.3582 => 0.3789, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.52% (0.6069 => 0.6404, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.41% (0.2552 => 0.2690, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.35% (0.4880 => 0.5141, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.95% (0.6915 => 0.7257, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.67% (1.5150 => 1.5857, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3217 => 0.3367, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 4.58% (29.3170 => 30.6600, std.dev.: 0.2237) MultiSource/Applications/Burg/burg: 4.31% (1.1440 => 1.1933, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.13% (0.3901 => 0.4062, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.12% (3.0225 => 3.1469, std.dev.: 0.0212) MultiSource/Applications/SPASS/SPASS: 3.52% (13.3238 => 13.7930, std.dev.: 0.1244) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (12.6413 => 13.0635, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 3.30% (4.7455 => 4.9021, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.1827 => 1.2172, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.2186 => 8.4504, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.72% (1.2021 => 1.2348, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.51% (1.0821 => 1.1093, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.47% (0.8569 => 0.8781, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.42% (6.2546 => 6.4058, std.dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.4908 => 6.6407, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1672 => 1.1932, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: 2.22% (1.3268 => 1.3563, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.20% (14.7256 => 15.0495, std.dev.: 0.0375) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.20% (1.0689 => 1.0924, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (4.0318 => 4.1150, std.dev.: 0.0101) MultiSource/Applications/treecc/treecc: 2.03% (1.8798 => 1.9179, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (4.3380 => 4.3943, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.29% (4.2616 => 4.3165, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 1.24% (3.8796 => 3.9276, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0373) SingleSource/Benchmarks/Shootout/ary3: 14.89% (1.7426 => 2.0021, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.96% (4.0101 => 4.5699, std.dev.: 0.0183) SingleSource/Benchmarks/McGill/queens: 11.27% (1.6261 => 1.8094, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 8.48% (7.0025 => 7.5965, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.37% (3.0256 => 3.2789, std.dev.: 0.0768) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 7.82% (0.1433 => 0.1545, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.96% (40.4792 => 42.8914, std.dev.: 0.3862) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.89% (4.2129 => 4.4612, std.dev.: 0.0711) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 4.30% (15.2242 => 15.8792, std.dev.: 0.0260) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5411, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.77% (0.8498 => 0.8818, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.07% (2.6656 => 2.7475, std.dev.: 0.0146) MultiSource/Benchmarks/sim/sim: 2.90% (3.8907 => 4.0037, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.76% (0.5876 => 0.6038, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.65% (4.6127 => 4.7349, std.dev.: 0.0244) MultiSource/Benchmarks/FreeBench/mason/mason: 2.48% (0.5004 => 0.5128, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.22% (6.6312 => 6.7783, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (3.4230 => 3.4761, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9152 => 2.9589, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.42% (1.6110 => 1.6339, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -99.81% (1.4117 => 0.0027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.16% (5.2665 => 4.1520, std.dev.: 0.0760) SingleSource/Benchmarks/Shootout-C++/ary3: -19.88% (1.7473 => 1.4000, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.1647 => 0.9606, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.51% (15.8312 => 13.2172, std.dev.: 0.1096) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.78% (3.6023 => 3.2139, std.dev.: 0.1094) SingleSource/Benchmarks/Misc/ReedSolomon: -9.26% (8.5113 => 7.7231, std.dev.: 0.0494) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.12% (3.2007 => 2.9727, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: -7.12% (7.6833 => 7.1364, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.71% (3.6254 => 3.3821, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3355, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9431, std.dev.: 0.3019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.40% (3.9413 => 3.7284, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -4.96% (4.4195 => 4.2004, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4140 => 0.3938, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -4.77% (0.2664 => 0.2537, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.16% (1.2959 => 1.2420, std.dev.: 0.0115) MultiSource/Applications/sgefa/sgefa: -4.08% (0.3746 => 0.3593, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -3.51% (0.4296 => 0.4145, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -3.32% (9.5474 => 9.2303, std.dev.: 0.0463) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.20% (1.4021 => 1.3573, std.dev.: 0.0154) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.00% (1.2722 => 1.2340, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.61% (3.7496 => 3.6516, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.60% (1.1683 => 1.1379, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (92.7467 => 90.8179, std.dev.: 0.2750) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4199, std.dev.: 0.0132) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.93% (2.3569 => 2.3114, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.71% (2.0027 => 1.9684, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -1.68% (1.0926 => 1.0742, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -1.68% (3.4286 => 3.3710, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.57% (1.0686 => 1.0518, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2475, std.dev.: 0.0301) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.41% (27.1724 => 26.7895, std.dev.: 0.0326) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3246, std.dev.: 0.0226) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.34% (0.9980 => 0.9946, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 0.66% (0.6022 => 0.6062, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1666 => 0.1664, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.09% (0.1554 => 0.1506, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.32% (0.3083 => 0.3093, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.80% (0.2394 => 0.2351, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (0.3175 => 0.3180, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.22% (0.2302 => 0.2297, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -3.79% (0.0449 => 0.0432, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -62.22% (0.0090 => 0.0034, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.94% (0.0192 => 0.0123, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.92% (0.0301 => 0.0232, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.28% (0.0324 => 0.0268, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -24.29% (0.0177 => 0.0134, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: -24.62% (0.0325 => 0.0245, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1429 => 0.0001) MultiSource/Applications/lemon/lemon: -99.58% (1.5019 => 0.0063, std.dev.: 0.0011) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 15.19% (0.1501 => 0.1729, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -99.98% (0.4264 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.46% (0.1344 => 0.1377, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.14% (0.0232 => 0.0176, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1350 => 1.1269, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.65% (0.0637 => 0.0601, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.46% (0.0246 => 0.0144, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.72% (0.7541 => 0.7671, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.13% (1.5363 => 1.5997, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 03:03:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 05:03:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929100354.EB56B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4376?compare_to=4372&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4376, Order: 164885, Start Time: 2012-09-29 07:20:16, End Time: 2012-09-29 10:04:32 To: 4372, Order: 164880, Start Time: 2012-09-29 03:56:57, End Time: 2012-09-29 06:41:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 969 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.20% (124.9571 => 130.2052, std.dev.: 0.6927) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0472 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0473 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0431 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0431 => 0.0431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0423 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.45% (0.0443 => 0.0441) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0445 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0446 => 0.0446, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0421 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0422 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0452 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0453 => 0.0453) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0416 => 0.0416, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.73% (0.3496 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.72% (0.3465 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.70% (0.3488 => 0.3896, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.69% (0.3446 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.68% (0.3442 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.53% (0.3460 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3643 => 0.4059, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 11.29% (0.3650 => 0.4062, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.21% (1.5932 => 1.7400, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5826 => 0.6355, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.5889 => 0.6419, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.3004 => 0.3248, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.86% (0.2875 => 0.3101, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.78% (0.2750 => 0.2964, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7171 => 0.7721, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2780 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2714 => 0.2920, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 7.55% (0.2823 => 0.3036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2803 => 0.3012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.2738 => 0.2942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.44% (0.2729 => 0.2932, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.43% (1.3152 => 1.4129, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.42% (1.6211 => 1.7414, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.42% (0.3060 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.40% (0.2811 => 0.3019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2813 => 0.3021, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (2.0673 => 2.2200, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.35% (0.3362 => 0.3609, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2792 => 0.2997, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.31% (0.4361 => 0.4680, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 7.24% (0.3096 => 0.3320, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.23% (0.9909 => 1.0625, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (3.5627 => 3.8198, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 7.16% (0.3267 => 0.3501, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.13% (0.2736 => 0.2931, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.3258 => 0.3490, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3317 => 0.3550, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.02% (0.3348 => 0.3583, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.91% (0.3124 => 0.3340, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (2.7292 => 2.9169, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.3678 => 0.3929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.3625 => 0.3871, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.78% (5.5417 => 5.9174, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.75% (0.4994 => 0.5331, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.3726 => 0.3975, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.61% (0.3477 => 0.3707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.58% (0.4146 => 0.4419, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3282 => 0.3498, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4251 => 0.4526, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.40% (0.3690 => 0.3926, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.38% (1.0781 => 1.1469, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.34% (0.3930 => 0.4179, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.18% (0.5000 => 0.5309, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 6.17% (0.6634 => 0.7043, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.14% (0.3845 => 0.4081, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.3981 => 0.4225, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.07% (4.2109 => 4.4665, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.99% (4.4195 => 4.6844, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (0.5026 => 0.5326, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 5.96% (0.2566 => 0.2719, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.5012 => 0.5309, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.86% (0.2866 => 0.3034, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.86% (0.3890 => 0.4118, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.80% (0.2068 => 0.2188, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.71% (2.1013 => 2.2213, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.6435 => 0.6801, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 5.63% (0.4029 => 0.4256, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.61% (1.8794 => 1.9849, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.2737 => 0.2890, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (0.4658 => 0.4918, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.3903 => 0.4120, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.56% (0.4139 => 0.4369, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.49% (23.5202 => 24.8120, std.dev.: 0.0392) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.5900 => 0.6224, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 5.48% (0.5546 => 0.5850, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 5.47% (1.4269 => 1.5049, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 5.47% (4.6177 => 4.8701, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.38% (0.3084 => 0.3250, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.36% (0.2969 => 0.3128, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.2040 => 0.2148, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.28% (2.1653 => 2.2796, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 4.98% (0.3336 => 0.3502, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.92% (0.3271 => 0.3432, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.2075 => 0.2177, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 4.86% (0.9697 => 1.0168, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 4.80% (0.7875 => 0.8253, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.2103 => 0.2203, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.70% (1.9694 => 2.0620, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.56% (1.9966 => 2.0877, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 4.49% (2.0346 => 2.1260, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: 4.42% (0.4847 => 0.5061, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.35% (0.2691 => 0.2808, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.08% (0.7426 => 0.7729, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (0.4253 => 0.4397, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.34% (11.6398 => 12.0282, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.18% (4.6926 => 4.8419, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 3.14% (0.3498 => 0.3608, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.28% (11.9555 => 12.2285, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1749, std.dev.: 0.1391) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6406, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2114, std.dev.: 0.0092) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (2.0820 => 2.1195, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2288, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4531, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2798, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5901, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5543, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7874, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8035, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8429, std.dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5795, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0421, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 03:13:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 05:13:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929101307.A816C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4377?compare_to=4373&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4377, Order: 164887, Start Time: 2012-09-29 09:01:12, End Time: 2012-09-29 10:14:42 To: 4373, Order: 164885, Start Time: 2012-09-29 07:18:23, End Time: 2012-09-29 08:32:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (85 on baseline) Performance Regressions: 0 (176 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 85 (0 on baseline) Unchanged Tests: 956 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.10% (1.4838 => 1.4675, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.42% (0.0478 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0479 => 0.0480, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0449 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0437 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0432 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0448 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.44% (0.0451 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0456 => 0.0455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0424 => 0.0425) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0421 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.48% (0.0421 => 0.0423) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: - (0.0003 => 0.0003) MultiSource/Applications/JM/ldecod/ldecod: - (0.1048 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: - (0.0014 => 0.0014) MultiSource/Applications/lemon/lemon: 0.10% (1.4639 => 1.4654, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 0.14% (0.8444 => 0.8456, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.73% (0.0274 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.29% (0.1700 => 0.1695, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: - (0.0174 => 0.0174, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: - (0.0012 => 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0002 => 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0140 => 0.0140) MultiSource/Benchmarks/nbench/nbench: -0.00% (8.2718 => 8.2716, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: - (0.0008 => 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -99.80% (0.1519 => 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -12.23% (0.1194 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -99.98% (7.6086 => 0.0014) MultiSource/Applications/lemon/lemon: 2.49% (1.4298 => 1.4654, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -81.59% (4.5928 => 0.8456, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.37% (4.4062 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -97.69% (7.3305 => 0.1695, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -99.12% (1.9762 => 0.0174, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -99.92% (1.4728 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -94.29% (0.0035 => 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.45% (0.0145 => 0.0140) MultiSource/Benchmarks/nbench/nbench: -26.55% (11.2619 => 8.2716, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: -99.90% (0.8273 => 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.89% (2.0176 => 2.4391, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.39% (0.1413 => 0.1574) SingleSource/UnitTests/ObjC++/property-reference-object: 11.21% (0.5818 => 0.6470, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.14% (0.4328 => 0.4810, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.81% (0.4062 => 0.4501, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.78% (3.9660 => 4.3936, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.55% (0.1327 => 0.1467, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.51% (0.7061 => 0.7803, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.47% (1.3693 => 1.5127, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 10.46% (0.7038 => 0.7774, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.24% (0.1435 => 0.1582, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.23% (0.3899 => 0.4298, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (0.7710 => 0.8497, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.17% (0.2596 => 0.2860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.03% (0.2721 => 0.2994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.02% (0.6959 => 0.7656, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.97% (0.5265 => 0.5790, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.96% (1.2193 => 1.3407, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.90% (0.3485 => 0.3830, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.82% (1.9828 => 2.1775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.76% (0.4016 => 0.4408, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3580 => 0.3929, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.3489 => 0.3828, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.69% (0.9199 => 1.0090, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.64% (0.2966 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.6283 => 0.6888, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.62% (0.3130 => 0.3431, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.59% (13.8202 => 15.1462, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 9.57% (0.3293 => 0.3608, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.50% (1.4563 => 1.5946, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.47% (0.3453 => 0.3780, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.40% (0.3107 => 0.3399, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.40% (1.1364 => 1.2432, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.25% (0.4791 => 0.5234, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 9.23% (0.3868 => 0.4225, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.09% (1.0313 => 1.1250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.94% (0.3534 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.90% (0.3246 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.88% (0.4390 => 0.4780, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.80% (0.5577 => 0.6068, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.66% (0.1986 => 0.2158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.56% (0.2945 => 0.3197, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.51% (0.2995 => 0.3250, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4379 => 0.4748, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.34% (1.1061 => 1.1983, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 8.29% (3.8646 => 4.1851, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: 8.20% (0.2243 => 0.2427, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.17% (16.6129 => 17.9694, std.dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.10% (0.8310 => 0.8983, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.04% (0.5637 => 0.6090, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.99% (0.6744 => 0.7283, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.99% (7.2180 => 7.7948, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 7.93% (0.2925 => 0.3157, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.91% (3.6692 => 3.9596, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.88% (0.3755 => 0.4051, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.84% (0.8698 => 0.9380, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3220 => 0.3472, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.72% (1.9270 => 2.0758, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 7.71% (2.1791 => 2.3470, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.61% (3.1889 => 3.4316, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.60% (0.7460 => 0.8027, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.51% (0.2023 => 0.2175, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.47% (1.0594 => 1.1385, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.44% (0.1478 => 0.1588, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.41% (0.6576 => 0.7063, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.35% (1.3245 => 1.4218, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.95% (14.8535 => 15.8856, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.87% (4.3801 => 4.6810, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 6.82% (0.3578 => 0.3822, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.79% (4.4433 => 4.7449, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 6.79% (0.2859 => 0.3053, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.77% (1.2749 => 1.3612, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.76% (8.4961 => 9.0708, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/parameter-passing: 6.74% (0.4003 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.71% (1.1333 => 1.2094, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3914 => 0.4176, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.68% (0.6135 => 0.6545, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.65% (1.2292 => 1.3110, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 6.65% (0.3789 => 0.4041, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.55% (0.3663 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.44% (3.2742 => 3.4852, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/exceptions-3: 6.43% (0.3623 => 0.3856, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.41% (13.2842 => 14.1358, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.39% (1.3819 => 1.4702, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.38% (0.8818 => 0.9381, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.34% (4.6629 => 4.9587, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.31% (0.2504 => 0.2662, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (1.3813 => 1.4675, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.24% (0.3511 => 0.3730, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.19% (6.5754 => 6.9826, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.6250 => 0.6636, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.14% (14.5298 => 15.4221, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.97% (0.4805 => 0.5092, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1819 => 0.1924, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.70% (4.9865 => 5.2705, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.56% (1.5188 => 1.6033, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.51% (0.9108 => 0.9610, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.24% (3.7467 => 3.9432, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.97% (2.1007 => 2.2052, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.82% (6.2785 => 6.5810, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.13% (33.2944 => 34.6711, std.dev.: 0.0202) MultiSource/Applications/sqlite3/sqlite3: 2.93% (16.2614 => 16.7371, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std.dev.: 0.0546) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (3.1736 => 3.4162, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/richards_benchmark: 6.50% (1.1560 => 1.2311, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.31% (2.8813 => 3.0344, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (2.8606 => 2.9960, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1167, std.dev.: 0.0641) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.14% (12.0921 => 12.4718, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5889, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5851, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (9.9194 => 10.0318, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5857, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.28% (0.4657 => 0.3899, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (22.5627 => 22.0627, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std.dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2775, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.77% (1.3780 => 1.2985, std.dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4103, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.40% (3.2729 => 3.1616, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.73% (3.0263 => 2.9438, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.97% (0.6615 => 0.6485) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2398, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.76% (5.3167 => 5.2232, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2142, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8995, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 03:26:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 05:26:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929102634.C76D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4378?compare_to=4374&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4378, Order: 164889, Start Time: 2012-09-29 09:07:36, End Time: 2012-09-29 10:28:09 To: 4374, Order: 164885, Start Time: 2012-09-29 07:18:10, End Time: 2012-09-29 08:38:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (84 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 103 (19 on baseline) Unchanged Tests: 938 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.23% (15.0547 => 15.2404, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5765 => 0.5775, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 0.07% (16.0485 => 16.0593, std.dev.: 0.0707) MultiSource/Applications/kimwitu++/kc: -0.07% (15.0926 => 15.0826, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 0.21% (82.9537 => 83.1250, std.dev.: 0.0325) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3676 => 4.3701, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1484.63% (0.0488 => 0.7733, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1431.91% (0.0492 => 0.7537, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1344.86% (0.0457 => 0.6603, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1344.01% (0.0459 => 0.6628, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1281.66% (0.0447 => 0.6176, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1279.06% (0.0449 => 0.6192, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1248.17% (0.0438 => 0.5905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1237.10% (0.0442 => 0.5910, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1340.83% (0.0458 => 0.6599, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1333.19% (0.0461 => 0.6607, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1312.39% (0.0452 => 0.6384, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1301.32% (0.0455 => 0.6376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1275.96% (0.0441 => 0.6068, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1252.69% (0.0446 => 0.6033, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1300.22% (0.0451 => 0.6315, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1300.44% (0.0453 => 0.6344, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1400.00% (0.0461 => 0.6915, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1373.19% (0.0470 => 0.6924, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1255.15% (0.0437 => 0.5922, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1257.31% (0.0438 => 0.5945, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1331.18% (0.0449 => 0.6426, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1322.79% (0.0452 => 0.6431, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1253.39% (0.0442 => 0.5982, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1248.87% (0.0444 => 0.5989, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1214.85% (0.0431 => 0.5667, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1198.63% (0.0438 => 0.5688, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1214.12% (0.0432 => 0.5677, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1215.01% (0.0433 => 0.5694, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1360.98% (0.0469 => 0.6852, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1362.98% (0.0470 => 0.6876, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1194.17% (0.0429 => 0.5552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1191.88% (0.0431 => 0.5568, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1215.74% (0.0432 => 0.5684, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1204.82% (0.0436 => 0.5689, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1248.19% (0.0442 => 0.5959, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1240.67% (0.0445 => 0.5966, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.29% (1.2356 => 1.2320, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (7.5789 => 7.5940, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.09% (3.7354 => 3.7388, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.40% (0.6554 => 0.6580, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -2.13% (0.0047 => 0.0046, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: - (0.1049 => 0.1049) MultiSource/Applications/JM/lencod/lencod: - (0.0014 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/lemon/lemon: -0.03% (1.4571 => 1.4567, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.8534 => 0.8545, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.36% (0.0276 => 0.0275, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (0.0686 => 0.0694, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: - (0.0174 => 0.0174) MultiSource/Benchmarks/Olden/power/power: - (0.0012 => 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0002 => 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -0.00% (8.3648 => 8.3645, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/ffbench: - (0.0008 => 0.0008, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.44% (63.2438 => 83.1250, std.dev.: 0.0325) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -97.18% (0.1629 => 0.0046, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -19.18% (0.1298 => 0.1049) MultiSource/Applications/lemon/lemon: 0.74% (1.4460 => 1.4567, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -81.60% (4.6441 => 0.8545, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.37% (4.3882 => 0.0275, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -99.10% (1.9405 => 0.0174) MultiSource/Benchmarks/Olden/power/power: -99.89% (1.1277 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -94.59% (0.0037 => 0.0002) MultiSource/Benchmarks/nbench/nbench: -28.16% (11.6436 => 8.3645, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: -99.92% (0.9505 => 0.0008, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.00% (10.3673 => 15.2404, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 30.39% (0.1622 => 0.2115, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.38% (7.0540 => 8.1387, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.29% (2.2022 => 2.5389, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.07% (1.1194 => 1.2657, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.90% (1.7609 => 1.9705, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.43% (0.1584 => 0.1765, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3473 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5925 => 0.6513, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.77% (0.6030 => 0.6619, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.75% (0.3282 => 0.3602, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.37% (0.1655 => 0.1810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.27% (0.7326 => 0.8005, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.22% (0.3307 => 0.3612, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.98% (0.2905 => 0.3166, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/fibo: 8.92% (0.2725 => 0.2968, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.78% (0.2756 => 0.2998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.77% (0.2714 => 0.2952, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.52% (0.2793 => 0.3031, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 8.30% (0.3422 => 0.3706, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.20% (0.4636 => 0.5016, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.18% (9.4845 => 10.2602, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.09% (0.6675 => 0.7215, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.06% (0.3177 => 0.3433, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 8.05% (0.7433 => 0.8031, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 8.03% (0.7115 => 0.7686, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.02% (0.8172 => 0.8827, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 7.97% (10.4361 => 11.2680, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.91% (2.0665 => 2.2300, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.89% (0.5105 => 0.5508, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.87% (0.4615 => 0.4978, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.84% (0.2831 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.83% (0.3052 => 0.3291, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.80% (0.7835 => 0.8446, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2802 => 0.3020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.72% (0.2877 => 0.3099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.69% (0.2872 => 0.3093, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.69% (0.3379 => 0.3639, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.68% (0.3865 => 0.4162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.66% (0.2871 => 0.3091, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.65% (0.4103 => 0.4417, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.65% (0.4289 => 0.4617, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4203 => 0.4524, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.60% (0.4064 => 0.4373, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.55% (0.3283 => 0.3531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.43% (0.1695 => 0.1821, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.43% (0.3162 => 0.3397, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.43% (5.7591 => 6.1871, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2554 => 0.2743, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.39% (1.5415 => 1.6554, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.38% (0.8067 => 0.8662, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3826 => 0.4108, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.37% (0.3109 => 0.3338, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 7.26% (0.6456 => 0.6925, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.22% (3.3354 => 3.5762, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.4048 => 0.4340, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.16% (0.3423 => 0.3668, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4620 => 0.4950, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.13% (0.2271 => 0.2433, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (4.2646 => 4.5670, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.06% (0.5860 => 0.6274, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.3935 => 0.4212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.98% (1.3050 => 1.3961, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.95% (0.1510 => 0.1615, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.89% (0.2758 => 0.2948, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5569 => 0.5950, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.82% (5.0018 => 5.3427, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.81% (4.9449 => 5.2817, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.80% (8.1363 => 8.6897, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.69% (0.2107 => 0.2248, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.63% (1.5603 => 1.6638, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.49% (0.5020 => 0.5346, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.39% (0.1940 => 0.2064, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.31% (7.9617 => 8.4644, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.28% (0.9765 => 1.0378, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 6.27% (0.3092 => 0.3286, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.24% (1.1861 => 1.2601, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 6.21% (1.1642 => 1.2365, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 6.10% (3.8723 => 4.1085, std.dev.: 0.0192) MultiSource/Applications/JM/lencod/lencod: 6.04% (21.9371 => 23.2628, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.02% (0.3441 => 0.3648, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 6.01% (0.3180 => 0.3371, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.99% (1.0722 => 1.1364, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 5.82% (0.3387 => 0.3584, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.71% (1.2842 => 1.3575, std.dev.: 0.0083) MultiSource/Applications/treecc/treecc: 5.66% (2.0273 => 2.1420, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.4299 => 0.4542, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.57% (0.2603 => 0.2748, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.40% (0.6450 => 0.6798, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 5.39% (2.2969 => 2.4207, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8921 => 0.9382, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.96% (1.5859 => 1.6646, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5981 => 0.6276, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.75% (1.4186 => 1.4860, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (14.3668 => 15.0256, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.50% (2.2024 => 2.3016, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.1840 => 1.2356, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.41% (0.3427 => 0.3544, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.15% (0.8101 => 0.8356, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.13% (17.1811 => 17.5463, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (3.8922 => 3.9664, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.47% (1.1145 => 1.3872, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.11% (2.8904 => 3.0670, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 4.43% (1.1396 => 1.1901, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7666, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (4.2280 => 4.3599, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2325, std.dev.: 0.0201) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.21% (5.2763 => 3.2600, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.28% (5.3855 => 3.9166, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.97% (5.3526 => 3.9090, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0691, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.17% (2.9384 => 2.6103, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -6.46% (22.1758 => 20.7433, std.dev.: 0.0331) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -12.27% (1.2373 => 1.0855, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2913, std.dev.: 0.1031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (1.8329 => 1.7122, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.83% (1.5660 => 1.4904, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.32% (3.2827 => 3.1738, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.11% (8.1563 => 7.9846, std.dev.: 0.0221) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5024, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1019, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8541, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.44% (0.5229 => 0.5775, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 7.14% (14.9895 => 16.0593, std.dev.: 0.0707) MultiSource/Applications/kimwitu++/kc: 6.55% (14.1553 => 15.0826, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 6.32% (4.1105 => 4.3701, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.51% (1.1048 => 1.2320, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.09% (7.1582 => 7.5940, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.97% (3.4629 => 3.7388, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.75% (0.6222 => 0.6580, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: -98.06% (0.0720 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.20% (0.2116 => 0.0694, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 03:48:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 05:48:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929104824.EB98B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4379?compare_to=4375&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4379, Order: 164889, Start Time: 2012-09-29 09:04:06, End Time: 2012-09-29 10:50:02 To: 4375, Order: 164885, Start Time: 2012-09-29 07:02:02, End Time: 2012-09-29 08:48:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (29 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 13 (68 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 98 (69 on baseline) Unchanged Tests: 928 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.47% (0.4477 => 0.4677, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.32% (0.5691 => 0.5880, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.7605 => 0.7829, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4145 => 0.4257, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.5914 => 0.6067, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 1.46% (0.8495 => 0.8619, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.37% (1.1932 => 1.2096, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.4234 => 1.4428, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 16.12% (5.3141 => 6.1708, std.dev.: 0.1718) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.88% (1.3573 => 1.4099, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.85% (1.0699 => 1.1004, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.68% (22.1173 => 22.7107, std.dev.: 0.1758) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.50% (4.8635 => 4.9364, std.dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -1.14% (1.1933 => 1.1797, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.57% (2.7475 => 2.7043, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.23% (2.9589 => 2.9226, std.dev.: 0.0114) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/ClamAV/clamscan: -0.03% (14.6542 => 14.6491, std.dev.: 0.0500) MultiSource/Applications/kimwitu++/kc: -0.65% (16.1621 => 16.0575, std.dev.: 0.1629) MultiSource/Applications/lua/lua: 0.66% (3.6714 => 3.6955, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: 2.58% (0.9946 => 1.0203, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -0.42% (2.1618 => 2.1527, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: 0.78% (0.6062 => 0.6109, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -0.60% (0.1664 => 0.1654, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.48% (0.0676 => 0.0686, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.33% (0.1506 => 0.1526, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.78% (0.3093 => 0.3069, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2351 => 0.2350, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.19% (0.3180 => 0.3186, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.26% (0.2297 => 0.2303, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 4.17% (0.0432 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -8.89% (0.0090 => 0.0082, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-11-VaListArg: 150.00% (0.0034 => 0.0085, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.39% (0.0238 => 0.0199, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.10% (0.0123 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0386 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.17% (0.0232 => 0.0220, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.42% (0.0282 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.82% (0.0268 => 0.0239, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 32.84% (0.0134 => 0.0178) SingleSource/UnitTests/Vector/Altivec/test1: -0.52% (0.0191 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.85% (0.0246 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 34.69% (0.0245 => 0.0330, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -2.09% (1.7619 => 1.7250, std.dev.: 0.0193) MultiSource/Applications/JM/lencod/lencod: -16.67% (0.0006 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/lemon/lemon: 4.76% (0.0063 => 0.0066, std.dev.: 0.0012) MultiSource/Applications/lua/lua: - (0.0001 => 0.0001) MultiSource/Applications/minisat/minisat: -0.76% (13.0323 => 12.9339, std.dev.: 0.0378) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.69% (0.1729 => 0.1741, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.86% (0.0140 => 0.0136, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.57% (0.5525 => 0.5612, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/pifft/pifft: 0.64% (0.1719 => 0.1730, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.87% (0.1377 => 0.1365, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (0.0068 => 0.0069, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: - (0.0039 => 0.0039, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.95% (0.0612 => 0.0545, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 47.16% (0.0176 => 0.0259, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.73% (0.0578 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -20.46% (0.0259 => 0.0206, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: - (0.0019 => 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -1.01% (0.0691 => 0.0684, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -0.04% (499.4044 => 499.1847, std.dev.: 0.2870) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1269 => 1.1272, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0016 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.82% (0.0601 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.97% (0.0144 => 0.0203, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.92% (0.0208 => 0.0264, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -7.58% (18.5555 => 17.1490, std.dev.: 1.8322) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -0.07% (2.7492 => 2.7472, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7671 => 0.7650, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -0.33% (0.2998 => 0.2988, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: 1.21% (2.3521 => 2.3806, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: 0.56% (9.5152 => 9.5683, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 300.00% (0.0001 => 0.0004, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: -3.13% (0.0032 => 0.0031, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.11% (1.5997 => 1.5979, std.dev.: 0.0063) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: 0.28% (14.6079 => 14.6491, std.dev.: 0.0500) MultiSource/Applications/kimwitu++/kc: 4.88% (15.3105 => 16.0575, std.dev.: 0.1629) MultiSource/Applications/lua/lua: 2.71% (3.5980 => 3.6955, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 2.65% (2.0972 => 2.1527, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.16% (0.0790 => 0.0686, std.dev.: 0.0033) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: 2501.81% (0.0663 => 1.7250, std.dev.: 0.0193) MultiSource/Applications/JM/lencod/lencod: -99.99% (6.7458 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -99.80% (0.0500 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (29.5232 => 0.0001) MultiSource/Applications/minisat/minisat: 107.79% (6.2244 => 12.9339, std.dev.: 0.0378) MultiSource/Applications/siod/siod: -100.00% (3.5520 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.43% (2.4042 => 0.0136, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -91.95% (6.9722 => 0.5612, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/pifft/pifft: -0.75% (0.1743 => 0.1730, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -97.91% (0.3301 => 0.0069, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -90.99% (0.0433 => 0.0039, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -99.18% (2.5166 => 0.0206, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -99.87% (1.4184 => 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -27.77% (0.0947 => 0.0684, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 62397987.50% (0.0008 => 499.1847, std.dev.: 0.2870) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.50% (0.0040 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -15.11% (0.0311 => 0.0264, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -19.00% (21.1721 => 17.1490, std.dev.: 1.8322) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -7.59% (2.9728 => 2.7472, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -79.31% (1.4441 => 0.2988, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: 1.51% (2.3453 => 2.3806, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: 3.44% (9.2503 => 9.5683, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 300.00% (0.0001 => 0.0004, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: - (0.0031 => 0.0031, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.27% (4.1772 => 3.1216, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/except: 82816.67% (0.0006 => 0.4975, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.18% (0.1414 => 0.1558, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.84% (0.1159 => 0.1273, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 8.02% (2.1763 => 2.3509, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 7.61% (0.5309 => 0.5713, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.33% (0.6410 => 0.6880, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.01% (0.3582 => 0.3833, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 6.79% (0.6173 => 0.6592, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 6.03% (1.0046 => 1.0652, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (1.1653 => 1.2342, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.60% (0.2552 => 0.2695, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.24% (0.6069 => 0.6387, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.6915 => 0.7238, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (1.5150 => 1.5850, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.59% (0.4880 => 0.5104, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.33% (0.3901 => 0.4070, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.31% (29.3170 => 30.5819, std.dev.: 0.1388) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.15% (0.7639 => 0.7956, std.dev.: 0.0120) MultiSource/Applications/d/make_dparser: 4.00% (3.0225 => 3.1435, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4248 => 0.4415, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.7722 => 0.8022, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.86% (0.2797 => 0.2905, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.63% (1.1672 => 1.2096, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (12.6413 => 13.0841, std.dev.: 0.1653) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.1827 => 1.2235, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.23% (1.2021 => 1.2409, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.12% (1.1440 => 1.1797, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.10% (13.3238 => 13.7364, std.dev.: 0.0354) MultiSource/Applications/oggenc/oggenc: 2.87% (4.7455 => 4.8819, std.dev.: 0.0273) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (6.2546 => 6.4319, std.dev.: 0.0207) MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (8.2186 => 8.4449, std.dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (1.0689 => 1.0974, std.dev.: 0.0069) MultiSource/Applications/hbd/hbd: 2.59% (1.3268 => 1.3611, std.dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.0821 => 1.1099, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8405 => 0.8619, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.52% (0.8569 => 0.8785, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 2.47% (6.4908 => 6.6508, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5740 => 0.5880, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.4408 => 1.4754, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.0317 => 2.0787, std.dev.: 0.0122) MultiSource/Applications/JM/lencod/lencod: 2.25% (14.7256 => 15.0563, std.dev.: 0.0491) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.4113 => 1.4428, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.19% (0.5937 => 0.6067, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.0318 => 4.1173, std.dev.: 0.0126) MultiSource/Applications/treecc/treecc: 1.99% (1.8798 => 1.9173, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.87% (0.5520 => 0.5623, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.56% (1.4189 => 1.4411, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.07% (8.2559 => 8.3445, std.dev.: 0.0337) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.25% (4.0101 => 4.5415, std.dev.: 0.0378) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.00% (0.0917 => 0.1027, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.35% (1.0063 => 1.1004, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6255, std.dev.: 0.0470) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.05% (0.2857 => 0.3087, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 4.45% (15.2242 => 15.9010, std.dev.: 0.0208) SingleSource/Benchmarks/Misc/dt: 4.42% (0.9851 => 1.0286, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5396, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.17% (0.5876 => 0.6062, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 2.75% (3.8907 => 3.9978, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/mason/mason: 2.46% (0.5004 => 0.5127, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (6.6312 => 6.7740, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.6127 => 4.6989, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.45% (2.6656 => 2.7043, std.dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (3.4230 => 3.4677, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -99.81% (1.4117 => 0.0027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.23% (5.2665 => 4.0958, std.dev.: 0.0839) SingleSource/Benchmarks/Shootout-C++/ary3: -20.53% (1.7473 => 1.3886, std.dev.: 0.0373) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.46% (15.8312 => 13.0672, std.dev.: 0.1698) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.33% (1.1647 => 0.9628, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: -11.09% (8.5113 => 7.5672, std.dev.: 0.1052) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.37% (3.2007 => 2.9647, std.dev.: 0.0282) MultiSource/Applications/lambda-0_1_3/lambda: -7.21% (7.6833 => 7.1295, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3751, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/fibo: -6.68% (4.6355 => 4.3258, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/distray/distray: -6.57% (0.2664 => 0.2489, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9523, std.dev.: 0.1275) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7260, std.dev.: 0.0332) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1893, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.40% (0.4564 => 0.4363, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -3.31% (0.4296 => 0.4154, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.16% (1.2959 => 1.2550, std.dev.: 0.0141) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.05% (1.2722 => 1.2334, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.99% (3.7496 => 3.6375, std.dev.: 0.0267) MultiSource/Benchmarks/PAQ8p/paq8p: -2.76% (92.7467 => 90.1900, std.dev.: 0.5173) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.71% (0.4140 => 0.4028, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -2.20% (2.4013 => 2.3484, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -2.11% (3.4286 => 3.3564, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.97% (1.1683 => 1.1453, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4191, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.84% (1.8739 => 1.8394, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3569 => 2.3172, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -1.65% (8.5323 => 8.3919, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.62% (2.0027 => 1.9702, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (9.3855 => 9.2374, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std.dev.: 0.0713) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.37% (27.1724 => 26.8012, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/lists: -1.15% (16.5617 => 16.3706, std.dev.: 0.0183) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.23% (0.9980 => 1.0203, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.44% (0.6022 => 0.6109, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -0.72% (0.1666 => 0.1654, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.80% (0.1554 => 0.1526, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.45% (0.3083 => 0.3069, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.84% (0.2394 => 0.2350, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (0.3175 => 0.3186, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2302 => 0.2303, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -7.87% (0.0089 => 0.0082, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-11-VaListArg: -5.56% (0.0090 => 0.0085, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.08% (0.0240 => 0.0199, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.91% (0.0301 => 0.0220, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -26.23% (0.0324 => 0.0239, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1429 => 0.0001) MultiSource/Applications/lemon/lemon: -99.56% (1.5019 => 0.0066, std.dev.: 0.0012) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 15.99% (0.1501 => 0.1741, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -99.98% (0.4264 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.56% (0.1344 => 0.1365, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.47% (0.0589 => 0.0545, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.64% (0.0232 => 0.0259, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.16% (0.0639 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.69% (1.1350 => 1.1272, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0637 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (0.0246 => 0.0203, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.01% (1.5363 => 1.5979, std.dev.: 0.0063) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 04:58:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 06:58:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929115842.629D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4380?compare_to=4377&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4380, Order: 164889, Start Time: 2012-09-29 10:46:43, End Time: 2012-09-29 12:00:18 To: 4377, Order: 164887, Start Time: 2012-09-29 09:01:12, End Time: 2012-09-29 10:14:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (85 on baseline) Performance Regressions: 0 (174 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 85 (0 on baseline) Unchanged Tests: 957 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0480 => 0.0480, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0480 => 0.0481, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0450 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0439 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0432 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0453 => 0.0453) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.20% (0.0455 => 0.0465, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.45% (0.0441 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0422 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: - (0.0003 => 0.0003) MultiSource/Applications/JM/ldecod/ldecod: - (0.1048 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: - (0.0014 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -0.04% (1.4654 => 1.4648, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -0.19% (0.8456 => 0.8440, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.36% (0.0276 => 0.0275, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.06% (0.1695 => 0.1696, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: - (0.0174 => 0.0174, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: - (0.0012 => 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0002 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0140 => 0.0140) MultiSource/Benchmarks/nbench/nbench: 0.01% (8.2716 => 8.2724, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: - (0.0008 => 0.0008, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: -99.80% (0.1519 => 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -12.23% (0.1194 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -99.98% (7.6086 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.45% (1.4298 => 1.4648, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -81.62% (4.5928 => 0.8440, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.38% (4.4062 => 0.0275, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -97.69% (7.3305 => 0.1696, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -99.12% (1.9762 => 0.0174, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -99.92% (1.4728 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -94.29% (0.0035 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.45% (0.0145 => 0.0140) MultiSource/Benchmarks/nbench/nbench: -26.55% (11.2619 => 8.2724, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -99.90% (0.8273 => 0.0008, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.88% (2.0176 => 2.4389, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.21% (0.4328 => 0.4813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.93% (0.5748 => 0.6376, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.65% (3.9660 => 4.3883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.57% (0.7038 => 0.7782, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.47% (0.1327 => 0.1466, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.43% (1.3693 => 1.5121, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 10.38% (0.7061 => 0.7794, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash: 10.29% (0.4062 => 0.4480, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.25% (0.2596 => 0.2862, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.24% (0.1435 => 0.1582, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.13% (0.7710 => 0.8491, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 10.07% (0.2690 => 0.2961, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.05% (0.3899 => 0.4291, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.98% (0.2655 => 0.2920, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.95% (0.5265 => 0.5789, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 9.94% (0.2937 => 0.3229, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.90% (0.3485 => 0.3830, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2760 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.85% (1.2193 => 1.3394, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.78% (1.9828 => 2.1767, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.3580 => 0.3930, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.77% (0.6959 => 0.7639, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.76% (0.4016 => 0.4408, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.69% (0.3489 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.6283 => 0.6890, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.64% (0.3756 => 0.4118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2761 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.61% (0.9199 => 1.0083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.57% (0.3293 => 0.3608, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 9.44% (13.8202 => 15.1253, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 9.43% (0.3149 => 0.3446, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.41% (1.1364 => 1.2433, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.37% (1.4563 => 1.5928, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sieve: 9.35% (0.3453 => 0.3776, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 9.20% (0.3868 => 0.4224, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.4791 => 0.5231, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.02% (1.0313 => 1.1243, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.95% (0.4390 => 0.4783, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.82% (0.5577 => 0.6069, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.56% (0.2945 => 0.3197, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.48% (0.2995 => 0.3249, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 8.41% (3.8646 => 4.1896, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 8.30% (1.1061 => 1.1979, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.29% (0.4379 => 0.4742, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.20% (0.2914 => 0.3153, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 8.17% (16.6129 => 17.9709, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/football/football: 8.06% (0.8310 => 0.8980, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.99% (3.6692 => 3.9622, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.98% (0.5637 => 0.6087, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.98% (0.2243 => 0.2422, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.95% (7.2180 => 7.7917, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 7.93% (0.6744 => 0.7279, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.92% (0.1276 => 0.1377, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.91% (0.3755 => 0.4052, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.90% (0.7506 => 0.8099, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 7.86% (0.2925 => 0.3155, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3220 => 0.3472, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.74% (0.8698 => 0.9371, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.67% (0.7460 => 0.8032, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.61% (2.1791 => 2.3450, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 7.60% (3.1889 => 3.4314, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1865 => 0.2006, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 7.53% (1.9270 => 2.0721, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 7.47% (1.0594 => 1.1385, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.41% (0.6576 => 0.7063, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.33% (1.3245 => 1.4216, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.92% (14.8535 => 15.8818, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.4003 => 0.4276, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.76% (4.4433 => 4.7438, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 6.75% (1.2749 => 1.3609, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.70% (4.3801 => 4.6736, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 6.69% (8.4961 => 9.0644, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions: 6.67% (0.3914 => 0.4175, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.67% (0.6135 => 0.6544, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 6.66% (0.3601 => 0.3841, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.66% (1.2292 => 1.3111, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.65% (0.2859 => 0.3049, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (1.1333 => 1.2083, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.60% (0.3650 => 0.3891, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 6.52% (0.3940 => 0.4197, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (13.2842 => 14.1502, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/for-in: 6.52% (0.3789 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.52% (0.4113 => 0.4381, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.48% (1.3819 => 1.4714, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 6.44% (0.3663 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.43% (0.3623 => 0.3856, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.37% (0.8818 => 0.9380, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.36% (1.3813 => 1.4691, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.26% (4.6629 => 4.9550, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 6.19% (14.5298 => 15.4287, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (6.5754 => 6.9789, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.13% (3.2742 => 3.4748, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.10% (0.3511 => 0.3725, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.6250 => 0.6628, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.4805 => 0.5091, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.64% (4.9865 => 5.2679, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.43% (0.9108 => 0.9603, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.35% (1.5188 => 1.6001, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.07% (3.7467 => 3.9367, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.79% (2.1007 => 2.2014, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (6.2785 => 6.5749, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 4.18% (33.2944 => 34.6848, std.dev.: 0.0275) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7367, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (3.1736 => 3.4176, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1560 => 1.2318, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.32% (2.8813 => 3.0346, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.74% (2.8606 => 2.9963, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.90% (10.7476 => 11.1672, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.87% (1.7081 => 1.7742, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.14% (12.0921 => 12.4719, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5897, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5846, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (9.9194 => 10.0299, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.01% (12.4560 => 12.5820, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.34% (0.4657 => 0.3896, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.30% (22.5627 => 22.0434, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.80% (1.2308 => 1.0856, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2930, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3024, std.dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5090, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.43% (3.2729 => 3.1607, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.83% (3.0263 => 2.9406, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.97% (0.6615 => 0.6485, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2417, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.69% (5.3167 => 5.2268, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8984, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2297, std.dev.: 0.0096) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 05:24:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 07:24:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929122445.5F2342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4381?compare_to=4378&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4381, Order: 164890, Start Time: 2012-09-29 11:04:51, End Time: 2012-09-29 12:26:20 To: 4378, Order: 164889, Start Time: 2012-09-29 09:07:36, End Time: 2012-09-29 10:28:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 11 (1 on baseline) Performance Regressions: 6 (148 on baseline) Performance Improvements: 5 (36 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 928 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: 3582.61% (0.0046 => 0.1694, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 19.54% (0.1049 => 0.1254, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 737400.00% (0.0014 => 10.3250, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -0.27% (1.4567 => 1.4527, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 440.26% (0.8545 => 4.6165, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15932.00% (0.0275 => 4.4088, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/bh/bh: 11010.34% (0.0174 => 1.9332, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 92950.00% (0.0012 => 1.1166, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1750.00% (0.0002 => 0.0037, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 41.06% (8.3645 => 11.7993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 118737.50% (0.0008 => 0.9507, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.90% (3.0670 => 3.2174, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 2.20% (1.1901 => 1.2163, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.0855 => 1.0988, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (27.6650 => 27.9964, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: 1.10% (7.9606 => 8.0479, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.10% (1.5789 => 1.5962, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.47% (0.8446 => 0.8322, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: -1.41% (0.8005 => 0.7892, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -1.38% (15.2404 => 15.0307, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -1.02% (1.3575 => 1.3436, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.81% (12.4815 => 12.2552, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.10% (0.5775 => 0.5769, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -0.34% (16.0593 => 16.0052, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: -0.88% (15.0826 => 14.9501, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -0.21% (83.1250 => 82.9503, std.dev.: 0.0383) MultiSource/Benchmarks/MallocBench/gs/gs: -0.76% (4.3701 => 4.3371, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.35% (0.7733 => 0.7706, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.46% (0.7537 => 0.7502, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.14% (0.6603 => 0.6594, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.29% (0.6628 => 0.6609, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.18% (0.6176 => 0.6165, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.39% (0.6192 => 0.6168, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.30% (0.5905 => 0.5887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.17% (0.5910 => 0.5900, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.20% (0.6599 => 0.6586, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.24% (0.6607 => 0.6591, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.19% (0.6384 => 0.6372, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.38% (0.6376 => 0.6352, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.15% (0.6068 => 0.6059, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.20% (0.6033 => 0.6021, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.14% (0.6315 => 0.6306, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.6344 => 0.6329, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.26% (0.6915 => 0.6897, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.27% (0.6924 => 0.6905, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.19% (0.5922 => 0.5911, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.10% (0.5945 => 0.5939, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.26% (0.6426 => 0.6409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.11% (0.6431 => 0.6424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.27% (0.5982 => 0.5966, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.5989 => 0.5975, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.18% (0.5667 => 0.5657, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.35% (0.5688 => 0.5668, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.14% (0.5677 => 0.5669, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.21% (0.5694 => 0.5682, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.10% (0.6852 => 0.6845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.20% (0.6876 => 0.6862, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.18% (0.5552 => 0.5542, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.22% (0.5568 => 0.5556, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.14% (0.5684 => 0.5676, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.21% (0.5689 => 0.5677, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.18% (0.5959 => 0.5948, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.22% (0.5966 => 0.5953, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.2320 => 1.2307, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.61% (7.5940 => 7.5479, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.37% (3.7388 => 3.7248, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.91% (0.6580 => 0.6520, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.35% (0.1432 => 0.1427, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.86% (0.0694 => 0.0688, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.16% (63.2438 => 82.9503, std.dev.: 0.0383) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14240.28% (0.0720 => 10.3250, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.98% (10.3673 => 15.0307, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 27.93% (0.1622 => 0.2075, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.79% (2.2022 => 2.5278, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.64% (7.0540 => 8.0865, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.17% (1.1194 => 1.2668, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.78% (1.7609 => 1.9683, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.04% (0.1584 => 0.1743, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 10.02% (0.3282 => 0.3611, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.61% (0.1655 => 0.1814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.56% (0.3307 => 0.3590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5925 => 0.6429, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.37% (0.6030 => 0.6535, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.11% (0.8172 => 0.8835, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.4879 => 0.5267, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 7.87% (9.4845 => 10.2309, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.82% (0.1625 => 0.1752, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6675 => 0.7192, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 7.70% (10.4361 => 11.2396, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: 7.66% (0.7115 => 0.7660, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.48% (0.3422 => 0.3678, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.46% (0.3109 => 0.3341, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 7.37% (0.2714 => 0.2914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.37% (0.2756 => 0.2959, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 7.31% (0.7433 => 0.7976, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.25% (0.5105 => 0.5475, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.23% (0.2793 => 0.2995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.21% (0.2831 => 0.3035, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4289 => 0.4594, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.07% (5.7591 => 6.1663, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.02% (0.4615 => 0.4939, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4203 => 0.4497, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.92% (0.3423 => 0.3660, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.92% (1.5415 => 1.6482, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 6.90% (3.3354 => 3.5655, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.89% (0.3136 => 0.3352, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (4.2646 => 4.5579, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (2.0665 => 2.2063, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.74% (0.4064 => 0.4338, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.74% (0.3650 => 0.3896, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.73% (0.4103 => 0.4379, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.68% (1.3050 => 1.3922, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.68% (0.3098 => 0.3305, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.65% (0.3865 => 0.4122, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (8.1363 => 8.6760, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.60% (0.2107 => 0.2246, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.5860 => 0.6246, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.57% (4.9449 => 5.2700, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3826 => 0.4077, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3283 => 0.3498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.54% (0.3379 => 0.3600, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.52% (0.4048 => 0.4312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.52% (0.5569 => 0.5932, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.41% (5.0018 => 5.3223, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.6456 => 0.6869, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.38% (0.4636 => 0.4932, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 6.36% (0.3603 => 0.3832, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.33% (0.3162 => 0.3362, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.32% (0.4620 => 0.4912, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.31% (0.5020 => 0.5337, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.25% (0.3935 => 0.4181, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.22% (0.7835 => 0.8322, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.20% (0.8067 => 0.8567, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 6.19% (0.3684 => 0.3912, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.13% (0.2758 => 0.2927, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 6.00% (1.1642 => 1.2341, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.97% (0.9765 => 1.0348, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.92% (1.5603 => 1.6527, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.84% (0.3441 => 0.3642, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (1.1861 => 1.2552, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 5.78% (3.8723 => 4.0963, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 5.77% (0.4299 => 0.4547, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 5.76% (1.0722 => 1.1340, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (7.9617 => 8.4113, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: 5.63% (0.3180 => 0.3359, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.52% (0.3387 => 0.3574, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.47% (21.9371 => 23.1377, std.dev.: 0.0195) MultiSource/Applications/treecc/treecc: 5.42% (2.0273 => 2.1371, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.29% (0.6450 => 0.6791, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.90% (0.8921 => 0.9358, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.75% (1.5859 => 1.6612, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 4.67% (2.2969 => 2.4041, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2842 => 1.3436, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.60% (0.5981 => 0.6256, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (14.3668 => 15.0143, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.35% (1.4186 => 1.4803, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.31% (2.2024 => 2.2974, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.1840 => 1.2332, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (0.8101 => 0.8389, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.18% (0.3427 => 0.3536, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.83% (17.1811 => 17.4963, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.73% (3.8922 => 3.9597, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3815, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.79% (0.3463 => 0.3629, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7756, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3514, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7993, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2315, std.dev.: 0.0219) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5782, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.45% (5.2763 => 3.2476, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.70% (5.3855 => 3.8937, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8885, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1237, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.17% (2.9384 => 2.6101, std.dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: -6.52% (22.1758 => 20.7301, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0988, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3064, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7919, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1618, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4932, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5004, std.dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9934, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0903, std.dev.: 0.0202) SingleSource/UnitTests/Vector/multiplies: -1.76% (2.5528 => 2.5079, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2552, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2295, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.33% (0.5229 => 0.5769, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 6.78% (14.9895 => 16.0052, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 5.61% (14.1553 => 14.9501, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 5.51% (4.1105 => 4.3371, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1048 => 1.2307, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.44% (7.1582 => 7.5479, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.56% (3.4629 => 3.7248, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.79% (0.6222 => 0.6520, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.91% (0.1485 => 0.1427, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.49% (0.2116 => 0.0688, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 05:29:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 07:29:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929122931.AC86F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4382?compare_to=4379&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4382, Order: 164891, Start Time: 2012-09-29 11:08:15, End Time: 2012-09-29 12:31:09 To: 4379, Order: 164889, Start Time: 2012-09-29 09:04:06, End Time: 2012-09-29 10:50:02 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 29 (10 on baseline) Performance Regressions: 15 (75 on baseline) Performance Improvements: 4 (43 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 925 (773 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: 2.50% (14.6491 => 15.0146, std.dev.: 0.1371) MultiSource/Applications/kimwitu++/kc: 1.36% (16.0575 => 16.2751, std.dev.: 0.2634) MultiSource/Applications/lua/lua: 0.97% (3.6955 => 3.7313, std.dev.: 0.0452) MultiSource/Applications/siod/siod: 0.65% (2.1527 => 2.1668, std.dev.: 0.0232) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.08% (0.0686 => 0.0762, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: -96.38% (1.7250 => 0.0624, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1321540.00% (0.0005 => 6.6082, std.dev.: 0.0735) MultiSource/Applications/kimwitu++/kc: 52600.00% (0.0001 => 0.0527, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 28900300.00% (0.0001 => 28.9004, std.dev.: 0.2782) MultiSource/Applications/minisat/minisat: -51.70% (12.9339 => 6.2470, std.dev.: 0.2475) MultiSource/Applications/siod/siod: - (0.0000 => 3.6462, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17877.21% (0.0136 => 2.4449, std.dev.: 0.0631) MultiSource/Benchmarks/Bullet/bullet: 1142.89% (0.5612 => 6.9751, std.dev.: 0.0230) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.35% (0.1730 => 0.1672, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4955.07% (0.0069 => 0.3488, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 956.41% (0.0039 => 0.0412, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 11636.41% (0.0206 => 2.4177, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: 75652.63% (0.0019 => 1.4393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 40.35% (0.0684 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -100.00% (499.1847 => 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 500.00% (0.0001 => 0.0006, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.26% (0.0264 => 0.0299, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 26.42% (17.1490 => 21.6805, std.dev.: 0.4388) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.75% (2.7472 => 2.7954, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 352.34% (0.2988 => 1.3516, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/whetstone: -0.16% (2.3806 => 2.3767, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/methcall: -6.59% (9.5683 => 8.9375, std.dev.: 0.0404) SingleSource/Benchmarks/Shootout-C++/objinst: 50.00% (0.0004 => 0.0006) SingleSource/Benchmarks/Stanford/Oscar: - (0.0031 => 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/power/power: 12.01% (0.1066 => 0.1194, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.28% (0.7165 => 0.7400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.73% (0.8750 => 0.8901, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 1.51% (3.1435 => 3.1911, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 51785.19% (0.0027 => 1.4009, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ReedSolomon: 12.76% (7.5672 => 8.5324, std.dev.: 0.0205) SingleSource/Benchmarks/Dhrystone/dry: 4.37% (2.3484 => 2.4510, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 2.92% (14.4860 => 14.9088, std.dev.: 0.0470) MultiSource/Benchmarks/Olden/tsp/tsp: 2.73% (1.7718 => 1.8201, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.64% (13.0672 => 13.4118, std.dev.: 0.1093) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.18% (4.3342 => 4.4289, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.79% (5.2940 => 5.3888, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.65% (2.9226 => 2.9708, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.20% (39.0226 => 39.4912, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.13% (1.8394 => 1.8601, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.86% (6.1708 => 5.5007, std.dev.: 0.2043) MultiSource/Applications/SIBsim4/SIBsim4: -7.38% (3.4677 => 3.2119, std.dev.: 0.0442) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.91% (1.9702 => 1.8735, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.04% (4.9607 => 4.9093, std.dev.: 0.0140) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.41% (1.0203 => 1.0161, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6109 => 0.6086, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: -0.42% (0.1654 => 0.1647, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.88% (0.1526 => 0.1570, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.76% (0.3069 => 0.3123, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (0.2350 => 0.2377, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.22% (0.3186 => 0.3193, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.26% (0.2303 => 0.2309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0450 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -34.15% (0.0082 => 0.0054, std.dev.: 0.0017) SingleSource/UnitTests/2003-08-11-VaListArg: 5.88% (0.0085 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 22.11% (0.0199 => 0.0243, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.91% (0.0220 => 0.0233, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.08% (0.0278 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 33.89% (0.0239 => 0.0320, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -1.12% (0.0178 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0190 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.19% (0.0253 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -1.82% (0.0330 => 0.0324, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 145000.00% (0.0001 => 0.1451, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 23274.24% (0.0066 => 1.5427, std.dev.: 0.0132) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -13.15% (0.1741 => 0.1512, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 420500.00% (0.0001 => 0.4206, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.90% (0.1365 => 0.1339, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.55% (0.0545 => 0.0548, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.83% (0.0259 => 0.0218, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.28% (0.0640 => 0.0587, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1272 => 1.1310, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0016 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 360.00% (0.0005 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.76% (0.0636 => 0.0593, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.56% (0.0203 => 0.0143, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.7650 => 0.7654, std.dev.: 0.0249) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.30% (1.5979 => 1.5931, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.09% (4.1772 => 3.0873, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/except: 81966.67% (0.0006 => 0.4924, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.58% (0.0745 => 0.0876, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.41% (0.1414 => 0.1547, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.82% (2.1763 => 2.3464, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 7.69% (0.5309 => 0.5717, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.35% (0.6410 => 0.6881, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 6.30% (15.3105 => 16.2751, std.dev.: 0.2634) MultiSource/Applications/minisat/minisat: 6.17% (0.6173 => 0.6554, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.86% (0.3582 => 0.3792, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 5.78% (1.1653 => 1.2327, std.dev.: 0.0214) MultiSource/Applications/d/make_dparser: 5.58% (3.0225 => 3.1911, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.79% (0.6069 => 0.6360, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.1672 => 1.2194, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.37% (0.2654 => 0.2770, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.30% (0.3026 => 0.3156, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 4.28% (29.3170 => 30.5721, std.dev.: 0.1526) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.4880 => 0.5085, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 4.19% (13.3238 => 13.8823, std.dev.: 0.0980) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.12% (0.7639 => 0.7954, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3217 => 0.3349, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (1.5150 => 1.5750, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.95% (0.4248 => 0.4416, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.86% (0.2797 => 0.2905, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.80% (4.7455 => 4.9257, std.dev.: 0.0599) MultiSource/Applications/lua/lua: 3.70% (3.5980 => 3.7313, std.dev.: 0.0452) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (6.4908 => 6.7265, std.dev.: 0.0374) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (12.6413 => 13.0962, std.dev.: 0.0468) MultiSource/Applications/hbd/hbd: 3.38% (1.3268 => 1.3716, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 3.32% (2.0972 => 2.1668, std.dev.: 0.0232) MultiSource/Applications/Burg/burg: 3.18% (1.1440 => 1.1804, std.dev.: 0.0137) MultiSource/Applications/treecc/treecc: 2.87% (1.8798 => 1.9338, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (3.0758 => 3.1635, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.85% (8.2186 => 8.4527, std.dev.: 0.0470) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.6079 => 15.0146, std.dev.: 0.1371) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.75% (1.2021 => 1.2351, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (6.2546 => 6.4198, std.dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.4408 => 1.4783, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0821 => 1.1098, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (4.0318 => 4.1183, std.dev.: 0.0276) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (1.0689 => 1.0900, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.5963 => 0.6067, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.4189 => 1.4428, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.29% (1.3935 => 1.4115, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 45.25% (0.0263 => 0.0382, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3394, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0013, std.dev.: 0.0756) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.10% (4.0101 => 4.5756, std.dev.: 0.0295) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.80% (7.0025 => 7.6187, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.77% (1.0063 => 1.0946, std.dev.: 0.0218) SingleSource/Benchmarks/Stanford/Puzzle: 8.65% (0.1433 => 0.1557, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.13% (4.2129 => 4.4289, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/tsp/tsp: 5.03% (1.7330 => 1.8201, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.88% (0.7609 => 0.7980, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.63% (40.4792 => 42.3550, std.dev.: 0.5867) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 3.81% (15.2242 => 15.8038, std.dev.: 0.0540) SingleSource/Benchmarks/Misc/dt: 3.34% (0.9851 => 1.0180, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 2.91% (14.4877 => 14.9088, std.dev.: 0.0470) MultiSource/Benchmarks/FreeBench/mason/mason: 2.82% (0.5004 => 0.5145, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 2.79% (3.8907 => 3.9993, std.dev.: 0.0114) MultiSource/Applications/siod/siod: 2.65% (3.5520 => 3.6462, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.60% (2.6656 => 2.7349, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.50% (4.6127 => 4.7281, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (6.6312 => 6.7749, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 2.07% (2.4013 => 2.4510, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.91% (2.9152 => 2.9708, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.49% (22.3381 => 22.6715, std.dev.: 0.0549) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.45% (38.9255 => 39.4912, std.dev.: 0.0391) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.58% (0.3497 => 0.2078, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.32% (5.2665 => 4.0910, std.dev.: 0.0960) SingleSource/Benchmarks/Shootout-C++/ary3: -20.97% (1.7473 => 1.3809, std.dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.48% (1.1647 => 0.9611, std.dev.: 0.0233) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.28% (15.8312 => 13.4118, std.dev.: 0.1093) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.97% (3.2007 => 2.9456, std.dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: -7.10% (7.6833 => 7.1378, std.dev.: 0.0371) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3735, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -6.66% (4.6355 => 4.3268, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.45% (2.0027 => 1.8735, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3516, std.dev.: 0.0191) MultiSource/Applications/SIBsim4/SIBsim4: -6.17% (3.4230 => 3.2119, std.dev.: 0.0442) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9486, std.dev.: 0.1719) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout/fib2: -5.35% (4.4195 => 4.1831, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.38% (0.3746 => 0.3582, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.93% (2.5166 => 2.4177, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.70% (1.2722 => 1.2251, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/misr: -3.61% (0.4296 => 0.4141, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (9.2503 => 8.9375, std.dev.: 0.0404) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.78% (3.7496 => 3.6452, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.29% (1.1683 => 1.1416, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (92.7467 => 90.7587, std.dev.: 0.0946) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.11% (2.4457 => 2.3942, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4180, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.99% (0.6119 => 0.5997, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3618, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3139, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2258, std.dev.: 0.0231) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.43% (27.1724 => 26.7849, std.dev.: 0.1013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3130, std.dev.: 0.0296) SingleSource/Benchmarks/Dhrystone/fldry: -1.23% (2.4971 => 2.4665, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: -1.22% (16.5617 => 16.3593, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/oourafft: -1.02% (3.8200 => 3.7811, std.dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: -1.00% (13.4743 => 13.3394, std.dev.: 0.0150) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.81% (0.9980 => 1.0161, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.06% (0.6022 => 0.6086, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1666 => 0.1647, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.03% (0.1554 => 0.1570, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.30% (0.3083 => 0.3123, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.2394 => 0.2377, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3175 => 0.3193, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.30% (0.2302 => 0.2309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -39.33% (0.0089 => 0.0054, std.dev.: 0.0017) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.59% (0.0301 => 0.0233, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1429 => 0.1451, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 2.72% (1.5019 => 1.5427, std.dev.: 0.0132) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1501 => 0.1512, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.36% (0.4264 => 0.4206, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.37% (0.1344 => 0.1339, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.96% (0.0589 => 0.0548, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.03% (0.0232 => 0.0218, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.35% (1.1350 => 1.1310, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.91% (0.0637 => 0.0593, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.87% (0.0246 => 0.0143, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0249) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.70% (1.5363 => 1.5931, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 06:20:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 08:20:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929132001.1FE022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4383?compare_to=4376&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4383, Order: 164889, Start Time: 2012-09-29 10:36:53, End Time: 2012-09-29 13:21:37 To: 4376, Order: 164885, Start Time: 2012-09-29 07:20:16, End Time: 2012-09-29 10:04:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 968 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 11.07% (67.4642 => 74.9344, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary: 8.09% (0.2090 => 0.2259, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.42% (0.0471 => 0.0473) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.42% (0.0472 => 0.0474) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.46% (0.0431 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.45% (0.0442 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0427 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.47% (0.0427 => 0.0429) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0445 => 0.0446) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.67% (0.0446 => 0.0449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0421 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.44% (0.0451 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0453 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3496 => 0.3918, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 12.06% (0.3465 => 0.3883, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3469 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.00% (0.3442 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.91% (0.3460 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.59% (0.3650 => 0.4073, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3724 => 0.4149, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.35% (0.1063 => 0.1173, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.02% (1.5932 => 1.7528, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.23% (0.5826 => 0.6364, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.5889 => 0.6429, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.3004 => 0.3270, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.77% (0.2738 => 0.2978, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2875 => 0.3116, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.23% (0.1421 => 0.1538, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.14% (0.3195 => 0.3455, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.12% (0.3362 => 0.3635, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7171 => 0.7750, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 8.05% (0.9909 => 1.0707, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 8.04% (0.2725 => 0.2944, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 8.03% (0.2714 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.00% (0.2750 => 0.2970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.00% (0.2813 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.93% (0.2823 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.90% (0.2911 => 0.3141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2811 => 0.3032, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.2780 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2803 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.81% (0.2729 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.80% (0.4361 => 0.4701, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (1.3152 => 1.4173, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.75% (0.3096 => 0.3336, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.75% (2.0673 => 2.2275, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2792 => 0.3008, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.70% (1.6211 => 1.7459, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3267 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3060 => 0.3292, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3258 => 0.3502, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.45% (0.4994 => 0.5366, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.45% (3.5627 => 3.8280, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.44% (0.5000 => 0.5372, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.33% (0.3124 => 0.3353, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.33% (5.5417 => 5.9479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3317 => 0.3560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3348 => 0.3593, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.28% (0.3930 => 0.4216, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 7.26% (0.4146 => 0.4447, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 7.25% (0.2566 => 0.2752, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 7.18% (0.3678 => 0.3942, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3726 => 0.3991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.09% (0.3625 => 0.3882, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 7.08% (0.3477 => 0.3723, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 7.07% (1.0781 => 1.1543, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3282 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.87% (0.2736 => 0.2924, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.2014 => 0.2152, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.82% (2.7292 => 2.9152, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.78% (0.3690 => 0.3940, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.3845 => 0.4104, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4251 => 0.4533, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.56% (4.2109 => 4.4872, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 6.44% (0.6634 => 0.7061, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.43% (0.3981 => 0.4237, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.2866 => 0.3047, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (4.4195 => 4.6952, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.5012 => 0.5324, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (2.1013 => 2.2293, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.03% (0.6435 => 0.6823, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (0.2691 => 0.2853, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.01% (4.6177 => 4.8951, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 5.90% (2.1653 => 2.2931, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.89% (0.3903 => 0.4133, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 5.87% (23.5202 => 24.9008, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (0.5026 => 0.5321, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 5.85% (1.8794 => 1.9894, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.85% (0.2737 => 0.2897, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 5.85% (0.3336 => 0.3531, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.84% (0.3890 => 0.4117, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.5900 => 0.6242, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.73% (0.2075 => 0.2194, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.69% (0.2040 => 0.2156, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.68% (1.4269 => 1.5079, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.58% (0.4139 => 0.4370, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 5.53% (0.9697 => 1.0233, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.51% (0.3084 => 0.3254, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.41% (0.5546 => 0.5846, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.3271 => 0.3446, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.35% (0.4658 => 0.4907, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 5.27% (0.2391 => 0.2517, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.2103 => 0.2209, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (1.9694 => 2.0675, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.93% (2.0346 => 2.1350, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.92% (0.2969 => 0.3115, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 4.85% (0.7875 => 0.8257, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 4.85% (0.4847 => 0.5082, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.79% (1.9966 => 2.0922, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.3498 => 0.3644, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (0.7426 => 0.7733, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.01% (0.5361 => 0.5576, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.97% (0.4253 => 0.4422, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.58% (11.6398 => 12.0561, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.36% (4.6926 => 4.8505, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3792 => 0.3898, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.42% (11.9555 => 12.2450, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.34% (0.2162 => 0.3553, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1718, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.05% (14.0481 => 14.6169, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5124, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4449, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2796, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5808, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4645, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5830, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7830, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7990, std.dev.: 0.0126) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5193, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.10% (17.2379 => 16.8764, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0460, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 06:42:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 08:42:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929134242.1B7722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4384?compare_to=4380&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4384, Order: 164892, Start Time: 2012-09-29 12:29:22, End Time: 2012-09-29 13:44:18 To: 4380, Order: 164889, Start Time: 2012-09-29 10:46:43, End Time: 2012-09-29 12:00:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (72 on baseline) New Passes: 13 (0 on baseline) Performance Regressions: 3 (177 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 952 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc/ffbench MultiSource/Applications/ClamAV/clamscan: 52033.33% (0.0003 => 0.1564, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 13.36% (0.1048 => 0.1188, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 540264.29% (0.0014 => 7.5651, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -0.76% (1.4648 => 1.4537, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 441.30% (0.8440 => 4.5686, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15892.73% (0.0275 => 4.3980, std.dev.: 0.0296) MultiSource/Benchmarks/Bullet/bullet: 4177.48% (0.1696 => 7.2546, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: 10989.08% (0.0174 => 1.9295, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 123508.33% (0.0012 => 1.4833, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1550.00% (0.0002 => 0.0033, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (0.0140 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 41.73% (8.2724 => 11.7245, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 105062.50% (0.0008 => 0.8413, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.18% (3.0346 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 2.02% (1.2318 => 1.2567, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.35% (1.5741 => 1.5954, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.99% (12.4719 => 12.2234, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -1.38% (2.4075 => 2.3742, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.63% (0.0480 => 0.0477, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.42% (0.0481 => 0.0479) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0448 => 0.0448) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.67% (0.0451 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.46% (0.0439 => 0.0437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.69% (0.0434 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.45% (0.0449 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.67% (0.0451 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.45% (0.0445 => 0.0443, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.45% (0.0446 => 0.0444) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0435 => 0.0434) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0442 => 0.0441) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.44% (0.0453 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (0.0465 => 0.0453, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.45% (0.0443 => 0.0441) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0432 => 0.0431) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.47% (0.0425 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.47% (0.0425 => 0.0423) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.43% (0.0460 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.47% (0.0422 => 0.0420) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.47% (0.0423 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.47% (0.0425 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.92% (0.0433 => 0.0429, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.52% (2.0176 => 2.4517, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.38% (0.0826 => 0.0953, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.11% (0.0834 => 0.0935, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 10.86% (0.4328 => 0.4798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.62% (0.5818 => 0.6436, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.56% (0.1013 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.53% (3.9660 => 4.3837, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.47% (0.2721 => 0.3006, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 10.30% (1.3693 => 1.5104, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 10.23% (0.7038 => 0.7758, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.03% (0.3899 => 0.4290, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.03% (0.7061 => 0.7769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.02% (0.2596 => 0.2856, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.00% (0.4062 => 0.4468, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.95% (0.1327 => 0.1459, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.87% (0.6283 => 0.6903, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.83% (0.3022 => 0.3319, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.78% (1.2193 => 1.3385, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.77% (0.6959 => 0.7639, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.69% (0.5265 => 0.5775, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.69% (0.9199 => 1.0090, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.68% (0.7710 => 0.8456, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.60% (0.4791 => 0.5251, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.50% (0.3485 => 0.3816, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.48% (1.4563 => 1.5944, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.47% (13.8202 => 15.1289, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.47% (1.1364 => 1.2440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.44% (0.2607 => 0.2853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.41% (0.2690 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.29% (1.9828 => 2.1670, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.29% (0.3489 => 0.3813, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.27% (0.2655 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2765 => 0.3021, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.25% (0.3580 => 0.3911, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.24% (0.2966 => 0.3240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3293 => 0.3597, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.23% (0.2937 => 0.3208, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.21% (0.4016 => 0.4386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2628 => 0.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.19% (0.3756 => 0.4101, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.16% (0.2761 => 0.3014, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.02% (1.0313 => 1.1243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.01% (0.3107 => 0.3387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.97% (0.3868 => 0.4215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.2988 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.92% (0.3149 => 0.3430, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.77% (0.3453 => 0.3756, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.75% (0.1589 => 0.1728, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 8.68% (0.3192 => 0.3469, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.66% (0.4390 => 0.4770, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.61% (0.2995 => 0.3253, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3534 => 0.3838, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.57% (0.5577 => 0.6055, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.31% (16.6129 => 17.9929, std.dev.: 0.0146) MultiSource/Applications/Burg/burg: 8.27% (1.1061 => 1.1976, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.20% (0.4379 => 0.4738, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.18% (0.6576 => 0.7114, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.11% (3.8646 => 4.1781, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 8.11% (0.8310 => 0.8984, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.07% (0.5637 => 0.6092, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.03% (3.6692 => 3.9637, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 7.98% (0.2945 => 0.3180, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.90% (0.6744 => 0.7277, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (7.2180 => 7.7774, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 7.73% (0.3220 => 0.3469, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.71% (0.8698 => 0.9369, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.67% (1.0594 => 1.1407, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.64% (0.3755 => 0.4042, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.61% (3.1889 => 3.4316, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 7.59% (0.2925 => 0.3147, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.58% (0.1569 => 0.1688, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.57% (0.7460 => 0.8025, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 7.48% (1.9270 => 2.0711, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.42% (2.1791 => 2.3408, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4190, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.98% (14.8535 => 15.8901, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 6.93% (1.2749 => 1.3632, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.89% (0.2859 => 0.3056, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (1.3819 => 1.4766, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (8.4961 => 9.0776, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.79% (1.3813 => 1.4751, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.4003 => 0.4274, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3914 => 0.4176, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.65% (0.3789 => 0.4041, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3646 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.63% (4.3801 => 4.6707, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.63% (4.4433 => 4.7380, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.59% (0.6135 => 0.6539, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.58% (1.1333 => 1.2079, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.52% (0.3940 => 0.4197, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.52% (0.4113 => 0.4381, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.45% (0.3131 => 0.3333, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.43% (4.6629 => 4.9629, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (13.2842 => 14.1384, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.40% (0.8818 => 0.9382, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.32% (1.2292 => 1.3069, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.2140 => 0.2274, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (6.5754 => 6.9817, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 6.17% (14.5298 => 15.4270, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.17% (3.2742 => 3.4762, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.95% (0.3511 => 0.3720, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.6250 => 0.6621, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.87% (0.4805 => 0.5087, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.82% (0.2321 => 0.2456, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.70% (4.9865 => 5.2708, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.28% (0.9108 => 0.9589, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.27% (1.5188 => 1.5988, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 5.05% (3.7467 => 3.9358, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.79% (2.1007 => 2.2013, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (6.2785 => 6.5699, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: 4.11% (33.2944 => 34.6621, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 3.02% (16.2614 => 16.7524, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.71% (1.8175 => 2.2485, std.dev.: 0.0575) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.71% (1.1560 => 1.2567, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7245, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.01% (10.7476 => 11.0713, std.dev.: 0.0428) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5822, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0510, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6009, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2234, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3232, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.28% (0.4657 => 0.3899, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.09% (22.5627 => 22.0910, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.18% (1.2308 => 1.0809, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2723, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.71% (1.3780 => 1.2993, std.dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1577, std.dev.: 0.0159) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.72% (3.0263 => 2.9441, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7047, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2431, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1411, std.dev.: 0.0230) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8732, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2361, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2546, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 07:07:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 09:07:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929140758.04C0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4385?compare_to=4382&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4385, Order: 164892, Start Time: 2012-09-29 12:47:08, End Time: 2012-09-29 14:09:36 To: 4382, Order: 164891, Start Time: 2012-09-29 11:08:15, End Time: 2012-09-29 12:31:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 17 (91 on baseline) Performance Improvements: 8 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 948 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 6.40% (0.1767 => 0.1880, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.5640 => 0.5927, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.76% (0.2142 => 0.2244, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.73% (0.4500 => 0.4713, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.04% (0.7806 => 0.8043, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.23% (0.6018 => 0.6152, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.4278 => 1.4558, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.84% (1.2101 => 1.2324, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (0.9063 => 0.9216, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.30% (3.9483 => 3.9997, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (8.3217 => 8.4234, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.0900 => 1.1027, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.85% (0.0515 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.07% (0.5997 => 0.6241, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.08% (3.3547 => 3.4246, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.73% (3.5424 => 3.6036, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.29% (0.8786 => 0.8899, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.39% (0.8901 => 0.8777, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.18% (0.8488 => 0.8388, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -1.07% (4.9257 => 4.8731, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -4.62% (1.8201 => 1.7360, std.dev.: 0.0228) MultiSource/Applications/SPASS/SPASS: -2.93% (8.5396 => 8.2890, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.26% (5.4305 => 5.3078, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: -2.16% (4.4289 => 4.3332, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.70% (13.4118 => 13.1835, std.dev.: 0.0786) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.39% (1.0161 => 1.0201, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 0.97% (0.6086 => 0.6145, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -1.82% (0.1647 => 0.1617, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.46% (0.1570 => 0.1593, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3123 => 0.3126, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.80% (0.2377 => 0.2396, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3193 => 0.3190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2309 => 0.2306, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 2.67% (0.0450 => 0.0462) SingleSource/UnitTests/2003-05-07-VarArgs: 64.81% (0.0054 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.41% (0.0243 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0191 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0385 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.15% (0.0233 => 0.0252, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0281 => 0.0283, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0320 => 0.0322, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 1.70% (0.0176 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.59% (0.0189 => 0.0186, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 3.20% (0.0250 => 0.0258, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.85% (0.0324 => 0.0330, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1451 => 0.1453, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -4.93% (1.5427 => 1.4666, std.dev.: 0.0434) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1512 => 0.1512, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.99% (0.4206 => 0.3996, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.49% (0.1339 => 0.1359, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.58% (0.0548 => 0.0606, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0218 => 0.0187, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.71% (0.0587 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1310 => 1.1293, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -8.70% (0.0023 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.0593 => 0.0551, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.86% (0.0143 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7654 => 0.7668, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.33% (1.5931 => 1.5984, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.07% (4.1772 => 3.0883, std.dev.: 0.0332) SingleSource/Benchmarks/Shootout-C++/except: 82066.67% (0.0006 => 0.4930, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.97% (0.0745 => 0.0931, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.03% (0.1414 => 0.1570, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.66% (0.1159 => 0.1271, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.23% (0.5309 => 0.5746, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.93% (0.6410 => 0.6918, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.91% (2.1763 => 2.3485, std.dev.: 0.0139) MultiSource/Applications/minisat/minisat: 7.47% (0.6173 => 0.6634, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.43% (0.2552 => 0.2716, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 6.26% (1.0046 => 1.0675, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 6.16% (1.1653 => 1.2371, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 6.01% (15.3105 => 16.2302, std.dev.: 0.0312) MultiSource/Applications/lambda-0_1_3/lambda: 5.89% (0.6915 => 0.7322, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.82% (0.6069 => 0.6422, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.64% (0.3582 => 0.3784, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 5.60% (0.3217 => 0.3397, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.39% (0.4880 => 0.5143, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.5150 => 1.5881, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 4.72% (29.3170 => 30.7006, std.dev.: 0.1627) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.56% (0.7639 => 0.7987, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 4.36% (3.0225 => 3.1544, std.dev.: 0.0172) MultiSource/Applications/hbd/hbd: 4.35% (1.3268 => 1.3845, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.31% (0.4248 => 0.4431, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.2797 => 0.2916, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.20% (1.1827 => 1.2324, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.16% (0.7722 => 0.8043, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.3026 => 0.3146, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.96% (0.3008 => 0.3127, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (12.6413 => 13.1342, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3062 => 0.3180, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.2771 => 0.2877, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.81% (0.2654 => 0.2755, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.69% (1.1672 => 1.2103, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 3.67% (3.5980 => 3.7301, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.62% (0.5937 => 0.6152, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 3.58% (13.3238 => 13.8006, std.dev.: 0.0173) MultiSource/Applications/siod/siod: 3.51% (2.0972 => 2.1709, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.29% (0.7226 => 0.7464, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5740 => 0.5927, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.18% (6.2546 => 6.4537, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (1.0689 => 1.1027, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.15% (1.4113 => 1.4558, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (3.8796 => 3.9997, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.2186 => 8.4634, std.dev.: 0.0434) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8405 => 0.8649, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.6079 => 15.0296, std.dev.: 0.0476) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.5963 => 0.6128, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.4908 => 6.6697, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.75% (1.2021 => 1.2351, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.74% (1.8798 => 1.9314, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 2.69% (4.7455 => 4.8731, std.dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0821 => 1.1111, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.66% (4.0318 => 4.1392, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.57% (1.4189 => 1.4553, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.55% (0.4596 => 0.4713, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.7256 => 15.0981, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.5636 => 0.5775, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.40% (4.2616 => 4.3638, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.7784 => 0.7952, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5520 => 0.5636, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9029 => 0.9216, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.03% (8.2559 => 8.4234, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.3380 => 4.4172, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (1.3935 => 1.4179, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.2815 => 4.3518, std.dev.: 0.0197) MultiSource/Applications/hexxagon/hexxagon: 1.50% (0.9425 => 0.9566, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 28.86% (0.0499 => 0.0643, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2273, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std.dev.: 0.0765) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.82% (4.0101 => 4.5643, std.dev.: 0.0218) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.48% (1.0063 => 1.0916, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout/lists: 8.44% (7.0025 => 7.5935, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (0.3301 => 0.3469, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.72% (0.8498 => 0.8899, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/dt: 4.26% (0.9851 => 1.0271, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8476, std.dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.86% (4.2129 => 4.3332, std.dev.: 0.0161) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8949, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 2.75% (3.8907 => 3.9975, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/mason/mason: 2.64% (0.5004 => 0.5136, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 2.25% (3.5520 => 3.6318, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.20% (0.5876 => 0.6005, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (6.6312 => 6.7703, std.dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/dry: 2.02% (2.4013 => 2.4498, std.dev.: 0.0178) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (2.4042 => 2.4518, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash: 1.92% (0.6308 => 0.6429, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.32% (0.3497 => 0.2052, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: -20.68% (1.7473 => 1.3859, std.dev.: 0.0484) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.66% (5.2665 => 4.2310, std.dev.: 0.1927) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.44% (1.1647 => 0.9616, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.72% (15.8312 => 13.1835, std.dev.: 0.0786) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0303) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.10% (0.0917 => 0.0806, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.72% (3.2007 => 2.9537, std.dev.: 0.0173) MultiSource/Applications/lambda-0_1_3/lambda: -7.15% (7.6833 => 7.1338, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.94% (3.6254 => 3.3737, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3302, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: -6.31% (0.2664 => 0.2496, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7928, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -6.02% (1.4441 => 1.3571, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.4230 => 3.2260, std.dev.: 0.0585) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (62.4126 => 58.9295, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -5.46% (4.4195 => 4.1784, std.dev.: 0.0271) MultiSource/Benchmarks/Olden/bh/bh: -4.20% (2.5166 => 2.4109, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.18% (0.4564 => 0.4373, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -4.16% (9.2503 => 8.8659, std.dev.: 0.0690) MultiSource/Applications/sgefa/sgefa: -3.87% (0.3746 => 0.3601, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.51% (3.7496 => 3.6181, std.dev.: 0.0361) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.31% (1.2722 => 1.2301, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -2.85% (8.5323 => 8.2890, std.dev.: 0.0625) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2849, std.dev.: 0.0178) MultiSource/Applications/lua/lua: -2.62% (29.5232 => 28.7509, std.dev.: 0.0658) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.38% (1.2959 => 1.2651, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/misr: -2.37% (0.4296 => 0.4194, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -2.04% (92.7467 => 90.8547, std.dev.: 0.1904) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3128, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3646, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2284, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4617, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3068, std.dev.: 0.0562) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.32% (27.1724 => 26.8137, std.dev.: 0.0591) SingleSource/Benchmarks/Shootout-C++/hash2: -1.24% (3.4876 => 3.4443, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.12% (1.8739 => 1.8529, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.21% (0.9980 => 1.0201, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.04% (0.6022 => 0.6145, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -2.94% (0.1666 => 0.1617, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.51% (0.1554 => 0.1593, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (0.3083 => 0.3126, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2394 => 0.2396, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.47% (0.3175 => 0.3190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2302 => 0.2306, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 2.90% (0.0449 => 0.0462) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.28% (0.0301 => 0.0252, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.59% (0.0189 => 0.0186, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 3.61% (0.0249 => 0.0258, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -2.35% (1.5019 => 1.4666, std.dev.: 0.0434) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1501 => 0.1512, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.29% (0.4264 => 0.3996, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.12% (0.1344 => 0.1359, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.89% (0.0589 => 0.0606, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.40% (0.0232 => 0.0187, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.78% (0.0639 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1350 => 1.1293, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.50% (0.0637 => 0.0551, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.68% (0.7541 => 0.7668, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.04% (1.5363 => 1.5984, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 07:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 09:15:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929141514.127742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4386?compare_to=4381&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4386, Order: 164892, Start Time: 2012-09-29 12:55:23, End Time: 2012-09-29 14:16:50 To: 4381, Order: 164890, Start Time: 2012-09-29 11:04:51, End Time: 2012-09-29 12:26:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 948 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.53% (54.5343 => 55.9113, std.dev.: 0.2704) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (15.0307 => 14.7396, std.dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.40% (0.5769 => 0.5746, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.22% (16.0052 => 15.9694, std.dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: -0.21% (14.9501 => 14.9185, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 0.40% (82.9503 => 83.2801, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3371 => 4.3347, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.08% (0.7706 => 0.7712, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.04% (0.7502 => 0.7499, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.08% (0.6594 => 0.6589, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.02% (0.6609 => 0.6610, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.11% (0.6165 => 0.6158, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.11% (0.6168 => 0.6161, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.07% (0.5887 => 0.5891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.03% (0.5900 => 0.5898, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.09% (0.6586 => 0.6580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.09% (0.6591 => 0.6585, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.03% (0.6372 => 0.6370, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.02% (0.6352 => 0.6351, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.02% (0.6059 => 0.6060, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.03% (0.6021 => 0.6019, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.13% (0.6306 => 0.6298, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.06% (0.6329 => 0.6325, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.03% (0.6897 => 0.6895, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.06% (0.6905 => 0.6901, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.14% (0.5911 => 0.5903, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.13% (0.5939 => 0.5931, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.03% (0.6409 => 0.6411, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.05% (0.6424 => 0.6427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.03% (0.5966 => 0.5964, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.03% (0.5975 => 0.5973, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.07% (0.5657 => 0.5653, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.04% (0.5668 => 0.5670, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.09% (0.5669 => 0.5664, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.5682 => 0.5682, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.13% (0.6845 => 0.6836, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.6862 => 0.6862, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.20% (0.5542 => 0.5531, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.09% (0.5556 => 0.5561, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.02% (0.5676 => 0.5677, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.07% (0.5677 => 0.5681, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.02% (0.5948 => 0.5947, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.05% (0.5953 => 0.5950, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.13% (1.2307 => 1.2291, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (7.5479 => 7.5537, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.07% (3.7248 => 3.7222, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.12% (0.6520 => 0.6512, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1427 => 0.1430, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.49% (0.0688 => 0.0664, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.68% (63.2438 => 83.2801, std.dev.: 0.0138) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14232.92% (0.0720 => 10.3197, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.17% (10.3673 => 14.7396, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: 30.21% (0.1622 => 0.2112, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.91% (2.2022 => 2.5305, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.49% (7.0540 => 8.0764, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops: 13.48% (0.1432 => 0.1625, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.88% (1.1194 => 1.2636, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.74% (1.7609 => 1.9676, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3543 => 0.3907, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.16% (0.1584 => 0.1745, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.09% (0.3282 => 0.3613, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.68% (0.3927 => 0.4307, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.69% (0.3177 => 0.3453, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.19% (0.3307 => 0.3578, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 8.19% (0.1440 => 0.1558, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.91% (9.4845 => 10.2346, std.dev.: 0.0149) MultiSource/Applications/JM/ldecod/ldecod: 7.85% (10.4361 => 11.2551, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.78% (0.5105 => 0.5502, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 7.60% (0.7115 => 0.7656, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.52% (0.6675 => 0.7177, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.51% (0.5925 => 0.6370, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.6030 => 0.6476, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 7.39% (0.7433 => 0.7982, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.37% (5.7591 => 6.1836, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.18% (0.8172 => 0.8759, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.11% (0.3109 => 0.3330, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.85% (3.3354 => 3.5640, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7326 => 0.7822, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.72% (0.3423 => 0.3653, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.71% (0.4636 => 0.4947, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.70% (0.2554 => 0.2725, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.65% (1.3050 => 1.3918, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.62% (1.5415 => 1.6436, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 6.61% (0.2831 => 0.3018, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (4.2646 => 4.5450, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.5860 => 0.6243, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.4103 => 0.4370, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (8.1363 => 8.6644, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 6.44% (0.4289 => 0.4565, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.42% (0.4064 => 0.4325, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.42% (5.0018 => 5.3227, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3232 => 0.3439, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (2.0665 => 2.1986, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.37% (4.9449 => 5.2601, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.36% (0.3865 => 0.4111, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.34% (0.7835 => 0.8332, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4620 => 0.4909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3650 => 0.3878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4203 => 0.4465, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.23% (0.5569 => 0.5916, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.19% (0.3826 => 0.4063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.19% (0.3603 => 0.3826, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 6.11% (1.5603 => 1.6557, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: 6.10% (0.4048 => 0.4295, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.8067 => 0.8558, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.03% (7.9617 => 8.4421, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.98% (0.5020 => 0.5320, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.90% (0.3935 => 0.4167, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.82% (0.3092 => 0.3272, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3684 => 0.3898, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.79% (1.1642 => 1.2316, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.77% (0.3379 => 0.3574, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.72% (1.1861 => 1.2539, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.70% (0.9765 => 1.0322, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.66% (3.8723 => 4.0915, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 5.61% (21.9371 => 23.1684, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3441 => 0.3631, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.52% (1.0722 => 1.1314, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.38% (0.3180 => 0.3351, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.37% (0.3387 => 0.3569, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4299 => 0.4526, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.03% (2.0273 => 2.1293, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.88% (0.6450 => 0.6765, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.86% (0.8921 => 0.9355, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5981 => 0.6258, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.63% (1.5859 => 1.6593, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 4.60% (2.2969 => 2.4026, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2842 => 1.3389, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (14.3668 => 14.9756, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.23% (2.2024 => 2.2956, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.4186 => 1.4774, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.1840 => 1.2321, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.92% (0.3427 => 0.3527, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.8101 => 0.8328, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.90% (17.1811 => 17.5073, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (3.8922 => 3.9609, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (3.1578 => 3.3814, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7702, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (4.2280 => 4.3561, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2156, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.35% (5.2763 => 3.2526, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.69% (5.3855 => 3.8940, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.32% (5.3526 => 3.8905, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1403, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.06% (2.9384 => 2.6135, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -6.77% (22.1758 => 20.6740, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -11.93% (1.2373 => 1.0897, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3101, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7096, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4936, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 8.0001, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.87% (8.6802 => 8.5180, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2502, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1048, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.89% (0.5229 => 0.5746, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.54% (14.9895 => 15.9694, std.dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: 5.39% (14.1553 => 14.9185, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 5.45% (4.1105 => 4.3347, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.25% (1.1048 => 1.2291, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.53% (7.1582 => 7.5537, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.49% (3.4629 => 3.7222, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.66% (0.6222 => 0.6512, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 09:33:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 11:33:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929163353.776F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4387?compare_to=4383&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4387, Order: 164892, Start Time: 2012-09-29 13:50:54, End Time: 2012-09-29 16:35:29 To: 4383, Order: 164889, Start Time: 2012-09-29 10:36:53, End Time: 2012-09-29 13:21:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (72 on baseline) Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 72 (0 on baseline) Unchanged Tests: 969 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.31% (1.7528 => 1.7758, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.63% (0.0473 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.63% (0.0474 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.68% (0.0442 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.12% (0.0445 => 0.0440, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.69% (0.0432 => 0.0429) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.69% (0.0433 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.70% (0.0426 => 0.0423) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.68% (0.0442 => 0.0439) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.90% (0.0444 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.69% (0.0437 => 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.70% (0.0428 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.70% (0.0429 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.69% (0.0435 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.69% (0.0435 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.67% (0.0446 => 0.0443) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.45% (0.0449 => 0.0447, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.71% (0.0422 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.71% (0.0423 => 0.0420) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.69% (0.0435 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.69% (0.0436 => 0.0433) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.71% (0.0425 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.70% (0.0426 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.72% (0.0417 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.72% (0.0418 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.96% (0.0418 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.66% (0.0453 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.66% (0.0454 => 0.0451, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.72% (0.0414 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.72% (0.0415 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.72% (0.0417 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.72% (0.0418 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.94% (0.0424 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.46% (1.5932 => 1.7758, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 11.17% (0.3446 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3488 => 0.3877, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.14% (0.3465 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3496 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.10% (0.3442 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3469 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3460 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.77% (0.3650 => 0.4043, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.73% (0.3643 => 0.4034, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.63% (0.1063 => 0.1176, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.53% (0.3724 => 0.4116, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.3004 => 0.3248, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5826 => 0.6296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.05% (0.5889 => 0.6363, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.76% (0.2875 => 0.3098, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.64% (0.2750 => 0.2960, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.53% (0.1421 => 0.1528, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.45% (0.3195 => 0.3433, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2725 => 0.2927, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.41% (0.2714 => 0.2915, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.40% (0.9909 => 1.0642, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 7.33% (0.2823 => 0.3030, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.29% (0.2729 => 0.2928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.29% (0.2813 => 0.3018, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.28% (1.3152 => 1.4110, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.26% (2.0673 => 2.2174, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2780 => 0.2981, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.22% (0.3060 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2803 => 0.3005, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (0.4361 => 0.4675, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.17% (0.3096 => 0.3318, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.13% (0.3267 => 0.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.2792 => 0.2991, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.3845 => 0.4119, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2911 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.08% (0.2811 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.98% (1.0781 => 1.1534, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.3258 => 0.3485, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (1.6211 => 1.7332, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.84% (0.5000 => 0.5342, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.83% (0.4994 => 0.5335, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.75% (0.7171 => 0.7655, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.3678 => 0.3926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.74% (0.3726 => 0.3977, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3317 => 0.3539, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3124 => 0.3333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4146 => 0.4423, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.65% (3.5627 => 3.7996, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 6.63% (0.3348 => 0.3570, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3282 => 0.3498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.47% (0.3477 => 0.3702, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.41% (5.5417 => 5.8967, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.29% (0.2736 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4251 => 0.4518, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.22% (2.7292 => 2.8990, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.15% (0.3690 => 0.3917, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (0.2691 => 0.2856, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 6.10% (4.2109 => 4.4677, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.3981 => 0.4215, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.86% (4.4195 => 4.6785, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.85% (0.4139 => 0.4381, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (0.3930 => 0.4159, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 5.74% (4.6177 => 4.8826, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 5.69% (23.5202 => 24.8595, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.66% (0.5900 => 0.6234, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.65% (0.2566 => 0.2711, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.55% (2.1013 => 2.2179, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 5.55% (0.5012 => 0.5290, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (0.3890 => 0.4104, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.49% (0.6435 => 0.6788, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.40% (2.1653 => 2.2822, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 5.40% (0.3336 => 0.3516, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.2040 => 0.2150, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.37% (0.2068 => 0.2179, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.32% (1.8794 => 1.9793, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.28% (0.9697 => 1.0209, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (0.4658 => 0.4901, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.3903 => 0.4106, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2737 => 0.2878, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 5.10% (0.2391 => 0.2513, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.3084 => 0.3241, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.06% (0.6634 => 0.6970, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.2075 => 0.2179, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 4.98% (1.4269 => 1.4979, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 4.83% (0.5546 => 0.5814, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.80% (2.0346 => 2.1322, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.3271 => 0.3425, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.55% (1.9694 => 2.0590, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.2969 => 0.3102, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.43% (0.7875 => 0.8224, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 4.39% (0.4847 => 0.5060, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.39% (1.9966 => 2.0842, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.28% (0.4253 => 0.4435, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.84% (0.7426 => 0.7711, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.57% (0.3498 => 0.3623, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.54% (0.5361 => 0.5551, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.42% (0.5584 => 0.5775, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (11.6398 => 12.0074, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.98% (4.6926 => 4.8323, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 1.78% (11.9555 => 12.1689, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.05% (0.2122 => 0.2314, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6085, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1631, std.dev.: 0.0293) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6237, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2075, std.dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5038, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2278, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4501, std.dev.: 0.0174) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std.dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4474, std.dev.: 0.2362) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5564, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/ary2: -8.87% (0.2402 => 0.2189, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8025, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8027, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7873, std.dev.: 0.0416) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5792, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 10:41:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 12:41:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929174107.E58012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4388?compare_to=4385&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4388, Order: 164896, Start Time: 2012-09-29 16:19:40, End Time: 2012-09-29 17:42:45 To: 4385, Order: 164892, Start Time: 2012-09-29 12:47:08, End Time: 2012-09-29 14:09:36 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (82 on baseline) Performance Improvements: 10 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 960 (767 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.03% (1.2993 => 1.3127, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.97% (13.1835 => 13.4428, std.dev.: 0.0642) SingleSource/Benchmarks/Shootout-C++/methcall: 1.37% (8.8659 => 8.9873, std.dev.: 0.0282) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -11.04% (5.6452 => 5.0222, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -11.02% (5.6518 => 5.0292, std.dev.: 0.0874) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.11% (5.3176 => 5.0992, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.86% (5.2832 => 5.1322, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.68% (5.3078 => 5.1655, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.45% (5.3906 => 5.2586, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.40% (5.2930 => 5.1661, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.18% (3.6036 => 3.5252, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.12% (9.9692 => 9.7578, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.96% (5.0473 => 4.9482, std.dev.: 0.0278) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.17% (1.0201 => 1.0218, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 0.28% (0.6145 => 0.6162, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -0.93% (0.1617 => 0.1602, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1593 => 0.1590, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.45% (0.3126 => 0.3112, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2396 => 0.2400, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.82% (0.3190 => 0.3216, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.78% (0.2306 => 0.2265, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -0.43% (0.0462 => 0.0460, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -32.22% (0.0090 => 0.0061, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.05% (0.0244 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0387 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.65% (0.0252 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0283 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0322 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0179 => 0.0179, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 2.69% (0.0186 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -2.71% (0.0258 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.91% (0.0330 => 0.0327, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -72.73% (0.0011 => 0.0003, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1453 => 0.1458, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.06% (1.4666 => 1.5115, std.dev.: 0.0464) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1512 => 0.1507, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.55% (0.3996 => 0.4018, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.93% (0.1359 => 0.1426, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.45% (0.0606 => 0.0639, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.53% (0.0187 => 0.0186, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.85% (0.0644 => 0.0587, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1293 => 1.1266, std.dev.: 0.0211) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -76.19% (0.0021 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.43% (0.0551 => 0.0636, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (0.0200 => 0.0205, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.18% (0.7668 => 0.7654, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.06% (1.5984 => 1.5975, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.17% (4.1772 => 3.0839, std.dev.: 0.1158) SingleSource/Benchmarks/Shootout-C++/except: 82100.00% (0.0006 => 0.4932, std.dev.: 0.0133) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.41% (0.1414 => 0.1547, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 9.29% (0.5309 => 0.5802, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.13% (0.6410 => 0.6931, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 7.92% (2.1763 => 2.3487, std.dev.: 0.0317) MultiSource/Applications/minisat/minisat: 7.10% (0.6173 => 0.6611, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 6.58% (15.3105 => 16.3175, std.dev.: 0.2470) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.6915 => 0.7357, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (1.1653 => 1.2384, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5150 => 1.5995, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.50% (0.3582 => 0.3779, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 5.44% (0.3217 => 0.3392, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.36% (0.6069 => 0.6394, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.29% (0.4880 => 0.5138, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.3901 => 0.4089, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 4.80% (29.3170 => 30.7252, std.dev.: 0.0839) MultiSource/Applications/hbd/hbd: 4.79% (1.3268 => 1.3904, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.64% (0.7226 => 0.7561, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.50% (0.5937 => 0.6204, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.48% (1.1827 => 1.2357, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.48% (0.7639 => 0.7981, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 4.42% (3.0225 => 3.1560, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.2797 => 0.2916, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (12.6413 => 13.1676, std.dev.: 0.0835) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.05% (1.1672 => 1.2145, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.92% (0.3008 => 0.3126, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.86% (13.3238 => 13.8382, std.dev.: 0.1131) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.85% (0.2886 => 0.2997, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.84% (0.2654 => 0.2756, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.74% (0.2806 => 0.2911, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.73% (0.5740 => 0.5954, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 3.70% (14.6079 => 15.1483, std.dev.: 0.0963) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.70% (0.4248 => 0.4405, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (3.8796 => 4.0209, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2877 => 0.2981, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.46% (1.1440 => 1.1836, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/09-vor/vor: 3.44% (0.3026 => 0.3130, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 3.42% (2.0972 => 2.1690, std.dev.: 0.0231) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.0689 => 1.1047, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.31% (6.2546 => 6.4619, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5636 => 0.5819, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 3.24% (0.8405 => 0.8677, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (8.2186 => 8.4759, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.11% (0.4596 => 0.4739, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.03% (1.4408 => 1.4845, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5520 => 0.5687, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.2742 => 1.3127, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.00% (1.2021 => 1.2382, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.70% (4.0318 => 4.1408, std.dev.: 0.0261) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0821 => 1.1111, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.57% (0.5963 => 0.6116, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.56% (8.2559 => 8.4671, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.4113 => 1.4473, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9029 => 0.9254, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (4.2616 => 4.3676, std.dev.: 0.0270) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.7256 => 15.0914, std.dev.: 0.1096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.7784 => 0.7974, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.28% (4.3380 => 4.4367, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.2815 => 4.3603, std.dev.: 0.0294) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2272, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.84% (0.0766 => 0.0918, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9975, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5631, std.dev.: 0.0726) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.67% (0.0917 => 0.1024, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6109, std.dev.: 0.0176) SingleSource/Benchmarks/Stanford/Puzzle: 8.58% (0.1433 => 0.1556, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8230, std.dev.: 0.0570) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 2.89% (3.8907 => 4.0033, std.dev.: 0.0310) MultiSource/Applications/siod/siod: 2.84% (3.5520 => 3.6530, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8899, std.dev.: 0.0567) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (2.4042 => 2.4683, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (6.6312 => 6.7727, std.dev.: 0.0430) SingleSource/Benchmarks/Dhrystone/dry: 1.82% (2.4013 => 2.4449, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (4.6414 => 4.6886, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.47% (5.2665 => 4.0831, std.dev.: 0.0737) SingleSource/Benchmarks/Shootout-C++/ary3: -20.52% (1.7473 => 1.3887, std.dev.: 0.0325) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.1647 => 0.9603, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.09% (15.8312 => 13.4428, std.dev.: 0.0642) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9390, std.dev.: 0.0572) MultiSource/Applications/lambda-0_1_3/lambda: -7.10% (7.6833 => 7.1379, std.dev.: 0.0669) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3776, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/fibo: -6.71% (4.6355 => 4.3245, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8732, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/distray/distray: -6.34% (0.2664 => 0.2495, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: -6.22% (3.4230 => 3.2100, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.09% (2.9728 => 2.7918, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (62.4126 => 58.9094, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7256, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/fib2: -5.36% (4.4195 => 4.1824, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -4.91% (1.4441 => 1.3732, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.53% (2.5166 => 2.4025, std.dev.: 0.0263) MultiSource/Applications/sgefa/sgefa: -4.43% (0.3746 => 0.3580, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.39% (1.2722 => 1.2291, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.18% (3.7496 => 3.6304, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/methcall: -2.84% (9.2503 => 8.9873, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.76% (61.1734 => 59.4874, std.dev.: 0.6373) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0242) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4140 => 0.4030, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -2.51% (0.4296 => 0.4188, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -2.28% (92.7467 => 90.6331, std.dev.: 0.7896) MultiSource/Applications/aha/aha: -2.15% (3.4286 => 3.3548, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.14% (1.1683 => 1.1433, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4220, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2207, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.48% (1.8739 => 1.8462, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.43% (27.1724 => 26.7846, std.dev.: 0.0563) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3068, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: -1.33% (16.5617 => 16.3408, std.dev.: 0.0632) SingleSource/Benchmarks/Dhrystone/fldry: -1.30% (2.4971 => 2.4647, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.38% (0.9980 => 1.0218, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 2.32% (0.6022 => 0.6162, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -3.84% (0.1666 => 0.1602, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.32% (0.1554 => 0.1590, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.94% (0.3083 => 0.3112, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.2394 => 0.2400, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (0.3175 => 0.3216, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (0.2302 => 0.2265, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 2.45% (0.0449 => 0.0460, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -32.22% (0.0090 => 0.0061, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -70.00% (0.0010 => 0.0003, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 0.64% (1.5019 => 1.5115, std.dev.: 0.0464) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.40% (0.1501 => 0.1507, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.77% (0.4264 => 0.4018, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.1344 => 0.1426, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.0589 => 0.0639, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.83% (0.0232 => 0.0186, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1350 => 1.1266, std.dev.: 0.0211) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 333.33% (0.0006 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0637 => 0.0636, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.67% (0.0246 => 0.0205, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.98% (1.5363 => 1.5975, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 10:48:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 12:48:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929174828.F0EDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4389?compare_to=4386&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4389, Order: 164894, Start Time: 2012-09-29 16:29:36, End Time: 2012-09-29 17:50:05 To: 4386, Order: 164892, Start Time: 2012-09-29 12:55:23, End Time: 2012-09-29 14:16:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 950 (706 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.59% (0.5746 => 0.5780, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -0.05% (15.9694 => 15.9611, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: -0.03% (14.9185 => 14.9135, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -0.02% (83.2801 => 83.2601, std.dev.: 0.0459) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3347 => 4.3337, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -94.06% (0.7712 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -93.88% (0.7499 => 0.0459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -93.52% (0.6589 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -93.51% (0.6610 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -93.23% (0.6158 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -93.20% (0.6161 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -93.02% (0.5891 => 0.0411, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -93.01% (0.5898 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -93.50% (0.6580 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -93.47% (0.6585 => 0.0430, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -93.36% (0.6370 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -93.31% (0.6351 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -93.18% (0.6060 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -93.12% (0.6019 => 0.0414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -93.32% (0.6298 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -93.34% (0.6325 => 0.0421, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -93.73% (0.6895 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -93.55% (0.6901 => 0.0445, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -93.07% (0.5903 => 0.0409) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -93.09% (0.5931 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -93.45% (0.6411 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -93.45% (0.6427 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -93.09% (0.5964 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -93.09% (0.5973 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -92.85% (0.5653 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -92.86% (0.5670 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -92.90% (0.5664 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -92.89% (0.5682 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -93.58% (0.6836 => 0.0439, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -93.57% (0.6862 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -92.73% (0.5531 => 0.0402, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -92.77% (0.5561 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -92.90% (0.5677 => 0.0403) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -92.91% (0.5681 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -93.09% (0.5947 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -93.09% (0.5950 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2291 => 1.2287, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (7.5537 => 7.5501, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.7222 => 3.7217, std.dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6512 => 0.6508, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1430 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.60% (0.0664 => 0.0668, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.65% (63.2438 => 83.2601, std.dev.: 0.0459) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14236.94% (0.0720 => 10.3226, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.08% (10.3673 => 14.7302, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 30.21% (0.1622 => 0.2112, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.86% (2.2022 => 2.5294, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.37% (7.0540 => 8.0680, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.92% (1.1194 => 1.2640, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.56% (1.7609 => 1.9644, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.72% (0.3828 => 0.4200, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.65% (0.3927 => 0.4306, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.55% (0.3886 => 0.4257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3307 => 0.3580, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.95% (10.4361 => 11.2653, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.85% (9.4845 => 10.2286, std.dev.: 0.0209) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.79% (0.8172 => 0.8809, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.52% (0.7115 => 0.7650, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7433 => 0.7990, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.49% (0.6675 => 0.7175, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.6030 => 0.6480, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.29% (5.7591 => 6.1789, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.17% (0.5105 => 0.5471, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.10% (0.4636 => 0.4965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.07% (0.2714 => 0.2906, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.04% (0.3109 => 0.3328, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.01% (0.3423 => 0.3663, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 6.89% (0.2554 => 0.2730, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.3865 => 0.4130, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.82% (0.3283 => 0.3507, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2831 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.4615 => 0.4929, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.78% (3.3354 => 3.5614, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7326 => 0.7822, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.70% (1.5415 => 1.6448, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.5860 => 0.6248, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4289 => 0.4571, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.54% (5.0018 => 5.3291, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.4103 => 0.4370, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (4.2646 => 4.5415, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.49% (1.3050 => 1.3897, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.42% (2.0665 => 2.1992, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.40% (0.4064 => 0.4324, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.37% (8.1363 => 8.6545, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.35% (0.3826 => 0.4069, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3232 => 0.3437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.33% (4.9449 => 5.2578, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.3098 => 0.3293, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3162 => 0.3361, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 6.29% (0.6456 => 0.6862, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.27% (0.3650 => 0.3879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.26% (0.4203 => 0.4466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2793 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4620 => 0.4907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.16% (0.3603 => 0.3825, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.8067 => 0.8561, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 6.11% (1.5603 => 1.6557, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.09% (0.5569 => 0.5908, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.08% (0.7835 => 0.8311, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.02% (7.9617 => 8.4406, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.95% (0.3935 => 0.4169, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3684 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5020 => 0.5309, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.9765 => 1.0323, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.68% (1.1642 => 1.2303, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (1.1861 => 1.2527, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 5.61% (3.8723 => 4.0896, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3441 => 0.3634, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.58% (21.9371 => 23.1605, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 5.51% (0.4299 => 0.4536, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.40% (0.3387 => 0.3570, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 5.40% (1.0722 => 1.1301, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.12% (2.0273 => 2.1310, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.85% (0.6450 => 0.6763, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8921 => 0.9348, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.64% (2.2969 => 2.4034, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.51% (1.5859 => 1.6575, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.46% (0.5981 => 0.6248, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3409, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (14.3668 => 14.9885, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (2.2024 => 2.2932, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.07% (1.4186 => 1.4764, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 3.95% (1.1840 => 1.2308, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.8101 => 0.8328, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4877, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.74% (3.8922 => 3.9601, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (3.1578 => 3.3818, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7616, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (4.2280 => 4.3573, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7990, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2555, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.73% (5.3855 => 3.8919, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.35% (5.3526 => 3.8888, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1388, std.dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.89% (2.9384 => 2.6184, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -6.73% (22.1758 => 20.6838, std.dev.: 0.0318) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -11.41% (1.2373 => 1.0961, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2883, std.dev.: 0.0854) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.25% (1.5835 => 1.5004, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1642, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4915, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.08% (8.6802 => 8.4994, std.dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0029, std.dev.: 0.0147) SingleSource/UnitTests/Vector/multiplies: -1.79% (2.5528 => 2.5070, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2502, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1031, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.54% (0.5229 => 0.5780, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 6.48% (14.9895 => 15.9611, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 5.36% (14.1553 => 14.9135, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 5.43% (4.1105 => 4.3337, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.21% (1.1048 => 1.2287, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.47% (7.1582 => 7.5501, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.47% (3.4629 => 3.7217, std.dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.60% (0.6222 => 0.6508, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 10:56:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 12:56:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120929175620.989782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4390?compare_to=4384&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4390, Order: 164896, Start Time: 2012-09-29 16:32:25, End Time: 2012-09-29 17:57:57 To: 4384, Order: 164892, Start Time: 2012-09-29 12:29:22, End Time: 2012-09-29 13:44:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 69 (0 on baseline) Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 969 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1463.94% (0.0477 => 0.7460, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1418.58% (0.0479 => 0.7274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1315.85% (0.0448 => 0.6343, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1312.95% (0.0448 => 0.6330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1270.94% (0.0437 => 0.5991, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1276.66% (0.0437 => 0.6016, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1236.74% (0.0430 => 0.5748, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1235.50% (0.0431 => 0.5756, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1331.32% (0.0447 => 0.6398, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1327.01% (0.0448 => 0.6393, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1302.03% (0.0443 => 0.6211, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1289.86% (0.0444 => 0.6171, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1267.82% (0.0432 => 0.5909, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1255.99% (0.0434 => 0.5885, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1297.73% (0.0440 => 0.6150, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1295.92% (0.0441 => 0.6156, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1366.30% (0.0451 => 0.6613, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1362.69% (0.0453 => 0.6626, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1224.53% (0.0428 => 0.5669, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1220.28% (0.0429 => 0.5664, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1319.55% (0.0440 => 0.6246, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1315.87% (0.0441 => 0.6244, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1249.65% (0.0431 => 0.5817, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1242.03% (0.0433 => 0.5811, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1209.00% (0.0422 => 0.5524, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1208.27% (0.0423 => 0.5534, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1206.40% (0.0422 => 0.5513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1207.57% (0.0423 => 0.5531, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1338.86% (0.0458 => 0.6590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1339.35% (0.0460 => 0.6621, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1189.05% (0.0420 => 0.5414, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1187.17% (0.0421 => 0.5419, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1211.61% (0.0422 => 0.5535, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1213.48% (0.0423 => 0.5556, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1257.94% (0.0428 => 0.5812, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1254.78% (0.0429 => 0.5812, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5954500.00% (0.0001 => 5.9546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4032800.00% (0.0001 => 4.0329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5341000.00% (0.0001 => 5.3411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6671100.00% (0.0001 => 6.6712, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4737900.00% (0.0001 => 4.7380, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4350200.00% (0.0001 => 4.3503, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7185100.00% (0.0001 => 7.1852, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4378300.00% (0.0001 => 4.3784, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4101500.00% (0.0001 => 4.1016, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5382800.00% (0.0001 => 5.3829, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4400200.00% (0.0001 => 4.4003, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5211600.00% (0.0001 => 5.2117, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4165400.00% (0.0001 => 4.1655, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5196500.00% (0.0001 => 5.1966, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4153900.00% (0.0001 => 4.1540, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5202900.00% (0.0001 => 5.2030, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4249200.00% (0.0001 => 4.2493, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8321500.00% (0.0001 => 8.3216, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4213800.00% (0.0001 => 4.2139, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8549500.00% (0.0001 => 8.5496, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5533000.00% (0.0001 => 5.5331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4192700.00% (0.0001 => 4.1928, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4129000.00% (0.0001 => 4.1291, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6661400.00% (0.0001 => 6.6615, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6125000.00% (0.0001 => 6.1251, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5419300.00% (0.0001 => 5.4194, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8696700.00% (0.0001 => 8.6968, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4889800.00% (0.0001 => 4.8899, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4717200.00% (0.0001 => 4.7173, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8739600.00% (0.0001 => 8.7397, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7651700.00% (0.0001 => 7.6518, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4918100.00% (0.0001 => 4.9182, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3566600.00% (0.0001 => 3.5667, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.53% (3.7934 => 3.8893, std.dev.: 0.0326) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2752500.00% (0.0001 => 2.7526, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2115300.00% (0.0001 => 2.1154, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4970000.00% (0.0001 => 4.9701, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.66% (2.0176 => 2.4546, std.dev.: 0.0138) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4328 => 0.4800, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.74% (0.5818 => 0.6443, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.68% (3.9660 => 4.3894, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.1588 => 0.1757, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.62% (0.2721 => 0.3010, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5748 => 0.6353, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.46% (0.2781 => 0.3072, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.33% (0.7038 => 0.7765, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 10.30% (1.3693 => 1.5104, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 10.14% (0.7061 => 0.7777, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.13% (0.2596 => 0.2859, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 10.02% (0.4062 => 0.4469, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.00% (0.6283 => 0.6911, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2782 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.93% (0.6959 => 0.7650, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.90% (0.3899 => 0.4285, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.88% (1.2193 => 1.3398, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.83% (0.7710 => 0.8468, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.74% (0.3130 => 0.3435, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.74% (0.5265 => 0.5778, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.73% (0.9199 => 1.0094, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.73% (0.3022 => 0.3316, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.58% (0.4791 => 0.5250, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.56% (0.3485 => 0.3818, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.52% (13.8202 => 15.1361, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.52% (1.1364 => 1.2446, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.44% (0.3293 => 0.3604, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.43% (1.4563 => 1.5937, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.2966 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3489 => 0.3817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.39% (0.3580 => 0.3916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.36% (1.9828 => 2.1683, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.34% (0.4016 => 0.4391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.29% (0.3756 => 0.4105, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.28% (0.2726 => 0.2979, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.26% (0.2937 => 0.3209, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.13% (0.3868 => 0.4221, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.08% (1.0313 => 1.1249, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.01% (0.2696 => 0.2939, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3149 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.98% (0.3107 => 0.3386, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.2988 => 0.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.95% (0.3453 => 0.3762, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.88% (0.5577 => 0.6072, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.86% (0.3534 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.85% (0.2995 => 0.3260, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.70% (0.4390 => 0.4772, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 8.68% (0.3192 => 0.3469, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.60% (0.3246 => 0.3525, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2127 => 0.2306, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.39% (1.1061 => 1.1989, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.31% (0.4379 => 0.4743, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.31% (3.8646 => 4.1857, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 8.22% (16.6129 => 17.9789, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.18% (0.6576 => 0.7114, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 8.17% (0.8310 => 0.8989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.12% (0.2945 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.00% (0.5637 => 0.6088, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.00% (3.6692 => 3.9627, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.92% (0.6744 => 0.7278, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.87% (7.2180 => 7.7860, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3220 => 0.3471, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.79% (0.2925 => 0.3153, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 7.75% (1.0594 => 1.1415, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.74% (0.8698 => 0.9371, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.69% (0.7460 => 0.8034, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 7.65% (3.1889 => 3.4328, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.61% (0.2023 => 0.2177, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.58% (0.1569 => 0.1688, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.57% (1.9270 => 2.0728, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 7.51% (2.1791 => 2.3428, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.51% (0.3755 => 0.4037, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.33% (0.3245 => 0.3483, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.30% (1.3245 => 1.4212, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 7.07% (14.8535 => 15.9040, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.92% (1.2749 => 1.3631, std.dev.: 0.0190) MultiSource/Benchmarks/mafft/pairlocalalign: 6.87% (8.4961 => 9.0797, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.87% (1.3819 => 1.4768, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 6.84% (0.4003 => 0.4277, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3914 => 0.4181, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 6.82% (0.3578 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.73% (0.3789 => 0.4044, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.73% (1.3813 => 1.4742, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.72% (4.4433 => 4.7417, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.2859 => 0.3051, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.71% (4.3801 => 4.6739, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3601 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.69% (0.3646 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.60% (1.1333 => 1.2081, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3623 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.59% (0.4113 => 0.4384, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.54% (0.6135 => 0.6536, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.46% (4.6629 => 4.9640, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 6.45% (1.2292 => 1.3085, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (13.2842 => 14.1387, std.dev.: 0.0137) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.32% (0.8818 => 0.9375, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 6.26% (6.5754 => 6.9871, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 6.23% (14.5298 => 15.4344, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.18% (3.2742 => 3.4767, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.08% (0.6250 => 0.6630, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2504 => 0.2655, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.95% (0.3511 => 0.3720, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.93% (0.4805 => 0.5090, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.78% (4.9865 => 5.2748, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.41% (1.5188 => 1.6010, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.35% (0.9108 => 0.9595, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.12% (3.7467 => 3.9387, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.93% (2.1007 => 2.2042, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.74% (6.2785 => 6.5759, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 4.27% (33.2944 => 34.7155, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 3.05% (16.2614 => 16.7575, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std.dev.: 0.0464) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1915, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (1.1560 => 1.2558, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (3.1736 => 3.4127, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0029, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7255, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 3.08% (3.7731 => 3.8893, std.dev.: 0.0326) MultiSource/Applications/SPASS/SPASS: 2.91% (10.7476 => 11.0600, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.02% (7.4271 => 7.5771, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5833, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2237, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (22.5627 => 22.0652, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.63% (1.2308 => 1.0876, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2839, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3114, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.43% (5.0168 => 4.7944, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.26% (3.2729 => 3.1662, std.dev.: 0.0195) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9445, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7081, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.77% (0.6615 => 0.6498) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2507, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2312, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1805, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 12:37:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 14:37:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929193756.4E7902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4391?compare_to=4389&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4391, Order: 164896, Start Time: 2012-09-29 18:19:14, End Time: 2012-09-29 19:39:32 To: 4389, Order: 164894, Start Time: 2012-09-29 16:29:36, End Time: 2012-09-29 17:50:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 949 (701 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.89% (1.3150 => 1.2902, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.62% (0.5780 => 0.5744, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.12% (15.9611 => 15.9806, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 0.20% (14.9135 => 14.9435, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: 0.03% (83.2601 => 83.2879, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 0.31% (4.3337 => 4.3471, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0459 => 0.0459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0421 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.02% (0.0445 => 0.0454, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0404 => 0.0404) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0405 => 0.0405, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0404 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0402 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2287 => 1.2297, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.5501 => 7.5540, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.04% (3.7217 => 3.7233, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.6508 => 0.6516, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1428 => 0.1428, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.84% (0.0668 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.69% (63.2438 => 83.2879, std.dev.: 0.0064) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.00% (0.0720 => 10.3212, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.18% (10.3673 => 14.7405, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 30.27% (0.1622 => 0.2113, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.91% (2.2022 => 2.5306, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.42% (7.0540 => 8.0711, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.86% (1.1194 => 1.2634, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.52% (1.7609 => 1.9638, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.29% (0.1584 => 0.1747, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.05% (0.3282 => 0.3612, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3307 => 0.3582, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 8.19% (0.1440 => 0.1558, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.04% (10.4361 => 11.2752, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.03% (0.4879 => 0.5271, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.85% (9.4845 => 10.2286, std.dev.: 0.0241) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.69% (0.7115 => 0.7662, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.6030 => 0.6483, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.51% (0.7433 => 0.7991, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.51% (0.6675 => 0.7176, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.36% (5.7591 => 6.1830, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 7.28% (0.2554 => 0.2740, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.15% (0.8067 => 0.8644, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2700 => 0.2891, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 7.01% (0.3109 => 0.3327, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 6.96% (3.3354 => 3.5674, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.8172 => 0.8736, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 6.89% (0.3423 => 0.3659, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.71% (1.3050 => 1.3926, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.70% (1.5415 => 1.6448, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4636 => 0.4945, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2831 => 0.3019, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.60% (0.5860 => 0.6247, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.60% (0.3865 => 0.4120, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.4064 => 0.4332, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (4.2646 => 4.5456, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.55% (5.0018 => 5.3295, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.48% (0.4103 => 0.4369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.47% (0.3650 => 0.3886, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.47% (4.9449 => 5.2646, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.44% (8.1363 => 8.6606, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2872 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.44% (0.4289 => 0.4565, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.36% (1.5603 => 1.6595, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3232 => 0.3437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.3121 => 0.3318, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (2.0665 => 2.1969, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.26% (0.4203 => 0.4466, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4620 => 0.4906, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.16% (0.3603 => 0.3825, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 6.15% (0.2877 => 0.3054, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.13% (0.2758 => 0.2927, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.12% (0.3935 => 0.4176, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3826 => 0.4058, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.03% (0.4048 => 0.4292, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.02% (7.9617 => 8.4411, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3092 => 0.3278, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.93% (0.7835 => 0.8300, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.84% (0.9765 => 1.0335, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 5.81% (3.8723 => 4.0974, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.78% (0.5020 => 0.5310, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.75% (0.3441 => 0.3639, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.74% (1.1642 => 1.2310, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.66% (21.9371 => 23.1785, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.64% (1.1861 => 1.2530, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4299 => 0.4537, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 5.48% (1.0722 => 1.1310, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 5.40% (0.3387 => 0.3570, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.30% (2.0273 => 2.1348, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.95% (0.6450 => 0.6769, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.74% (1.5859 => 1.6610, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.72% (0.8921 => 0.9342, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.68% (2.2969 => 2.4044, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5981 => 0.6259, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2842 => 1.3411, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (14.3668 => 14.9778, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.4186 => 1.4777, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.2024 => 2.2926, std.dev.: 0.0186) MultiSource/Benchmarks/nbench/nbench: 3.99% (1.1840 => 1.2312, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.18% (0.3427 => 0.3536, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.8101 => 0.8349, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.85% (17.1811 => 17.4983, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (3.8922 => 3.9577, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (3.1578 => 3.3819, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.1396 => 1.2150, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.75% (3.6395 => 3.7761, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (4.2280 => 4.3677, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.21% (6.5088 => 6.5877, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2087, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.38% (5.2763 => 3.2515, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.70% (5.3855 => 3.8937, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.34% (5.3526 => 3.8894, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1439, std.dev.: 0.0316) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.07% (2.9384 => 2.6131, std.dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: -6.67% (22.1758 => 20.6974, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.2373 => 1.0963, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2505, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7914, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1610, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4976, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0915, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0104, std.dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2516, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.71% (8.6802 => 8.5316, std.dev.: 0.0161) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2293, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.10% (1.3045 => 1.2902, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.85% (0.5229 => 0.5744, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.61% (14.9895 => 15.9806, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 5.57% (14.1553 => 14.9435, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 5.76% (4.1105 => 4.3471, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.31% (1.1048 => 1.2297, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.53% (7.1582 => 7.5540, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.52% (3.4629 => 3.7233, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.73% (0.6222 => 0.6516, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1485 => 0.1428, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 13:11:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 15:11:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929201135.118822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4392?compare_to=4387&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4392, Order: 164896, Start Time: 2012-09-29 17:04:35, End Time: 2012-09-29 20:13:11 To: 4387, Order: 164892, Start Time: 2012-09-29 13:50:54, End Time: 2012-09-29 16:35:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (6 on baseline) New Passes: 66 (0 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (128 on baseline) Existing Failures: 6 (0 on baseline) Unchanged Tests: 969 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 157.45% (0.0470 => 0.1210, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 158.17% (0.0471 => 0.1216, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 133.26% (0.0439 => 0.1024, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 133.18% (0.0440 => 0.1026, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 122.84% (0.0429 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 122.79% (0.0430 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 117.10% (0.0421 => 0.0914, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 116.78% (0.0423 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 133.26% (0.0439 => 0.1024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 132.95% (0.0440 => 0.1025, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 120.47% (0.0425 => 0.0937, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 120.42% (0.0426 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 125.69% (0.0432 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 126.16% (0.0432 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 137.47% (0.0443 => 0.1052, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 135.79% (0.0447 => 0.1054, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 114.08% (0.0419 => 0.0897, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 114.05% (0.0420 => 0.0899, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 128.01% (0.0432 => 0.0985, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 128.18% (0.0433 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 118.48% (0.0422 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 118.68% (0.0423 => 0.0925, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 111.59% (0.0414 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 112.05% (0.0415 => 0.0880, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 111.14% (0.0413 => 0.0872, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 111.35% (0.0414 => 0.0875, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 141.11% (0.0450 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 141.24% (0.0451 => 0.1088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 109.98% (0.0411 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 110.44% (0.0412 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 110.63% (0.0414 => 0.0872, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 110.84% (0.0415 => 0.0875, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 118.81% (0.0420 => 0.0919, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 118.76% (0.0421 => 0.0921, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14403000.00% (0.0001 => 14.4031, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12634500.00% (0.0001 => 12.6346, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15795900.00% (0.0001 => 15.7960, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17349400.00% (0.0001 => 17.3495, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13749700.00% (0.0001 => 13.7498, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 13350500.00% (0.0001 => 13.3506, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16380200.00% (0.0001 => 16.3803, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 15014400.00% (0.0001 => 15.0145, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14885400.00% (0.0001 => 14.8855, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 14729100.00% (0.0001 => 14.7292, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 17452400.00% (0.0001 => 17.4525, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17099600.00% (0.0001 => 17.0997, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15345100.00% (0.0001 => 15.3452, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14788000.00% (0.0001 => 14.7881, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12388700.00% (0.0001 => 12.3888, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12024900.00% (0.0001 => 12.0250, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8947500.00% (0.0001 => 8.9476, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7356700.00% (0.0001 => 7.3568, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 24494200.00% (0.0001 => 24.4943, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 18474100.00% (0.0001 => 18.4742, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14071500.00% (0.0001 => 14.0716, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13661000.00% (0.0001 => 13.6611, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9311300.00% (0.0001 => 9.3114, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8681000.00% (0.0001 => 8.6811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10954500.00% (0.0001 => 10.9546, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14632200.00% (0.0001 => 14.6323, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12380200.00% (0.0001 => 12.3803, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12377100.00% (0.0001 => 12.3772, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16891100.00% (0.0001 => 16.8912, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14066800.00% (0.0001 => 14.0669, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17149800.00% (0.0001 => 17.1499, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15931100.00% (0.0001 => 15.9312, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.16% (127.4088 => 131.4400, std.dev.: 0.0718) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 130.18% (0.0434 => 0.0999, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 130.11% (0.0435 => 0.1001, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9810400.00% (0.0001 => 9.8105, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9411700.00% (0.0001 => 9.4118, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.29% (1.5932 => 1.7731, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3496 => 0.3887, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3488 => 0.3877, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 11.11% (0.3446 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.11% (0.3465 => 0.3850, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.07% (0.3442 => 0.3823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3469 => 0.3852, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3460 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.88% (0.3650 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3643 => 0.4037, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 10.55% (0.3724 => 0.4117, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5826 => 0.6295, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.98% (0.5889 => 0.6359, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.79% (0.2875 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.46% (0.3004 => 0.3228, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (0.3195 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2750 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.37% (0.2714 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.37% (0.2823 => 0.3031, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.35% (1.3152 => 1.4119, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.33% (0.2729 => 0.2929, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.32% (0.9909 => 1.0634, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 7.29% (0.2813 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.27% (0.2780 => 0.2982, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2792 => 0.2993, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (2.0673 => 2.2158, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2803 => 0.3003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2811 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2911 => 0.3118, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.11% (0.4994 => 0.5349, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3096 => 0.3316, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.10% (0.3267 => 0.3499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.09% (0.3060 => 0.3277, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.08% (0.7171 => 0.7679, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.3258 => 0.3485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3348 => 0.3580, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.86% (0.5026 => 0.5371, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (1.6211 => 1.7310, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 6.74% (1.0781 => 1.1508, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.3678 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3317 => 0.3539, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3124 => 0.3333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.3726 => 0.3975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4146 => 0.4423, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.65% (0.4361 => 0.4651, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.3625 => 0.3864, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3282 => 0.3498, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.57% (3.5627 => 3.7967, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3477 => 0.3700, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.40% (0.5000 => 0.5320, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.40% (0.3845 => 0.4091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.40% (0.3690 => 0.3926, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.38% (0.2068 => 0.2200, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.35% (0.1968 => 0.2093, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.32% (5.5417 => 5.8917, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (0.3930 => 0.4174, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4251 => 0.4514, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (2.7292 => 2.8972, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.2014 => 0.2137, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.00% (4.2109 => 4.4635, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (4.4195 => 4.6846, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.90% (0.3981 => 0.4216, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 5.81% (23.5202 => 24.8873, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 5.71% (1.8794 => 1.9868, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.2736 => 0.2892, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 5.69% (0.2566 => 0.2712, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 5.67% (0.3336 => 0.3525, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.64% (4.6177 => 4.8782, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 5.63% (0.5012 => 0.5294, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.56% (2.1013 => 2.2181, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.53% (0.5900 => 0.6226, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.51% (2.1653 => 2.2847, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.51% (0.4139 => 0.4367, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.47% (0.6634 => 0.6997, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (0.3890 => 0.4101, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.41% (0.6435 => 0.6783, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.40% (0.9697 => 1.0221, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.24% (0.4029 => 0.4240, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.3903 => 0.4106, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.19% (1.4269 => 1.5009, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2737 => 0.2878, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.09% (0.2691 => 0.2828, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.3084 => 0.3240, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.2075 => 0.2177, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.90% (0.5546 => 0.5818, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (0.4658 => 0.4880, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.69% (1.9694 => 2.0617, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.65% (0.3271 => 0.3423, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.60% (0.7875 => 0.8237, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.58% (2.0346 => 2.1278, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 4.52% (0.4847 => 0.5066, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (1.9966 => 2.0859, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.2969 => 0.3101, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.22% (0.2391 => 0.2492, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.11% (0.4253 => 0.4428, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.78% (0.7426 => 0.7707, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.74% (0.3498 => 0.3629, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (0.5361 => 0.5554, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.38% (0.5584 => 0.5773, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.06% (11.6398 => 11.9955, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (4.6926 => 4.8269, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.94% (11.9555 => 12.1875, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.60% (3.3903 => 3.6140, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 5.17% (1.8057 => 1.8991, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6394, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1952, std.dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5074, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4366, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2912, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4569, std.dev.: 0.1019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.37% (2.4764 => 2.4424, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5302, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7976, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7950, std.dev.: 0.0073) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8366, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.10% (0.6293 => 0.6161, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0424, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 14:43:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 16:43:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929214306.A906B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4393?compare_to=4388&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4393, Order: 164897, Start Time: 2012-09-29 20:21:54, End Time: 2012-09-29 21:44:44 To: 4388, Order: 164896, Start Time: 2012-09-29 16:19:40, End Time: 2012-09-29 17:42:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (68 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 969 (786 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.15% (0.7811 => 0.8057, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.30% (2.6973 => 2.7323, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.50% (1.3904 => 1.3695, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -1.29% (1.3732 => 1.3555, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.25% (1.0218 => 1.0192, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -0.39% (0.6162 => 0.6138, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 5.74% (0.1602 => 0.1694, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.31% (0.1590 => 0.1585, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3112 => 0.3121, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.04% (0.2400 => 0.2327, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (0.3216 => 0.3173, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.25% (0.2265 => 0.2316, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -5.87% (0.0460 => 0.0433, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 47.54% (0.0061 => 0.0090) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.05% (0.0239 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0190 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0386 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.42% (0.0299 => 0.0220, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0321 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0179 => 0.0179, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -0.52% (0.0191 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -29.08% (0.0251 => 0.0178, std.dev.: 0.0040) SingleSource/UnitTests/byval-alignment: -0.31% (0.0327 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -66.67% (0.0003 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1458 => 0.1469, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -0.14% (1.5115 => 1.5094, std.dev.: 0.0309) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.26% (0.1507 => 0.1488, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4018 => 0.4013, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.42% (0.1426 => 0.1363, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.40% (0.0639 => 0.0547, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.78% (0.0186 => 0.0260, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.34% (0.0587 => 0.0589, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1266 => 1.1293, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0636 => 0.0637, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.44% (0.0205 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7654 => 0.7665, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.5975 => 1.5977, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.37% (4.1772 => 3.0757, std.dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0005) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.18% (0.1414 => 0.1558, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.15% (0.1159 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.02% (0.6410 => 0.6924, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 7.89% (0.5309 => 0.5728, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 7.88% (2.1763 => 2.3478, std.dev.: 0.0583) MultiSource/Applications/minisat/minisat: 6.69% (0.6173 => 0.6586, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.39% (0.3582 => 0.3811, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 6.10% (1.0046 => 1.0659, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.09% (0.4880 => 0.5177, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.6915 => 0.7321, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 5.58% (15.3105 => 16.1643, std.dev.: 0.1155) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.2552 => 0.2694, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 5.55% (1.1653 => 1.2300, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.16% (0.4248 => 0.4467, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.07% (0.6069 => 0.6377, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.07% (1.5150 => 1.5918, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: 4.77% (29.3170 => 30.7145, std.dev.: 0.2264) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.7639 => 0.7986, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 4.51% (0.3217 => 0.3362, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.7722 => 0.8057, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.33% (0.2797 => 0.2918, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 4.26% (3.0225 => 3.1513, std.dev.: 0.0434) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.94% (1.1672 => 1.2132, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (12.6413 => 13.1106, std.dev.: 0.1447) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3008 => 0.3116, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (1.1827 => 1.2242, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.27% (0.8569 => 0.8849, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 3.22% (3.5980 => 3.7140, std.dev.: 0.0109) MultiSource/Applications/hbd/hbd: 3.22% (1.3268 => 1.3695, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.0689 => 1.1002, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (8.2186 => 8.4590, std.dev.: 0.0761) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.4908 => 6.6786, std.dev.: 0.0594) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.75% (1.4408 => 1.4804, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.0317 => 2.0836, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (3.0758 => 3.1478, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.01% (0.5963 => 0.6083, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.26% (0.9425 => 0.9544, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.17% (0.0261 => 0.0405, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Bubblesort: 44.87% (0.0263 => 0.0381, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3375, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.63% (0.0766 => 0.0924, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.86% (4.0101 => 4.5659, std.dev.: 0.0698) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.89% (0.0917 => 0.1026, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0103) SingleSource/Benchmarks/Stanford/Puzzle: 8.93% (0.1433 => 0.1561, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 8.52% (7.0025 => 7.5988, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (0.3301 => 0.3538, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: 4.33% (15.2242 => 15.8828, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.14% (40.4792 => 42.1543, std.dev.: 0.3413) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5368, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 3.73% (0.9851 => 1.0218, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.02% (14.4877 => 14.9251, std.dev.: 0.0387) MultiSource/Benchmarks/sim/sim: 2.71% (3.8907 => 3.9960, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/mason/mason: 2.68% (0.5004 => 0.5138, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.50% (2.6656 => 2.7323, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.6308 => 0.6455, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.31% (0.5876 => 0.6012, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.16% (6.6312 => 6.7744, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 1.97% (3.5520 => 3.6220, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.78% (4.6127 => 4.6948, std.dev.: 0.0238) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (2.4013 => 2.4435, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 1.52% (1.4184 => 1.4399, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.2726 => 1.2868, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.43% (0.3497 => 0.2083, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0914, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/ary3: -20.65% (1.7473 => 1.3864, std.dev.: 0.0423) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.26% (1.1647 => 0.9637, std.dev.: 0.0307) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.78% (15.8312 => 13.1746, std.dev.: 0.1422) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1573, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.68% (3.2007 => 2.9229, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: -7.47% (0.3746 => 0.3466, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -7.19% (7.6833 => 7.1308, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3734, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3301, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -6.14% (1.4441 => 1.3555, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: -6.10% (3.4230 => 3.2143, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9247, std.dev.: 0.1154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -5.33% (4.4195 => 4.1839, std.dev.: 0.0840) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.54% (0.4564 => 0.4357, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -4.30% (2.5166 => 2.4084, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.67% (1.2959 => 1.2484, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: -3.59% (9.2503 => 8.9182, std.dev.: 0.0522) SingleSource/Benchmarks/McGill/misr: -2.91% (0.4296 => 0.4171, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.89% (3.7496 => 3.6413, std.dev.: 0.0363) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std.dev.: 0.0412) MultiSource/Benchmarks/PAQ8p/paq8p: -2.32% (92.7467 => 90.5992, std.dev.: 0.5302) MultiSource/Applications/lua/lua: -2.29% (29.5232 => 28.8481, std.dev.: 0.0925) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.12% (1.1683 => 1.1435, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.08% (2.3569 => 2.3078, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: -1.71% (3.4876 => 3.4279, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.48% (9.3855 => 9.2468, std.dev.: 0.0291) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7907, std.dev.: 0.0683) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3061, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: -1.21% (2.4971 => 2.4669, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.12% (0.9980 => 1.0192, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.93% (0.6022 => 0.6138, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 1.68% (0.1666 => 0.1694, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.99% (0.1554 => 0.1585, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (0.3083 => 0.3121, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.80% (0.2394 => 0.2327, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3175 => 0.3173, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.61% (0.2302 => 0.2316, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -3.56% (0.0449 => 0.0433, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.33% (0.0240 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.91% (0.0301 => 0.0220, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -28.51% (0.0249 => 0.0178, std.dev.: 0.0040) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.80% (0.1429 => 0.1469, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 0.50% (1.5019 => 1.5094, std.dev.: 0.0309) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.87% (0.1501 => 0.1488, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.89% (0.4264 => 0.4013, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1344 => 0.1363, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.07% (0.0232 => 0.0260, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.82% (0.0639 => 0.0589, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1350 => 1.1293, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0637 => 0.0637, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.64% (0.7541 => 0.7665, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.00% (1.5363 => 1.5977, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 14:53:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 16:53:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929215302.431CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4394?compare_to=4391&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4394, Order: 164897, Start Time: 2012-09-29 20:34:16, End Time: 2012-09-29 21:54:39 To: 4391, Order: 164896, Start Time: 2012-09-29 18:19:14, End Time: 2012-09-29 19:39:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (146 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 945 (704 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.38% (11.2752 => 11.4312, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 1.09% (14.7405 => 14.9019, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (78.9433 => 80.5555, std.dev.: 0.4380) MultiSource/Benchmarks/llubenchmark/llu: 1.13% (3.7876 => 3.8304, std.dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.20% (20.6974 => 20.4487, std.dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.37% (0.5744 => 0.5765, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.29% (15.9806 => 16.0264, std.dev.: 0.0259) MultiSource/Applications/kimwitu++/kc: -0.04% (14.9435 => 14.9376, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: 0.44% (83.2879 => 83.6521, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.3471 => 4.3425, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.65% (0.0460 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0459 => 0.0459) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0429 => 0.0428) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.63% (0.0454 => 0.0433, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0402 => 0.0402) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0402 => 0.0401) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0402 => 0.0402) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0403 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2297 => 1.2311, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.5540 => 7.5661, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.34% (3.7233 => 3.7359, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.6516 => 0.6513, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1428 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.27% (63.2438 => 83.6521, std.dev.: 0.0130) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14228.75% (0.0720 => 10.3167, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.74% (10.3673 => 14.9019, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 32.74% (0.1622 => 0.2153, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.87% (2.2022 => 2.5296, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.48% (7.0540 => 8.0751, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.28% (0.1566 => 0.1774, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.68% (1.1194 => 1.2613, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.67% (1.7609 => 1.9664, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1584 => 0.1744, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.67% (0.3828 => 0.4198, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.54% (10.4361 => 11.4312, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3927 => 0.4296, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.39% (0.3886 => 0.4251, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.4879 => 0.5290, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.37% (9.4845 => 10.2783, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3307 => 0.3582, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.12% (0.3177 => 0.3435, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.87% (0.6675 => 0.7200, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.74% (0.7115 => 0.7666, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 7.68% (5.7591 => 6.2015, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.59% (0.3109 => 0.3345, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.53% (0.5925 => 0.6371, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.6030 => 0.6480, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.41% (0.7433 => 0.7984, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2554 => 0.2743, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.37% (0.5105 => 0.5481, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (0.4615 => 0.4942, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 7.07% (0.3422 => 0.3664, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.03% (0.4636 => 0.4962, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.00% (3.3354 => 3.5689, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.97% (1.5415 => 1.6489, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 6.95% (0.3423 => 0.3661, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.91% (1.3050 => 1.3952, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.84% (4.2646 => 4.5563, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.74% (0.7326 => 0.7820, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.72% (0.5860 => 0.6254, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3650 => 0.3894, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.60% (0.4103 => 0.4374, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.60% (0.3865 => 0.4120, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.60% (0.8172 => 0.8711, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.56% (5.0018 => 5.3300, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 6.55% (0.6456 => 0.6879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.53% (0.4289 => 0.4569, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.50% (8.1363 => 8.6652, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 6.50% (0.2831 => 0.3015, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.49% (4.9449 => 5.2658, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.47% (0.8067 => 0.8589, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.46% (0.7835 => 0.8341, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3232 => 0.3440, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.42% (0.4064 => 0.4325, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.40% (0.4203 => 0.4472, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.5569 => 0.5925, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.34% (2.0665 => 2.1975, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 6.29% (1.5603 => 1.6584, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.24% (7.9617 => 8.4589, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 6.24% (0.3603 => 0.3828, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3121 => 0.3315, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2758 => 0.2929, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.5020 => 0.5328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.13% (0.4620 => 0.4903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.11% (0.3092 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3684 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.99% (0.9765 => 1.0350, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/moments: 5.98% (0.4048 => 0.4290, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.97% (1.1642 => 1.2337, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.92% (0.3935 => 0.4168, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.91% (1.0722 => 1.1356, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.85% (1.1861 => 1.2555, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 5.82% (3.8723 => 4.0977, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.75% (0.3441 => 0.3639, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.63% (21.9371 => 23.1723, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.57% (0.2603 => 0.2748, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.36% (2.0273 => 2.1360, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.12% (0.6450 => 0.6780, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.08% (0.8921 => 0.9374, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.88% (2.2969 => 2.4091, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.80% (1.5859 => 1.6621, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.71% (0.5981 => 0.6263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (14.3668 => 14.9959, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.4186 => 1.4807, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2842 => 1.3399, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.1840 => 1.2351, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.25% (2.2024 => 2.2960, std.dev.: 0.0179) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.96% (0.8101 => 0.8341, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.03% (17.1811 => 17.5293, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.97% (3.8922 => 3.9689, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3830, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.70% (3.6395 => 3.7743, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.97% (4.2280 => 4.3537, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 1.38% (3.7781 => 3.8304, std.dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2219, std.dev.: 0.0398) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.07% (5.2763 => 3.2674, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.58% (5.3855 => 3.9003, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.15% (5.3526 => 3.8993, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1046, std.dev.: 0.0492) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.01% (2.9384 => 2.6148, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -7.79% (22.1758 => 20.4487, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0989, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.49% (1.5373 => 1.3761, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2821, std.dev.: 0.0775) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.60% (1.8329 => 1.7119, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4969, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.13% (8.6802 => 8.4955, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9947, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0893, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2548, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.25% (0.5229 => 0.5765, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 6.92% (14.9895 => 16.0264, std.dev.: 0.0259) MultiSource/Applications/kimwitu++/kc: 5.53% (14.1553 => 14.9376, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/gs/gs: 5.64% (4.1105 => 4.3425, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.43% (1.1048 => 1.2311, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.70% (7.1582 => 7.5661, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.88% (3.4629 => 3.7359, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.68% (0.6222 => 0.6513, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 16:22:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 18:22:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120929232223.54EF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4395?compare_to=4393&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4395, Order: 164898, Start Time: 2012-09-29 22:01:11, End Time: 2012-09-29 23:24:01 To: 4393, Order: 164897, Start Time: 2012-09-29 20:21:54, End Time: 2012-09-29 21:44:44 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 2 (67 on baseline) Performance Improvements: 4 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 967 (779 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.66% (1.0770 => 1.1164, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 3.55% (0.3466 => 0.3589, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.81% (0.8930 => 0.8768, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.62% (4.4127 => 4.3413, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -6.47% (3.5307 => 3.3021, std.dev.: 0.0662) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.64% (4.7509 => 4.6729, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.45% (1.0192 => 1.0146, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.6138 => 0.6135, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -5.25% (0.1694 => 0.1605, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.96% (0.1585 => 0.1554, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.80% (0.3121 => 0.3096, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.45% (0.2327 => 0.2270, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3173 => 0.3172, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.99% (0.2316 => 0.2270, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 4.62% (0.0433 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 3.45% (0.0087 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.13% (0.0160 => 0.0165, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.35% (0.0192 => 0.0151, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0387 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 35.91% (0.0220 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0283 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0322 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0179 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -4.21% (0.0190 => 0.0182, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: 42.13% (0.0178 => 0.0253, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -3.99% (0.0326 => 0.0313, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.56% (0.1469 => 0.1402, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: -1.07% (1.5094 => 1.4932, std.dev.: 0.0358) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.15% (0.1488 => 0.1456, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.00% (0.4013 => 0.4053, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.71% (0.1363 => 0.1400, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.65% (0.0547 => 0.0556, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.46% (0.0260 => 0.0173, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.51% (0.0589 => 0.0592, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1293 => 1.1281, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.29% (0.0637 => 0.0546, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.50% (0.0200 => 0.0145, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (0.7665 => 0.7647, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.09% (1.5977 => 1.5991, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.64% (4.1772 => 3.1062, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/except: 82583.33% (0.0006 => 0.4961, std.dev.: 0.0017) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.01% (2.1763 => 2.3507, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.99% (0.6410 => 0.6922, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 7.29% (0.5309 => 0.5696, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 6.50% (0.6173 => 0.6574, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 6.49% (1.0046 => 1.0698, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.6069 => 0.6429, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 5.89% (1.1653 => 1.2339, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 5.63% (15.3105 => 16.1723, std.dev.: 0.0775) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.07% (0.3217 => 0.3380, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.95% (0.6915 => 0.7257, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.51% (1.5150 => 1.5833, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.41% (0.4880 => 0.5095, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.37% (0.7639 => 0.7973, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 4.28% (29.3170 => 30.5723, std.dev.: 0.0460) MultiSource/Applications/d/make_dparser: 4.13% (3.0225 => 3.1474, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (12.6413 => 13.1031, std.dev.: 0.0765) MultiSource/Applications/SPASS/SPASS: 3.40% (13.3238 => 13.7769, std.dev.: 0.0734) MultiSource/Applications/siod/siod: 3.38% (2.0972 => 2.1680, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.30% (0.4248 => 0.4388, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 3.19% (1.3268 => 1.3691, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (1.1672 => 1.2014, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0821 => 1.1135, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.85% (1.2021 => 1.2363, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.6079 => 15.0217, std.dev.: 0.0564) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (8.2186 => 8.4486, std.dev.: 0.0131) MultiSource/Applications/lua/lua: 2.72% (3.5980 => 3.6958, std.dev.: 0.0284) MultiSource/Applications/oggenc/oggenc: 2.71% (4.7455 => 4.8742, std.dev.: 0.0384) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.4908 => 6.6554, std.dev.: 0.0591) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.53% (6.2546 => 6.4128, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.43% (3.0758 => 3.1505, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (4.0318 => 4.1295, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.41% (0.7226 => 0.7400, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.25% (1.0689 => 1.0930, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.16% (0.8569 => 0.8754, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8405 => 0.8581, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.04% (14.7256 => 15.0266, std.dev.: 0.0831) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.0317 => 2.0725, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.88% (0.5636 => 0.5742, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.74% (4.2616 => 4.3356, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.2815 => 4.3511, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.4189 => 1.4346, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.68% (0.0917 => 0.1070, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5503, std.dev.: 0.0840) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 11.72% (0.1433 => 0.1601, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.94% (1.0063 => 1.1164, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 8.82% (7.0025 => 7.6199, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8381, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.38% (0.5587 => 0.5776, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (4.2129 => 4.3372, std.dev.: 0.0227) MultiSource/Benchmarks/sim/sim: 2.83% (3.8907 => 4.0008, std.dev.: 0.0248) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8958, std.dev.: 0.0688) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.69% (2.6656 => 2.7374, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.6308 => 0.6458, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (6.6312 => 6.7738, std.dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.69% (0.3497 => 0.2109, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.60% (5.2665 => 4.1288, std.dev.: 0.0843) SingleSource/Benchmarks/Shootout-C++/ary3: -20.57% (1.7473 => 1.3879, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.1647 => 0.9598, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.97% (15.8312 => 13.1439, std.dev.: 0.1746) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1591, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (1.4034 => 1.2852, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.33% (3.6023 => 3.3021, std.dev.: 0.0662) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9416, std.dev.: 0.0242) MultiSource/Applications/lambda-0_1_3/lambda: -7.14% (7.6833 => 7.1349, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.6254 => 3.3786, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3281, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8733, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3532, std.dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: -6.29% (3.4230 => 3.2078, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/distray/distray: -6.01% (0.2664 => 0.2504, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9225, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout/fib2: -5.15% (4.4195 => 4.1920, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.59% (0.4140 => 0.3950, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -4.22% (2.5166 => 2.4105, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.21% (0.4564 => 0.4372, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -4.19% (0.3746 => 0.3589, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.96% (45.4683 => 43.6694, std.dev.: 0.6865) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.66% (1.2722 => 1.2257, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: -3.19% (9.2503 => 8.9553, std.dev.: 0.0397) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2857, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.64% (3.7496 => 3.6507, std.dev.: 0.0257) MultiSource/Applications/lua/lua: -2.59% (29.5232 => 28.7582, std.dev.: 0.2046) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (92.7467 => 90.4239, std.dev.: 0.2496) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.50% (1.0686 => 1.0419, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: -2.36% (6.7458 => 6.5869, std.dev.: 0.0347) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.32% (2.4457 => 2.3889, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.17% (1.1683 => 1.1429, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4183, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3122, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.84% (61.1734 => 60.0463, std.dev.: 0.3344) MultiSource/Applications/aha/aha: -1.80% (3.4286 => 3.3668, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/neural/neural: -1.65% (1.0926 => 1.0746, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2325, std.dev.: 0.0306) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3165, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8104, std.dev.: 0.0433) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4648, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.22% (1.7361 => 1.7150, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.66% (0.9980 => 1.0146, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.88% (0.6022 => 0.6135, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -3.66% (0.1666 => 0.1605, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1554 => 0.1554, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (0.3083 => 0.3096, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.18% (0.2394 => 0.2270, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3175 => 0.3172, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (0.2302 => 0.2270, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.25% (0.0240 => 0.0165, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.35% (0.0192 => 0.0151, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.70% (0.0189 => 0.0182, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -3.69% (0.0325 => 0.0313, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.89% (0.1429 => 0.1402, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: -0.58% (1.5019 => 1.4932, std.dev.: 0.0358) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.00% (0.1501 => 0.1456, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.95% (0.4264 => 0.4053, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.17% (0.1344 => 0.1400, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.0589 => 0.0556, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.43% (0.0232 => 0.0173, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.36% (0.0639 => 0.0592, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1350 => 1.1281, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.29% (0.0637 => 0.0546, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.06% (0.0246 => 0.0145, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7541 => 0.7647, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.09% (1.5363 => 1.5991, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 16:43:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 18:43:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120929234318.94EFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4396?compare_to=4394&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4396, Order: 164899, Start Time: 2012-09-29 22:24:32, End Time: 2012-09-29 23:44:51 To: 4394, Order: 164897, Start Time: 2012-09-29 20:34:16, End Time: 2012-09-29 21:54:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (145 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 945 (704 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.42% (0.4306 => 0.4410, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.21% (54.7890 => 56.5482, std.dev.: 0.0869) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.44% (11.4312 => 11.2669, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.36% (2.5296 => 2.4953, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.00% (3.9003 => 3.8612, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5765 => 0.5761, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.02% (16.0264 => 16.0226, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 0.26% (14.9376 => 14.9764, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: -0.61% (83.6521 => 83.1401, std.dev.: 0.0243) MultiSource/Benchmarks/MallocBench/gs/gs: 0.36% (4.3425 => 4.3583, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0414 => 0.0414) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0433 => 0.0433, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0403 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0402 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0404 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0401 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0402 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2311 => 1.2310, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.41% (7.5661 => 7.5351, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.44% (3.7359 => 3.7193, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6513 => 0.6509, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1431 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.46% (63.2438 => 83.1401, std.dev.: 0.0243) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14242.22% (0.0720 => 10.3264, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.50% (10.3673 => 14.7736, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 29.35% (0.1622 => 0.2098, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.71% (7.0540 => 8.0210, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.31% (2.2022 => 2.4953, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.15% (0.1566 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.48% (1.1194 => 1.2591, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (1.7609 => 1.9595, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.77% (0.3543 => 0.3889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.65% (0.3543 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3516 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3828 => 0.4191, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.37% (0.3927 => 0.4295, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.14% (0.3886 => 0.4241, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.74% (0.3282 => 0.3569, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1655 => 0.1793, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3307 => 0.3580, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.09% (0.3177 => 0.3434, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.00% (0.6675 => 0.7209, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.99% (0.4879 => 0.5269, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.96% (10.4361 => 11.2669, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 7.94% (9.4845 => 10.2380, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 7.79% (0.7433 => 0.8012, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1625 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.62% (0.7115 => 0.7657, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.40% (0.3109 => 0.3339, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.38% (0.5105 => 0.5482, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.17% (5.7591 => 6.1721, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.08% (3.3354 => 3.5717, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4615 => 0.4941, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.99% (0.5925 => 0.6339, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.97% (0.6030 => 0.6450, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.96% (0.5860 => 0.6268, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.95% (1.5415 => 1.6487, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 6.93% (0.2554 => 0.2731, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.89% (0.3423 => 0.3659, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.4103 => 0.4384, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.82% (0.8067 => 0.8617, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (1.3050 => 1.3939, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.77% (4.2646 => 4.5535, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 6.75% (0.3422 => 0.3653, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.69% (0.4636 => 0.4946, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.64% (0.5569 => 0.5939, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.3092 => 0.3292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3865 => 0.4114, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (8.1363 => 8.6566, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.8172 => 0.8693, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.37% (0.5020 => 0.5340, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.33% (0.7326 => 0.7790, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.33% (4.9449 => 5.2577, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 6.32% (0.4289 => 0.4560, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.30% (0.4064 => 0.4320, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.29% (0.6456 => 0.6862, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.29% (1.1642 => 1.2374, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.28% (0.3136 => 0.3333, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.28% (0.4203 => 0.4467, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.27% (5.0018 => 5.3153, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.26% (1.5603 => 1.6579, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.2831 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3650 => 0.3878, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3283 => 0.3488, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.20% (0.7835 => 0.8321, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.19% (0.3603 => 0.3826, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.16% (2.0665 => 2.1938, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.05% (0.3387 => 0.3592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.05% (0.9765 => 1.0356, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (1.1861 => 1.2576, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.02% (0.3441 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3162 => 0.3352, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.01% (1.0722 => 1.1366, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.4048 => 0.4289, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.93% (0.4620 => 0.4894, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.91% (3.8723 => 4.1011, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.86% (7.9617 => 8.4282, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3935 => 0.4164, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.77% (0.2877 => 0.3043, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.62% (0.3684 => 0.3891, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.61% (0.2603 => 0.2749, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.61% (2.0273 => 2.1410, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 5.30% (2.2969 => 2.4186, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 5.23% (0.4299 => 0.4524, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.6450 => 0.6784, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 5.13% (0.8921 => 0.9379, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.09% (1.5859 => 1.6667, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.95% (0.5981 => 0.6277, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 4.85% (21.9371 => 23.0012, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.58% (2.2024 => 2.3032, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.57% (1.4186 => 1.4835, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (14.3668 => 14.9859, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2842 => 1.3393, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.26% (1.1840 => 1.2344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.01% (0.8101 => 0.8345, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.04% (17.1811 => 17.5324, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.92% (3.8922 => 3.9668, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.45% (3.6395 => 3.7650, std.dev.: 0.0118) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3474, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.52% (0.9540 => 0.9685, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2327, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.19% (5.2763 => 3.2611, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.30% (5.3855 => 3.8612, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.87% (5.3526 => 3.8607, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2065, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.07% (2.9384 => 2.6132, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -7.85% (22.1758 => 20.4342, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.73% (19.9488 => 18.2072, std.dev.: 0.0500) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5961, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1642, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4998, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.13% (8.6802 => 8.4956, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -2.01% (10.2830 => 10.0768, std.dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2524, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (8.1563 => 8.0233, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.41% (9.5636 => 9.4287, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2266, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.17% (0.5229 => 0.5761, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.89% (14.9895 => 16.0226, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 5.80% (14.1553 => 14.9764, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 6.03% (4.1105 => 4.3583, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.42% (1.1048 => 1.2310, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.27% (7.1582 => 7.5351, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.40% (3.4629 => 3.7193, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.61% (0.6222 => 0.6509, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 16:49:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 18:49:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120929234919.BDC122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4397?compare_to=4392&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4397, Order: 164897, Start Time: 2012-09-29 20:42:08, End Time: 2012-09-29 23:50:54 To: 4392, Order: 164896, Start Time: 2012-09-29 17:04:35, End Time: 2012-09-29 20:13:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (6 on baseline) Performance Regressions: 0 (132 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (128 on baseline) Existing Failures: 6 (0 on baseline) Unchanged Tests: 1035 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.86% (131.4400 => 128.9979, std.dev.: 0.9408) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.20% (0.0999 => 0.1001, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.20% (0.1001 => 0.1003, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (9.8105 => 9.8094, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.02% (9.4118 => 9.4102, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.79% (1.5932 => 1.7810, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 10.65% (0.3465 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3496 => 0.3866, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.58% (0.3442 => 0.3806, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.55% (0.3488 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.53% (0.3446 => 0.3809, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3460 => 0.3824, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.41% (0.3469 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3643 => 0.4017, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.25% (0.3650 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.02% (0.3724 => 0.4097, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.79% (0.5826 => 0.6280, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.71% (0.5889 => 0.6343, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.47% (1.3152 => 1.4134, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.19% (0.4994 => 0.5353, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.10% (0.2875 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (1.6211 => 1.7358, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (0.4361 => 0.4665, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.96% (1.0781 => 1.1531, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.92% (0.5000 => 0.5346, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.85% (0.3195 => 0.3414, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.3004 => 0.3209, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.82% (5.5417 => 5.9196, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.76% (0.2738 => 0.2923, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 6.73% (0.2823 => 0.3013, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.72% (0.9909 => 1.0575, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.67% (0.2729 => 0.2911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.65% (2.0673 => 2.2048, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/methcall: 6.65% (0.2813 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.61% (3.5627 => 3.7983, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.2780 => 0.2963, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.57% (0.3362 => 0.3583, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.55% (0.2750 => 0.2930, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.54% (0.3060 => 0.3260, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2803 => 0.2986, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.51% (0.7171 => 0.7638, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4146 => 0.4416, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 6.51% (0.2075 => 0.2210, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2792 => 0.2973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.35% (0.3258 => 0.3465, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3267 => 0.3474, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.33% (0.2811 => 0.2989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.32% (0.2911 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.3096 => 0.3291, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (4.4195 => 4.6927, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/moments: 6.17% (0.3678 => 0.3905, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (2.7292 => 2.8973, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 6.15% (0.6634 => 0.7042, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (0.5026 => 0.5334, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.12% (0.3625 => 0.3847, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.12% (0.3317 => 0.3520, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (0.3930 => 0.4170, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.09% (0.3282 => 0.3482, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.09% (4.2109 => 4.4675, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.08% (0.3124 => 0.3314, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.06% (0.3348 => 0.3551, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.06% (0.3336 => 0.3538, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (0.2040 => 0.2163, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 5.98% (0.3477 => 0.3685, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (2.1013 => 2.2266, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.93% (0.3690 => 0.3909, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.93% (0.3726 => 0.3947, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.2736 => 0.2896, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.76% (0.4251 => 0.4496, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 5.75% (23.5202 => 24.8725, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 5.69% (1.8794 => 1.9864, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (0.3890 => 0.4111, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 5.67% (4.6177 => 4.8794, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (2.1653 => 2.2871, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 5.54% (1.4269 => 1.5060, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.3981 => 0.4201, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.2068 => 0.2182, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.5900 => 0.6225, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.48% (0.4139 => 0.4366, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.3845 => 0.4054, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.39% (0.6435 => 0.6782, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 5.39% (0.2691 => 0.2836, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.3084 => 0.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.29% (0.5012 => 0.5277, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.24% (0.4029 => 0.4240, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.3903 => 0.4106, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.19% (0.2737 => 0.2879, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 5.08% (2.0346 => 2.1379, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 5.07% (0.5546 => 0.5827, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 5.02% (0.2391 => 0.2511, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (0.4658 => 0.4890, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.89% (0.3271 => 0.3431, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.85% (0.7875 => 0.8257, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.2103 => 0.2205, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.84% (0.9697 => 1.0166, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.70% (0.4847 => 0.5075, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.63% (1.9966 => 2.0891, std.dev.: 0.0338) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.59% (1.9694 => 2.0597, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.43% (0.7426 => 0.7755, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.2969 => 0.3097, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (0.5361 => 0.5581, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (0.5584 => 0.5801, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.63% (11.6398 => 12.0622, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.46% (0.3498 => 0.3619, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.6926 => 4.8434, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.99% (0.4253 => 0.4380, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.92% (11.9555 => 12.1854, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1643, std.dev.: 0.1492) SingleSource/Benchmarks/Dhrystone/dry: 4.31% (14.0481 => 14.6539, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std.dev.: 0.0629) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5028, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4555, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.28% (7.1849 => 7.2766, std.dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5895, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4578, std.dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.37% (2.4764 => 2.4424, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5866, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8042, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -3.22% (17.2379 => 16.6827, std.dev.: 0.0958) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 17:05:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 19:05:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930000540.C5DAE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4398?compare_to=4390&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4398, Order: 164899, Start Time: 2012-09-29 22:41:43, End Time: 2012-09-30 00:07:15 To: 4390, Order: 164896, Start Time: 2012-09-29 16:32:25, End Time: 2012-09-29 17:57:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (178 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.66% (3.8893 => 3.7857, std.dev.: 0.0397) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7526 => 2.7527, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9701 => 4.9706, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.55% (2.0176 => 2.4524, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.02% (0.1410 => 0.1650, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.04% (0.4328 => 0.4806, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.88% (0.5818 => 0.6451, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.76% (0.4062 => 0.4499, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.65% (3.9660 => 4.3882, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.1588 => 0.1757, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.60% (1.3693 => 1.5144, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.57% (0.2781 => 0.3075, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.49% (0.5748 => 0.6351, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.37% (0.7038 => 0.7768, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.17% (0.6959 => 0.7667, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 10.15% (0.7061 => 0.7778, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.13% (0.2596 => 0.2859, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.13% (0.3899 => 0.4294, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.97% (0.3130 => 0.3442, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.90% (0.5265 => 0.5786, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.89% (0.3022 => 0.3321, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.82% (1.2193 => 1.3390, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.76% (0.9199 => 1.0097, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.75% (0.7710 => 0.8462, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 9.74% (0.2628 => 0.2884, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.73% (0.3485 => 0.3824, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.72% (0.3580 => 0.3928, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.70% (0.1062 => 0.1165, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.63% (1.9828 => 2.1738, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.61% (0.6283 => 0.6887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.60% (0.3489 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.60% (0.3293 => 0.3609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.55% (1.1364 => 1.2449, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.52% (1.4563 => 1.5949, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.40% (13.8202 => 15.1195, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.39% (0.4016 => 0.4393, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.37% (0.3756 => 0.4108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.35% (0.2696 => 0.2948, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.24% (0.2988 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.23% (0.4791 => 0.5233, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.18% (0.3192 => 0.3485, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.15% (0.3868 => 0.4222, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.09% (0.3453 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1589 => 0.1731, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.88% (1.0313 => 1.1229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.86% (0.3534 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.84% (0.3246 => 0.3533, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.79% (0.4390 => 0.4776, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.61% (0.5577 => 0.6057, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.58% (0.2995 => 0.3252, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.51% (16.6129 => 18.0274, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.35% (1.1061 => 1.1985, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.34% (0.4379 => 0.4744, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.32% (3.8646 => 4.1863, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2945 => 0.3190, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.16% (0.5637 => 0.6097, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 8.06% (0.8310 => 0.8980, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.93% (3.6692 => 3.9603, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 7.90% (0.6744 => 0.7277, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.90% (0.2925 => 0.3156, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.90% (0.7460 => 0.8049, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3220 => 0.3474, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.86% (0.6576 => 0.7093, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.80% (3.1889 => 3.4375, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.78% (7.2180 => 7.7797, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.75% (0.3755 => 0.4046, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 7.73% (2.1791 => 2.3476, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.65% (1.3819 => 1.4876, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 7.64% (1.0594 => 1.1403, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.62% (0.8698 => 0.9361, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 7.56% (1.9270 => 2.0726, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.54% (1.3813 => 1.4855, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.52% (0.1569 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.24% (0.1657 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.3245 => 1.4195, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 7.09% (0.4003 => 0.4287, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.07% (14.8535 => 15.9030, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.93% (1.2749 => 1.3632, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 6.91% (0.3601 => 0.3850, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 6.90% (0.3940 => 0.4212, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.89% (0.2859 => 0.3056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3663 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.79% (0.3650 => 0.3898, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.76% (4.6629 => 4.9782, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.4113 => 0.4390, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3623 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.70% (4.3801 => 4.6737, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.69% (4.4433 => 4.7406, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.68% (1.1333 => 1.2090, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.64% (8.4961 => 9.0605, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.64% (1.2292 => 1.3108, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.53% (0.8818 => 0.9394, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.49% (0.6135 => 0.6533, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 6.48% (0.3131 => 0.3334, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 6.32% (14.5298 => 15.4476, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (13.2842 => 14.1211, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 6.22% (6.5754 => 6.9846, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2504 => 0.2659, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.18% (3.2742 => 3.4767, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.16% (0.2321 => 0.2464, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.6250 => 0.6628, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.87% (0.3511 => 0.3717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.83% (0.4805 => 0.5085, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.75% (4.9865 => 5.2730, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.44% (1.5188 => 1.6014, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.40% (0.9108 => 0.9600, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.17% (3.7467 => 3.9404, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.94% (2.1007 => 2.2044, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (6.2785 => 6.5713, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.60% (33.2944 => 34.8261, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 2.95% (16.2614 => 16.7412, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5133, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2619, std.dev.: 0.0552) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.70% (1.1560 => 1.2566, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7247, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.91% (10.7476 => 11.0605, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5872, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5838, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2249, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5898, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.45% (22.5627 => 22.0098, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.50% (1.2308 => 1.0892, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2986, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7079, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9461, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2389, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7054, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2309, std.dev.: 0.0128) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1846, std.dev.: 0.0224) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4339, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2411, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5648, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 18:01:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 20:01:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930010141.8EAA12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4399?compare_to=4395&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4399, Order: 164900, Start Time: 2012-09-29 23:40:01, End Time: 2012-09-30 01:03:15 To: 4395, Order: 164898, Start Time: 2012-09-29 22:01:11, End Time: 2012-09-29 23:24:01 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 14 (81 on baseline) Performance Improvements: 4 (43 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 955 (767 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3081 => 0.3191, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.7812 => 0.8008, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.0725 => 2.1108, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: 1.70% (8.9682 => 9.1209, std.dev.: 0.0577) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (1.4065 => 1.4269, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.14% (1.3691 => 1.3847, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 14.53% (0.7695 => 0.8813, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.65% (1.7813 => 1.8642, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.73% (41.2548 => 42.3810, std.dev.: 0.4352) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.56% (0.3950 => 0.4051, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.42% (13.1439 => 13.4617, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.6584 => 4.7216, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.3494 => 2.3744, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.04% (2.7374 => 2.7660, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.37% (40.5915 => 39.2246, std.dev.: 0.1010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.71% (1.1164 => 1.0862, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.74% (2.3726 => 2.3312, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/tsp/tsp: -1.62% (1.7570 => 1.7285, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.34% (1.0146 => 1.0111, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 0.62% (0.6135 => 0.6173, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 5.55% (0.1605 => 0.1694, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.32% (0.1554 => 0.1518, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (0.3096 => 0.3143, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.52% (0.2270 => 0.2418, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (0.3172 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.2270 => 0.2340, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 0.66% (0.0453 => 0.0456, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 49.09% (0.0165 => 0.0246, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 29.80% (0.0151 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0388 => 0.0392, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.73% (0.0299 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0283 => 0.0286, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.68% (0.0179 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 6.04% (0.0182 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: 6.07% (0.0313 => 0.0332, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.07% (0.1402 => 0.1445, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.69% (1.4932 => 1.5633, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.12% (0.1456 => 0.1516, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.59% (0.4053 => 0.4077, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.21% (0.1400 => 0.1355, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.44% (0.0556 => 0.0564, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.39% (0.0173 => 0.0210, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.53% (0.0592 => 0.0607, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1281 => 1.1268, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.77% (0.0546 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 62.07% (0.0145 => 0.0235, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.25% (0.7647 => 0.7666, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.11% (1.5991 => 1.5973, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.11% (0.0121 => 0.0064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.67% (4.1772 => 3.1048, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/except: 82533.33% (0.0006 => 0.4958, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.19% (0.1414 => 0.1544, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.42% (0.5309 => 0.5756, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 8.39% (2.1763 => 2.3588, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.91% (0.6410 => 0.6917, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 6.97% (0.6173 => 0.6603, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.35% (1.0046 => 1.0684, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.27% (0.2552 => 0.2712, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (1.1653 => 1.2382, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 5.86% (15.3105 => 16.2076, std.dev.: 0.0783) MultiSource/Applications/lambda-0_1_3/lambda: 5.86% (0.6915 => 0.7320, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.67% (0.3582 => 0.3785, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.62% (0.6069 => 0.6410, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.00% (0.3901 => 0.4096, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (1.5150 => 1.5906, std.dev.: 0.0235) MultiSource/Applications/d/make_dparser: 4.96% (3.0225 => 3.1723, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.90% (0.7639 => 0.8013, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 4.67% (29.3170 => 30.6852, std.dev.: 0.1950) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.59% (0.4880 => 0.5104, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 4.36% (1.3268 => 1.3847, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.21% (0.3062 => 0.3191, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.17% (0.4248 => 0.4425, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 4.17% (0.3217 => 0.3351, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.14% (13.3238 => 13.8753, std.dev.: 0.0725) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.11% (0.2797 => 0.2912, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.99% (1.1440 => 1.1896, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (1.1827 => 1.2290, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.89% (2.0317 => 2.1108, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 3.59% (4.7455 => 4.9161, std.dev.: 0.0199) MultiSource/Applications/siod/siod: 3.54% (2.0972 => 2.1715, std.dev.: 0.0188) MultiSource/Applications/ClamAV/clamscan: 3.34% (14.6079 => 15.0956, std.dev.: 0.0269) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0821 => 1.1181, std.dev.: 0.0122) MultiSource/Applications/treecc/treecc: 3.18% (1.8798 => 1.9396, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.10% (0.3418 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.2186 => 8.4664, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (3.0758 => 3.1677, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 2.93% (3.5980 => 3.7035, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 2.92% (14.7256 => 15.1558, std.dev.: 0.0285) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.4908 => 6.6804, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.89% (1.2021 => 1.2369, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.7784 => 0.8008, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.3520 => 0.3621, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.81% (0.5937 => 0.6104, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.0689 => 1.0986, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.77% (0.8569 => 0.8806, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.3935 => 1.4269, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.4113 => 1.4447, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: 1.42% (0.9425 => 0.9559, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 53.26% (0.0261 => 0.0400, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.97% (0.0766 => 0.0896, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 15.70% (1.7426 => 2.0162, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.89% (4.0101 => 4.5673, std.dev.: 0.0352) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.78% (0.0917 => 0.1025, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 11.05% (1.6261 => 1.8058, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/Puzzle: 9.42% (0.1433 => 0.1568, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 9.19% (7.0025 => 7.6459, std.dev.: 0.0313) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.44% (0.2857 => 0.3098, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.94% (1.0063 => 1.0862, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.98% (4.2129 => 4.4227, std.dev.: 0.0380) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.70% (40.4792 => 42.3810, std.dev.: 0.4352) SingleSource/Benchmarks/Misc/fp-convert: 4.41% (15.2242 => 15.8949, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/dt: 3.97% (0.9851 => 1.0242, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.77% (2.6656 => 2.7660, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.71% (0.8498 => 0.8813, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.89% (14.4877 => 14.9070, std.dev.: 0.0686) MultiSource/Benchmarks/FreeBench/mason/mason: 2.82% (0.5004 => 0.5145, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 2.62% (3.8907 => 3.9928, std.dev.: 0.0365) MultiSource/Applications/siod/siod: 2.60% (3.5520 => 3.6444, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.36% (4.6127 => 4.7216, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.20% (6.6312 => 6.7768, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 2.06% (0.6308 => 0.6438, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 2.04% (2.4013 => 2.4503, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.86% (2.4042 => 2.4489, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 1.24% (2.3453 => 2.3744, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.02% (3.6388 => 3.6760, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.24% (5.2665 => 4.0953, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/ary3: -19.88% (1.7473 => 1.4000, std.dev.: 0.0434) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.38% (1.1647 => 0.9623, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.97% (15.8312 => 13.4617, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: -9.52% (0.1114 => 0.1008, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.53% (3.2007 => 2.9596, std.dev.: 0.0362) MultiSource/Applications/lambda-0_1_3/lambda: -7.21% (7.6833 => 7.1297, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3778, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: -6.57% (0.3746 => 0.3500, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.55% (2.0027 => 1.8716, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (4.6355 => 4.3352, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3567, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -5.97% (3.4230 => 3.2188, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7962, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9473, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (3.9413 => 3.7270, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1881, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -4.14% (2.5166 => 2.4124, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.87% (1.2722 => 1.2230, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/misr: -3.70% (0.4296 => 0.4137, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9450, std.dev.: 0.0395) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.23% (2.4457 => 2.3668, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2861, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.39% (3.7496 => 3.6599, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.39% (1.1683 => 1.1404, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6882, std.dev.: 0.4068) MultiSource/Applications/JM/lencod/lencod: -2.14% (6.7458 => 6.6014, std.dev.: 0.0112) MultiSource/Applications/lua/lua: -2.12% (29.5232 => 28.8981, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4218, std.dev.: 0.0160) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3569 => 2.3136, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3696, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2325, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -1.62% (1.4117 => 1.3889, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3102, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: -1.32% (16.5617 => 16.3427, std.dev.: 0.0708) SingleSource/Benchmarks/Dhrystone/fldry: -1.30% (2.4971 => 2.4647, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.14% (2.3580 => 2.3312, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.31% (0.9980 => 1.0111, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 2.51% (0.6022 => 0.6173, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 1.68% (0.1666 => 0.1694, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.32% (0.1554 => 0.1518, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (0.3083 => 0.3143, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.00% (0.2394 => 0.2418, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (0.3175 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.65% (0.2302 => 0.2340, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.50% (0.0240 => 0.0246, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.27% (0.0301 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: 2.15% (0.0325 => 0.0332, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1429 => 0.1445, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.09% (1.5019 => 1.5633, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.00% (0.1501 => 0.1516, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.39% (0.4264 => 0.4077, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.82% (0.1344 => 0.1355, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.0589 => 0.0564, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.01% (0.0639 => 0.0607, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1350 => 1.1268, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.94% (0.0637 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.47% (0.0246 => 0.0235, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.66% (0.7541 => 0.7666, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.97% (1.5363 => 1.5973, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.57% (0.0070 => 0.0064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 18:32:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 20:32:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930013228.E00772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4400?compare_to=4396&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4400, Order: 164900, Start Time: 2012-09-30 00:13:55, End Time: 2012-09-30 01:34:05 To: 4396, Order: 164899, Start Time: 2012-09-29 22:24:32, End Time: 2012-09-29 23:44:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (146 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 948 (702 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.74% (80.2748 => 78.8786, std.dev.: 0.5342) MultiSource/Benchmarks/llubenchmark/llu: -1.56% (3.8611 => 3.8008, std.dev.: 0.0196) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.16% (0.5761 => 0.5752, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.05% (16.0226 => 16.0309, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: -0.02% (14.9764 => 14.9728, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: 0.01% (83.1401 => 83.1498, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.3583 => 4.3537, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0458 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0460 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0404 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0401 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0403 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0439 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0440 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0401 => 0.0401) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0401 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2310 => 1.2320, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (7.5351 => 7.5352, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (3.7193 => 3.7205, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6509 => 0.6513, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.48% (63.2438 => 83.1498, std.dev.: 0.0202) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14236.11% (0.0720 => 10.3220, std.dev.: 0.0150) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.55% (10.3673 => 14.7785, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 29.47% (0.1622 => 0.2100, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.05% (7.0540 => 8.0450, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 13.62% (0.1432 => 0.1627, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.31% (2.2022 => 2.4954, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.15% (0.1566 => 0.1772, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.42% (1.1194 => 1.2584, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.40% (1.7609 => 1.9617, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.16% (0.1584 => 0.1745, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.73% (0.3516 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3561 => 0.3907, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.45% (0.3927 => 0.4298, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.11% (0.3886 => 0.4240, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.81% (0.3282 => 0.3571, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3307 => 0.3585, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.00% (9.4845 => 10.2429, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 7.95% (10.4361 => 11.2660, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.6675 => 0.7205, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.84% (0.3177 => 0.3426, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.72% (0.7433 => 0.8007, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1625 => 0.1750, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 7.58% (0.7115 => 0.7654, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.42% (0.5105 => 0.5484, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.40% (0.3109 => 0.3339, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.30% (0.5860 => 0.6288, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.21% (5.7591 => 6.1741, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 7.20% (0.2554 => 0.2738, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4615 => 0.4946, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.3423 => 0.3664, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 7.02% (3.3354 => 3.5696, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5925 => 0.6338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.97% (0.6030 => 0.6450, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (4.2646 => 4.5598, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4636 => 0.4956, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.4103 => 0.4386, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.89% (1.3050 => 1.3949, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.85% (1.5415 => 1.6471, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.67% (0.2758 => 0.2942, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.62% (0.7835 => 0.8354, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5569 => 0.5936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.52% (0.8067 => 0.8593, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 6.50% (0.3092 => 0.3293, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.9449 => 5.2639, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (8.1363 => 8.6596, std.dev.: 0.0089) MultiSource/Applications/hbd/hbd: 6.42% (1.5603 => 1.6604, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.39% (0.3865 => 0.4112, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.38% (0.6456 => 0.6868, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.37% (0.5020 => 0.5340, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.34% (5.0018 => 5.3191, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.32% (0.4289 => 0.4560, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.30% (0.3650 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.28% (0.4203 => 0.4467, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.28% (0.7326 => 0.7786, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.27% (0.4064 => 0.4319, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.24% (2.0665 => 2.1955, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (0.8172 => 0.8681, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.19% (0.3603 => 0.3826, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.18% (1.1642 => 1.2361, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.18% (0.9765 => 1.0368, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3441 => 0.3652, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.3232 => 0.3430, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (1.1861 => 1.2586, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.10% (0.3162 => 0.3355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3283 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.04% (0.4620 => 0.4899, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.02% (1.0722 => 1.1368, std.dev.: 0.0157) MultiSource/Benchmarks/sim/sim: 6.02% (0.3387 => 0.3591, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.94% (3.8723 => 4.1022, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (7.9617 => 8.4277, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.80% (0.2603 => 0.2754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3935 => 0.4161, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.63% (0.3180 => 0.3359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.62% (0.3684 => 0.3891, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.60% (2.0273 => 2.1408, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 5.49% (2.2969 => 2.4230, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4299 => 0.4534, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.22% (0.6450 => 0.6787, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.13% (0.8921 => 0.9379, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.96% (1.5859 => 1.6646, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 4.89% (21.9371 => 23.0092, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.66% (0.5981 => 0.6260, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.4186 => 1.4840, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.56% (2.2024 => 2.3029, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2842 => 1.3398, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.28% (1.1840 => 1.2347, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (14.3668 => 14.9700, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.8101 => 0.8350, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.04% (17.1811 => 17.5308, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.97% (3.8922 => 3.9688, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4511, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (3.1578 => 3.3812, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7683, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7990, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2323, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5800, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.05% (5.2763 => 3.2686, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.29% (5.3855 => 3.8617, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.85% (5.3526 => 3.8617, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1831, std.dev.: 0.0464) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.00% (2.9384 => 2.6151, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -7.86% (22.1758 => 20.4319, std.dev.: 0.0268) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -12.22% (1.2373 => 1.0861, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2952, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1618, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4974, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.22% (8.1563 => 7.9753, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.13% (8.6802 => 8.4950, std.dev.: 0.0092) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0907, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -1.74% (12.4730 => 12.2556, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5134, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4235, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2300, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.00% (0.5229 => 0.5752, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 6.95% (14.9895 => 16.0309, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 5.78% (14.1553 => 14.9728, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 5.92% (4.1105 => 4.3537, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.51% (1.1048 => 1.2320, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.27% (7.1582 => 7.5352, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.44% (3.4629 => 3.7205, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.68% (0.6222 => 0.6513, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 19:00:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 21:00:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930020006.D8D3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4401?compare_to=4398&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4401, Order: 164907, Start Time: 2012-09-30 00:36:10, End Time: 2012-09-30 02:01:43 To: 4398, Order: 164899, Start Time: 2012-09-29 22:41:43, End Time: 2012-09-30 00:07:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (178 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.53% (27.8296 => 29.6468, std.dev.: 0.0633) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.35% (55.3047 => 56.6043, std.dev.: 0.0737) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7527 => 2.7523, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.09% (4.9706 => 4.9749, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.10% (2.0176 => 2.4433, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.78% (0.1072 => 0.1209, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.86% (0.5818 => 0.6450, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.83% (0.1588 => 0.1760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.79% (0.4328 => 0.4795, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.65% (0.5748 => 0.6360, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 10.61% (0.4062 => 0.4493, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7061 => 0.7809, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.46% (0.2781 => 0.3072, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.42% (3.9660 => 4.3794, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 10.27% (0.7038 => 0.7761, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 10.15% (1.3693 => 1.5083, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.05% (0.2596 => 0.2857, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.90% (0.3899 => 0.4285, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.84% (0.7710 => 0.8469, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.84% (0.6959 => 0.7644, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.82% (0.5265 => 0.5782, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.76% (1.2193 => 1.3383, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.71% (0.6283 => 0.6893, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.65% (0.9199 => 1.0087, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.60% (0.3022 => 0.3312, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.50% (0.4390 => 0.4807, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.47% (0.3485 => 0.3815, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.44% (1.1364 => 1.2437, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.39% (1.4563 => 1.5931, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 9.39% (0.2726 => 0.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.36% (1.9828 => 2.1683, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.35% (0.4791 => 0.5239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.35% (0.2760 => 0.3018, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.33% (0.2937 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.31% (0.2761 => 0.3018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.31% (0.2966 => 0.3242, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.29% (13.8202 => 15.1043, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.27% (0.3580 => 0.3912, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.27% (0.3756 => 0.4104, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.24% (0.4016 => 0.4387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.20% (0.3489 => 0.3810, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.08% (0.3293 => 0.3592, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.05% (0.3868 => 0.4218, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 9.02% (0.3149 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.92% (0.3107 => 0.3384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.84% (0.2988 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.81% (0.3246 => 0.3532, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 8.77% (0.3453 => 0.3756, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.77% (0.3534 => 0.3844, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.75% (0.1589 => 0.1728, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 8.74% (0.3192 => 0.3471, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.74% (1.0313 => 1.1214, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.5577 => 0.6052, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2127 => 0.2306, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.27% (0.4379 => 0.4741, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 8.19% (16.6129 => 17.9732, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 8.17% (3.8646 => 4.1805, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.09% (0.5637 => 0.6093, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2945 => 0.3183, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.02% (1.1061 => 1.1948, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 7.93% (0.8310 => 0.8969, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.87% (3.6692 => 3.9578, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.7460 => 0.8044, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3220 => 0.3471, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (7.2180 => 7.7801, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 7.78% (0.6744 => 0.7269, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.73% (0.7506 => 0.8086, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.70% (0.3755 => 0.4044, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3578 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.62% (0.2925 => 0.3148, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.60% (0.3646 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3601 => 0.3874, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.54% (1.0594 => 1.1393, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.50% (0.8698 => 0.9350, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.48% (2.1791 => 2.3422, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.44% (3.1889 => 3.4262, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.39% (0.3940 => 0.4231, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.37% (1.9270 => 2.0691, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.33% (0.6576 => 0.7058, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.3245 => 1.4181, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.93% (0.3245 => 0.3470, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.86% (14.8535 => 15.8723, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/05-eks/eks: 6.83% (0.4113 => 0.4394, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (1.2749 => 1.3619, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (1.3819 => 1.4754, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.73% (1.3813 => 1.4743, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.72% (4.3801 => 4.6744, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.68% (0.6135 => 0.6545, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (8.4961 => 9.0591, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.57% (4.4433 => 4.7353, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 6.55% (4.6629 => 4.9681, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.1333 => 1.2074, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.52% (0.8818 => 0.9393, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.2859 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.2140 => 0.2276, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 6.34% (1.2292 => 1.3071, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 6.22% (14.5298 => 15.4333, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.21% (0.3511 => 0.3729, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.15% (3.2742 => 3.4755, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.6250 => 0.6628, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.01% (6.5754 => 6.9709, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (13.2842 => 14.0828, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.79% (4.9865 => 5.2753, std.dev.: 0.0294) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.62% (0.4805 => 0.5075, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.31% (1.5188 => 1.5994, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.19% (0.9108 => 0.9581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.04% (3.7467 => 3.9355, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.78% (2.1007 => 2.2011, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (6.2785 => 6.5712, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 4.28% (33.2944 => 34.7195, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7247, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 23.69% (1.8175 => 2.2481, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (3.1736 => 3.4120, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9836, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1027, std.dev.: 0.0397) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5939, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5852, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5974, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2247, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (8.8259 => 8.9143, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.65% (0.4657 => 0.3928, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (22.5627 => 22.0057, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2308 => 1.0915, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2793, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5155, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0231) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.26% (1.9762 => 1.9316, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2362, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7052, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2313, std.dev.: 0.0051) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1650, std.dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8713, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2401, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4351, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 19:58:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 21:58:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930025843.C51FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4402?compare_to=4399&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4402, Order: 164907, Start Time: 2012-09-30 01:35:21, End Time: 2012-09-30 03:00:22 To: 4399, Order: 164900, Start Time: 2012-09-29 23:40:01, End Time: 2012-09-30 01:03:15 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 7 (90 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 963 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.01% (0.5626 => 0.5908, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.98% (0.4597 => 0.4734, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.7328 => 0.7485, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9099 => 0.9292, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (4.3943 => 4.4416, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 14.57% (3.2320 => 3.7029, std.dev.: 0.1318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.02% (1.4338 => 1.4484, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.51% (1.4269 => 1.4054, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.51% (2.7660 => 2.6967, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.09% (4.1382 => 4.0932, std.dev.: 0.0144) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.67% (1.0111 => 1.0179, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -0.03% (0.6173 => 0.6171, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 0.47% (0.1694 => 0.1702, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.40% (0.1518 => 0.1600, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (0.3143 => 0.3138, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.99% (0.2418 => 0.2394, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.46% (0.3251 => 0.3236, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.47% (0.2340 => 0.2329, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -5.70% (0.0456 => 0.0430, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: 2.25% (0.0089 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.10% (0.0091 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.81% (0.0246 => 0.0244, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0196 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0392 => 0.0393, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.42% (0.0240 => 0.0239, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.50% (0.0286 => 0.0276, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0327 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0182 => 0.0182, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.04% (0.0193 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0253 => 0.0254, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.90% (0.0332 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1445 => 0.1447, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -4.60% (1.5633 => 1.4914, std.dev.: 0.0256) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.97% (0.1516 => 0.1471, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.78% (0.4077 => 0.4272, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.17% (0.1355 => 0.1398, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.50% (0.0564 => 0.0595, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.43% (0.0210 => 0.0234, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.12% (0.0607 => 0.0582, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1268 => 1.1317, std.dev.: 0.0479) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2300.00% (0.0001 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.0643 => 0.0602, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.64% (0.0235 => 0.0260, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.7666 => 0.7646, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.04% (1.5973 => 1.5979, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 89.06% (0.0064 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.81% (4.1772 => 3.0572, std.dev.: 0.0707) SingleSource/Benchmarks/Shootout-C++/except: 81916.67% (0.0006 => 0.4921, std.dev.: 0.0049) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.82% (0.1414 => 0.1567, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 9.12% (0.5309 => 0.5793, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 7.93% (2.1763 => 2.3489, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6410 => 0.6913, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 7.19% (0.6173 => 0.6617, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.30% (1.0046 => 1.0679, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 5.83% (15.3105 => 16.2038, std.dev.: 0.1468) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.1653 => 1.2328, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.2552 => 0.2696, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.54% (1.5150 => 1.5989, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.53% (0.4248 => 0.4483, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.51% (0.6915 => 0.7296, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.6069 => 0.6397, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.83% (0.7639 => 0.8008, std.dev.: 0.0068) MultiSource/Applications/d/make_dparser: 4.76% (3.0225 => 3.1663, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.47% (0.2797 => 0.2922, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3217 => 0.3357, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4880 => 0.5088, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.13% (1.1440 => 1.1913, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.12% (0.3008 => 0.3132, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 4.10% (29.3170 => 30.5179, std.dev.: 0.2495) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (12.6413 => 13.1541, std.dev.: 0.0838) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.98% (0.3062 => 0.3184, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.87% (1.3268 => 1.3781, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.85% (0.7722 => 0.8019, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 3.73% (13.3238 => 13.8209, std.dev.: 0.0197) MultiSource/Applications/sgefa/sgefa: 3.68% (0.2877 => 0.2983, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.7226 => 0.7485, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 3.54% (0.3026 => 0.3133, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (1.1827 => 1.2243, std.dev.: 0.0108) MultiSource/Applications/siod/siod: 3.50% (2.0972 => 2.1706, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (6.2546 => 6.4552, std.dev.: 0.0393) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.0689 => 1.1030, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.18% (3.0758 => 3.1737, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 3.13% (3.5980 => 3.7107, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.13% (0.3418 => 0.3525, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 3.10% (1.8798 => 1.9381, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.00% (0.4596 => 0.4734, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (4.0318 => 4.1522, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (1.4408 => 1.4832, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5740 => 0.5908, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9029 => 0.9292, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.90% (2.0317 => 2.0906, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 2.88% (4.7455 => 4.8823, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.6079 => 15.0104, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.70% (0.5520 => 0.5669, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.69% (1.2021 => 1.2344, std.dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0821 => 1.1109, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 2.65% (0.3847 => 0.3949, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.4113 => 1.4487, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (6.4908 => 6.6608, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.7256 => 15.0847, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.40% (0.8569 => 0.8775, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.3380 => 4.4416, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (3.8796 => 3.9711, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.34% (4.2815 => 4.3818, std.dev.: 0.0234) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (1.4189 => 1.4518, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.29% (0.5636 => 0.5765, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.5963 => 0.6097, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.92% (4.2616 => 4.3433, std.dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.64% (8.2559 => 8.3916, std.dev.: 0.0284) MultiSource/Applications/hexxagon/hexxagon: 1.37% (0.9425 => 0.9554, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 53.64% (0.0261 => 0.0401, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.84% (0.0766 => 0.0918, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 15.12% (1.7426 => 2.0060, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.78% (4.0101 => 4.5628, std.dev.: 0.0469) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.18% (1.0063 => 1.0987, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6342, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.79% (0.3301 => 0.3525, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.86% (40.4792 => 42.4458, std.dev.: 0.1523) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.00% (4.2129 => 4.3815, std.dev.: 0.0600) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8321, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5415, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: 3.79% (0.9851 => 1.0224, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8919, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 2.46% (3.5520 => 3.6393, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (6.6312 => 6.7727, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.4184 => 1.4394, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.45% (1.6110 => 1.6343, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.6127 => 4.6792, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.12% (1.4324 => 1.4484, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.55% (0.3497 => 0.2079, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.27% (5.2665 => 4.1465, std.dev.: 0.0692) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.1647 => 0.9609, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.66% (15.8312 => 13.1930, std.dev.: 0.1075) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1575, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.15% (3.2007 => 2.9400, std.dev.: 0.0220) MultiSource/Applications/lambda-0_1_3/lambda: -7.26% (7.6833 => 7.1253, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3761, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3310, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.28% (1.4441 => 1.3534, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.90% (3.4230 => 3.2211, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9509, std.dev.: 0.1025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7266, std.dev.: 0.0356) SingleSource/Benchmarks/Shootout/fib2: -5.33% (4.4195 => 4.1840, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -4.42% (92.7467 => 88.6489, std.dev.: 1.0467) MultiSource/Benchmarks/Olden/bh/bh: -4.34% (2.5166 => 2.4074, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.20% (1.4021 => 1.3432, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.09% (1.2722 => 1.2202, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.28% (3.7496 => 3.6266, std.dev.: 0.0330) SingleSource/Benchmarks/McGill/misr: -3.19% (0.4296 => 0.4159, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (9.2503 => 8.9586, std.dev.: 0.0531) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.83% (61.1734 => 59.4400, std.dev.: 0.6273) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2867, std.dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.59% (1.1683 => 1.1380, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.36% (1.0686 => 1.0434, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.17% (2.4457 => 2.3926, std.dev.: 0.0205) MultiSource/Applications/lua/lua: -2.13% (29.5232 => 28.8956, std.dev.: 0.1723) MultiSource/Applications/aha/aha: -2.02% (3.4286 => 3.3594, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.01% (2.8964 => 2.8381, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.98% (0.6119 => 0.5998, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3118, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -1.72% (3.4876 => 3.4276, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2257, std.dev.: 0.0381) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -1.45% (2.4971 => 2.4610, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8041, std.dev.: 0.0751) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.10% (16.5617 => 16.3799, std.dev.: 0.0615) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.99% (0.9980 => 1.0179, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 2.47% (0.6022 => 0.6171, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 2.16% (0.1666 => 0.1702, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.96% (0.1554 => 0.1600, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.78% (0.3083 => 0.3138, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2394 => 0.2394, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.92% (0.3175 => 0.3236, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.17% (0.2302 => 0.2329, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -4.23% (0.0449 => 0.0430, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: 2.25% (0.0089 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.60% (0.0301 => 0.0239, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.82% (0.0284 => 0.0276, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1429 => 0.1447, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -0.70% (1.5019 => 1.4914, std.dev.: 0.0256) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.00% (0.1501 => 0.1471, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.19% (0.4264 => 0.4272, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1344 => 0.1398, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.02% (0.0589 => 0.0595, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.86% (0.0232 => 0.0234, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1350 => 1.1317, std.dev.: 0.0479) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.49% (0.0637 => 0.0602, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (0.0246 => 0.0260, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.39% (0.7541 => 0.7646, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.01% (1.5363 => 1.5979, std.dev.: 0.0006) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 20:21:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 22:21:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930032139.316EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4403?compare_to=4400&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4403, Order: 164908, Start Time: 2012-09-30 02:03:08, End Time: 2012-09-30 03:23:15 To: 4400, Order: 164900, Start Time: 2012-09-30 00:13:55, End Time: 2012-09-30 01:34:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 949 (704 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.32% (14.7785 => 14.5827, std.dev.: 0.0151) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5752 => 0.5744, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.40% (16.0309 => 15.9667, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -0.20% (14.9728 => 14.9435, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -0.15% (83.1498 => 83.0211, std.dev.: 0.0456) MultiSource/Benchmarks/MallocBench/gs/gs: - (4.3537 => 4.3537, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0458 => 0.0459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.65% (0.0459 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0427 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.47% (0.0429 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.96% (0.0416 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.72% (0.0418 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.73% (0.0410 => 0.0413) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.49% (0.0412 => 0.0414, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.49% (0.0412 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.72% (0.0419 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.71% (0.0421 => 0.0424) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.69% (0.0432 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0409 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.48% (0.0420 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0421 => 0.0424) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.73% (0.0411 => 0.0414, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.73% (0.0412 => 0.0415) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.50% (0.0403 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.75% (0.0401 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0404 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0440 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.50% (0.0401 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.50% (0.0402 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.50% (0.0402 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.50% (0.0403 => 0.0405, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0410 => 0.0412, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.49% (0.0411 => 0.0413, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.2320 => 1.2294, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (7.5352 => 7.5162, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (3.7205 => 3.7054, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.80% (0.6513 => 0.6461, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1431 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0647 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.27% (63.2438 => 83.0211, std.dev.: 0.0456) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.33% (0.0720 => 10.3200, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.66% (10.3673 => 14.5827, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/richards_benchmark: 28.42% (0.1622 => 0.2083, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.10% (7.0540 => 8.0489, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.85% (2.2022 => 2.5073, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 13.27% (0.1432 => 0.1622, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.96% (1.1194 => 1.2645, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.84% (0.1566 => 0.1767, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.53% (1.7609 => 1.9640, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.88% (0.3473 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.45% (0.3282 => 0.3592, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.68% (10.4361 => 11.3419, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 7.92% (0.1440 => 0.1554, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.83% (0.3307 => 0.3566, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.70% (0.5925 => 0.6381, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 7.68% (0.6030 => 0.6493, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.67% (9.4845 => 10.2124, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 7.55% (0.7433 => 0.7994, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.28% (0.7115 => 0.7633, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.27% (0.6675 => 0.7160, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.10% (5.7591 => 6.1680, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/08-main/main: 7.09% (0.2554 => 0.2735, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.96% (0.2700 => 0.2888, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7326 => 0.7835, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.95% (0.3109 => 0.3325, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.84% (1.5415 => 1.6470, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3423 => 0.3656, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.80% (3.3354 => 3.5623, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.5860 => 0.6256, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.74% (0.5105 => 0.5449, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.61% (1.3050 => 1.3912, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.51% (0.8067 => 0.8592, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.49% (0.3422 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (4.2646 => 4.5412, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.48% (5.0018 => 5.3257, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.46% (0.8172 => 0.8700, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (8.1363 => 8.6607, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5569 => 0.5923, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (4.9449 => 5.2553, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 6.20% (0.7835 => 0.8321, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2758 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.14% (0.4103 => 0.4355, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 5.96% (1.1642 => 1.2336, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.96% (0.5020 => 0.5319, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.92% (0.9765 => 1.0343, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.87% (0.2725 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.85% (0.3232 => 0.3421, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2891 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.81% (0.6456 => 0.6831, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (0.4064 => 0.4300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.80% (0.3865 => 0.4089, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.77% (1.1861 => 1.2545, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.73% (0.3387 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3650 => 0.3859, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.71% (0.2905 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4636 => 0.4899, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.67% (0.4289 => 0.4532, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.66% (1.0722 => 1.1329, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.62% (3.8723 => 4.0901, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (7.9617 => 8.4071, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.54% (0.4203 => 0.4436, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.54% (0.3826 => 0.4038, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.44% (0.3162 => 0.3334, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.3098 => 0.3266, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.40% (2.0273 => 2.1367, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (2.0665 => 2.1777, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.38% (1.5603 => 1.6442, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (0.4620 => 0.4868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.36% (0.2872 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2756 => 0.2903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.3052 => 0.3214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2871 => 0.3023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.26% (0.3935 => 0.4142, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.26% (0.4299 => 0.4525, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2877 => 0.3028) SingleSource/Benchmarks/Shootout-C++/moments: 5.24% (0.4048 => 0.4260, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3684 => 0.3876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2793 => 0.2938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.19% (0.3603 => 0.3790, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.12% (0.3379 => 0.3552, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.12% (0.6450 => 0.6780, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2802 => 0.2944, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.94% (21.9371 => 23.0218, std.dev.: 0.0111) MultiSource/Applications/siod/siod: 4.93% (2.2969 => 2.4101, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.81% (0.8921 => 0.9350, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.73% (0.5981 => 0.6264, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.46% (1.5859 => 1.6566, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.4186 => 1.4802, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (14.3668 => 14.9658, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.02% (2.2024 => 2.2909, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.87% (1.1840 => 1.2298, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.71% (1.2842 => 1.3318, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.14% (0.8101 => 0.8355, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.89% (17.1811 => 17.5057, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.8922 => 3.9587, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.11% (3.1578 => 3.3824, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7757, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (4.2280 => 4.3519, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2138, std.dev.: 0.0306) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2494, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.83% (5.3855 => 3.8868, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.48% (5.3526 => 3.8815, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2032, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.05% (2.9384 => 2.6138, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -7.77% (22.1758 => 20.4522, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -12.22% (1.2373 => 1.0861, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3773, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2946, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.61% (1.8329 => 1.7118, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.60% (3.2827 => 3.1646, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4969, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9975, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.93% (8.6802 => 8.5127, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2532, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -1.69% (10.2830 => 10.1088, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2250, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.85% (0.5229 => 0.5744, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.52% (14.9895 => 15.9667, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 5.57% (14.1553 => 14.9435, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 5.92% (4.1105 => 4.3537, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.28% (1.1048 => 1.2294, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.00% (7.1582 => 7.5162, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.00% (3.4629 => 3.7054, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.84% (0.6222 => 0.6461, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 20:27:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 22:27:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120930032732.017012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4404?compare_to=4397&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4404, Order: 164900, Start Time: 2012-09-30 00:19:58, End Time: 2012-09-30 03:28:58 To: 4397, Order: 164897, Start Time: 2012-09-29 20:42:08, End Time: 2012-09-29 23:50:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (6 on baseline) Performance Regressions: 2 (129 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (128 on baseline) Existing Failures: 6 (0 on baseline) Unchanged Tests: 1033 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.96% (128.9979 => 131.5266, std.dev.: 0.2766) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.1234 => 54.8195, std.dev.: 0.1138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.57% (1.7810 => 1.7531, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.90% (0.1001 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.80% (0.1003 => 0.0995, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8094 => 9.8108, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (9.4102 => 9.4096, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3446 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.21% (0.3469 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3488 => 0.3879, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.20% (0.3465 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.19% (0.3442 => 0.3827, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 11.16% (0.3460 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.16% (0.3496 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.88% (0.3650 => 0.4047, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3643 => 0.4037, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.61% (0.3724 => 0.4119, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.04% (1.5932 => 1.7531, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.29% (0.5826 => 0.6309, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.15% (0.5889 => 0.6369, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.3004 => 0.3233, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.57% (0.3195 => 0.3437, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2875 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2729 => 0.2933, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 7.47% (0.2823 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2738 => 0.2939, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2813 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2750 => 0.2949, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2792 => 0.2994, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.20% (0.9909 => 1.0622, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2911 => 0.3118, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2803 => 0.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.05% (0.2780 => 0.2976, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.04% (2.0673 => 2.2128, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.03% (0.3060 => 0.3275, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.3362 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3096 => 0.3312, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.94% (0.2811 => 0.3006, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7171 => 0.7668, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.87% (1.3152 => 1.4055, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 6.84% (0.3317 => 0.3544, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3267 => 0.3490, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.79% (0.4994 => 0.5333, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4146 => 0.4423, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.66% (0.3348 => 0.3571, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3258 => 0.3474, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (1.6211 => 1.7282, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.60% (0.4361 => 0.4649, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.3845 => 0.4098, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.58% (0.3678 => 0.3920, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3124 => 0.3329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3726 => 0.3969, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (3.5627 => 3.7948, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.43% (0.3282 => 0.3493, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.36% (0.3477 => 0.3698, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.24% (0.2566 => 0.2726, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.23% (5.5417 => 5.8872, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.18% (0.5000 => 0.5309, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.17% (1.0781 => 1.1446, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 6.16% (0.4251 => 0.4513, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3690 => 0.3915, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.10% (2.7292 => 2.8956, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.3981 => 0.4219, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (0.5026 => 0.5322, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 5.73% (4.2109 => 4.4520, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 5.70% (23.5202 => 24.8614, std.dev.: 0.0202) MultiSource/Applications/siod/siod: 5.67% (0.6634 => 0.7010, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.67% (4.4195 => 4.6699, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (0.3930 => 0.4151, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 5.53% (0.4029 => 0.4252, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.52% (0.6435 => 0.6790, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.2736 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.42% (0.2068 => 0.2180, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.5012 => 0.5283, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.34% (1.4269 => 1.5031, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.2737 => 0.2883) MultiSource/Benchmarks/MallocBench/gs/gs: 5.29% (1.8794 => 1.9789, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (0.3890 => 0.4095, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.27% (0.2866 => 0.3017, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.27% (2.1013 => 2.2120, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (2.1653 => 2.2782, std.dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: 5.19% (4.6177 => 4.8573, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.17% (0.4139 => 0.4353, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.16% (0.3084 => 0.3243, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.00% (0.3903 => 0.4098, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.92% (0.9697 => 1.0174, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.2040 => 0.2140, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.83% (0.2691 => 0.2821, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.80% (0.3336 => 0.3496, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (0.4658 => 0.4877, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.68% (0.3271 => 0.3424, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.54% (0.5546 => 0.5798, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.50% (1.9694 => 2.0580, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.50% (1.9966 => 2.0864, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.50% (0.7875 => 0.8229, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 4.33% (2.0346 => 2.1227, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 4.31% (0.4847 => 0.5056, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.18% (0.2969 => 0.3093, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.78% (0.7426 => 0.7707, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (0.5361 => 0.5555, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.32% (0.4253 => 0.4394, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.26% (0.5584 => 0.5766, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.15% (4.6926 => 4.8406, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.14% (11.6398 => 12.0054, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.3498 => 0.3601, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 1.88% (11.9555 => 12.1806, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.60% (3.3903 => 3.6140, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6674, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1727, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.46% (1.8057 => 1.8863, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6317, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2106, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5079, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4442, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.08% (105.3826 => 106.5224, std.dev.: 0.0464) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5496, std.dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7892, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.70% (0.2402 => 0.2241, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7982, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.30% (17.2379 => 16.8407, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5002, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 20:54:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 22:54:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930035428.EA8672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4405?compare_to=4401&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4405, Order: 164908, Start Time: 2012-09-30 02:30:36, End Time: 2012-09-30 03:56:05 To: 4401, Order: 164907, Start Time: 2012-09-30 00:36:10, End Time: 2012-09-30 02:01:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (179 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1036 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 5.18% (2.2481 => 2.3645, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.60% (78.9134 => 80.1742, std.dev.: 0.2912) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.78% (56.6043 => 54.4626, std.dev.: 0.6091) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7523 => 2.7523, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9749 => 4.9745, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.09% (2.0176 => 2.4431, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.87% (0.1072 => 0.1210, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 10.88% (0.4328 => 0.4799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.83% (0.7061 => 0.7826, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.79% (0.2596 => 0.2876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.78% (0.5818 => 0.6445, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.61% (0.5748 => 0.6358, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.45% (3.9660 => 4.3805, std.dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.39% (0.7038 => 0.7769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.12% (0.6959 => 0.7663, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.06% (1.3693 => 1.5071, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.03% (0.2721 => 0.2994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2782 => 0.3060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.98% (0.3899 => 0.4288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.95% (0.4062 => 0.4466, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.76% (1.2193 => 1.3383, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.75% (0.4390 => 0.4818, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.72% (0.5265 => 0.5777, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.71% (0.6283 => 0.6893, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.52% (0.7710 => 0.8444, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.50% (0.9199 => 1.0073, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.50% (0.3022 => 0.3309, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.48% (0.4791 => 0.5245, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.47% (0.3485 => 0.3815, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.45% (0.2655 => 0.2906, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.43% (1.1364 => 1.2436, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.42% (1.4563 => 1.5935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.36% (1.9828 => 2.1683, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.32% (0.3756 => 0.4106, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.31% (0.3489 => 0.3814, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.30% (0.3580 => 0.3913, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.29% (13.8202 => 15.1038, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.24% (0.2966 => 0.3240, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.21% (0.4016 => 0.4386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.14% (0.3293 => 0.3594, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.11% (0.3149 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.97% (0.3868 => 0.4215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.3107 => 0.3385, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.79% (1.0313 => 1.1219, std.dev.: 0.0142) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.77% (0.3453 => 0.3756, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.65% (0.3192 => 0.3468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3534 => 0.3838, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.58% (0.2995 => 0.3252, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.50% (0.5577 => 0.6051, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.18% (1.1061 => 1.1966, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.15% (0.2945 => 0.3185, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.15% (3.8646 => 4.1795, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 8.14% (16.6129 => 17.9657, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.08% (0.4379 => 0.4733, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.02% (0.5637 => 0.6089, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.95% (0.7506 => 0.8103, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.93% (0.8310 => 0.8969, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3220 => 0.3473, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (3.6692 => 3.9572, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.84% (0.7460 => 0.8045, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.77% (0.6744 => 0.7268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.75% (0.3755 => 0.4046, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.75% (7.2180 => 7.7773, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 7.74% (0.3578 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.60% (0.3646 => 0.3923, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.55% (0.8698 => 0.9355, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.53% (2.1791 => 2.3431, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 7.51% (1.0594 => 1.1390, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.43% (3.1889 => 3.4258, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3601 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.37% (1.9270 => 2.0691, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.36% (0.6576 => 0.7060, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.32% (0.3650 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.26% (0.3623 => 0.3886, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.20% (1.3245 => 1.4198, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.84% (0.3245 => 0.3467, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.82% (14.8535 => 15.8672, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (1.3819 => 1.4760, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 6.78% (0.4113 => 0.4392, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.74% (1.2749 => 1.3608, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.69% (8.4961 => 9.0642, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.68% (0.6135 => 0.6545, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.68% (1.3813 => 1.4736, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 6.61% (4.6629 => 4.9709, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.54% (4.3801 => 4.6667, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 6.54% (0.2859 => 0.3046, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.49% (0.8818 => 0.9390, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.49% (4.4433 => 4.7315, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1333 => 1.2067, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 6.40% (1.2292 => 1.3079, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.32% (0.3131 => 0.3329, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.18% (0.3511 => 0.3728, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2140 => 0.2271, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.10% (3.2742 => 3.4739, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.08% (0.6250 => 0.6630, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 6.07% (14.5298 => 15.4124, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (13.2842 => 14.0850, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 6.00% (6.5754 => 6.9699, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.86% (0.2321 => 0.2457, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.83% (0.1819 => 0.1925, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.79% (4.9865 => 5.2751, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.4805 => 0.5077, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.37% (1.5188 => 1.6003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.14% (0.9108 => 0.9576, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.07% (3.7467 => 3.9366, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.91% (2.1007 => 2.2038, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (6.2785 => 6.5709, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 4.27% (33.2944 => 34.7162, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7213, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 30.10% (1.8175 => 2.3645, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2549, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.65% (1.2998 => 1.3733, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7245, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.92% (10.7476 => 11.0618, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5836, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5841, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5927, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2222, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3232, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6838, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.74% (0.4657 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (22.5627 => 22.0058, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.59% (1.2308 => 1.0882, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2796, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3034, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.30% (2.6470 => 2.5066, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0207) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2393, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7052, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0057, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1316, std.dev.: 0.0264) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3305 => 7.2273, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2372, std.dev.: 0.0346) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5645, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Sep 29 21:36:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 29 Sep 2012 23:36:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930043659.2BDE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4406?compare_to=4402&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4406, Order: 164908, Start Time: 2012-09-30 03:16:10, End Time: 2012-09-30 04:38:38 To: 4402, Order: 164907, Start Time: 2012-09-30 01:35:21, End Time: 2012-09-30 03:00:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 9 (76 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 961 (773 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.84% (0.8405 => 0.8560, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.39% (0.8062 => 0.8174, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.32% (0.8742 => 0.8857, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (2.3489 => 2.3740, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.98% (1.7572 => 1.8622, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.96% (1.3432 => 1.4232, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 2.66% (88.6489 => 91.0038, std.dev.: 0.2685) MultiSource/Benchmarks/llubenchmark/llu: 1.68% (1.9964 => 2.0299, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.56% (3.6266 => 3.6833, std.dev.: 0.0154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -5.94% (3.7029 => 3.4831, std.dev.: 0.0363) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.60% (2.4639 => 2.4246, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.51% (1.4484 => 1.4266, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.26% (1.0179 => 1.0205, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 0.18% (0.6171 => 0.6182, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -0.29% (0.1702 => 0.1697, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.38% (0.1600 => 0.1594, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.61% (0.3138 => 0.3157, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.2394 => 0.2388, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.83% (0.3236 => 0.3209, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.73% (0.2329 => 0.2312, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 5.12% (0.0430 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -2.20% (0.0091 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.38% (0.0244 => 0.0226, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.51% (0.0196 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.25% (0.0393 => 0.0392, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.78% (0.0239 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.99% (0.0276 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0326 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0182 => 0.0182, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0195 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.39% (0.0254 => 0.0253, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 1.52% (0.0329 => 0.0334, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1447 => 0.1458, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 0.52% (1.4914 => 1.4992, std.dev.: 0.0367) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.40% (0.1471 => 0.1521, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.85% (0.4272 => 0.4193, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.57% (0.1398 => 0.1406, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.04% (0.0595 => 0.0625, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.81% (0.0234 => 0.0271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.97% (0.0582 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1317 => 1.1261, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.64% (0.0602 => 0.0556, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (0.0260 => 0.0256, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7646 => 0.7658, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.05% (1.5979 => 1.5987, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.08% (4.1772 => 3.0878, std.dev.: 0.0478) SingleSource/Benchmarks/Shootout-C++/except: 82183.33% (0.0006 => 0.4937, std.dev.: 0.0013) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.81% (0.0745 => 0.0900, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.34% (0.1414 => 0.1546, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 9.08% (2.1763 => 2.3740, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 7.80% (0.5309 => 0.5723, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.60% (0.6410 => 0.6897, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 7.17% (1.1653 => 1.2488, std.dev.: 0.0103) MultiSource/Applications/lemon/lemon: 6.78% (1.0046 => 1.0727, std.dev.: 0.0227) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.6915 => 0.7370, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: 6.32% (0.6173 => 0.6563, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.3582 => 0.3808, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.07% (15.3105 => 16.2404, std.dev.: 0.2523) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6069 => 0.6378, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.90% (0.3901 => 0.4092, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.5150 => 1.5891, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.84% (0.7639 => 0.8009, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 4.61% (29.3170 => 30.6676, std.dev.: 0.2132) MultiSource/Benchmarks/McCat/18-imp/imp: 4.54% (0.3217 => 0.3363, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 4.52% (3.0225 => 3.1591, std.dev.: 0.0221) MultiSource/Applications/hbd/hbd: 4.44% (1.3268 => 1.3857, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.28% (0.4880 => 0.5089, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.2797 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.2952 => 0.3073, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.06% (1.1440 => 1.1905, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.05% (1.1672 => 1.2145, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (12.6413 => 13.1407, std.dev.: 0.0650) MultiSource/Applications/SPASS/SPASS: 3.91% (13.3238 => 13.8452, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.81% (0.4248 => 0.4410, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 3.66% (2.0972 => 2.1740, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 3.51% (4.7455 => 4.9122, std.dev.: 0.0289) MultiSource/Applications/ClamAV/clamscan: 3.46% (14.6079 => 15.1138, std.dev.: 0.1457) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.39% (0.7722 => 0.7984, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 3.24% (6.4908 => 6.7010, std.dev.: 0.0291) MultiSource/Applications/lua/lua: 3.06% (3.5980 => 3.7081, std.dev.: 0.0333) MultiSource/Applications/treecc/treecc: 3.04% (1.8798 => 1.9369, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 2.96% (14.7256 => 15.1615, std.dev.: 0.0965) MultiSource/Benchmarks/mafft/pairlocalalign: 2.94% (8.2186 => 8.4606, std.dev.: 0.0252) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.0758 => 3.1616, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.74% (1.2021 => 1.2350, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.0689 => 1.0979, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.4408 => 1.4794, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (1.4113 => 1.4489, std.dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.0821 => 1.1107, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (6.2546 => 6.4115, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.39% (4.0318 => 4.1282, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.3935 => 1.4249, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.0317 => 2.0774, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Bubblesort: 38.40% (0.0263 => 0.0364, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.67% (0.0917 => 0.1079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9981, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5461, std.dev.: 0.0212) SingleSource/Benchmarks/McGill/queens: 10.77% (1.6261 => 1.8012, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Puzzle: 9.98% (0.1433 => 0.1576, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.58% (1.0063 => 1.1027, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.47% (7.0025 => 7.5955, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.64% (40.4792 => 42.7631, std.dev.: 0.4313) SingleSource/Benchmarks/Misc/fp-convert: 4.76% (15.2242 => 15.9490, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/dt: 4.17% (0.9851 => 1.0262, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.62% (0.8498 => 0.8806, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.28% (0.5587 => 0.5770, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.15% (0.5876 => 0.6061, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (4.2129 => 4.3422, std.dev.: 0.0432) MultiSource/Applications/hexxagon/hexxagon: 2.95% (14.4877 => 14.9156, std.dev.: 0.0450) MultiSource/Benchmarks/FreeBench/mason/mason: 2.80% (0.5004 => 0.5144, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 2.64% (3.8907 => 3.9934, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 2.57% (3.5520 => 3.6433, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 2.27% (0.6308 => 0.6451, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (6.6312 => 6.7779, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: 1.98% (2.4013 => 2.4488, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.50% (1.4021 => 1.4232, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (4.6414 => 4.6884, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.26% (5.2665 => 4.1466, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/ary3: -20.04% (1.7473 => 1.3972, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.45% (1.1647 => 0.9615, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.77% (15.8312 => 13.1756, std.dev.: 0.0951) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.85% (3.2007 => 2.9495, std.dev.: 0.0159) MultiSource/Applications/lambda-0_1_3/lambda: -7.02% (7.6833 => 7.1439, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.75% (3.6254 => 3.3807, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3324, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8729, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3523, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.91% (2.9728 => 2.7970, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: -5.91% (3.4230 => 3.2206, std.dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (62.4126 => 58.9093, std.dev.: 0.0836) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7256, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -4.90% (4.4195 => 4.2030, std.dev.: 0.0403) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.59% (0.3746 => 0.3574, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -4.25% (2.5166 => 2.4096, std.dev.: 0.0094) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.40% (1.2722 => 1.2290, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (9.2503 => 8.9365, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.31% (3.6023 => 3.4831, std.dev.: 0.0363) SingleSource/Benchmarks/McGill/misr: -2.91% (0.4296 => 0.4171, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2873, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -2.66% (29.5232 => 28.7371, std.dev.: 0.1589) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.48% (45.4683 => 44.3402, std.dev.: 0.3911) SingleSource/Benchmarks/Misc/ffbench: -2.33% (1.4117 => 1.3788, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4188, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.94% (1.1683 => 1.1456, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (92.7467 => 91.0038, std.dev.: 0.2685) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3128, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (9.3855 => 9.2179, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.77% (3.7496 => 3.6833, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (0.6119 => 0.6018, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3209, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8165, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4645, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.25% (0.9980 => 1.0205, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.66% (0.6022 => 0.6182, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 1.86% (0.1666 => 0.1697, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.57% (0.1554 => 0.1594, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.40% (0.3083 => 0.3157, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.2394 => 0.2388, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.07% (0.3175 => 0.3209, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2302 => 0.2312, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0449 => 0.0452, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.83% (0.0240 => 0.0226, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.60% (0.0192 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 2.77% (0.0325 => 0.0334, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -0.18% (1.5019 => 1.4992, std.dev.: 0.0367) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.33% (0.1501 => 0.1521, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.67% (0.4264 => 0.4193, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.61% (0.1344 => 0.1406, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.0589 => 0.0625, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.81% (0.0232 => 0.0271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.16% (0.0639 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.78% (1.1350 => 1.1261, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 233.33% (0.0006 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.72% (0.0637 => 0.0556, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (0.0246 => 0.0256, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.06% (1.5363 => 1.5987, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 00:09:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 02:09:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120930070903.18AF62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4407?compare_to=4404&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4407, Order: 164908, Start Time: 2012-09-30 03:58:15, End Time: 2012-09-30 07:10:35 To: 4404, Order: 164900, Start Time: 2012-09-30 00:19:58, End Time: 2012-09-30 03:28:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 3 (0 on baseline) Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1035 (772 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.41% (0.0992 => 0.1006, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.11% (0.0995 => 0.1006, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 16139100.00% (0.0001 => 16.1392, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.58% (2.4535 => 2.5168, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (9.8108 => 9.8128, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.04% (9.4096 => 9.4132, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 16958500.00% (0.0001 => 16.9586, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3465 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.46% (0.3446 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.45% (0.3442 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.41% (0.3496 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.41% (0.3488 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.36% (0.3460 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.27% (0.3469 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.06% (0.3643 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.43% (1.5932 => 1.7594, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5826 => 0.6286, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.85% (0.5889 => 0.6351, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.47% (0.1619 => 0.1740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2738 => 0.2934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.99% (0.4361 => 0.4666, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.97% (1.3152 => 1.4069, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.94% (1.6211 => 1.7336, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.89% (0.4994 => 0.5338, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2875 => 0.3068, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (3.5627 => 3.8012, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 6.58% (5.5417 => 5.9063, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 6.55% (0.2750 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2714 => 0.2891, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.52% (1.0781 => 1.1484, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.50% (0.5000 => 0.5325, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.49% (0.3004 => 0.3199, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3195 => 0.3402, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.40% (0.7171 => 0.7630, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.37% (0.3267 => 0.3475, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2803 => 0.2981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.34% (0.2823 => 0.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2813 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2729 => 0.2901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2792 => 0.2967, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.2014 => 0.2140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.22% (0.4146 => 0.4404, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (2.7292 => 2.8980, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.3258 => 0.3459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.17% (0.3096 => 0.3287, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.16% (4.2109 => 4.4704, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 6.14% (0.9909 => 1.0517, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (0.5026 => 0.5334, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 6.12% (0.2780 => 0.2950, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.04% (0.6634 => 0.7035, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.04% (0.2566 => 0.2721, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2811 => 0.2980, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.5900 => 0.6253, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3625 => 0.3841, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.91% (0.3317 => 0.3513, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.85% (0.3348 => 0.3544, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.85% (0.3678 => 0.3893, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.2736 => 0.2895, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3477 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.74% (0.2040 => 0.2157, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.72% (4.4195 => 4.6721, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.69% (0.3690 => 0.3900, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.3845 => 0.4063, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.66% (0.3726 => 0.3937, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.62% (4.6177 => 4.8772, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (2.1653 => 2.2859, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.2068 => 0.2183, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.51% (0.4139 => 0.4367, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4251 => 0.4484, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.43% (0.3903 => 0.4115, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (0.3890 => 0.4101, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.40% (1.8794 => 1.9808, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 5.39% (0.4029 => 0.4246, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.31% (1.4269 => 1.5027, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (0.4658 => 0.4900, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.19% (0.6435 => 0.6769, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.3981 => 0.4186, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.14% (0.5546 => 0.5831, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.3084 => 0.3241, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 5.01% (0.5012 => 0.5263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.97% (0.2737 => 0.2873, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.92% (0.3336 => 0.3500, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (0.2075 => 0.2176, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.3271 => 0.3429, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.69% (1.9694 => 2.0617, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 4.63% (2.0346 => 2.1288, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.62% (0.7875 => 0.8239, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (1.9966 => 2.0875, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.2969 => 0.3103, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.35% (0.2391 => 0.2495, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.24% (0.7426 => 0.7741, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 4.05% (0.9697 => 1.0090, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.95% (0.5361 => 0.5573, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.78% (0.5584 => 0.5795, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.6926 => 4.8443, std.dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.3498 => 0.3610, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.75% (11.9555 => 12.1645, std.dev.: 0.0143) SingleSource/UnitTests/Vector/constpool: 1.63% (2.4764 => 2.5168, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6713, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std.dev.: 0.1425) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6287, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1980, std.dev.: 0.0064) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5865, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5456, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary2: -9.49% (0.2402 => 0.2174, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7864, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8005, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7640, std.dev.: 0.0410) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5740, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0450, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 01:27:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 03:27:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930082713.1ABF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4408?compare_to=4403&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4408, Order: 164910, Start Time: 2012-09-30 07:08:10, End Time: 2012-09-30 08:28:49 To: 4403, Order: 164908, Start Time: 2012-09-30 02:03:08, End Time: 2012-09-30 03:23:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 6 (79 on baseline) Performance Regressions: 4 (149 on baseline) Performance Improvements: 4 (33 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (19 on baseline) Unchanged Tests: 936 (700 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Applications/JM/lencod/lencod: -99.99% (10.3200 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 0.44% (1.4519 => 1.4583, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -17.73% (4.6166 => 3.7983, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.09% (4.4088 => 4.4129, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/power/power: -99.89% (1.1091 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0037 => 0.0037, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.92% (14.5827 => 15.4467, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.8700 => 0.8856, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (8.4071 => 8.4942, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.86% (12.2532 => 12.4815, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.68% (3.2177 => 3.0670, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.08% (1.2158 => 1.1905, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.18% (27.9929 => 27.6624, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.13% (1.5964 => 1.5784, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.87% (0.5744 => 0.5794, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.53% (15.9667 => 16.0508, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 0.02% (14.9435 => 14.9461, std.dev.: 0.0247) MultiSource/Benchmarks/Bullet/bullet: 0.47% (83.0211 => 83.4143, std.dev.: 0.0799) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.3537 => 4.3521, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.44% (0.0459 => 0.0461) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0427 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (0.0435 => 0.0459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0414 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0404 => 0.0404, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0405 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0403 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0404 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.29% (1.2294 => 1.2330, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.5162 => 7.5283, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.34% (3.7054 => 3.7181, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.28% (0.6461 => 0.6479, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.28% (0.1433 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (0.0647 => 0.0673, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.89% (63.2438 => 83.4143, std.dev.: 0.0799) New Failures - Execution Time ----------------------------- MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Applications/lemon/lemon: 0.85% (1.4460 => 1.4583, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -18.21% (4.6441 => 3.7983, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.56% (4.3882 => 4.4129, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -99.89% (1.1277 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0037 => 0.0037, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.99% (10.3673 => 15.4467, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 31.44% (0.1622 => 0.2132, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.61% (7.0540 => 8.0846, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/flops: 14.46% (0.1432 => 0.1639, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.39% (2.2022 => 2.5190, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.11% (1.1194 => 1.2661, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.09% (0.1566 => 0.1771, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (1.7609 => 1.9698, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.49% (0.1584 => 0.1766, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3543 => 0.3949, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 11.40% (0.3561 => 0.3967, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 9.72% (0.3282 => 0.3601, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.43% (0.1655 => 0.1811, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.96% (0.4879 => 0.5316, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 8.96% (10.4361 => 11.3708, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.86% (0.1625 => 0.1769, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.37% (0.8172 => 0.8856, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3307 => 0.3580, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.3177 => 0.3438, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 7.86% (9.4845 => 10.2300, std.dev.: 0.0228) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7433 => 0.7992, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 7.52% (0.7115 => 0.7650, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6675 => 0.7174, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.41% (5.7591 => 6.1861, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.37% (0.5105 => 0.5481, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 7.33% (0.7835 => 0.8409, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 7.20% (0.2554 => 0.2738, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 7.15% (3.3354 => 3.5739, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.15% (1.5415 => 1.6517, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 7.11% (0.3109 => 0.3330, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 7.01% (0.3423 => 0.3663, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3959, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.89% (0.5860 => 0.6264, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.87% (0.8067 => 0.8621, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.86% (0.1940 => 0.2073, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (4.2646 => 4.5560, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (8.1363 => 8.6872, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.75% (0.5569 => 0.5945, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.74% (4.9449 => 5.2783, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.71% (5.0018 => 5.3376, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.69% (7.9617 => 8.4942, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.67% (0.2758 => 0.2942, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.64% (0.2756 => 0.2939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4636 => 0.4935, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.44% (0.3121 => 0.3322, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.4103 => 0.4366, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.25% (0.4064 => 0.4318, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4289 => 0.4557, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 6.24% (1.1642 => 1.2368, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 6.21% (0.3092 => 0.3284, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.13% (0.3865 => 0.4102, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.08% (0.9765 => 1.0359, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4620 => 0.4901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.08% (0.2831 => 0.3003, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.05% (0.3650 => 0.3871, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.5020 => 0.5323, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.02% (0.4203 => 0.4456, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.1861 => 1.2574, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 6.01% (0.6456 => 0.6844, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.99% (0.3387 => 0.3590, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (2.0665 => 2.1903, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.99% (0.3441 => 0.3647, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 5.98% (0.3379 => 0.3581, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.94% (0.3098 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.91% (0.3162 => 0.3349, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.91% (1.5603 => 1.6525, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 5.88% (0.3283 => 0.3476, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.83% (0.3603 => 0.3813, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.83% (3.8723 => 4.0979, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2802 => 0.2964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.78% (0.4048 => 0.4282, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.75% (1.0722 => 1.1338, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.67% (2.0273 => 2.1423, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.67% (0.3935 => 0.4158, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.63% (0.3180 => 0.3359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3684 => 0.3889, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.52% (21.9371 => 23.1480, std.dev.: 0.0289) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.22% (2.2969 => 2.4167, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.21% (0.6450 => 0.6786, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.98% (0.8921 => 0.9365, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5981 => 0.6273, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.65% (1.4186 => 1.4846, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.55% (1.5859 => 1.6581, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.32% (14.3668 => 14.9872, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.26% (1.1840 => 1.2344, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 4.23% (1.2842 => 1.3385, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.00% (2.2024 => 2.2905, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3817 => 0.3961, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.68% (0.8101 => 0.8399, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5461, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (3.8922 => 3.9632, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (3.1578 => 3.3854, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.11% (2.8904 => 3.0670, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 4.47% (1.1396 => 1.1905, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7674, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.15% (4.2280 => 4.3612, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2403, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 1.27% (11.6436 => 11.7916, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2644, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.55% (5.3855 => 3.9020, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.01% (5.3526 => 3.9071, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1242, std.dev.: 1.1249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.95% (2.9384 => 2.6165, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -7.65% (22.1758 => 20.4802, std.dev.: 0.0448) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.24% (1.6925 => 1.4177, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -11.93% (1.2373 => 1.0897, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3071, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (1.8329 => 1.7121, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.54% (1.9577 => 1.8493, std.dev.: 0.0135) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.23% (3.2827 => 3.1767, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4986, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5085, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1021, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0163, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.81% (0.5229 => 0.5794, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 7.08% (14.9895 => 16.0508, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 5.59% (14.1553 => 14.9461, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/gs/gs: 5.88% (4.1105 => 4.3521, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.60% (1.1048 => 1.2330, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.17% (7.1582 => 7.5283, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.37% (3.4629 => 3.7181, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.6222 => 0.6479, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: -98.06% (0.0720 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.19% (0.2116 => 0.0673, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 01:32:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 03:32:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930083250.B7D622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4409?compare_to=4405&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4409, Order: 164910, Start Time: 2012-09-30 07:08:07, End Time: 2012-09-30 08:34:27 To: 4405, Order: 164908, Start Time: 2012-09-30 02:30:36, End Time: 2012-09-30 03:56:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 8 (11 on baseline) Performance Regressions: 2 (177 on baseline) Performance Improvements: 3 (30 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1026 (689 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Applications/ClamAV/clamscan: -99.81% (0.1570 => 0.0003) MultiSource/Applications/JM/lencod/lencod: -99.98% (7.5698 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 0.80% (1.4512 => 1.4628, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -17.83% (4.5709 => 3.7559, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.20% (4.3956 => 4.4045, std.dev.: 0.0303) MultiSource/Benchmarks/Bullet/bullet: -97.65% (7.2273 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -99.92% (1.4833 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0033 => 0.0033, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 29.57% (0.3930 => 0.5092, std.dev.: 0.0380) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 2.05% (12.2222 => 12.4733, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.93% (3.1919 => 3.0346, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -1.90% (1.2549 => 1.2311, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.34% (1.5952 => 1.5739, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7523 => 2.7524, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1154 => 2.1155, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.07% (4.9745 => 4.9710, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Applications/ClamAV/clamscan: -99.80% (0.1519 => 0.0003) MultiSource/Applications/JM/lencod/lencod: -99.98% (7.6086 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.31% (1.4298 => 1.4628, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -18.22% (4.5928 => 3.7559, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.04% (4.4062 => 4.4045, std.dev.: 0.0303) MultiSource/Benchmarks/Bullet/bullet: -97.69% (7.3305 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -99.92% (1.4728 => 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (0.0035 => 0.0033, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.04% (2.0176 => 2.4422, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.11% (0.0834 => 0.0935, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0230) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.00% (0.1327 => 0.1473, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 10.93% (0.5818 => 0.6454, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash2: 10.81% (0.4328 => 0.4796, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.73% (0.5748 => 0.6365, std.dev.: 0.0123) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.50% (3.9660 => 4.3826, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (0.7038 => 0.7766, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.32% (0.2596 => 0.2864, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.31% (0.7710 => 0.8505, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 10.28% (1.3693 => 1.5100, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.26% (0.5265 => 0.5805, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.24% (0.1435 => 0.1582, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (0.4390 => 0.4837, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 10.04% (0.4062 => 0.4470, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.98% (0.3899 => 0.4288, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.88% (1.2193 => 1.3398, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.80% (0.6959 => 0.7641, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.79% (0.3022 => 0.3318, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.79% (1.4563 => 1.5988, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.3580 => 0.3930, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.66% (0.3489 => 0.3826, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.65% (0.9199 => 1.0087, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.6283 => 0.6886, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.56% (0.3485 => 0.3818, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.47% (0.2966 => 0.3247, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.46% (1.9828 => 2.1704, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2761 => 0.3022, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.45% (13.8202 => 15.1264, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.39% (1.1364 => 1.2431, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/except: 9.38% (0.2760 => 0.3019, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.35% (0.2726 => 0.2981, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.29% (0.2765 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.29% (0.3756 => 0.4105, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4016 => 0.4388, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 9.20% (0.3293 => 0.3596, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.16% (0.4791 => 0.5230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.08% (0.3149 => 0.3435, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.06% (0.5577 => 0.6082, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.05% (0.2995 => 0.3266, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.05% (1.0313 => 1.1246, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 9.04% (0.3107 => 0.3388, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.01% (0.2696 => 0.2939, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1478 => 0.1611, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.97% (0.3868 => 0.4215, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.90% (0.2988 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.87% (0.3246 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.80% (0.3192 => 0.3473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.75% (0.3453 => 0.3755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3534 => 0.3835, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.33% (1.1061 => 1.1982, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.29% (0.4379 => 0.4742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.23% (0.8310 => 0.8994, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 8.21% (3.8646 => 4.1820, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1276 => 0.1380, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.11% (3.6692 => 3.9667, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.02% (7.2180 => 7.7966, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 7.99% (16.6129 => 17.9402, std.dev.: 0.0261) MultiSource/Applications/spiff/spiff: 7.95% (0.7506 => 0.8103, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 7.93% (0.6744 => 0.7279, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.93% (0.5637 => 0.6084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.89% (0.3650 => 0.3938, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.7460 => 0.8044, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3220 => 0.3472, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 7.81% (2.1791 => 2.3492, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.80% (0.3755 => 0.4048, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 7.80% (3.1889 => 3.4375, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.72% (1.0594 => 1.1412, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1865 => 0.2009, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 7.66% (0.2925 => 0.3149, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.65% (0.8698 => 0.9363, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.56% (0.3663 => 0.3940, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.56% (0.6576 => 0.7073, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 7.51% (0.3914 => 0.4208, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 7.49% (1.9270 => 2.0714, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.44% (1.3245 => 1.4231, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-3: 7.26% (0.3623 => 0.3886, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 7.16% (14.8535 => 15.9171, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 7.14% (1.2749 => 1.3659, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.90% (8.4961 => 9.0821, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.84% (0.3245 => 0.3467, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.81% (0.6135 => 0.6553, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.81% (4.3801 => 4.6785, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.79% (1.3819 => 1.4758, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.3813 => 1.4750, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.74% (4.4433 => 4.7430, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.2859 => 0.3051, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.68% (1.1333 => 1.2090, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.68% (4.6629 => 4.9743, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.59% (0.8818 => 0.9399, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.49% (13.2842 => 14.1458, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 6.44% (1.2292 => 1.3084, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 6.35% (14.5298 => 15.4520, std.dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 6.33% (6.5754 => 6.9916, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.18% (0.3511 => 0.3728, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.93% (3.2742 => 3.4684, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 5.92% (0.6250 => 0.6620, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.81% (0.4805 => 0.5084, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.71% (4.9865 => 5.2712, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.25% (1.5188 => 1.5985, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.19% (3.7467 => 3.9411, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.16% (0.9108 => 0.9578, std.dev.: 0.0126) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.99% (6.2785 => 6.5917, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.87% (2.1007 => 2.2030, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.44% (33.2944 => 34.7724, std.dev.: 0.0260) MultiSource/Applications/sqlite3/sqlite3: 3.07% (16.2614 => 16.7602, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2581, std.dev.: 0.0424) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/richards_benchmark: 6.50% (1.1560 => 1.2311, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.32% (2.8813 => 3.0346, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.70% (2.8606 => 2.9951, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.2619 => 11.7229, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.79% (10.7476 => 11.1546, std.dev.: 0.0415) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.15% (12.0921 => 12.4733, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5820, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5853, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.20% (8.8259 => 8.9321, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5952, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.70% (0.4657 => 0.3926, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.38% (22.5627 => 22.0263, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -11.85% (1.2308 => 1.0849, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2858, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.36% (1.3780 => 1.2903, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std.dev.: 0.0197) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0163) MultiSource/Applications/siod/siod: -3.42% (3.2729 => 3.1611, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: -2.82% (3.0263 => 2.9409, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.44% (1.9762 => 1.9280, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.97% (0.6615 => 0.6485, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2377, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: -1.83% (5.3167 => 5.2195, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2099, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8989, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 01:36:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 03:36:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930083615.90FEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4410?compare_to=4406&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4410, Order: 164910, Start Time: 2012-09-30 06:51:45, End Time: 2012-09-30 08:37:54 To: 4406, Order: 164908, Start Time: 2012-09-30 03:16:10, End Time: 2012-09-30 04:38:38 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 25 (25 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 12 (63 on baseline) Performance Improvements: 11 (41 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 925 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: -2.61% (15.1138 => 14.7189, std.dev.: 0.1640) MultiSource/Applications/kimwitu++/kc: -0.35% (16.2404 => 16.1828, std.dev.: 0.0815) MultiSource/Applications/lua/lua: 0.05% (3.7081 => 3.7101, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -0.98% (2.1740 => 2.1527, std.dev.: 0.0242) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -15.25% (0.0800 => 0.0678, std.dev.: 0.0031) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: 2988.69% (0.0654 => 2.0200, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -99.99% (6.6162 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0528 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -100.00% (28.7371 => 0.0001) MultiSource/Applications/minisat/minisat: 109.11% (6.2483 => 13.0658, std.dev.: 0.3106) MultiSource/Applications/siod/siod: -100.00% (3.6433 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.45% (2.4246 => 0.0133, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -91.87% (6.9484 => 0.5647, std.dev.: 0.0454) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.47% (0.1767 => 0.1688, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -98.01% (0.3414 => 0.0068) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -90.13% (0.0395 => 0.0039, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -99.87% (1.4392 => 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.14% (0.0963 => 0.0692, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 124858975.00% (0.0004 => 499.4363, std.dev.: 0.0435) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -87.50% (0.0040 => 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (2.7970 => 2.7474, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -78.34% (1.3523 => 0.2929, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 6.68% (8.9365 => 9.5339, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.16% (0.8252 => 0.8513, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.85% (0.8498 => 0.8740, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (0.8737 => 0.8912, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.55% (0.9005 => 0.9145, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.44% (0.8934 => 0.9063, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (8.4606 => 8.5621, std.dev.: 0.0318) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 49.04% (0.0208 => 0.0310, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 7.75% (3.2206 => 3.4703, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.32% (21.2078 => 22.3367, std.dev.: 0.1654) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 5.23% (1.8729 => 1.9709, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.06% (13.1756 => 13.4468, std.dev.: 0.1040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.63% (3.4950 => 3.5520, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.94% (0.4667 => 0.4483, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: -3.19% (0.7772 => 0.7524, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (0.7370 => 0.7254, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.27% (1.4489 => 1.4305, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: -1.23% (1.1905 => 1.1758, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: -1.19% (1.9369 => 1.9138, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -39.77% (0.0264 => 0.0159, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -11.17% (8.5318 => 7.5790, std.dev.: 0.0726) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.39% (1.4232 => 1.3038, std.dev.: 0.0445) SingleSource/Benchmarks/Dhrystone/dry: -4.14% (2.4488 => 2.3473, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -2.76% (14.9156 => 14.5038, std.dev.: 0.0440) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.37% (1.0205 => 1.0167, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -0.74% (0.6182 => 0.6136, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -2.77% (0.1697 => 0.1650, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.20% (0.1594 => 0.1559, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.98% (0.3157 => 0.3063, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.21% (0.2388 => 0.2383, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.69% (0.3209 => 0.3231, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2312 => 0.2327, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -7.08% (0.0452 => 0.0420, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: -4.49% (0.0089 => 0.0085, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -4.44% (0.0090 => 0.0086, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.64% (0.0226 => 0.0241, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.05% (0.0197 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.61% (0.0392 => 0.0370, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.99% (0.0303 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.74% (0.0287 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0325 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -21.43% (0.0182 => 0.0143, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: -1.03% (0.0195 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.79% (0.0253 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -2.69% (0.0334 => 0.0325, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1458 => 0.0001) MultiSource/Applications/lemon/lemon: -99.39% (1.4992 => 0.0091, std.dev.: 0.0001) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 7.56% (0.1521 => 0.1636, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -99.98% (0.4193 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.36% (0.1406 => 0.1401, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.64% (0.0625 => 0.0546, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.39% (0.0271 => 0.0232, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.47% (0.0640 => 0.0573, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1261 => 1.1192, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.00% (0.0020 => 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.88% (0.0556 => 0.0572, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.50% (0.0256 => 0.0224, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.11% (0.7658 => 0.7573, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.44% (1.5987 => 1.5917, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: 0.76% (14.6079 => 14.7189, std.dev.: 0.1640) MultiSource/Applications/kimwitu++/kc: 5.70% (15.3105 => 16.1828, std.dev.: 0.0815) MultiSource/Applications/lua/lua: 3.12% (3.5980 => 3.7101, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.65% (2.0972 => 2.1527, std.dev.: 0.0242) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.18% (0.0790 => 0.0678, std.dev.: 0.0031) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: 2946.76% (0.0663 => 2.0200, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -99.99% (6.7458 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0500 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -100.00% (29.5232 => 0.0001) MultiSource/Applications/minisat/minisat: 109.91% (6.2244 => 13.0658, std.dev.: 0.3106) MultiSource/Applications/siod/siod: -100.00% (3.5520 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.45% (2.4042 => 0.0133, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -91.90% (6.9722 => 0.5647, std.dev.: 0.0454) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.16% (0.1743 => 0.1688, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -97.94% (0.3301 => 0.0068) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -90.99% (0.0433 => 0.0039, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -99.87% (1.4184 => 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -26.93% (0.0947 => 0.0692, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 62429437.50% (0.0008 => 499.4363, std.dev.: 0.0435) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -87.50% (0.0040 => 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -7.58% (2.9728 => 2.7474, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -79.72% (1.4441 => 0.2929, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 3.07% (9.2503 => 9.5339, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: - (0.0031 => 0.0031, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.58% (4.1772 => 3.0669, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0150) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 9.41% (2.1763 => 2.3811, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.91% (0.6410 => 0.6981, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 8.04% (0.5309 => 0.5736, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.48% (0.3582 => 0.3850, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.00% (0.6173 => 0.6605, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 6.52% (1.0046 => 1.0701, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.23% (0.2552 => 0.2711, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (1.1653 => 1.2372, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.34% (0.6069 => 0.6393, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 4.99% (29.3170 => 30.7794, std.dev.: 0.1188) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (12.6413 => 13.2689, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.7639 => 0.8018, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.6915 => 0.7254, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.59% (0.4880 => 0.5104, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.54% (1.5150 => 1.5838, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.31% (0.3901 => 0.4069, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.18% (8.2186 => 8.5621, std.dev.: 0.0318) MultiSource/Applications/d/make_dparser: 4.13% (3.0225 => 3.1473, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.2952 => 0.3073, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.07% (0.2996 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.88% (0.4248 => 0.4413, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.40% (0.3062 => 0.3166, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.32% (1.2021 => 1.2420, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 3.30% (13.3238 => 13.7637, std.dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.3520 => 0.3634, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.22% (4.7455 => 4.8985, std.dev.: 0.0309) MultiSource/Applications/hbd/hbd: 3.20% (1.3268 => 1.3693, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (4.0318 => 4.1577, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.0689 => 1.0987, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: 2.78% (1.1440 => 1.1758, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.7256 => 15.1174, std.dev.: 0.0851) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.0758 => 3.1558, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (1.3935 => 1.4243, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.7784 => 0.7951, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.0317 => 2.0698, std.dev.: 0.0139) MultiSource/Applications/treecc/treecc: 1.81% (1.8798 => 1.9138, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.44% (4.3380 => 4.4005, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.4113 => 1.4305, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 56.70% (0.0261 => 0.0409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.49% (0.0766 => 0.0900, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.07% (4.0101 => 4.5743, std.dev.: 0.0114) SingleSource/Benchmarks/Stanford/Puzzle: 13.75% (0.1433 => 0.1630, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.73% (1.0063 => 1.0942, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout/lists: 8.36% (7.0025 => 7.5881, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8506, std.dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 3.86% (0.3420 => 0.3552, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (40.4792 => 41.9688, std.dev.: 0.5569) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.63% (0.5587 => 0.5790, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 2.78% (3.8907 => 3.9990, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.17% (4.6127 => 4.7126, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.16% (6.6312 => 6.7742, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (3.4230 => 3.4703, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.77% (0.7738 => 0.7524, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.46% (0.4596 => 0.4483, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.52% (0.3497 => 0.2045, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.64% (5.2665 => 4.1270, std.dev.: 0.2312) SingleSource/Benchmarks/Shootout-C++/ary3: -20.70% (1.7473 => 1.3856, std.dev.: 0.0369) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.56% (1.1647 => 0.9602, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.06% (15.8312 => 13.4468, std.dev.: 0.1040) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1569, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.78% (0.0917 => 0.0809, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: -10.95% (8.5113 => 7.5790, std.dev.: 0.0726) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.77% (3.2007 => 2.9200, std.dev.: 0.0219) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -7.08% (7.6833 => 7.1392, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3753, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3313, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0327) MultiSource/Benchmarks/mafft/pairlocalalign: -5.43% (62.4126 => 59.0228, std.dev.: 0.0696) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1879, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -4.06% (0.3746 => 0.3594, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -3.89% (0.4296 => 0.4129, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.77% (1.2959 => 1.2471, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/bh/bh: -3.73% (2.5166 => 2.4227, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.64% (2.4457 => 2.3567, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.12% (3.7496 => 3.6326, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2850, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.66% (1.1683 => 1.1372, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -2.25% (2.4013 => 2.3473, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.09% (45.4683 => 44.5180, std.dev.: 0.2133) MultiSource/Applications/aha/aha: -1.99% (3.4286 => 3.3602, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: -1.92% (92.7467 => 90.9645, std.dev.: 0.2872) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4207, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.76% (2.3569 => 2.3155, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.59% (2.0027 => 1.9709, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3098, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: -1.39% (2.4971 => 2.4625, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.38% (9.3855 => 9.2561, std.dev.: 0.0281) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.32% (27.1724 => 26.8125, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/lists: -1.32% (16.5617 => 16.3427, std.dev.: 0.0641) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.87% (0.9980 => 1.0167, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.89% (0.6022 => 0.6136, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -0.96% (0.1666 => 0.1650, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.32% (0.1554 => 0.1559, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.65% (0.3083 => 0.3063, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.46% (0.2394 => 0.2383, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.76% (0.3175 => 0.3231, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2302 => 0.2327, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -6.46% (0.0449 => 0.0420, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: -4.49% (0.0089 => 0.0085, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: -4.44% (0.0090 => 0.0086, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.13% (0.0390 => 0.0370, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -19.21% (0.0177 => 0.0143, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -99.93% (0.1429 => 0.0001) MultiSource/Applications/lemon/lemon: -99.39% (1.5019 => 0.0091, std.dev.: 0.0001) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 8.99% (0.1501 => 0.1636, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -99.98% (0.4264 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.24% (0.1344 => 0.1401, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.30% (0.0589 => 0.0546, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.33% (0.0639 => 0.0573, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.39% (1.1350 => 1.1192, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.20% (0.0637 => 0.0572, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.94% (0.0246 => 0.0224, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7541 => 0.7573, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.61% (1.5363 => 1.5917, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 03:15:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 05:15:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930101516.B625F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4411?compare_to=4410&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4411, Order: 164912, Start Time: 2012-09-30 08:53:57, End Time: 2012-09-30 10:16:54 To: 4410, Order: 164910, Start Time: 2012-09-30 06:51:45, End Time: 2012-09-30 08:37:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 25 (10 on baseline) Performance Regressions: 20 (92 on baseline) Performance Improvements: 10 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 918 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/siod/siod MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Applications/ClamAV/clamscan: 2.25% (14.7189 => 15.0494, std.dev.: 0.1015) MultiSource/Applications/kimwitu++/kc: 0.20% (16.1828 => 16.2154, std.dev.: 0.2366) MultiSource/Applications/lua/lua: 0.33% (3.7101 => 3.7222, std.dev.: 0.0212) MultiSource/Applications/siod/siod: 0.96% (2.1527 => 2.1734, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.81% (0.0678 => 0.0792, std.dev.: 0.0040) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/siod/siod MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Stanford/Oscar MultiSource/Applications/JM/ldecod/ldecod: -96.84% (2.0200 => 0.0638, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1317260.00% (0.0005 => 6.5868, std.dev.: 0.0318) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0444, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 28735600.00% (0.0001 => 28.7357, std.dev.: 0.3223) MultiSource/Applications/minisat/minisat: -52.64% (13.0658 => 6.1886, std.dev.: 0.1345) MultiSource/Applications/siod/siod: - (0.0000 => 3.6293, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18234.59% (0.0133 => 2.4385, std.dev.: 0.0165) MultiSource/Benchmarks/Bullet/bullet: 1123.76% (0.5647 => 6.9106, std.dev.: 0.1409) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.74% (0.1688 => 0.1768, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4935.29% (0.0068 => 0.3424, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 1012.82% (0.0039 => 0.0434, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 75652.63% (0.0019 => 1.4393, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 36.56% (0.0692 => 0.0945, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -100.00% (499.4363 => 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0005 => 0.0005, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.67% (2.7474 => 2.7932, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 361.93% (0.2929 => 1.3530, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -5.90% (9.5339 => 8.9715, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/objinst: 500.00% (0.0001 => 0.0006, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: - (0.0031 => 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 7.00% (0.2928 => 0.3133, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.09% (0.1791 => 0.1900, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.77% (0.3249 => 0.3404, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2408 => 0.2518, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.45% (0.5645 => 0.5840, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.8967 => 0.9232, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 2.84% (0.7524 => 0.7738, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.50% (0.5998 => 0.6148, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.5947 => 0.6084, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8536 => 0.8721, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (3.9567 => 4.0151, std.dev.: 0.0177) MultiSource/Applications/treecc/treecc: 1.14% (1.9138 => 1.9357, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.05% (1.2202 => 1.2330, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 12.57% (7.5790 => 8.5318, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: 4.34% (2.3473 => 2.4491, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.68% (14.5038 => 14.8925, std.dev.: 0.0757) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.60% (0.7723 => 0.7924, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 2.35% (1.3712 => 1.4034, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.70% (2.3567 => 2.3967, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.42% (2.7025 => 2.7410, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.35% (0.8199 => 0.8006, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.33% (0.8740 => 0.8536, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.98% (0.9145 => 0.8964, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -13.98% (3.7707 => 3.2434, std.dev.: 0.0949) MultiSource/Applications/SIBsim4/SIBsim4: -7.43% (3.4703 => 3.2124, std.dev.: 0.0626) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.97% (1.9709 => 1.8729, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.59% (3.5520 => 3.4956, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.49% (39.5672 => 38.9761, std.dev.: 0.1879) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.19% (1.4373 => 1.4202, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/five11/five11: -1.02% (5.2624 => 5.2086, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.09% (1.0167 => 1.0278, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.16% (0.6136 => 0.6207, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 1.88% (0.1650 => 0.1681, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.32% (0.1559 => 0.1564, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.79% (0.3063 => 0.3179, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.43% (0.2383 => 0.2349, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.34% (0.3231 => 0.3242, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.86% (0.2327 => 0.2347, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 9.05% (0.0420 => 0.0458, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -54.12% (0.0085 => 0.0039, std.dev.: 0.0024) SingleSource/UnitTests/2003-08-11-VaListArg: -66.28% (0.0086 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.66% (0.0241 => 0.0245, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.57% (0.0191 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.41% (0.0370 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.33% (0.0300 => 0.0257, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0282 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.55% (0.0322 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 26.57% (0.0143 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -25.39% (0.0193 => 0.0144, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -2.79% (0.0251 => 0.0244, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 20.00% (0.0005 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 144200.00% (0.0001 => 0.1443, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 16318.68% (0.0091 => 1.4941, std.dev.: 0.0352) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -8.01% (0.1636 => 0.1505, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 394400.00% (0.0001 => 0.3945, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.64% (0.1401 => 0.1392, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.40% (0.0546 => 0.0570, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.91% (0.0232 => 0.0209, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.09% (0.0573 => 0.0561, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.76% (1.1192 => 1.1277, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.20% (0.0572 => 0.0596, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.91% (0.0224 => 0.0157, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.14% (0.7573 => 0.7659, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.45% (1.5917 => 1.5988, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.23% (4.1772 => 3.0398, std.dev.: 0.0654) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.53% (0.1159 => 0.1281, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.63% (0.5309 => 0.5767, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.38% (2.1763 => 2.3587, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.68% (0.6410 => 0.6902, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.40% (0.3582 => 0.3847, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 7.05% (0.6173 => 0.6608, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 6.62% (1.0046 => 1.0711, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (1.1653 => 1.2393, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 6.09% (0.6915 => 0.7336, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 5.91% (15.3105 => 16.2154, std.dev.: 0.2366) MultiSource/Benchmarks/McCat/18-imp/imp: 5.81% (0.3217 => 0.3404, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.70% (0.6069 => 0.6415, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.40% (1.5150 => 1.5968, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.18% (0.3901 => 0.4103, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 5.03% (29.3170 => 30.7919, std.dev.: 0.4079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.84% (0.7639 => 0.8009, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 4.46% (3.0225 => 3.1574, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.43% (0.4880 => 0.5096, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3062 => 0.3195, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.25% (1.1827 => 1.2330, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3008 => 0.3133, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.14% (1.1440 => 1.1914, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (12.6413 => 13.1629, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.09% (0.2886 => 0.3004, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.07% (0.4248 => 0.4421, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.7226 => 0.7518, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 4.02% (1.3268 => 1.3802, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.2662 => 0.2766, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.87% (1.1672 => 1.2124, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.79% (0.2952 => 0.3064, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.77% (13.3238 => 13.8267, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/football/football: 3.76% (0.8405 => 0.8721, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.2771 => 0.2872, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 3.63% (2.0972 => 2.1734, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.62% (0.5636 => 0.5840, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.55% (0.5937 => 0.6148, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 3.49% (3.8796 => 4.0151, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 3.45% (3.5980 => 3.7222, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.0689 => 1.1050, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 3.28% (4.7455 => 4.9010, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.22% (0.3195 => 0.3298, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.17% (3.0758 => 3.1733, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.05% (1.2021 => 1.2388, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.04% (1.4408 => 1.4846, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 3.02% (14.6079 => 15.0494, std.dev.: 0.1015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.00% (6.2546 => 6.4420, std.dev.: 0.0204) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.4908 => 6.6848, std.dev.: 0.0122) MultiSource/Applications/treecc/treecc: 2.97% (1.8798 => 1.9357, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.82% (0.8569 => 0.8811, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0821 => 1.1126, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.7256 => 15.1086, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.43% (4.0318 => 4.1296, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.0317 => 2.0776, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9029 => 0.9232, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (1.4113 => 1.4418, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.14% (0.5520 => 0.5638, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.09% (4.2616 => 4.3508, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (1.3935 => 1.4221, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.03% (0.5963 => 0.6084, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.4189 => 1.4472, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (8.2559 => 8.4194, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.2742 => 1.2982, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.3380 => 4.4174, std.dev.: 0.0188) MultiSource/Applications/hexxagon/hexxagon: 1.72% (0.9425 => 0.9587, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.41% (0.0766 => 0.0907, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0307) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (4.0101 => 4.5398, std.dev.: 0.0116) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 11.07% (1.6261 => 1.8061, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6036, std.dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.18% (1.0063 => 1.0786, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/fp-convert: 4.71% (15.2242 => 15.9406, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.14% (0.7609 => 0.7924, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 4.08% (0.9851 => 1.0253, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (0.3301 => 0.3424, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.71% (3.4080 => 3.5346, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.60% (0.5587 => 0.5788, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.58% (0.8498 => 0.8802, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.46% (0.6308 => 0.6526, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.83% (2.6656 => 2.7410, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8925, std.dev.: 0.0757) MultiSource/Benchmarks/FreeBench/mason/mason: 2.74% (0.5004 => 0.5141, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 2.70% (3.8907 => 3.9957, std.dev.: 0.0164) MultiSource/Applications/siod/siod: 2.18% (3.5520 => 3.6293, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.14% (6.6312 => 6.7732, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4013 => 2.4491, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.72% (0.3497 => 0.2038, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.00% (5.2665 => 4.1077, std.dev.: 0.0507) SingleSource/Benchmarks/Shootout-C++/ary3: -20.09% (1.7473 => 1.3963, std.dev.: 0.0405) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.1647 => 0.9598, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.72% (15.8312 => 13.1836, std.dev.: 0.1294) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1595, std.dev.: 0.0402) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.89% (0.0917 => 0.0808, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.96% (3.6023 => 3.2434, std.dev.: 0.0949) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.65% (1.4034 => 1.2820, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: -8.52% (0.2664 => 0.2437, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9426, std.dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: -7.07% (7.6833 => 7.1400, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3741, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3307, std.dev.: 0.0326) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8729, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -6.31% (1.4441 => 1.3530, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -6.15% (3.4230 => 3.2124, std.dev.: 0.0626) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (62.4126 => 58.9535, std.dev.: 0.1071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7263, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1883, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: -4.28% (2.5166 => 2.4088, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: -4.28% (8.5323 => 8.1675, std.dev.: 0.1116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.10% (0.4564 => 0.4377, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.99% (1.2722 => 1.2214, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.21% (3.7496 => 3.6294, std.dev.: 0.0268) SingleSource/Benchmarks/McGill/misr: -3.12% (0.4296 => 0.4162, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -3.01% (9.2503 => 8.9715, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2850, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: -2.36% (6.7458 => 6.5868, std.dev.: 0.0318) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.17% (1.1683 => 1.1429, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.07% (45.4683 => 44.5254, std.dev.: 0.1067) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.00% (2.4457 => 2.3967, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3617, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.70% (0.6119 => 0.6015, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0507, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2291, std.dev.: 0.0241) MultiSource/Benchmarks/FreeBench/neural/neural: -1.65% (1.0926 => 1.0746, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.3569 => 2.3188, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: -1.47% (2.4971 => 2.4605, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.39% (27.1724 => 26.7960, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3114, std.dev.: 0.0997) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.37% (1.8739 => 1.8482, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.99% (0.9980 => 1.0278, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 3.07% (0.6022 => 0.6207, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 0.90% (0.1666 => 0.1681, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (0.3083 => 0.3179, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.88% (0.2394 => 0.2349, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.11% (0.3175 => 0.3242, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (0.2302 => 0.2347, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 2.00% (0.0449 => 0.0458, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -56.18% (0.0089 => 0.0039, std.dev.: 0.0024) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.08% (0.0240 => 0.0245, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.62% (0.0301 => 0.0257, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -23.81% (0.0189 => 0.0144, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1429 => 0.1443, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -0.52% (1.5019 => 1.4941, std.dev.: 0.0352) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1501 => 0.1505, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.48% (0.4264 => 0.3945, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.57% (0.1344 => 0.1392, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.23% (0.0589 => 0.0570, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.91% (0.0232 => 0.0209, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.21% (0.0639 => 0.0561, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.64% (1.1350 => 1.1277, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.44% (0.0637 => 0.0596, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.18% (0.0246 => 0.0157, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.56% (0.7541 => 0.7659, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.07% (1.5363 => 1.5988, std.dev.: 0.0013) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 03:17:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 05:17:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930101729.82D0C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4412?compare_to=4408&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4412, Order: 164912, Start Time: 2012-09-30 08:58:27, End Time: 2012-09-30 10:19:06 To: 4408, Order: 164910, Start Time: 2012-09-30 07:08:10, End Time: 2012-09-30 08:28:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 6 (1 on baseline) Performance Regressions: 4 (147 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 938 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Applications/JM/lencod/lencod: 737200.00% (0.0014 => 10.3222, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: -0.45% (1.4583 => 1.4518, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 21.57% (3.7983 => 4.6175, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.13% (4.4129 => 4.4070, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 92325.00% (0.0012 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0037 => 0.0037, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.92% (3.0670 => 3.2178, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 2.17% (1.1905 => 1.2163, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (27.6624 => 27.9952, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.16% (1.5784 => 1.5967, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.54% (15.4467 => 14.7455, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.84% (12.4815 => 12.2514, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.64% (0.5794 => 0.5757, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: -0.30% (16.0508 => 16.0019, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: -0.05% (14.9461 => 14.9383, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: -0.49% (83.4143 => 83.0093, std.dev.: 0.0607) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.3521 => 4.3531, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0462 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0421 => 0.0421, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.14% (0.0459 => 0.0440, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0406 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0407 => 0.0407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0404 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0404 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0414 => 0.0414, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.15% (1.2330 => 1.2311, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (7.5283 => 7.5160, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.19% (3.7181 => 3.7110, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.6479 => 0.6474, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.42% (0.1437 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.89% (0.0673 => 0.0667, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.25% (63.2438 => 83.0093, std.dev.: 0.0607) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14236.39% (0.0720 => 10.3222, std.dev.: 0.0060) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.23% (10.3673 => 14.7455, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 28.55% (0.1622 => 0.2085, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.16% (7.0540 => 8.0526, std.dev.: 0.0211) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.70% (2.2022 => 2.5039, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.01% (1.1194 => 1.2650, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.96% (0.1566 => 0.1769, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.82% (1.7609 => 1.9690, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 10.88% (0.3473 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.90% (0.3282 => 0.3574, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 8.39% (10.4361 => 11.3119, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.36% (0.4879 => 0.5287, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.25% (0.3177 => 0.3439, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3307 => 0.3574, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.87% (9.4845 => 10.2312, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/Hello: 7.66% (0.5925 => 0.6379, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.63% (0.6030 => 0.6490, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.63% (0.4615 => 0.4967, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.60% (0.7433 => 0.7998, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.43% (0.6675 => 0.7171, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.42% (0.7115 => 0.7643, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.8172 => 0.8776, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 7.37% (0.3109 => 0.3338, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.22% (0.2700 => 0.2895, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.16% (5.7591 => 6.1716, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.5105 => 0.5463, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.98% (1.5415 => 1.6491, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.93% (0.5860 => 0.6266, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 6.90% (3.3354 => 3.5655, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7326 => 0.7828, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 6.84% (0.3423 => 0.3657, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1510 => 0.1612, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.75% (1.3050 => 1.3931, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (4.2646 => 4.5511, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.57% (0.7835 => 0.8350, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5569 => 0.5934, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.54% (4.9449 => 5.2681, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.53% (8.1363 => 8.6673, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.51% (5.0018 => 5.3274, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.47% (0.8067 => 0.8589, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 6.46% (0.3422 => 0.3643, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 6.40% (0.3092 => 0.3290, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.35% (0.2758 => 0.2933, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.31% (0.2107 => 0.2240, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 6.27% (0.4289 => 0.4558, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4636 => 0.4926, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.3121 => 0.3316, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.08% (0.9765 => 1.0359, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.98% (0.5020 => 0.5320, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.97% (1.1642 => 1.2337, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.97% (1.1861 => 1.2569, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2891 => 0.3062, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 5.87% (3.8723 => 4.0996, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: 5.86% (0.2831 => 0.2997, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.4064 => 0.4302, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.82% (0.3865 => 0.4090, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.82% (1.0722 => 1.1346, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.78% (0.3441 => 0.3640, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 5.78% (0.2905 => 0.3073, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.78% (0.6456 => 0.6829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2756 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.75% (0.3650 => 0.3860, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (7.9617 => 8.4155, std.dev.: 0.0178) MultiSource/Benchmarks/sim/sim: 5.70% (0.3387 => 0.3580, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.67% (2.0665 => 2.1836, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.66% (0.4203 => 0.4441, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.65% (0.3826 => 0.4042, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.57% (0.3283 => 0.3466, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3232 => 0.3411, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3162 => 0.3337, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 5.47% (2.0273 => 2.1382, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/moments: 5.46% (0.4048 => 0.4269, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.43% (1.5603 => 1.6450, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6450 => 0.6799, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.3098 => 0.3265, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (0.4620 => 0.4869, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2871 => 0.3025, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.36% (21.9371 => 23.1126, std.dev.: 0.0289) MultiSource/Benchmarks/McCat/05-eks/eks: 5.33% (0.4299 => 0.4528, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.3052 => 0.3214, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.25% (0.2802 => 0.2949, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.22% (0.2872 => 0.3022, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.22% (0.3603 => 0.3791, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.21% (0.2877 => 0.3027, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.13% (0.3684 => 0.3873, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3935 => 0.4136, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.03% (2.2969 => 2.4124, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5981 => 0.6276, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 4.86% (0.8921 => 0.9355, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.65% (1.5859 => 1.6596, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.46% (1.4186 => 1.4818, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (14.3668 => 14.9728, std.dev.: 0.0201) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.1840 => 1.2336, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.06% (2.2024 => 2.2918, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 3.79% (1.2842 => 1.3329, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.3131 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.8101 => 0.8351, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.3427 => 0.3531, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.00% (17.1811 => 17.5241, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (3.8922 => 3.9617, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 7.17% (3.1578 => 3.3843, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.1396 => 1.2163, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7755, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (4.2280 => 4.3621, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2245, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5750, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2646, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.84% (5.3855 => 3.8862, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.43% (5.3526 => 3.8844, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2036, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.02% (2.9384 => 2.6146, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -7.77% (22.1758 => 20.4518, std.dev.: 0.0435) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.36% (1.2373 => 1.0968, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3060, std.dev.: 0.0721) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7114, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1619, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4979, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0813, std.dev.: 0.0120) SingleSource/UnitTests/Vector/multiplies: -1.85% (2.5528 => 2.5057, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0078, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.6802 => 8.5222, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2514, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.10% (0.5229 => 0.5757, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 6.75% (14.9895 => 16.0019, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 5.53% (14.1553 => 14.9383, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 5.90% (4.1105 => 4.3531, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.43% (1.1048 => 1.2311, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.00% (7.1582 => 7.5160, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.16% (3.4629 => 3.7110, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.6222 => 0.6474, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 03:27:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 05:27:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930102752.496E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4413?compare_to=4409&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4413, Order: 164912, Start Time: 2012-09-30 09:03:46, End Time: 2012-09-30 10:29:28 To: 4409, Order: 164910, Start Time: 2012-09-30 07:08:07, End Time: 2012-09-30 08:34:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 8 (0 on baseline) Performance Regressions: 4 (175 on baseline) Performance Improvements: 3 (31 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1024 (698 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Applications/ClamAV/clamscan: 52733.33% (0.0003 => 0.1585, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 540421.43% (0.0014 => 7.5673, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: -0.70% (1.4628 => 1.4526, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 21.60% (3.7559 => 4.5673, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.16% (4.4045 => 4.3973, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 4163.97% (0.1696 => 7.2317, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: 123508.33% (0.0012 => 1.4833, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0033 => 0.0033, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.18% (3.0346 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 1.94% (1.2311 => 1.2550, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.91% (1.2903 => 1.3150, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.40% (1.5739 => 1.5960, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -17.58% (0.5092 => 0.4197, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.99% (12.4733 => 12.2245, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -1.41% (2.4081 => 2.3741, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7524 => 2.7523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (2.1155 => 2.1153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.07% (4.9710 => 4.9744, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.04% (2.0176 => 2.4422, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.74% (0.5818 => 0.6443, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.66% (0.7061 => 0.7814, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 10.65% (0.4328 => 0.4789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.61% (0.5748 => 0.6358, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.41% (0.4062 => 0.4485, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.41% (3.9660 => 4.3790, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.26% (0.7038 => 0.7760, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.09% (1.3693 => 1.5075, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.06% (0.7710 => 0.8486, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.02% (0.1327 => 0.1460, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.87% (0.3899 => 0.4284, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.80% (0.6959 => 0.7641, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.78% (0.5265 => 0.5780, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.70% (1.2193 => 1.3376, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.70% (0.9199 => 1.0091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.63% (0.3022 => 0.3313, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.62% (0.3130 => 0.3431, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.6283 => 0.6886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.43% (1.4563 => 1.5936, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3580 => 0.3915, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.34% (0.2966 => 0.3243, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.34% (1.1364 => 1.2425, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 9.34% (13.8202 => 15.1104, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.30% (0.3485 => 0.3809, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.28% (0.2607 => 0.2849, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.17% (0.3489 => 0.3809, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2628 => 0.2869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.17% (1.9828 => 2.1646, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.16% (0.2937 => 0.3206, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.12% (0.4791 => 0.5228, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.10% (0.2726 => 0.2974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.06% (0.2760 => 0.3010, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.04% (0.2765 => 0.3015, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.03% (0.3756 => 0.4095, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.94% (0.4016 => 0.4375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.93% (0.3293 => 0.3587, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 8.85% (0.3107 => 0.3382, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.84% (0.3868 => 0.4210, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.83% (0.3149 => 0.3427, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.83% (0.2696 => 0.2934, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.77% (1.0313 => 1.1217, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.75% (0.4390 => 0.4774, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.60% (0.2988 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.5577 => 0.6052, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 8.51% (0.3453 => 0.3747, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.49% (0.3192 => 0.3463, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.48% (0.2995 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.32% (0.3534 => 0.3828, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.10% (3.8646 => 4.1776, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 8.09% (1.1061 => 1.1956, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.03% (0.8310 => 0.8977, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.00% (16.6129 => 17.9417, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (3.6692 => 3.9612, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 7.95% (0.2945 => 0.3179, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.93% (0.5637 => 0.6084, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.93% (0.2914 => 0.3145, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.90% (0.7460 => 0.8049, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.86% (0.7506 => 0.8096, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.80% (0.6576 => 0.7089, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.78% (7.2180 => 7.7796, std.dev.: 0.0120) MultiSource/Applications/siod/siod: 7.67% (2.1791 => 2.3463, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.64% (0.6744 => 0.7259, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 7.64% (1.0594 => 1.1403, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.61% (0.3220 => 0.3465, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.60% (0.3578 => 0.3850, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.59% (0.2925 => 0.3147, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3789 => 0.4075, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.54% (3.1889 => 3.4295, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.46% (0.3646 => 0.3918, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.46% (0.3755 => 0.4035, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 7.45% (1.9270 => 2.0706, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.4003 => 0.4301, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3650 => 0.3921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.35% (0.8698 => 0.9337, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/synchronized: 7.34% (0.3663 => 0.3932, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 7.31% (0.1478 => 0.1586, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.15% (1.3245 => 1.4192, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.97% (1.3819 => 1.4782, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.97% (1.2749 => 1.3637, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.92% (14.8535 => 15.8811, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.3813 => 1.4763, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.79% (0.8818 => 0.9417, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.69% (0.3245 => 0.3462, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.69% (8.4961 => 9.0642, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 6.58% (0.3131 => 0.3337, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.4113 => 0.4382, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 6.51% (4.6629 => 4.9665, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.51% (4.4433 => 4.7324, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.1333 => 1.2070, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.50% (4.3801 => 4.6646, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 6.44% (0.2859 => 0.3043, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.41% (0.6135 => 0.6528, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.39% (1.2292 => 1.3077, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.32% (0.3511 => 0.3733, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275) MultiSource/Applications/ClamAV/clamscan: 6.27% (14.5298 => 15.4402, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.10% (13.2842 => 14.0948, std.dev.: 0.0186) MultiSource/Applications/JM/ldecod/ldecod: 6.07% (6.5754 => 6.9746, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.01% (3.2742 => 3.4709, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2504 => 0.2654, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.6250 => 0.6608, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.62% (0.4805 => 0.5075, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.59% (4.9865 => 5.2651, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.17% (1.5188 => 1.5973, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.12% (0.9108 => 0.9574, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.08% (3.7467 => 3.9370, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (6.2785 => 6.5717, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.61% (2.1007 => 2.1976, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 4.25% (33.2944 => 34.7107, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.88% (16.2614 => 16.7290, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std.dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.2619 => 11.7265, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.20% (10.7476 => 11.0918, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5902, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5826, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.11% (3.1071 => 3.1415, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2245, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5890, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.72% (0.4657 => 0.3925, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.61% (22.5627 => 21.9738, std.dev.: 0.0343) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2308 => 1.0915, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2730, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7942, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1569, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7058, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2439, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2317, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1898, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 03:48:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 05:48:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120930104822.1A1842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4414?compare_to=4407&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4414, Order: 164910, Start Time: 2012-09-30 07:39:53, End Time: 2012-09-30 10:49:59 To: 4407, Order: 164908, Start Time: 2012-09-30 03:58:15, End Time: 2012-09-30 07:10:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.05% (9.8128 => 9.8082, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.04% (9.4132 => 9.4094, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (16.9586 => 16.9567, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.17% (0.3465 => 0.3852, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.14% (0.3446 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3460 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3488 => 0.3873, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 11.01% (0.3496 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3469 => 0.3850, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.98% (0.3442 => 0.3820, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.68% (0.3650 => 0.4040, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.65% (0.3643 => 0.4031, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.65% (1.5932 => 1.7628, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.50% (0.3724 => 0.4115, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5826 => 0.6301, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.05% (0.5889 => 0.6363, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.76% (0.3004 => 0.3237, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.41% (0.1619 => 0.1739, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.31% (1.3152 => 1.4114, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.27% (0.4994 => 0.5357, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.17% (0.2875 => 0.3081, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (1.6211 => 1.7360, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.09% (0.4361 => 0.4670, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.94% (0.2738 => 0.2928, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3195 => 0.3416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.83% (0.2736 => 0.2923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.75% (0.7171 => 0.7655, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2803 => 0.2991, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.70% (5.5417 => 5.9128, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 6.70% (0.2823 => 0.3012, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.69% (0.2750 => 0.2934, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.69% (1.0781 => 1.1502, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (3.5627 => 3.8009, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/methcall: 6.68% (0.2813 => 0.3001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (2.0673 => 2.2050, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.2780 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.63% (0.2792 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3267 => 0.3483, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2729 => 0.2909, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2811 => 0.2994, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 6.50% (0.9909 => 1.0553, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3096 => 0.3297, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.48% (0.5000 => 0.5324, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.39% (0.2911 => 0.3097, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.37% (0.3060 => 0.3255, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.37% (2.7292 => 2.9031, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 6.33% (0.3348 => 0.3560, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.32% (0.3258 => 0.3464, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3362 => 0.3573, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.24% (0.3124 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.17% (0.3678 => 0.3905, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.15% (0.3317 => 0.3521, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (0.3930 => 0.4170, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.09% (0.3282 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.07% (0.3625 => 0.3845, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (0.5900 => 0.6257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.01% (0.3726 => 0.3950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.95% (0.3477 => 0.3684, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.95% (4.2109 => 4.4615, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4146 => 0.4387, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.81% (0.2566 => 0.2715, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 5.74% (23.5202 => 24.8707, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4251 => 0.4495, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3690 => 0.3901, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.3845 => 0.4063, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (4.4195 => 4.6681, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.45% (2.1013 => 2.2159, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.3981 => 0.4198, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.2866 => 0.3022, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.37% (4.6177 => 4.8655, std.dev.: 0.0130) MultiSource/Applications/spiff/spiff: 5.36% (0.4029 => 0.4245, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 5.32% (0.6634 => 0.6987, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.27% (0.6435 => 0.6774, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.27% (0.4139 => 0.4357, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 5.22% (2.1653 => 2.2784, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.18% (0.3903 => 0.4105, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.17% (0.2068 => 0.2175, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.17% (1.4269 => 1.5007, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.14% (0.3890 => 0.4090, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.11% (0.5012 => 0.5268, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 5.10% (0.3336 => 0.3506, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2737 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.96% (0.3084 => 0.3237, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (0.4658 => 0.4888, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.92% (0.5546 => 0.5819, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.2040 => 0.2140, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 4.83% (0.2691 => 0.2821, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.3271 => 0.3429, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 4.67% (0.9697 => 1.0150, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.67% (1.9694 => 2.0614, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.66% (1.9966 => 2.0896, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.2969 => 0.3102, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.47% (0.7875 => 0.8227, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.31% (2.0346 => 2.1222, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.01% (0.7426 => 0.7724, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.00% (0.4847 => 0.5041, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.71% (0.5361 => 0.5560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.40% (0.5584 => 0.5774, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.25% (11.6398 => 12.0181, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.08% (0.4253 => 0.4384, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.02% (4.6926 => 4.8345, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.3498 => 0.3601, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.87% (11.9555 => 12.1796, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-2: 5.14% (1.8057 => 1.8986, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1701, std.dev.: 0.0674) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6388, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2058, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5079, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4400, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2807, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5967, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4562, std.dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5816, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -9.08% (0.2402 => 0.2184, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7839, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7989, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7589, std.dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 06:06:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 08:06:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930130633.505EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4415?compare_to=4411&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4415, Order: 164915, Start Time: 2012-09-30 11:45:24, End Time: 2012-09-30 13:08:12 To: 4411, Order: 164912, Start Time: 2012-09-30 08:53:57, End Time: 2012-09-30 10:16:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 16 (93 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 957 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7907 => 0.8081, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 1.65% (16.2154 => 16.4822, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.2982 => 1.3187, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (4.3508 => 4.3954, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 11.34% (3.0433 => 3.3884, std.dev.: 0.0638) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.92% (3.0184 => 3.3177, std.dev.: 0.0658) MultiSource/Benchmarks/FreeBench/distray/distray: 5.91% (0.2437 => 0.2581, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.13% (4.2844 => 4.4614, std.dev.: 0.0624) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (2.5051 => 2.6069, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (0.3424 => 0.3533, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 2.74% (3.0398 => 3.1230, std.dev.: 0.0209) MultiSource/Benchmarks/Olden/tsp/tsp: 2.19% (1.7389 => 1.7770, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.05% (13.1836 => 13.4540, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (0.8802 => 0.8933, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.08% (4.6592 => 4.7097, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.02% (5.8687 => 5.9285, std.dev.: 0.0200) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.79% (1.0278 => 1.0197, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 0.29% (0.6207 => 0.6225, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -0.36% (0.1681 => 0.1675, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.30% (0.1564 => 0.1528, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.92% (0.3179 => 0.3118, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.2349 => 0.2410, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.68% (0.3242 => 0.3264, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.09% (0.2347 => 0.2345, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -0.87% (0.0458 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 128.21% (0.0039 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 217.24% (0.0029 => 0.0092, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.82% (0.0245 => 0.0243, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0194 => 0.0194, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.29% (0.0257 => 0.0304, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0283 => 0.0287, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0327 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.10% (0.0181 => 0.0183, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 36.11% (0.0144 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 3.69% (0.0244 => 0.0253, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -19.39% (0.0330 => 0.0266, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 66.67% (0.0006 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.62% (0.1443 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.92% (1.4941 => 1.5378, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.65% (0.1505 => 0.1450, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.64% (0.3945 => 0.4128, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.50% (0.1392 => 0.1399, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.04% (0.0570 => 0.0547, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.87% (0.0209 => 0.0215, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.43% (0.0561 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1277 => 1.1314, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.55% (0.0596 => 0.0641, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.66% (0.0157 => 0.0202, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7659 => 0.7651, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.14% (1.5988 => 1.5966, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.09% (0.0121 => 0.0110, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.24% (4.1772 => 3.1230, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0049) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.23% (0.1159 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.12% (0.1414 => 0.1543, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 8.60% (2.1763 => 2.3635, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: 8.53% (0.5309 => 0.5762, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.32% (0.6410 => 0.6943, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 7.65% (15.3105 => 16.4822, std.dev.: 0.0307) MultiSource/Applications/minisat/minisat: 7.39% (0.6173 => 0.6629, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.98% (0.3582 => 0.3832, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.78% (1.0046 => 1.0727, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 6.44% (1.1653 => 1.2404, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 6.29% (0.6915 => 0.7350, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.59% (0.3901 => 0.4119, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (1.5150 => 1.5973, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.35% (0.4880 => 0.5141, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (1.1827 => 1.2448, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.21% (0.2552 => 0.2685, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.1672 => 1.2256, std.dev.: 0.0194) MultiSource/Benchmarks/Bullet/bullet: 4.98% (29.3170 => 30.7777, std.dev.: 0.1746) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.94% (0.7639 => 0.8016, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.6069 => 0.6368, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.84% (0.2106 => 0.2208, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (12.6413 => 13.2310, std.dev.: 0.0698) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3217 => 0.3367, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.31% (3.0225 => 3.1527, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.2797 => 0.2915, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.14% (0.4248 => 0.4424, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.7226 => 0.7524, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3062 => 0.3181, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.83% (1.3268 => 1.3776, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: 3.82% (13.3238 => 13.8325, std.dev.: 0.0646) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.82% (0.7784 => 0.8081, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 3.80% (1.1440 => 1.1875, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.73% (1.2021 => 1.2469, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.68% (0.5520 => 0.5723, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 3.64% (3.5980 => 3.7289, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 3.63% (2.0972 => 2.1734, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.60% (1.4408 => 1.4926, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.58% (1.0689 => 1.1072, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 3.53% (4.7455 => 4.9128, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.2742 => 1.3187, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.45% (3.0758 => 3.1820, std.dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.6079 => 15.1059, std.dev.: 0.0476) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.35% (0.5636 => 0.5825, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (3.8796 => 4.0085, std.dev.: 0.0303) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.29% (0.7722 => 0.7976, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.26% (0.3195 => 0.3299, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (6.2546 => 6.4529, std.dev.: 0.0504) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (4.2616 => 4.3954, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5740 => 0.5919, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.0821 => 1.1155, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.06% (0.8569 => 0.8831, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (8.2186 => 8.4597, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.0317 => 2.0897, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.82% (8.2559 => 8.4885, std.dev.: 0.0443) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.4908 => 6.6680, std.dev.: 0.0248) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.7256 => 15.1162, std.dev.: 0.0477) MultiSource/Applications/treecc/treecc: 2.57% (1.8798 => 1.9282, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.49% (1.4113 => 1.4464, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.2815 => 4.3827, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.63% (1.3935 => 1.4162, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.53% (1.6538 => 2.3407, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.61% (4.0101 => 4.5558, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.65% (3.0256 => 3.3177, std.dev.: 0.0658) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.31% (0.2857 => 0.3123, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 8.72% (7.0025 => 7.6131, std.dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.57% (1.0063 => 1.0925, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (0.3301 => 0.3533, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.09% (40.4792 => 42.9431, std.dev.: 0.3520) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.90% (4.2129 => 4.4614, std.dev.: 0.0624) SingleSource/Benchmarks/Shootout/heapsort: 5.36% (3.2159 => 3.3884, std.dev.: 0.0638) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.12% (0.8498 => 0.8933, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8495, std.dev.: 0.0431) SingleSource/Benchmarks/Misc/dt: 4.04% (0.9851 => 1.0249, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 2.85% (3.8907 => 4.0015, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 2.84% (3.5520 => 3.6527, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8981, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.6308 => 0.6476, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 2.54% (1.7330 => 1.7770, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.54% (0.5876 => 0.6025, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.48% (2.6656 => 2.7316, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.20% (6.6312 => 6.7773, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.10% (4.6127 => 4.7097, std.dev.: 0.0191) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (2.4013 => 2.4487, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.37% (2.3453 => 2.3775, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 1.24% (4.6414 => 4.6988, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.72% (0.3497 => 0.2108, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.35% (5.2665 => 4.1422, std.dev.: 0.0465) SingleSource/Benchmarks/Shootout-C++/ary3: -18.77% (1.7473 => 1.4193, std.dev.: 0.0932) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.29% (1.1647 => 0.9633, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.02% (15.8312 => 13.4540, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.14% (1.4034 => 1.2892, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9444, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -7.09% (7.6833 => 7.1386, std.dev.: 0.0313) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.45% (2.0027 => 1.8736, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: -6.41% (4.6355 => 4.3384, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3519, std.dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (3.4230 => 3.2160, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (62.4126 => 58.9601, std.dev.: 0.1093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.42% (3.9413 => 3.7278, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1899, std.dev.: 0.0542) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -3.92% (0.3746 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.92% (2.5166 => 2.4180, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.88% (1.2959 => 1.2456, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/misr: -3.54% (0.4296 => 0.4144, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.37% (45.4683 => 43.9377, std.dev.: 0.2289) SingleSource/Benchmarks/Shootout-C++/methcall: -3.35% (9.2503 => 8.9402, std.dev.: 0.0466) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.19% (0.4140 => 0.4008, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2937, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.39% (3.7496 => 3.6601, std.dev.: 0.0196) MultiSource/Applications/lua/lua: -2.35% (29.5232 => 28.8284, std.dev.: 0.1761) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.15% (1.1683 => 1.1432, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -2.11% (6.7458 => 6.6037, std.dev.: 0.0536) MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (92.7467 => 90.9510, std.dev.: 0.5815) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3649, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.84% (2.4457 => 2.4008, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.4876 => 3.4242, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2332, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.61% (61.1734 => 60.1897, std.dev.: 0.3486) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3237, std.dev.: 0.0587) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4643, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.31% (1.8739 => 1.8494, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.17% (27.1724 => 26.8550, std.dev.: 0.1070) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.17% (0.9980 => 1.0197, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 3.37% (0.6022 => 0.6225, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 0.54% (0.1666 => 0.1675, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.67% (0.1554 => 0.1528, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (0.3083 => 0.3118, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.67% (0.2394 => 0.2410, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (0.3175 => 0.3264, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.87% (0.2302 => 0.2345, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -18.15% (0.0325 => 0.0266, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.39% (1.5019 => 1.5378, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.40% (0.1501 => 0.1450, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.19% (0.4264 => 0.4128, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1344 => 0.1399, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.33% (0.0232 => 0.0215, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.95% (0.0639 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1350 => 1.1314, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.63% (0.0637 => 0.0641, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.89% (0.0246 => 0.0202, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.93% (1.5363 => 1.5966, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 57.14% (0.0070 => 0.0110, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 06:17:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 08:17:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930131713.7C7732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4416?compare_to=4412&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4416, Order: 164915, Start Time: 2012-09-30 11:58:28, End Time: 2012-09-30 13:18:50 To: 4412, Order: 164912, Start Time: 2012-09-30 08:58:27, End Time: 2012-09-30 10:19:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 949 (702 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.92% (1.2904 => 1.3152, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.5757 => 0.5747, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.02% (16.0019 => 15.9980, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 0.08% (14.9383 => 14.9499, std.dev.: 0.0381) MultiSource/Benchmarks/Bullet/bullet: 0.05% (83.0093 => 83.0489, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.3531 => 4.3525, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0463 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0406 => 0.0406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0442 => 0.0442, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0404 => 0.0404, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0404 => 0.0405, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0404 => 0.0404, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0413 => 0.0413, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0414 => 0.0414, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2311 => 1.2308, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.5160 => 7.5118, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.15% (3.7110 => 3.7053, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.6474 => 0.6470, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (0.0667 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.32% (63.2438 => 83.0489, std.dev.: 0.0110) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14230.28% (0.0720 => 10.3178, std.dev.: 0.0122) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.31% (10.3673 => 14.7540, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 28.55% (0.1622 => 0.2085, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.08% (7.0540 => 8.0471, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.61% (2.2022 => 2.5020, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.03% (0.1566 => 0.1770, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.90% (1.1194 => 1.2638, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.68% (1.7609 => 1.9666, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1584 => 0.1744, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 10.01% (0.3886 => 0.4275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.78% (0.3282 => 0.3570, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.40% (0.4879 => 0.5289, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.40% (0.1655 => 0.1794, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 8.32% (10.4361 => 11.3048, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.06% (0.3177 => 0.3433, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.98% (0.3307 => 0.3571, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.86% (0.8172 => 0.8814, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.82% (9.4845 => 10.2264, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 7.68% (0.6030 => 0.6493, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.55% (0.7433 => 0.7994, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 7.41% (0.7115 => 0.7642, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.33% (0.6675 => 0.7164, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.32% (0.1695 => 0.1819, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 7.27% (0.3109 => 0.3335, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.22% (0.2700 => 0.2895, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.17% (5.7591 => 6.1719, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2554 => 0.2736, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 7.10% (0.3423 => 0.3666, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (0.4615 => 0.4942, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.04% (3.3354 => 3.5702, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.93% (1.5415 => 1.6484, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.89% (0.5860 => 0.6264, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.88% (0.7326 => 0.7830, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.86% (0.8067 => 0.8620, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.80% (1.3050 => 1.3937, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.69% (0.2107 => 0.2248, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (4.2646 => 4.5474, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5569 => 0.5936, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.57% (0.3121 => 0.3326, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4636 => 0.4940, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.55% (8.1363 => 8.6690, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.45% (5.0018 => 5.3245, std.dev.: 0.0135) MultiSource/Applications/spiff/spiff: 6.41% (0.7835 => 0.8337, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.35% (4.9449 => 5.2589, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 6.31% (0.3422 => 0.3638, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.27% (0.2758 => 0.2931, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.19% (0.4103 => 0.4357, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 6.14% (0.3092 => 0.3282, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.03% (0.9765 => 1.0354, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2891 => 0.3063) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.92% (1.1861 => 1.2563, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 5.91% (1.1642 => 1.2330, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.90% (0.2831 => 0.2998, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 5.86% (3.8723 => 4.0994, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.84% (0.5020 => 0.5313, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.81% (0.3650 => 0.3862, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (0.4064 => 0.4300, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (7.9617 => 8.4237, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 5.79% (1.0722 => 1.1343, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/09-vor/vor: 5.79% (0.3180 => 0.3364, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4289 => 0.4536, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.76% (0.3387 => 0.3582, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.75% (0.3441 => 0.3639, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.72% (0.6456 => 0.6825, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3826 => 0.4043, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.64% (0.3865 => 0.4083, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3162 => 0.3340, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.58% (1.5603 => 1.6474, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 5.57% (0.3052 => 0.3222, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3232 => 0.3412, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.55% (2.0273 => 2.1398, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.4048 => 0.4272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2802 => 0.2957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.52% (0.4203 => 0.4435, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.51% (0.3283 => 0.3464, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.49% (0.2603 => 0.2746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2756 => 0.2907, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (2.0665 => 2.1795, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 5.47% (0.2725 => 0.2874, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2871 => 0.3026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (0.4620 => 0.4869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.36% (0.3098 => 0.3264, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4299 => 0.4529, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.32% (21.9371 => 23.1048, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3603 => 0.3794, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.26% (0.2793 => 0.2940, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2872 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2877 => 0.3028, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 5.19% (2.2969 => 2.4161, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.18% (0.3935 => 0.4139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.13% (0.3684 => 0.3873, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.07% (0.6450 => 0.6777, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.91% (0.8921 => 0.9359, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5981 => 0.6262, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.62% (1.5859 => 1.6591, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.59% (1.4186 => 1.4837, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (14.3668 => 14.9640, std.dev.: 0.0199) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.1840 => 1.2322, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.07% (2.2024 => 2.2920, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.2842 => 1.3342, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.3131 => 0.3244, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.8101 => 0.8342, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.95% (17.1811 => 17.5168, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (3.8922 => 3.9613, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.13% (3.1578 => 3.3828, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (1.1396 => 1.2162, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7706, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3481, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5775, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2080, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.17% (5.2763 => 3.2623, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.85% (5.3855 => 3.8854, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.34% (5.3526 => 3.8890, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1891, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.01% (2.9384 => 2.6148, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: -7.78% (22.1758 => 20.4508, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.63% (1.2373 => 1.0934, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2673, std.dev.: 0.0369) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5964, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4975, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.90% (8.6802 => 8.5150, std.dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0038, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: -1.80% (12.4730 => 12.2488, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6826, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.70% (10.2830 => 10.1083, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2289, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.91% (0.5229 => 0.5747, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 6.73% (14.9895 => 15.9980, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 5.61% (14.1553 => 14.9499, std.dev.: 0.0381) MultiSource/Benchmarks/MallocBench/gs/gs: 5.89% (4.1105 => 4.3525, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1048 => 1.2308, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.94% (7.1582 => 7.5118, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.00% (3.4629 => 3.7053, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.6222 => 0.6470, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.30% (0.2116 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 06:22:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 08:22:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930132238.82ADD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4417?compare_to=4413&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4417, Order: 164915, Start Time: 2012-09-30 11:58:35, End Time: 2012-09-30 13:24:16 To: 4413, Order: 164912, Start Time: 2012-09-30 09:03:46, End Time: 2012-09-30 10:29:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (175 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.31% (55.0917 => 56.3628, std.dev.: 0.1607) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.03% (1.3150 => 1.3015, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7523 => 2.7524, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.01% (2.1153 => 2.1155, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9744 => 4.9748, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.00% (2.0176 => 2.4412, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.09% (0.1410 => 0.1651, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.70% (0.4328 => 0.4791, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.59% (0.5748 => 0.6357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.46% (0.4062 => 0.4487, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.38% (3.9660 => 4.3777, std.dev.: 0.0090) SingleSource/Regression/C++/ofstream_ctor: 10.21% (0.2781 => 0.3065, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.17% (0.7038 => 0.7754, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2782 => 0.3065, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 10.15% (0.7061 => 0.7778, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.13% (0.2596 => 0.2859, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.95% (0.3899 => 0.4287, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 9.91% (1.3693 => 1.5050, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.76% (0.6959 => 0.7638, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.74% (1.2193 => 1.3380, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1327 => 0.1456, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.65% (0.7710 => 0.8454, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.62% (0.3130 => 0.3431, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.58% (0.6283 => 0.6885, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.58% (0.9199 => 1.0080, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.56% (0.3022 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.38% (0.3485 => 0.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.37% (1.4563 => 1.5928, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 9.33% (0.2690 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2607 => 0.2850, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.1364 => 1.2417, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.25% (1.9828 => 2.1663, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 9.25% (13.8202 => 15.0981, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.23% (0.4791 => 0.5233, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.22% (0.3580 => 0.3910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.17% (0.3107 => 0.3392, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.17% (0.2726 => 0.2976, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.11% (0.3489 => 0.3807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.08% (0.2765 => 0.3016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.07% (0.5577 => 0.6083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.06% (0.2760 => 0.3010, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.06% (0.2937 => 0.3203, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.05% (0.3756 => 0.4096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.04% (0.4016 => 0.4379, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.04% (0.2966 => 0.3234, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.00% (0.4390 => 0.4785, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 8.96% (0.3293 => 0.3588, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 8.95% (0.3868 => 0.4214, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.89% (0.3149 => 0.3429, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.67% (1.0313 => 1.1207, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3453 => 0.3750, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.60% (0.2988 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.55% (0.3192 => 0.3465, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3534 => 0.3835, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.45% (0.2995 => 0.3248, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 8.15% (0.7506 => 0.8118, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 8.06% (3.8646 => 4.1762, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.02% (0.4379 => 0.4730, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.01% (0.8310 => 0.8976, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 8.01% (0.2945 => 0.3181, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.96% (1.1061 => 1.1942, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 7.92% (16.6129 => 17.9293, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.90% (3.6692 => 3.9589, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.84% (0.5637 => 0.6079, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.72% (7.2180 => 7.7750, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 7.70% (0.3220 => 0.3468, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 7.64% (0.6744 => 0.7259, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.59% (0.7460 => 0.8026, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3578 => 0.3847, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.51% (3.1889 => 3.4283, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.2925 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.48% (1.0594 => 1.1386, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.47% (0.8698 => 0.9348, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.47% (1.9270 => 2.0710, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 7.45% (2.1791 => 2.3414, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 7.40% (0.2243 => 0.2409, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.39% (0.6576 => 0.7062, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.39% (0.3789 => 0.4069, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.38% (0.3646 => 0.3915) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 7.33% (0.3601 => 0.3865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.27% (0.3755 => 0.4028, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4190, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.98% (1.3813 => 1.4777, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 6.92% (14.8535 => 15.8814, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.84% (1.3819 => 1.4764, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (1.2749 => 1.3618, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.75% (0.2859 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.72% (0.3245 => 0.3463, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.66% (4.3801 => 4.6718, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 6.66% (8.4961 => 9.0618, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/05-eks/eks: 6.56% (0.4113 => 0.4383, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.52% (0.8818 => 0.9393, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (1.1333 => 1.2071, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.45% (0.6135 => 0.6531, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.45% (4.4433 => 4.7299, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 6.44% (4.6629 => 4.9630, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.29% (0.3511 => 0.3732, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.28% (1.2292 => 1.3064, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 6.21% (14.5298 => 15.4315, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.05% (3.2742 => 3.4722, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (13.2842 => 14.0870, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2504 => 0.2653, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.91% (6.5754 => 6.9640, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.62% (4.9865 => 5.2666, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 5.62% (0.6250 => 0.6601, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.58% (0.4805 => 0.5073, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.09% (0.9108 => 0.9572, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5188 => 1.5956, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.85% (3.7467 => 3.9283, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (6.2785 => 6.5694, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.47% (2.1007 => 2.1945, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 4.21% (33.2944 => 34.6977, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7256, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2619, std.dev.: 0.0513) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.54% (1.1560 => 1.2547, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (3.1736 => 3.4116, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7236, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0927, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5903, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5823, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5942, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2252, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.61% (0.4657 => 0.3930, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.53% (22.5627 => 21.9925, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2770, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.55% (1.3780 => 1.3015, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1573, std.dev.: 0.0238) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7079, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9448, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7057, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2431, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.40% (7.3305 => 7.2278, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2130, std.dev.: 0.0147) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2407, std.dev.: 0.0125) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 07:27:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 09:27:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120930142753.DEAA52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4418?compare_to=4414&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4418, Order: 164912, Start Time: 2012-09-30 11:19:22, End Time: 2012-09-30 14:29:31 To: 4414, Order: 164910, Start Time: 2012-09-30 07:39:53, End Time: 2012-09-30 10:49:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 3 (129 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1036 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.98% (0.4040 => 0.4524, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 4.95% (1.6036 => 1.6829, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.89% (2.0635 => 2.1024, std.dev.: 0.0093) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (9.8082 => 9.8105, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.03% (9.4094 => 9.4126, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (16.9567 => 16.9576, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3465 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.30% (0.3442 => 0.3831, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.27% (0.3496 => 0.3890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.26% (0.3446 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.24% (0.3460 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.24% (0.3488 => 0.3880, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 11.16% (0.3469 => 0.3856, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/property: 10.93% (0.3650 => 0.4049, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.90% (0.3643 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.63% (0.3724 => 0.4120, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 10.30% (1.5932 => 1.7573, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.91% (0.5826 => 0.6287, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.88% (0.5889 => 0.6353, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.1619 => 0.1741, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.20% (0.2738 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.09% (0.4994 => 0.5348, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.09% (0.4361 => 0.4670, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.96% (1.3152 => 1.4067, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (1.6211 => 1.7334, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.90% (0.5000 => 0.5345, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2875 => 0.3069, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.3004 => 0.3206, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.67% (3.5627 => 3.8004, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.2823 => 0.3008, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.44% (0.7171 => 0.7633, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.44% (0.2750 => 0.2927, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.42% (0.3195 => 0.3400, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.41% (5.5417 => 5.8972, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2729 => 0.2904, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2813 => 0.2993, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.38% (1.0781 => 1.1469, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 6.33% (0.9909 => 1.0536, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.2014 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.24% (2.0673 => 2.1962, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2803 => 0.2976, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.2068 => 0.2195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.12% (0.2792 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.11% (0.2911 => 0.3089, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3625 => 0.3846, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.08% (2.7292 => 2.8952, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.08% (0.2780 => 0.2949, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3267 => 0.3465, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.04% (0.3096 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (0.3930 => 0.4167, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3258 => 0.3454, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.01% (0.5026 => 0.5328, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4146 => 0.4395, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2811 => 0.2978, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3124 => 0.3309, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.89% (0.3362 => 0.3560, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.88% (0.3060 => 0.3240, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.2736 => 0.2896, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 5.83% (4.2109 => 4.4564, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 5.79% (0.3317 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.78% (1.8794 => 1.9880, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (4.4195 => 4.6733, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 5.70% (0.3348 => 0.3539, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3282 => 0.3469, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.69% (0.2566 => 0.2712, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 5.68% (0.6634 => 0.7011, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 5.68% (0.3678 => 0.3887, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.61% (0.3477 => 0.3672, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.61% (0.4139 => 0.4371, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.5900 => 0.6230, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.56% (0.3690 => 0.3895, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.2866 => 0.3025, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.53% (2.1013 => 2.2176, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 5.53% (4.6177 => 4.8731, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3726 => 0.3932, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 5.53% (23.5202 => 24.8205, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 5.53% (0.4251 => 0.4486, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (0.3890 => 0.4104, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.44% (0.4029 => 0.4248, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.3903 => 0.4112, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (2.1653 => 2.2788, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 5.19% (1.4269 => 1.5009, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.3845 => 0.4043, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 5.10% (0.5546 => 0.5829, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.3084 => 0.3240, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.00% (0.6435 => 0.6757, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.93% (0.7875 => 0.8263, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.92% (0.4658 => 0.4887, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (0.2075 => 0.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.82% (0.2737 => 0.2869, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.5012 => 0.5253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.74% (0.3271 => 0.3426, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 4.74% (0.3336 => 0.3494, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.72% (1.9966 => 2.0909, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.58% (1.9694 => 2.0596, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 4.55% (2.0346 => 2.1271, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.41% (0.2969 => 0.3100, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.31% (0.4847 => 0.5056, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.31% (0.9697 => 1.0115, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (0.7426 => 0.7730, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (0.2691 => 0.2799, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.88% (0.5361 => 0.5569, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.69% (0.5584 => 0.5790, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.28% (11.6398 => 12.0217, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (4.6926 => 4.8395, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.3498 => 0.3600, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.68% (11.9555 => 12.1558, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.23% (0.2162 => 0.3529, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.2122 => 0.2256, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6768, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1617, std.dev.: 0.1373) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6424, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1952, std.dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5059, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4597, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2888, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5867, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5461, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7937, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7911, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -3.21% (17.2379 => 16.6849, std.dev.: 0.0646) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0424, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 07:45:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 09:45:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930144502.222362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4419?compare_to=4415&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4419, Order: 164917, Start Time: 2012-09-30 13:24:02, End Time: 2012-09-30 14:46:41 To: 4415, Order: 164915, Start Time: 2012-09-30 11:45:24, End Time: 2012-09-30 13:08:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (80 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 965 (773 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7976 => 0.8164, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.23% (0.8265 => 0.8367, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.31% (1.0925 => 1.1287, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.13% (1.2597 => 1.2865, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.87% (0.7764 => 0.7909, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.32% (1.4107 => 1.4293, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.15% (16.4822 => 16.1278, std.dev.: 0.0674) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -2.17% (4.4614 => 4.3647, std.dev.: 0.0258) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.79% (1.0197 => 1.0116, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -0.96% (0.6225 => 0.6165, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 0.24% (0.1675 => 0.1679, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.47% (0.1528 => 0.1581, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.09% (0.3118 => 0.3152, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2410 => 0.2414, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (0.3264 => 0.3222, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.98% (0.2345 => 0.2322, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel: - (0.0454 => 0.0454, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -2.17% (0.0092 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0243 => 0.0242, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.03% (0.0194 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0392 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.64% (0.0304 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.39% (0.0287 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.83% (0.0327 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.19% (0.0183 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -9.18% (0.0196 => 0.0178, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.19% (0.0253 => 0.0250, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 23.68% (0.0266 => 0.0329, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1452 => 0.1444, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -4.46% (1.5378 => 1.4692, std.dev.: 0.0392) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.52% (0.1450 => 0.1472, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.84% (0.4128 => 0.4204, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.86% (0.1399 => 0.1439, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.46% (0.0547 => 0.0555, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.79% (0.0215 => 0.0264, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.50% (0.0569 => 0.0606, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1314 => 1.1281, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0641 => 0.0642, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.88% (0.0202 => 0.0178, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.7651 => 0.7660, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.03% (1.5966 => 1.5961, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.00% (0.0110 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.20% (4.1772 => 3.0826, std.dev.: 0.0754) SingleSource/Benchmarks/Shootout-C++/except: 82250.00% (0.0006 => 0.4941, std.dev.: 0.0012) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.32% (0.6410 => 0.6943, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 8.21% (2.1763 => 2.3550, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: 7.82% (0.5309 => 0.5724, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 7.23% (1.0046 => 1.0772, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.92% (0.6173 => 0.6600, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (1.1653 => 1.2397, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.35% (0.2552 => 0.2714, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.20% (0.3582 => 0.3804, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.6069 => 0.6427, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.72% (0.7722 => 0.8164, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.5150 => 1.5978, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 5.34% (15.3105 => 16.1278, std.dev.: 0.0674) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.4248 => 0.4472, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 5.25% (0.6915 => 0.7278, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.4880 => 0.5126, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 4.74% (3.0225 => 3.1658, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.73% (0.7639 => 0.8000, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 4.62% (29.3170 => 30.6718, std.dev.: 0.0594) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (12.6413 => 13.2029, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1672 => 1.2178, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3217 => 0.3345, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 3.91% (1.1440 => 1.1887, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.4408 => 1.4960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.83% (0.2797 => 0.2904, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.75% (13.3238 => 13.8240, std.dev.: 0.1408) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.64% (0.2886 => 0.2991, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.56% (0.3062 => 0.3171, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.48% (0.2877 => 0.2977, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.47% (1.1827 => 1.2237, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (8.2186 => 8.5029, std.dev.: 0.0137) MultiSource/Applications/hbd/hbd: 3.44% (1.3268 => 1.3725, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.42% (1.2021 => 1.2432, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0821 => 1.1176, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 3.26% (4.7455 => 4.9004, std.dev.: 0.0508) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.23% (6.2546 => 6.4566, std.dev.: 0.0465) MultiSource/Applications/ClamAV/clamscan: 3.06% (14.6079 => 15.0547, std.dev.: 0.0935) MultiSource/Applications/siod/siod: 2.96% (2.0972 => 2.1592, std.dev.: 0.0190) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.4908 => 6.6810, std.dev.: 0.0517) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (4.0318 => 4.1442, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.77% (1.4113 => 1.4504, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.74% (0.8569 => 0.8804, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 2.74% (3.5980 => 3.6966, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8405 => 0.8628, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.7256 => 15.0953, std.dev.: 0.1114) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.0689 => 1.0956, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.24% (4.2815 => 4.3772, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (1.3935 => 1.4128, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 48.29% (0.0263 => 0.0390, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 39.46% (0.0261 => 0.0364, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.72% (0.0766 => 0.0940, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std.dev.: 0.0390) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.90% (0.0917 => 0.1072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.91% (1.7426 => 2.0025, std.dev.: 0.0312) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5443, std.dev.: 0.0772) SingleSource/Benchmarks/Stanford/Puzzle: 12.91% (0.1433 => 0.1618, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 12.16% (1.0063 => 1.1287, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8070, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/lists: 8.95% (7.0025 => 7.6293, std.dev.: 0.1043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 8.75% (21.1721 => 23.0238, std.dev.: 0.5847) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.3301 => 0.3465, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 4.58% (15.2242 => 15.9208, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.94% (0.7609 => 0.7909, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.79% (3.4080 => 3.5371, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (4.2129 => 4.3647, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (40.4792 => 41.8554, std.dev.: 0.5134) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.6308 => 0.6507, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.06% (0.5876 => 0.6056, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 2.95% (3.8907 => 4.0055, std.dev.: 0.0198) MultiSource/Applications/hexxagon/hexxagon: 2.83% (14.4877 => 14.8977, std.dev.: 0.0233) MultiSource/Applications/siod/siod: 2.62% (3.5520 => 3.6449, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.24% (6.6312 => 6.7795, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4013 => 2.4483, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.78% (0.3497 => 0.2106, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.41% (5.2665 => 4.1915, std.dev.: 0.2095) SingleSource/Benchmarks/Shootout-C++/ary3: -20.19% (1.7473 => 1.3945, std.dev.: 0.0859) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.39% (1.1647 => 0.9622, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.11% (15.8312 => 13.2808, std.dev.: 0.2048) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.43% (0.0917 => 0.0803, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std.dev.: 0.0772) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -7.17% (7.6833 => 7.1327, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/richards_benchmark: -6.99% (1.4441 => 1.3431, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3735, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.74% (2.0027 => 1.8678, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3315, std.dev.: 0.0359) MultiSource/Applications/SIBsim4/SIBsim4: -6.15% (3.4230 => 3.2124, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7960, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9255, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7254, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1858, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.40% (2.5166 => 2.4059, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.76% (1.2722 => 1.2244, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.63% (9.2503 => 8.9143, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2854, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/misr: -2.65% (0.4296 => 0.4182, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -2.53% (29.5232 => 28.7773, std.dev.: 0.0678) MultiSource/Applications/JM/lencod/lencod: -2.24% (6.7458 => 6.5949, std.dev.: 0.0387) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.21% (3.7496 => 3.6668, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.03% (1.1683 => 1.1446, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4222, std.dev.: 0.0103) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3666, std.dev.: 0.0116) MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (92.7467 => 91.0741, std.dev.: 0.4090) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.63% (1.8739 => 1.8433, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2331, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8165, std.dev.: 0.1123) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4649, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.36% (0.9980 => 1.0116, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.37% (0.6022 => 0.6165, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 0.78% (0.1666 => 0.1679, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.74% (0.1554 => 0.1581, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.3083 => 0.3152, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.84% (0.2394 => 0.2414, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.48% (0.3175 => 0.3222, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.87% (0.2302 => 0.2322, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 1.12% (0.0089 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0284 => 0.0283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -5.82% (0.0189 => 0.0178, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1429 => 0.1444, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -2.18% (1.5019 => 1.4692, std.dev.: 0.0392) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.93% (0.1501 => 0.1472, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.41% (0.4264 => 0.4204, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.1344 => 0.1439, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.0589 => 0.0555, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.79% (0.0232 => 0.0264, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.16% (0.0639 => 0.0606, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1350 => 1.1281, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.78% (0.0637 => 0.0642, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (0.0246 => 0.0178, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.89% (1.5363 => 1.5961, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 08:07:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 10:07:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930150700.CBD242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4420?compare_to=4416&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4420, Order: 164917, Start Time: 2012-09-30 13:48:08, End Time: 2012-09-30 15:08:37 To: 4416, Order: 164915, Start Time: 2012-09-30 11:58:28, End Time: 2012-09-30 13:18:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (144 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (705 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (54.7745 => 56.5284, std.dev.: 0.0965) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.40% (0.8814 => 0.8691, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.05% (80.5275 => 78.8801, std.dev.: 0.1795) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5747 => 0.5743, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: -0.27% (15.9980 => 15.9555, std.dev.: 0.0420) MultiSource/Applications/kimwitu++/kc: -0.25% (14.9499 => 14.9123, std.dev.: 0.0237) MultiSource/Benchmarks/Bullet/bullet: 0.27% (83.0489 => 83.2725, std.dev.: 0.0377) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.3525 => 4.3491, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.65% (0.0460 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.65% (0.0462 => 0.0459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.47% (0.0430 => 0.0428) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.69% (0.0432 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.72% (0.0419 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0421 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0413 => 0.0411) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.96% (0.0416 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.72% (0.0415 => 0.0412, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.72% (0.0417 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.71% (0.0423 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.71% (0.0424 => 0.0421) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.69% (0.0434 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.04% (0.0442 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.73% (0.0410 => 0.0407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.73% (0.0412 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0422 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.72% (0.0414 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.74% (0.0406 => 0.0403, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.74% (0.0407 => 0.0404) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.50% (0.0404 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.74% (0.0407 => 0.0404) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.68% (0.0442 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0443 => 0.0441) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.74% (0.0404 => 0.0401) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.74% (0.0405 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.50% (0.0404 => 0.0402, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.74% (0.0406 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.73% (0.0413 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.72% (0.0414 => 0.0411) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.2308 => 1.2297, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.27% (7.5118 => 7.4916, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.26% (3.7053 => 3.6955, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.40% (0.6470 => 0.6444, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.07% (0.0713 => 0.0684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.67% (63.2438 => 83.2725, std.dev.: 0.0377) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14232.64% (0.0720 => 10.3195, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.10% (10.3673 => 14.7321, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 28.42% (0.1622 => 0.2083, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.83% (7.0540 => 8.0293, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.59% (2.2022 => 2.5014, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 13.13% (0.1432 => 0.1620, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.91% (1.1194 => 1.2639, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.91% (1.7609 => 1.9707, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.88% (0.3473 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.79% (0.1584 => 0.1739, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.64% (0.3516 => 0.3855, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3694 => 0.4045, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.32% (0.3927 => 0.4293, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3828 => 0.4183, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.08% (0.3886 => 0.4239, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.65% (0.3282 => 0.3566, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.24% (0.4879 => 0.5281, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 8.20% (10.4361 => 11.2919, std.dev.: 0.0114) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.82% (9.4845 => 10.2259, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.36% (0.6675 => 0.7166, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7433 => 0.7979, std.dev.: 0.0181) MultiSource/Applications/minisat/minisat: 7.34% (0.7115 => 0.7637, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.14% (0.3109 => 0.3331, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.6030 => 0.6458, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.09% (0.5569 => 0.5964, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.06% (5.7591 => 6.1658, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.88% (0.5105 => 0.5456, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.76% (1.5415 => 1.6457, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.69% (3.3354 => 3.5584, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.68% (1.3050 => 1.3922, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 6.60% (0.3423 => 0.3649, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.55% (4.2646 => 4.5441, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.55% (0.5860 => 0.6244, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.55% (0.8067 => 0.8595, std.dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference: 6.36% (0.7326 => 0.7792, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.35% (0.8172 => 0.8691, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.31% (0.2107 => 0.2240, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.24% (4.9449 => 5.2535, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.21% (5.0018 => 5.3123, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (8.1363 => 8.6381, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.96% (0.3422 => 0.3626, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.96% (0.7835 => 0.8302, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.92% (0.9765 => 1.0343, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.84% (1.1642 => 1.2322, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.4103 => 0.4341, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.78% (0.5020 => 0.5310, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.1861 => 1.2542, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 5.74% (1.0722 => 1.1337, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.65% (3.8723 => 4.0910, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 5.64% (0.3387 => 0.3578, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (7.9617 => 8.4035, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 5.48% (0.4289 => 0.4524, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.47% (0.6456 => 0.6809, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (0.4064 => 0.4285, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.40% (0.2891 => 0.3047, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.33% (2.0273 => 2.1353, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.23% (0.3650 => 0.3841, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 5.23% (0.2831 => 0.2979, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.22% (1.5603 => 1.6417, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3865 => 0.4065, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.17% (21.9371 => 23.0703, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.16% (0.4203 => 0.4420, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.15% (0.3826 => 0.4023, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 5.15% (0.3283 => 0.3452, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.14% (0.4299 => 0.4520, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2725 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.09% (0.3162 => 0.3323, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (0.4620 => 0.4852, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.01% (2.0665 => 2.1701, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.99% (0.4048 => 0.4250, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.97% (2.2969 => 2.4111, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/except: 4.91% (0.2871 => 0.3012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.90% (0.2756 => 0.2891, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.89% (0.8921 => 0.9357, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 4.85% (0.3052 => 0.3200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2872 => 0.3011, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.83% (0.3603 => 0.3777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6450 => 0.6761, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2877 => 0.3014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3684 => 0.3859, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3935 => 0.4121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.69% (0.2793 => 0.2924, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.65% (1.5859 => 1.6597, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.62% (0.3379 => 0.3535, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5981 => 0.6257, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.60% (0.2802 => 0.2931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.46% (1.4186 => 1.4818, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (2.2024 => 2.2932, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.01% (14.3668 => 14.9435, std.dev.: 0.0178) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.1840 => 1.2310, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2842 => 1.3279, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 3.39% (0.3131 => 0.3237, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.01% (0.3427 => 0.3530, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.81% (0.8101 => 0.8329, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.88% (17.1811 => 17.5049, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (3.8922 => 3.9622, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.1396 => 1.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7696, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (4.2280 => 4.3526, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2278, std.dev.: 0.0214) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5749, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.14% (5.2763 => 3.2639, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.87% (5.3855 => 3.8848, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.46% (5.3526 => 3.8830, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1970, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.99% (2.9384 => 2.6154, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -7.78% (22.1758 => 20.4509, std.dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -11.74% (1.2373 => 1.0921, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2671, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.93% (1.6805 => 1.5976, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4987, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.05% (10.2830 => 10.0727, std.dev.: 0.0219) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9950, std.dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.94% (8.6802 => 8.5114, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -1.76% (2.5528 => 2.5078, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2545, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2271, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.83% (0.5229 => 0.5743, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 6.44% (14.9895 => 15.9555, std.dev.: 0.0420) MultiSource/Applications/kimwitu++/kc: 5.35% (14.1553 => 14.9123, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/gs/gs: 5.80% (4.1105 => 4.3491, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.31% (1.1048 => 1.2297, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.66% (7.1582 => 7.4916, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.72% (3.4629 => 3.6955, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.6222 => 0.6444, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 10:41:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 12:41:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930174132.B28582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4421?compare_to=4417&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4421, Order: 164917, Start Time: 2012-09-30 16:17:31, End Time: 2012-09-30 17:43:09 To: 4417, Order: 164915, Start Time: 2012-09-30 11:58:35, End Time: 2012-09-30 13:24:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (178 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.86% (78.3728 => 80.6109, std.dev.: 0.3505) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.94% (56.3628 => 54.7075, std.dev.: 0.1405) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7524 => 2.7526, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (2.1155 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9748 => 4.9745, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.02% (2.0176 => 2.4417, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.57% (0.5818 => 0.6433, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 10.51% (0.4328 => 0.4783, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 10.46% (0.5748 => 0.6349, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.31% (3.9660 => 4.3750, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 10.23% (0.7038 => 0.7758, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 10.17% (0.4062 => 0.4475, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.02% (0.2596 => 0.2856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.93% (0.7061 => 0.7762, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 9.88% (1.3693 => 1.5046, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 9.85% (0.2781 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.83% (0.7710 => 0.8468, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.3899 => 0.4279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.74% (0.5265 => 0.5778, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1327 => 0.1456, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.68% (1.2193 => 1.3373, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.65% (0.6283 => 0.6889, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.61% (0.6959 => 0.7628, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.49% (0.2782 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.40% (0.3022 => 0.3306, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.38% (0.9199 => 1.0062, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.34% (1.1364 => 1.2425, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.29% (13.8202 => 15.1041, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.25% (1.4563 => 1.5910, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2607 => 0.2846, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.15% (0.3485 => 0.3804, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.4791 => 0.5226, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.00% (0.2690 => 0.2932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.98% (1.9828 => 2.1609, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.96% (0.2655 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.95% (0.4390 => 0.4783, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 8.95% (0.2761 => 0.3008, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.91% (0.2726 => 0.2969, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.90% (0.2628 => 0.2862, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.89% (0.3489 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.85% (0.3580 => 0.3897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.85% (0.2937 => 0.3197, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.84% (0.2760 => 0.3004, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.81% (1.0313 => 1.1222, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.81% (0.3756 => 0.4087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.75% (0.3293 => 0.3581, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.74% (0.4016 => 0.4367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.73% (0.2966 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.72% (0.2765 => 0.3006, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.64% (0.2696 => 0.2929, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 8.63% (0.3868 => 0.4202, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 8.59% (0.3107 => 0.3374, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.59% (0.5577 => 0.6056, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 8.57% (0.3149 => 0.3419, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.53% (0.3246 => 0.3523, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 8.37% (0.2988 => 0.3238, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.33% (0.6576 => 0.7124, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 8.27% (0.3192 => 0.3456, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 8.22% (0.3453 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 8.19% (3.8646 => 4.1811, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 8.15% (0.3534 => 0.3822, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.13% (0.2127 => 0.2300, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.02% (1.1061 => 1.1948, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (3.6692 => 3.9617, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.4379 => 0.4728, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.94% (16.6129 => 17.9321, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 7.93% (0.8310 => 0.8969, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.86% (0.5637 => 0.6080, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.85% (0.3578 => 0.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.78% (0.7506 => 0.8090, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.76% (0.2914 => 0.3140, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.74% (0.2945 => 0.3173, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.72% (0.3914 => 0.4216, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3601 => 0.3877, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3663 => 0.3943, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.62% (0.6744 => 0.7258, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.59% (0.7460 => 0.8026, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (7.2180 => 7.7651, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.56% (1.0594 => 1.1395, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.3220 => 0.3462, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3623 => 0.3895, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.48% (3.1889 => 3.4274, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.48% (2.1791 => 2.3420, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.27% (1.9270 => 2.0670, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.22% (0.8698 => 0.9326, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.11% (1.3245 => 1.4187, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.11% (0.3755 => 0.4022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.07% (0.1569 => 0.1680, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.96% (1.3813 => 1.4775, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.96% (0.6135 => 0.6562, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.93% (1.3819 => 1.4777, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.86% (14.8535 => 15.8730, std.dev.: 0.0155) MultiSource/Applications/SIBsim4/SIBsim4: 6.83% (1.2749 => 1.3620, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.67% (4.6629 => 4.9740, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 6.60% (8.4961 => 9.0571, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.57% (0.8818 => 0.9397, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.54% (4.3801 => 4.6664, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.52% (4.4433 => 4.7328, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1333 => 1.2067, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4113 => 0.4378, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.44% (0.2859 => 0.3043, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 6.23% (14.5298 => 15.4351, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.11% (13.2842 => 14.0965, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.10% (0.3511 => 0.3725, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (3.2742 => 3.4728, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2504 => 0.2655, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.03% (6.5754 => 6.9716, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.01% (1.2292 => 1.3031, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.60% (0.4805 => 0.5074, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.54% (4.9865 => 5.2628, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 5.50% (0.6250 => 0.6594, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.3245 => 0.3418, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.21% (1.5188 => 1.5979, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.15% (0.9108 => 0.9577, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.96% (3.7467 => 3.9325, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.61% (2.1007 => 2.1975, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (6.2785 => 6.5606, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 4.16% (33.2944 => 34.6810, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.96% (16.2614 => 16.7420, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5124, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2557, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7260, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.80% (10.7476 => 11.0481, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6007, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5830, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2260, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5868, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.01% (8.8259 => 8.9148, std.dev.: 0.0200) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.67% (22.5627 => 21.9613, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2308 => 1.0928, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3041, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3030, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9457, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7054, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2157, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1732, std.dev.: 0.0284) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2508, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8708, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 11:06:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 13:06:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120930180655.52D882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4422?compare_to=4418&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4422, Order: 164917, Start Time: 2012-09-30 14:58:28, End Time: 2012-09-30 18:08:32 To: 4418, Order: 164912, Start Time: 2012-09-30 11:19:22, End Time: 2012-09-30 14:29:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (130 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.55% (9.8061 => 9.9585, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.55% (1.6829 => 1.6063, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (9.8105 => 9.8109, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.03% (9.4126 => 9.4101, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.05% (16.9576 => 16.9653, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.89% (0.3465 => 0.3877, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3446 => 0.3853, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3469 => 0.3878) SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3442 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.67% (0.3488 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 11.34% (0.3650 => 0.4064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3643 => 0.4055, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.14% (0.3724 => 0.4139, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.14% (1.5932 => 1.7547, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5826 => 0.6292, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.5889 => 0.6358, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (1.3152 => 1.4093, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.95% (1.6211 => 1.7337, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2875 => 0.3074, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 6.86% (0.3004 => 0.3210, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.79% (0.4361 => 0.4657, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 6.68% (0.7171 => 0.7650, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.65% (0.2813 => 0.3000, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.63% (0.4994 => 0.5325, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3195 => 0.3406, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.59% (0.2823 => 0.3009, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2738 => 0.2918, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.55% (0.2750 => 0.2930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2729 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.46% (0.5000 => 0.5323, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (2.0673 => 2.2007, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.44% (5.5417 => 5.8985, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: 6.38% (1.0781 => 1.1469, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 6.36% (0.9909 => 1.0539, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (3.5627 => 3.7891, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2803 => 0.2981, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3267 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.3096 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.26% (0.3258 => 0.3462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2780 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2792 => 0.2966, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2811 => 0.2986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.17% (0.4146 => 0.4402, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.2911 => 0.3090, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (0.5026 => 0.5335, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3625 => 0.3846, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.09% (2.7292 => 2.8954, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.08% (0.3124 => 0.3314, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.06% (0.3317 => 0.3518, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3060 => 0.3244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.3362 => 0.3562, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.92% (0.2566 => 0.2718, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (0.5900 => 0.6249, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 5.87% (4.2109 => 4.4579, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 5.85% (0.3348 => 0.3544, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.3845 => 0.4070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.82% (0.3726 => 0.3943, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.82% (0.3282 => 0.3473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.82% (0.3678 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 5.79% (23.5202 => 24.8819, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 5.78% (0.3477 => 0.3678, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.77% (0.2736 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4251 => 0.4495, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.72% (4.4195 => 4.6721, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 5.70% (0.6634 => 0.7012, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.61% (0.3690 => 0.3897, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.61% (0.4029 => 0.4255, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.45% (0.3890 => 0.4102, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.39% (4.6177 => 4.8668, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 5.39% (1.8794 => 1.9807, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 5.33% (2.1013 => 2.2133, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.32% (0.2068 => 0.2178, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.28% (0.6435 => 0.6775, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.3981 => 0.4191, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 5.24% (1.4269 => 1.5016, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.22% (0.4139 => 0.4355, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 5.11% (2.1653 => 2.2759, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.07% (0.3903 => 0.4101, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.3084 => 0.3240) SingleSource/Benchmarks/Misc-C++/bigfib: 5.03% (0.5012 => 0.5264, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.01% (0.2737 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.00% (0.2040 => 0.2142, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.96% (0.5546 => 0.5821, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.81% (0.7875 => 0.8254, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 4.80% (0.3336 => 0.3496, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (0.4658 => 0.4881, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.62% (0.3271 => 0.3422, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (1.9966 => 2.0880, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.55% (1.9694 => 2.0590, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 4.54% (2.0346 => 2.1269, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.34% (0.2969 => 0.3098, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.32% (0.9697 => 1.0116, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 4.27% (0.2391 => 0.2493) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.21% (0.7426 => 0.7739, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.14% (0.5361 => 0.5583, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 4.11% (0.4847 => 0.5046, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.78% (0.5584 => 0.5795, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.48% (11.6398 => 12.0444, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.24% (4.6926 => 4.8447, std.dev.: 0.0171) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.3498 => 0.3601, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.68% (0.4253 => 0.4367, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.82% (11.9555 => 12.1732, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: 1.36% (2.4764 => 2.5101, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6763, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1692, std.dev.: 0.0430) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6349, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1972, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (41.7953 => 42.6231, std.dev.: 0.0160) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5070, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5932, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5525, std.dev.: 0.0159) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7930, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.45% (0.2402 => 0.2271, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8000, std.dev.: 0.0112) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.54% (0.6293 => 0.6133, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -2.45% (17.2379 => 16.8161, std.dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5750, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 12:19:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 14:19:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930191908.2E0A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4423?compare_to=4419&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4423, Order: 164918, Start Time: 2012-09-30 17:57:50, End Time: 2012-09-30 19:20:47 To: 4419, Order: 164917, Start Time: 2012-09-30 13:24:02, End Time: 2012-09-30 14:46:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (76 on baseline) Performance Improvements: 3 (49 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 964 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.37% (0.9502 => 0.9632, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (1.4128 => 1.4282, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (3.2414 => 3.4756, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/hash: 3.83% (0.6507 => 0.6756, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.70% (1.3807 => 1.4318, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.97% (22.1218 => 22.5571, std.dev.: 0.1113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.31% (0.8367 => 0.8257, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.24% (1.4960 => 1.4774, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -8.23% (3.3148 => 3.0419, std.dev.: 0.0960) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.37% (1.0116 => 1.0153, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: -0.19% (0.6165 => 0.6153, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 1.13% (0.1679 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1581 => 0.1580, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.89% (0.3152 => 0.3124, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2414 => 0.2413, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.56% (0.3222 => 0.3240, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.15% (0.2322 => 0.2272, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -8.81% (0.0454 => 0.0414, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: -28.89% (0.0090 => 0.0064, std.dev.: 0.0013) SingleSource/UnitTests/2003-08-11-VaListArg: -63.33% (0.0090 => 0.0033, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0242 => 0.0244, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.15% (0.0192 => 0.0161, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0387 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.76% (0.0299 => 0.0219, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.12% (0.0283 => 0.0277, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.56% (0.0321 => 0.0326, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0179 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 6.18% (0.0178 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.00% (0.0250 => 0.0255, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -2.13% (0.0329 => 0.0322, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1444 => 0.1445, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 0.16% (1.4692 => 1.4716, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.72% (0.1472 => 0.1432, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.66% (0.4204 => 0.4050, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.41% (0.1439 => 0.1390, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.29% (0.0555 => 0.0601, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.86% (0.0264 => 0.0201, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.77% (0.0606 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1281 => 1.1292, std.dev.: 0.0566) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.93% (0.0642 => 0.0559, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.79% (0.0178 => 0.0141, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.7660 => 0.7649, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.06% (1.5961 => 1.5952, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.22% (0.0121 => 0.0105, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.90% (4.1772 => 3.0954, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/except: 81850.00% (0.0006 => 0.4917, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.40% (0.0745 => 0.0897, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.40% (0.1414 => 0.1561, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1159 => 0.1276, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 9.38% (0.5309 => 0.5807, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 7.92% (2.1763 => 2.3486, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.57% (0.6410 => 0.6895, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 7.13% (0.6173 => 0.6613, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.21% (1.0046 => 1.0670, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.2552 => 0.2704, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (1.1653 => 1.2342, std.dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: 5.77% (0.6915 => 0.7314, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 5.61% (15.3105 => 16.1701, std.dev.: 0.0824) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.36% (0.3582 => 0.3774, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 5.01% (29.3170 => 30.7866, std.dev.: 0.0472) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (1.5150 => 1.5903, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.96% (0.6069 => 0.6370, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.91% (0.7639 => 0.8014, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 4.88% (0.3217 => 0.3374, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.75% (0.4880 => 0.5112, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.61% (0.2797 => 0.2926, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.38% (0.3062 => 0.3196, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.36% (0.3901 => 0.4071, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.21% (1.1827 => 1.2325, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 4.03% (3.0225 => 3.1442, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (12.6413 => 13.1172, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.3847 => 0.3988, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.42% (2.0972 => 2.1690, std.dev.: 0.0236) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.1672 => 1.2062, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 3.30% (8.2186 => 8.4896, std.dev.: 0.0092) MultiSource/Applications/hbd/hbd: 3.25% (1.3268 => 1.3699, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 3.23% (13.3238 => 13.7541, std.dev.: 0.0941) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.13% (0.3418 => 0.3525, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.3520 => 0.3629, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3412 => 0.3513, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.95% (1.2021 => 1.2376, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.7226 => 0.7439, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 2.69% (3.5980 => 3.6947, std.dev.: 0.0223) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.6079 => 14.9986, std.dev.: 0.0906) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.0689 => 1.0973, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.64% (0.8569 => 0.8795, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.55% (6.2546 => 6.4143, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.4408 => 1.4774, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (4.0318 => 4.1331, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.51% (3.0758 => 3.1529, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.49% (1.3935 => 1.4282, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.0317 => 2.0819, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.43% (0.5937 => 0.6081, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.20% (0.9425 => 0.9632, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.5963 => 0.6080, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.8796 => 3.9551, std.dev.: 0.0277) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.24% (1.6538 => 2.3358, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.05% (3.4629 => 4.2263, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 14.55% (1.7426 => 1.9962, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.08% (4.0101 => 4.5347, std.dev.: 0.0164) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.56% (0.0917 => 0.1023, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 10.91% (1.6261 => 1.8035, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1433 => 0.1563, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6079, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash: 7.10% (0.6308 => 0.6756, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3301 => 0.3472, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.83% (40.4792 => 42.4330, std.dev.: 0.2819) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 3.96% (15.2242 => 15.8269, std.dev.: 0.0682) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.20% (0.8498 => 0.8770, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8964, std.dev.: 0.0163) MultiSource/Benchmarks/sim/sim: 2.73% (3.8907 => 3.9970, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (6.6312 => 6.7750, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.09% (3.5520 => 3.6262, std.dev.: 0.0180) SingleSource/Benchmarks/Dhrystone/dry: 1.92% (2.4013 => 2.4474, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.79% (4.6127 => 4.6952, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.29% (5.2665 => 4.1450, std.dev.: 0.2447) SingleSource/Benchmarks/Shootout-C++/ary3: -20.43% (1.7473 => 1.3904, std.dev.: 0.1135) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.45% (1.1647 => 0.9615, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.80% (15.8312 => 13.1709, std.dev.: 0.1797) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.79% (1.4034 => 1.2800, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.29% (3.2007 => 2.9355, std.dev.: 0.0337) MultiSource/Applications/lambda-0_1_3/lambda: -7.11% (7.6833 => 7.1374, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3745, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3312, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.33% (1.4441 => 1.3527, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7927, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -6.00% (3.4230 => 3.2175, std.dev.: 0.0175) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (62.4126 => 58.9117, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7252, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1861, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.10% (61.1734 => 58.0551, std.dev.: 1.0388) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: -4.69% (0.2664 => 0.2539, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -4.14% (2.5166 => 2.4123, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: -4.00% (0.3746 => 0.3596, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.77% (1.2722 => 1.2242, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.60% (1.2959 => 1.2492, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.52% (3.6023 => 3.4756, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/methcall: -2.86% (9.2503 => 8.9858, std.dev.: 0.0426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.83% (3.7496 => 3.6436, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/misr: -2.56% (0.4296 => 0.4186, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -2.36% (92.7467 => 90.5553, std.dev.: 0.7996) MultiSource/Applications/JM/lencod/lencod: -2.31% (6.7458 => 6.5899, std.dev.: 0.0426) MultiSource/Applications/lua/lua: -2.30% (29.5232 => 28.8431, std.dev.: 0.0557) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.11% (1.1683 => 1.1437, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -2.01% (3.4876 => 3.4174, std.dev.: 0.0236) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.83% (0.6119 => 0.6007, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3662, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/ffbench: -1.77% (1.4117 => 1.3867, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.42% (9.3855 => 9.2525, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3073, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.39% (27.1724 => 26.7941, std.dev.: 0.0756) SingleSource/Benchmarks/Shootout-C++/lists: -1.39% (16.5617 => 16.3313, std.dev.: 0.0849) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.30% (1.8739 => 1.8496, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4649, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: -1.27% (2.0192 => 1.9935, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.73% (0.9980 => 1.0153, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 2.18% (0.6022 => 0.6153, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 1.92% (0.1666 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.67% (0.1554 => 0.1580, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (0.3083 => 0.3124, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.79% (0.2394 => 0.2413, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.05% (0.3175 => 0.3240, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.30% (0.2302 => 0.2272, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -7.80% (0.0449 => 0.0414, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: -28.09% (0.0089 => 0.0064, std.dev.: 0.0013) SingleSource/UnitTests/2003-08-11-VaListArg: -63.33% (0.0090 => 0.0033, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.15% (0.0192 => 0.0161, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.24% (0.0301 => 0.0219, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.46% (0.0284 => 0.0277, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1429 => 0.1445, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -2.02% (1.5019 => 1.4716, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.60% (0.1501 => 0.1432, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.02% (0.4264 => 0.4050, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.42% (0.1344 => 0.1390, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.04% (0.0589 => 0.0601, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1350 => 1.1292, std.dev.: 0.0566) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.24% (0.0637 => 0.0559, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.68% (0.0246 => 0.0141, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.83% (1.5363 => 1.5952, std.dev.: 0.0023) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0070 => 0.0105, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 12:29:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 14:29:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930192923.7E4AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4424?compare_to=4420&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4424, Order: 164918, Start Time: 2012-09-30 18:10:27, End Time: 2012-09-30 19:30:59 To: 4420, Order: 164917, Start Time: 2012-09-30 13:48:08, End Time: 2012-09-30 15:08:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (144 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 948 (706 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.17% (0.8691 => 0.8793, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.20% (7.9583 => 8.0537, std.dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5743 => 0.5746, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 0.21% (15.9555 => 15.9884, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 0.12% (14.9123 => 14.9299, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -0.03% (83.2725 => 83.2451, std.dev.: 0.0317) MultiSource/Benchmarks/MallocBench/gs/gs: -0.03% (4.3491 => 4.3480, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0459 => 0.0459, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0429 => 0.0429, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0412 => 0.0413, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0430 => 0.0430, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0403 => 0.0404, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0402 => 0.0402) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0404 => 0.0404) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0401 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0402 => 0.0403) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2297 => 1.2280, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.17% (7.4916 => 7.5042, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.14% (3.6955 => 3.7005, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.34% (0.6444 => 0.6466, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0684 => 0.0685, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.63% (63.2438 => 83.2451, std.dev.: 0.0317) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14251.67% (0.0720 => 10.3332, std.dev.: 0.0068) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.17% (10.3673 => 14.7394, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 28.30% (0.1622 => 0.2081, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.79% (0.0834 => 0.0949, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.78% (7.0540 => 8.0261, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.36% (2.2022 => 2.4965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.77% (1.1194 => 1.2623, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.12% (1.7609 => 1.9568, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1625 => 0.1783, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.68% (0.3927 => 0.4307, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.67% (0.3828 => 0.4198, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 9.47% (0.3886 => 0.4254, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 8.59% (0.3282 => 0.3564, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 8.15% (10.4361 => 11.2863, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.03% (0.4879 => 0.5271, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.3177 => 0.3431, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.77% (9.4845 => 10.2212, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.60% (0.8172 => 0.8793, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.52% (0.5105 => 0.5489, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.51% (0.7115 => 0.7649, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 7.48% (0.7433 => 0.7989, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.46% (0.6675 => 0.7173, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.32% (0.4615 => 0.4953, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 7.31% (0.5925 => 0.6358, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5569 => 0.5974, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.6030 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2700 => 0.2891, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.01% (0.3109 => 0.3327, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.96% (1.5415 => 1.6488, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.4103 => 0.4387, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.86% (5.7591 => 6.1540, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3423 => 0.3656, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.75% (1.3050 => 1.3931, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.75% (3.3354 => 3.5604, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 6.58% (0.7326 => 0.7808, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (4.2646 => 4.5425, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.51% (0.8067 => 0.8592, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (8.1363 => 8.6446, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.23% (4.9449 => 5.2530, std.dev.: 0.0083) MultiSource/Applications/Burg/burg: 6.20% (1.1642 => 1.2364, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.18% (5.0018 => 5.3110, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4636 => 0.4921, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.2905 => 0.3083, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.13% (0.7835 => 0.8315, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 6.11% (0.3092 => 0.3281, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.02% (0.3422 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.98% (0.3162 => 0.3351, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.97% (0.9765 => 1.0348, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.96% (0.3441 => 0.3646, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.86% (0.5020 => 0.5314, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.80% (3.8723 => 4.0968, std.dev.: 0.0130) MultiSource/Applications/lemon/lemon: 5.76% (1.0722 => 1.1340, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.1861 => 1.2542, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (0.4064 => 0.4295, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.67% (0.6456 => 0.6822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.67% (0.4289 => 0.4532, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.60% (0.3180 => 0.3358, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2891 => 0.3052, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3650 => 0.3852, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.51% (0.2831 => 0.2987, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.49% (2.0273 => 2.1387, std.dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.45% (7.9617 => 8.3959, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3865 => 0.4075, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.39% (0.2725 => 0.2872, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.38% (0.2603 => 0.2743, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.36% (1.5603 => 1.6440, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3283 => 0.3457, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.3232 => 0.3401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.22% (0.4620 => 0.4861, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.19% (0.2756 => 0.2899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (2.0665 => 2.1733, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 5.12% (0.4299 => 0.4519, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.11% (21.9371 => 23.0585, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.4048 => 0.4254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.08% (0.2872 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.08% (0.3603 => 0.3786, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.05% (0.6450 => 0.6776, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.02% (2.2969 => 2.4123, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.3052 => 0.3205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.94% (0.3684 => 0.3866, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.93% (0.3935 => 0.4129, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2877 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.83% (0.8921 => 0.9352, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2802 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3379 => 0.3541, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.68% (1.5859 => 1.6601, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5981 => 0.6259, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.4186 => 1.4810, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (2.2024 => 2.2943, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 4.08% (1.1840 => 1.2323, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (14.3668 => 14.9507, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2842 => 1.3304, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 3.29% (0.3131 => 0.3234, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.16% (0.8101 => 0.8357, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.86% (17.1811 => 17.5013, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.57% (3.8922 => 3.9532, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.74% (1.1396 => 1.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3672, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.38% (3.6395 => 3.7624, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3496, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7995, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2135, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2558, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.09% (5.3855 => 3.8727, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.65% (5.3526 => 3.8725, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1565, std.dev.: 0.0400) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.14% (2.9384 => 2.6112, std.dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: -7.92% (22.1758 => 20.4202, std.dev.: 0.0365) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -11.18% (1.2373 => 1.0990, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (19.9488 => 18.2432, std.dev.: 0.0882) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.84% (1.8329 => 1.7075, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.50% (3.2827 => 3.1678, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5099, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.09% (8.1563 => 7.9858, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5006, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: -1.78% (12.4730 => 12.2511, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6831, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.60% (10.2830 => 10.1181, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.89% (0.5229 => 0.5746, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 6.66% (14.9895 => 15.9884, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 5.47% (14.1553 => 14.9299, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 5.78% (4.1105 => 4.3480, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.15% (1.1048 => 1.2280, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.83% (7.1582 => 7.5042, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.86% (3.4629 => 3.7005, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.92% (0.6222 => 0.6466, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 12:36:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 14:36:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930193606.B56362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4425?compare_to=4421&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4425, Order: 164918, Start Time: 2012-09-30 18:12:07, End Time: 2012-09-30 19:37:44 To: 4421, Order: 164917, Start Time: 2012-09-30 16:17:31, End Time: 2012-09-30 17:43:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.7075 => 56.6503, std.dev.: 0.0799) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7526 => 2.7524, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.29% (4.9745 => 4.9601, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.41% (2.0176 => 2.4496, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.86% (0.4328 => 0.4798, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.73% (0.4062 => 0.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.1588 => 0.1757, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.59% (3.9660 => 4.3861, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.45% (0.7061 => 0.7799, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.43% (0.2781 => 0.3071, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.25% (0.2721 => 0.3000, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.24% (0.7038 => 0.7759, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.15% (0.6959 => 0.7665, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.13% (0.2596 => 0.2859, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 10.11% (1.3693 => 1.5078, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2782 => 0.3063, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.07% (0.5265 => 0.5795, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.00% (0.3899 => 0.4289, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.93% (0.3022 => 0.3322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.83% (1.2193 => 1.3392, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.81% (0.3485 => 0.3827, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.74% (0.3130 => 0.3435, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.74% (0.6283 => 0.6895, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.67% (0.9199 => 1.0089, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.67% (0.2607 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.64% (0.7710 => 0.8453, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 9.55% (0.2690 => 0.2947, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.54% (1.9828 => 2.1719, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.51% (0.2628 => 0.2878, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.47% (13.8202 => 15.1291, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.46% (1.4563 => 1.5940, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.43% (1.1364 => 1.2436, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.42% (0.3756 => 0.4110, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.39% (0.2726 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.37% (0.3489 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.4791 => 0.5240, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3580 => 0.3915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2765 => 0.3021, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.24% (0.4016 => 0.4387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.21% (0.3107 => 0.3393, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.20% (0.2966 => 0.3239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.20% (0.3293 => 0.3596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.10% (0.3868 => 0.4220, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 9.02% (0.3149 => 0.3433, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.95% (1.0313 => 1.1236, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.75% (0.3246 => 0.3530, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.73% (0.5577 => 0.6064, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 8.72% (0.3453 => 0.3754, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1276 => 0.1387, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 8.68% (0.3192 => 0.3469, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.65% (0.2995 => 0.3254, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3534 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.22% (3.8646 => 4.1824, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.20% (0.4379 => 0.4738, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 8.19% (16.6129 => 17.9743, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2945 => 0.3186, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.18% (0.6576 => 0.7114, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.15% (1.1061 => 1.1962, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 8.09% (0.8310 => 0.8982, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.00% (3.6692 => 3.9628, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.2914 => 0.3147, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.99% (0.7506 => 0.8106, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.95% (0.5637 => 0.6085, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.84% (0.6744 => 0.7273, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.84% (0.7460 => 0.8045, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.77% (7.2180 => 7.7791, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3578 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.70% (0.3220 => 0.3468, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.68% (3.1889 => 3.4339, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.66% (1.0594 => 1.1406, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.66% (0.8698 => 0.9364, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.64% (0.3601 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3789 => 0.4078, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.62% (0.2925 => 0.3148, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.2243 => 0.2414, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.59% (1.9270 => 2.0733, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 7.56% (2.1791 => 2.3439, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3663 => 0.3939, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.48% (0.3755 => 0.4036, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.45% (0.3623 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.41% (0.2023 => 0.2173, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1865 => 0.2003, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.39% (1.3245 => 1.4224, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 7.27% (0.4113 => 0.4412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.1569 => 0.1683, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 7.16% (14.8535 => 15.9173, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.03% (1.3819 => 1.4790, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.98% (1.3813 => 1.4777, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 6.94% (1.2749 => 1.3634, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.91% (0.6135 => 0.6559, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.74% (4.3801 => 4.6754, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.72% (4.4433 => 4.7420, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.70% (8.4961 => 9.0655, std.dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 6.67% (4.6629 => 4.9738, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.65% (0.8818 => 0.9404, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.2859 => 0.3048, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.55% (1.1333 => 1.2075, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.47% (1.2292 => 1.3087, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.2140 => 0.2278, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.35% (13.2842 => 14.1283, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 6.29% (14.5298 => 15.4430, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.20% (3.2742 => 3.4773, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (6.5754 => 6.9818, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.10% (0.3511 => 0.3725, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2504 => 0.2653, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.4805 => 0.5082, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.74% (0.6250 => 0.6609, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.71% (4.9865 => 5.2711, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.61% (0.3245 => 0.3427, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.33% (1.5188 => 1.5998, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.9108 => 0.9590, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.07% (3.7467 => 3.9365, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.74% (2.1007 => 2.2002, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (6.2785 => 6.5697, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 4.42% (33.2944 => 34.7672, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 3.05% (16.2614 => 16.7580, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.85% (1.8175 => 2.2509, std.dev.: 0.0541) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.73% (1.1560 => 1.2569, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.54% (3.1736 => 3.4129, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3798, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7252, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.00% (10.7476 => 11.0700, std.dev.: 0.0384) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5908, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5844, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.17% (8.8259 => 8.9294, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5921, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2233, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.52% (22.5627 => 21.9930, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2308 => 1.0933, std.dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2978, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5111, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7943, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.47% (3.2729 => 3.1592, std.dev.: 0.0220) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2389, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7057, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2194, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2498, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1910, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2303, std.dev.: 0.0118) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4336, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 14:42:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 16:42:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930214238.655052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4426?compare_to=4423&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4426, Order: 164919, Start Time: 2012-09-30 20:17:32, End Time: 2012-09-30 21:41:11 To: 4423, Order: 164918, Start Time: 2012-09-30 17:57:50, End Time: 2012-09-30 19:20:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (70 on baseline) Performance Improvements: 5 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 957 (776 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.76% (0.8429 => 0.8577, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.34% (1.2888 => 1.3061, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.32% (0.8010 => 0.8116, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (2.3486 => 2.3762, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 7.70% (1.3904 => 1.4975, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.26% (58.0551 => 61.6887, std.dev.: 0.0981) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (42.4330 => 43.5674, std.dev.: 0.2666) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.11% (2.6807 => 2.7373, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 1.51% (1.9962 => 2.0264, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 1.23% (3.6262 => 3.6707, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/hash: 1.05% (4.3097 => 4.3550, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -4.03% (0.3123 => 0.2997, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.70% (1.4282 => 1.3896, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -1.74% (0.9632 => 0.9464, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.70% (1.4318 => 1.3359, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/hash: -3.85% (0.6756 => 0.6496, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.72% (1.0153 => 0.9978, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: -0.72% (0.6153 => 0.6109, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -4.95% (0.1698 => 0.1614, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.05% (0.1580 => 0.1516, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.86% (0.3124 => 0.3066, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.31% (0.2413 => 0.2309, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.04% (0.3240 => 0.3174, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.06% (0.2272 => 0.2296, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -6.76% (0.0414 => 0.0386, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: 37.50% (0.0064 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 178.79% (0.0033 => 0.0092) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.97% (0.0244 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.63% (0.0161 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.32% (0.0385 => 0.0326, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 36.53% (0.0219 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.81% (0.0277 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.61% (0.0326 => 0.0324, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -24.02% (0.0179 => 0.0136, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -11.64% (0.0189 => 0.0167, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.96% (0.0255 => 0.0250, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -4.04% (0.0322 => 0.0309, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.25% (0.1445 => 0.1427, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 3.51% (1.4716 => 1.5233, std.dev.: 0.0220) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.09% (0.1432 => 0.1462, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.47% (0.4050 => 0.4069, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.1390 => 0.1462, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.33% (0.0601 => 0.0609, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.91% (0.0201 => 0.0237, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.15% (0.0647 => 0.0646, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.1292 => 1.1245, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.25% (0.0559 => 0.0566, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.10% (0.0141 => 0.0206, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.7649 => 0.7666, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.41% (1.5952 => 1.6017, std.dev.: 0.0075) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.24% (0.0105 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.43% (4.1772 => 3.1568, std.dev.: 0.0647) SingleSource/Benchmarks/Shootout-C++/except: 83250.00% (0.0006 => 0.5001, std.dev.: 0.0019) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 9.19% (2.1763 => 2.3762, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.57% (0.6410 => 0.6895, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 6.89% (0.5309 => 0.5675, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 6.77% (0.6173 => 0.6591, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 6.71% (1.0046 => 1.0720, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (1.1653 => 1.2380, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.72% (0.3582 => 0.3787, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.51% (0.7639 => 0.8060, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 5.44% (15.3105 => 16.1427, std.dev.: 0.1089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.21% (0.6069 => 0.6385, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.97% (0.4248 => 0.4459, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.87% (0.3901 => 0.4091, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.6915 => 0.7224, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (1.5150 => 1.5793, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.00% (0.2797 => 0.2909, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.97% (29.3170 => 30.4814, std.dev.: 0.1871) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.90% (1.1672 => 1.2127, std.dev.: 0.0106) MultiSource/Applications/d/make_dparser: 3.88% (3.0225 => 3.1399, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (12.6413 => 13.1247, std.dev.: 0.0886) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3217 => 0.3330, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 3.20% (0.8405 => 0.8674, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 3.02% (13.3238 => 13.7257, std.dev.: 0.1055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.93% (0.8569 => 0.8820, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.89% (1.2021 => 1.2368, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.7226 => 0.7423, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0821 => 1.1109, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 2.63% (2.0972 => 2.1524, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.1827 => 1.2136, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 2.52% (8.2186 => 8.4258, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.2742 => 1.3061, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.6079 => 14.9709, std.dev.: 0.1031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (6.2546 => 6.4100, std.dev.: 0.0257) MultiSource/Applications/Burg/burg: 2.48% (1.1440 => 1.1724, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.43% (0.5520 => 0.5654, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.0689 => 1.0918, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.86% (1.4113 => 1.4376, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (4.0318 => 4.0933, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.23% (1.4189 => 1.4363, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.94% (0.0261 => 0.0407, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Bubblesort: 49.81% (0.0263 => 0.0394, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/pi: 40.95% (1.6538 => 2.3311, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.26% (3.4629 => 4.2337, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/ary3: 16.29% (1.7426 => 2.0264, std.dev.: 0.0094) SingleSource/Benchmarks/Stanford/Puzzle: 15.63% (0.1433 => 0.1657, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.63% (0.0917 => 0.1042, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.32% (0.0766 => 0.0868, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.19% (4.0101 => 4.5392, std.dev.: 0.0223) SingleSource/Benchmarks/McGill/queens: 11.15% (1.6261 => 1.8074, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.41% (1.0063 => 1.1010, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6125, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.09% (0.2857 => 0.3088, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.63% (40.4792 => 43.5674, std.dev.: 0.2666) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.30% (0.3301 => 0.3542, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: 4.17% (0.9851 => 1.0262, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8216, std.dev.: 0.0435) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.34% (3.5520 => 3.6707, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.11% (14.4877 => 14.9380, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.6308 => 0.6496, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 2.92% (3.8907 => 4.0042, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.69% (2.6656 => 2.7373, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (6.6312 => 6.7824, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.4013 => 2.4527, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.85% (4.6127 => 4.6981, std.dev.: 0.0236) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4396, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: 1.24% (4.3016 => 4.3550, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.22% (4.0659 => 4.1154, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.18% (0.7738 => 0.7492, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.41% (0.3497 => 0.2049, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.36% (5.2665 => 4.1941, std.dev.: 0.0684) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.1647 => 0.9605, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.12% (15.8312 => 13.2788, std.dev.: 0.0925) SingleSource/Benchmarks/Shootout-C++/ary3: -14.30% (1.7473 => 1.4975, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0472) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.23% (3.6023 => 3.2698, std.dev.: 0.1259) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.52% (1.4034 => 1.2839, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9445, std.dev.: 0.0232) MultiSource/Applications/lambda-0_1_3/lambda: -6.97% (7.6833 => 7.1481, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3753, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -6.56% (1.4441 => 1.3493, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.36% (4.6355 => 4.3405, std.dev.: 0.0229) MultiSource/Benchmarks/FreeBench/distray/distray: -6.16% (0.2664 => 0.2500, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7934, std.dev.: 0.0154) MultiSource/Applications/SIBsim4/SIBsim4: -5.81% (3.4230 => 3.2241, std.dev.: 0.0179) MultiSource/Benchmarks/mafft/pairlocalalign: -5.50% (62.4126 => 58.9777, std.dev.: 0.0455) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.43% (3.9413 => 3.7274, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/fib2: -5.13% (4.4195 => 4.1929, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.72% (1.4021 => 1.3359, std.dev.: 0.0188) MultiSource/Applications/sgefa/sgefa: -4.70% (0.3746 => 0.3570, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.81% (2.5166 => 2.4206, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.42% (1.2722 => 1.2287, std.dev.: 0.0106) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.32% (1.2959 => 1.2529, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/methcall: -3.21% (9.2503 => 8.9535, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.95% (0.4140 => 0.4018, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -2.61% (9.5474 => 9.2979, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -2.42% (1.0926 => 1.0662, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.33% (2.4457 => 2.3886, std.dev.: 0.0208) MultiSource/Benchmarks/PAQ8p/paq8p: -2.32% (92.7467 => 90.5957, std.dev.: 0.2884) MultiSource/Applications/JM/lencod/lencod: -2.26% (6.7458 => 6.5936, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.01% (3.7496 => 3.6741, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.96% (1.1683 => 1.1454, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -1.88% (29.5232 => 28.9691, std.dev.: 0.1159) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4224, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.80% (2.3569 => 2.3145, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0023) MultiSource/Applications/aha/aha: -1.58% (3.4286 => 3.3743, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2387, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3155, std.dev.: 0.0824) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8104, std.dev.: 0.0266) SingleSource/Benchmarks/Dhrystone/fldry: -1.18% (2.4971 => 2.4676, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.02% (0.9980 => 0.9978, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.44% (0.6022 => 0.6109, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -3.12% (0.1666 => 0.1614, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.45% (0.1554 => 0.1516, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.55% (0.3083 => 0.3066, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.55% (0.2394 => 0.2309, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.26% (0.2302 => 0.2296, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -14.03% (0.0449 => 0.0386, std.dev.: 0.0034) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.42% (0.0240 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.41% (0.0390 => 0.0326, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -23.16% (0.0177 => 0.0136, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -11.64% (0.0189 => 0.0167, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -4.92% (0.0325 => 0.0309, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1429 => 0.1427, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.42% (1.5019 => 1.5233, std.dev.: 0.0220) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.60% (0.1501 => 0.1462, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.57% (0.4264 => 0.4069, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.78% (0.1344 => 0.1462, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.40% (0.0589 => 0.0609, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.16% (0.0232 => 0.0237, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.10% (0.0639 => 0.0646, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.93% (1.1350 => 1.1245, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.15% (0.0637 => 0.0566, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.26% (0.0246 => 0.0206, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.66% (0.7541 => 0.7666, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.26% (1.5363 => 1.6017, std.dev.: 0.0075) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 14:45:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 16:45:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120930214551.129012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4427?compare_to=4422&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4427, Order: 164918, Start Time: 2012-09-30 18:37:24, End Time: 2012-09-30 21:47:29 To: 4422, Order: 164917, Start Time: 2012-09-30 14:58:28, End Time: 2012-09-30 18:08:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (135 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.2271 => 0.2162, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (9.8109 => 9.8103, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.01% (9.4101 => 9.4109, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (16.9653 => 16.9645, std.dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.73% (0.3496 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.70% (0.3488 => 0.3896, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3446 => 0.3848, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.65% (0.3460 => 0.3863, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.32% (0.3650 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.35% (0.1063 => 0.1173, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 10.16% (1.5932 => 1.7551, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.5889 => 0.6365, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5826 => 0.6296, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.67% (0.4994 => 0.5377, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2738 => 0.2939, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.29% (0.3004 => 0.3223, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.1619 => 0.1737, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.22% (1.3152 => 1.4101, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (1.6211 => 1.7376, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2875 => 0.3080, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (0.4361 => 0.4665, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 6.73% (5.5417 => 5.9145, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 6.72% (0.9909 => 1.0575, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.70% (0.3195 => 0.3409, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.2736 => 0.2919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.68% (0.2813 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.66% (0.2823 => 0.3011, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.64% (0.7171 => 0.7647, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2803 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2729 => 0.2909, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.57% (0.5026 => 0.5356, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 6.55% (0.2750 => 0.2930, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.53% (3.5627 => 3.7955, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary: 6.51% (0.3258 => 0.3470, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.49% (1.0781 => 1.1481, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.43% (2.0673 => 2.2003, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.42% (0.5000 => 0.5321, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3267 => 0.3476, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.36% (0.3096 => 0.3293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2792 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2780 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (2.7292 => 2.9018, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.27% (0.4146 => 0.4406, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.2911 => 0.3093, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3317 => 0.3523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.18% (0.3348 => 0.3555, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.18% (0.3124 => 0.3317, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.18% (0.3060 => 0.3249, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.15% (0.2811 => 0.2984, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3362 => 0.3567, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.06% (0.3930 => 0.4168, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (0.3625 => 0.3842, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.93% (0.5900 => 0.6250, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 5.93% (0.3726 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.93% (23.5202 => 24.9144, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/moments: 5.93% (0.3678 => 0.3896, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.93% (4.2109 => 4.4604, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 5.92% (0.2566 => 0.2718, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.3282 => 0.3475, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.88% (0.6634 => 0.7024, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.87% (0.3477 => 0.3681, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.80% (0.3690 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (4.4195 => 4.6749, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 5.76% (0.4251 => 0.4496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.2866 => 0.3026, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.55% (0.3890 => 0.4106, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.55% (0.3336 => 0.3521, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.54% (0.3845 => 0.4058, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.53% (2.1013 => 2.2176, std.dev.: 0.0161) MultiSource/Applications/JM/lencod/lencod: 5.50% (4.6177 => 4.8716, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 5.47% (1.8794 => 1.9822, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.43% (0.3981 => 0.4197, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.39% (0.6435 => 0.6782, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.2040 => 0.2150, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.3903 => 0.4111, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 5.33% (1.4269 => 1.5029, std.dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (2.1653 => 2.2800, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.2068 => 0.2177, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.2737 => 0.2881, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.19% (0.5546 => 0.5834, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.3084 => 0.3244, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.17% (0.4139 => 0.4353, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.5012 => 0.5266, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.91% (1.9694 => 2.0661, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (0.4658 => 0.4884, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.2103 => 0.2205, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.79% (1.9966 => 2.0923, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 4.69% (2.0346 => 2.1300, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.60% (0.7875 => 0.8237, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.2969 => 0.3105, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.54% (0.9697 => 1.0137, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 4.31% (0.4847 => 0.5056, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.27% (0.2391 => 0.2493, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.24% (0.7426 => 0.7741, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (0.2691 => 0.2800, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.03% (0.5361 => 0.5577, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (0.5584 => 0.5807, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.70% (11.6398 => 12.0703, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (4.6926 => 4.8570, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.14% (0.3498 => 0.3608, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.94% (0.4253 => 0.4378, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.96% (11.9555 => 12.1898, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 1.73% (2.4764 => 2.5193, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6818, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8906, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6400, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2030, std.dev.: 0.0468) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6426, std.dev.: 0.0129) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5073, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2204, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2891, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6014, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4584, std.dev.: 0.0278) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5372, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/ary2: -9.99% (0.2402 => 0.2162, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8008, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8038, std.dev.: 0.0102) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7672, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5740, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 14:49:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 16:49:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930214905.AAA3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4428?compare_to=4424&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4428, Order: 164919, Start Time: 2012-09-30 20:30:21, End Time: 2012-09-30 21:50:43 To: 4424, Order: 164918, Start Time: 2012-09-30 18:10:27, End Time: 2012-09-30 19:30:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (144 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 945 (706 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.97% (2.4965 => 2.5457, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (3.8727 => 3.9334, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 1.57% (14.7394 => 14.9702, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (3.8725 => 3.9303, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (8.0261 => 8.1226, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5746 => 0.5756, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -0.25% (15.9884 => 15.9492, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: -0.21% (14.9299 => 14.8980, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.01% (83.2451 => 84.0829, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.3480 => 4.3404, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0458 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0459 => 0.0459) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0411 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.38% (0.0434 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0402 => 0.0402, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0404 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0401 => 0.0402) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0403 => 0.0403) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2280 => 1.2271, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.5042 => 7.5162, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.02% (3.7005 => 3.6999, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.6466 => 0.6474, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1431 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0685 => 0.0685, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.95% (63.2438 => 84.0829, std.dev.: 0.0195) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.19% (0.0720 => 10.3199, std.dev.: 0.0094) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.40% (10.3673 => 14.9702, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 31.57% (0.1622 => 0.2134, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.60% (2.2022 => 2.5457, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.15% (7.0540 => 8.1226, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.82% (1.1194 => 1.2629, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.39% (1.7609 => 1.9615, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.91% (0.3543 => 0.3894, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3561 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.82% (0.3543 => 0.3891, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.79% (0.1584 => 0.1739, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 9.48% (0.3282 => 0.3593, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.43% (0.3828 => 0.4189, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3927 => 0.4296, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.16% (0.3886 => 0.4242, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.85% (10.4361 => 11.3597, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.86% (0.8172 => 0.8814, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 7.62% (9.4845 => 10.2074, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.27% (0.6675 => 0.7160, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.25% (5.7591 => 6.1766, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.6030 => 0.6467, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5925 => 0.6354, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.24% (0.7433 => 0.7971, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 7.10% (0.7115 => 0.7620, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.03% (0.5105 => 0.5464, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.89% (0.4615 => 0.4933, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 6.88% (0.3109 => 0.3323, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.73% (0.2554 => 0.2726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.67% (0.8067 => 0.8605, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.5860 => 0.6248, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.58% (1.5415 => 1.6430, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.58% (0.3422 => 0.3647, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.55% (0.1695 => 0.1806, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.54% (0.3423 => 0.3647, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.49% (3.3354 => 3.5519, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.48% (0.7835 => 0.8343, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.46% (0.7326 => 0.7799, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.45% (1.3050 => 1.3892, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.30% (0.4636 => 0.4928, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.27% (4.2646 => 4.5322, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.22% (8.1363 => 8.6427, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.16% (4.9449 => 5.2497, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.2905 => 0.3083, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.11% (0.5569 => 0.5909, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.08% (5.0018 => 5.3060, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.02% (0.3307 => 0.3506, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.90% (0.4289 => 0.4542, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2107 => 0.2231, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.76% (21.9371 => 23.2009, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (0.4064 => 0.4296, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.68% (0.9765 => 1.0320, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.66% (1.1642 => 1.2301, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.5020 => 0.5304, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.61% (0.3136 => 0.3312, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.60% (0.2891 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.3379 => 0.3567, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3650 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.56% (0.4103 => 0.4331, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.53% (3.8723 => 4.0863, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.49% (0.3826 => 0.4036, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.48% (0.2831 => 0.2986, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.47% (1.1861 => 1.2510, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.46% (0.3387 => 0.3572, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.42% (7.9617 => 8.3935, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 5.41% (0.4048 => 0.4267, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.37% (1.0722 => 1.1298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.32% (0.4620 => 0.4866, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.31% (1.5603 => 1.6431, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.31% (0.4203 => 0.4426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3865 => 0.4070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3283 => 0.3455, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.3232 => 0.3401, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.21% (0.3935 => 0.4140, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2871 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.19% (0.3162 => 0.3326, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.18% (2.0273 => 2.1323, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 5.16% (0.3098 => 0.3258, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.11% (2.0665 => 2.1722, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.08% (0.2872 => 0.3018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.08% (0.3052 => 0.3207, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4299 => 0.4517, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3603 => 0.3784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.93% (0.2802 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2877 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.83% (0.3684 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.6450 => 0.6757, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 4.68% (2.2969 => 2.4043, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.64% (0.8921 => 0.9335, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.46% (0.5981 => 0.6248, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.28% (1.5859 => 1.6537, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.04% (1.4186 => 1.4759, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (14.3668 => 14.9262, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.69% (2.2024 => 2.2837, std.dev.: 0.0159) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2842 => 1.3290, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.39% (0.3131 => 0.3237, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.8101 => 0.8331, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4723, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.8922 => 3.9482, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2159, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7674, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.32% (4.2280 => 4.3682, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2121, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 1.01% (3.7781 => 3.8164, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2554, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.96% (5.3855 => 3.9334, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.57% (5.3526 => 3.9303, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1837, std.dev.: 0.0426) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.01% (2.9384 => 2.6149, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -8.02% (22.1758 => 20.3984, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -11.86% (1.2373 => 1.0905, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/mandel-2: -10.49% (1.5373 => 1.3760, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3013, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7102, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5024, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5970, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.58% (3.2827 => 3.1652, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4953, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5164, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0959, std.dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2544, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0137, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0189) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.08% (0.5229 => 0.5756, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.40% (14.9895 => 15.9492, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 5.25% (14.1553 => 14.8980, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 5.59% (4.1105 => 4.3404, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.07% (1.1048 => 1.2271, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.00% (7.1582 => 7.5162, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.84% (3.4629 => 3.6999, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.6222 => 0.6474, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 14:54:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 16:54:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120930215424.CF1EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4429?compare_to=4425&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4429, Order: 164919, Start Time: 2012-09-30 20:30:21, End Time: 2012-09-30 21:56:02 To: 4425, Order: 164918, Start Time: 2012-09-30 18:12:07, End Time: 2012-09-30 19:37:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7524 => 2.7524, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.30% (4.9601 => 4.9748, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.46% (2.0176 => 2.4305, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.72% (0.3899 => 0.4317, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 10.55% (0.5818 => 0.6432, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.51% (0.7061 => 0.7803, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.39% (0.5748 => 0.6345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.26% (0.4328 => 0.4772, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.21% (3.9660 => 4.3709, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 10.12% (0.7038 => 0.7750, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 10.07% (0.4062 => 0.4471, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 9.79% (1.3693 => 1.5033, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.73% (0.6959 => 0.7636, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.63% (0.2721 => 0.2983, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 9.56% (0.2781 => 0.3047, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.53% (0.7710 => 0.8445, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.53% (0.3022 => 0.3310, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.47% (1.2193 => 1.3348, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.42% (0.6283 => 0.6875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.38% (0.9199 => 1.0062, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.30% (1.4563 => 1.5917, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2782 => 0.3040, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.26% (1.1364 => 1.2416, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.12% (0.3485 => 0.3803, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.12% (13.8202 => 15.0806, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.10% (0.4791 => 0.5227, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 8.90% (0.2607 => 0.2839, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.85% (0.3580 => 0.3897, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.85% (1.9828 => 2.1582, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.84% (0.5577 => 0.6070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 8.84% (0.2761 => 0.3005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.83% (0.3489 => 0.3797, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 8.82% (0.2937 => 0.3196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.81% (0.2655 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.80% (0.2966 => 0.3227, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.77% (0.2760 => 0.3002, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.75% (0.2628 => 0.2858, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.75% (0.4390 => 0.4774, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.75% (0.3293 => 0.3581, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 8.74% (0.2690 => 0.2925, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.73% (0.3756 => 0.4084, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2765 => 0.3004, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.62% (0.2726 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.62% (0.4016 => 0.4362, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.58% (0.2995 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.55% (1.0313 => 1.1195, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 8.51% (0.3868 => 0.4197, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.46% (0.3107 => 0.3370, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.3149 => 0.3415, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.42% (0.2696 => 0.2923, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.35% (0.3246 => 0.3517, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.2988 => 0.3237, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.17% (0.3453 => 0.3735, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 8.15% (0.3192 => 0.3452, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.06% (0.3534 => 0.3819, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.97% (3.8646 => 4.1726, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: 7.94% (0.8310 => 0.8970, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.92% (0.4379 => 0.4726, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 7.92% (1.1061 => 1.1937, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 7.90% (16.6129 => 17.9260, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.86% (0.6576 => 0.7093, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3601 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.70% (0.3663 => 0.3945, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.67% (0.7506 => 0.8082, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.67% (0.3650 => 0.3930, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.65% (3.6692 => 3.9498, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3623 => 0.3900, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.64% (0.2945 => 0.3170, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.62% (0.6744 => 0.7258, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 7.61% (0.3220 => 0.3465, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.59% (0.5637 => 0.6065, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.59% (0.3940 => 0.4239, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.46% (7.2180 => 7.7563, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.39% (0.7460 => 0.8011, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 7.38% (2.1791 => 2.3399, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 7.36% (0.2243 => 0.2408, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.35% (3.1889 => 3.4234, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 7.31% (1.0594 => 1.1368, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 7.24% (1.9270 => 2.0665, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.19% (0.3755 => 0.4025, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.15% (0.8698 => 0.9320, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.99% (1.3245 => 1.4171, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.81% (0.4113 => 0.4393, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.3813 => 1.4750, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 6.77% (0.1478 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (1.3819 => 1.4747, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.65% (14.8535 => 15.8416, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (8.4961 => 9.0597, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 6.60% (1.2749 => 1.3590, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.48% (4.6629 => 4.9649, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.47% (4.3801 => 4.6634, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.44% (4.4433 => 4.7295, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2059, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.40% (0.8818 => 0.9382, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.28% (0.6135 => 0.6520, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 6.20% (0.3131 => 0.3325, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.16% (0.2859 => 0.3035, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (3.2742 => 3.4728, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 6.03% (14.5298 => 15.4060, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (13.2842 => 14.0689, std.dev.: 0.0241) MultiSource/Applications/hexxagon/hexxagon: 5.88% (1.2292 => 1.3015, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.83% (0.2504 => 0.2650, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.83% (0.1819 => 0.1925, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.78% (0.3511 => 0.3714, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.78% (6.5754 => 6.9552, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.57% (0.6250 => 0.6598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.50% (4.9865 => 5.2609, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.29% (0.4805 => 0.5059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.27% (0.3245 => 0.3416, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.07% (0.9108 => 0.9570, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5188 => 1.5956, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 4.76% (3.7467 => 3.9250, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.51% (2.1007 => 2.1955, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (6.2785 => 6.5553, std.dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: 3.93% (33.2944 => 34.6028, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 2.70% (16.2614 => 16.7009, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.01% (10.7476 => 11.0716, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5965, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5158, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5824, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1889, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2233, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5900, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.40% (0.4657 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.77% (22.5627 => 21.9377, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.41% (1.2308 => 1.0904, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2621, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3019, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0214) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9308, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7051, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2499, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1254, std.dev.: 0.0609) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2402, std.dev.: 0.0341) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 16:21:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 18:21:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120930232130.D0C0B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4430?compare_to=4426&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4430, Order: 164924, Start Time: 2012-09-30 22:00:34, End Time: 2012-09-30 23:23:08 To: 4426, Order: 164919, Start Time: 2012-09-30 20:17:32, End Time: 2012-09-30 21:41:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 8 (74 on baseline) Performance Improvements: 8 (40 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 957 (777 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 11.55% (0.1359 => 0.1516, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 9.70% (0.1031 => 0.1131, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.8905 => 0.9143, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 1.41% (3.9023 => 3.9574, std.dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 6.37% (1.2529 => 1.3327, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.31% (0.7606 => 0.7934, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.72% (11.5479 => 11.7465, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: 1.29% (2.3672 => 2.3978, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.47% (0.8577 => 0.8365, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.01% (0.8675 => 0.8501, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -7.67% (1.4975 => 1.3826, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/mandel-2: -4.02% (3.1568 => 3.0299, std.dev.: 0.0430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.83% (43.5674 => 42.7701, std.dev.: 0.1838) MultiSource/Applications/minisat/minisat: -1.35% (6.2591 => 6.1749, std.dev.: 0.0304) SingleSource/Benchmarks/McGill/chomp: -1.33% (1.0208 => 1.0072, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: -1.30% (2.0264 => 2.0001, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.01% (0.9978 => 0.9979, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: -0.46% (0.6109 => 0.6081, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -1.30% (0.1614 => 0.1593, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.89% (0.1516 => 0.1575, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.85% (0.3066 => 0.3092, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.91% (0.2309 => 0.2353, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.95% (0.3174 => 0.3204, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2296 => 0.2300, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 1.30% (0.0386 => 0.0391, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: 1.14% (0.0088 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -3.26% (0.0092 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.61% (0.0227 => 0.0242, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0191 => 0.0190, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.56% (0.0326 => 0.0380, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.01% (0.0299 => 0.0293, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.42% (0.0282 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 30.15% (0.0136 => 0.0177) SingleSource/UnitTests/Vector/Altivec/test1: 11.98% (0.0167 => 0.0187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0250 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -7.12% (0.0309 => 0.0287, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.40% (0.1427 => 0.1447, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -0.46% (1.5233 => 1.5163, std.dev.: 0.0156) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.28% (0.1462 => 0.1510, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.74% (0.4069 => 0.4039, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.77% (0.1462 => 0.1363, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.66% (0.0609 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.39% (0.0237 => 0.0210, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.61% (0.0646 => 0.0571, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1245 => 1.1285, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.41% (0.0566 => 0.0558, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.49% (0.0206 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.12% (0.7666 => 0.7657, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.28% (1.6017 => 1.5972, std.dev.: 0.0102) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.47% (4.1772 => 3.0299, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/except: 81966.67% (0.0006 => 0.4924, std.dev.: 0.0206) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.89% (0.0745 => 0.0923, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.40% (0.1159 => 0.1268, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.78% (0.5309 => 0.5722, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 7.28% (2.1763 => 2.3347, std.dev.: 0.0439) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.74% (0.6410 => 0.6842, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 6.35% (0.6173 => 0.6565, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (1.1653 => 1.2376, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 5.58% (1.0046 => 1.0607, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.30% (0.7639 => 0.8044, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.18% (0.6915 => 0.7273, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.02% (1.5150 => 1.5910, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.91% (0.3582 => 0.3758, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.82% (0.3217 => 0.3372, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.66% (0.6069 => 0.6352, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 4.60% (15.3105 => 16.0146, std.dev.: 0.0825) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.43% (0.2797 => 0.2921, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.08% (0.4880 => 0.5079, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.00% (1.1672 => 1.2139, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 3.83% (29.3170 => 30.4395, std.dev.: 0.1207) MultiSource/Applications/d/make_dparser: 3.81% (3.0225 => 3.1378, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.74% (0.4248 => 0.4407, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3901 => 0.4032, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.1827 => 1.2213, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 3.16% (13.3238 => 13.7449, std.dev.: 0.0276) MultiSource/Applications/Burg/burg: 3.11% (1.1440 => 1.1796, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.7226 => 0.7432, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.81% (4.7455 => 4.8787, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 2.71% (2.0972 => 2.1540, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 2.51% (8.2186 => 8.4249, std.dev.: 0.0523) MultiSource/Applications/hbd/hbd: 2.51% (1.3268 => 1.3601, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.50% (1.2021 => 1.2322, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (6.2546 => 6.4013, std.dev.: 0.0553) MultiSource/Applications/lua/lua: 2.27% (3.5980 => 3.6798, std.dev.: 0.0213) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.4908 => 6.6350, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 2.21% (1.0821 => 1.1060, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 2.10% (14.6079 => 14.9151, std.dev.: 0.0725) MultiSource/Applications/treecc/treecc: 2.04% (1.8798 => 1.9181, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8796 => 3.9574, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.92% (0.5937 => 0.6051, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.0317 => 2.0707, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.4189 => 1.4428, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.67% (14.7256 => 14.9720, std.dev.: 0.0794) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2616 => 4.3211, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 44.44% (0.0261 => 0.0377, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 21.89% (3.4629 => 4.2209, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.63% (0.0766 => 0.0924, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 14.78% (1.7426 => 2.0001, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.62% (4.0101 => 4.5563, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1433 => 0.1563, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.96% (7.0025 => 7.6297, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.72% (0.2857 => 0.3106, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.63% (1.0063 => 1.0931, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout/heapsort: 5.91% (3.2159 => 3.4060, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.66% (40.4792 => 42.7701, std.dev.: 0.1838) SingleSource/Benchmarks/Misc/dt: 4.53% (0.9851 => 1.0297, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.37% (15.2242 => 15.8888, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.27% (0.7609 => 0.7934, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.84% (1.2959 => 1.3327, std.dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8932, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/mason/mason: 2.50% (0.5004 => 0.5129, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.49% (3.5520 => 3.6406, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 2.47% (3.8907 => 3.9868, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/whetstone: 2.24% (2.3453 => 2.3978, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.18% (6.6312 => 6.7757, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.01% (2.6656 => 2.7192, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.21% (4.6127 => 4.6686, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.66% (0.3497 => 0.2110, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.97% (5.2665 => 4.1097, std.dev.: 0.0949) SingleSource/Benchmarks/Shootout-C++/ary3: -20.87% (1.7473 => 1.3826, std.dev.: 0.0306) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9599, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.45% (15.8312 => 13.2277, std.dev.: 0.1379) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0478) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.89% (1.4034 => 1.2787, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.45% (3.2007 => 2.9304, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: -7.11% (7.6833 => 7.1369, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3729, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/fibo: -6.57% (4.6355 => 4.3309, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8726, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/richards_benchmark: -6.06% (1.4441 => 1.3566, std.dev.: 0.0237) MultiSource/Applications/SIBsim4/SIBsim4: -6.04% (3.4230 => 3.2162, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/distray/distray: -5.67% (0.2664 => 0.2513, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9235, std.dev.: 0.1118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -5.45% (4.4195 => 4.1786, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -4.22% (2.5166 => 2.4103, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: -4.22% (0.3746 => 0.3588, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.60% (45.4683 => 43.8323, std.dev.: 0.5823) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (9.2503 => 8.9318, std.dev.: 0.0410) MultiSource/Applications/lua/lua: -2.80% (29.5232 => 28.6980, std.dev.: 0.1032) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.73% (0.4140 => 0.4027, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -2.49% (6.7458 => 6.5777, std.dev.: 0.0593) MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (92.7467 => 90.5689, std.dev.: 0.3769) SingleSource/Benchmarks/Shootout-C++/hash2: -2.12% (3.4876 => 3.4137, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -2.04% (3.4286 => 3.3586, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.01% (1.1683 => 1.1448, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: -1.74% (3.4659 => 3.4056, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2401, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3136, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.37% (27.1724 => 26.8000, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4645, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: -1.20% (1.0194 => 1.0072, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.01% (0.9980 => 0.9979, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 0.98% (0.6022 => 0.6081, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -4.38% (0.1666 => 0.1593, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.35% (0.1554 => 0.1575, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3083 => 0.3092, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.71% (0.2394 => 0.2353, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.91% (0.3175 => 0.3204, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.09% (0.2302 => 0.2300, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -12.92% (0.0449 => 0.0391, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.56% (0.0390 => 0.0380, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.66% (0.0301 => 0.0293, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177) SingleSource/UnitTests/Vector/Altivec/test1: -1.06% (0.0189 => 0.0187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -11.69% (0.0325 => 0.0287, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1429 => 0.1447, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 0.96% (1.5019 => 1.5163, std.dev.: 0.0156) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.60% (0.1501 => 0.1510, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.28% (0.4264 => 0.4039, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1344 => 0.1363, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.64% (0.0639 => 0.0571, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1350 => 1.1285, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.40% (0.0637 => 0.0558, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.85% (0.0246 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 3.96% (1.5363 => 1.5972, std.dev.: 0.0102) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 16:38:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 18:38:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120930233841.429EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4431?compare_to=4428&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4431, Order: 164924, Start Time: 2012-09-30 22:19:49, End Time: 2012-09-30 23:40:19 To: 4428, Order: 164919, Start Time: 2012-09-30 20:30:21, End Time: 2012-09-30 21:50:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (146 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (704 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.6705 => 56.4509, std.dev.: 0.1080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.35% (0.8814 => 0.8695, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (14.9702 => 14.8001, std.dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5756 => 0.5757, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 0.17% (15.9492 => 15.9757, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: -0.36% (14.8980 => 14.8438, std.dev.: 0.0129) MultiSource/Benchmarks/Bullet/bullet: -0.55% (84.0829 => 83.6223, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: -0.29% (4.3404 => 4.3277, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0457 => 0.0457) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0459 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.24% (0.0424 => 0.0423) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.64% (0.0453 => 0.0432, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0402 => 0.0402) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0405 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0402 => 0.0401, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0403 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0410 => 0.0410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2271 => 1.2269, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (7.5162 => 7.5019, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.19% (3.6999 => 3.7071, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.40% (0.6474 => 0.6448, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.55% (0.0685 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.22% (63.2438 => 83.6223, std.dev.: 0.0223) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.19% (0.0720 => 10.3199, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 42.76% (10.3673 => 14.8001, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 29.41% (0.1622 => 0.2099, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.49% (2.2022 => 2.5212, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (7.0540 => 8.0480, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.88% (1.1194 => 1.2636, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.55% (1.7609 => 1.9643, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 10.16% (0.3473 => 0.3826, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.91% (0.3543 => 0.3894, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.79% (0.1584 => 0.1739, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.69% (0.3282 => 0.3600, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.43% (0.3828 => 0.4189, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.42% (0.3927 => 0.4297, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.24% (0.3886 => 0.4245, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 9.10% (10.4361 => 11.3853, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.06% (0.3177 => 0.3433, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.86% (9.4845 => 10.2302, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: 7.64% (0.1440 => 0.1550, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.58% (0.1438 => 0.1547, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5925 => 0.6368, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.43% (0.7115 => 0.7644, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.37% (0.6675 => 0.7167, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.33% (0.6030 => 0.6472, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.27% (5.7591 => 6.1778, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2700 => 0.2891, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7433 => 0.7957, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.5105 => 0.5463, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 6.98% (0.3109 => 0.3326, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.84% (0.5860 => 0.6261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 6.81% (3.3354 => 3.5625, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4615 => 0.4927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.70% (0.7326 => 0.7817, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2271 => 0.2420, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.53% (1.3050 => 1.3902, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3423 => 0.3645, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.46% (1.5415 => 1.6411, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.40% (0.8172 => 0.8695, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.35% (5.0018 => 5.3193, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.30% (8.1363 => 8.6490, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.9449 => 5.2558, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 6.27% (0.7835 => 0.8326, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.20% (4.2646 => 4.5290, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.5569 => 0.5913, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.8067 => 0.8562, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2107 => 0.2233, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.96% (0.3422 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.95% (0.2758 => 0.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.90% (0.5020 => 0.5316, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 5.89% (0.3092 => 0.3274, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (0.3121 => 0.3304, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.78% (0.4636 => 0.4904, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 5.69% (3.8723 => 4.0926, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.65% (0.4103 => 0.4335, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (7.9617 => 8.4115, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.63% (21.9371 => 23.1724, std.dev.: 0.0205) SingleSource/Regression/C++/ofstream_ctor: 5.58% (0.2905 => 0.3067, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.9765 => 1.0308, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.52% (0.3387 => 0.3574, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.52% (1.5603 => 1.6464, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 5.51% (0.6456 => 0.6812, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (0.4064 => 0.4288, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.49% (1.1642 => 1.2281, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.47% (0.2891 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.41% (0.4289 => 0.4521, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 5.40% (1.0722 => 1.1301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.37% (0.2831 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.36% (0.3865 => 0.4072, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.32% (0.3650 => 0.3844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.26% (0.4203 => 0.4424, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.25% (0.3162 => 0.3328, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.3136 => 0.3300, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1861 => 1.2478, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.18% (0.3826 => 0.4024, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.17% (0.4620 => 0.4859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.17% (0.3232 => 0.3399, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.14% (0.4299 => 0.4520, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.12% (0.3283 => 0.3451, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 5.11% (0.4048 => 0.4255, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.06% (0.3441 => 0.3615, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 5.05% (0.3603 => 0.3785, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.05% (2.0273 => 2.1297, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2756 => 0.2895, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.3052 => 0.3205, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (2.0665 => 2.1699, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 5.00% (0.3098 => 0.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.98% (0.2871 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.94% (0.2877 => 0.3019, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2872 => 0.3013, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3935 => 0.4127, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.87% (0.2793 => 0.2929, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.82% (0.2802 => 0.2937, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.81% (0.6450 => 0.6760, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.80% (0.3684 => 0.3861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3379 => 0.3541, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.70% (0.8921 => 0.9340, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 4.56% (2.2969 => 2.4016, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (1.5859 => 1.6572, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5981 => 0.6247, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (1.4186 => 1.4762, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.93% (2.2024 => 2.2890, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (14.3668 => 14.9250, std.dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 3.85% (1.1840 => 1.2296, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2842 => 1.3277, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.26% (0.3131 => 0.3233, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.69% (0.8101 => 0.8319, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.8922 => 3.9585, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4667, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4511, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.1396 => 1.2156, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7750, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3525, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7992, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2154, std.dev.: 0.0265) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2588, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.54% (5.3855 => 3.9024, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.13% (5.3526 => 3.9003, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1612, std.dev.: 0.0587) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.99% (2.9384 => 2.6154, std.dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: -8.11% (22.1758 => 20.3777, std.dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3011, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7114, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5962, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4963, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5140, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0907, std.dev.: 0.0268) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0121, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2530, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5089, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2299, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.10% (0.5229 => 0.5757, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 6.58% (14.9895 => 15.9757, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 4.86% (14.1553 => 14.8438, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 5.28% (4.1105 => 4.3277, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.05% (1.1048 => 1.2269, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.80% (7.1582 => 7.5019, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.05% (3.4629 => 3.7071, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.63% (0.6222 => 0.6448, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 18:24:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 20:24:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121001012434.274CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4432?compare_to=4427&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4432, Order: 164924, Start Time: 2012-09-30 22:16:18, End Time: 2012-10-01 01:26:11 To: 4427, Order: 164918, Start Time: 2012-09-30 18:37:24, End Time: 2012-09-30 21:47:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (127 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.01% (2.5193 => 2.4938, std.dev.: 0.0079) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.03% (9.8103 => 9.8075, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (9.4109 => 9.4096, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.04% (16.9645 => 16.9578, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.93% (0.3446 => 0.3857, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3465 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.75% (0.3488 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.70% (0.3496 => 0.3905, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.65% (0.3442 => 0.3843, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.34% (0.3650 => 0.4064, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 11.25% (0.3643 => 0.4053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.35% (0.1063 => 0.1173, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.99% (1.5932 => 1.7523, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5826 => 0.6294, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.00% (0.5889 => 0.6360, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.41% (0.4994 => 0.5364, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.29% (0.3004 => 0.3223, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.1619 => 0.1737, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.20% (0.2875 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2738 => 0.2933, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.10% (1.3152 => 1.4086, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.90% (0.5026 => 0.5373, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.74% (0.4361 => 0.4655, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.71% (0.1505 => 0.1606, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.70% (1.6211 => 1.7297, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 6.68% (0.7171 => 0.7650, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.67% (0.3195 => 0.3408, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.62% (0.9909 => 1.0565, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2803 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2729 => 0.2909, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.58% (0.2736 => 0.2916, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 6.56% (0.3096 => 0.3299, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.2823 => 0.3008, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.54% (0.5000 => 0.5327, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.50% (5.5417 => 5.9019, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (2.0673 => 2.2012, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2813 => 0.2994, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.41% (3.5627 => 3.7911, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.38% (0.2792 => 0.2970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.37% (0.2780 => 0.2957, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.36% (1.0781 => 1.1467, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.36% (0.2911 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.29% (0.3258 => 0.3463, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3267 => 0.3471, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.24% (0.3124 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2811 => 0.2986, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.22% (0.4146 => 0.4404, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.18% (0.3060 => 0.3249, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.15% (0.3317 => 0.3521, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.12% (0.3348 => 0.3553, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 6.11% (4.2109 => 4.4680, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.09% (0.3282 => 0.3482, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.09% (2.7292 => 2.8953, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.07% (0.3362 => 0.3566, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3625 => 0.3841, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.96% (0.3726 => 0.3948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3678 => 0.3897, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.93% (0.5900 => 0.6250, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 5.84% (0.3477 => 0.3680, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 5.84% (23.5202 => 24.8931, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (0.3930 => 0.4156, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.72% (0.3690 => 0.3901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.72% (0.4251 => 0.4494, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.68% (0.6634 => 0.7011, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 5.65% (1.8794 => 1.9856, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (4.4195 => 4.6682, std.dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 5.49% (0.2566 => 0.2707, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.3981 => 0.4198, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.3084 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.32% (0.3890 => 0.4097, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.3845 => 0.4049, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.4139 => 0.4358, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.27% (0.2866 => 0.3017, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.27% (0.6435 => 0.6774, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.26% (0.4029 => 0.4241, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 5.23% (4.6177 => 4.8592, std.dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: 5.23% (2.1013 => 2.2111, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.22% (0.2068 => 0.2176, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.18% (0.3903 => 0.4105, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2737 => 0.2878, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 5.14% (1.4269 => 1.5003, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 5.13% (0.5012 => 0.5269, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (2.1653 => 2.2761, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (1.9966 => 2.0973, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.96% (0.4658 => 0.4889, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 4.86% (0.3336 => 0.3498, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 4.81% (0.5546 => 0.5813, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.73% (1.9694 => 2.0625, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.65% (0.3271 => 0.3423, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.41% (0.7875 => 0.8222, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.36% (0.9697 => 1.0120, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.35% (2.0346 => 2.1231, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.2969 => 0.3097, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (0.4847 => 0.5049, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.01% (0.7426 => 0.7724, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (0.5361 => 0.5568, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (0.2691 => 0.2792, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.59% (11.6398 => 12.0580, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.41% (0.4253 => 0.4398, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.6926 => 4.8516, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.3498 => 0.3614, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.87% (11.9555 => 12.1785, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.33% (0.5917 => 0.6706, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6085, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6795, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8979, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std.dev.: 0.1182) SingleSource/Benchmarks/Dhrystone/dry: 4.08% (14.0481 => 14.6209, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1952, std.dev.: 0.0447) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5063, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (41.7953 => 42.5245, std.dev.: 0.0548) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5835, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5499, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary2: -9.78% (0.2402 => 0.2167, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7962, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: -3.24% (17.2379 => 16.6801, std.dev.: 0.0919) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 20:39:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 22:39:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001033934.61AE62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4433?compare_to=4430&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4433, Order: 164925, Start Time: 2012-10-01 02:18:10, End Time: 2012-10-01 03:40:55 To: 4430, Order: 164924, Start Time: 2012-09-30 22:00:34, End Time: 2012-09-30 23:23:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (69 on baseline) Performance Improvements: 3 (43 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 967 (779 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 15.69% (0.7659 => 0.8861, std.dev.: 0.0423) SingleSource/Benchmarks/Misc/fbench: 1.19% (3.4056 => 3.4460, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.10% (1.3912 => 1.4065, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.27% (0.8044 => 0.7942, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -11.13% (3.4060 => 3.0268, std.dev.: 0.1286) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.25% (3.6924 => 3.6464, std.dev.: 0.0163) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.13% (0.9979 => 1.0092, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 0.54% (0.6081 => 0.6114, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.15% (0.1593 => 0.1675, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1575 => 0.1570, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (0.3092 => 0.3082, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.10% (0.2353 => 0.2327, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.56% (0.3204 => 0.3154, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.00% (0.2300 => 0.2277, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 15.86% (0.0391 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -12.36% (0.0089 => 0.0078, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -10.11% (0.0089 => 0.0080, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.24% (0.0242 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.16% (0.0380 => 0.0368, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.68% (0.0293 => 0.0291, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.72% (0.0278 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0320 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -38.50% (0.0187 => 0.0115, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0251 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 14.63% (0.0287 => 0.0329, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.48% (0.1447 => 0.1440, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -1.30% (1.5163 => 1.4966, std.dev.: 0.0312) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1510 => 0.1512, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4039 => 0.4068, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.51% (0.1363 => 0.1356, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0613 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.24% (0.0210 => 0.0178, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.28% (0.0571 => 0.0558, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1285 => 1.1286, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.0558 => 0.0609, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.64% (0.0207 => 0.0156, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7657 => 0.7656, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.21% (1.5972 => 1.6006, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -66.94% (0.0121 => 0.0040, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.84% (4.1772 => 3.0560, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/except: 82116.67% (0.0006 => 0.4933, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.00% (2.1763 => 2.3503, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.19% (0.6410 => 0.6871, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 7.16% (0.5309 => 0.5689, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 6.43% (0.6173 => 0.6570, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (1.1653 => 1.2350, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 5.86% (1.0046 => 1.0635, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.44% (0.3582 => 0.3777, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.5150 => 1.5874, std.dev.: 0.0149) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.6915 => 0.7241, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.68% (0.6069 => 0.6353, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 4.55% (15.3105 => 16.0069, std.dev.: 0.1901) MultiSource/Benchmarks/Bullet/bullet: 4.32% (29.3170 => 30.5831, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.14% (0.4880 => 0.5082, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.97% (0.7639 => 0.7942, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.60% (0.4248 => 0.4401, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.58% (3.0225 => 3.1306, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.23% (0.3901 => 0.4027, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.21% (1.1440 => 1.1807, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.09% (1.1827 => 1.2192, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.98% (4.7455 => 4.8867, std.dev.: 0.0344) MultiSource/Applications/SPASS/SPASS: 2.96% (13.3238 => 13.7188, std.dev.: 0.0541) MultiSource/Applications/siod/siod: 2.65% (2.0972 => 2.1528, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.0758 => 3.1558, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 2.52% (8.2186 => 8.4256, std.dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.4908 => 6.6538, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8405 => 0.8608, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 2.24% (14.6079 => 14.9345, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.14% (1.4408 => 1.4717, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.12% (0.5937 => 0.6063, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.10% (0.8569 => 0.8749, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.7256 => 15.0338, std.dev.: 0.0556) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.0317 => 2.0732, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 1.97% (3.5980 => 3.6690, std.dev.: 0.0269) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.96% (1.0689 => 1.0899, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: 1.82% (1.8798 => 1.9141, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5520 => 0.5620, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.75% (4.2616 => 4.3361, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.5963 => 0.6065, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.4189 => 1.4420, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7784 => 0.7897, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.25% (1.2742 => 1.2901, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.15% (0.0766 => 0.0905, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9963, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (4.0101 => 4.5400, std.dev.: 0.0253) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.56% (0.2857 => 0.3130, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6098, std.dev.: 0.0132) SingleSource/Benchmarks/Stanford/Puzzle: 8.44% (0.1433 => 0.1554, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.42% (1.0063 => 1.0910, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (0.3301 => 0.3519, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.25% (40.4792 => 43.0095, std.dev.: 0.3568) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.51% (0.7609 => 0.7952, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7901, std.dev.: 0.0300) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.85% (14.4877 => 14.9012, std.dev.: 0.0390) MultiSource/Benchmarks/sim/sim: 2.66% (3.8907 => 3.9942, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.16% (6.6312 => 6.7743, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.13% (3.5520 => 3.6278, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.87% (2.6656 => 2.7154, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (2.4013 => 2.4433, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.6127 => 4.6792, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.98% (0.3497 => 0.2064, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.84% (5.2665 => 4.1163, std.dev.: 0.1122) SingleSource/Benchmarks/Shootout-C++/ary3: -20.62% (1.7473 => 1.3870, std.dev.: 0.1179) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.28% (1.1647 => 0.9634, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.85% (15.8312 => 13.1630, std.dev.: 0.1963) SingleSource/Benchmarks/Shootout/sieve: -12.35% (8.1594 => 7.1520, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.96% (1.4034 => 1.2777, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.30% (3.2007 => 2.9350, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -7.41% (2.0027 => 1.8543, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: -7.20% (7.6833 => 7.1304, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.95% (3.6254 => 3.3733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (4.6355 => 4.3250, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.22% (2.9728 => 2.7879, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: -6.15% (3.4230 => 3.2125, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/richards_benchmark: -6.14% (1.4441 => 1.3554, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (62.4126 => 58.9154, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.50% (1.4021 => 1.3250, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.61% (0.4140 => 0.3949, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -4.56% (0.3746 => 0.3575, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -4.23% (2.5166 => 2.4102, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.98% (1.2722 => 1.2216, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/misr: -3.45% (0.4296 => 0.4148, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.04% (2.4457 => 2.3714, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.93% (45.4683 => 44.1366, std.dev.: 0.4556) SingleSource/Benchmarks/Shootout-C++/methcall: -2.92% (9.2503 => 8.9799, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6464, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2850, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -2.46% (6.7458 => 6.5800, std.dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: -2.27% (92.7467 => 90.6424, std.dev.: 0.1748) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.26% (1.1683 => 1.1419, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -2.12% (29.5232 => 28.8980, std.dev.: 0.1859) SingleSource/Benchmarks/Shootout-C++/hash2: -2.03% (3.4876 => 3.4169, std.dev.: 0.0029) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3616, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2222, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.44% (1.8739 => 1.8470, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/fldry: -1.43% (2.4971 => 2.4614, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3071, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.29% (27.1724 => 26.8223, std.dev.: 0.0182) MultiSource/Benchmarks/llubenchmark/llu: -1.12% (2.0192 => 1.9965, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.12% (0.9980 => 1.0092, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 1.53% (0.6022 => 0.6114, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 0.54% (0.1666 => 0.1675, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.03% (0.1554 => 0.1570, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3083 => 0.3082, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.80% (0.2394 => 0.2327, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.66% (0.3175 => 0.3154, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (0.2302 => 0.2277, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -12.36% (0.0089 => 0.0078, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -11.11% (0.0090 => 0.0080, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.64% (0.0390 => 0.0368, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.32% (0.0301 => 0.0291, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -39.15% (0.0189 => 0.0115, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1429 => 0.1440, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -0.35% (1.5019 => 1.4966, std.dev.: 0.0312) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1501 => 0.1512, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.60% (0.4264 => 0.4068, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.89% (0.1344 => 0.1356, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.28% (0.0232 => 0.0178, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.68% (0.0639 => 0.0558, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1286, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.40% (0.0637 => 0.0609, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.59% (0.0246 => 0.0156, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.52% (0.7541 => 0.7656, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.19% (1.5363 => 1.6006, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.86% (0.0070 => 0.0040, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 20:55:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Sep 2012 22:55:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001035555.CB2642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4434?compare_to=4431&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4434, Order: 164925, Start Time: 2012-10-01 02:30:50, End Time: 2012-10-01 03:51:01 To: 4431, Order: 164924, Start Time: 2012-09-30 22:19:49, End Time: 2012-09-30 23:40:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (143 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 948 (706 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.21% (14.8001 => 15.2756, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.55% (78.1976 => 79.4115, std.dev.: 0.4385) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.50% (0.5757 => 0.5728, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -0.34% (15.9757 => 15.9218, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: -0.12% (14.8438 => 14.8267, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: -0.61% (83.6223 => 83.1106, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.3277 => 4.3261, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0458 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.73% (0.0413 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0414 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0412 => 0.0413) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0402 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0403 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.46% (0.0439 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0401 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0402 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0403 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.18% (1.2269 => 1.2247, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (7.5019 => 7.4919, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.32% (3.7071 => 3.6951, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.02% (0.6448 => 0.6447, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0647 => 0.0650, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.41% (63.2438 => 83.1106, std.dev.: 0.0134) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.83% (0.0720 => 10.3218, std.dev.: 0.0126) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.34% (10.3673 => 15.2756, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 28.36% (0.1622 => 0.2082, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.06% (2.2022 => 2.5119, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.94% (7.0540 => 8.0373, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.76% (1.1194 => 1.2622, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.32% (0.1566 => 0.1759, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.97% (1.7609 => 1.9540, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.83% (0.3927 => 0.4313, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.79% (0.1584 => 0.1739, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.38% (10.4361 => 11.3111, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.4879 => 0.5261, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.67% (0.1655 => 0.1782, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.57% (0.1440 => 0.1549, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.41% (9.4845 => 10.1871, std.dev.: 0.0124) SingleSource/UnitTests/ObjC++/property-reference-object: 7.26% (0.6030 => 0.6468, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.13% (0.6675 => 0.7151, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5925 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.94% (0.7115 => 0.7609, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7433 => 0.7947, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 6.82% (0.3109 => 0.3321, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.79% (5.7591 => 6.1500, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5105 => 0.5450, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.5860 => 0.6248, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.55% (0.1695 => 0.1806, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.2554 => 0.2720, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.45% (3.3354 => 3.5504, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.39% (0.7326 => 0.7794, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2271 => 0.2416, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 6.37% (0.3423 => 0.3641, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.33% (1.3050 => 1.3876, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.30% (1.5415 => 1.6386, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.25% (0.8172 => 0.8683, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (4.2646 => 4.5306, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.20% (0.5569 => 0.5914, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (8.1363 => 8.6338, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.08% (5.0018 => 5.3060, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.05% (4.9449 => 5.2440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.8067 => 0.8547, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.93% (0.3422 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.93% (0.3307 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.84% (0.2758 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.76% (0.4636 => 0.4903, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.74% (0.7835 => 0.8285, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.70% (0.4103 => 0.4337, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1940 => 0.2049, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.52% (1.1642 => 1.2285, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 5.47% (0.6456 => 0.6809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.47% (0.2891 => 0.3049, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9765 => 1.0297, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (0.4064 => 0.4285, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.40% (0.5020 => 0.5291, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4289 => 0.4520, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.37% (0.3387 => 0.3569, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.37% (0.2905 => 0.3061, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.33% (21.9371 => 23.1072, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 5.33% (0.2831 => 0.2982, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (7.9617 => 8.3842, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.23% (0.3650 => 0.3841, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.23% (0.3826 => 0.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.23% (0.3865 => 0.4067, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.21% (1.0722 => 1.1281, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.18% (3.8723 => 4.0730, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.17% (0.3232 => 0.3399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.17% (0.3136 => 0.3298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.15% (0.3283 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.12% (1.1861 => 1.2468, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.11% (2.0665 => 2.1722, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.09% (0.4203 => 0.4417, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.3098 => 0.3255, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2756 => 0.2895, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.02% (1.5603 => 1.6387, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (0.4620 => 0.4852, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.01% (2.0273 => 2.1288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3162 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.97% (0.3684 => 0.3867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.95% (0.3052 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.95% (0.2871 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.92% (0.4048 => 0.4247, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3603 => 0.3780, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.90% (0.2714 => 0.2847, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2872 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.80% (0.3935 => 0.4124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.76% (0.2793 => 0.2926, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.71% (0.3379 => 0.3538, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 4.54% (2.2969 => 2.4012, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.51% (0.6450 => 0.6741, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.41% (0.8921 => 0.9314, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5981 => 0.6240, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.19% (1.5859 => 1.6523, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.4186 => 1.4751, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (14.3668 => 14.9122, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.2024 => 2.2824, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.1840 => 1.2268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.42% (0.3131 => 0.3238, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2842 => 1.3278, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.8101 => 0.8301, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4200, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.26% (3.8922 => 3.9413, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7655, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3475, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (0.9540 => 0.9683, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5838, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2197, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.17% (5.2763 => 3.2622, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.79% (5.3855 => 3.8887, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.28% (5.3526 => 3.8924, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1430, std.dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.07% (2.9384 => 2.6131, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.29% (22.1758 => 20.3366, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -11.51% (1.2373 => 1.0949, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2706, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.60% (1.8329 => 1.7119, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.44% (3.2827 => 3.1698, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5023, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.18% (8.1563 => 7.9781, std.dev.: 0.0231) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4972, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std.dev.: 0.0390) MultiSource/Applications/hexxagon/hexxagon: -1.80% (12.4730 => 12.2487, std.dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5081, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.54% (0.5229 => 0.5728, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.22% (14.9895 => 15.9218, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 4.74% (14.1553 => 14.8267, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 5.25% (4.1105 => 4.3261, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.85% (1.1048 => 1.2247, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.66% (7.1582 => 7.4919, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.71% (3.4629 => 3.6951, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.6222 => 0.6447, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Sep 30 22:38:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 00:38:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121001053844.B0E4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4435?compare_to=4432&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4435, Order: 164925, Start Time: 2012-10-01 02:30:25, End Time: 2012-10-01 05:40:23 To: 4432, Order: 164924, Start Time: 2012-09-30 22:16:18, End Time: 2012-10-01 01:26:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 4 (130 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1035 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.2130 => 0.2260, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (114.2538 => 118.4626, std.dev.: 0.0777) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.26% (73.9711 => 74.9032, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.08% (54.2297 => 54.8127, std.dev.: 0.1140) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8075 => 9.8083, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.02% (9.4096 => 9.4111, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.03% (16.9578 => 16.9530, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3446 => 0.3863, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3496 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 12.00% (0.3442 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.99% (0.3460 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.75% (0.3650 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.56% (0.3643 => 0.4064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3724 => 0.4147, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.53% (1.5932 => 1.7609, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.5889 => 0.6401, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5826 => 0.6329, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.96% (0.2738 => 0.2956, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2875 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.3004 => 0.3222, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 7.20% (0.7171 => 0.7687, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.16% (0.2750 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.15% (0.2729 => 0.2924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.08% (0.2823 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2803 => 0.3000, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.01% (0.3195 => 0.3419, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3096 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.93% (0.2813 => 0.3008, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.92% (2.0673 => 2.2103, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.86% (1.3152 => 1.4054, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3267 => 0.3490, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (0.4361 => 0.4658, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 6.80% (0.9909 => 1.0583, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (0.4994 => 0.5332, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2780 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (1.6211 => 1.7302, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2811 => 0.3000, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.72% (0.3258 => 0.3477, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.2911 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.63% (0.3124 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.61% (0.4146 => 0.4420, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3317 => 0.3536, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.57% (5.5417 => 5.9059, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 6.57% (1.0781 => 1.1489, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.57% (0.3625 => 0.3863, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3362 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.50% (0.3060 => 0.3259, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (3.5627 => 3.7935, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.44% (0.3930 => 0.4183, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.40% (0.5000 => 0.5320, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.40% (0.3282 => 0.3492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.39% (0.3678 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.33% (0.3348 => 0.3560, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 6.30% (0.3477 => 0.3696, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3726 => 0.3960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4251 => 0.4514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3690 => 0.3918, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.12% (2.7292 => 2.8962, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.95% (0.5026 => 0.5325, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.2866 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 5.88% (23.5202 => 24.9028, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.87% (0.4139 => 0.4382, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.85% (0.3981 => 0.4214, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.3845 => 0.4065, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.70% (4.2109 => 4.4511, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.2736 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.57% (0.5012 => 0.5291, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.56% (0.6634 => 0.7003, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (4.4195 => 4.6635, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (0.3890 => 0.4101, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.41% (0.4029 => 0.4247, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.2737 => 0.2885, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.39% (0.6435 => 0.6782, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.39% (1.8794 => 1.9807, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 5.39% (2.1013 => 2.2145, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.37% (0.2068 => 0.2179, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.28% (4.6177 => 4.8615, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.1968 => 0.2071, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.22% (0.5900 => 0.6208, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.3903 => 0.4106, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.14% (0.3271 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.3084 => 0.3240, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (2.1653 => 2.2735, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 4.93% (1.4269 => 1.4972, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 4.92% (0.5546 => 0.5819, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (0.4658 => 0.4881, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 4.71% (0.3336 => 0.3493, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.67% (1.9694 => 2.0614, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.54% (1.9966 => 2.0873, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.2969 => 0.3101, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.44% (0.7875 => 0.8225, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.36% (2.0346 => 2.1234, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.33% (0.4847 => 0.5057, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.31% (0.9697 => 1.0115, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (0.7426 => 0.7733, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (0.5361 => 0.5563, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.64% (0.5584 => 0.5787, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.55% (11.6398 => 12.0525, std.dev.: 0.0241) MultiSource/Applications/lambda-0_1_3/lambda: 3.43% (0.3498 => 0.3618, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.6926 => 4.8486, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.08% (0.4253 => 0.4384, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.87% (0.3792 => 0.3901, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 1.97% (11.9555 => 12.1910, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: 1.14% (2.4764 => 2.5046, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6729, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 5.14% (1.8057 => 1.8986, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.1072) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2053, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6522, std.dev.: 0.0135) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5049, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5930, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5795, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7930, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.72% (17.2379 => 16.7688, std.dev.: 0.0764) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: